FP16 - AshokBhat/notes GitHub Wiki

About

  • 16-bit floating-point format: 1-bit sign, 5-bit exponent and 10-bit fraction
  • IEEE half-precision floating-point

Comparison

Hardware support

  • x86_64 CPUs - Intel and AMD - No support
  • Arm CPUs - Yes
  • NVIDIA GPUs - Yes

See also