bfloat16 vs float16: how two 16-bit formats split their bits
A look at bfloat16 and float16 through their bit layouts, loss scaling, and a small example of low-precision addition.
A look at bfloat16 and float16 through their bit layouts, loss scaling, and a small example of low-precision addition.