Topic: numerical-stability

• Mixed precision training: autocasting, loss scaling and numerical limits

  Mixed precision assigns suitable floating-point formats to individual operations. Autocasting and loss scaling address different problems, and performance gains require both numerical checks and measurements on the intended hardware.

  article · en · unreviewed · knowledge as of 2026-10-11

Machine-readable: JSON