$ ./guess_the_languageAI & ML
AI & ML · medium · #35

What is the most likely cause of this loss behavior?

step   loss
   1   2.30
   2   5.10
   3  18.70
   4    nan
  1. Learning rate is too high
  2. Batch size is too large
  3. Too much dropout is applied
  4. The model is overfitting
Loss that explodes to NaN right away usually means steps overshoot the minimum; lower the learning rate.
Play AI & ML ▸