$ ./guess_the_languageAI & ML
AI & ML · medium · #30

What do these loss curves show?

epoch  train_loss  val_loss
  1      0.90       0.95
  2      0.50       0.60
  3      0.30       0.55
  4      0.15       0.62
  5      0.08       0.75
  1. Overfitting after about epoch 3
  2. Underfitting through all epochs
  3. A learning rate far too low
  4. Training has fully converged
Training loss keeps falling while validation loss rises after epoch 3: the model is memorizing the training set.
Play AI & ML ▸