AI Dictionary › AI Fundamentals

Overfitting

Overfitting is the phenomenon where a machine learning model memorizes its training data instead of learning general patterns. The result: excellent performance on already-seen data, poor performance on new data, like a student who memorizes exercise solutions without understanding the method.

Definition

It is countered with more training data, regularization, validation on held-out data and early stopping. Its opposite is underfitting: a model too simple to capture the real patterns.

Related terms

• Machine Learning
• Training Data
• Fine-tuning
• Deep Learning
• Parameters

More in AI Fundamentals

• LLM (Large Language Model)
• Token
• Context Window
• Temperature
• AI Hallucination
• Fine-tuning
• RAG (Retrieval Augmented Generation)
• Embedding

Put it into practice

• Real scenario: apply this concept with an instant AI verdict.
• Daily gym: short drills to train dictionary concepts.
• Playoff game: challenge other players, elimination-style.

📱 Download the Android app (beta) iOS coming soon

Say what you mean. Get what you need.

Grace Certified, the AI coach that trains and certifies your prompt engineering, by Agora Intelligence.