AI Dictionary › AI Fundamentals

Feature importance

Feature importance (Importanza delle caratteristiche)

Feature importance is a measure that quantifies how much each input variable contributes to a machine learning model's predictions, making it possible to understand which characteristics truly drive the decision and which are nearly irrelevant. It is one of the main tools for opening, at least partially, a model's black box and understanding what is actually steering its results.

Definition

How it works

There are different methods for calculating it, with varying degrees of rigor. In tree-based models, like random forest and gradient boosting, importance is naturally estimated by observing how much each feature contributes, on average across all trees, to reducing error when used for a split. A more general method, applicable to any model, is permutation importance, which randomly shuffles the values of one feature at a time and measures how much performance worsens: if shuffling a variable severely hurts the model, that variable was important. More recent techniques such as SHAP values, based on game theory, allow a precise and consistent contribution to be attributed to each feature for every individual prediction, not just on average across the whole dataset.

Applications

It is a valuable tool both during development, to understand whether the model is relying on sensible signals or on unwanted artifacts in the data, and in production, to explain decisions to those who receive them: why a loan application was rejected, which factors carry the most weight in an assisted diagnosis, which signals triggered a fraud alert. In many regulated sectors, such as finance and insurance, providing this kind of explanation is not just good practice but often a regulatory requirement.

History & etymology

The concept of attributing relative weight to a statistical model's variables is as old as regression itself, but feature importance as a systematic model interpretation tool developed alongside the spread of complex algorithms like random forest, starting in the early 2000s, and was further enriched by the growth of the explainability, or XAI, field starting in the second half of the 2010s, when the need to explain increasingly opaque models became central both for technical reasons and growing regulatory requirements.

Related terms

• Decision tree
• Random forest
• Explainability (XAI)
• Feature selection
• Gradient boosting

More in AI Fundamentals

• LLM (Large Language Model)
• Token
• Context Window
• Temperature
• AI Hallucination
• Fine-tuning
• RAG (Retrieval Augmented Generation)
• Embedding

Put it into practice

• Real scenario: apply this concept with an instant AI verdict.
• Daily gym: short drills to train dictionary concepts.
• Playoff game: challenge other players, elimination-style.

📱 Download the Android app (beta) iOS coming soon

Say what you mean. Get what you need.

Grace Certified, the AI coach that trains and certifies your prompt engineering, by Agora Intelligence.