AI Dictionary › AI Fundamentals

Inference

Inference is the process through which an already-trained AI model generates a response from an input. Unlike training (the phase in which the model learns from data), inference is the operational phase: the model receives a prompt and produces an output by applying patterns learned during training.

Definition

Every time you write a message to ChatGPT, Gemini, or any other LLM and receive a response, you are using inference.

Related terms

More in AI Fundamentals

Put it into practice

From our network

AGORÀ Intelligence: Enterprise AI Governance Platform

Govern AI at scale: policies, adoption and measurable results on your data. Built for boards and C-suite.

Visit agora-intelligence.com →

From the Agora Intelligence blog

More on agora-intelligence.com →

📱 Download the Android app (beta) iOS coming soon

Say what you mean. Get what you need.

Grace Certified, the AI coach that trains and certifies your prompt engineering, by Agora Intelligence.