AI Dictionary › Fondamenti AI

Latency

Latenza (Latency)

Latency is the time between sending a prompt and receiving the model's response, typically measured as time-to-first-token and total generation time.

Definition

It depends on model size, prompt and response length, server load, and inference optimization. In AI product design, latency is a decisive UX factor: a customer service chatbot must answer in 1-2 seconds, while document analysis can afford 30.

Related terms

• Inference
• Token
• SLM (Small Language Model)
• API
• Token Efficiency

More in Fondamenti AI

• LLM (Large Language Model)
• Token
• Context Window
• Temperature
• AI Hallucination
• Fine-tuning
• RAG (Retrieval Augmented Generation)
• Embedding

Put it into practice

• Real scenario: apply this concept with an instant AI verdict.
• Daily gym: short drills to train dictionary concepts.
• Playoff game: challenge other players, elimination-style.

📱 Download the Android app (beta) iOS coming soon

Say what you mean. Get what you need.

Grace Certified, the AI coach that trains and certifies your prompt engineering, by Agora Intelligence.