AI Dictionary › Fondamenti AI

Queue

Coda (Queue)

A queue is a structure that holds items waiting to be processed, normally serving them in arrival order: first in, first out (FIFO). In distributed systems the message queue is the buffer that decouples those who produce work from those who consume it, letting each side run at its own pace.

Definition

How it works

A producer places messages in the queue and one or more consumers pick them up and process them when ready. If consumers slow down, the queue grows and absorbs the spike instead of letting the system collapse. Modern message brokers add delivery guarantees, processing acknowledgements and dead letter queues for messages that repeatedly fail.

Applications

In AI, queues govern batched inference requests, training jobs waiting for GPUs, and agent pipelines processing tasks in sequence. Tools like RabbitMQ, Amazon SQS and Apache Kafka orchestrate flows of millions of messages. Outside AI, every printer, call center and online payment system runs on queues.

History & etymology

The word comes from the French queue, an animal's tail, in turn from the Latin cauda. The mathematical study of queues predates computers: in 1909 the Danish engineer Agner Krarup Erlang analyzed waiting times at the Copenhagen telephone exchange, founding queueing theory. In software, message queues became critical infrastructure with IBM MQSeries (1993) and the open source brokers of the 2000s.

How it's used in Grace

Grace's daily gym presents exercises one at a time, in an ordered sequence: the same FIFO principle behind queues. In the professional scenarios on automation you learn to describe asynchronous workflows to an AI using the correct vocabulary.

Related terms

More in Fondamenti AI

Put it into practice

From our network

HSE Genius: AI for Safety Data Sheets

Extract SDS data, H phrases and ECHA compliance checks in seconds, powered by AI.

Visit hsegenius.com →

From the Agora Intelligence blog

More on agora-intelligence.com →

📱 Download the Android app (beta) iOS coming soon

Say what you mean. Get what you need.

Grace Certified, the AI coach that trains and certifies your prompt engineering, by Agora Intelligence.