AI Dictionary › AI Fundamentals
Explainability (XAI) is an AI system's capacity to make the reasons for its decisions understandable. Deep learning models are inherently "black boxes": billions of numerical parameters produce the output, but no single "why" can be pointed to the way it could with a written rule.
The issue is both technical and regulatory: when AI decides on credit, hiring, healthcare or justice, unexplainability becomes unacceptable. GDPR grants data subjects the right to meaningful information about automated decision logic, and the AI Act imposes transparency requirements proportionate to risk.
Practical approaches: post-hoc techniques that estimate which factors weighed on the decision (SHAP, LIME), intrinsically interpretable models where the stakes require it, and, with LLMs, chain of thought, which makes the reasoning path visible even though it isn't a complete mechanistic explanation.
From our network
AGORÀ Intelligence: Enterprise AI Governance Platform
Govern AI at scale: policies, adoption and measurable results on your data. Built for boards and C-suite.
Visit agora-intelligence.com →From the Agora Intelligence blog
📱 Download the Android app (beta) iOS coming soon
Say what you mean. Get what you need.
Grace Certified, the AI coach that trains and certifies your prompt engineering, by Agora Intelligence.