Careers › Research

AI Evaluation Researcher

Full-time · Remote (IT/EU) · Talent pool: opens as we grow

You make the heart of Grace trustworthy: the AI evaluation of prompts. You study, measure and improve how the system scores, fair, consistent, defensible.

What you will do

• Design and evaluate prompt scoring criteria
• Measure consistency, bias and fairness of scoring
• Build test sets and benchmarks
• Improve system prompts and rubrics
• Document the methodology transparently

What we are looking for

• Experience with LLMs, NLP or model evaluation
• Methodological rigor and an experimental mindset
• Comfort with Python and data analysis
• Ability to write clearly and honestly
• Bonus: background in educational assessment or psychometrics

Think you qualify?

For engineering roles the selection is already open: 5 real senior scenarios evaluated by Grace's AI, scored out of 100, retries allowed. Test your skills now →

Interested? Send your CV or LinkedIn profile to [email protected]: when we start hiring, we call first those who stepped forward.

Other positions

• Engineering Manager / Tech Lead
• Senior Full-Stack Engineer
• Senior AI Engineer (LLM & Evaluation)
• Senior Backend Engineer (Laravel)
• Senior Frontend Engineer (React)
• Senior Mobile Engineer (Capacitor)

📱 Download the Android app (beta) iOS coming soon

Say what you mean. Get what you need.

Grace Certified, the AI coach that trains and certifies your prompt engineering, by Agora Intelligence.