Careers › Research

AI Evaluation Researcher

Full-time · Remote (IT/EU) · Talent pool: opens as we grow

You make the heart of Grace trustworthy: the AI evaluation of prompts. You study, measure and improve how the system scores, fair, consistent, defensible.

What you will do

• Design and evaluate prompt scoring criteria
• Measure consistency, bias and fairness of scoring
• Build test sets and benchmarks
• Improve system prompts and rubrics
• Document the methodology transparently

What we are looking for

• Experience with LLMs, NLP or model evaluation
• Methodological rigor and an experimental mindset
• Comfort with Python and data analysis
• Ability to write clearly and honestly
• Bonus: background in educational assessment or psychometrics

Think you qualify?

For engineering roles the selection is already open: 5 real senior scenarios evaluated by Grace's AI, scored out of 100, retries allowed. Test your skills now →

Interested? Send your CV or LinkedIn profile to [email protected]: when we start hiring, we call first those who stepped forward.

Other positions

• Engineering Manager / Tech Lead
• Senior Full-Stack Engineer
• Senior AI Engineer (LLM & Evaluation)
• Senior Backend Engineer (Laravel)
• Senior Frontend Engineer (React)
• Senior Mobile Engineer (Capacitor)

Say what you mean. Get what you need.

Grace Certified, the AI coach that trains and certifies your prompt engineering, by Agora Intelligence.