Problem Solving › Data Analysis
A/B test ambiguo: vince B ma non sei sicuro · Data Analysis · Advanced
An A/B test on the new checkout has run for 6 days. Variant B converts at 4.4% vs 4.1% for A, a +7% relative lift, with about 3,000 users per group. The PM wants to launch B to everyone now. The p-value is 0.08. A promotion ran mid-test affecting only some users. The signal is promising but not clean. How do you decide whether B truly wins or you risk launching on a noisy result?
Un A/B test sul nuovo checkout gira da 6 giorni. La variante B converte al 4,4% contro il 4,1% di A, un +7% relativo, con circa 3.000 utenti per gruppo. Il product manager vuole lanciare B subito su tutti. Il p-value è 0,08. C'è stata una promozione a metà test che ha toccato solo alcuni utenti. Il segnale è promettente ma non netto. Come decidi se B vince davvero o se rischi di lanciare su un risultato rumoroso?
Read the case, write how you would solve it — in free text, no prompt required — and Grace's AI judges whether your solution actually works: solved or not solved, with a 0-100 score and coaching feedback that points at what is still uncovered without revealing the answer. Your first 5 evaluations each day are free.
It is a advanced-level Data Analysis case based on a real workplace situation. You read the problem, write how you would solve it in free text, and Grace's AI judges whether your solution actually works — or what is still uncovered.
Anyone who wants to train structured problem solving: managers, professionals and candidates preparing for case interviews in Data Analysis. The advanced difficulty makes it a demanding test of real-world judgment.
Yes. The feedback tells you what remains uncovered — without revealing the solution — so you can strengthen your plan and try again. After you solve it, 6 more Data Analysis cases are waiting.
Solving a advanced case earns up to 100 XP on the first successful solution. Failed attempts and repeat solutions earn much less — the reward is for cracking it.
All 150 problem-solving cases → · Prompt training scenarios →
From our network
Kaimaki Web — Websites That Win Customers
Custom websites, web apps and digital marketing for growing businesses.
Visit kaimakiweb.com →From the Agora Intelligence blog
📱 Download the Android app (beta) iOS coming soon
Say what you mean. Get what you need.
Grace Certified — the AI coach that trains and certifies your prompt engineering — by Agora Intelligence.