Product,Marketing High ROISkill: Intermediate Sprint
Analyze A/B testing results for product
Make data-driven product decisions from A/B test results
$01//
Expected Impact
Rigorous A/B analysis improves product decisions by 40% and prevents false conclusions that waste development resources.
$02//
Recommended Models
Anthropic: Claude Sonnet 4.5OpenAI: GPT-5.2
$03//
Inputs Required
Test HypothesisVariantsResults DataSample SizeDuration
$04//
Prompt Template
Copy and customize for your context
I need to analyze A/B testing results for our product.
Test data: [TEST_DATA: control vs. variant metrics]
Sample sizes: [SAMPLE_SIZES: users per group]
Test duration: [TEST_DURATION: how long the test ran]
Success metrics: [SUCCESS_METRICS: what we're measuring]
You are a product analytics and experimentation expert. Help me interpret these results and make a decision.
CONSTRAINTS:
- Consider statistical significance
- Look beyond the primary metric
- Account for segment differences
- Consider practical significance, not just statistical
DELIVERABLES:
- Results summary with statistical analysis
- Segment-level breakdown if relevant
- Recommendation with confidence level
- Follow-up test suggestions if inconclusive
$05//
Implementation Tips
1
Provide test design and statistical context so AI can interpret results correctly
2
Ask for statistical significance assessment and confidence levels
3
Request actionable recommendations: "based on these results, what should we do next?"
For:
Product ManagerGrowth ManagerData AnalystUX Researcher
Industries:
TechnologySaaSE-commerceDigital Products
Best with a Custom GPT for repeated use
