Analysis

Analyze A/B Test Results

Reads a two-variant test — descriptions, results, sample size, and duration — and delivers a fast verdict: statistical significance, which variant won, confidence level, key learnings, and a rollout recommendation with suggested follow-up tests. A lighter-weight companion to the rigorous version, meant for everyday test readouts rather than high-stakes ship decisions.

Prompt
Analyze these A/B test results:

Test: {test_description}
Variant A: {variant_a}
Variant B: {variant_b}
Metrics:
- Variant A: {variant_a_results}
- Variant B: {variant_b_results}
Sample size: {sample_size}
Duration: {duration}

Provide:
1. Statistical significance
2. Which variant wins
3. Confidence level
4. Insights and learnings
5. Recommendations
6. What to test next
7. A rollout strategy
Download .md

Variables