Read your A/B test results
Where your test results are, what each metric means, and how to tell whether a version has really won.
Open a test to see Result guidance, Key metrics, the Funnel and the Breakdown. Compare versions on revenue per visitor. Trust a winner only when Result guidance says so.
Open your results
- In Shopify admin, open Apps → Section Store → Bundles or Cart Drawer.
- Click A/B Tests.
- Click View on your test.
- Pick a date range at the top: Today, Yesterday, Last 7d, Last 30d, Last 90d, Last month or your own dates.
What's on the page
- Result guidance: tells you where the test stands and what to do.
- Key metrics: totals for the date range.
- Metrics over time: a daily chart for each version.
- Funnel: Visitors, ATC, Checkout and Purchase. Pick one version or all.
- Breakdown: each version side by side. Badges compare it with Version A.
What the numbers mean
| Metric | Meaning |
|---|---|
| Visitors | People who saw one of the test's versions |
| Paid orders | Orders from those visitors that were paid |
| Conversion rate | Share of visitors who placed a paid order |
| Average order value | Revenue after refunds, divided by paid orders |
| Revenue per visitor | Revenue after refunds, divided by visitors |
| Revenue | Paid-order revenue after refunds |
In a bundle test, orders count only if they hold a product added through that bundle version.
Is there a winner?
We compare each version's revenue per visitor with Version A. We look for a result only after 7 complete active days, with 500 visitors and 20 paid orders on every version.
- "Version B has a statistically reliable revenue per visitor advantage." You have a winner. Its card shows Leading.
- "No version has a reliable revenue per visitor advantage yet." The difference could be chance. Keep the test running, or choose a version yourself.
One good week isn't a win. Wait for Result guidance to say so.
The list of tests shows the same in Best result: Collecting data, Inconclusive or the winning version.
Export your data
Click the ... button at the top of the test, then Export CSV. You get one row per day and version.
How long we keep it
Daily charts, funnel details, breakdowns and CSV exports stay for 12 months. After that, final visitors, orders, revenue and the winner stay on the page.
Related
- Why does my A/B test show no results yet?
- End an A/B test and pick a winner
- How does A/B test traffic split between versions?
Also searched as: ab test results, a/b test results, test results, result guidance, key metrics, revenue per visitor, conversion rate, paid orders, average order value, funnel, breakdown, export csv, statistically reliable, which version won, leading badge
Did this answer your question?