In order to decide if a split test is significant, you should go to A/B tests page from the menu on the left side. On the right side of each A/B tests under "P-Value" tab, you can see if the results are significant. If it is < 0.05 , your results are significant. It means that we are at least 95% sure, the difference seen is not by a chance, meaning there is real performance difference.

Calculator:
https://vwo.com/ab-split-test-significance-calculator/

  • If conversions are low (200 or less) and calculator says not significant, then our team will have to also look at the data over-time manually.

  • If one campaign performs better for 10 days in a row we can conclude the better performing campaign winner.

***The clients will be notified via email once the results are significant.

Did this answer your question?