A/B Testing & Optimization FAQ
Read frequent questions and get answers right away.
26 articles
Written by Lari Lehtonen
Can I schedule tests?
Written by Lari Lehtonen. Updated over a week ago
What do I need to create a test?
Written by Lari Lehtonen. Updated over a week ago
Can I test two segments against each other?
Written by Lari Lehtonen. Updated over a week ago
Can I only include new users to my tests?
Written by Lari Lehtonen. Updated over a week ago
What happens when I end a test?
Written by Lari Lehtonen. Updated over a week ago
Is there a limit to the number of campaign tests I can simultaneously run?
Written by Lari Lehtonen. Updated over a week ago
Does A/B Testing negatively affect SEO?
Written by Lari Lehtonen. Updated over a week ago
What Nosto products can I test?
Written by Lari Lehtonen. Updated over a week ago
Why is my test not significant?
Written by Lari Lehtonen. Updated over a week ago
When shall I analyze the results of my tests?
Written by Lari Lehtonen. Updated over a week ago
How many variations can I set up in a test?
Written by Lari Lehtonen. Updated over a week ago
Can I set up a control group?
Written by Lari Lehtonen. Updated over a week ago
What if my test is not significant?
Written by Lari Lehtonen. Updated over a week ago
Why do you show improvements in form of intervals?
Written by Lari Lehtonen. Updated over a week ago
Can you run tests in other channels than my online store?
Written by Lari Lehtonen. Updated over a week ago
When do you decide when a test is significant?
Written by Lari Lehtonen. Updated over a week ago
Can I optimize multiple sections of my online store at the same time?
Written by Lari Lehtonen. Updated over a week ago
Do you use a Frequentist or a Bayesian statistical approach?
Written by Lari Lehtonen. Updated over a week ago
Do you exclude outliers?
Written by Lari Lehtonen. Updated over a week ago
What different test types and methodologies do you support?
Written by Lari Lehtonen. Updated over a week ago
How do you continuously optimize?
Written by Lari Lehtonen. Updated over a week ago
What Optimization Goals can I choose?
Written by Lari Lehtonen. Updated over a week ago
Can I edit campaigns when they are part of a live test?
Written by Lari Lehtonen. Updated over a week ago
Can I optimize for multiple goals?
Written by Lari Lehtonen. Updated over a week ago
How does the attribution work in A/B testing?
Written by Lari Lehtonen. Updated over a week ago
What is a boxplot?
Written by Lari Lehtonen. Updated over a week ago