A/B Testing & Optimization FAQ

Can I schedule tests?

Written by Lari Lehtonen
Updated over a week ago

What do I need to create a test?

Written by Lari Lehtonen
Updated over a week ago

Can I test two segments against each other?

Written by Lari Lehtonen
Updated over a week ago

Can I only include new users to my tests?

Written by Lari Lehtonen
Updated over a week ago

What happens when I end a test?

Written by Lari Lehtonen
Updated over a week ago

Is there a limit to the number of campaign tests I can simultaneously run?

Written by Lari Lehtonen
Updated over a week ago

Does A/B Testing negatively affect SEO?

Written by Lari Lehtonen
Updated over a week ago

What Nosto products can I test?

Written by Lari Lehtonen
Updated over a week ago

Why is my test not significant?

Written by Lari Lehtonen
Updated over a week ago

When shall I analyze the results of my tests?

Written by Lari Lehtonen
Updated over a week ago

How many variations can I set up in a test?

Written by Lari Lehtonen
Updated over a week ago

Can I set up a control group?

Written by Lari Lehtonen
Updated over a week ago

What if my test is not significant?

Written by Lari Lehtonen
Updated over a week ago

Why do you show improvements in form of intervals?

Written by Lari Lehtonen
Updated over a week ago

Can you run tests in other channels than my online store?

Written by Lari Lehtonen
Updated over a week ago

When do you decide when a test is significant?

Written by Lari Lehtonen
Updated over a week ago

Can I optimize multiple sections of my online store at the same time?

Written by Lari Lehtonen
Updated over a week ago

Do you use a Frequentist or a Bayesian statistical approach?

Written by Lari Lehtonen
Updated over a week ago

Do you exclude outliers?

Written by Lari Lehtonen
Updated over a week ago

What different test types and methodologies do you support?

Written by Lari Lehtonen
Updated over a week ago

How do you continuously optimize?

Written by Lari Lehtonen
Updated over a week ago

What Optimization Goals can I choose?

Written by Lari Lehtonen
Updated over a week ago

Can I edit campaigns when they are part of a live test?

Written by Lari Lehtonen
Updated over a week ago

Can I optimize for multiple goals?

Written by Lari Lehtonen
Updated over a week ago

How does the attribution work in A/B testing?

Written by Lari Lehtonen
Updated over a week ago

What is a boxplot?

Written by Lari Lehtonen
Updated over a week ago