Campaign Testing FAQ
Read frequent questions and get answers right away.
Can I schedule tests?
What do I need to create a test?
Can I test two segments against each other?
Can I only include new users to my tests?
What happens when I end a test?
Is there a limit to the number of campaign tests I can simultaneously run?
Does Campaign Testing negatively affect SEO?
What Nosto products can I test?
Why is my test not significant?
When shall I analyze the results of my tests?
How many variations can I set up in a test?
Can I set up a control group?
What if my test is not significant?
Why do you show improvements in form of intervals?
Can you run tests in other channels than my online store?
When do you decide when a test is significant?
Can I optimize multiple sections of my online store at the same time?
Do you use a Frequentist or a Bayesian statistical approach?
Do you exclude outliers?
What different test types and methodologies do you support?
How do you continuously optimize?
What Optimization Goals can I choose?
Can I edit campaigns when they are part of a live test?
Can I optimize for multiple goals?
How does the attribution work in Campaign Testing?
What is a boxplot?