Run A/B tests and the autopilot

A/B test a new popup design against your live form, pick a winner by the metric you choose, or let the Veya autopilot keep testing new ideas.

Testing is on the form's Optimize tab. A form doesn't have to be live: you can launch it with a test running from day one.

Launch a new form with a test

Either way, Veya designs your form, then builds version B from that design, changing only what you describe.

  • When you request the form: fill in What should the second version change? under A/B test.
  • After you request it: on its Optimize tab, click New test and answer What should version B change?

Then:

  1. Review both versions. Nobody sees either one yet.
  2. Open version B and click Publish both and start test. Both go live together, with the test running.

If you ask for changes to your form's design, Veya rebuilds version B from the new design, so the two still differ only by your idea. Settings you change on the form, like its audience, offer or schedule, apply to both versions when they go live.

To launch without waiting, click Publish this version only on your form. It goes live alone, and the test starts when you approve version B.

Start a test

  1. Under Tests, click New test.
  2. Choose one:
    • Build a challenger: answer What should the challenger change?, and Veya designs a new version.
    • Compare live forms: test forms that already exist.
    • Popup vs no popup: show some visitors no popup and compare orders. See Test a popup against no popup.
  3. Name it under Test name, choose Decide the winner by, and start it with Build challenger or Start test.

A challenger keeps the live form's offer, so the test never changes what subscribers get.

End a test

On a running test, click Keep this one on the version you want, or Stop test to end it. You can then start the next round with Test against the winner or Test against the control. Past tests keeps the history.

Turn on the autopilot

The autopilot proposes ideas and tests them one round at a time.

  1. On Optimize, switch on Autopilot.
  2. Set Share of visitors who see the challenger and Longest test.
  3. Choose whether to Promote a significant winner without asking me.
  4. Click Turn on.

Test plan shows what's coming and History shows what ran.

Review a round

When a round needs you, use its card:

  • Review design to see the challenger, then Reject it or start it.
  • Make it live when a challenger has won.
  • End test, keep current form to stop and change nothing.

A number on Campaigns in the sidebar means a decision is waiting.

See the results

Test results on the Analytics page compares every test. A form's own Analytics tab shows its history: how it has done over time, every test it went through including the rounds before and after, and each version's results.

Your next popup?
We’ll build it for you.

14-day free trial on every plan. Custom design and revisions included.