Holdout test
Compare running OptiMonk against showing no campaign, to see the lift it brings.
What it is
Holdout test, in plain words.
How much extra revenue does your popup really bring? A holdout test keeps a slice of your traffic away from the campaign, and compares.
The A/B test has a built-in control arm, Control (no popup). Visitors in it see nothing at all.
The Overview tab shows the uplift and the chance to win for each arm. You don't need Google Analytics for it.
Key benefits
Why it earns its place.
The honest number.
See what the popup adds compared with showing nothing.
No code.
The control arm is built in.
Right next to your variants.
The control sits in the same variant table.
How it works
Three steps to set it up.
- 1Step 1
Open the campaign
Stay on the Overview tab.
- 2Step 2
Add the control
Click Add A/B test variant and choose Control (no popup).
- 3Step 3
Keep both on and read
Make sure both rows are switched on, then watch the uplift.
Questions, answered.
Step-by-step setup lives in the Help Center guide.
One.
Evenly. With one design and one control, half your visitors see the popup and half see nothing.
No, the comparison is on the Overview tab. You can still cross-check in GA if you like.
Yes. A control that's switched off isn't measuring anything.
