01
Before the test starts, decide
- The variable. Hook, visual, format, offer, or audience — exactly one, or the result explains nothing.
- The metric that decides it: cost per add-to-cart, cost per purchase, or thumb-stop rate. Choose one; a test with three possible winners has none.
- The budget and the duration, both fixed before launch. Changing either mid-test invalidates it.
- The winner rule, in numbers: 'variant B needs 20% lower cost per ATC over seven days to replace A'.
- The minimum volume below which you will call it inconclusive rather than guess. Say the number out loud; it prevents false confidence.
