Conversion Rate Optimisation
A/B Testing
A test that stops early or measures the wrong metric is worse than no test. The discipline is in the design, not the tool.
- Best fit
- Decisions backed by evidence instead of opinion.
- Engagement
- Monthly retainer, with a minimum testing window.
Scope
What is included.
Every item below is delivered by us. Scope is agreed in writing before work starts.
- Hypothesis backlog with expected impact
- Sample size calculation before launch
- Test implementation and QA
- Single-metric decision rules
- Segment analysis for insight
- Winner rollout and documentation
In detail
A/B Testing, in practice.
What the work involves, who it suits and what changes once it is running.
Design decides the result
Sample size is computed before launch and the decision rule is agreed in advance. Stopping when a variant looks good is how false wins get shipped.
Learning compounds
Even a flat test teaches something about the audience. Documented hypotheses turn testing from a series of bets into a body of knowledge.
Outcomes
What changes once it is running.
- Lift per test
- Test velocity
- Win rate
Works with
Part of Conversion Rate Optimisation.
A/B testing programme: hypothesis backlog, test design, sample sizing, implementation and rollout.
See the full serviceQuestions
Before you commit.
- How many tests should we run per month?
- One to two well-designed tests beat five rushed ones. Each needs time to reach significance.
- What if a test is inconclusive?
- That is a legitimate result. We document it and move on rather than declaring a winner on a flat result.
Other Conversion Rate Optimisation services
All Conversion Rate OptimisationNext step
Tell us what you are trying to fix.
A short conversation is usually enough to know whether we are the right fit. If we are not, we will say so.