Recent post

Everyone says they care about incrementality.

Very few teams actually run clean tests.

Why?

Because incrementality sounds simple, but in practice it feels slow, expensive, and messy.

And when you’re under pressure to hit numbers, “clean measurement” often gets pushed aside for “what looks like it’s working.”

This post is not about perfect experimentation.

It’s about what actually works in the real world.


The Reality: Most Teams Don’t Need Perfect Incrementality

You don’t need a PhD-level experimental design to make better decisions.

You need:

  • Directionally correct signals
  • Fast feedback loops
  • A system you’ll actually use

The goal is not academic certainty.

The goal is to answer one question:

Is this driving incremental growth, or just capturing demand that already exists?


Where Incrementality Breaks Down

Most teams fail before they even start.

Common issues:

  • Tests take too long to set up
  • Stakeholders won’t accept short-term dips
  • Results are overanalyzed
  • Nobody trusts the outcome

So teams fall back to:

Platform-reported performance
Last-touch attribution
“Feels like it’s working” logic

That’s how budgets get misallocated.


The Three Practical Ways to Measure Incrementality

You don’t need ten methods.

You need a few that are simple enough to run consistently.


1. Geo-Holdout Testing

This is the most practical place to start.

You split regions into:

  • Test markets (ads running)
  • Control markets (ads paused or reduced)

Then compare performance between the two.

What you’re looking for:

Does the test group outperform the control group in a meaningful way?

Not just installs. Revenue, engagement, downstream metrics.


Why it works:

  • Easy to understand
  • Works across channels
  • Doesn’t require platform support

Where teams mess it up:

  • Markets aren’t comparable
  • Tests are too short
  • Spend isn’t consistent

Keep it simple. Keep it fair.


2. Lift Tests (Platform-Based)

Most major platforms now offer some form of lift testing.

Meta, Google, TikTok.

They’ll split audiences and measure the incremental impact of your campaigns.


Why it works:

  • Cleaner methodology
  • Platform-controlled environment
  • Faster to launch

Where it falls short:

  • Black box methodology
  • Limited flexibility
  • Results require interpretation

Use these as directional signals, not absolute truth.


3. “Turn It Off” Tests

This is the one nobody likes.

Pause a channel or campaign and see what happens.

Yes, it’s uncomfortable.

Yes, performance might dip.

That’s the point.


What you learn:

  • Was that spend actually driving growth?
  • Or just harvesting existing demand?

Why this matters:

Some of the most “efficient” campaigns fall apart the second you turn them off.

That’s not efficiency. That’s dependency.


The “Good Enough” Framework

Here’s the part most teams miss.

You don’t need perfect tests.

You need repeatable ones.

A simple framework:

  1. Pick one variable
  2. Run a controlled test
  3. Measure directional impact
  4. Make a decision
  5. Move on

No overcomplication.

No endless debates.

Speed matters more than perfection.


Where Incrementality Actually Pays Off

Incrementality is not just about measurement.

It changes how you operate.

You start asking better questions:

  • Which channels actually drive new users?
  • Which creatives expand demand vs capture it?
  • Where are we over-investing?

This leads to:

  • Smarter budget allocation
  • Better creative strategy
  • Faster scaling decisions

That’s the real upside.


The Trap to Avoid

The biggest mistake is treating incrementality as a one-time project.

Run a test. Write a report. Move on.

That doesn’t work.

Incrementality should be ongoing.

A rhythm.

Something your team builds into how it operates.


The Work Dog Take

Most teams are not lacking tools.

They’re lacking conviction.

Incrementality forces you to face uncomfortable truths:

Some campaigns don’t actually work.
Some channels are overrated.
Some wins are not real growth.

That’s why it gets avoided.

But if you want to scale, you need to know what’s real.

Not what looks good in a dashboard.

If you’re running spend and not pressure-testing it, you’re guessing.

We can help you set up incrementality frameworks that actually fit how your team operates.

Reply and let’s talk.