Most brands that say education doesn't convert have never actually run the test.

They looked at a discount popup's opt-in rate, imagined what an educational one might do, and decided against it. That's not data. That's an ill-informed guesstimate.

This week I want to break down the 3 most common mistakes brands make when they rule out education without ever testing it:

1. Comparing warm traffic to cold traffic and calling it a fair fight
   ​
2. Judging the test after one send instead of one full sales cycle
   ​
3. Measuring opt-in rate instead of the number that actually pays the bills

Here's why this matters.

Every one of these mistakes points the same direction: toward keeping the discount popup, because it "already works." I asked that exact question about Satechi's popup a few months back, and every one of these three mistakes comes down to a measurement problem.

Let's get into it.

Mistake #1: Comparing warm traffic to cold traffic

The first mistake is testing an educational offer against your best-performing discount placement instead of an equivalent one.

A discount popup usually lives on high-intent pages: cart, checkout, exit-intent on a product page. An educational offer gets tested on the homepage, or worse, as a brand-new popup competing against a discount that's been optimized for a year.

​Scosche's popup makes the same mistake in reverse — a 15% off offer fires the instant a visitor lands, while nothing educational ever gets tested in that slot to see if it could do better.

Here's how I'd fix it

Swap the offers on the same placement, for the same audience, for the same window of time. Nothing else changes.

Take a brand like Lume Cube selling professional lighting gear. If "10% off" runs on exit-intent and "The Professional Lighting Playbook" runs buried on a blog post, of course the discount wins. It's competing against a page nobody found.

Mistake #2: Judging the test after one send

The second mistake is pulling the plug after a week because the numbers look soft.

A discount removes a price objection instantly. That's why it converts fast and dies fast. An educational offer removes doubt, and doubt takes longer to work through. Checking the scoreboard on day three tells you which offer moved faster. It tells you nothing about which offer earned more.

​Most visitors aren't ready to buy the moment they land on your site — that gap between browsing and buying is exactly why doubt takes longer to close than a coupon does.

Here's how to run it right

• Run the test for one full sales cycle, not one week
  ​
• Track opt-ins weekly so you can see the curve, not just the final number
  ​
• Compare the two offers at the same point in each of their curves, not at an arbitrary shared date

An educational email course can see opt-in rates anywhere from 10% to 30% with a dedicated landing page, and that range often climbs the longer the offer has been live and building trust. If you cut the test early, you'll never see the potential.

Mistake #3: Measuring opt-in rate instead of revenue per subscriber

The third mistake, and the one that actually costs money, is stopping the analysis at opt-in rate.

A 10% off popup will usually beat an educational offer on opt-in rate. That's expected. A discount is an easier yes. But opt-in rate only tells you how many people said yes. It says nothing about who they are or what they do next.

Pull revenue per subscriber over 90 days for each group. Bargain hunters from the discount list buy once, on sale, and go quiet. Subscribers who opted in for education buy at full price and stick around for the next email. I broke down why a smaller, more qualified list outearns a bigger one a few issues back, and the math holds here too.

If you're only ever grading the popup on day-one opt-ins, you're grading the wrong test.

The real fix

Every one of these mistakes comes down to the same thing: brands never let education compete on a level field long enough to find out what it could do.

I've written before about the three jobs a popup offer actually needs to do for a considered purchase, and testing is exactly where all three get decided.

Even if you've already tried an educational popup once and watched it underperform, check which of these three mistakes was actually running the show before you write off the whole approach.

Test it the right way, and you're not guessing anymore. You're finding out.

Until next time, see ya!

Gannon

P.S. Which mistake are you most guilty of?

1. Comparing warm traffic to cold traffic
2. Judging the test after one send
3. Measuring opt-in rate instead of revenue per subscriber

Hit reply and send me the number — 1, 2, or 3.