Stop testing a broken popup


A/B testing a broken popup is like adjusting the font on a billboard nobody drives past.

Most DTC brands know their popup isn’t performing. So they do what seems logical — swap the headline, try a different button color, test a new trigger timing. They run the experiments. They wait for the data. Nothing moves.

The problem is structural, not cosmetic.

After auditing popups across dozens of DTC tech accessory brands using a 7-category, 86-point scoring framework, the same four structural failures show up every time.

Most brands score below 52 out of 86 points. And the lost points almost always cluster in the same places.

Today I’m walking through those four places — with a question you can answer right now by looking at your own popup, and a one-sentence fix spec you can hand to your designer or developer this week.

Let’s get into it.

~

Failure 1: Your offer has no reason to exist for a full-price buyer

Answer this: does your popup offer something a visitor would want even if they had no intention of buying today?

If the answer is no — if the only reason to sign up is to get 10% off — you’ve built a list of coupon redeemers.

That’s not a subscriber base.

That’s a discount expectation you’ll have to keep feeding.

The person who signs up for an educational email course titled “The 5 mistakes that make a $200 cable management setup look like a $30 one” signs up because they care about their setup. The person who signs up for 10% off signs up because they care about saving $15. Those two subscribers behave completely differently once they’re in your email list.

The offer you lead with is the audience you attract.

Here’s how I’d fix it:

Replace the discount with a lead magnet that solves a real pre-purchase problem — one your customer has before they’re ready to buy. Something like “The 3-day guide to choosing the right [product category] for your setup” works for someone who isn’t ready to buy yet. 10% off only works for someone who already is.

~

Failure 2: Your headline describes what you want, not what they get

Answer this: does your popup headline describe an outcome the visitor cares about, or an action you want them to take?

Headlines like “Join our newsletter”, “Sign up for updates”, and “Subscribe to stay in the loop” all describe the transaction from your side.

The visitor reads them and asks: so what’s in it for me? A headline that scores well answers that question in a single sentence — with a specific outcome, not a vague benefit.

Here’s what that looks like in practice:

  • “Stop looking washed out on camera” — for a lighting brand
  • “Build a clutter-free desk in one weekend” — for a cable management brand
  • “Know which case material survives 3 years — and which ones don’t” — for a phone case brand

Each of those tells the visitor what their life looks like after they subscribe.

Here’s how I’d fix it:

Rewrite your headline to answer one question: “What will I know or be able to do after I subscribe that I can’t do right now?”

One sentence. Specific outcome. No jargon.

~

Failure 3: Your CTA button is a label, not a nudge

Answer this: does your CTA button tell the visitor what they’re getting, or just describe the click they’re making?

“Subscribe”, “Submit”, and “Get offer” are labels.

They describe the mechanics of the action. They don’t remind the visitor what they’re about to receive. At the moment of maximum hesitation — the second before someone decides whether to give you their email — you’ve gone quiet on value.

This is the final persuasion moment and most brands waste it.

The button is usually written in the last five minutes before launch, after everyone’s attention has moved to technical setup. It gets treated as a label when it’s the last line of copy a visitor reads before they decide.

Here’s how I’d fix it:

Write the CTA as a first-person value statement.

“Send me the guide”.

“Show me the setup mistakes”.

“Get my free blueprint”.

The visitor reads those words as their own voice — make sure that voice is affirming the value exchange, not just acknowledging the click.

~

Failure 4: Your popup fires before the visitor has any context

Answer this: does your popup appear within the first five seconds of a visit?

If yes, you’re interrupting a visitor who hasn’t read a word of your site yet.

They don’t know what you sell. They don’t know why it matters. They have zero context for why they’d want to hear from you — and you’re already asking for their email. The popup might convert at 1–2%, but the more important question is: who are those people?

Subscribers who sign up with zero context are the least qualified people on your list.

Here’s how I’d fix it:

Set your popup trigger to fire after at least 45-60 seconds, or after the visitor has scrolled to 40% of the page — whichever comes first.

Give them enough time to understand what you’re selling before you ask them to subscribe to it. Even if you’ve already tried timing delays without results, pair the delay with a better offer (see Failure 1) and the combination will outperform either change alone.

~

Four structural failures. Four diagnostic questions. Four fixes you can hand off today.

You don’t need another A/B test. You need to know which of these four problems your popup has — then fix the right thing.

Lead with expertise, not 10% off.

Until next time, see ya!

Gannon

P.S. Want to score your own popup across all 7 categories in under 15 minutes? The 15-Minute Popup Audit Kit walks you through every question, shows you exactly where you’re losing points, and tells you what to fix first.

Grab it here →

DTC Popup Fixes

I score real DTC popups. You get the fixes — no discount required. Every Tuesday, I break down a real DTC tech accessory brand's popup — scored against a 7-category, 86-point framework, with specific fixes you can hand straight to your dev team. 30+ brands audited so far. Same five mistakes, almost every time.

Read more from DTC Popup Fixes
	Screenshot of Skylight's original popup, "Get $10 Off Your Order," with Calendar, Frame, and Both buttons over a lifestyle photo of the Skylight Calendar.

I've got a Skylight Calendar mounted by my fridge, syncing five different iCloud calendars into one screen my whole family checks every day. So when their popup only scored 46 out of 86 — a 53% — one weak spot surprised me most. Nordberg Family Skylight Calendar Today, you get the 46/86 score, the 3 categories costing Skylight the most subscribers, and the fixed popup I'd ship instead. If you want to run your popup through the same 7 categories, you can get your popup's real score for free....

Dark green background with a wrench icon and bold white text reading "Build a smaller list that actually converts."

Your subscriber count is the least useful number in your email dashboard. Most DTC founders chase list size because it feels like progress. A bigger number looks better in a board deck. But list size and revenue don’t move together the way founders assume they do. A popup promises 10% off, the list grows quickly, and six months later opens are down, redemptions only happen on discount codes, and the “growth” cost real margin on every single email send. Somewhere between 10 and 30 percent of...

Rolling Square's original 'Free gift for you' popup on a solid blue background, used as a newsletter thumbnail

Rolling Square's popup gives away a $12 cable to build a list of bargain hunters. You'd never guess a brand with patents and Wired features runs a popup this generic. A free cable isn't a bad offer. It's just a wasted one. Rolling Square built their whole brand on being the one company that gets your setup, from the cable in your keychain to the charger in your bag. Then their popup shows up in under 10 seconds and offers the exact same thing every giveaway site runs: a free gift for your...