We Became a Fake Customer. Most Never Followed Up.
We built a tool that poses as a new customer and tracks whether a business actually responds. What it found should make you rethink your next ad dollar.
Here's an uncomfortable question. When a brand new lead fills out the form on your website, what actually happens next?
Not what's supposed to happen. What actually happens. Does someone call? How fast? Does anyone follow up at all, or does that lead quietly sit in an inbox until it goes cold?
Most business owners genuinely don't know. And that blind spot is costing them more than any ad budget.
The client who helps everyone else get customers
We do a lot of work for a company whose entire reason for existing is helping independent local businesses win and keep customers. Think of the kind of operation that runs the ads, manages the lead flow, and staffs the phones for a whole network of small, owner-run locations.
They're good at what they do. But even they kept running into the same wall with their own clients. A location would say, "We need more leads." The company would turn on more marketing, the leads would go up, and nothing would change. The phone didn't ring more. The calendar didn't fill.
So the real question stopped being "how do we get more leads" and became something much more basic and much more awkward: when a lead comes in, is anyone actually responding to it?
Nobody could answer that with a straight face. Every location swore they followed up with everyone. There was no way to check. You can't see your own front door from the inside.
The problem wasn't leads. It was silence.
This is the part worth sitting with, because it's true for almost every business, not just theirs.
The instinct, when sales are soft, is to buy more leads. More ads, more traffic, more forms filled out. But a lead is just a person raising their hand and saying "I'm interested, call me." If nobody calls, you didn't have a lead problem. You had a response problem.
You didn't have a lead problem. You had a response problem, and you just paid good money to make it bigger.
It's a signal problem, not a volume problem. The signals are already coming in. They're dying in the gap between "someone reached out" and "someone reached back." And that gap is invisible from the inside, because everyone assumes someone else picked it up.
You cannot fix what you cannot see. So we built a way to see it.
What we built: a customer who isn't real
The tool is simple to describe and a little sneaky in the best way. We call it a mystery shopper.
You give it a business's website. From there it does the work a curious new customer would do, automatically:
- It finds the real contact form on the site, not the self-booking link, the actual "get in touch" form that a new person would use.
- It generates a throwaway identity: a believable name, a temporary phone number, and a dummy email, so the business sees exactly what a real new inquiry looks like.
- It fills out and submits the form, then starts a timer.
- For the next seven days, it quietly logs every single call, text, and email that comes back.
- At the end, it spits out a plain report: a timeline of what happened, minute by minute, after a new customer raised their hand.
Then the temporary number gets released back into the pool and the identity disappears. Nothing lingers.
That's it. No opinions, no spin. Just a clean record of what a real person would have experienced if they'd reached out to you today.
What the report actually showed
I'll keep this qualitative on purpose, because the honest version is more useful than a made-up stat.
More often than we expected, the answer was nothing. We tested businesses that went multiple days without a single reply. No call, no text, no email, after someone had literally filled out the form asking to be contacted. One ran four full days in total silence.
And then, every so often, you'd see the other kind. A business that called within the hour, left a warm voicemail, and followed up with a couple of texts the same day. You didn't need a dashboard to feel the difference. One of these businesses was going to win that customer. The other had already lost them and didn't even know a customer had been there.
The gap between "we follow up with everyone" and the actual timeline was the whole story. Not because people were lazy. Because nobody could see it, so nobody fixed it.
What we were careful about
A tool like this can go wrong if you're not thoughtful, so a few of the guardrails mattered as much as the build.
It tests your own front line, not your customers. The point is to shop yourself, or a business you're deciding whether to work with. It's not for deceiving real people, and the fake identity is temporary by design and thrown away when the test ends.
It measures response, not the whole relationship. The tool tells you if someone reached out and how fast. It doesn't grade the conversation, judge the pitch, or close the deal. Speed and consistency are what it sees, and that turns out to be most of the game, but it's not all of it. A human still has to be good once the phone connects.
It's a diagnosis, not a cure. The report tells you where the leak is. It doesn't patch it. Fixing a broken follow-up process is still people and habits and accountability, and no tool does that part for you.
We kept it gated. It was tempting to throw a version of this open to the whole internet. We didn't, for an obvious reason: if anyone can mystery-shop any business, then your competitors can shop you and your clients too. Some capabilities are better kept pointed at your own front door.
What this means for your business
You don't need our tool to use the lesson, and that's kind of the point.
Before you spend another dollar trying to get more leads, find out what happens to the ones you already get. You can do a low-tech version this afternoon: have a friend your team won't recognize fill out your website form, or call your main line as a brand new customer, and just write down what happens and how long it takes. The results tend to be humbling.
A few things we'd bet you'll learn:
- The first few minutes decide almost everything. A fast, human response beats a beautiful funnel that answers tomorrow. Interest fades by the hour.
- "We follow up with everyone" is almost never true. Not out of laziness, but because busy people assume someone else caught it. Hope is not a process.
- A dead-simple cadence beats a fancy one. A quick reply in the first few minutes, a nudge an hour later, and one more the next day will put you ahead of most of your competition, full stop.
This is different from the usual advice to go follow up harder. We've written before about following up with leads so they don't go cold and about systems that report success while quietly failing underneath. This is the step before all of that: proving to yourself what really happens, so you stop guessing. If you can't measure whether the thing is actually working, you're flying blind.
Most businesses are one honest test away from finding real money they already paid for and never collected. The leads aren't the problem. The silence after them is.
If you're spending to bring in leads but you're not sure what happens once they land, that gap is exactly the kind of thing we help businesses find and close at Humanity AI.
Questions & Answers
What is a lead-response mystery shop?
It's a test where someone poses as a brand new customer, reaches out to a business the normal way (usually by filling out the website form), and records exactly what the business does in response: whether anyone follows up, how fast, and through which channels. It shows the real experience a new customer gets, instead of the one you assume they get.
Why does lead response speed matter so much?
Because interest is perishable. A person who just raised their hand is ready to talk now, not next week. The business that responds first and fastest usually wins, often regardless of who had the better offer.
Can I mystery-shop my own business without special software?
Yes. Have someone your team won't recognize fill out your contact form or call your main number as a new customer, and log what happens and when. It's less tidy than an automated tool, but the lesson lands just as hard.
Isn't it dishonest to submit a fake inquiry?
The intent matters. Using it to test your own business, or to evaluate one you're considering partnering with, is a normal quality check, the same idea as a secret shopper in a store. Using a throwaway identity that's discarded after the test keeps it clean. It is not meant for tricking or spamming real businesses.
Want to talk more?
Tell me what is on your mind and I will take a look. No pressure, no obligation, just a real conversation about your business.
Start a conversation →