A laptop showing website analytics and charts, the kind of data a medical practice would use to decide whether to A/B test its website
A/B testing looks scientific, and it is, when you have the traffic to back it. Most practice websites do not, yet. Photo via Pexels.

A dermatologist emailed us in the spring, pretty excited. She had read an article about how a big retailer lifted sales by testing two button colors, and she wanted to A/B test her practice website. Headline here, headline there. Blue button, green button. She figured a few tweaks would fill her schedule. We asked one question before she spent a dollar on it: how many people visit your website in a month? About 600, she said.

That number ended the conversation, in the best way. At 600 visitors a month, she could not run an honest A/B test if she tried for a year. We saved her the cost of the tool and pointed her at five fixes instead. Her bookings went up within six weeks, without a single test. Here is why, and how to know which camp your practice is in.

What A/B testing actually is

A/B testing, also called split testing, means showing one version of a page to half your visitors and a different version to the other half, then measuring which one gets more people to book or call. Change one thing, send real traffic at both, and let the numbers pick the winner. Done right, it replaces opinions and guesswork with evidence. It is genuinely one of the best tools in marketing.

The catch is the phrase done right. A/B testing only works when you have enough traffic to tell a real difference from plain luck. Flip a coin four times and you might get three heads. That does not mean the coin is rigged. The same thing happens on a low traffic website. Version B looks like it is winning for two weeks, you declare victory, and then it reverts, because you were watching noise, not a real pattern.

The math nobody tells you before they sell you the tool

Here is the part that gets skipped. To trust an A/B test, you need a sample size big enough to reach statistical significance, usually 95 percent confidence. According to guidance compiled by tools like Convert and HubSpot, a page converting at 2 to 5 percent generally needs on the order of 1,000 or more conversions per version to reliably detect a modest 10 to 20 percent lift. Even a looser standard of roughly 100 conversions per version typically takes four to six weeks of steady traffic.

Sit with that for a second. Conversions, not visitors. If your website converts at 5 percent, getting 100 conversions means roughly 2,000 visitors, per version, so 4,000 visitors for one test. The practice with 600 visitors a month would need most of a year to finish a single test, and the smaller the improvement you are hunting, the worse it gets. Halving the size of the effect you want to detect roughly quadruples the traffic you need. By the time a slow test finishes, your services, your competitors, and your season have all moved on.

~1,000 Conversions per version you often need to trust a modest A/B test result at 95 percent confidence. A typical practice website books a tiny fraction of that in a year.

This is not a reason to feel bad about your traffic. It is a reason to spend your energy where it actually pays off. A/B testing is a magnifying glass. It is brilliant for finding small gains on pages that already get a flood of visitors. It is useless for a page that only a few hundred people see, because there is nothing to magnify yet.

What a good practice website converts at

It helps to know the target. According to Unbounce conversion benchmark data drawn from tens of thousands of real pages, the median landing page conversion rate for health and wellness is about 5.1 percent, a bit below the cross industry median of 6.6 percent. Top performers reach 8 to 10 percent. Dental sits lower, around 4.3 percent.

So if your site turns 2 percent of visitors into booked patients, the gap to a solid 5 or 6 percent is not hiding in a button color. It is in the fundamentals: how fast the page loads, whether people can book without calling, whether they trust you in the first five seconds. You do not need to test your way to those answers. The evidence is already in. You just need to apply it.

Fix these first, because they beat any test

Before anyone runs an experiment, we walk a practice through the same short checklist. None of these need testing. They are known winners with mountains of evidence behind them.

We cover one of these in depth in our guide on how many clicks it should take to book an appointment, and the short version is: fewer than you think. These fixes are exactly what our websites that convert for healthcare are built around, because they move bookings for every practice, no matter how much traffic you have.

Quick gut check: are you ready to A/B test?

Answer three questions. One, does the page you want to test get at least a few thousand visitors a month? Two, does it already produce a steady stream of bookings you can measure? Three, have you already fixed speed, mobile booking, and your form? If you cannot say yes to all three, you are not ready to test, and that is good news, because the fixes that come first are faster and cheaper than any experiment.

When A/B testing really is worth it

We are not against testing. We love it in the right spot. A/B testing earns its keep once you have real volume on a specific page. The usual candidates are large groups and multi location practices, and any practice spending real money on ads, because a paid landing page can pull thousands of visitors a month on its own. On a page like that, a 15 percent lift is worth testing for, and you will actually reach significance before the result goes stale.

If you are running ads, the smartest place to test is often the ad itself, not the website, because ad platforms gather data far faster. We wrote about that in our piece on whether your practice should A/B test its ads. The principle is the same everywhere: test where the traffic is heavy and the feedback is fast.

And you cannot know any of this if you are not measuring where patients come from in the first place. Most practices have no idea which pages, ads, or channels actually produce booked visits, which makes every decision a guess. Our guide on how to track where your patients come from is the honest starting point, well before any test.

The bigger point: traffic first, then tuning

Here is the hidden trap in A/B testing culture. It assumes your problem is conversion, when for most practices the real problem is that too few of the right people ever land on the site. If 600 people visit a month, the win is not turning 30 bookings into 33. It is getting 3,000 of the right local people to the site so the same 5 percent becomes 150 bookings. That comes from local search, a strong healthcare SEO presence, reviews, and ads that reach patients near you, not from rearranging a page a few hundred people see.

When the traffic is thin, every inquiry matters even more, which is why we make sure none slip through. Our AI receptionist answers every call and web message day or night, so the handful of people who do reach out actually turn into booked visits instead of voicemails. Fix the leaks, grow the traffic, and the question of whether to A/B test answers itself in time.

Where we come in

We build the whole picture as one connected patient acquisition system, so you are not buying a testing tool and hoping. We start with a website that already follows the fundamentals the data supports, point qualified local traffic at it through SEO, social, and ads, and track what actually books a patient. When a page finally does earn enough traffic to test, we test it properly, with real significance, not a two week hunch. Until then, we spend your budget on the things that move the needle today.

Our honest take

A/B testing your website is a great idea at the wrong time for most practices. If your site gets a few hundred visitors a month, skip it. You would be reading tea leaves and paying for the privilege. Put that money and attention into a fast, trustworthy site that lets people book in two taps, and into getting more of the right patients to it. Do that, and one day you will have enough traffic that testing finally makes sense. That is a good day to look forward to. It is not today.

Not sure if your site should be tested or just fixed? Let's look together.

Book a free strategy call. We will check your real traffic and conversion numbers, tell you honestly whether A/B testing is worth it yet, and show you the handful of fixes that will book more patients this month. No tool to buy, no jargon, just a clear plan.

Book a free strategy call →