Original data · 2026-07-10

We asked AI the same questions about 20 businesses two weeks later. All 20 answers had changed.

A one-time AI visibility check tells you where you stood on the day you ran it. We wanted to know how long that answer stays true — so we took 20 real US businesses we had already audited, waited about two weeks, and re-ran the identical questions on the identical engines. Not a paraphrase, not a new city, not a different prompt: the same words. Every one of the 20 came back different. Half the scores moved. Fewer than half the competitors the engines had named the first time were still named the second. Here is the full data.

Begin your check

Free · 60 sec

No account · No card · 3 buyer questions, 2 engines

By running a check you agree to our Terms and Privacy Policy.

Who runs this

Finding 1: Not one business had a fully stable result

We define a result as two things: the AI Visibility Score (how often, and how prominently, the engines name you when your buyers ask) and the competitor list (the rival businesses the engines named instead). Across the 20 re-runs, 20 of 20 changed on at least one of those two — the score, the rival set, or both. Zero were unchanged.

This is the number we did not expect. We assumed a well-established business asking an identical question would mostly get an identical answer a fortnight later. That happened exactly zero times.

Finding 2: Half the scores moved — some a long way

Two weeks later…Businesses (n=20)
Score changed10 (50%)
— rose8
— fell2
Score moved 10+ points4 (20%)
Score moved a full band (17+ points)2 (10%)
Mean absolute move6.0 points

The two largest moves were both upward and both large: a Dallas med spa went from 50 to 83 in 14 days, and a Fort Lauderdale personal-injury firm went from 17 to 42 in 23 days. Neither hired us; neither, as far as we know, did anything at all. The engines simply changed their minds. The two decliners were milder (47→41 and 28→26), but a business watching only its own score would have read those as noise.

The direction of travel is worth naming honestly: 8 of the 10 moves were upward. Some of that is the general expansion of what these engines retrieve about local businesses. It does not make the number stable — it makes it a moving target that happens, on this sample and in this window, to be drifting up.

Finding 3: A flat score does not mean a stable position

Ten businesses scored exactly the same both times. It would be reasonable to call those ten stable and move on. They weren't. All ten of them had a different competitor list the second time. Same score, different rivals standing in front of them — a different set of businesses the engines now consider the answer to their customers' question.

If you check your AI visibility once, see a mediocre score, check again and see the same mediocre score, the intuitive read is nothing is happening. On this data, that read was wrong in 10 cases out of 10.

Finding 4: 57% of the competitors were new names

Each check records the top 5 rivals the engines named. Across the 20 businesses that is 100 competitor slots per round. Comparing round one to round two:

The competitive picture is substantially less stable than the score. That matters, because the competitor list is the part of an audit people act on — it is where you look to find who has the review volume, the directory listings, and the roundup mentions you don't. Half of that list has a shelf life measured in weeks.

Finding 5: Being named as often is not being named the same

Of the 10 businesses whose score moved, 3 were mentioned in exactly the same number of AI answers as before. Their mention rate was identical; what changed was where they landed inside the answer — named first with a reason, versus listed fourth in a trailing "others include…" clause. The engines had not stopped naming them. They had stopped recommending them.

Mention-counting alone would have shown a flat line through all three of those cases. This is the same lesson our run-to-run study found inside a single day — a screenshot proves nothing — extended across weeks: a mention count is not a position.

Finding 6: The lower-visibility vertical moved more

VerticalRe-runsScores that movedMean absolute move
Personal-injury law firms54 of 59.6 points
Med spas156 of 154.8 points

The law firms are the smaller sample and we won't over-read it, but the pattern is consistent with what we see across the full local-business benchmark: the more fragmented and contested a category is — 190 distinct rival firms named across just 10 personal-injury audits — the more freely the engines reshuffle it. Nobody in that category has become the consensus answer, so every re-run is a fresh election.

Methodology

Drawn from our production audit corpus: 134 completed AI visibility audits on 93 distinct US businesses, 790 engine answers, 463 distinct rival businesses named, run between 2026-06-12 and 2026-07-09. From those we took every business audited twice, at least 7 days apart, where the question inputs were byte-identical — same business name, same vertical string, same location string, and therefore the same three generated prompts. That is n=20, with gaps of 14 to 23 days (median 14). We discarded 19 other re-audits whose vertical or location text had been edited between runs, because their prompts were no longer literally the same question.

Each audit sends three buyer-intent prompts ("What are the best {vertical} in {city}?", "I'm looking for {vertical} in {city}, who do you recommend?", "Is {business} a good choice?") to ChatGPT (OpenAI) and Perplexity — six answers per audit, 240 answers across the study. A judge model parses every answer for whether the subject was mentioned, how prominently, and which rival businesses were named. The score is the mean of a per-answer prominence weighting, 0–100.

What we cannot claim: we did not contact these 20 businesses and we do not know whether any of them changed their marketing, earned press, or gained reviews during the window. Some of the movement is certainly real-world change. What we can say precisely is that nothing about the question changed, and that a business owner re-checking on our schedule would have received a different answer in 20 cases out of 20. Individual figures are rounded. The subject businesses are audited from public information and are described here by metro and vertical only — none is a customer, and we do not publish individual businesses' scores against their names.

What this means if you own a business

The honest conclusion is narrower than "check constantly." It is this: an AI visibility number has a half-life, and on this evidence that half-life is shorter than a month. A single check is genuinely useful — it is the only way to find out whether the engines name you at all, and which rivals they name instead. It is a photograph, not a fixed address.

So use it as a baseline, and re-measure after you change something — new directory listings, review volume, a comparison page, a roundup mention. A change you can't measure against a baseline isn't a fix, it's a hope. And if your score is flat, look past it at the rival list: on this data that list moved every single time, and it is where the actual instructions live.

Related reading: do AI answers change every time you ask? (yes — 69% of recommended brands didn't survive a same-day repeat), which AI engine actually recommends your business, and why AI recommends your competitors instead of you.

How often does AI visibility actually change?

In our n=20 controlled re-run, every business's result changed within about two weeks: 50% of scores moved (mean absolute move 6.0 points, up to 33), and 100% of businesses saw their named-competitor list change. Nothing about the questions asked was different.

How often should I check my AI visibility?

There's no universal answer, but a monthly cadence and a re-check after any substantive change (new listings, review push, new comparison content, a roundup mention) matches what this data supports. Checking more often than you change anything mostly measures the engines' own drift.

Does a stable score mean my AI visibility is stable?

No. Ten of our twenty businesses scored identically both times, and all ten had a different top-5 competitor list. The score can sit still while the set of businesses being recommended ahead of you turns over.

Did the businesses that improved do anything to improve?

We don't know, and we won't claim otherwise — we never contacted them. We audited them from public information, twice, with identical questions. Eight of the ten moves were upward, which is consistent both with real-world gains and with these engines broadly retrieving more about local businesses over time.

Why only ChatGPT and Perplexity?

The free check runs those two engines. The paid full audit adds Gemini and Claude across 25 of your buyers' questions with three samples each — which matters, because engines disagree with each other far more than they disagree with themselves.

See your number

A free 60-second check shows what AI says about you.

See where you stand today — free check

Method — we query the official APIs of each AI engine, with web search where supported. Answers vary between runs; the full audit repeats every question and reports frequencies, never one-off snapshots.