AI search news ·
Do pages you never request indexing for get indexed on their own? 2 of 9 went in on single organic Googlebot fetches in 3 days, 0 of the 13 pages Googlebot never fetched moved, and all 10 clicked pages were re-fetched within 72 hours
Three days after a scheduled task clicked "Request indexing" on 11 of our unindexed URLs and left 9 alone, the untreated side has moved: 2 of the 9 are now indexed, each on a single organic Googlebot fetch dated 2026-08-27, with no click, no task and no request behind it. The other 7, plus the 6 posts published since and the one clicked URL Googlebot never fetched, are 0 of 14 indexed, with 0 Googlebot requests between them in seven days, while every one of the 14 has been read by OpenAI's, Perplexity's, Anthropic's or Amazon's crawler in the same week. The 10 clicked URLs that went in on 2026-08-26 are still in, and Googlebot has re-fetched all 10 on its own since; Search Console still reports the click-fetch second as their last crawl. The two untreated pages went in on the day Googlebot's requests to this site doubled, so one reading cannot say whether the click primed anything or Googlebot simply had a bigger day. The counts, the per-URL tables, and the one variable we changed today are below.
What was pre-registered, and what was read
On 2026-08-26 we published the 27-hour reading of a Request-indexing test: 10 of 11 clicked URLs indexed, 0 of 9 unclicked. The decision rule had been written down before the data: read again on 2026-08-28, count M of 11 clicked and N of 9 unclicked, and treat M of 3 or more with N of 0 as "the button works". The rule also said what an N of 1 or more would mean: the comparison weakens, because pages were going in without the button. Today N is 2, so this post is the weakened reading, stated as counts, not a new claim about the button.
Everything below was read between 16:38 and 16:43 UTC on 2026-08-28 by two instruments: Search Console's URL-Inspection API for index state and last-crawl time, and our own crawler ledger for every request whose user agent names Googlebot (probe rows and spoofed rows excluded, as in every ledger read we publish). The 14-URL denominator, the 11 clicked URLs and the 9 unclicked ones are read from files written before today, not chosen this afternoon. The cut script and artifact are in our repository, `content/news/request_indexing_followup_cut.mjs` and `request-indexing-followup-cut-2026-08-28.json`, with 14 self-checks that assert every number in this post, including that the analyst's "Googlebot doubled" figure reproduces from the raw rows.
The read, as counts
| Cohort on the 2026-08-25 morning sweep | URLs | Indexed 08-26 (27 h) | Indexed 08-28 (75 h) | Googlebot rows, trailing 7 d | Search Console last crawl |
|---|---|---|---|---|---|
| Clicked (Request indexing, 13:18 to 13:38 UTC) | 11 | 10 | 10 | 21 (10 click fetches + 11 organic re-fetches on the 10) | the 08-25 click second, on all 10, unchanged |
| Not clicked | 9 | 0 | 2 | 2 (one row per page that went in; 0 on the other 7) | 2026-08-27 12:35:15Z and 23:33:03Z, each equal to its ledger row |
| Published after the sweep (08-25 to 08-27) | 6 | 0 (2 existed) | 0 | 0 | none |
| The 14 not indexed today: 7 unclicked + 6 new + the clicked URL that never fetched | 14 | 0 | 0 | none |
The two that went in without a click
Both are posts from the week before the test, both read "Discovered - currently not indexed" on the 08-25 sweep, and both had 0 Googlebot requests on the ledger from 2026-08-18 to the 08-26 read. Each then drew exactly one Googlebot request on 2026-08-27, from a US address, and Search Console now reports that request as the last crawl, to the second. There was no click: the scheduled task that pressed the button on 08-25 has no directory on the machine it ran from, there is no sweep file after 08-25, and the ledger shows no click cadence on either day.
| URL (shortened) | Published | 08-25 sweep | 08-26 read | 08-28 read | Googlebot rows since 08-20 | Search Console last crawl |
|---|---|---|---|---|---|---|
| /news/is-the-gptbot-in-your-server-logs-really-openai… | 2026-08-22 | Discovered | Discovered | Submitted and indexed | 1: 2026-08-27 12:35:16Z (robots.txt one second earlier) | 2026-08-27T12:35:15Z |
| /news/does-googlebot-still-fetch-new-posts-on-publish… | 2026-08-21 | Discovered | unknown to Google | Submitted and indexed | 1: 2026-08-27 23:33:03Z | 2026-08-27T23:33:03Z |
One fetch each, then indexed. That is the same shape as the clicked cohort: on this site, the first Googlebot content fetch of an unindexed page has been the fetch it went in on, 12 times out of 12 (10 clicked, 2 organic). The difference the button made was when the fetch happened, not whether a fetch was enough.
What Googlebot did on the day they went in
Googlebot's requests to this site, by UTC day, from the ledger. 2026-08-28 is the partial day to 16:22 UTC. "Paths" counts distinct URLs including robots.txt and sitemap.xml.
| UTC day | Googlebot rows | Distinct paths | Note |
|---|---|---|---|
| 2026-08-24 | 11 | 6 | |
| 2026-08-25 | 40 | 18 | the click day: 10 click fetches, 21 robots.txt requests |
| 2026-08-26 | 27 | 12 | 1 re-fetch of a clicked page, 5 homepage requests |
| 2026-08-27 | 49 | 29 | the 2 untreated pages went in; 4 clicked pages re-fetched; 8 other already-indexed posts fetched |
| 2026-08-28 (to 16:22Z) | 28 | 17 | 6 clicked pages re-fetched |
Our analyst's standing 24-hour window (09:37 UTC to 09:37 UTC) read 53 rows over 32 paths for 08-27 to 08-28, against 27 over 15 the day before, and the raw rows reproduce that exactly. Where the doubled day went: 15 robots.txt requests, 3 sitemap requests, 10 requests to 9 already-indexed /news posts, 8 organic re-fetches of clicked pages, 7 to /guide pages, 5 to /compare pages, the 2 fetches that indexed the untreated pages, and 1 each to the homepage, a /for page and a /data page. Requests to the 14 pages that are not indexed: 0 of 53.
The ten clicked pages, three days on
All 10 are still indexed. Every one of them has since drawn at least one organic Googlebot request, between 27 hours and 69 hours after its click fetch, and one of them two. Search Console's last-crawl field did not move on any of them: it still reports the 08-25 click second. We do not know whether the inspection field lags, or whether these later requests are a kind of fetch Google does not count as the crawl of record. It is a difference between the two instruments, and we report both.
| Clicked URL (shortened) | Click fetch (ledger) = Search Console last crawl | Organic Googlebot requests since |
|---|---|---|
| /data/ai-visibility-benchmark-med-spas | 2026-08-25 13:21:21Z | 08-27 10:03Z, 08-28 10:23Z |
| /news/ai-engines-barely-share-cited-domains… | 13:23:19Z | 08-28 05:06Z |
| /news/yelp-openai-licensing… | 13:25:20Z | 08-27 23:17Z |
| /news/robots-txt-does-not-control-ai-visibility… | 13:27:17Z | 08-26 12:52Z |
| /news/did-your-search-console-generative-ai-impressions-drop… | 13:27:17Z | 08-28 08:53Z |
| /news/do-ai-crawlers-read-llms-txt… | 13:29:22Z | 08-28 05:05Z |
| /news/does-ai-cite-one-page-or-many… | 13:31:20Z | 08-28 10:06Z |
| /news/how-fast-do-ai-crawlers-fetch-a-new-page… | 13:31:20Z | 08-27 22:27Z |
| /news/did-chatgpt-stop-citing-reddit-on-august-14… | no fetch, not indexed | none |
| /news/does-ai-reuse-the-same-sources… | 13:33:31Z | 08-27 21:36Z |
| /news/does-chatgpt-send-visitors-to-pages-google-buries… | 13:37:32Z | 08-28 08:58Z |
What one reading cannot separate
Two stories fit these numbers, and the data does not pick one. In the first, the clicks on 08-25 put 10 pages into Google's crawl schedule, Googlebot returned to all 10 within three days, and while it was on the site it also picked up two neighbouring posts that link to and from them. In the second, Googlebot had a bigger day for reasons of its own, 49 requests over 29 paths against a daily median of 26 for the prior week, and the two untreated pages were simply the ones its schedule reached; the re-fetches of the clicked pages were part of the same larger day. The control for both stories is the same: the 13 pages Googlebot has not requested at all. Under either story, they did not move, and a page that has never been fetched cannot be indexed.
The fourteen Googlebot has never fetched
Thirteen of these have 0 Googlebot requests since the ledger started watching them on 2026-08-18; the fourteenth is the clicked URL that drew no fetch and never went in. Every one of the fourteen was fetched in the same seven days by at least three of OpenAI's, Perplexity's, Anthropic's, Amazon's, Microsoft's and Yandex's crawlers. "Discovered" and "unknown to Google" are reported as read at 16:38 UTC; the 08-26 post showed those two labels swapping between API reads four minutes apart, so we count them together as not indexed and do not narrate the label.
| URL (shortened) | Published | Age at read | Cohort | Search Console 08-28 | Googlebot rows, 7 d | Other crawlers, 7 d |
|---|---|---|---|---|---|---|
| /news/can-chatgpt-send-a-reader-to-a-page-before-google-crawls-it… | 2026-08-24 | 4 d | not clicked 08-25 | Discovered | 0 | OAI-SearchBot, PerplexityBot, ClaudeBot, Amazonbot, bingbot, YandexBot |
| /news/do-new-ai-cited-sources-survive-a-week… | 2026-08-24 | 4 d | not clicked 08-25 | unknown to Google | 0 | OAI-SearchBot, ChatGPT-User, PerplexityBot, ClaudeBot, Amazonbot, bingbot, YandexBot |
| /news/what-queries-does-google-show-a-small-ai-search-site-for… | 2026-08-23 | 5 d | not clicked 08-25 | Discovered | 0 | OAI-SearchBot, PerplexityBot, ClaudeBot, Amazonbot, bingbot, YandexBot |
| /news/does-your-json-ld-still-parse… | 2026-08-23 | 5 d | not clicked 08-25 | unknown to Google | 0 | OAI-SearchBot ×2, ChatGPT-User, PerplexityBot, ClaudeBot, Amazonbot, YandexBot |
| /news/do-page-one-google-rankings-earn-clicks… | 2026-08-22 | 6 d | not clicked 08-25 | Discovered | 0 | OAI-SearchBot, PerplexityBot, ClaudeBot, Amazonbot, YandexBot ×2 |
| /news/how-many-visitors-do-ai-engines-actually-send… | 2026-08-21 | 7 d | not clicked 08-25 | Discovered | 0 | PerplexityBot, ClaudeBot, Amazonbot |
| /news/what-are-iboubot-and-petalbot… | 2026-08-20 | 8 d | not clicked 08-25 | unknown to Google | 0 | bingbot ×6, PerplexityBot, ClaudeBot, Amazonbot |
| /news/five-external-visitors-in-74-days-reached-our-check-form… | 2026-08-25 | 3 d | published after the sweep | unknown to Google | 0 | OAI-SearchBot, ClaudeBot, Amazonbot, bingbot, YandexBot ×2 |
| /news/four-weekly-runs-576-ai-answers… | 2026-08-25 | 3 d | published after the sweep | Discovered | 0 | OAI-SearchBot, PerplexityBot, ClaudeBot, Amazonbot, YandexBot |
| /news/where-do-ai-crawlers-actually-go… | 2026-08-26 | 2 d | published after the sweep | Discovered | 0 | OAI-SearchBot, ClaudeBot, Amazonbot, bingbot, YandexBot |
| /news/does-googles-request-indexing-button-actually-work… | 2026-08-26 | 2 d | published after the sweep | unknown to Google | 0 | OAI-SearchBot, PerplexityBot, ClaudeBot, Amazonbot, YandexBot |
| /news/what-did-our-pitch-emails-actually-say… | 2026-08-27 | 1 d | published after the sweep | Discovered | 0 | OAI-SearchBot, PerplexityBot, ClaudeBot, Amazonbot, YandexBot ×2 |
| /news/fifteen-ai-referrals-in-76-days… | 2026-08-27 | 1 d | published after the sweep | unknown to Google | 0 | OAI-SearchBot, PerplexityBot, ClaudeBot, YandexBot |
| /news/did-chatgpt-stop-citing-reddit-on-august-14… | 2026-08-19 | 9 d | clicked 08-25, never fetched | unknown to Google | 0 | PerplexityBot ×2, ClaudeBot, Amazonbot |
The one variable we changed today, and its read date
The button is recorded as something that worked once. The task that pressed it ran from a scheduler that no longer exists on the machine, and we are not going to plan a publishing pipeline around a button with a daily quota that a person or a script has to press. So today, before this post, our engineer shipped the internal-linking change that had been prepared as one variable: the /news index is now grouped by month with dated sections, and every post carries `rel="next"` and `rel="prev"` links to its neighbours. We checked the neighbour links on the live 08-26 post before writing this. The read is pre-registered for 2026-09-11 on the same 14 URLs named above, and the rule is written: if at least 7 of the 14 are indexed by then, the hub stays; if 0 of the 14 are, internal linking is not what is holding these pages out, and no further link-shape work ships on this stall. Anything between is reported as inconclusive. The instrument is one command, `ops/verify/hub_read.mjs`, and its verdict line on 09-11 will be quoted as printed.
Why this matters if you care about AI visibility
- Being fetched once is the whole game for a small site's Google indexation. Twelve of twelve pages that Googlebot fetched went in on that fetch, clicked or not; fourteen pages it has not fetched are out, however they are labelled. If you track "Discovered - currently not indexed", track Googlebot requests in your own logs beside it; the label tells you less than the absence of a fetch does.
- The AI engines are not waiting for Google. Every one of the 14 unindexed pages was read by OpenAI's, Perplexity's or Anthropic's crawler inside the week, several by ChatGPT-User, which fires only when a ChatGPT user is actually shown the page. Whether an answer engine can cite you and whether Google has indexed you are separate questions with separate evidence, and the second does not gate the first.
- Do not read a lever off one good day. Two unrequested pages going in on the day Googlebot's requests doubled looks like a signal and might be noise; we have said which reading would settle it (09-11, 14 named URLs, a written bar) rather than declaring one. If a vendor tells you their change got your pages indexed, ask what the untouched pages did the same week.
If the question you actually have is whether the engines currently cite your business, before the question of which index it sits in, the free 60-second check asks four of them the way a customer would and shows you the sources they used.
Limits
- Nine unclicked and 11 clicked pages on one site. Two organic index events is a count of two; it separates "never happens" from "happens", nothing finer.
- Search Engine Roundtable reported on the morning of 2026-08-28 that site owners were seeing indexing or serving delays, with Google's Search Status Dashboard showing no incident; the dashboard's incident feed, read by us at 16:30 UTC, lists nothing after the August 2026 spam update, whose rollout completed 2026-08-21. Our two index events are dated 08-27, before those reports, and we saw no change on the 14 either way. We note it because a reader comparing their own 08-28 numbers should know the day was contested.
- The ledger trusts the user agent and does not reverse-DNS addresses. For the two organic index events the last-crawl time reported by Search Console agrees with the ledger row to within one second, which is the strongest confirmation we can get without a log-level reverse lookup.
- The three-day organic re-fetches of the clicked pages are ledger rows that Search Console does not reflect in its last-crawl field. One of the two instruments is describing something the other is not; we do not know which, and we have not asserted that the re-fetches changed anything.
- The 09-11 read tests internal linking as one variable on a live site where posts keep shipping daily. Six of the 14 are under four days old; some may go in for reasons that have nothing to do with the hub, which is why the bar is 7 of 14 and not 1.
Do pages get indexed by Google without clicking Request indexing?
Yes, on this site, 2 of 9 unindexed pages that nobody clicked were indexed within three days, each on a single organic Googlebot fetch on 2026-08-27. The other 7, and 6 newer posts, have had 0 Googlebot requests and are still not indexed.
Does Request indexing make Googlebot come back to the page afterward?
All 10 pages that were clicked and indexed on 2026-08-25 were re-fetched by Googlebot on its own within 72 hours, while the 13 pages that were never fetched drew 0 requests. But the re-fetches happened during a day when Googlebot's requests to the whole site doubled, so we cannot separate a click effect from a bigger crawl day on one reading.
Why does Search Console's last crawl time not update when Googlebot fetches the page again?
We do not know. Our server ledger shows organic Googlebot requests to all 10 indexed pages after the click, and Search Console's URL Inspection still reports the 2026-08-25 click-fetch second as the last crawl on every one. Either the field lags or those later requests are not the crawl Google records; we report both instruments and have not picked.
Is Discovered - currently not indexed different from URL is unknown to Google?
Not usefully, on our reads. The two labels swapped on 6 of 12 unindexed URLs between API calls four minutes apart on 2026-08-26, and none of the 14 unindexed URLs today has a single Googlebot request regardless of which label it carries. We count both as not indexed and watch fetches instead.
See your number
See which businesses AI names when your client's buyers ask.
Running this for clients? The $249 agency 5-pack audits five businesses, white-labeled.
Who runs this
- Built and operated by Sensara LLC, Atlanta, Georgia — about us and how the audit works.
- See what the report looks like before you run anything — score per engine, the competitors AI names instead of you, and a fix plan.
- We run the same audit on ourselves every week and publish the result: in the latest run AI named AskedAbout in 1 of 144 answers. We report our own numbers the way we report yours.