AI search news ·

Do pages you never request indexing for get indexed on their own? 2 of 9 went in on single organic Googlebot fetches in 3 days, 0 of the 13 pages Googlebot never fetched moved, and all 10 clicked pages were re-fetched within 72 hours

Three days after a scheduled task clicked "Request indexing" on 11 of our unindexed URLs and left 9 alone, the untreated side has moved: 2 of the 9 are now indexed, each on a single organic Googlebot fetch dated 2026-08-27, with no click, no task and no request behind it. The other 7, plus the 6 posts published since and the one clicked URL Googlebot never fetched, are 0 of 14 indexed, with 0 Googlebot requests between them in seven days, while every one of the 14 has been read by OpenAI's, Perplexity's, Anthropic's or Amazon's crawler in the same week. The 10 clicked URLs that went in on 2026-08-26 are still in, and Googlebot has re-fetched all 10 on its own since; Search Console still reports the click-fetch second as their last crawl. The two untreated pages went in on the day Googlebot's requests to this site doubled, so one reading cannot say whether the click primed anything or Googlebot simply had a bigger day. The counts, the per-URL tables, and the one variable we changed today are below.

What was pre-registered, and what was read

On 2026-08-26 we published the 27-hour reading of a Request-indexing test: 10 of 11 clicked URLs indexed, 0 of 9 unclicked. The decision rule had been written down before the data: read again on 2026-08-28, count M of 11 clicked and N of 9 unclicked, and treat M of 3 or more with N of 0 as "the button works". The rule also said what an N of 1 or more would mean: the comparison weakens, because pages were going in without the button. Today N is 2, so this post is the weakened reading, stated as counts, not a new claim about the button.

Everything below was read between 16:38 and 16:43 UTC on 2026-08-28 by two instruments: Search Console's URL-Inspection API for index state and last-crawl time, and our own crawler ledger for every request whose user agent names Googlebot (probe rows and spoofed rows excluded, as in every ledger read we publish). The 14-URL denominator, the 11 clicked URLs and the 9 unclicked ones are read from files written before today, not chosen this afternoon. The cut script and artifact are in our repository, `content/news/request_indexing_followup_cut.mjs` and `request-indexing-followup-cut-2026-08-28.json`, with 14 self-checks that assert every number in this post, including that the analyst's "Googlebot doubled" figure reproduces from the raw rows.

The read, as counts

Cohort on the 2026-08-25 morning sweepURLsIndexed 08-26 (27 h)Indexed 08-28 (75 h)Googlebot rows, trailing 7 dSearch Console last crawl
Clicked (Request indexing, 13:18 to 13:38 UTC)11101021 (10 click fetches + 11 organic re-fetches on the 10)the 08-25 click second, on all 10, unchanged
Not clicked9022 (one row per page that went in; 0 on the other 7)2026-08-27 12:35:15Z and 23:33:03Z, each equal to its ledger row
Published after the sweep (08-25 to 08-27)60 (2 existed)00none
The 14 not indexed today: 7 unclicked + 6 new + the clicked URL that never fetched1400none

The two that went in without a click

Both are posts from the week before the test, both read "Discovered - currently not indexed" on the 08-25 sweep, and both had 0 Googlebot requests on the ledger from 2026-08-18 to the 08-26 read. Each then drew exactly one Googlebot request on 2026-08-27, from a US address, and Search Console now reports that request as the last crawl, to the second. There was no click: the scheduled task that pressed the button on 08-25 has no directory on the machine it ran from, there is no sweep file after 08-25, and the ledger shows no click cadence on either day.

URL (shortened)Published08-25 sweep08-26 read08-28 readGooglebot rows since 08-20Search Console last crawl
/news/is-the-gptbot-in-your-server-logs-really-openai…2026-08-22DiscoveredDiscoveredSubmitted and indexed1: 2026-08-27 12:35:16Z (robots.txt one second earlier)2026-08-27T12:35:15Z
/news/does-googlebot-still-fetch-new-posts-on-publish…2026-08-21Discoveredunknown to GoogleSubmitted and indexed1: 2026-08-27 23:33:03Z2026-08-27T23:33:03Z

One fetch each, then indexed. That is the same shape as the clicked cohort: on this site, the first Googlebot content fetch of an unindexed page has been the fetch it went in on, 12 times out of 12 (10 clicked, 2 organic). The difference the button made was when the fetch happened, not whether a fetch was enough.

What Googlebot did on the day they went in

Googlebot's requests to this site, by UTC day, from the ledger. 2026-08-28 is the partial day to 16:22 UTC. "Paths" counts distinct URLs including robots.txt and sitemap.xml.

UTC dayGooglebot rowsDistinct pathsNote
2026-08-24116
2026-08-254018the click day: 10 click fetches, 21 robots.txt requests
2026-08-2627121 re-fetch of a clicked page, 5 homepage requests
2026-08-274929the 2 untreated pages went in; 4 clicked pages re-fetched; 8 other already-indexed posts fetched
2026-08-28 (to 16:22Z)28176 clicked pages re-fetched

Our analyst's standing 24-hour window (09:37 UTC to 09:37 UTC) read 53 rows over 32 paths for 08-27 to 08-28, against 27 over 15 the day before, and the raw rows reproduce that exactly. Where the doubled day went: 15 robots.txt requests, 3 sitemap requests, 10 requests to 9 already-indexed /news posts, 8 organic re-fetches of clicked pages, 7 to /guide pages, 5 to /compare pages, the 2 fetches that indexed the untreated pages, and 1 each to the homepage, a /for page and a /data page. Requests to the 14 pages that are not indexed: 0 of 53.

The ten clicked pages, three days on

All 10 are still indexed. Every one of them has since drawn at least one organic Googlebot request, between 27 hours and 69 hours after its click fetch, and one of them two. Search Console's last-crawl field did not move on any of them: it still reports the 08-25 click second. We do not know whether the inspection field lags, or whether these later requests are a kind of fetch Google does not count as the crawl of record. It is a difference between the two instruments, and we report both.

Clicked URL (shortened)Click fetch (ledger) = Search Console last crawlOrganic Googlebot requests since
/data/ai-visibility-benchmark-med-spas2026-08-25 13:21:21Z08-27 10:03Z, 08-28 10:23Z
/news/ai-engines-barely-share-cited-domains…13:23:19Z08-28 05:06Z
/news/yelp-openai-licensing…13:25:20Z08-27 23:17Z
/news/robots-txt-does-not-control-ai-visibility…13:27:17Z08-26 12:52Z
/news/did-your-search-console-generative-ai-impressions-drop…13:27:17Z08-28 08:53Z
/news/do-ai-crawlers-read-llms-txt…13:29:22Z08-28 05:05Z
/news/does-ai-cite-one-page-or-many…13:31:20Z08-28 10:06Z
/news/how-fast-do-ai-crawlers-fetch-a-new-page…13:31:20Z08-27 22:27Z
/news/did-chatgpt-stop-citing-reddit-on-august-14…no fetch, not indexednone
/news/does-ai-reuse-the-same-sources…13:33:31Z08-27 21:36Z
/news/does-chatgpt-send-visitors-to-pages-google-buries…13:37:32Z08-28 08:58Z

What one reading cannot separate

Two stories fit these numbers, and the data does not pick one. In the first, the clicks on 08-25 put 10 pages into Google's crawl schedule, Googlebot returned to all 10 within three days, and while it was on the site it also picked up two neighbouring posts that link to and from them. In the second, Googlebot had a bigger day for reasons of its own, 49 requests over 29 paths against a daily median of 26 for the prior week, and the two untreated pages were simply the ones its schedule reached; the re-fetches of the clicked pages were part of the same larger day. The control for both stories is the same: the 13 pages Googlebot has not requested at all. Under either story, they did not move, and a page that has never been fetched cannot be indexed.

The fourteen Googlebot has never fetched

Thirteen of these have 0 Googlebot requests since the ledger started watching them on 2026-08-18; the fourteenth is the clicked URL that drew no fetch and never went in. Every one of the fourteen was fetched in the same seven days by at least three of OpenAI's, Perplexity's, Anthropic's, Amazon's, Microsoft's and Yandex's crawlers. "Discovered" and "unknown to Google" are reported as read at 16:38 UTC; the 08-26 post showed those two labels swapping between API reads four minutes apart, so we count them together as not indexed and do not narrate the label.

URL (shortened)PublishedAge at readCohortSearch Console 08-28Googlebot rows, 7 dOther crawlers, 7 d
/news/can-chatgpt-send-a-reader-to-a-page-before-google-crawls-it…2026-08-244 dnot clicked 08-25Discovered0OAI-SearchBot, PerplexityBot, ClaudeBot, Amazonbot, bingbot, YandexBot
/news/do-new-ai-cited-sources-survive-a-week…2026-08-244 dnot clicked 08-25unknown to Google0OAI-SearchBot, ChatGPT-User, PerplexityBot, ClaudeBot, Amazonbot, bingbot, YandexBot
/news/what-queries-does-google-show-a-small-ai-search-site-for…2026-08-235 dnot clicked 08-25Discovered0OAI-SearchBot, PerplexityBot, ClaudeBot, Amazonbot, bingbot, YandexBot
/news/does-your-json-ld-still-parse…2026-08-235 dnot clicked 08-25unknown to Google0OAI-SearchBot ×2, ChatGPT-User, PerplexityBot, ClaudeBot, Amazonbot, YandexBot
/news/do-page-one-google-rankings-earn-clicks…2026-08-226 dnot clicked 08-25Discovered0OAI-SearchBot, PerplexityBot, ClaudeBot, Amazonbot, YandexBot ×2
/news/how-many-visitors-do-ai-engines-actually-send…2026-08-217 dnot clicked 08-25Discovered0PerplexityBot, ClaudeBot, Amazonbot
/news/what-are-iboubot-and-petalbot…2026-08-208 dnot clicked 08-25unknown to Google0bingbot ×6, PerplexityBot, ClaudeBot, Amazonbot
/news/five-external-visitors-in-74-days-reached-our-check-form…2026-08-253 dpublished after the sweepunknown to Google0OAI-SearchBot, ClaudeBot, Amazonbot, bingbot, YandexBot ×2
/news/four-weekly-runs-576-ai-answers…2026-08-253 dpublished after the sweepDiscovered0OAI-SearchBot, PerplexityBot, ClaudeBot, Amazonbot, YandexBot
/news/where-do-ai-crawlers-actually-go…2026-08-262 dpublished after the sweepDiscovered0OAI-SearchBot, ClaudeBot, Amazonbot, bingbot, YandexBot
/news/does-googles-request-indexing-button-actually-work…2026-08-262 dpublished after the sweepunknown to Google0OAI-SearchBot, PerplexityBot, ClaudeBot, Amazonbot, YandexBot
/news/what-did-our-pitch-emails-actually-say…2026-08-271 dpublished after the sweepDiscovered0OAI-SearchBot, PerplexityBot, ClaudeBot, Amazonbot, YandexBot ×2
/news/fifteen-ai-referrals-in-76-days…2026-08-271 dpublished after the sweepunknown to Google0OAI-SearchBot, PerplexityBot, ClaudeBot, YandexBot
/news/did-chatgpt-stop-citing-reddit-on-august-14…2026-08-199 dclicked 08-25, never fetchedunknown to Google0PerplexityBot ×2, ClaudeBot, Amazonbot

The one variable we changed today, and its read date

The button is recorded as something that worked once. The task that pressed it ran from a scheduler that no longer exists on the machine, and we are not going to plan a publishing pipeline around a button with a daily quota that a person or a script has to press. So today, before this post, our engineer shipped the internal-linking change that had been prepared as one variable: the /news index is now grouped by month with dated sections, and every post carries `rel="next"` and `rel="prev"` links to its neighbours. We checked the neighbour links on the live 08-26 post before writing this. The read is pre-registered for 2026-09-11 on the same 14 URLs named above, and the rule is written: if at least 7 of the 14 are indexed by then, the hub stays; if 0 of the 14 are, internal linking is not what is holding these pages out, and no further link-shape work ships on this stall. Anything between is reported as inconclusive. The instrument is one command, `ops/verify/hub_read.mjs`, and its verdict line on 09-11 will be quoted as printed.

Why this matters if you care about AI visibility

If the question you actually have is whether the engines currently cite your business, before the question of which index it sits in, the free 60-second check asks four of them the way a customer would and shows you the sources they used.

Limits

Do pages get indexed by Google without clicking Request indexing?

Yes, on this site, 2 of 9 unindexed pages that nobody clicked were indexed within three days, each on a single organic Googlebot fetch on 2026-08-27. The other 7, and 6 newer posts, have had 0 Googlebot requests and are still not indexed.

Does Request indexing make Googlebot come back to the page afterward?

All 10 pages that were clicked and indexed on 2026-08-25 were re-fetched by Googlebot on its own within 72 hours, while the 13 pages that were never fetched drew 0 requests. But the re-fetches happened during a day when Googlebot's requests to the whole site doubled, so we cannot separate a click effect from a bigger crawl day on one reading.

Why does Search Console's last crawl time not update when Googlebot fetches the page again?

We do not know. Our server ledger shows organic Googlebot requests to all 10 indexed pages after the click, and Search Console's URL Inspection still reports the 2026-08-25 click-fetch second as the last crawl on every one. Either the field lags or those later requests are not the crawl Google records; we report both instruments and have not picked.

Is Discovered - currently not indexed different from URL is unknown to Google?

Not usefully, on our reads. The two labels swapped on 6 of 12 unindexed URLs between API calls four minutes apart on 2026-08-26, and none of the 14 unindexed URLs today has a single Googlebot request regardless of which label it carries. We count both as not indexed and watch fetches instead.

See your number

See which businesses AI names when your client's buyers ask.

Running this for clients? The $249 agency 5-pack audits five businesses, white-labeled.

Check a client's AI visibility

Begin your check

Free · 60 sec

No account · No card · 3 buyer questions, 2 engines

By running a check you agree to our Terms and Privacy Policy.

Who runs this