AI search news ·

PerplexityBot fetched 60 of our 179 URLs in two bursts of 9 and 20 minutes, and 4 of our 5 newest posts inside 21 hours. Googlebot fetched 14 paths in the same 29 hours and none of the 5

Between 09-06 12:17 UTC and 09-07 07:43 UTC, PerplexityBot requested 60 distinct paths on askedabout.com, 33% of the 179 URLs in the live sitemap, in two bursts: 44 rows in 9 minutes and 17 rows in 20 minutes. It was the crawler's second whole-site sweep in 5.3 days; the first, on 09-01, covered 36 paths. Between sweeps it fetched two paths a day, one of them robots.txt. The sweep reached 4 of the 5 posts we published since 09-05, between 14.4 and 20.4 hours after each went live; the fifth had been live 2.8 hours at the read. In the same 28.5 hours Googlebot logged 39 rows on 14 paths, 18 of them robots.txt and 3 the sitemap, and fetched none of the 5 newest posts. The same day's citation gauge, run 5.4 hours after the sweep ended, had Perplexity citing us in 3 of 36 answers on one page, the same 3 of 36 and the same page as the week before. Method, every table and the artifact are below.

Method, stated before the numbers

Every request to askedabout.com from a bot-shaped user agent is written to a ledger with the path, the vendor and kind the shipped classifier assigns, and a timestamp; our own probe rows are tagged and excluded from every count here. This read pulled the seven days to 09-07 16:49 UTC: 3279 rows, 78 of them probes, 3201 net, under the pull's 5000-row cap so nothing was dropped. A burst is a run of PerplexityBot rows with no gap over 60 minutes. A sweep is any burst of 10 or more rows; the sweep under study is every such burst on 09-06 and 09-07, and the comparison window runs from its first row to the read, 28.5 hours. Per-post counts come from the uncapped per-path index since each post's ship commit, with vendors joined from the capped pull; the two counts are asserted equal for every post. The citation gauge is the weekly 12-question, 4-engine, 3-sample self-audit, read from its stored answers.

The computation is the committed script `content/news/perplexity_sweep_cut.mjs`; it writes `content/news/perplexity-sweep-cut-2026-09-07.json` and this post's text is generated from that file. 21 of 21 self-checks pass, including the cap, the newest-row age, the per-post count agreement and the sitemap membership of every swept path.

PerplexityBot's seven days: 118 rows, 78 distinct paths, three sweeps

Burst (first row, UTC)Last rowMinutesRowsDistinct pathsPaths by class
2026-09-01 05:01:37 UTC05:02 UTC12525/robots.txt 1 · /news 15 · /for 1 · /refund-policy 1 · /compare 4 · / 1 · /about 1 · /library 1
2026-09-01 08:03:25 UTC08:03 UTC0.188/guide 2 · /for 2 · /data 3 · /privacy-policy 1
2026-09-01 12:58:17 UTC12:58 UTC0.31212/news 2 · /robots.txt 1 · /guide 4 · /data 4 · /for 1
2026-09-01 21:34:54 UTC21:34 UTC022/guide 1 · /robots.txt 1
2026-09-03 03:48:51 UTC03:48 UTC022/robots.txt 1 · / 1
2026-09-03 19:30:10 UTC19:30 UTC022/robots.txt 1 · /news 1
2026-09-04 21:35:52 UTC21:35 UTC022/robots.txt 1 · /guide 1
2026-09-05 19:11:56 UTC19:11 UTC022/guide 1 · /robots.txt 1
2026-09-06 12:17:16 UTC12:26 UTC94444/news 24 · /robots.txt 1 · / 1 · /library 1 · /about 1 · /for 3 · /guide 4 · /data 3 · /compare 5 · /agency-5-pack 1
2026-09-07 07:23:43 UTC07:43 UTC20.11717/news 3 · /robots.txt 1 · /compare 1 · /for 2 · /terms 1 · /guide 5 · /data 4
2026-09-07 14:54:38 UTC14:54 UTC022/compare 1 · /robots.txt 1

Two shapes. Eight of the 11 bursts are two rows: robots.txt plus one page, most days at least once. The other three are the sweeps: 37 rows across two bursts on 09-01 (36 paths), 44 rows in 9 minutes on 09-06, 17 rows in 20 minutes on 09-07. The 09-06 and 09-07 bursts overlap on one path only, robots.txt; together they are 60 distinct paths, 59 of them in the sitemap (33% of 179): /news 27, /robots.txt 1, / 1, /library 1, /about 1, /for 5, /guide 9, /data 7, /compare 6, /agency-5-pack 1, /terms 1. Nothing on our side changed between the two sweeps that would ask for one: PerplexityBot fetched the sitemap 0 times in the seven days, so the sweeps do not start from it.

Every crawler in the same 28.5 hours

Crawler (vendor/kind as classified)RowsDistinct pathsDistinct /news posts
Meta (facebookexternalhit / meta-externalagent) (meta/crawl)5737228
other bot-shaped agents (SEO-tool crawlers, unnamed) (other/other)1277353
PerplexityBot (perplexity/crawl)636026
ChatGPT-User (openai/user)441511
Googlebot (google/search)39149
Amazonbot (amazon/crawl)343426
GPTBot / OAI-SearchBot (openai/crawl)332210
YandexBot (yandex/search)3253
bingbot (microsoft/search)17106
Applebot (apple/crawl)13117
ClaudeBot (anthropic/crawl)753
Claude-User (anthropic/user)111

Rows and reach are different numbers. Meta's crawler logged 573 rows on 72 paths, re-fetching the same pages; PerplexityBot logged 63 rows on 60 paths, one request per page. Amazonbot took the same shape on a smaller scale (34 rows, 34 paths). Googlebot's 39 rows are 14 paths: robots.txt 18 times, the sitemap 3 times, 9 /news posts (all published before 2026-09-05), one /guide, one /compare and one /data page.

The 5 newest posts: PerplexityBot 4, Googlebot 0

Post (slug, truncated)Shipped (UTC)Hours live at readPerplexityBot first fetch (hours after ship)Googlebot rowsAll crawler rowsVendors that fetched it inside 24 h
new-ai-cited-domains-survived-a-week-at-35-percent-87-of-248…09-07 14:02 UTC2.8none yet (2.8 h live)02YandexBot, ClaudeBot
how-long-does-a-new-page-stay-discovered-not-indexed-before-…09-06 16:58 UTC23.909-07 07:23 UTC (14.4)07GPTBot / OAI-SearchBot, PerplexityBot, other bot-shaped agents, Meta, ClaudeBot, Amazonbot
cold-pitch-emails-by-touch-107-emails-to-66-named-people-at-…09-06 14:17 UTC26.509-07 07:23 UTC (17.1)06GPTBot / OAI-SearchBot, YandexBot, Meta, other bot-shaped agents, PerplexityBot
a-page-with-one-google-impression-in-28-days-took-three-refe…09-05 16:56 UTC47.909-06 12:17 UTC (19.4)018ClaudeBot, GPTBot / OAI-SearchBot, Meta, Amazonbot, PerplexityBot
cold-email-opens-by-recipient-mail-provider-0-of-21-google-h…09-05 15:50 UTC4909-06 12:17 UTC (20.4)011ClaudeBot, Meta, GPTBot / OAI-SearchBot, other bot-shaped agents, PerplexityBot

The four posts live for more than a day were each fetched once by PerplexityBot, inside the sweep, 14.4 to 20.4 hours after publish; the sweep did the new-page discovery, not a separate fetch. The newest post had been live 2.8 hours at the read and had 2 rows, YandexBot and ClaudeBot. Googlebot has 0 rows on the 5. This repeats the 09-01 read, where four AI crawlers fetched a new post inside nine hours and Googlebot had not fetched it in seven days.

Googlebot's one new index this run, read the same way

On the 14-URL index we pre-registered on 08-28, day 11: 3 of 14 indexed, verdict "INCONCLUSIVE — 3 of 14 indexed, under the bar of 7 and above 0". The new one is `what-queries-does-google-show-a-small-ai-search-site-for-83-of-2…`: Search Console lastCrawlTime 2026-09-07T12:42:09Z, matching a Googlebot row in our ledger to the second, and "Submitted and indexed" at the 16:39 UTC read, under four hours later. That row is the path's first Googlebot row since the index shipped on 08-28, and it is the second post on this index to go from its first Googlebot fetch to indexed inside a day, after yesterday's. Over the same seven days PerplexityBot fetched 5 of the 14 and Googlebot 3; the 11 not indexed have 0 Googlebot rows in seven days.

The citation gauge the same day, beside the sweep and not scored

Gauge run (UTC)Perplexity answersAnswers citing askedabout.comDistinct askedabout paths citedPerplexity source URLs in the runAll four engines citing us
09-07 13:10 UTC363/compare/best-profound-alternatives7175
08-31 13:11 UTC363/compare/best-profound-alternatives7088

The weekly gauge ran 5.4 hours after the sweep's last row. Perplexity cited us in 3 of 36 answers, all on `/compare/best-profound-alternatives`, the same count and the same page as the 08-31 run. That page was in the sweep (3 PerplexityBot rows in seven days). 60 paths fetched, 1 path cited, and the cited set did not move. We report the two side by side because they land on the same day; a 12-question panel cannot attribute a citation to a crawl, and this post does not.

What this means for a business that wants to be found by AI engines

Limits

Trailing indexation, read the same run

The 8 posts published 2026-09-04 to 09-07 were inspected in the same run: 5 "Discovered, not indexed", 3 unknown to Google, 0 indexed, 0 with a lastCrawlTime, 0 Googlebot rows on their paths since publish against 87 rows from other crawlers. PerplexityBot has fetched 7 of the 8.

Post (slug, truncated)PublishedHTTPURL Inspection state at readGooglebot rows since publishAll crawler rows since publish
new-ai-cited-domains-survived-a-week-at-35-percent-87-of-248…2026-09-07200Discovered, not indexed04
how-long-does-a-new-page-stay-discovered-not-indexed-before-…2026-09-06200Discovered, not indexed09
cold-pitch-emails-by-touch-107-emails-to-66-named-people-at-…2026-09-06200Unknown to Google07
a-page-with-one-google-impression-in-28-days-took-three-refe…2026-09-05200Discovered, not indexed019
cold-email-opens-by-recipient-mail-provider-0-of-21-google-h…2026-09-05200Discovered, not indexed012
why-did-googles-ai-mode-stop-citing-sources-on-gemini-3-8-fl…2026-09-04200Unknown to Google014
six-google-clicks-in-8-landed-days-against-a-bar-of-25-in-28…2026-09-04200Discovered, not indexed011
a-cold-email-restart-at-48-hours-41-sends-to-31-agencies-3-o…2026-09-04200Unknown to Google011

The next reading, pre-committed

2026-09-14: The 2026-09-14 13:07 UTC gauge run (run 7): Perplexity's answers citing askedabout.com out of 36, and the cited paths, reported beside whether PerplexityBot swept again in the seven days between (a sweep = a burst of 10 or more rows). Pre-registered falsification: if a second sweep lands and Perplexity's cited-path set is unchanged from run 6, sweeps are not adding cited pages on this panel; if the set grows without a sweep, the sweep is not the mechanism either. Also 2026-09-11: the pre-registered 14-URL hub read (bar 7 indexed). Published either way.

How often does PerplexityBot crawl a small site?

On this site, in whole-site sweeps: 36 paths on 09-01 and 60 paths across 09-06 and 09-07, 5.3 days apart, each burst finishing in minutes. Between sweeps it fetched about two paths a day, one of them robots.txt.

Does PerplexityBot fetch new posts before Googlebot does?

Here, yes, every time so far. The four posts live for more than a day were fetched by PerplexityBot 14.4 to 20.4 hours after publish, inside the sweep; Googlebot has 0 rows on all 5 newest posts. At least 4 other vendors fetched each of the four inside 24 hours.

Does a full crawl by Perplexity mean it will cite the site?

Not on this evidence. After 60 paths were fetched, Perplexity cited us in 3 of 36 sampled answers on one page, the same as the week before. Fetching is access; citation is a separate decision made at answer time.

See your number

See which businesses AI names when your client's buyers ask.

Running this for clients? The $249 agency 5-pack audits five businesses, white-labeled.

Check a client's AI visibility

Begin your check

Free · 60 sec

No account · No card · 3 buyer questions, 2 engines

By running a check you agree to our Terms and Privacy Policy.

Who runs this