AI search news ·
PerplexityBot fetched 60 of our 179 URLs in two bursts of 9 and 20 minutes, and 4 of our 5 newest posts inside 21 hours. Googlebot fetched 14 paths in the same 29 hours and none of the 5
Between 09-06 12:17 UTC and 09-07 07:43 UTC, PerplexityBot requested 60 distinct paths on askedabout.com, 33% of the 179 URLs in the live sitemap, in two bursts: 44 rows in 9 minutes and 17 rows in 20 minutes. It was the crawler's second whole-site sweep in 5.3 days; the first, on 09-01, covered 36 paths. Between sweeps it fetched two paths a day, one of them robots.txt. The sweep reached 4 of the 5 posts we published since 09-05, between 14.4 and 20.4 hours after each went live; the fifth had been live 2.8 hours at the read. In the same 28.5 hours Googlebot logged 39 rows on 14 paths, 18 of them robots.txt and 3 the sitemap, and fetched none of the 5 newest posts. The same day's citation gauge, run 5.4 hours after the sweep ended, had Perplexity citing us in 3 of 36 answers on one page, the same 3 of 36 and the same page as the week before. Method, every table and the artifact are below.
Method, stated before the numbers
Every request to askedabout.com from a bot-shaped user agent is written to a ledger with the path, the vendor and kind the shipped classifier assigns, and a timestamp; our own probe rows are tagged and excluded from every count here. This read pulled the seven days to 09-07 16:49 UTC: 3279 rows, 78 of them probes, 3201 net, under the pull's 5000-row cap so nothing was dropped. A burst is a run of PerplexityBot rows with no gap over 60 minutes. A sweep is any burst of 10 or more rows; the sweep under study is every such burst on 09-06 and 09-07, and the comparison window runs from its first row to the read, 28.5 hours. Per-post counts come from the uncapped per-path index since each post's ship commit, with vendors joined from the capped pull; the two counts are asserted equal for every post. The citation gauge is the weekly 12-question, 4-engine, 3-sample self-audit, read from its stored answers.
The computation is the committed script `content/news/perplexity_sweep_cut.mjs`; it writes `content/news/perplexity-sweep-cut-2026-09-07.json` and this post's text is generated from that file. 21 of 21 self-checks pass, including the cap, the newest-row age, the per-post count agreement and the sitemap membership of every swept path.
PerplexityBot's seven days: 118 rows, 78 distinct paths, three sweeps
| Burst (first row, UTC) | Last row | Minutes | Rows | Distinct paths | Paths by class |
|---|---|---|---|---|---|
| 2026-09-01 05:01:37 UTC | 05:02 UTC | 1 | 25 | 25 | /robots.txt 1 · /news 15 · /for 1 · /refund-policy 1 · /compare 4 · / 1 · /about 1 · /library 1 |
| 2026-09-01 08:03:25 UTC | 08:03 UTC | 0.1 | 8 | 8 | /guide 2 · /for 2 · /data 3 · /privacy-policy 1 |
| 2026-09-01 12:58:17 UTC | 12:58 UTC | 0.3 | 12 | 12 | /news 2 · /robots.txt 1 · /guide 4 · /data 4 · /for 1 |
| 2026-09-01 21:34:54 UTC | 21:34 UTC | 0 | 2 | 2 | /guide 1 · /robots.txt 1 |
| 2026-09-03 03:48:51 UTC | 03:48 UTC | 0 | 2 | 2 | /robots.txt 1 · / 1 |
| 2026-09-03 19:30:10 UTC | 19:30 UTC | 0 | 2 | 2 | /robots.txt 1 · /news 1 |
| 2026-09-04 21:35:52 UTC | 21:35 UTC | 0 | 2 | 2 | /robots.txt 1 · /guide 1 |
| 2026-09-05 19:11:56 UTC | 19:11 UTC | 0 | 2 | 2 | /guide 1 · /robots.txt 1 |
| 2026-09-06 12:17:16 UTC | 12:26 UTC | 9 | 44 | 44 | /news 24 · /robots.txt 1 · / 1 · /library 1 · /about 1 · /for 3 · /guide 4 · /data 3 · /compare 5 · /agency-5-pack 1 |
| 2026-09-07 07:23:43 UTC | 07:43 UTC | 20.1 | 17 | 17 | /news 3 · /robots.txt 1 · /compare 1 · /for 2 · /terms 1 · /guide 5 · /data 4 |
| 2026-09-07 14:54:38 UTC | 14:54 UTC | 0 | 2 | 2 | /compare 1 · /robots.txt 1 |
Two shapes. Eight of the 11 bursts are two rows: robots.txt plus one page, most days at least once. The other three are the sweeps: 37 rows across two bursts on 09-01 (36 paths), 44 rows in 9 minutes on 09-06, 17 rows in 20 minutes on 09-07. The 09-06 and 09-07 bursts overlap on one path only, robots.txt; together they are 60 distinct paths, 59 of them in the sitemap (33% of 179): /news 27, /robots.txt 1, / 1, /library 1, /about 1, /for 5, /guide 9, /data 7, /compare 6, /agency-5-pack 1, /terms 1. Nothing on our side changed between the two sweeps that would ask for one: PerplexityBot fetched the sitemap 0 times in the seven days, so the sweeps do not start from it.
Every crawler in the same 28.5 hours
| Crawler (vendor/kind as classified) | Rows | Distinct paths | Distinct /news posts |
|---|---|---|---|
| Meta (facebookexternalhit / meta-externalagent) (meta/crawl) | 573 | 72 | 28 |
| other bot-shaped agents (SEO-tool crawlers, unnamed) (other/other) | 127 | 73 | 53 |
| PerplexityBot (perplexity/crawl) | 63 | 60 | 26 |
| ChatGPT-User (openai/user) | 44 | 15 | 11 |
| Googlebot (google/search) | 39 | 14 | 9 |
| Amazonbot (amazon/crawl) | 34 | 34 | 26 |
| GPTBot / OAI-SearchBot (openai/crawl) | 33 | 22 | 10 |
| YandexBot (yandex/search) | 32 | 5 | 3 |
| bingbot (microsoft/search) | 17 | 10 | 6 |
| Applebot (apple/crawl) | 13 | 11 | 7 |
| ClaudeBot (anthropic/crawl) | 7 | 5 | 3 |
| Claude-User (anthropic/user) | 1 | 1 | 1 |
Rows and reach are different numbers. Meta's crawler logged 573 rows on 72 paths, re-fetching the same pages; PerplexityBot logged 63 rows on 60 paths, one request per page. Amazonbot took the same shape on a smaller scale (34 rows, 34 paths). Googlebot's 39 rows are 14 paths: robots.txt 18 times, the sitemap 3 times, 9 /news posts (all published before 2026-09-05), one /guide, one /compare and one /data page.
The 5 newest posts: PerplexityBot 4, Googlebot 0
| Post (slug, truncated) | Shipped (UTC) | Hours live at read | PerplexityBot first fetch (hours after ship) | Googlebot rows | All crawler rows | Vendors that fetched it inside 24 h |
|---|---|---|---|---|---|---|
| new-ai-cited-domains-survived-a-week-at-35-percent-87-of-248… | 09-07 14:02 UTC | 2.8 | none yet (2.8 h live) | 0 | 2 | YandexBot, ClaudeBot |
| how-long-does-a-new-page-stay-discovered-not-indexed-before-… | 09-06 16:58 UTC | 23.9 | 09-07 07:23 UTC (14.4) | 0 | 7 | GPTBot / OAI-SearchBot, PerplexityBot, other bot-shaped agents, Meta, ClaudeBot, Amazonbot |
| cold-pitch-emails-by-touch-107-emails-to-66-named-people-at-… | 09-06 14:17 UTC | 26.5 | 09-07 07:23 UTC (17.1) | 0 | 6 | GPTBot / OAI-SearchBot, YandexBot, Meta, other bot-shaped agents, PerplexityBot |
| a-page-with-one-google-impression-in-28-days-took-three-refe… | 09-05 16:56 UTC | 47.9 | 09-06 12:17 UTC (19.4) | 0 | 18 | ClaudeBot, GPTBot / OAI-SearchBot, Meta, Amazonbot, PerplexityBot |
| cold-email-opens-by-recipient-mail-provider-0-of-21-google-h… | 09-05 15:50 UTC | 49 | 09-06 12:17 UTC (20.4) | 0 | 11 | ClaudeBot, Meta, GPTBot / OAI-SearchBot, other bot-shaped agents, PerplexityBot |
The four posts live for more than a day were each fetched once by PerplexityBot, inside the sweep, 14.4 to 20.4 hours after publish; the sweep did the new-page discovery, not a separate fetch. The newest post had been live 2.8 hours at the read and had 2 rows, YandexBot and ClaudeBot. Googlebot has 0 rows on the 5. This repeats the 09-01 read, where four AI crawlers fetched a new post inside nine hours and Googlebot had not fetched it in seven days.
Googlebot's one new index this run, read the same way
On the 14-URL index we pre-registered on 08-28, day 11: 3 of 14 indexed, verdict "INCONCLUSIVE — 3 of 14 indexed, under the bar of 7 and above 0". The new one is `what-queries-does-google-show-a-small-ai-search-site-for-83-of-2…`: Search Console lastCrawlTime 2026-09-07T12:42:09Z, matching a Googlebot row in our ledger to the second, and "Submitted and indexed" at the 16:39 UTC read, under four hours later. That row is the path's first Googlebot row since the index shipped on 08-28, and it is the second post on this index to go from its first Googlebot fetch to indexed inside a day, after yesterday's. Over the same seven days PerplexityBot fetched 5 of the 14 and Googlebot 3; the 11 not indexed have 0 Googlebot rows in seven days.
The citation gauge the same day, beside the sweep and not scored
| Gauge run (UTC) | Perplexity answers | Answers citing askedabout.com | Distinct askedabout paths cited | Perplexity source URLs in the run | All four engines citing us |
|---|---|---|---|---|---|
| 09-07 13:10 UTC | 36 | 3 | /compare/best-profound-alternatives | 717 | 5 |
| 08-31 13:11 UTC | 36 | 3 | /compare/best-profound-alternatives | 708 | 8 |
The weekly gauge ran 5.4 hours after the sweep's last row. Perplexity cited us in 3 of 36 answers, all on `/compare/best-profound-alternatives`, the same count and the same page as the 08-31 run. That page was in the sweep (3 PerplexityBot rows in seven days). 60 paths fetched, 1 path cited, and the cited set did not move. We report the two side by side because they land on the same day; a 12-question panel cannot attribute a citation to a crawl, and this post does not.
What this means for a business that wants to be found by AI engines
- Perplexity refreshes its copy of a small site in whole-site bursts days apart, not page by page. A new page here was in PerplexityBot's log within 21 hours because a sweep happened to land; between sweeps the crawler fetched two paths a day. If your page is new, the question is when the next sweep runs, and our ledger says 5.3 days between the last two. How Perplexity picks what it cites is a separate question from whether it has your page.
- Being fetched is not being cited. 60 of our paths were fetched and the same one page was cited 3 of 36 times the same afternoon, as it was the week before. Crawler rows are evidence of access, not of visibility; the only way to know what an engine says about your business is to ask it, on a schedule. You can run that check on your own business.
- Googlebot is the outlier on a small site. 39 rows in 28.5 hours, 18 of them robots.txt, none on the 5 newest posts, while at least 5 vendors fetched each of the four day-old posts inside 24 hours. When Google does fetch a post here, it has indexed it the same day twice running; the wait is for the fetch.
Limits
- Vendor is the user-agent string as classified; rows are not reverse-DNS verified. PerplexityBot's declared token was `PerplexityBot/1.0` on every row.
- The 60-minute burst rule and the 10-row sweep floor are this post's definitions, chosen before the tables were drawn; the 09-07 burst counted as part of one sweep with 09-06 because they overlap on robots.txt only and together cover the site.
- One site, one week, three sweeps. 5.3 days between sweeps is one interval, not a cadence.
- The window (28.5 hours) starts at the sweep's first row, so it is drawn around PerplexityBot; every other vendor's count is over the same clock, not over a window drawn for it.
- The user-agent pull is capped at 5000 rows and returned 3279; the per-post totals come from the uncapped index and agree.
- The gauge comparison is two runs, seven days apart, on one page. Nothing here scores the sweep's effect on citations; the pre-committed read below does.
Trailing indexation, read the same run
The 8 posts published 2026-09-04 to 09-07 were inspected in the same run: 5 "Discovered, not indexed", 3 unknown to Google, 0 indexed, 0 with a lastCrawlTime, 0 Googlebot rows on their paths since publish against 87 rows from other crawlers. PerplexityBot has fetched 7 of the 8.
| Post (slug, truncated) | Published | HTTP | URL Inspection state at read | Googlebot rows since publish | All crawler rows since publish |
|---|---|---|---|---|---|
| new-ai-cited-domains-survived-a-week-at-35-percent-87-of-248… | 2026-09-07 | 200 | Discovered, not indexed | 0 | 4 |
| how-long-does-a-new-page-stay-discovered-not-indexed-before-… | 2026-09-06 | 200 | Discovered, not indexed | 0 | 9 |
| cold-pitch-emails-by-touch-107-emails-to-66-named-people-at-… | 2026-09-06 | 200 | Unknown to Google | 0 | 7 |
| a-page-with-one-google-impression-in-28-days-took-three-refe… | 2026-09-05 | 200 | Discovered, not indexed | 0 | 19 |
| cold-email-opens-by-recipient-mail-provider-0-of-21-google-h… | 2026-09-05 | 200 | Discovered, not indexed | 0 | 12 |
| why-did-googles-ai-mode-stop-citing-sources-on-gemini-3-8-fl… | 2026-09-04 | 200 | Unknown to Google | 0 | 14 |
| six-google-clicks-in-8-landed-days-against-a-bar-of-25-in-28… | 2026-09-04 | 200 | Discovered, not indexed | 0 | 11 |
| a-cold-email-restart-at-48-hours-41-sends-to-31-agencies-3-o… | 2026-09-04 | 200 | Unknown to Google | 0 | 11 |
The next reading, pre-committed
2026-09-14: The 2026-09-14 13:07 UTC gauge run (run 7): Perplexity's answers citing askedabout.com out of 36, and the cited paths, reported beside whether PerplexityBot swept again in the seven days between (a sweep = a burst of 10 or more rows). Pre-registered falsification: if a second sweep lands and Perplexity's cited-path set is unchanged from run 6, sweeps are not adding cited pages on this panel; if the set grows without a sweep, the sweep is not the mechanism either. Also 2026-09-11: the pre-registered 14-URL hub read (bar 7 indexed). Published either way.
How often does PerplexityBot crawl a small site?
On this site, in whole-site sweeps: 36 paths on 09-01 and 60 paths across 09-06 and 09-07, 5.3 days apart, each burst finishing in minutes. Between sweeps it fetched about two paths a day, one of them robots.txt.
Does PerplexityBot fetch new posts before Googlebot does?
Here, yes, every time so far. The four posts live for more than a day were fetched by PerplexityBot 14.4 to 20.4 hours after publish, inside the sweep; Googlebot has 0 rows on all 5 newest posts. At least 4 other vendors fetched each of the four inside 24 hours.
Does a full crawl by Perplexity mean it will cite the site?
Not on this evidence. After 60 paths were fetched, Perplexity cited us in 3 of 36 sampled answers on one page, the same as the week before. Fetching is access; citation is a separate decision made at answer time.
See your number
See which businesses AI names when your client's buyers ask.
Running this for clients? The $249 agency 5-pack audits five businesses, white-labeled.
Who runs this
- Built and operated by Sensara LLC, Atlanta, Georgia — about us and how the audit works.
- See what the report looks like before you run anything — score per engine, the competitors AI names instead of you, and a fix plan.
- We run the same audit on ourselves every week and publish the result: in the latest run AI named AskedAbout in 1 of 144 answers. We report our own numbers the way we report yours.