Snapshots for 2026-10
2026-10, day by day.
This month is complete. Each day below lists its facts and a table of crawler requests. The numbers come from one website. They describe what these crawlers did here, not across the web.
This page is also available as JSON, Markdown and CSV. Cite as: Benes, Peter. Rattlesnakes By Mail: A Field Guide to the Crawlers of the Web. benesthemenace.com. Licence CC BY 4.0.
2026-10-01
- F-261001-01 An MCP client named agent-index-prober first called list_changes on 2026-10-01. Source
- F-261001-02 An MCP client named Tendle first called list_changes on 2026-10-01. Source
- F-261001-03 Every request on 2026-10-01 from ClaudeBot, Bingbot, GPTBot, OAI-SearchBot and Googlebot was verified against the operator's published method. Source
2026-10-02
- F-261002-01 PerplexityBot has made no requests since 2026-09-25, 7 days. Source
- F-261002-02 ClaudeBot fetched /.well-known/agent-card.json on 2026-10-02; it is the first crawler to do so here. Source
- F-261002-03 Every request on 2026-10-02 from ClaudeBot, Bingbot, GPTBot, Googlebot and OAI-SearchBot was verified against the operator's published method. Source
2026-10-03
- F-261003-01 Bingbot made 14 requests on 2026-10-03, 7 times its 28-day median of 2. Source
- F-261003-02 Every request on 2026-10-03 from ClaudeBot, Bingbot, GPTBot and OAI-SearchBot was verified against the operator's published method. Source
- F-261003-03 4 crawlers made 67 requests on 2026-10-03; ClaudeBot made the most, with 48. Source
2026-10-04
- F-261004-01 PerplexityBot returned on 2026-10-04 after 8 days without a request. Source
- F-261004-02 ChatGPT-User has made no requests since 2026-09-27, 7 days. Source
- F-261004-03 Claude-User has made no requests since 2026-09-20, 14 days. Source
- F-261004-04 GoogleOther has made no requests since 2026-09-27, 7 days. Source
- F-261004-05 PerplexityBot requested a JSON file for the first time on 2026-10-04. Source
- F-261004-06 Every request on 2026-10-04 from ClaudeBot, Googlebot, Bingbot, OAI-SearchBot and GPTBot was verified against the operator's published method. Source
2026-10-05
- F-261005-01 GoogleOther returned on 2026-10-05 after 7 days without a request. Source
- F-261005-02 An MCP client named smithery-explore first called list_changes on 2026-10-05. Source
- F-261005-03 Every request on 2026-10-05 from ClaudeBot, Googlebot, Bingbot, GoogleOther and GPTBot was verified against the operator's published method. Source
2026-10-06
- F-261006-01 Applebot has made no requests since 2026-09-29, 7 days. Source
- F-261006-02 An MCP client named FaceabotProbe first called list_changes on 2026-10-06. Source
- F-261006-03 Every request on 2026-10-06 from ClaudeBot, Googlebot, Bingbot, GPTBot and OAI-SearchBot was verified against the operator's published method. Source
2026-10-07
- F-261007-01 Bingbot made 11 requests on 2026-10-07, 5.5 times its 28-day median of 2. Source
- F-261007-02 An MCP client named BrickBlueBot first called list_changes on 2026-10-07. Source
- F-261007-03 Every request on 2026-10-07 from ClaudeBot, Bingbot, GPTBot, OAI-SearchBot and PerplexityBot was verified against the operator's published method. Source
2026-10-08
- F-261008-01 Bingbot made 17 requests on 2026-10-08, its highest daily count since the site launched on 2026-09-13; its previous high was 16, on 2026-09-30. Source
- F-261008-02 Bingbot made 17 requests on 2026-10-08, 8.5 times its 28-day median of 2. Source
- F-261008-03 Every request on 2026-10-08 from ClaudeBot, Bingbot, OAI-SearchBot and GPTBot was verified against the operator's published method. Source
2026-10-09
- F-261009-01 ClaudeBot re-read the whole site on 2026-10-09 (308 requests); its previous full re-read was 2026-09-24, 15 days earlier. Source
- F-261009-02 OAI-SearchBot made 13 requests on 2026-10-09, its highest daily count since the site launched on 2026-09-13; its previous high was 5, on 2026-09-22. Source
- F-261009-03 ClaudeBot made 1,140 requests on 2026-10-09, 23.8 times its 28-day median of 48. Source
- F-261009-04 OAI-SearchBot made 13 requests on 2026-10-09, 4.3 times its 28-day median of 3. Source
- F-261009-05 ChatGPT-User returned on 2026-10-09 after 11 days without a request. Source
- F-261009-06 OAI-SearchBot requested an HTML page for the first time on 2026-10-09. Source
- F-261009-07 OAI-SearchBot requested a JSON file for the first time on 2026-10-09. Source
- F-261009-08 OAI-SearchBot requested a Markdown file for the first time on 2026-10-09. Source
- F-261009-09 ChatGPT-User fetched 1 page on 2026-10-09 in response to people's requests; the most fetched was /claims/12. Source
- F-261009-10 Every request on 2026-10-09 from ClaudeBot, OAI-SearchBot, Bingbot, GPTBot and Googlebot was verified against the operator's published method. Source
2026-10-10
- F-261010-01 Bingbot made 21 requests on 2026-10-10, its highest daily count since the site launched on 2026-09-13; its previous high was 17, on 2026-10-08. Source
- F-261010-02 Bingbot made 21 requests on 2026-10-10, 7 times its 28-day median of 3. Source
- F-261010-03 ChatGPT-User fetched 1 page on 2026-10-10 in response to people's requests; the most fetched was /changes. Source
- F-261010-04 An MCP client named mcp-contract-check first called lookup_crawler on 2026-10-10. Source
- F-261010-05 An MCP client named mcp first called lookup_crawler on 2026-10-10. Source
- F-261010-06 Every request on 2026-10-10 from ClaudeBot, Bingbot, Googlebot, OAI-SearchBot and GPTBot was verified against the operator's published method. Source
2026-10-11
- F-261011-01 OAI-SearchBot made 28 requests on 2026-10-11, its highest daily count since the site launched on 2026-09-13; its previous high was 13, on 2026-10-09. Source
- F-261011-02 OAI-SearchBot made 28 requests on 2026-10-11, 9.3 times its 28-day median of 3. Source
- F-261011-03 Claude-User has made no requests since 2026-09-20, 21 days. Source
- F-261011-04 An MCP client named katalir-verify first called lookup_crawler on 2026-10-11. Source
- F-261011-05 Every request on 2026-10-11 from ClaudeBot, OAI-SearchBot, Googlebot, Bingbot and GPTBot was verified against the operator's published method. Source
2026-10-12
- F-261012-01 GoogleOther has made no requests since 2026-10-05, 7 days. Source
- F-261012-02 Every request on 2026-10-12 from ClaudeBot, Bingbot, Googlebot, OAI-SearchBot and GPTBot was verified against the operator's published method. Source
- F-261012-03 6 crawlers made 70 requests on 2026-10-12; ClaudeBot made the most, with 48. Source
2026-10-13
- F-261013-01 OAI-SearchBot made 22 requests on 2026-10-13, 7.3 times its 28-day median of 3. Source
- F-261013-02 Applebot has made no requests since 2026-09-29, 14 days. Source
- F-261013-03 OAI-SearchBot requested a CSV file for the first time on 2026-10-13. Source
- F-261013-04 OAI-SearchBot requested an XML file for the first time on 2026-10-13. Source
- F-261013-05 An MCP client named agent-collector first called list_changes on 2026-10-13. Source
- F-261013-06 Every request on 2026-10-13 from ClaudeBot, OAI-SearchBot, Bingbot, Googlebot and GPTBot was verified against the operator's published method. Source
2026-10-14
- F-261014-01 OAI-SearchBot made 44 requests on 2026-10-14, its highest daily count since the site launched on 2026-09-13; its previous high was 28, on 2026-10-11. Source
- F-261014-02 OAI-SearchBot made 44 requests on 2026-10-14, 14.7 times its 28-day median of 3. Source
- F-261014-03 Applebot returned on 2026-10-14 after 14 days without a request. Source
- F-261014-04 PerplexityBot has made no requests since 2026-10-07, 7 days. Source
- F-261014-05 Every request on 2026-10-14 from ClaudeBot, OAI-SearchBot, Googlebot, Bingbot and GPTBot was verified against the operator's published method. Source
2026-10-15
- F-261015-01 GPTBot made 61 requests on 2026-10-15, 20.3 times its 28-day median of 3. Source
- F-261015-02 Every request on 2026-10-15 from GPTBot, ClaudeBot, Bingbot, Googlebot and OAI-SearchBot was verified against the operator's published method. Source
- F-261015-03 5 crawlers made 143 requests on 2026-10-15; GPTBot made the most, with 61. Source
2026-10-16
- F-261016-01 Every request on 2026-10-16 from ClaudeBot, Googlebot, Bingbot, OAI-SearchBot and GPTBot was verified against the operator's published method. Source
- F-261016-02 5 crawlers made 83 requests on 2026-10-16; ClaudeBot made the most, with 48. Source
2026-10-17
- F-261017-01 An MCP client named connect-mcp-test first called list_changes on 2026-10-17. Source
- F-261017-02 Every request on 2026-10-17 from ClaudeBot, Bingbot, Applebot, Googlebot and OAI-SearchBot was verified against the operator's published method. Source
- F-261017-03 6 crawlers made 74 requests on 2026-10-17; ClaudeBot made the most, with 44. Source
2026-10-18
- F-261018-01 Claude-User has made no requests since 2026-09-20, 28 days. Source
- F-261018-02 Every request on 2026-10-18 from ClaudeBot, Bingbot, Applebot, OAI-SearchBot and GPTBot was verified against the operator's published method. Source
- F-261018-03 6 crawlers made 82 requests on 2026-10-18; ClaudeBot made the most, with 46. Source
2026-10-19
- F-261019-01 PerplexityBot returned on 2026-10-19 after 11 days without a request. Source
- F-261019-02 ChatGPT-User has made no requests since 2026-10-12, 7 days. Source
- F-261019-03 GoogleOther has made no requests since 2026-10-05, 14 days. Source
- F-261019-04 Every request on 2026-10-19 from Bingbot, OAI-SearchBot, GPTBot and PerplexityBot was verified against the operator's published method. Source
2026-10-20
- F-261020-01 Bingbot requested a JSON file for the first time on 2026-10-20. Source
- F-261020-02 Every request on 2026-10-20 from Googlebot, Bingbot, Applebot, GPTBot and OAI-SearchBot was verified against the operator's published method. Source
- F-261020-03 5 crawlers made 41 requests on 2026-10-20; Googlebot made the most, with 16. Source
2026-10-21
- F-261021-01 Bingbot made 23 requests on 2026-10-21, its highest daily count since the site launched on 2026-09-13; its previous high was 21, on 2026-10-10. Source
- F-261021-02 PerplexityBot made 4 requests on 2026-10-21, its highest daily count since the site launched on 2026-09-13; its previous high was 2, on 2026-09-25. Source
- F-261021-03 GoogleOther returned on 2026-10-21 after 15 days without a request. Source
- F-261021-04 Bingbot requested a Markdown file for the first time on 2026-10-21. Source
- F-261021-05 GoogleOther requested a Markdown file for the first time on 2026-10-21. Source
- F-261021-06 PerplexityBot fetched /llms.txt on 2026-10-21; it is the first crawler to do so here. Source
- F-261021-07 An MCP client named phase-a first called identify_user_agent on 2026-10-21. Source
- F-261021-08 Every request on 2026-10-21 from Bingbot, Googlebot, GoogleOther, Applebot and PerplexityBot was verified against the operator's published method. Source
2026-10-22
- F-261022-01 GPTBot requested a text file for the first time on 2026-10-22. Source
- F-261022-02 Every request on 2026-10-22 from Googlebot, Bingbot and OAI-SearchBot was verified against the operator's published method. Source
- F-261022-03 4 crawlers made 59 requests on 2026-10-22; Googlebot made the most, with 29. Source
2026-10-23
Instrument outage on 2026-10-23: no counts are published for this day.
2026-10-24
- F-261024-01 Bingbot first fetched the 2026-10-23 snapshot 3 h 54 min after it was published. Source
- F-261024-02 Googlebot first fetched the 2026-10-23 snapshot 7 h 3 min after it was published. Source
- F-261024-03 GoogleOther first fetched the 2026-10-23 snapshot 9 h 44 min after it was published. Source
- F-261024-04 An MCP client named mcp-observatory first called list_changes on 2026-10-24. Source
- F-261024-05 Every request on 2026-10-24 from ClaudeBot, Bingbot, Googlebot, OAI-SearchBot and GPTBot was verified against the operator's published method. Source
2026-10-25
- F-261025-01 Claude-User has made no requests since 2026-09-20, 35 days. Source
- F-261025-02 Bingbot first fetched the 2026-10-24 snapshot 3 h 53 min after it was published. Source
- F-261025-03 Every request on 2026-10-25 from ClaudeBot, Bingbot, Googlebot, GPTBot and OAI-SearchBot was verified against the operator's published method. Source
2026-10-26
- F-261026-01 ChatGPT-User made 9 requests on 2026-10-26, its highest daily count since the site launched on 2026-09-13; its previous high was 3, on 2026-09-19. Source
- F-261026-02 ChatGPT-User returned on 2026-10-26 after 13 days without a request. Source
- F-261026-03 ChatGPT-User fetched 9 pages on 2026-10-26 in response to people's requests; the most fetched was /data. Source
- F-261026-04 Bingbot first fetched the 2026-10-25 snapshot 3 h 59 min after it was published. Source
- F-261026-05 Googlebot first fetched the 2026-10-25 snapshot 10 h 31 min after it was published. Source
- F-261026-06 Every request on 2026-10-26 from ClaudeBot, Googlebot, Bingbot, ChatGPT-User and OAI-SearchBot was verified against the operator's published method. Source
2026-10-27
- F-261027-01 Bingbot made 24 requests on 2026-10-27, its highest daily count since the site launched on 2026-09-13; its previous high was 23, on 2026-10-21. Source
- F-261027-02 Bingbot first fetched the 2026-10-26 snapshot 3 h 54 min after it was published. Source
- F-261027-03 Googlebot first fetched the 2026-10-26 snapshot 14 h 2 min after it was published. Source
- F-261027-04 Every request on 2026-10-27 from ClaudeBot, Googlebot, Bingbot, OAI-SearchBot and GPTBot was verified against the operator's published method. Source
2026-10-28
- F-261028-01 Bingbot made 31 requests on 2026-10-28, its highest daily count since the site launched on 2026-09-13; its previous high was 24, on 2026-10-27. Source
- F-261028-02 PerplexityBot has made no requests since 2026-10-21, 7 days. Source
- F-261028-03 Bingbot first fetched the 2026-10-27 snapshot 3 h 54 min after it was published. Source
- F-261028-04 Googlebot first fetched the 2026-10-27 snapshot 8 h 46 min after it was published. Source
- F-261028-05 GoogleOther first fetched the 2026-10-27 snapshot 8 h 46 min after it was published. Source
- F-261028-06 ClaudeBot first fetched the 2026-10-27 snapshot 8 h 48 min after it was published. Source
- F-261028-07 Every request on 2026-10-28 from ClaudeBot, Bingbot, OAI-SearchBot, GPTBot and GoogleOther was verified against the operator's published method. Source
2026-10-29
- F-261029-01 Bingbot made 36 requests on 2026-10-29, its highest daily count since the site launched on 2026-09-13; its previous high was 31, on 2026-10-28. Source
- F-261029-02 ChatGPT-User made 15 requests on 2026-10-29, its highest daily count since the site launched on 2026-09-13; its previous high was 9, on 2026-10-26. Source
- F-261029-03 GPTBot made 343 requests on 2026-10-29, 114.3 times its 28-day median of 3. Source
- F-261029-04 ClaudeBot made 217 requests on 2026-10-29, 4.5 times its 28-day median of 48. Source
- F-261029-05 Bingbot made 36 requests on 2026-10-29, 3 times its 28-day median of 12. Source
- F-261029-06 Reflectionbot requested this site for the first time on 2026-10-29; its first request was for /robots.txt. Source
- F-261029-07 Bingbot first fetched the 2026-10-28 snapshot 3 h 59 min after it was published. Source
- F-261029-08 OAI-SearchBot first fetched the 2026-10-28 snapshot 11 h 56 min after it was published. Source
- F-261029-09 GPTBot first fetched the 2026-10-28 snapshot 11 h 56 min after it was published. Source
- F-261029-10 ClaudeBot first fetched the 2026-10-28 snapshot 20 h 16 min after it was published. Source
- F-261029-11 Every request on 2026-10-29 from GPTBot, ClaudeBot, Bingbot, OAI-SearchBot and Reflectionbot was verified against the operator's published method. Source
2026-10-30
- F-261030-01 ClaudeBot made 231 requests on 2026-10-30, 4.8 times its 28-day median of 48. Source
- F-261030-02 Bingbot first fetched the 2026-10-29 snapshot 3 h 56 min after it was published. Source
- F-261030-03 Googlebot first fetched the 2026-10-29 snapshot 13 h 11 min after it was published. Source
- F-261030-04 An MCP client named smartbench-use-test first called lookup_crawler on 2026-10-30. Source
- F-261030-05 An MCP client named mcpyp-incremental first called lookup_crawler on 2026-10-30. Source
- F-261030-06 An MCP client named aisonar first called aisonar_authprobe_40fae6 on 2026-10-30. Source
- F-261030-07 Every request on 2026-10-30 from ClaudeBot, Bingbot, Googlebot, OAI-SearchBot and GPTBot was verified against the operator's published method. Source
2026-10-31
- F-261031-01 Bingbot first fetched the 2026-10-30 snapshot 3 h 52 min after it was published. Source
- F-261031-02 Googlebot first fetched the 2026-10-30 snapshot 6 h 47 min after it was published. Source
- F-261031-03 GoogleOther first fetched the 2026-10-30 snapshot 6 h 47 min after it was published. Source
- F-261031-04 Every request on 2026-10-31 from ClaudeBot, Bingbot, Applebot, OAI-SearchBot and GPTBot was verified against the operator's published method. Source
All snapshots: https://rattlesnakesbymail.com/snapshots