Robots often asking for robots.txt in 2026.

These User Agent strings have requested robots.txt since Jan 1, 2026 before crawling the site.
The list has been updated on January 17, 2026 20:53.

1. o i l / . c m atible; BacklinkS...<b title="modified">LOG SPAM</b> e d d o )
   Last request: 2026-01-15 21:59:23
2. Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)
   Last request: 2026-01-16 02:03:40
3. Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
   Last request: 2026-01-17 13:01:53
4. Mozilla/5.0 (compatible; Konqueror/3; Linux)
   Last request: 2026-01-12 13:38:15
5. Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
   Last request: 2026-01-17 18:49:09
6. Mozilla/5.0 (compatible;PetalBot;+https://webmaster.petalsearch.com/site/petalbot)
   Last request: 2026-01-05 18:45:16
7. Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/40.0.5981.1056 Mobile Safari/537.36
   Last request: 2026-01-05 19:26:54
8. Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.6016.1530 Mobile Safari/537.36
   Last request: 2026-01-13 14:25:32
9. Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.7021.1711 Mobile Safari/537.36
   Last request: 2026-01-06 06:39:03
10. Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.8849.1898 Mobile Safari/537.36
    Last request: 2026-01-09 03:04:05
11. Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.3207.1579 Mobile Safari/537.36
    Last request: 2026-01-07 12:00:05
12. Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.6100.1114 Mobile Safari/537.36
    Last request: 2026-01-05 01:31:32
13. Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.5219.1099 Mobile Safari/537.36
    Last request: 2026-01-16 23:12:38
14. Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.6752.1246 Mobile Safari/537.36
    Last request: 2026-01-06 22:01:34
15. Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.4854.1340 Mobile Safari/537.36
    Last request: 2026-01-09 15:16:58
16. Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/45.0.9144.1827 Mobile Safari/537.36
    Last request: 2026-01-01 06:24:26
17. Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/47.0.2761.1597 Mobile Safari/537.36
    Last request: 2026-01-13 00:07:43
18. Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/47.0.3164.1259 Mobile Safari/537.36
    Last request: 2026-01-04 13:24:51
19. Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/47.0.7325.1782 Mobile Safari/537.36
    Last request: 2026-01-12 17:20:54
20. Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.5940.1209 Mobile Safari/537.36
    Last request: 2026-01-04 05:33:47
21. Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.6193.1541 Mobile Safari/537.36
    Last request: 2026-01-11 15:57:48
22. Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.4135.1604 Mobile Safari/537.36
    Last request: 2026-01-06 09:53:18
23. Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.5726.1526 Mobile Safari/537.36
    Last request: 2026-01-01 02:59:17
24. Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.3624.1832 Mobile Safari/537.36
    Last request: 2026-01-07 13:22:41
25. Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.6301.1209 Mobile Safari/537.36
    Last request: 2026-01-12 08:18:40
26. Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.3706.1709 Mobile Safari/537.36
    Last request: 2026-01-11 22:09:58
27. Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.6508.1988 Mobile Safari/537.36
    Last request: 2026-01-13 05:20:28
28. Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.9708.1640 Mobile Safari/537.36
    Last request: 2026-01-09 07:44:02
29. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.4556.1389 Mobile Safari/537.36
    Last request: 2026-01-12 04:48:12
30. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.9079.1421 Mobile Safari/537.36
    Last request: 2026-01-08 12:48:43
31. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.1610.1656 Mobile Safari/537.36
    Last request: 2026-01-05 05:51:23
32. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2737.1849 Mobile Safari/537.36
    Last request: 2026-01-03 11:07:02
33. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.9080.1656 Mobile Safari/537.36
    Last request: 2026-01-01 21:31:37
34. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.3022.1837 Mobile Safari/537.36
    Last request: 2026-01-10 05:50:57
35. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.7697.1335 Mobile Safari/537.36
    Last request: 2026-01-03 05:12:16
36. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.1767.1066 Mobile Safari/537.36
    Last request: 2026-01-07 00:00:30
37. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.1802.1009 Mobile Safari/537.36
    Last request: 2026-01-08 01:22:26
38. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.7244.1196 Mobile Safari/537.36
    Last request: 2026-01-08 13:30:50
39. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.5971.1207 Mobile Safari/537.36
    Last request: 2026-01-05 17:50:33
40. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.7588.1674 Mobile Safari/537.36
    Last request: 2026-01-16 09:47:37
41. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.1226.1916 Mobile Safari/537.36
    Last request: 2026-01-17 10:55:04
42. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.4865.1882 Mobile Safari/537.36
    Last request: 2026-01-17 11:13:59
43. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.7696.1352 Mobile Safari/537.36
    Last request: 2026-01-11 01:04:57
44. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.6555.1280 Mobile Safari/537.36
    Last request: 2026-01-02 12:54:52
45. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.9737.1473 Mobile Safari/537.36
    Last request: 2026-01-16 19:55:38
46. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.2213.1245 Mobile Safari/537.36
    Last request: 2026-01-11 04:27:04
47. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.9804.1636 Mobile Safari/537.36
    Last request: 2026-01-09 23:19:57
48. Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.9243.1000 Mobile Safari/537.36
    Last request: 2026-01-10 12:38:39
49. Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.4975.1904 Mobile Safari/537.36
    Last request: 2026-01-14 06:29:08
50. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (TestUserAgent)
    Last request: 2026-01-11 01:48:06
51. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.5268.1064 Safari/537.36
    Last request: 2026-01-06 13:50:05
52. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.6894.1677 Safari/537.36
    Last request: 2026-01-09 12:49:02
53. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.5548.1453 Safari/537.36
    Last request: 2026-01-10 14:42:00
54. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_0) AppleWebKit/535.11 (KHTML, like Gecko) Chrome/17.0.963.56 Safari/535.11
    Last request: 2026-01-10 13:34:29
55. Mozilla/5.0 (Macintosh; Intel Mac OS X 14_2_1) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.2 Safari/605.1.15
    Last request: 2026-01-12 10:02:09
56. Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36
    Last request: 2026-01-15 12:08:38
57. Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/143.0.0.0 Safari/537.36
    Last request: 2026-01-05 11:27:45
58. Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.81 Safari/537.36
    Last request: 2026-01-03 23:30:42
59. Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.2564.116 Safari/537.36
    Last request: 2026-01-15 14:07:31
60. Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.1822.1060 Safari/537.36
    Last request: 2026-01-13 14:53:14

 with a fake or unidentified User Agent:

1. Mozilla/4.0 (compatible; fluid/0.0; +http://www.leak.info/bot.html)
   Last request: 2026-01-15 23:04:50
2. Mozilla/5.0 (compatible; DataForSeoBot/1.0; +https://dataforseo.com/dataforseo-bot)
   Last request: 2026-01-08 10:26:29
3. Mozilla/5.0 (compatible; DotBot/1.2; +https://opensiteexplorer.org/dotbot; help&#64;moz.com)
   Last request: 2026-01-16 03:48:40
4. Mozilla/5.0 (compatible; HaloBot/1.0)
   Last request: 2026-01-09 21:41:36
5. Mozilla/5.0 (compatible; Qwantbot/1.0; +https://help.qwant.com/bot/)
   Last request: 2026-01-17 00:51:20
6. Mozilla/5.0 (compatible; SeekportBot; +https://bot.seekport.com)
   Last request: 2026-01-05 22:24:30
7. Mozilla/5.0 (compatible; wpbot/1.4; +https://forms.gle/ajBaxygz9jSR8p8G9)
   Last request: 2026-01-13 07:05:52
8. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.3; robots.txt; +https://openai.com/searchbot
   Last request: 2026-01-16 22:12:29
9. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot)
   Last request: 2026-01-14 21:09:38
10. Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36
    Last request: 2026-01-17 16:45:25
11. Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.1938.76 Safari/537.36
    Last request: 2026-01-17 02:50:40
12. Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot&#64;anthropic.com)
    Last request: 2026-01-17 20:53:04
13. python-requests/2.31.0
    Last request: 2026-01-06 23:19:48

Robots do not always request robots.txt and asking for it does not always mean obeying it.

Display the robots that recently visited the site

Display the robots asking for robots.txt