Robots often asking for robots.txt in 2025.

These User Agent strings have requested robots.txt since Jan 1, 2025 before crawling the site.
The list has been updated on August 06, 2025 13:27.

  1. o i l / . c m atible; BacklinkS...<b title="modified">LOG SPAM</b> e d d o )
    Last request: 2025-08-06 12:28:54
  2. facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
    Last request: 2025-08-01 15:20:16
  3. Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)
    Last request: 2025-08-05 08:19:40
  4. Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler)
    Last request: 2025-07-30 04:16:23
  5. Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
    Last request: 2025-08-06 06:06:59
  6. Mozilla/5.0 (compatible; Konqueror/3; Linux)
    Last request: 2025-06-20 08:46:50
  7. Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/)
    Last request: 2025-04-20 00:09:08
  8. Mozilla/5.0 (compatible; SEOkicks; +https://www.seokicks.de/robot.html)
    Last request: 2025-08-03 10:19:03
  9. Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
    Last request: 2025-08-06 12:17:08
  10. Mozilla/5.0 (compatible;PetalBot;+https://webmaster.petalsearch.com/site/petalbot)
    Last request: 2025-08-02 11:59:31
  11. Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2296.1579 Mobile Safari/537.36
    Last request: 2025-07-04 18:44:00
  12. Mozilla/5.0 (iPhone; CPU iPhone OS 18_3_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) CriOS/134.0.6998.33 Mobile/15E148 Safari/604.1
    Last request: 2025-04-11 18:56:03
  13. Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.1431.1424 Mobile Safari/537.36
    Last request: 2025-07-05 17:25:02
  14. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.4163.1661 Mobile Safari/537.36
    Last request: 2025-07-08 06:23:53
  15. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.7797.1049 Mobile Safari/537.36
    Last request: 2025-07-23 14:20:24
  16. Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.7964.1304 Mobile Safari/537.36
    Last request: 2025-07-04 18:42:56
  17. Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2904.1035 Mobile Safari/537.36
    Last request: 2025-07-24 04:54:05
  18. Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.7886.1839 Mobile Safari/537.36
    Last request: 2025-08-02 09:13:21
  19. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.1429.1766 Safari/537.36
    Last request: 2025-04-12 05:42:47
  20. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2836.1262 Safari/537.36
    Last request: 2025-03-17 14:26:22
  21. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.3102.1558 Safari/537.36
    Last request: 2025-03-15 13:58:10
  22. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.4666.1523 Safari/537.36
    Last request: 2025-06-19 14:24:38
  23. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.8246.1871 Safari/537.36
    Last request: 2025-03-19 14:48:29
  24. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.8994.1996 Safari/537.36
    Last request: 2025-07-10 08:17:26
  25. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.8579.1579 Safari/537.36
    Last request: 2025-03-25 05:29:45
  26. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2596.1709 Safari/537.36
    Last request: 2025-04-05 15:36:02
  27. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2335.1993 Safari/537.36
    Last request: 2025-07-22 06:00:46
  28. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.5104.1348 Safari/537.36
    Last request: 2025-07-23 14:20:02
  29. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/47.0.7571.1812 Safari/537.36
    Last request: 2025-04-04 08:44:58
  30. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.4787.1946 Safari/537.36
    Last request: 2025-03-09 12:45:48
  31. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.7308.1646 Safari/537.36
    Last request: 2025-06-10 20:34:07
  32. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.5307.1961 Safari/537.36
    Last request: 2025-07-12 05:08:41
  33. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.6186.1899 Safari/537.36
    Last request: 2025-05-27 16:24:07
  34. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.4010.1135 Safari/537.36
    Last request: 2025-07-14 08:16:23
  35. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.8591.1090 Safari/537.36
    Last request: 2025-07-08 06:22:56
  36. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.9220.1464 Safari/537.36
    Last request: 2025-05-02 05:24:43
  37. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.4428.1596 Safari/537.36
    Last request: 2025-06-15 07:29:10
  38. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.7365.1243 Safari/537.36
    Last request: 2025-06-08 17:02:00
  39. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.1805.1081 Safari/537.36
    Last request: 2025-03-20 18:23:51
  40. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.5613.1971 Safari/537.36
    Last request: 2025-03-28 16:44:34
  41. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.5713.1316 Safari/537.36
    Last request: 2025-05-09 02:56:45
  42. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2086.1425 Safari/537.36
    Last request: 2025-05-11 02:35:21
  43. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.3097.1872 Safari/537.36
    Last request: 2025-03-11 13:08:58
  44. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2222.1235 Safari/537.36
    Last request: 2025-07-30 15:37:49
  45. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.8650.1359 Safari/537.36
    Last request: 2025-05-06 06:30:40
  46. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.1407.1062 Safari/537.36
    Last request: 2025-03-27 15:05:51
  47. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.1443.1265 Safari/537.36
    Last request: 2025-04-20 14:34:22
  48. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.4587.1008 Safari/537.36
    Last request: 2025-04-10 05:12:04
  49. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.5616.1804 Safari/537.36
    Last request: 2025-04-26 11:02:26
  50. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.7687.1388 Safari/537.36
    Last request: 2025-06-11 09:02:50
  51. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.4243.1214 Safari/537.36
    Last request: 2025-04-18 14:05:44
  52. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.1340.1612 Safari/537.36
    Last request: 2025-03-21 15:14:27
  53. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.9812.1413 Safari/537.36
    Last request: 2025-06-15 16:22:58
  54. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.6226.1869 Safari/537.36
    Last request: 2025-05-12 23:53:07
  55. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.9149.1910 Safari/537.36
    Last request: 2025-06-27 18:32:02
  56. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.7653.1871 Safari/537.36
    Last request: 2025-03-30 03:38:44
  57. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/47.0.2678.1409 Safari/537.36
    Last request: 2025-06-09 09:09:07
  58. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/47.0.4558.1462 Safari/537.36
    Last request: 2025-05-07 02:48:29
  59. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.2244.1839 Safari/537.36
    Last request: 2025-05-26 09:52:23
  60. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.5046.1950 Safari/537.36
    Last request: 2025-03-18 18:08:30
  61. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.7957.1586 Safari/537.36
    Last request: 2025-04-30 11:41:22
  62. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.1451.1471 Safari/537.36
    Last request: 2025-05-04 06:03:29
  63. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.4809.1612 Safari/537.36
    Last request: 2025-05-14 13:02:17
  64. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.2191.1428 Safari/537.36
    Last request: 2025-04-14 05:55:40
  65. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.9284.1484 Safari/537.36
    Last request: 2025-05-15 07:12:47
  66. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.9596.1577 Safari/537.36
    Last request: 2025-04-19 14:57:40
  67. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.4422.1082 Safari/537.36
    Last request: 2025-03-22 18:31:32
  68. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/45.0.3415.1455 Safari/537.36
    Last request: 2025-03-16 22:20:37
  69. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/45.0.7764.1523 Safari/537.36
    Last request: 2025-06-27 01:14:18
  70. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/45.0.8284.1655 Safari/537.36
    Last request: 2025-03-23 05:02:41
  71. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.1733.1511 Safari/537.36
    Last request: 2025-05-21 11:24:49
  72. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.7635.1115 Safari/537.36
    Last request: 2025-07-16 05:42:14
  73. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.7701.1934 Safari/537.36
    Last request: 2025-06-07 15:10:20
  74. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.6712.1500 Safari/537.36
    Last request: 2025-04-11 13:23:29
  75. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.6640.1916 Safari/537.36
    Last request: 2025-07-05 17:22:38
  76. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.6125.1545 Safari/537.36
    Last request: 2025-05-17 06:03:46
  77. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.1878.1596 Safari/537.36
    Last request: 2025-07-15 08:12:16
  78. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.6317.1883 Safari/537.36
    Last request: 2025-03-30 21:14:13
  79. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.7837.1394 Safari/537.36
    Last request: 2025-04-17 14:33:07
  80. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.2639.1747 Safari/537.36
    Last request: 2025-03-22 05:27:33
  81. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.125 Safari/537.36 (compatible: Remo/0.1; +https://www.remotasks.com/en/info.txt)
    Last request: 2025-05-18 05:13:00
  82. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/102.0.0.0 Safari/537.3 12.23
    Last request: 2025-02-24 12:05:41
  83. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/109.0.0.0 Safari/537.36
    Last request: 2025-06-05 07:37:17
  84. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36
    Last request: 2025-03-13 05:05:59
  85. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/129.0.0.0 Safari/537.36
    Last request: 2025-03-07 10:53:48
  86. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/135.0.0.0 Safari/537.36
    Last request: 2025-06-24 15:35:36
  87. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.6 Safari/605.1.1 11.07
    Last request: 2025-01-25 11:15:27
  88. Mozilla/5.0 (Macintosh; Intel Mac OS X 14.2; rv:109.0) Gecko/20100101 Firefox/121.0
    Last request: 2025-01-15 09:24:07
  89. Mozilla/5.0 (Macintosh; Intel Mac OS X 14_2_1) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.2 Safari/605.1.15
    Last request: 2025-01-29 03:28:20
  90. Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.4a) Gecko/20030401
    Last request: 2025-07-17 03:35:10
  91. Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36
    Last request: 2025-02-21 17:37:53
  92. Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36 Edg/120.0.2210.133
    Last request: 2025-07-30 17:48:56
  93. Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.6422.59 Safari/537.36
    Last request: 2025-06-23 03:33:41
  94. Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36
    Last request: 2025-04-09 19:05:08
  95. Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/132.0.0.0 Safari/537.3
    Last request: 2025-03-26 12:05:47
  96. Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/135.0.0.0 Safari/537.36 Edg/135.0.0.0
    Last request: 2025-07-24 15:37:16
  97. Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.2394.133 Safari/537.36
    Last request: 2025-07-15 03:58:15
  98. Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.2708.60 Safari/537.36
    Last request: 2025-05-12 03:56:37
  99. Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.2814.66 Safari/537.36
    Last request: 2025-07-14 05:24:55
  100. Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.2112.77 Safari/537.36
    Last request: 2025-07-15 05:25:50
  101. Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3230.136 Safari/537.36
    Last request: 2025-06-16 04:46:35
  102. Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.2223.194 Safari/537.36
    Last request: 2025-04-29 14:09:49
  103. Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/76.0.2055.185 Safari/537.36
    Last request: 2025-04-26 10:26:57
  104. Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/76.0.3415.35 Safari/537.36
    Last request: 2025-05-07 23:50:35
  105. Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.81 Safari/537.36
    Last request: 2025-07-22 12:00:29
  106. Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/121.0
    Last request: 2025-07-04 02:14:00
  107. Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.2564.116 Safari/537.36
    Last request: 2025-07-05 01:30:46
  108. Mozilla/5.0 (Windows NT 6.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.177 Safari/537.36
    Last request: 2025-05-11 02:55:27
  109. Mozilla/5.0 (Windows NT 6.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3806.45 Safari/537.36
    Last request: 2025-04-25 09:11:43
  110. Mozilla/5.0 (Windows NT 6.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3125.199 Safari/537.36
    Last request: 2025-05-03 19:06:14
  111. Mozilla/5.0 (Windows NT 6.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/77.0.3966.45 Safari/537.36
    Last request: 2025-05-05 21:32:04
  112. Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.2176.171 Safari/537.36
    Last request: 2025-04-23 06:45:33
  113. Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3320.143 Safari/537.36
    Last request: 2025-04-27 11:42:37
  114. Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3741.79 Safari/537.36
    Last request: 2025-05-02 17:53:52
  115. Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3203.58 Safari/537.36
    Last request: 2025-04-24 07:59:16
  116. Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3150.82 Safari/537.36
    Last request: 2025-07-16 14:13:33
  117. Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3886.110 Safari/537.36
    Last request: 2025-07-17 11:05:40
  118. Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/76.0.3362.4 Safari/537.36
    Last request: 2025-05-04 20:19:20
  119. Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3763.6 Safari/537.36
    Last request: 2025-05-01 16:38:22
  120. Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.8365.1738 Safari/537.36
    Last request: 2025-07-09 04:07:53
  121. Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/40.0.4242.1067 Safari/537.36
    Last request: 2025-06-01 14:24:42
  122. Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.1906.1402 Safari/537.36
    Last request: 2025-06-25 00:01:22
  123. Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.4880.1738 Safari/537.36
    Last request: 2025-07-19 10:22:18
  124. Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.4463.1470 Safari/537.36
    Last request: 2025-04-07 15:15:01
  125. Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/45.0.5465.1389 Safari/537.36
    Last request: 2025-06-14 01:16:51
  126. Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/47.0.7407.1399 Safari/537.36
    Last request: 2025-04-28 11:20:18
  127. Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.5846.1415 Safari/537.36
    Last request: 2025-06-25 17:59:57
  128. Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.6528.1924 Safari/537.36
    Last request: 2025-03-13 13:33:41
  129. Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.6810.1096 Safari/537.36
    Last request: 2025-04-15 14:01:54
  130. Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.8643.1590 Safari/537.36
    Last request: 2025-07-24 04:52:28
  131. Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.6764.1977 Safari/537.36
    Last request: 2025-04-21 15:20:39
  132. Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3266.1729 Safari/537.36
    Last request: 2025-03-27 03:48:10
  133. Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.2315.1205 Safari/537.36
    Last request: 2025-06-26 01:21:03
  134. Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.1386.1541 Safari/537.36
    Last request: 2025-07-15 18:09:39
  135. Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.8472.1397 Safari/537.36
    Last request: 2025-04-16 16:59:42
  136. Mozilla/5.0 (Windows NT 6.2; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3324.156 Safari/537.36
    Last request: 2025-07-13 10:10:35
  137. Mozilla/5.0 (Windows NT 6.2; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.2880.9 Safari/537.36
    Last request: 2025-07-17 05:27:30
  138. Mozilla/5.0 (Windows NT 6.2; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3110.148 Safari/537.36
    Last request: 2025-05-10 01:53:47
  139. Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3757.126 Safari/537.36
    Last request: 2025-05-09 00:52:29
  140. Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.2095.130 Safari/537.36
    Last request: 2025-05-06 22:48:09
  141. Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.2511.26 Safari/537.36
    Last request: 2025-04-28 12:56:19
  142. Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.2479.185 Safari/537.36
    Last request: 2025-04-22 05:30:32
  143. Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.2271.169 Safari/537.36
    Last request: 2025-07-16 11:52:43
  144. Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3166.165 Safari/537.36
    Last request: 2025-05-13 04:57:20
  145. Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3048.137 Safari/537.36
    Last request: 2025-04-30 15:25:57
  146. Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.4b) Gecko/20030516 Mozilla Firebird/0.6
    Last request: 2025-05-11 10:19:57
  147. Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36
    Last request: 2025-04-25 14:39:36
  148. Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.0.0 Safari/537.36
    Last request: 2025-07-12 10:38:59
  149. Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.4) Gecko/20030624
    Last request: 2025-03-25 08:26:47
  150. Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:109.0) Gecko/20100101 Firefox/121.0
    Last request: 2025-05-24 22:29:37
  151. netEstate NE Crawler (+http://www.website-datenbank.de/)
    Last request: 2025-02-04 20:00:43
  152. Turnitin (https://bit.ly/2UvnfoQ)
    Last request: 2025-06-28 20:49:25

 with a fake or unidentified User Agent:

  1. AliyunSecBot/Aliyun (AliyunSecBot&#64;service.alibaba.com)
    Last request: 2025-01-11 05:18:58
  2. curl/8.10.0
    Last request: 2025-06-11 05:54:20
  3. DuckAssistBot/1.1; (+http://duckduckgo.com/duckassistbot.html)
    Last request: 2025-04-05 00:49:09
  4. HanaleiBot runid=beta-stage-integration-test
    Last request: 2025-07-31 06:10:21
  5. HawaiiBot
    Last request: 2025-08-02 19:50:14
  6. Mozilla/4.0 (compatible; fluid/0.0; +http://www.leak.info/bot.html)
    Last request: 2025-08-05 20:47:48
  7. Mozilla/5.0 (compatible; AwarioBot/1.0; +https://awario.com/bots.html)
    Last request: 2025-07-26 11:40:52
  8. Mozilla/5.0 (compatible; BLEXBot/1.0; +https://help.seranking.com/en/blex-crawler)
    Last request: 2025-07-18 21:51:59
  9. Mozilla/5.0 (compatible; DataForSeoBot/1.0; +https://dataforseo.com/dataforseo-bot)
    Last request: 2025-07-02 04:04:31
  10. Mozilla/5.0 (compatible; DotBot/1.2; +https://opensiteexplorer.org/dotbot; help&#64;moz.com)
    Last request: 2025-08-06 10:49:13
  11. Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Robots/2.0; +https://help.mail.ru/webmaster/indexing/robots)
    Last request: 2025-08-02 11:43:54
  12. Mozilla/5.0 (compatible; MJ12bot/v2.0.1; http://mj12bot.com/)
    Last request: 2025-05-09 10:24:11
  13. Mozilla/5.0 (compatible; MJ12bot/v2.0.2; http://mj12bot.com/)
    Last request: 2025-06-28 10:20:28
  14. Mozilla/5.0 (compatible; MojeekBot/0.11; +https://www.mojeek.com/bot.html)
    Last request: 2025-03-10 12:08:10
  15. Mozilla/5.0 (compatible; Qwantbot-prod/1.0; +Qwantbot&#64;qwant.com)
    Last request: 2025-01-11 22:35:18
  16. Mozilla/5.0 (compatible; Qwantbot/1.0; +https://help.qwant.com/bot/)
    Last request: 2025-08-06 02:19:36
  17. Mozilla/5.0 (compatible; SeekportBot; +https://bot.seekport.com)
    Last request: 2025-08-04 21:15:16
  18. Mozilla/5.0 (compatible; SurdotlyBot/1.0; +http://sur.ly/bot.html)
    Last request: 2025-06-04 18:01:53
  19. Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io)
    Last request: 2025-06-11 03:07:59
  20. Mozilla/5.0 (compatible; WebwikiBot/2.1; +https://www.webwiki.fr)
    Last request: 2025-02-13 10:47:15
  21. Mozilla/5.0 (compatible; wpbot/1.2; +https://forms.gle/ajBaxygz9jSR8p8G9)
    Last request: 2025-02-11 19:00:44
  22. Mozilla/5.0 (compatible; wpbot/1.3; +https://forms.gle/ajBaxygz9jSR8p8G9)
    Last request: 2025-07-07 21:12:30
  23. Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot)
    Last request: 2025-08-03 00:51:20
  24. Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36
    Last request: 2025-08-05 18:11:50
  25. Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.1938.76 Safari/537.36
    Last request: 2025-07-16 11:00:08
  26. Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Bravebot/1.0; +https://search.brave.com/help/brave-search-crawler) Chrome/W.X.Y.Z Safari/537.36
    Last request: 2025-01-18 02:20:39
  27. Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot&#64;anthropic.com)
    Last request: 2025-08-06 13:27:10
  28. Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.0; +https://openai.com/gptbot)
    Last request: 2025-07-30 20:28:25
  29. Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot)
    Last request: 2025-08-06 05:49:13
  30. Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)
    Last request: 2025-01-31 22:05:06
  31. olympicBot
    Last request: 2025-02-22 10:25:27
  32. python-requests/2.31.0
    Last request: 2025-07-28 00:01:55
  33. Screaming Frog SEO Spider/21.3
    Last request: 2025-01-12 04:44:32
  34. serpstatbot/2.1 (advanced backlink tracking bot; https://serpstatbot.com/; abuse&#64;serpstatbot.com)
    Last request: 2025-06-18 13:57:22

Robots do not always request robots.txt and asking for it does not always mean obeying it.

Display the robots that recently visited the site

Display the robots asking for robots.txt