| Robots (30 / 122) [show full report] |
| 1 | 1561 | 16.06 | msnbot-media/1.1 (+http://search.msn.com... |
| 2 | 1392 | 14.33 | MJ12bot/v1.4.5 |
| 3 | 1257 | 12.94 | bingbot/2.0 |
| 4 | 692 | 7.12 | DotBot/1.1 |
| 5 | 654 | 6.73 | Googlebot (gocrawl v0.4) |
| 6 | 550 | 5.66 | CCBot/2.0 (http://commoncrawl.org/faq/) |
| 7 | 408 | 4.20 | compatible Mozilla/5.0 |
| 8 | 370 | 3.81 | python-requests/2.2.1 CPython/2.7.3 Linu... |
| 9 | 225 | 2.32 | Riddler (http://riddler.io/about.html) |
| 10 | 216 | 2.22 | linkdexbot/2.0 |
| 11 | 211 | 2.17 | YandexBot/3.0 |
| 12 | 191 | 1.97 | MojeekBot/0.6 |
| 13 | 164 | 1.69 | Yahoo! Slurp |
| 14 | 143 | 1.47 | Twitterbot/1.0 |
| 15 | 138 | 1.42 | Googlebot/2.1 |
| 16 | 114 | 1.17 | msnbot-UDiscovery/2.0b (+http://search.m... |
| 17 | 107 | 1.10 | Linux x86_64 |
| 18 | 92 | 0.95 | msnbot-NewsBlogs/2.0b (+http://search.ms... |
| 19 | 92 | 0.95 | MSIE 8.0 |
| 20 | 84 | 0.86 | msnbot-media/2.0b (+http://search.msn.co... |
| 21 | 68 | 0.70 | Sogou web spider/4.0(+http://www.sogou.c... |
| 22 | 51 | 0.52 | Baiduspider/2.0 |
| 23 | 51 | 0.52 | Apache-HttpClient/4.2.6 (java 1.5) |
| 24 | 50 | 0.51 | proximic |
| 25 | 45 | 0.46 | SMTBot/1.0 |
| 26 | 42 | 0.43 | Yeti/1.1 |
| 27 | 41 | 0.42 | HTTPClient/1.0 (2.4.0, ruby 2.1.2 (2014-... |
| 28 | 41 | 0.42 | rogerbot/1.0 (http://moz.com/help/pro/wh... |
| 29 | 41 | 0.42 | MSIE 6.0 |
| 30 | 37 | 0.38 | SeznamBot/3.2 |
