Robots |
1 | 192 | 23.24 | linkdexbot/2.0 |
2 | 158 | 19.13 | Googlebot/2.1 |
3 | 150 | 18.16 | MJ12bot/v1.4.5 |
4 | 83 | 10.05 | bingbot/2.0 |
5 | 52 | 6.30 | YandexBot/3.0 |
6 | 44 | 5.33 | compatible Mozilla/5.0 |
7 | 27 | 3.27 | Sogou web spider/4.0(+http://www.sogou.c... |
8 | 16 | 1.94 | AhrefsBot/5.0 |
9 | 13 | 1.57 | Yahoo! Slurp |
10 | 12 | 1.45 | Exabot/3.0 |
11 | 10 | 1.21 | - |
12 | 9 | 1.09 | SeznamBot/3.2 |
13 | 6 | 0.73 | Linux x86_64 |
14 | 6 | 0.73 | spbot/4.4.2 |
15 | 6 | 0.73 | Twitterbot/1.0 |
16 | 5 | 0.61 | bingbot/3.0-alpha |
17 | 5 | 0.61 | Python-urllib/2.6 |
18 | 4 | 0.48 | OrangeBot/2.0 |
19 | 4 | 0.48 | meanpathbot/1.0 |
20 | 3 | 0.36 | Wotbox/2.01 (+http://www.wotbox.com/bot/... |
21 | 3 | 0.36 | 007ac9 Crawler |
22 | 2 | 0.24 | oBot/2.3.1 |
23 | 2 | 0.24 | MSIE 6.0 |
24 | 2 | 0.24 | linkdexbot/2.2 |
25 | 2 | 0.24 | Firefox/2.0.0.6 |
26 | 1 | 0.12 | ia_archiver |
27 | 1 | 0.12 | BUbiNG (+http://law.di.unimi.it/BUbiNG.h... |
28 | 1 | 0.12 | Yeti/1.1 |
29 | 1 | 0.12 | panscient.com |
30 | 1 | 0.12 | BlackBerry9000/4.6.0.167 Profile/MIDP-2.... |
31 | 1 | 0.12 | SiteExplorer/1.0b |
32 | 1 | 0.12 | MSIE 5.01 |
33 | 1 | 0.12 | CCBot/2.0 (http://commoncrawl.org/faq/) |
34 | 1 | 0.12 | AdnormCrawler www.adnorm.com/crawler |
35 | 1 | 0.12 | nutch-1.4/Nutch-1.4 |