| Robot | Ile razy? | Ostatnio był |
| googlebot(Mozilla/5.0 (compatible; Googlebot/2.1; +http:/ ... | 170291 | 2010-09-08 04:17:24 |
| search(Mozilla/5.0 (compatible; Yahoo! Slurp; http://help ... | 147839 | 2009-11-13 11:10:30 |
| search(Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http:// ... | 79525 | 2010-09-08 15:41:19 |
| crawl(Mozilla/5.0 (compatible; DotBot/1.1; http://www.dot ... | 62192 | 2010-08-31 07:58:05 |
| bot(msnbot/1.0 (+http://search.msn.com/msnbot.htm)) ... | 30099 | 2008-02-18 03:51:15 |
| bot(msnbot-media/1.0 (+http://search.msn.com/msnbot.htm)) ... | 26290 | 2009-01-12 22:58:17 |
| bot(Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twicele ... | 20076 | 2010-07-30 21:17:28 |
| bot(msnbot/1.1 (+http://search.msn.com/msnbot.htm)) ... | 19396 | 2009-10-08 12:55:10 |
| crawl(WebAlta Crawler/2.0 (http://www.webalta.net/ru/abou ... | 15090 | 2008-09-09 22:26:29 |
| crawl(Crawl.pl-1/Nutch-0.9 (bot; www.pjwstk.edu.pl/~msyd/ ... | 11284 | 2008-06-28 19:30:01 |
| bot(Szukacz/1.5 (robot; www.szukacz.pl/html/jak_dziala_ro ... | 9895 | 2009-10-17 16:14:57 |
| bot(Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twicel ... | 8911 | 2008-07-03 06:15:48 |
| bot(OOZBOT/0.20 ( http://www.setooz.com/oozbot.html ; age ... | 6312 | 2010-04-07 00:11:01 |
| NetSprint(NetSprint -- 3.0) ... | 5691 | 2009-04-01 17:14:48 |
| onet(holmes/3.10.1 (OnetSzukaj/5.0; +http://szukaj.onet.p ... | 5448 | 2007-03-29 22:47:10 |
| search(Speedy Spider (http://www.entireweb.com/about/sear ... | 3815 | 2010-05-06 15:51:58 |
| bot(Mozilla/5.0 (compatible; MJ12bot/v1.2.1; http://www.m ... | 3526 | 2008-09-13 11:19:21 |
| bot(msnbot/2.0b (+http://search.msn.com/msnbot.htm)) ... | 3409 | 2010-09-08 14:08:36 |
| search(Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) Sp ... | 2892 | 2010-09-08 14:07:35 |
| search(Baiduspider+(+http://www.baidu.com/search/spider.h ... | 2646 | 2010-09-07 23:14:45 |
| bot(Mozilla/5.0 (compatible; YandexBot/3.0; +http://yande ... | 2551 | 2010-09-08 14:48:55 |
| crawl(IRLbot/3.0 (compatible; MSIE 6.0; http://irl.cs.tam ... | 2510 | 2007-07-31 12:12:03 |
| bot(Jyxobot/1) ... | 2497 | 2010-08-27 17:48:05 |
| bot(Gaisbot/3.0+(robot06@gais.cs.ccu.edu.tw;+http://gais. ... | 2480 | 2010-07-03 05:34:36 |
| crawl(ia_archiver (+http://www.alexa.com/site/help/webmas ... | 2229 | 2010-08-19 14:34:10 |
| bot(MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+)) ... | 2060 | 2008-01-17 20:49:34 |
| bot(psbot/0.1 (+http://www.picsearch.com/bot.html)) ... | 1409 | 2010-09-03 20:13:55 |
| crawl(CazoodleBot/CazoodleBot-0.1 (CazoodleBot Crawler; h ... | 1294 | 2008-01-02 14:13:45 |
| bot(Mozilla/5.0 (compatible; Purebot/1.1; +http://www.pur ... | 954 | 2010-04-17 03:35:28 |
| yandex(Yandex/1.01.001 (compatible; Win16; I)) ... | 928 | 2010-06-24 18:02:36 |
| bot(Mozilla/5.0 (compatible; MJ12bot/v1.2.3; http://www.m ... | 879 | 2008-12-19 10:03:40 |
| crawl(ichiro/2.0 (http://help.goo.ne.jp/door/crawler.html ... | 772 | 2008-01-12 07:02:38 |
| bot(msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)) ... | 597 | 2010-08-03 13:28:56 |
| googlebot(Googlebot/2.1 (+http://www.google.com/bot.html) ... | 537 | 2010-09-07 04:16:01 |
| bot(Mozilla/5.0 (compatible; MJ12bot/v1.2.2; http://www.m ... | 532 | 2008-09-17 17:43:39 |
| bot(Mozilla/5.0 (compatible; Search17Bot/1.1; http://www. ... | 499 | 2010-05-20 10:13:40 |
| crawl(CazoodleBot/Nutch-0.9-dev (CazoodleBot Crawler; htt ... | 461 | 2007-12-04 02:24:45 |
| crawl(Mozilla/5.0 (compatible; Dolphin/1.0; +http://tele- ... | 442 | 2009-06-16 09:54:13 |
| bot(bot/1.0 (bot; http://; bot@bot.bot)) ... | 390 | 2007-09-03 00:48:05 |
| crawl(Nokia6682/2.0 (3.01.1) SymbianOS/8.0 Series60/2.6 P ... | 370 | 2008-04-21 18:13:12 |
| bot(Yanga WorldSearch Bot v1.1/beta (http://www.yanga.co. ... | 339 | 2009-05-31 21:29:10 |
| bot(gemiusbot) ... | 333 | 2008-02-17 08:47:01 |
| spider(Mozilla/5.0 (compatible; 008/0.83; http://www.80le ... | 310 | 2010-05-25 20:41:40 |
| bot(Mozilla/5.0 (compatible; Gigamega.bot/1.0; +http://ww ... | 301 | 2007-10-04 05:53:06 |
| bot(Szukacz/1.5 (robot; www.szukacz.pl/jakdzialarobot.htm ... | 293 | 2009-10-13 06:07:20 |
| google(Mozilla/4.0 (compatible; GoogleToolbar 2.0.114.9-b ... | 281 | 2007-11-09 10:49:45 |
| crawl(MQBOT/Nutch-0.9-dev (MQBOT Nutch Crawler; http://vw ... | 278 | 2007-06-21 23:26:24 |
| bot(Gigabot/1.0) ... | 274 | 2007-05-30 12:41:15 |
| bot(msnbot/2.0b (+http://search.msn.com/msnbot.htm)._) ... | 264 | 2010-09-07 01:11:08 |
| bot(Gigabot/2.0) ... | 264 | 2007-05-12 11:47:31 |
| walker(LinkWalker/2.0) ... | 200 | 2010-06-02 20:28:33 |
| bot(OOZBOT/0.20 ( Setooz wymawiane jako say-th-uuz, oznac ... | 159 | 2009-06-09 09:47:06 |
| crawl(CCBot/1.0 (+http://www.commoncrawl.org/bot.html)) ... | 157 | 2010-09-03 00:04:25 |
| bot(Mozilla/5.0 (compatible; MJ12bot/v1.2.5; http://www.m ... | 149 | 2009-10-28 05:54:10 |
| google(Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; ... | 148 | 2009-09-14 08:03:22 |
| crawl(MSR-ISRCCrawler) ... | 138 | 2008-05-26 02:54:49 |
| crawl(CazoodleBot/Nutch-0.9-dev (CazoodleBot Crawler; htt ... | 127 | 2007-07-31 12:56:15 |
| crawl(Cityreview Robot (+http://www.cityreview.org/crawle ... | 126 | 2010-06-04 18:40:08 |
| onet(Mozilla/5.0 (X11; U; Linux i686; pl; rv:1.8.1.1) Gec ... | 124 | 2010-09-05 20:11:10 |
| spider(WinkySpider/Nutch-1.0-dev (wsiz.rzeszow.pl)) ... | 122 | 2007-11-09 05:32:32 |
| search(Speedy Spider (http://www.entireweb.com/about/sear ... | 119 | 2007-08-30 23:32:07 |
| bot(Mozilla/5.0 (compatible; Mp3Bot/0.4; +http://mp3realm ... | 112 | 2009-04-04 11:34:37 |
| bot(Mozilla/5.0 ( http://www.setooz.com/bot.html )) ... | 111 | 2010-09-08 01:02:31 |
| bot(Mozilla/5.0 (compatible; spbot/2.0.2; +http://www.seo ... | 102 | 2010-05-21 01:49:50 |
| bot(Mozilla/5.0 (compatible; aiHitBot/2.0.2-DM; +http://w ... | 98 | 2010-03-06 22:33:19 |
| bot(Mozilla/5.0 (compatible; aiHitBot/2.0.2-DM +http://ww ... | 98 | 2010-02-16 23:02:10 |
| bot(Mozilla/5.0 (compatible; spbot/2.0.4; +http://www.seo ... | 78 | 2010-08-20 22:58:02 |
| crawl(Mozilla/5.0 (compatible; KaloogaBot; http://www.kal ... | 70 | 2010-01-19 10:33:26 |
| googlebot(Googlebot/2.X larbin2.6.3@unspecified.mail) ... | 56 | 2008-09-10 04:39:25 |
| crawl(disco/Nutch-1.0-dev (experimental crawler; www.disc ... | 55 | 2007-12-24 18:05:03 |
| ask jeeves(Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +ht ... | 46 | 2010-09-04 10:15:33 |
| bot(Gigabot/3.0 (http://www.gigablast.com/spider.html)) ... | 43 | 2008-12-01 01:31:21 |
| bot(c-spider.bot) ... | 43 | 2008-03-15 22:35:06 |
| bot(Mozilla/5.0 (compatible; spbot/2.0.1; +http://www.seo ... | 42 | 2010-03-12 17:13:40 |
| bot(Mozilla/5.0/Nutch-1.0-dev ( http://www.setooz.com/bot ... | 41 | 2010-05-19 00:10:32 |
| search(Speedy Spider (Entireweb; Beta/1.1; http://www.ent ... | 40 | 2007-04-29 06:42:46 |
| bot(Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/)) ... | 39 | 2010-09-03 10:00:48 |
| bot(robotgenius (http://robotgenius.net)) ... | 36 | 2010-03-17 01:21:51 |
| crawl(WebAlta Crawler/1.3.23 (http://www.webalta.net/ru/a ... | 36 | 2009-07-23 21:52:03 |
| search(Speedy Spider (Entireweb; Beta/1.3; http://www.ent ... | 35 | 2007-05-27 07:55:05 |
| googlebot(SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configura ... | 31 | 2010-01-28 07:41:10 |
| bot(zschobot/Nutch-0.9-semantic_patch (zschobot indexing; ... | 30 | 2010-05-14 21:42:21 |
| googlebot(DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; G ... | 28 | 2009-04-12 01:56:43 |
| bot(MSRBOT (http://research.microsoft.com/research/sv/msr ... | 26 | 2007-11-15 10:59:56 |
| crawl(SimilarPages/Nutch-1.0-dev (SimilarPages Nutch Craw ... | 25 | 2009-09-05 17:48:52 |
| bot(Mozilla/5.0 (compatible; MJ12bot/v1.3.2; http://www.m ... | 24 | 2010-07-01 03:50:52 |
| bot(OOZBOT/0.20 ( -- ; http://www.setooz.com/oozbot.html ... | 20 | 2008-12-27 03:26:35 |
| crawl(ConveraCrawler/0.9e (+http://ews.converasearch.com/ ... | 20 | 2008-10-09 21:04:01 |
| bot(Yeti/1.0 (+http://help.naver.com/robots/)) ... | 20 | 2008-08-26 04:25:35 |
| google(Mozilla/4.0 (compatible; GoogleToolbar 2.0.114-big ... | 20 | 2008-12-18 23:42:44 |
| bot(CazoodleBot/0.0.2 (http://www.cazoodle.com; cazoodleb ... | 20 | 2008-08-09 17:10:50 |
| bot(Mozilla/5.0 (compatible; MJ12bot/v1.3.3; http://www.m ... | 18 | 2010-08-14 06:23:16 |
| crawl(VWBOT/Nutch-0.9-dev (VWBOT Nutch Crawler; http://vw ... | 18 | 2007-07-12 21:53:10 |
| bot(Mozilla/5.0 (compatible; spbot/2.0; +http://www.seopr ... | 16 | 2010-02-28 03:45:41 |
| bot(Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0; ob ... | 15 | 2010-02-19 00:49:24 |
| crawl(nutch.us/Nutch-1.0 (www.nutch.us; crawler@nutch.us) ... | 14 | 2009-05-13 01:40:44 |
| check(Yeti/0.01 (nhn/1noon, yetibot@naver.com, check robo ... | 14 | 2008-03-17 07:24:10 |
| google(Google-Sitemaps/1.0) ... | 14 | 2008-09-21 18:14:53 |
| bot(Mozilla/5.0 (compatible; discobot/1.0; +http://discov ... | 14 | 2008-08-08 15:51:53 |
| yandex(Yandex/1.01.001 (compatible; Win16; H)) ... | 14 | 2010-05-02 12:15:40 |
| bot(Snapbot/1.0 (Snap Shots, +http://www.snap.com)) ... | 12 | 2010-04-21 08:44:43 |
| googlebot(Nokia6820/2.0 (4.83) Profile/MIDP-1.0 Configura ... | 11 | 2008-08-14 06:20:14 |
| google(Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; ... | 11 | 2008-10-21 10:32:32 |
| crawl(VisBot/2.0 (Visvo.com Crawler; http://www.visvo.com ... | 10 | 2008-07-22 12:12:12 |
| googlebot(DoCoMo/1.0/N505i/c20/TB/W20H10 (compatible; Goo ... | 10 | 2008-09-29 07:07:25 |
| search(Mozilla/5.0 (compatible; Charlotte/1.1; http://www ... | 10 | 2009-07-14 08:18:58 |
| bot(msnbot/2.0b) ... | 10 | 2009-04-12 19:20:57 |
| crawl(Grub/2.0 (Grub.org crawler; http://www.grub.org/; b ... | 9 | 2008-10-01 09:39:37 |
| bot(miggibot/2007.09.07 (+http://www.micro-sys.dk/develop ... | 8 | 2007-10-09 12:35:13 |
| search(Mozilla/5.0 (compatible; Speedy Spider; http://www ... | 8 | 2010-03-11 18:57:02 |
| google(Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; ... | 8 | 2008-11-20 12:05:16 |
| googlebot(Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv ... | 8 | 2007-10-20 18:21:32 |
| bot(Snapbot/1.0 (+http://www.snap.com)) ... | 7 | 2010-08-31 12:43:53 |
| bot(Eurobot/1.0 (http://eurobot.ayell.eu)) ... | 6 | 2008-11-17 01:55:21 |
| crawl(TinEye/1.1 (http://tineye.com/crawler.html)) ... | 6 | 2008-04-19 16:25:54 |
| bot(Mozilla/5.0 (compatible; spbot/2.0.3; +http://www.seo ... | 6 | 2010-06-01 18:49:28 |
| bot(Mozilla/5.0 (compatible; Tagoobot/3.0; +http://www.ta ... | 6 | 2009-07-06 22:32:56 |
| crawl(Mozilla/5.0 (compatible; kua; http://www.kua.cz/cra ... | 6 | 2009-07-21 01:13:03 |
| bot(Mozilla/5.0 (superbot.com; +http://www.super.info)) ... | 6 | 2009-09-05 07:22:26 |
| google(Mediapartners-Google/2.1) ... | 6 | 2008-05-11 21:18:46 |
| bot(PlantyNet_WebRobot_V1.9 dhkang@plantynet.com) ... | 6 | 2007-09-20 17:13:17 |
| bot(MSNBOT_Mobile MSMOBOT Mozilla/2.0 (compatible; MSIE 4 ... | 5 | 2008-07-13 21:02:52 |
| search(Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; ... | 5 | 2007-10-24 18:25:07 |
| bot(A1 Sitemap Generator/1.4.8 (+http://www.micro-sys.dk/ ... | 5 | 2008-02-07 13:00:00 |
| bot(Mozilla/5.0 (SnapPreviewBot) Gecko/20061206 Firefox/1 ... | 5 | 2008-11-22 13:10:45 |
| google(Mozilla/5.0 (compatible; GoogleToolbar 2.1.128.4-b ... | 5 | 2009-01-12 06:46:48 |
| bot(Mozilla/5.0 (compatible; spbot/1.0; +http://www.seopr ... | 5 | 2010-02-09 19:08:05 |
| crawl(Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twic ... | 5 | 2008-06-29 02:51:59 |
| search(Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; ... | 4 | 2007-10-23 17:45:36 |
| google(Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; ... | 4 | 2008-10-14 10:10:54 |
| googlebot(Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv ... | 4 | 2007-04-30 12:00:35 |
| crawl(PluckItCrawler/1.0 (compatible; Mozilla 4.0; MSIE 5 ... | 4 | 2009-03-06 01:53:11 |
| bot(LapozzBot/1.5 (+http://robot.lapozz.hu)) ... | 4 | 2007-10-16 03:55:03 |
| bot(MLBot (www.metadatalabs.com)) ... | 4 | 2008-03-11 14:04:41 |
| bot(Mozilla/5.0 (compatible; heritrix/1.12.0 +http://www. ... | 4 | 2007-10-04 14:02:21 |
| bot(librabot/1.0 (+http://search.msn.com/msnbot.htm)) ... | 4 | 2009-03-02 16:42:02 |
| bot(Mozilla/5.0 (compatible; YesupBot/1.0; +http://www.ye ... | 4 | 2009-01-29 21:52:45 |
| search(Bigsearch.ca/Nutch-1.0-dev (Bigsearch.ca Internet ... | 4 | 2007-05-11 17:40:51 |
| spider(Huaweisymantecspider (compatible; MSIE 8.0; DSE-su ... | 4 | 2010-08-30 16:25:10 |
| search(Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; ... | 4 | 2007-04-29 10:40:33 |
| search(Mozilla/5.0 (compatible; Charlotte/1.0b; http://ww ... | 3 | 2007-09-24 20:31:39 |
| google(Mozilla/5.0 (en-us) AppleWebKit/525.13 (KHTML, lik ... | 3 | 2010-08-18 20:49:29 |
| crawl(DoubleVerify Crawler) ... | 3 | 2009-08-18 23:21:08 |
| crawl(DotBot/1.0.1 (http://www.dotnetdotcom.org/#info, cr ... | 3 | 2008-08-21 22:20:52 |
| yandex(YandexSomething/1.0) ... | 3 | 2009-06-16 22:18:56 |
| crawl(SapphireWebCrawler/Nutch-1.0-dev (Sapphire Web Craw ... | 3 | 2009-01-07 11:56:29 |
| bot(Mozilla/5.0 (compatible; MJ12bot/v1.2.4; http://www.m ... | 3 | 2009-04-25 13:11:30 |
| bot(Eurobot/1.0 (http://www.ayell.eu)) ... | 3 | 2008-07-06 03:56:16 |
| google(Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; ... | 3 | 2008-10-26 13:58:31 |
| google(Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1. ... | 3 | 2008-11-19 17:57:23 |
| bot(MJ12bot/v1.2.0 (http://majestic12.co.uk/bot.php?+)) ... | 3 | 2007-10-04 01:52:29 |
| googlebot(Googlebot/2.1 (http://www.googlebot.com/bot.htm ... | 3 | 2008-06-02 15:39:28 |
| bot(Gigabot/2.0att) ... | 3 | 2007-05-20 21:33:32 |
| bot(Semager/1.3 http://www.semager.de/blog/semager-bots/) ... | 3 | 2009-03-22 22:25:05 |
| crawl(SimilarPages/Nutch-1.0-dev (SimilarPages Nutch Craw ... | 3 | 2009-03-11 16:42:31 |
| bot(Mozilla/5.0 (compatible; discobot/1.1; +http://discov ... | 2 | 2010-07-15 09:02:44 |
| spider(Baiduspider+(+http://www.baidu.jp/spider/)) ... | 2 | 2010-08-09 21:28:31 |
| bot(MLBot (www.metadatalabs.com/mlbot)) ... | 2 | 2010-07-24 06:01:02 |
| googlebot(Mozilla/5.0 (compatible; Googlebot/2.1; http:/ ... | 2 | 2009-06-05 08:11:00 |
| bot(Mozilla/5.0 (compatible; SnapPreviewBot; en-US; rv:1. ... | 2 | 2007-02-18 05:02:46 |
| bot(IIITBOT/1.1 (Indian Language Web Search Engine; http: ... | 2 | 2008-04-26 15:30:31 |
| bot(Mozilla/5.0 (compatible; YandexBot/3.0; MirrorDetecto ... | 2 | 2010-07-11 16:38:57 |
| crawl(Mozilla/4.0 (compatible; MSIE 5.01; Windows 95; MSI ... | 2 | 2010-09-07 14:22:58 |
| bot(msnbot/1.0+(+http://search.msn.com/msnbot.htm)) ... | 2 | 2007-08-25 13:21:02 |
| bot(renlifangbot/1.0 (+http://search.msn.com/msnbot.htm)) ... | 2 | 2009-06-17 10:20:57 |
| bot(yacybot (amd64 Windows 7 6.1; java 1.6.0_18; Europe/p ... | 2 | 2010-03-02 01:37:49 |
| spider(WinkySpider/Nutch-0.9 (wsiz.rzeszow.pl)) ... | 2 | 2007-06-28 23:08:41 |
| googlebot(Googlebot-Image/1.0) ... | 2 | 2007-08-27 07:26:01 |
| yandex(Yandex/2.01.000 (compatible; Win16; Dyatel; C)) ... | 2 | 2010-09-06 07:16:55 |
| crawl(Mozilla/5.0 (Windows;) NimbleCrawler 2.0.1 obeys Us ... | 2 | 2007-08-13 13:03:25 |
| bot(Snapbot/1.0) ... | 2 | 2007-04-12 02:33:41 |
| bot(yacybot (i386 Linux 2.6.26-2-openvz-686; java 1.6.0_0 ... | 2 | 2009-12-05 20:27:18 |
| crawl(PHPCrawl) ... | 2 | 2009-08-10 20:30:55 |
| bot(Mozilla/5.0 (compatible; discobot/1.1; +http://discov ... | 2 | 2010-02-03 22:16:23 |
| crawl(nutch.us/Nutch-1.0 (nutch.us; crawler@nutch.us)) ... | 2 | 2009-07-09 20:49:08 |
| crawl(Nokia6682/2.0 (3.01.1) SymbianOS/8.0 Series60/2.6 P ... | 2 | 2010-03-12 03:10:01 |
| onet(Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; T ... | 2 | 2010-04-30 13:28:34 |
| search(Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; ... | 2 | 2008-04-13 22:50:38 |
| crawl(Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; ... | 2 | 2007-03-26 18:38:19 |
| bot(Mozilla/5.0 (compatible; Supendobot/0.2; +http://www. ... | 2 | 2009-08-24 00:48:45 |
| google(Mozilla/4.0 (compatible; GoogleToolbar 4.0.1020.25 ... | 2 | 2007-10-08 19:36:23 |
| google(Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; ... | 2 | 2008-08-08 17:35:10 |
| spider(Pete-Spider Light/2.43) ... | 2 | 2008-05-14 15:08:03 |
| google(Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; ... | 2 | 2008-11-14 21:47:17 |
| bot(Mozilla/5.0 (compatible; RSSMicro.com RSS/Atom Feed R ... | 2 | 2008-07-15 17:02:43 |
| google(Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; ... | 2 | 2008-11-15 10:57:45 |
| bot(Mozilla/5.0 (compatible; DBLBot/1.0; +http://www.dont ... | 2 | 2008-10-29 17:46:03 |
| google(Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; ... | 2 | 2008-11-03 15:31:38 |
| bot(Plonebot/0.1) ... | 2 | 2009-02-11 03:33:45 |
| googlebot(Googlebot/2.0 (http://www.googlebot.com/bot.htm ... | 2 | 2008-05-03 05:59:26 |
| googlebot(Mozilla/5.0 (compatible; Googlebot/2.1;+http:// ... | 2 | 2008-02-15 17:52:28 |
| bot(CatchBot/1.0; +http://www.catchbot.com) ... | 2 | 2008-11-25 07:55:01 |
| google(Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; ... | 2 | 2010-07-30 14:20:06 |
| crawl(Crawl.pl-1/Nutch-0.9 (test run; www.pjwstk.edu.pl/~ ... | 1 | 2007-05-21 09:07:52 |
| crawl(KnowItAll/Nutch-0.9 (Nutch-UW-Crawler; http://cs.wa ... | 1 | 2008-09-14 10:31:44 |
| crawl(ilial/Nutch-0.9 (Ilial, Inc. is a Los Angeles based ... | 1 | 2007-06-06 00:05:14 |
| bot(Nutch/Nutch-0.9 (Eurobot; http://www.ayell.eu )) ... | 1 | 2008-04-21 15:23:22 |
| crawl(IRLbot/3.0 (compatible; MSIE 6.0; http://irl.cs.tam ... | 1 | 2008-04-20 18:31:42 |
| bot(yacybot (amd64 Linux 2.6.31.5; java 1.6.0_0; Europe/e ... | 1 | 2009-12-05 23:47:28 |
| bot(yacybot (i386 Linux 2.6.26-2-openvz-686; java 1.6.0_0 ... | 1 | 2009-12-06 00:15:00 |
| spider(Pete-Spider Light/1.49) ... | 1 | 2008-03-21 09:42:20 |
| bot(nrsbot/5.0(loopip.com/robot.html)) ... | 1 | 2008-04-10 05:37:08 |
| google(Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; ... | 1 | 2008-10-06 17:13:52 |
| google(Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; ... | 1 | 2008-11-03 17:23:47 |
| bot(MSRBOT (http://research.microsoft.com/research/sv/msr ... | 1 | 2008-09-29 15:00:46 |
| google(Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; ... | 1 | 2008-09-28 09:47:25 |
| googlebot(Mozilla/5.0 (Windows; U; Win98; pl; rv:1.8.1.3) ... | 1 | 2007-06-27 15:08:50 |
| crawl(Mozilla/5.0 (compatible; MSI_Crawler/0.1; +http://w ... | 1 | 2010-04-28 23:53:40 |
| search(Speedy Spider (Entireweb; Beta/1.2; http://www.ent ... | 1 | 2007-05-10 15:39:01 |
| search(Mozilla/4.0 (compatible; MSIE 6.0; America Online ... | 1 | 2008-06-30 15:09:16 |
| search(Mozilla/5.0 (compatible; Baiduspider/1.0; +http:// ... | 1 | 2010-08-13 04:05:34 |
| bot(OOZBOT/0.17 (--; http://www.setooz.com/oozbot.html; p ... | 1 | 2008-07-14 03:36:09 |
| googlebot(Googlebot/2.1 (+http://www.googlebot.com/bot.ht ... | 1 | 2008-06-13 00:14:47 |
| search(Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; ... | 1 | 2007-02-18 10:13:54 |
| search(Bigsearch.ca/Nutch-0.9-dev (Bigsearch.ca Internet ... | 1 | 2007-03-09 20:03:47 |
| onet(Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; M ... | 1 | 2009-05-13 21:47:10 |
| bot(Rankivabot/3.2 (www.rankiva.com; 3.2; vzmxikn)) ... | 1 | 2008-05-14 23:51:36 |
| crawl(LarbinWebCrawler internet@bredband.net) ... | 1 | 2007-03-18 23:59:38 |
| bot(Eurobot/Nutch-1.0-dev (1.0)) ... | 1 | 2008-05-11 21:10:18 |
| bot(Mozilla/4.0 compatible ZyBorg/1.0 (wn.zyborg@looksmar ... | 1 | 2008-05-11 06:38:01 |
| bot(SanszBot/1.7(http://shop.eurosystems.hu/sanszbot, spi ... | 1 | 2008-05-04 20:10:31 |
| crawl(AdultsVisitUs/Nutch-1.1 (www.AdultsVisitUs.com; cra ... | 1 | 2010-04-21 23:12:36 |
| bot(yacybot (x86 Windows XP 5.1; java 1.6.0_16; Europe/de ... | 1 | 2009-12-05 20:24:55 |
| crawl(DotBot/1.0 (http://www.dotnetdotcom.org/#info, craw ... | 1 | 2008-07-07 19:02:44 |
| crawl(REAP-crawler Nutch/Nutch-1.0-dev (Reap Project; htt ... | 1 | 2008-04-28 08:50:09 |
| search(GeoHasher/Nutch-1.0 (GeoHasher Web Search Engine; ... | 1 | 2010-08-19 18:22:46 |
| google(Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; ... | 1 | 2008-10-17 20:19:11 |
| bot(yacybot (i386 Linux 2.6.28-16-generic; java 1.6.0_0; ... | 1 | 2009-12-05 20:22:49 |
| spider(Mozilla/5.0 (compatible; OpenX Spider; http://www. ... | 1 | 2008-12-14 07:26:53 |
| google(User-Agent: Mozilla/4.0 (compatible; MSIE 7.0; Win ... | 1 | 2008-12-25 11:55:12 |
| onet(Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; T ... | 1 | 2009-05-05 19:42:01 |
| onet(Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; T ... | 1 | 2009-04-30 13:03:01 |
| crawl(Nokia6610/1.0 (3.09) Profile/MIDP-1.0 Configuration ... | 1 | 2008-02-27 21:38:33 |
| onet(Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; T ... | 1 | 2009-04-25 11:06:41 |
| google(Mozilla/5.0 (Windows; U; Windows NT 5.1; it; rv:1. ... | 1 | 2009-02-02 15:25:06 |
| bot(WinWebBot/1.0; (Balaena Ltd, UK); http://www.balaena. ... | 1 | 2009-02-20 20:27:17 |
| bot(Mozilla/5.0 (compatible; OsO; http://oso.octopodus.co ... | 1 | 2008-02-18 05:30:34 |
| bot(MSNBOT_Mobile Mozilla/2.0 (compatible; MSIE 4.02; Win ... | 1 | 2007-10-27 12:29:41 |
| bot(panelbot) ... | 1 | 2009-04-07 02:07:08 |
| search(Mozilla/5.0 (compatible; Charlotte/1.0t; http://ww ... | 1 | 2009-03-28 00:26:32 |
| crawl(WIRE/0.15 (Linux; i686; Bot,Robot,Spider,Crawleri, ... | 1 | 2007-10-31 19:59:43 |
| crawl(Grub/2.0 (IOI crawler; http://index.isc.org/; crawl ... | 1 | 2009-03-01 02:39:15 |
| crawl(LarbinWebCrawler spider@download11.com) ... | 1 | 2007-11-20 08:55:08 |
| bot(Mozilla/6.0 (MSIE 6.0; Windows NT 5.1; RSSMicro.com R ... | 1 | 2008-01-08 10:08:16 |
| bot(nrsbot/5.0(loopimprovements.com/robot.html)) ... | 1 | 2007-09-13 00:46:06 |
| crawl(IOI/2.0 (ISC Open Index crawler; http://index.isc.o ... | 1 | 2008-12-07 20:13:13 |
| google(Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; ... | 1 | 2008-10-23 19:11:31 |
| bot(yacybot (amd64 Linux 2.6.27.39-0.2-default; java 1.6. ... | 1 | 2009-12-05 20:16:35 |
| crawl(Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; ... | 1 | 2009-11-29 02:02:44 |
| onet(Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; T ... | 1 | 2009-11-04 13:02:41 |
| crawl(Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; ... | 1 | 2009-11-01 13:54:49 |
| bot(librabot/2.0 (+http://academic.research.microsoft.com ... | 1 | 2009-10-18 02:31:46 |
| onet(Mozilla/5.0 (X11; U; Linux i686; pl; rv:OnetSzukaj/1 ... | 1 | 2007-07-23 11:50:27 |
| bot(Eurobot/1.1 (http://eurobot.ayell.eu)) ... | 1 | 2009-08-17 07:24:26 |
| search(Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; ... | 1 | 2008-10-31 11:17:47 |
| onet(Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.0; T ... | 1 | 2009-08-05 20:56:28 |
| search(Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; ... | 1 | 2007-07-23 21:53:05 |
| crawl(ichiro/3.0 (http://help.goo.ne.jp/door/crawler.html ... | 1 | 2009-07-10 09:44:39 |
| google(Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; ... | 1 | 2008-11-04 08:04:46 |
| bot(Mozilla/5.0 (compatible; BotTracer/2.0; +http://www.i ... | 1 | 2008-11-12 02:58:01 |
| crawl(kalooga/KaloogaBot (Kalooga; http://www.kalooga.com ... | 1 | 2008-11-26 17:45:18 |
| ask jeeves(Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +ht ... | 1 | 2008-03-02 03:17:49 |
| google(Mozilla/5.0 (Windows; U; Windows NT 5.1; cs; rv:1. ... | 1 | 2009-03-02 10:17:02 |