A-AA+then

รายชื่อ Robot ต่างๆของ Web Spider

สามารถอ่านค่านี้ได้จากตัวแปร $_SERVER[HTTP_USER_AGENT]

ADSAComponent ADSAComponent (postmaster@cnds.ucd.ie)
AOL 3.0 Mozilla/2.0 (Compatible; AOL-IWENG 3.0; Win16)
ASPseek 1.2.10 ASPseek/1.2.10
ASPseek 1.2.11 ASPseek/1.2.11
ASPseek 1.2.12 ASPseek/1.2.12
Almaden c01 http://www.almaden.ibm.com/cs/crawler [c01]
Almaden http://www.almaden.ibm.com/cs/crawler [fc3]
Almaden wf224 http://www.almaden.ibm.com/cs/crawler [wf224]
Almaden wf55 http://www.almaden.ibm.com/cs/crawler [wf55]
Amfibibot 0.06 Amfibibot/0.06 (Amfibi Robot; http://www.amfibi.com; agent@amfibi.com)
Amsterdam 2002 Mozilla/4.0 (Search Engine Marketing Tactics Amsterdam 2002 Information Spider)
AnswerBus AnswerBus (http://www.answerbus.com/)
Antibot 1.1.11 antibot-V1.1.11/i586-linux-2.2
Antibot 1.1.13 antibot-V1.1.13/i586-linux-2.2
Antibot 1.2.0 antibot-V1.2.0/redhat-linux-9
Appie 1.1 appie 1.1 (www.walhello.com)
Argus 1.1 Argus/1.1 (Nutch; http://www.simpy.com/bot.html; feedback at simpy dot com)
Art-Online 0.9 Art-Online.com 0.9(Beta)
Ask Jeeves Mozilla/2.0 (compatible; Ask Jeeves)
Ask Jeeves Teoma Mozilla/2.0 (compatible; Ask Jeeves/Teoma)
AvantGo 3.2 Mozilla/3.0 (compatible; AvantGo 3.2)
BDFetch BDFetch
BDNcentral Crawler 2.3 BDNcentral Crawler v2.3 [en] (http://www.bdncentral.com/robot.html)
BDNcentral Crawler 2.3 BDNcentral Crawler v2.3 [en] (http://www.bdncentral.com/robot.html) (X11; I; Linux 2.0.44 i686)
BaiDuSpider BaiDuSpider
BaiDuSpider Baiduspider+(+http://www.baidu.com/search/spider.htm)
Battlebot battlebot
Big Brother Big Brother (http://pauillac.inria.fr/~fpottier/)
BlogBot 1.2 BlogBot/1.2
Boitho-dc 0.4 boitho.com-dc/0.4 ( http://www.boitho.com/dcbot.html )
Boitho-dc 0.5 boitho.com-dc/0.5 ( http://www.boitho.com/dcbot.html )
Boitho-dc 0.66 boitho.com-dc/0.66 ( http://www.boitho.com/dcbot.html )
Boitho-robot 1.0 boitho.com-robot/1.0
Boitho-robot 1.1 boitho.com-robot/1.1
BorderManager 3.0 Mozilla/4.0 (compatible; BorderManager 3.0)
BrailleBot 1.0 BrailleBot 1.0
BruinBot BruinBot (+http://webarchive.cs.ucla.edu/bruinbot.html)
Bumblebee 1.0 bumblebee/1.0 (bumblebee@relevare.com; http://www.relevare.com/)
CARI Crawler Computer_and_Automation_Research_Institute_Crawler (nospamspidernospam@spider.ilab.sztakinospam.hunospam)
CARI Crawler Computer_and_Automation_Research_Institute_Crawler (spider@spider.ilab.sztaki.hu)
Cd34 0.1 cd34/0.1
Cerberian Drtrs 3.0 Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.0-Build-41)
Cerberian Drtrs 3.0 Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.0-Build-43)
Cerberian Drtrs CerberianDrtrs/Version-3.0-Release-24
Cerberian Drtrs Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.0-Build-40)
Cerberian Drtrs Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.1-Build-11)
Cerberian Drtrs Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.1-Build-12)
Cerberian Drtrs Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.1-Build-13)
Cerberian Drtrs Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.1-Build-16)
Cerberian Drtrs Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.1-Build-17)
Cerberian Drtrs Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.2-Build-0)
CipinetBot CipinetBot (http://www.cipinet.com/bot.html)
Clushbot 2.1 Clushbot/2.1 (+http://www.clush.com/bot.html)
Clushbot 3.21 Clushbot/3.21-BinaryFury (+http://www.clush.com/bot.html)
Clushbot 3.23 Clushbot/3.23-BinaryFury (+http://www.clush.com/bot.html)
Clushbot 3.24 Clushbot/3.24-BinaryFury (+http://www.clush.com/bot.html)
Clushbot 3.6 Clushbot/3.6-BinaryFury (+http://www.clush.com/bot.html)
Clushbot 3.9 Clushbot/3.9-BinaryFury (+http://www.clush.com/bot.html)
ComMOOnity LambdaMOO 1.8.1 ComMOOnity LambdaMOO/1.8.1
ConveraCrawler 0.1 CrawlConvera0.1 (CrawlConvera@yahoo.com)
ConveraCrawler 0.1 CrawlConvera0.1 (www.authoritativeweb.com)
ConveraCrawler 0.2 ConveraCrawler/0.2
ConveraCrawler 0.5 ConveraCrawler/0.5 (+http://www
Cosmos 0.9 cosmos/0.9_(robot@xyleme.com)
Cowbot 0.1 Cowbot-0.1 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)
Cowbot 0.1.1 Cowbot-0.1.1 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)
Crawl_Application Crawl_Application
CrocCrawler 3.3 CrocCrawler v3.3 [en] (http://www.croccrawler.com) (X11; I; Linux 2.0.44 i686)
CrocCrawler 4.3 CrocCrawler v4.3 [en] (http://www.croccrawler.com) (X11; I; Linux 2.0.44 i686)
Custo 2.0 Custo 2.0 (www.netwu.com)
CydralSpider 1.9 CydralSpider/1.9 (Cydral Web Image Search; http://www.cydral.com)
DeMozulator 1.0 DeMozulator 1.0 (MacOS, dMoz URL Check Agent, trebor@animeigo.com)
DeepIndex DeepIndex (http://www.deepindex.com)
DoCoMo 1.0 DoCoMo/1.0/N504i/c10/TB
DoCoMo 1.0 DoCoMo/1.0/P504iS/c10/TB
Dual Proxy Dual Proxy
Dumbot Dumbot(version 0.1 beta - dumbfind.com)
Dumbot Dumbot(version 0.1 beta - http://www.dumbfind.com/dumbot.html)
Dumbot Dumbot(version 0.1 beta)
E-SocietyRobot e-SocietyRobot(http://www.yama.info.waseda.ac.jp/~yamana/es/)
EARTHCOM.info 1.2 EARTHCOM.info/1.2
EmailSiphon EmailSiphon
Enterprise_Search 1.00.136 Enterprise_Search/1.00.136;MSSQL (http://www.innerprise.net/es-spider.asp)
Exactseek-crawler 2.63 exactseek-crawler-2.63 (crawler@exactseek.com)
Exactseek-crawler 2.63 exactseek-crawler-2.63 crawler@exactseek.com
Exactseek-crawler 2.63 exactseek-crawler-2.63-5 (crawler@exactseek.com)
Exactseek-crawler 2.63 exactseek-crawler-2.63-5 crawler@exactseek.com
Explorer 6 Explorer 6
FAST Enterprise Crawler 6 FAST Enterprise Crawler/6 (crawler@fast.no)
FAST Enterprise Crawler 6 FAST Enterprise Crawler/6 (www.fastsearch.com)
FAST FirstPage retriever FAST FirstPage retriever (compatible; MSIE 5.5; Mozilla/4.0)
FAST-WebCrawler 3.2 FAST-WebCrawler/3.2 test
FAST-WebCrawler 3.4 FAST-WebCrawler/3.4/PartnerSite (crawler@fast.no; http://fast.no/support.php?c=faqs/crawler)
FAST-WebCrawler 3.6 FAST-WebCrawler/3.6 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)
FAST-WebCrawler 3.6 FAST-WebCrawler/3.6/FirstPage (atw-crawler at fast dot no;http://fast.no/support/crawler.asp)
FAST-WebCrawler 3.6 FAST-WebCrawler/3.6/FirstPage (crawler@fast.no; http://fast.no/support.php?c=faqs/crawler)
FAST-WebCrawler 3.7 FAST-WebCrawler/3.7 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)
FAST-WebCrawler 3.7 FAST-WebCrawler/3.7/FirstPage (atw-crawler at fast dot no;http://fast.no/support/crawler.asp)
FAST-WebCrawler 3.8 FAST-WebCrawler/3.8 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)
FAST-WebCrawler 3.8 FAST-WebCrawler/3.8 (atw-crawler at fast dot no; http://www.alltheweb.com/help/webmaster/crawler)
FAST-WebCrawler 3.8 FAST-WebCrawler/3.8 (crawler at trd dot overture dot com; http://www.alltheweb.com/help/webmaster/crawler)
FAST-WebCrawler 3.8 FAST-WebCrawler/3.8/Fresh (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)
FAST-WebCrawler 3.x FAST-WebCrawler/3.x Multimedia
FAST-WebCrawler 3.x FAST-WebCrawler/3.x Multimedia (mm dash crawler at fast dot no)
FDSE robot Mozilla/4.0 (compatible: FDSE robot)
FastBug FastBug http://www.ay-up.com
Favicon favicon finder at http://iconsurf.com/
Favicon favicon monitor at http://iconsurf.com/
Filangy 0.01 Filangy/0.01-beta (Filangy; http://www.nutch.org/docs/en/bot.html; filangy-agent@filangy.com)
Filangy 1.01 Filangy/1.01 (Filangy; http://www.filangy.com/filangyinfo.jsp?inc=robots.jsp; filangy-agent@filangy.com)
Filangy 1.01 Filangy/1.01 (Filangy; http://www.nutch.org/docs/en/bot.html; filangy-agent@filangy.com)
FindLinks 0.71 FindLinks/0.71 (+http://wortschatz.uni-leipzig.de/findlinks/)
Findlinks 0.82 findlinks/0.82 (+http://wortschatz.uni-leipzig.de/findlinks/)
Findlinks 0.87 findlinks/0.87 (+http://wortschatz.uni-leipzig.de/findlinks/)
Findlinks 0.89 findlinks/0.89 (+http://wortschatz.uni-leipzig.de/findlinks/)
Firefly 1.0 Firefly/1.0 (compatible; Mozilla 4.0; MSIE 5.5)
FlickBot 1.1 Flickbot 1.1 RPT-HTTPClient/0.3-3
FlickBot 2.0 FlickBot 2.0 RPT-HTTPClient/0.3-3
Fluffy the spider Mozilla/3.0 (compatible; Fluffy the spider; http://www.searchhippo.com/; info@searchhippo.com)
FusionBot Mozilla/4.0 (compatible; MSIE 5.0; www.galaxy.com; http://www.pgts.com.au/; +http://www.galaxy.com/info/crawler.html)
FyberSpider FyberSpider (+http://www.fybersearch.com/fyberspider.php)
GAIS Robot 1.1A2 GAIS Robot/1.1A2
Gaisbot 3.0 Gaisbot/3.0+(robot@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php)
GalaxyBot 1.0 GalaxyBot/1.0 (http://www.galaxy.com/galaxybot.html)
Gatherer 0.9 gatherer/0.9
Gazz 5.0 gazz/5.0 (gazz@nttr.co.jp)
Generic Generic
GeonaBot 1.0 GeonaBot 1.0; http://www.geona.com/
GeonaBot 1.1 GeonaBot/1.1; http://www.geona.com/
GetRight 4.5 GetRight/4.5e
Gigabot 1.0 Gigabot/1.0
Girafabot Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; Girafabot; girafabot at girafa dot com; http://www.girafa.com)
Goldfire Server Goldfire Server
Googlebot 2.1 Googlebot/2.1 (+http://www.google.com/bot.html)
Googlebot 2.1 Googlebot/2.1 (+http://www.googlebot.com/bot.html)
Googlebot 2.1 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
Googlebot Test Googlebot/Test (+http://www.googlebot.com/bot.html)
Googlebot-Image 1.0 Googlebot-Image/1.0
Googlebot-Image 1.0 Googlebot-Image/1.0 (+http://www.googlebot.com/bot.html)
Green Research, Inc. Green Research, Inc.
GregBot GregBot (compatible; MSIE; Windows; Q312461)
Grub-client 0.3.0 Mozilla/4.0 (compatible; grub-client-0.3.0; Crawl your own stuff with http://grub.org)
Grub-client 1.0.3 Mozilla/4.0 (compatible; grub-client-1.0.3; Crawl your own stuff with http://grub.org)
Grub-client 1.0.4 Mozilla/4.0 (compatible; grub-client-1.0.4; Crawl your own stuff with http://grub.org)
Grub-client 1.0.5 Mozilla/4.0 (compatible; grub-client-1.0.5; Crawl your own stuff with http://grub.org)
Grub-client 1.0.6 Mozilla/4.0 (compatible; grub-client-1.0.6; Crawl your own stuff with http://grub.org)
Grub-client 1.0.7 Mozilla/4.0 (compatible; grub-client-1.0.7; Crawl your own stuff with http://grub.org)
Grub-client 1.07 Mozilla/4.0 (compatible; grub-client-1.07; Crawl your own stuff with http://grub.org)
Grub-client 1.1.1 Mozilla/4.0 (compatible; grub-client-1.1.1; Crawl your own stuff with http://grub.org)
Grub-client 1.2.1 Mozilla/4.0 (compatible; grub-client-1.2.1; Crawl your own stuff with http://grub.org)
Grub-client 1.3.1 Mozilla/4.0 (compatible; grub-client-1.3.1; Crawl your own stuff with http://grub.org)
Grub-client 1.3.7 Mozilla/4.0 (compatible; grub-client-1.3.7; Crawl your own stuff with http://grub.org)
Grub-client 1.4.3 Mozilla/4.0 (compatible; grub-client-1.4.3; Crawl your own stuff with http://grub.org)
Grub-client 1.5.3 Mozilla/4.0 (compatible; grub-client-1.5.3; Crawl your own stuff with http://grub.org)
Grub-client 2.3 Mozilla/4.0 (compatible; grub-client-2.3)
Grub-client grub-client
GulperBot 0.2.4 Crawler [en] (compatible; Crawler Gulper Web Bot 0.2.4 www.ecsl.cs.sunysb.edu/~maxim/cgi-bin/Link/GulperBot)
GulperBot 0.2.4 Mozilla/5.0 [en] (compatible; Gulper Web Bot 0.2.4 www.ecsl.cs.sunysb.edu/~maxim/cgi-bin/Link/GulperBot)
HTTPConnect HTTPConnect
HTTrack 3.0x Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)
Harvest-NG 1.0.2 Harvest-NG/1.0.2
Hatena Antenna 0.4 Hatena Antenna/0.4 (http://a.hatena.ne.jp/help#robot)
Hatena Antenna 0.4 Hatena Antenna/0.4 (http://a.hatena.ne.jp/help)
Hget 0.3 hget/0.3
Hitwise Spider 1.0 Hitwise Spider v1.0 http://www.hitwise.com
Htdig 3.1.5 htdig/3.1.5 (admin@ipc-opc.lan)
Htdig 3.1.5 htdig/3.1.5 (unconfigured@htdig.searchengine.maintainer)
Htdig 3.1.6 htdig/3.1.6 (http://computerorgs.com)
Htdig htdig
Html Link Validator Html Link Validator (www.lithopssoft.com)
Httpcheck 1.0 Httpcheck/1.0 (Perl 5.006001)
Httpget 5.2.2 httpget-5.2.2
ICS 1.2.105 Mozilla/4.0 (compatible; ICS 1.2.105)
IPiumBot IPiumBot laurion(dot)com
IRLbot 1.0 IRLbot/1.0 (+http://irl.cs.tamu.edu/crawler)
Ia_archiver ia_archiver
IcabotAccept lcabotAccept: */*
Ichiro 1.0 ichiro/1.0 (ichiro@nttr.co.jp)
IconSurf 2.0 IconSurf/2.0 favicon monitor (see http://iconsurf.com/robot.html)
IlTrovatore-Setaccio 0.03 IlTrovatore-Setaccio/0.03-dev (Indexing; http://www.iltrovatore.it/bot.html; info@iltrovatore.it)
IlTrovatore-Setaccio 1.2 IlTrovatore-Setaccio/1.2 (+http://www.iltrovatore.it/aiuto/faq.html)
IlTrovatore-Setaccio 1.2 IlTrovatore-Setaccio/1.2 (Indexing; http://www.iltrovatore.it/bot.html; bot@iltrovatore.it)
IlTrovatore-Setaccio 1.2 IlTrovatore-Setaccio/1.2 (Indexing; http://www.iltrovatore.it/bot.html; info@iltrovatore.it)
IlTrovatore-Setaccio 1.2 IlTrovatore-Setaccio/1.2 (It-bot; http://www.iltrovatore.it/bot.html; info@iltrovatore.it)
IlTrovatore-Setaccio 1.2 IlTrovatore-Setaccio/1.2-dev (Indexing; http://www.iltrovatore.it/bot.html; info@iltrovatore.it)
IlTrovatore-Setaccio IlTrovatore-Setaccio (+http://www.iltrovatore.it)
Iltrovatore-Setaccio 0.3 Iltrovatore-Setaccio/0.3-dev (Indexing; http://www.iltrovatore.it/bot.html; info@iltrovatore.it)
Iltrovatore-Setaccio 1.2 Iltrovatore-Setaccio/1.2 (It-bot; http://www.iltrovatore.it/bot.html; info@iltrovatore.it)
Iltrovatore-Setaccio Iltrovatore-Setaccio
Imagefetch 0.1 imagefetch/0.1 libwww-perl/5.66
Indy Library Mozilla/3.0 (compatible; Indy Library)
InelaBot 0.2 InelaBot/0.2 (+http://inelegant.org/bot)
InfoSeek Sidewinder 1.0A InfoSeek Sidewinder/1.0A
Infoseek SideWinder 1.45 Infoseek SideWinder/1.45 (Compatible; MSIE 10.0; UNIX)
Infoseek SideWinder 2.0B Infoseek SideWinder/2.0B (Linux 2.4 i686)
Ingrid 3.0 Mozilla/3.0 (INGRID/3.0 MT; webcrawler@NOSPAMexperimental.net; http://aanmelden.ilse.nl/?aanmeld_mode=webhints)
Inktomi slurp Mozilla/3.0 (Slurp/si; slurp@inktomi.com; http://www.inktomi.com/slurp.html)
Inktomi slurp Mozilla/5.0 (Slurp/cat; slurp@inktomi.com; http://www.inktomi.com/slurp.html)
Inktomi slurp Mozilla/5.0 (Slurp/si; slurp@inktomi.com; http://www.inktomi.com/slurp.html)
Inktomi slurp Slurp/2.0 (slurp@inktomi.com; http://www.inktomi.com/slurp.html)
Inktomi slurp Slurp/si-emb (slurp@inktomi.com; http://www.inktomi.com/slurp.html)
InternetLinkAgent 3.1 InternetLinkAgent/3.1
Istarthere http://www.istarthere.com (spider@istarthere.com)
Java 1.4.0 Java1.4.0
JoBo 1.3 JoBo/1.3 (http://www.matuschek.net/jobo.html)
K2spider k2spider
KMcrawler KMcrawler
Knowledge 0.2 Knowledge.com/0.2
Knowledge 0.3 Knowledge.com/0.3
Knowledge Engine Knowledge Engine
Kuloko-bot 0.2 kuloko-bot/0.2
LNSpiderguy LNSpiderguy
Larbin 2.6.2 Larbin larbin2.6.2@unspecified.mail
Larbin 2.6.2 larbin_2.6.2 (kalou@kalou.net)
Larbin 2.6.2 larbin_2.6.2 (larbin2.6.2@unspecified.mail)
Larbin 2.6.2 larbin_2.6.2 (larbin@correa.org)
Larbin 2.6.2 larbin_2.6.2 (pimenas@softnet.tuc.gr)
Larbin 2.6.2 larbin_2.6.2 (pimenas@systems.tuc.gr)
Larbin 2.6.2 larbin_2.6.2 (sumeet_sobti@yahoo.com)
Larbin 2.6.2 larbin_2.6.2 (vitalbox1@hotmail.com)
Larbin 2.6.2 larbin_2.6.2 (vshelk@yahoo.com)
Larbin 2.6.2 larbin_2.6.2 larbin2.6.2@unspecified.mail
Larbin 2.6.2 larbin_2.6.2 larbin@correa.org
Larbin 2.6.2 larbin_2.6.2 pimenas@systems.tuc.gr
Larbin 2.6.2 larbin_2.6.2 sumeet_sobti@yahoo.com
Larbin 2.6.2 larbin_2.6.2 vitalbox1@hotmail.com
Larbin 2.6.3 larbin_2.6.3 (andreas.beder@chello.at)
Larbin 2.6.3 larbin_2.6.3 (larbin-crawler@un.bewaff.net)
Larbin 2.6.3 larbin_2.6.3 (larbin2.6.3@unspecified.mail)
Larbin 2.6.3 larbin_2.6.3 (pimenas@softnet.tuc.gr)
Larbin 2.6.3 larbin_2.6.3 larbin2.6.3@unspecified.mail
Larbin 2.6.3 larbin_2.6.3_for_(http://cosco.hiit.fi/search/) (Tomi.Silander@hiit.fi)
Larbin 2.6.3 larbin_2.6.3_for_(http://cosco.hiit.fi/search/) (tsilande@hiit.fi)
Larbin 2.6.3 larbin_2.6.3_for_(http://cosco.hiit.fi/search/) Tomi.Silander@hiit.fi
Larbin 2.6.3 larbin_2.6.3_for_(http://cosco.hiit.fi/search/) tsilande@hiit.fi
Larbin 2.63 eseek-crawler-larbin-2.63 (crawler@exactseek.com)
Larbin 2.63 eseek-crawler-larbin-2.63 crawler@exactseek.com
Larbin LARBIN-EXPERIMENTAL (efp@gmx.net)
Larbin LARBIN-EXPERIMENTAL efp@gmx.net
Larbin Larbin (larbin2.6.2@unspecified.mail)
Larbin MSIE-5.13 (larbin@unspecified.mail)
Larbin MSIE-5.13 larbin@unspecified.mail
Larbin Mozilla (la2@unspecified.mail)
Larbin Mozilla la2@unspecified.mail
Larbin Mozilla/4.0 (efp@gmx.net)
Larbin Mozilla/4.0 efp@gmx.net
Larbin SearchGuild_DMOZ_Experiment (chris@searchguild.com)
Larbin SearchGuild_DMOZ_Experiment chris@searchguild.com
Larbin WinampMPEG/2.00 (larbin@unspecified.mail)
Larbin WinampMPEG/2.00 larbin@unspecified.mail
Larbin larbin (samualt9@bigfoot.com)
Larbin larbin samualt9@bigfoot.com
Larbin larbin_extended (larbin@oktie.com)
Larbin larbin_test (nobody@airmail.etn)
Libwww-MGET 1.0 libwww-MGET/1.0 libwww/5.2.8
Libwww-perl 5.3.2 / libwww/5.3.2
Libwww-perl 5.4.0 / libwww/5.4.0
Libwww-perl 5.48 libwww-perl/5.48
Libwww-perl 5.50 libwww-perl/5.50
Libwww-perl 5.51 libwww-perl/5.51
Libwww-perl 5.52 libwww-perl/5.52 FP/4.0
Libwww-perl 5.53 libwww-perl/5.53
Libwww-perl 5.63 libwww-perl/5.63
Libwww-perl 5.64 libwww-perl/5.64
Libwww-perl 5.65 MyApp/0.1 libwww-perl/5.65
Libwww-perl 5.65 libwww-perl/5.65
Libwww-perl 5.66 rawiswar/0.1 libwww-perl/5.66
Libwww-perl 5.68 libwww-perl/5.68
Libwww-perl 5.69 VanillaZilla/0.1 libwww-perl/5.69
Libwww-perl 5.69 libwww-perl/5.69
Libwww-perl 5.74 libwww-perl/5.74
Libwww-perl 5.75 libwww-perl/5.75
Libwww-perl 5.76 libwww-perl/5.76
Libwww-perl 5.800 libwww-perl/5.800
Libwww-perl 5.801 libwww-perl/5.801
Libwww-perl 5.802 libwww-perl/5.802
Libwww-perl 5.803 libwww-perl/5.803
Libwww-perl Perl-Win32::Internet/0.082
LimeBot 1.0 LimeBot/1.0 (+www.cruiselime.com/LimeBot.php)
LinkLint-checkonly 2.3.5 LinkLint-checkonly/2.3.5
Linkbot 3.0 Linkbot 3.0
Linknzbot 2004 Linknzbot 2004/(+http://www.linknz.co.nz/robot.php)
Linknzbot Linknzbot/ (+http://www.linknz.co.nz/robot.php)
Links SQL Links SQL (http://gossamer-threads.com/scripts/links-sql/)
Lite Bot 0616B Lite Bot 0616B
Look Look.com
Lwp-request 1.29 lwp-trivial/1.29
Lwp-request 1.35 lwp-trivial/1.35
Lwp-request 1.36 lwp-trivial/1.36
Lwp-request 2.01 lwp-request/2.01
Lwp-request 5.48 LWP::Simple/5.48
Lwp-request 5.65 LWP::Simple/5.65
Lycos_Spider Lycos_Spider_(modspider)
MS Data Access Microsoft Data Access Internet Publishing Provider Cache Manager
MS Data Access Microsoft Data Access Internet Publishing Provider DAV
MS Data Access Microsoft Data Access Internet Publishing Provider DAV 1.1
MS Data Access Microsoft Data Access Internet Publishing Provider Protocol Discovery
MS FrontPage 4.0 MSFrontPage/4.0
MS FrontPage 4.0 Mozilla/2.0 (compatible; MS FrontPage 4.0)
MS FrontPage 5.0 MSFrontPage/5.0
MS FrontPage 5.0 Mozilla/2.0 (compatible; MS FrontPage 5.0)
MSIECrawler Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0; MSIECrawler)
MSIECrawler Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; Win 9x 4.90; Q312461; BTopenworld; MSIECrawler)
MSIECrawler Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0; MSIECrawler)
MSIECrawler Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; MSIECrawler)
MSIECrawler Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Q312461; MSIECrawler)
MSIECrawler Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; matlas-2.0.2501; MSIECrawler)
MSIECrawler Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; MSIECrawler)
MSProxy 2.0 MSProxy/2.0
MSRBot 0.1 MSRBOT/0.1 (http://research.microsoft.com/research/sv/msrbot/)
Mediapartners-Google 2.1 Mediapartners-Google/2.1
Mediapartners-Google 2.1 Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html)
Mercator 2.0 Mercator-2.0
MetaGer-LinkChecker MetaGer-LinkChecker
Metacarta metacarta (crawler@metacarta.com)
Metacarta metacarta crawler@metacarta.com
Microsoft URL Control Microsoft URL Control - 5.00.3609
Microsoft URL Control Microsoft URL Control - 5.01.4319
Microsoft URL Control Microsoft URL Control - 6.00.8169
Microsoft URL Control Microsoft URL Control - 6.00.8862
Microsoft-ATL-Native 7.00 Microsoft-ATL-Native/7.00
MicrosoftPrototypeCrawler MicrosoftPrototypeCrawler (How's my crawling? mailto:newbiecrawler@hotmail.com)
Moget 1.0 moget/1.0 (moget@goo.ne.jp)
Moget 2.1 moget/2.1 (moget@goo.ne.jp)
MozDex 0.04 mozDex/0.04-dev (mozDex; http://www.mozdex.com/bot.html; spider@mozdex.com)
MozDex 0.05 mozDex/0.05-dev (mozDex; http://www.mozdex.com/bot.html; spider@mozdex.com)
Mozilla Mozilla/4.0 (compatible; Netcraft Web Server Survey)
Msnbot 0.1 MSNBOT/0.1 (http://search.msn.com/msnbot.htm)
Msnbot 0.11 msnbot/0.11 (+http://search.msn.com/msnbot.htm)
Msnbot 0.3 msnbot/0.3 (+http://search.msn.com/msnbot.htm)
Msnbot 1.0 msnbot/1.0 (+http://search.msn.com/msnbot.htm)
MysteryBot Mozilla/3.01 (compatible;)
NG 1.0 NG/1.0
NPBot NPBot
NPBot NPBot (http://www.nameprotect.com/botinfo.html)
NPBot NPBot-1/2.0
NPBot NPBot-1/2.0 (http://www.nameprotect.com/botinfo.html)
NaverBot 1.0 NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)
NaverBot_dloader 1.5 NaverBot_dloader/1.5
NaverRobot 1.0 dloader(NaverRobot)/1.0
NaverRobot 1.5 dloader(NaverRobot)/1.5
NetAnts 1.25 NetAnts/1.25
NetNoseCrawler 1.0 NetNoseCrawler/v1.0
NetNoseCrawler 2.0 Mozilla/4.0 (compatible; MSIE 5.0; NetNose-Crawler 2.0; A New Search Experience: http://www.netnose.com)
NetResearchServer 2.4 NetResearchServer/2.4(loopimprovements.com/robot.html)
NetResearchServer 2.5 NetResearchServer/2.5(loopimprovements.com/robot.html)
NetResearchServer 2.7 NetResearchServer/2.7(loopimprovements.com/robot.html)
NetResearchServer 2.8 NetResearchServer/2.8(loopimprovements.com/robot.html)
NetResearchServer 2.9 NetResearchServer/2.9(loopimprovements.com/robot.html)
NetResearchServer 3.4 NetResearchServer/3.4(loopimprovements.com/robot.html)
NetResearchServer NetResearchServer(http://www.look.com)
NextGenSearchBot 1 NextGenSearchBot 1 (for information visit http://www.eliyon.com/NextGenSearchBot)
None none
NuSearch Spider NuSearch Spider www.nusearch.com
NutchBot 0.05 NutchCVS/0.05 (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net)
NutchBot 0.05 NutchCVS/0.05-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net)
NutchBot 0.06 CreativeCommons/0.06-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net)
NutchCrawler Robot: NutchCrawler, Owner: wdavies@acm.org
NutchOrg 0.03 NutchOrg/0.03-dev (Nutch; http://www.nutch.org/docs/bot.html; nutch-agent@lists.sourceforge.net)
OWR_Crawler 0.1 OWR_Crawler 0.1
Obot Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0; obot)
Obot oBot
Ocelli 1.3 Ocelli/1.3 (http://www.globalspec.com/Ocelli)
OmniExplorer_Bot 1.07 OmniExplorer_Bot/1.07 (+http://www.omni-explorer.com) Internet Categorizer
OmniExplorer_Bot 1.07 OmniExplorer_Bot/1.07 (+http://www.omni-explorer.com) Job Crawler
Openbot 3.0 Openbot/3.0+(robot-response@openfind.com.tw;+http://www.openfind.com.tw/robot.html)
Openbot 3.0 Openbot/3.0+(robot@monkia.com.tw;+http://gais.cs.ccu.edu.tw/robot.php)
Openbot 3.0 Openfind data gatherer, Openbot/3.0+(robot-response@openfind.com.tw;+http://www.openfind.com.tw/robot.html)
OrangeBot OrangeBot
Organica 2.24 Mozilla/4.0 (compatible; Advanced Email Extractor v2.24)
Overture-WebCrawler 3.8 Overture-WebCrawler/3.8/Fresh (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)
PEERbot PEERbot www.peerbot.com
PWS.Kiosk PWS.Kiosk - Content Filtering
Parabot parabot (paracite@ecs.soton.ac.uk)
Patwebbot Patwebbot (http://www.herz-power.de/technik.html)
Pavuk 0.9 pavuk/0.9pl28 i586-pc-cygwin
Pavuk 0.9 pavuk/0.9pl29b i686-pc-linux-gnu
PipeLiner 0.3 pipeLiner/0.3a (PipeLine Spider; http://www.pipeline-search.com/webmaster.html; webmaster@pipeline-search.com)
Planethosting http://www.planethosting.com
Polybot 1.0 polybot 1.0 (http://cis.poly.edu/polybot/)
Pompos 1.1 Pompos/1.1 http://pompos.iliad.fr
Pompos 1.2 Pompos/1.2 http://pompos.iliad.fr
Pompos 1.3 Pompos/1.3 http://dir.com/pompos.html
Portal Manager 0.7 Portal Manager 0.7
Potbot 1.0 potbot 1.0
ProWebGuide Link Checker ProWebGuide Link Checker (http://www.prowebguide.com)
Program Shareware 1.0.3 Program Shareware 1.0.3
Psbot 0.1 psbot/0.1 (+http://www.picsearch.com/bot.html)
Pverify 1.2 pverify/1.2
QPCreep Test Rig QPCreep Test Rig ( We are not indexing, just testing )
QuepasaCreep 0.9.14 QuepasaCreep v0.9.14
QuepasaCreep QuepasaCreep ( crawler@quepasacorp.com )
QuepasaCreep v0.9.13 QuepasaCreep v0.9.13
RPT-HTTPClient 0.3 RPT-HTTPClient/0.3-3
Reifier reifier.org (admin@reifier.org)
Reifier reifier.org admin@reifier.org
Rico 0.1 rico/0.1
RixBot RixBot (http://www.oops-as.no/rix/)
RoboPal RoboPal (http://www.findpal.com/)
RobotMidareru 0.7 RobotMidareru/0.7libwww-perl/5.65
Robots.txt Validator Search Engine World Robots.txt Validator at http://www.searchengineworld.com/cgi-bin/robotcheck.cgi
Robozilla 1.0 Robozilla/1.0
SYCLIKControl LinkChecker Mozilla/5.0 (compatible; SYCLIKControl/LinkChecker;)
SafariBookmarkChecker 1.25 SafariBookmarkChecker/1.25 (+http://www.coriolis.ch/)
SafariBookmarkChecker 1.26 SafariBookmarkChecker/1.26 (+http://www.coriolis.ch/)
Scooter 1.0 Scooter/1.0
Scooter 1.1 Scooter-ARS-1.1
Scooter 3.0 Scooter-3.0.FS - Altavista.com
Scooter 3.2 Scooter-3.2
Scooter 3.2 Scooter-3.2.BT
Scooter 3.2 Scooter-3.2.EX
Scooter 3.2 Scooter-3.2.FNR
Scooter 3.2 Scooter-3.2.PDF
Scooter 3.2 Scooter-3.2.SF0
Scooter 3.2 Scooter-3.2.TX.FNR
Scooter 3.2 Scooter-3.2.XX0
Scooter 3.2 Scooter/3.2
Scooter 3.2 Scooter/3.2.SF0
Scooter 3.2 Scooter_x0-3.2.EX
Scooter 3.3 Scooter/3.3
Scooter 3.3 Scooter/3.3.QA
Scooter 3.3 Scooter/3.3.QA.pczukor
Scooter 3.3 Scooter/3.3.vscooter
Scooter 3.3 Scooter/3.3_SF
Scrubby 2.1 Scrubby/2.1 (http://www.scrubtheweb.com/abs/meta-check.html)
Scrubby 2.2 Scrubby/2.2 (http://www.scrubtheweb.com/)
Search Agent 1.0 Search Agent 1.0
SearchSpider 1.1 SearchSpider.com/1.1
Seekbot 1.0 Seekbot/1.0 (http://www.seekbot.net/bot.html) HTTPFetcher/0.3
Seekbot 1.0 Seekbot/1.0 (http://www.seekbot.net/bot.html) RobotsTxtFetcher/1.0 (XDF)
Semanticdiscovery 0.1 semanticdiscovery/0.1
Sensis.au Web Crawler Sensis.com.au Web Crawler (search_comments\at\sensis\dot\com\dot\au)
Sherlock 1.3 sherlock/1.3 httpget/1.3
Sherlock_spider sherlock_spider (jimfan@163.com)
SiteXpert SiteXpert
Sitecheck InternetSeer.com
Sitecheck sitecheck.internetseer.com (For more info see: http://sitecheck.internetseer.com)
Sitescooper 3.1.2 sitescooper/3.1.2 (http://sitescooper.org) libwww-perl/5.51
SlySearch 1.3 SlySearch/1.3 (http://www.slysearch.com)
SlySearch 1.3 SlySearch/1.3 http://www.slysearch.com
Sohu-search sohu-search
Speedy Spider Speedy Spider (http://www.entireweb.com)
SpeedySpider Mozilla/4.0 (compatible; SpeedySpider; www.entireweb.com)
Speedy_Spider Speedy_Spider_(http://www.entireweb.com)
SpiderKU 0.9 SpiderKU/0.9
SpiderMonkey 7.04 SpiderMonkey/7.04 (SpiderMonkey.ca info at http://spidermonkey.ca/sm.shtml)
SpiderMonkey 7.06 Spider_Monkey/7.06 (SpiderMonkey.ca info at http://SpiderMonkey.ca /sm.shtml)
SpiderMonkey 7.06 Spider_Monkey/7.06 (SpiderMonkey.ca info at http://www.spidermonkey.ca/sm.shtml)
SpurlBot 0.2 Mozilla/5.0 (compatible; SpurlBot/0.2)
Sqworm 2.9.85 Sqworm/2.9.85-BETA (beta_release; 20011115-775; i686-pc-linux-gnu)
Star Downloader Star Downloader
Steeler 1.3 Steeler/1.3 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)
SuperCleaner 2.56 Mozilla/4.0 (compatible; SuperCleaner 2.56; Windows NT 5.1)
Szukacz 1.5 Szukacz/1.5
Szukacz 1.5 Szukacz/1.5 (robot; www.szukacz.pl/jakdzialarobot.html; info@szukacz.pl)
Tarantula Tarantula Experimental Crawler
TclSOAP 1.0 Tcl http client package 1.0
TclSOAP 2.3 Tcl http client package 2.3
Teradex Mapper (Teradex Mapper; mapper@teradex.com; http://www.teradex.com)
Teradex_Crawler Teradex_Crawler (crawler@teradex.com; http://crawler.teradex.com)
TheSuBot 0.1 TheSuBot/0.1 (www.thesubot.de)
TheSuBot Beta thesubot-beta-www.thesubot.de
Thumbshots-de-Bot thumbshots-de-Bot (Version: 1.02, powered by www.thumbshots.de)
TimboBot 0.9 timboBot/0.9 http://www.breakingblogs.com/timbo_bot.html
Tkensaku 0.9 Tkensaku/0.9 (http://www.tkensaku.com/q.html)
TranSGeniKBot TranSGeniKBot (http://www.tsgk.net)
TranSGeniKBot www.tsgk.net TranSGeniKBot http://www.tsgk.net
TulipChain 5.7 TulipChain/5.7 (http://ostermiller.org/tulipchain/) Java/1.4.0_02 (http://java.sun.com/) Windows_Me/4.90
TulipChain 5.94 TulipChain/5.94 (http://ostermiller.org/tulipchain/) Java/1.4.1_01 (http://apple.com/) Mac_OS_X/10.2.8
TulipChain 6.01 TulipChain/6.01 (http://ostermiller.org/tulipchain/) Java/1.4.2_03 (http://java.sun.com/) Windows_XP/5.1 RPT-HTTPClient/0.3-3
TulipChain 6.02 TulipChain/6.02 (http://ostermiller.org/tulipchain/) Java/1.4.2_03 (http://apple.com/) Mac_OS_X/10.3.3 RPT-HTTPClient/0.3-3
TulipChain 6.03 TulipChain/6.03 (http://ostermiller.org/tulipchain/) Java/1.4.2_05 (http://java.sun.com/) Windows_XP/5.1 RPT-HTTPClient/0.3-3
TurnitinBot 1.4 TurnitinBot/1.4 (http://www.turnitin.com/robot/crawlerinfo.html)
TurnitinBot 1.4 TurnitinBot/1.4 http://www.turnitin.com/robot/crawlerinfo.html
TurnitinBot 1.5 TurnitinBot/1.5 (http://www.turnitin.com/robot/crawlerinfo.html)
TurnitinBot 1.5 TurnitinBot/1.5 http://www.turnitin.com/robot/crawlerinfo.html
TurnitinBot 2.0 TurnitinBot/2.0 (http://www.turnitin.com/robot/crawlerinfo.html)
TurnitinBot 2.0 TurnitinBot/2.0 http://www.turnitin.com/robot/crawlerinfo.html
TutorGigBot 1.5 TutorGigBot/1.5 ( +http://www.tutorgig.info )
Tutorial Crawler 1.4 Tutorial Crawler 1.4 (http://www.tutorgig.com/crawler)
UIowaCrawler 1.0 UIowaCrawler/1.0
UIowaCrawler 2.0 UIowaCrawler/2.0
USyd-NLP-Spider USyd-NLP-Spider (http://www.it.usyd.edu.au/~vinci/bot.html)
UdmSearch 3.1.20 UdmSearch/3.1.20
Unchaos_crawler 2.0.2 unchaos_crawler_2.0.2 (search.engine@unchaos.com)
Updated 0.1 updated/0.1beta (updated.com; http://www.updated.com; crawler@updated.om)
VSE 1.0 VSE/1.0 (vsecrawler@hotmail.com)
Vagabondo 2.0 Vagabondo/2.0 MT (webagent at wise-guys dot nl)
Vagabondo 2.0 Vagabondo/2.0 MT (webagent@NOSPAMwise-guys.nl)
Vagabondo 2.1 Mozilla/5.0 (compatible; Vagabondo/2.1; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/)
Vivante Link Checker Vivante Link Checker (http://www.vivante.com)
Void-bot 0.1 void-bot/0.1 (bot@void.be; http://www.void.be/)
VoilaBot 1.6 Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) VoilaBot; 1.6
VoilaBot 1.6 Mozilla/4.0_(compatible;_MSIE_5.0;_Windows_95)_VoilaBot/1.6 libwww/5.3.2
Vspider vspider
W3C-checklink 2.90 W3C-checklink/2.90 libwww-perl/5.64
W3C-checklink 3.6.2.3 W3C-checklink/3.6.2.3 libwww-perl/5.64
W3C-checklink 3.9.2 W3C-checklink/3.9.2 [3.17] libwww-perl/5.79
W3C-checklink 4.0 W3C-checklink/4.0 [4.4] libwww-perl/5.800
W3C-checklink 4.1 W3C-checklink/4.1 [4.14] libwww-perl/5.800
W3C_Validator 1.183 W3C_Validator/1.183 libwww-perl/5.64
W3C_Validator 1.305.2.109 W3C_Validator/1.305.2.109 libwww-perl/5.79
W3C_Validator 1.305.2.12 W3C_Validator/1.305.2.12 libwww-perl/5.64
W3C_Validator 1.305.2.137 W3C_Validator/1.305.2.137 libwww-perl/

PHP

Relate

^