googlebot=Google.com
slurp@inktomi=Hot Bot
ask jeeves=Ask Jeeves
lycos=Lycos.com
whatuseek=What You Seek
ia_archiver=Archive.org
Acoon=Acoon bot
ah-ha.com=ah-ha bot
AnzwersCrawl=Australian search
appie=Walhello.com search
Arachnoidea=EuroSeek search
Araneo=Apparently spiders
ArchitextSpider=Excite spider
ask jeeves=Ask Jeeves
Atomz=Atomz bot
aWapClient=WAP content crawler
bumblebee=Relevare.com bot
CMC=Computer Music Center bot
ComputingSite=ComputingSite bot
crawler3=Altavista spider
Cruizer=Southafrican spider
Datenbank=Datenbank.de bot
DeepIndex=DeepIndex spider
Die Blinde Kuh=German Kids spider
Esther =Build database bot
ExplorerSearch=New Zealand Explorer
FreeCrawl=EuroSeek spider
Fast-WebCrawler=AllTheWeb spider
Fido=PlanetSearch spider
Gaisbot=GAIS spider
Gigabot=Unknown bot
googlebot=Google bot
Google=Google bot
Gulliver=Northern Light spider
Gulper Web Bot=Yuntis web robot
ia_archiver=Archive.org Bot
Icorus=Webmasterworld.com Bot
InfoSeek=InfoSeek spider
Iron33=Verno spider
JCrawler=Vietnamese search
IsraeliSearch=Israeli Society
KO Yappo=Yappo search
KIT Fireball=Fireball search
lycos=Lycos.com Bot
Mercator=Altavista spider
Mewsoft Search Engine=Newsoft spider
Motor=CyberCon Search spider
MSNBOT=MSN Search
MuscatFerret=EuroFerret database
MwdSearch=Finnish search
NEC MeshExplorer=NETPLAZA search
Nederland Zoek=Nederland.net search
NetScoop=NetScoop search
Nutch=open-source web search
Openbot=Openfind search
Openfind data gatherer=Openfind bot
Orb Search=Orb search
RHCS=RoadHouse search
Scooter=Altavista spider
Scrubby=Scrub The Web search
SearchTone=Developer's site spider
semanticdiscovery=Semanticdiscovery.com spider
Sidewinder=InfoSeek spider
Slurp=Inktomi/Hot Bot search
SwissSearch=Swiss search
szukacz=Polish searches
Tarantula=Altavista spider
Trek17=Altavista search
UdiSearch=Yahoo spider
UltraSeek=InfoSeek spider
Vagabondo=Mainly Dutch spider
Valkyrie=Japanese ODIN search
Voyager=Lisa search service
VWbot=SearchBC database spider
w3index=Scandinavian web spider
WebCrawler=WebCrawler search
WebQuest=Build search
Wired Digital=Wired Digital spider
whatuseek=What You Seek
YahooSeeker=Yahoo spider
Zealbot=LookSmart spider
ZyBorg=Wisenut search
jeeves=Ask Jeeves
google=Google.com
Asterias=Singingfish Spider
Slurp=Inktomi Spider
ZyBorg=LookSmart Bot
slurp@inktomi=HotBot
lycos=Lycos.com
LinkWalker=Link Walker
Slurp/2.0=HotBot
ABCdatos BotLink/1.0.2=ABC Bot
'Ahoy! The Homepage Finder'=Ahoy Spider
appie/1.1=Walhello Spider
InfoSeek Robot 1.0=Infoseek
Infoseek Sidewinder=Infoseek
MSNBOT/0.1=MSNBot
Openbot=OpenBot
inktomisearch.com=Yahoo
Slurp.so/1.0=Yahoo
Slurp/2.0j=Yahoo
Slurp/2.0-KiteHourly=Yahoo
Slurp/2.0-OwlWeekly=Yahoo
Slurp/3.0-AU=Yahoo
UltraSeek=InfoSeek
MuscatFerret=WebTop
appie=Walhello
UK Searcher Spider=UK Searcher
teoma_agent1=Teoma.com
HenryTheMiragoRobot=MiragoBot
Lycos_Spider_(T-Rex)=Lycos
Toutatis 2.5-2=Hoppa.com
Hubater=Hubat.com
IlTrovatore-Setaccio=IlTrovatore.it
IncyWincy=IncyWincy.com
Mole2/1.0=Intags.de
MP3Bot=MP3bot.de
LNSpiderguy=Lexis-Nexis.com
kuloko-bot/0.2=Kuloko.com
NetResearchServer=Look.com
MantraAgent=Look Smart
Arachnoidea=EuroSeek
EZResult=EZResult
ArchitextSpider=Excite
ArchitectSpider=Excite
Inktomi=InktomiBot
GAIS Robot/1.0B2=Seednet
Gulliver/1.2=Northern Light
Infoseek Sidewinder/0.9=Sidewinder
lwp-trivial/1.27=Search 4 Free
Lycos_Spider_(T-Rex)/3.0=Lycos
Scooter/1.0=AltaVista
sexsearcher=Sex Searcher
WebCrawler/3.0 Robot libwww/5.0a=WebCrawler
WebCrawler-AddURL/2.0=WebCrawler
WiseWire=WiseWire
WiseWire-Alpha-1.0=WiseWire
WiseWire-Alpha-Spider=WiseWire
WiseWire-Alpha12-Spider971219a=WiseWire
WiseWire-Alpha12-Spider(971223a)=WiseWire
WiseWire-HotSpider-1.0=WiseWire
WiseWire-Spider=WiseWire
WiseWire-Spider-1.0=WiseWire
WiseWire-Spider2=WiseWire
WiseWire-Widow-1.0=WiseWire
WiseWire-Widow-1.0r=WiseWire
WiseWire-Widow-1.0-ALPHA12=WiseWire
AbachoBOT=Abacho
abcdatos_botlink=ABCDatos
AESOP_com_SpiderMan-AESOP.com
Scooter=AltaVista
Mercator=AltaVista
Scooter2_Mercator_3-1.0=Scooter2 Spider
roach.smo.av.com-1.0=Roach SPider
Tv_Merc_resh_26_1_D-1.0=Merc Spider
Wget=All The Web
antibot=AntiSearch.net
Atomz=Atomz
CanSeek/=Can Seek
ChristCRAWLER=Christ CRAWLER
DaAdLe.com ROBOT/=DaAdLe.com
contact/[email protected]=Jylee Spider
RaBot=Daum.net
Agent-admin/=Daum.net
DeepIndex=DeepIndex
DittoSpyder=Ditto.com
Jack=Jack Spider
EZResult=EZResults.com
FyberSearch=FyberSearch.com
GalaxyBot=Galaxy.com
geckobot=geckobot.com
GenCrawler=GenDoor.com
GeonaBot=Geona.com
moget/2.0=goo.ne.jp
JoocerBot=Joocer.com
HenryTheMiragoRobot=Mirago.co.uk
mozDex/=MozDex.com
MSNBOT/0.1=MSN
ObjectsSearch/0.01=ObjectsSearch.com
PicoSearch/=PicoSearch.com
PJspider=PortalJuice.com
DIIbot=PowerInter.net
gazz/1.0=Gazz Spider
NationalDirectory-SuperSpider=NationalDirectory.com
psbot=PicSearch.org
AlkalineBOT=AlkalineBOT
Scrubby/=ScrubTheWeb.com
asterias=SingingFish.com
Kototoi/0.1=Kototoi Spider
Searchspider/=Searchspider.com
SightQuestBot/=SightQuest.com
Spider_Monkey/=Spider_Monkey.ca
teoma_agent1=Teoma.com
ESISmartSpider=Travel-Finder.com
appie=Walhello.com
MuscatFerret=WebTop.com
WSCbot=WorldSearchCenter.com
Yandex=Yandex.com
Yellopet-Spider=Yellopet.com
libwww-perl=Libwww Spider
citenikbot/=CitenikBot
CLIPS-index=CLIPS Spider
cosmos=XYleme.com
Computer_and_Automation_Research_Institute_Crawler
=CARI Spider
DiaGem/=DiaGem Spider
EchO!/2.0=Voila.com
FinaleRobot=FinaleRobot
larbin=Larbin Spider
MultiText=MultiText Spider
OntoSpider=OntoSpider
sherlock_spider=Sherlock Spider
Steeler=Steeler Spider
0.1_hseo(at)cs.rutgers.edu=Rutgers.eduSpider
Zao/0.2=Zao Spider
[email protected]=Xcrawler
xyro=Xyro Spider
WebGather=WebGather Spider
Ad Muncher=Ad Muncher Spider
ADSAComponent=ADSA Spider
ADSARobot=ADSARobot
Albert Indexer=Albert Indexer
AnswerChase=AnswerChase
ASPSeek=ASPSeek
ATA-Translation-Service=ATA Spider
AVSearch=AVSearch Spider
beholder=Beholder Spider
e-sense=E-sense Spider
BravoBrian=BravoBrian Spider
[email protected]=BumbleBee Spider
Checkbot=Checkbot
contype=ConType Spider
Convera Internet Spider=Convera Spider
DaviesBot=DaviesBot
deepweb=Deepweb Spider
EbiNess=EbiNess Spider
EmailWolf=EmailWolf Spider
Excalibur Internet Spider=Excalibur Spider
Expired Domain Sleuth=Domain Slueth
GigaBaz=GigaBaz Spider
GigaBazVStheWeb=GigaBaz2 Spider
[email protected]=BrainBot Spider
Giskard=Giskard Spider
grub-client=Grub Spider
htdig=HT Dig Spider
http://webwarper.net=WebWarper.net
infoGIST=infoGIST Spider
InterGO=InterGO Spider
InternetArchive=Internet Archive
Internet Ninja=Internet Ninja Spider
InternetSeer=InternetSeer
ipiumBot=ipiumBot
InternetAmi IOR=InternetAmi
InsumaScout/=InsumaScout
Katriona=Katriona Spider
larbin=Larbin Spider
LEIA=LEIA Spider
LexiBot=LexiBot
logikabot=LogikaBot
Mister Pix II=Mister Pix Spider
MOSES 2.0 Spider=Moses 2.0 Spider
Mata Hari=MataHari Spider
metabot=MetaBot
NetCruiser=NetCruiser
NPBot=NPBot
NetZippy=NetZippy
NZBot=NZBot
Opencola=Opencola Spider
ORA_checksite=ORA Spider
Onekit.com - PAD File Get.=Onekit.com
Oxxbot1=Oxxbot1
Pansophica=Pansophica Spider
Phoaks=Phoaks Spider
phpMySearch-Crawler=phpMySearch
PICgrabber=PICgrabber
PictureOfInternet=POI Spider
[email protected]=Malfunction.orgr
PintaSpider=PintaSpider
Pita (Chub.Stanford.EDU)=Pita (Stanford.edu)
PitSpyder Thread0=PitSpyder
psbot=PSbot
PolyBot=PolyBot
PureSight=PureSight
Rumours-Agent=Rumours Spider
RepoMonkey Bait & Tackle=RepoMonkey Spider
Robot2.0(PingSoft)=Robot2.0
SilentSurf=SilentSurf
SlySearch=SlySearch
[email protected]=SlySearch.com
SpaceBison=SpaceBison
SpotOn=SpotOn Spider
SQ Webscanner=Webscanner
Squid=Squid Spider
Sqworm=Sqworm Spider
SurfControl=SurfControl
Tagword=Tagword
TaWWWantula=TaWWWantula
Tcl http client package=TCL Spider
TeraCrawl=TeraCrawl
TurnitinBot=TurnitinBot
UCmore=UCmore
UdmSearch=UdmSearch
unlostBot=unlostBot
[email protected]=Unlost.com
URLBlaze=URLBlaze Spider
utopy=Utopy Spider
[email protected]=Utopy.com
UtilMind HTTPGet=UtilMind Spider
UrlScope=UrlScope Spider
Vagabondo=Vagabondo Spider
VCI WebViewer=VCI Spider
vspider=VSpider
WAVETools=WAVETools Spider
Webbandit=Webbandit Spider
Webclipping.com=Webclipping Spider
webcollage=WebCollage Spider
WebCompass=WebCompas Spider
WebGenie=WebGenie Spider
Web Hound=WebHound Spider
Web Magnet=WebMagnet Spider
WebMiner=WebMiner Spider
Webpush=Webpush Spider
WebSymmetrix=WebSymmetrix Spider
webrank=WebRank Spider
webwasher=WebWasher Spider
WhosTalking=WhosTalking
XupiterToolbar=Xupiter Spider
StackRambler=Rambler
rambler=Rambler
oBot=oBot
Aport=Aport
WebZIP=WebZIP
ZunZun=ZunZun
OmniWeb=OmniWeb
ZipppBot=ZipppBot
GetSmart=GetSmart
MarcoPolo=MarcoPolo
PlantyNet=PlantyNet
Ivan Susanin=IvanSusanin
Netprospector=Netprospector
TurtleScanner=TurtleScanner
Yahoo-MMCrawler=Y!MMCrawler
Binky=libwww.Binky
amaya=libwww.amaya
Webgate=libwww.Webgate
W3C_Validator=libwww.W3C_Validator
libwww=libwww.nothing