ABCdatos BotLink
searchspider
http://www.robotstxt.org/wc/active/html/abcdatos.html
botlink+AEA-abcdatos.com
217.126.0.0/18
abot
unknown
http://www.abot.com/
Accelatech
rssspider
Accoona
searchspider
http://accoona.com/about/about_accoona.jsp
crawler at accoona dot com
aconon Index (raubfische.de)
searchspider
Ahoy!
searchspider
http://www.robotstxt.org/wc/active/html/ahoythehomepagefinder.html
marclang@cs.washington.edu
cs.washington.edu
128.208.0.0/16
Alexa
searchspider
Alkaline
searchspider
http://www.robotstxt.org/wc/active/html/Alkaline.html
dblock@vestris.com
Almaden Crawler
searchspider
http://www.almaden.ibm.com/cs/crawler/
crawler at us dot ibm dot com
ananzi
searchspider
Anthill
searchspider
http://www.robotstxt.org/wc/active/html/anthill.html
info@anthill.org
213.10.10.116-213.10.10.118
Aport
searchspider
http://www.aport.ru/
ru
Apple
rssspider
Arachnophilia
searchspider
http://www.robotstxt.org/wc/active/html/arachnophilia.html
taluskie@utpapa.ph.utexas.edu
Araneo
searchspider
http://www.robotstxt.org/wc/active/html/araneo.html
araneo@esperantisto.net
ArchitextSpider
searchspider
http://www.robotstxt.org/wc/active/html/architext.html
spider@atext.com
arks
searchspider
http://www.robotstxt.org/wc/active/html/arks.html
aniruddha.c@usa.net
ASpider
searchspider
http://www.robotstxt.org/wc/active/html/aspider.html
fredj@pvv.ntnu.no
www.allthatnet.com
207.36.0.0/16
ATN Worldwide
searchspider
http://www.robotstxt.org/wc/active/html/atn.txt.html
info@allthatnet.com
www.atomz.com
64.191.196.0/23
Atomz.com
searchspider
http://www.robotstxt.org/wc/active/html/atomz.html
mike@atomz.com
192.134.99.192
193.50.125.0/24
AURESYS
searchspider
http://www.robotstxt.org/wc/active/html/auresys.html
mannina@crrm.univ-mrs.fr
BackRub
searchspider
http://www.robotstxt.org/wc/active/html/backrub.html
page@leland.stanford.edu
*.netcologne.de
194.8.193.0-194.8.194.255
Baiduspider
searchspider
http://www.baidu.com/search/spider.htm
cn
BBot
searchspider
http://www.robotstxt.org/wc/active/html/bbot.html
poluf1 at yahoo dot co dot uk
BecomeBot
searchspider
http://www.become.com/webmasters.html
Big Brother
searchspider
http://www.robotstxt.org/wc/active/html/bigbrother.html
Francois.Pottier@inria.fr
Bigmir
searchspider
http://www.bigmir.net/
ua
Bitacle
blogspider
http://bitacle.org/
Biz
searchspider
http://www.biz360.com
blogsmanager [at] biz360 [dot] com
Bjaaland
searchspider
http://www.robotstxt.org/wc/active/html/bjaaland.html
tbray@textuality.com
140.190.65.1-140.190.65.254
BlackWidow
searchspider
http://www.robotstxt.org/wc/active/html/blackwidow.html
khooghee@marys.smumn.edu
134.100.0.0/16
BlogCrawler
rssspider
BlogDb
rssspider
http://blogdb.jp
BlogFan
rssspider
http://www.blogfan.org
Bloglies
rssspider
http://www.bloglines.com
BlogPulse
rssspider
BlogSearch
rssspider
http://www.icerocket.com
BlogsNow
blogspider
http://www.blogsnow.com/
andreas [at] blogsnow [dot] com
BlogStreetBot
rssspider
http://www.blogstreet.com/
BlogStreetBot
rssspider
http://bulkfeeds.net
BoardPulse
forumspider
http://www.boardpulse.com/
support@boardpulse.com
BoardReader
forumspider
http://www.boardreader.com/aboutus.asp
info@boardreader.com
BoardViewer
searchspider
http://www.boardviewer.com/
support@boardviewer.com
Boitho
searchspider
http://www.boitho.com/bot.html
post [at] boitho [dot] com
217.118.38.226-217.118.38.234
80.202.212.14
212.71.72.75
Borg-Bot
searchspider
http://www.robotstxt.org/wc/active/html/borg-bot.html
botdev@skunkfarm.com
210.159.73.34-210.159.73.35
BSpider
searchspider
http://www.robotstxt.org/wc/active/html/bspider.html
okumura@rsl.crl.fujixerox.co.jp
CACTVS Chemistry
searchspider
Calif
searchspider
CaRP
rssspider
http://www.biz360.com
blogsmanager [at] biz360 [dot] com
Checkbot
searchspider
ChristCrawler.com
searchspider
cIeNcIaFiCcIoN.nEt
searchspider
Cipinet
unknown
http://www.cipinet.com/bot.html
CJNetworkQuality
misc_spider
http://www.cj.com/networkquality/
CMC/0.01
searchspider
ColdFusion
searchspider
Combine System
searchspider
cometsystems.com
searchspider
ComputingSite Robi/1.0
searchspider
Conceptbot
searchspider
Cooby.de Crawler
searchspider
CoolBot
searchspider
Cusco
searchspider
CyberSpyder
searchspider
daypop
rssspider
DeadLinkCheck
linkchecker
http://dlc.sourceforge.net/
martial [at] users [dot] sourceforge [dot] net
Desert Realm
searchspider
DeWeb(c)
searchspider
Die Blinde Kuh
searchspider
http://www.robotstxt.org/wc/active/html/blindekuh.html
maschinist@blinde-kuh.de
DienstSpider
searchspider
Digger
searchspider
Digimarc MarcSpider
searchspider
Digimarc Marcspider/CGI
searchspider
Digital Integrity Robot
searchspider
Direct Hit Grabber
searchspider
DNAbot
searchspider
Dot.tk
linkchecker
http://www.dot.tk
DragonBot
searchspider
DWCP (Dridus' Web Cataloging Project)
searchspider
e-Society
searchspider
http://www.yama.info.waseda.ac.jp/~yamana/es/index_eng.htm
abuse-es[at] yama [dot] info [dot] waseda [dot] ac [dot] jp
eaxactseek-page
searchspider
crawler [at] exactseek [dot]com
EbiNess
searchspider
Edgeio
rssspider
http://www.edgeio.com
EIT Link Verifier Robot
searchspider
ELFINBOT
searchspider
Emacs-w3 Search Engine
searchspider
Esther
searchspider
EuripBot
searchspider
Evliya Celebi
searchspider
ExactSeek_Spider
searchspider
http://www.askjeevs.com
ExaLead
searchspider
http://botspotter.net/bs-389.html
fr
ExaLead Beta
searchspider
http://beta.exalead.com/search/C=0/2p=Help.7
crawler@exalead.com
FAST / AlltheWeb
searchspider
http://help.yahoo.com/help/us/ysearch/slurp/index.html
FastCrawler
searchspider
Feed24
rssspider
http://www.feed24.com
FeedBlitz
searchspider
http://www.feedblitz.com
FeedBurner
rssspider
http://www.FeedBurner.com
FeedFetcher-Google
rssspider
http://www.google.com/feedfetcher.html
FeedParser
rssspider
http://www.feedparser.org
Feedster
rssspider
http://www.feedstermedia.com/
FeedValidator
searchspider
FEHLSTART
searchspider
de
Felix IDE
searchspider
FetchRover
searchspider
fido
searchspider
FindLinks
misc_spider
http://wortschatz.uni-leipzig.de/findlinks/
Findroy
rssspider
http://www.findory.com
Fish search
searchspider
Fluid Dynamics
searchspider
Fouineur
searchspider
Freecrawl
searchspider
FunnelWeb
searchspider
Gais
searchspider
http://gais.cs.ccu.edu.tw/robot.php
robot@gais.cs.ccu.edu.tw
GAMEKIT
searchspider
http://www.uchoose.de/crawler/gamekitbot/
de
gammaSpider
searchspider
gazz
searchspider
GCreep
searchspider
genieBot
searchspider
http://64.5.245.11/faq/faq.html
wgao (at) genieknows.com
GeoURL
misc_spider
http://geourl.org/bot.html
GetterroboPlus Puu
searchspider
GetURL
searchspider
Gigabot
searchspider
http://www.gigablast.com/spider.html
Girafabot
searchspider
http://www.girafa.com/
Goku
unknown
http://goku.ru/bot.htm; bot@goku.ru
bot [at] goku [dot] ru
Golem
searchspider
Gonzo
unknown
crawleradmin [dot] t-info [at] telekom [dot] de
Google
searchspider
http://www.google.com/bot.html
googlebot@google.com
64.233.160.0-64.233.191.255
66.249.64.0-66.249.95.255
72.14.192.0-72.14.207.255
216.239.32.0-216.239.63.255
Google AdSense
searchspider
https://www.google.com/adsense/faq
adsense-support@google.com
Googlebot-Image
imagespider
http://www.googlebot.com/bot.html
Gpostbot
searchspider
http://www.gpost.info/help.php?c=bot
Griffon
searchspider
Gromit
searchspider
Grub Client
searchspider
Gulper Bot
searchspider
H?m?h?kki
searchspider
http://www.robotstxt.org/wc/active/html/finnish.html
Timo.Metsala@www.fi
fi
havIndex
searchspider
HeinrichderMiragoRobot
searchspider
HenryTheMiragoRobot
searchspider
Heritrix
searchspider
http://www.worio.com
HKU WWW Octopus
searchspider
HolyCowDude
rssspider
http://www.holycowdude.com/spider.htm
Hometown
searchspider
ht://Dig
searchspider
HTML Index
searchspider
HTMLgobble
searchspider
I, Robot
searchspider
iajaBot
searchspider
IBM_Planetwide
searchspider
IceRocket
blogspider
http://www.icerocket.com/
ichiro
unknown
ichiro [at] nttr [dot] co [dot] jp
IlTrovatore-Setaccio
searchspider
http://www.iltrovatore.it/aiuto/faq.html
info@iltrovatore.it
image.kapsi.net
searchspider
Imagelock
searchspider
IncyWincy
searchspider
Informant
searchspider
InfoSeek Robot 1.0
searchspider
Infoseek Sidewinder
searchspider
InfoSpiders
searchspider
Ingrid
searchspider
Inktomi
searchspider
Insitor
searchspider
http://www.insitor.de/
Inspector Web
searchspider
IntelliAgent
searchspider
Intelliseek
searchspider
http://www.intelliseek.com/
Internet Cruiser
searchspider
Internet Seer
http_monitoring
Internet Shinchakubin
searchspider
InternetLinkAgent
searchspider
Iron33
searchspider
Israeli-search
searchspider
itch
forumspider
http://www.itch.com/infoforwebmasters.html
JavaBee
searchspider
JBot
searchspider
JCrawler
searchspider
JetEye
searchspider
http://www.jeteye.com/jetbot.html
JoBo
searchspider
Jobot
searchspider
JoeBot
searchspider
JumpStation
searchspider
Katipo
searchspider
KDD-Explorer
searchspider
KIT-Fireball
searchspider
KO_Yappo_Robot
searchspider
LabelGrabber
searchspider
larbin
searchspider
legs
searchspider
Link Alarm
linkchecker
Link Validator
searchspider
LinkScan
searchspider
LinkWalker
searchspider
livedoorCheckers
searchspider
Lockon
searchspider
logo.gif
searchspider
Lycos
searchspider
Magpie
searchspider
Majestics MJ12bot
searchspider
Mammoth
searchspider
http://www.sli-systems.com
Marvin
searchspider
marvin/infoseek
searchspider
Mattie
searchspider
MediaFox
searchspider
Mercator
searchspider
http://research.compaq.com/SRC/mercator/
MerzScope
searchspider
META
searchspider
http://www.meta.com.ua/
ua
MetaGer
searchspider
MindCrawler
searchspider
Miva
unknown
AlgoFeedback [at] miva [dot] com
mnoGoSearch
searchspider
moget
searchspider
MOMspider
searchspider
Monster
searchspider
Moreover
searchspider
http://www.moreover.com
Motor
searchspider
MSNBot
searchspider
Muscat Ferret
searchspider
Mwd.Search
searchspider
NameProtect
searchspider
NaverBot
searchspider
http://www.spidermatic.com/en/robot-spider/20
nhnbot@naver.com
kr
NEC-MeshExplorer
searchspider
Nederland.zoek
searchspider
NetCarta WebMap
searchspider
Netcraft Web Server Survey
http_monitoring
http://news.netcraft.com/
NetMechanic
searchspider
NetScoop
searchspider
newscan-online
searchspider
NextGenSearchBot
searchspider
http://www.zoominfo.com/NextGenSearchBot
NHSE Web Forager
searchspider
NIF
rssspider
http://www.newsisfree.com/robot.php users
NimbleCrawler
unknown
http://www.healthline.com/aboutus.jsp
crawler@healthline.com
72.5.115.0-72.5.115.127
Nomad
searchspider
Norbert
searchspider
http://www.Burf.com
Northern Light
searchspider
nzexplorer
searchspider
Occam
searchspider
Ocelli
searchspider
http://www.globalspec.com/Ocelli
Online24-Bot
searchspider
Openbot
searchspider
http://www.openfind.com.tw/robot.html
robot-response@openfind.com.tw
Openfind data gatherer
searchspider
Orb Search
searchspider
Pack Rat
searchspider
PageBoy
searchspider
ParaSite
searchspider
Patric
searchspider
pegasus
searchspider
PerlCrawler 1.0
searchspider
PGP Key Agent
searchspider
Phantom
searchspider
PhpDig
searchspider
PiltdownMan
searchspider
Pimptrain.com's
searchspider
PingALink
http_monitoring
Pioneer
searchspider
Pluck
searchspider
http://www.pluck.com
PlumtreeWebAccessor
searchspider
PodNova
searchspider
http://www.podnova.com
Pompos
searchspider
http://dir.com/pompos.html
Poppi
searchspider
Popular Iconoclast
searchspider
Portal Juice
searchspider
PortalB Spider
searchspider
Project Kolinka Forum Search
forumspider
http://www.kolinka.com/
questions [at] kolinka [dot] com
psbot
searchspider
Qango
searchspider
http://www.qango.com
Rambler
searchspider
http://www.rambler.ru/
Raven Search
searchspider
ru
Resume Robot
searchspider
Road Runner: The ImageScape Robot
searchspider
RoadHouse Crawling System
searchspider
Robbie the Robot
searchspider
RoboCrawl
searchspider
RoboFox
searchspider
Robot Francoroute
searchspider
Robozilla
searchspider
Roverbot
searchspider
RSS Feed Seeker
rssspider
http://www.rss-spider.com/fsb.php
RuLeS
searchspider
SafetyNet
searchspider
SBIder.
rssspider
http://www.sitesell.com/sbider.html
Scharia
searchspider
Science-Index
searchspider
Scooter
searchspider
SearchNZ
searchspider
http://www.searchnz.co.nz/
SearchProcess
searchspider
Seekbot
searchspider
http://www.seekbot.net/bot.html
de
Senrigan
searchspider
Sensis Web Crawler
searchspider
http://www.sensis.com.au/help.do
search_comments\at\sensis\dot\com\dot\au
au
SG-Scout
searchspider
ShagSeeker
searchspider
Shai'Hulud
searchspider
Simmany Robot Ver1.0
searchspider
Site Searcher
searchspider
Site Valet
searchspider
Site-List
rssspider
http://www.site-list.net
SiteTech-Rover
searchspider
SitiDi.net/SitiDiBot
searchspider
Skymob.com
searchspider
SLCrawler
searchspider
Sleek
searchspider
Smart Spider
searchspider
Snooper
searchspider
sohu-search
searchspider
Solbot
searchspider
Speedy Spider
searchspider
Sphere
searchspider
scout at sphere dot com
Sphider
searchspider
SpiderBot
searchspider
Spiderline Crawler
searchspider
SpiderMan
searchspider
SpiderView(tm)
searchspider
spider_monkey
searchspider
Suke
searchspider
suntek search engine
searchspider
Szukacz
searchspider
http://www.szukacz.pl/html/RobotEnglishVersion.html
info@szukacz.pl
193.218.115.0/24
194.181.35.0/24
bramka.proszynski.pl
brama.proszynski.pl
pl
T-H-U-N-D-E-R-S-T-O-N-E
searchspider
TACH Black Widow
searchspider
Tarantula
searchspider
tarspider
searchspider
Tcl W3 Robot
searchspider
TechBOT
searchspider
Technorati
blogspider
http://technorati.com/about/
press [at] technorati [dot] com
Templeton
searchspider
Teoma/Ask Jeeves
searchspider
http://sp.teoma.com/docs/teoma/about/
The Jubii
searchspider
The NorthStar Robot
searchspider
The NWI Robot
searchspider
The Peregrinator
searchspider
thumbshots-de-Bot
misc_spider
TITAN
searchspider
TitIn
searchspider
TLSpider
searchspider
Turnitin.com
searchspider
http://www.turnitin.com/static/products_services/search_engines.html
TurnitinBot
searchspider
Turtle
searchspider
http://www.turtle.ru/
ru
UCSD Crawl
searchspider
UMBC
rssspider
Unpartisan
rssspider
http://www.unpartisan.com
URL Check
searchspider
URL Spider Pro
searchspider
Valkyrie
searchspider
Verticrawl
searchspider
Victoria
searchspider
vision-search
searchspider
VoilaBot
unknown
http://www.voila.com/
Voyager
searchspider
VWbot
searchspider
W3C
linkchecker
http://validator.w3.org/checklink
W3C
htmlvalidator
http://validator.w3.org/
W3C
cssvalidator
http://jigsaw.w3.org/css-validator/
W3M2
searchspider
w3mir
searchspider
w@pSpider
searchspider
Walhello appie
searchspider
http://www.robotstxt.org/wc/active/html/appie.html
aimo@walhello.com
halsoft.com
192.188.16.0/24
WallPaper
searchspider
Web Core / Roots
searchspider
Web Moose
searchspider
WebBandit
searchspider
WebCatcher
searchspider
Webclipping
searchspider
WebCopy
searchspider
webfetcher
searchspider
weblayers
searchspider
WebLinker
searchspider
Weblog Monitor
searchspider
WebQuest
searchspider
WebReaper
searchspider
webs
searchspider
WebSearchBench
searchspider
http://websearchbench.cs.uni-dortmund.de/
de
WebStolperer
searchspider
WebVac
searchspider
webwalk
searchspider
WebWalker
searchspider
WebWatch
searchspider
Wget
searchspider
whatUseek Winona
searchspider
Whois Source
http_monitoring
http://www.whois.sc/info/webmasters/surveybot.html
Wild Ferret Web Hopper
searchspider
Willow
linkchecker
WinHTTP
searchspider
Wired Digital
searchspider
WiseNut
searchspider
WorldIndexer
searchspider
http://www.omni-explorer.com
WWWC
searchspider
WWWeasel Robot
searchspider
wwwster
searchspider
gue[at]cis.uni-muenchen.de
WWWWanderer
searchspider
X-Crawler
searchspider
Xenu Link Sleuth
linkchecker
http://home.snafu.de/tilman/xenulink.html
XGET
searchspider
XYLEME Robot
searchspider
Yahoo Publisher Network
misc_spider
http://publisher.yahoo.com/
Yahoo! Slurp
searchspider
Yahoo-Blogs
rssspider
http://help.yahoo.com/help/us/ysearch/crawling/crawling-02.html
Yahoo-VerticalCrawler
searchspider
YahooFeedSeeker
searchspider
http://my.yahoo.com/s/publishers.html
Yandex
searchspider
http://www.yandex.ru/
ru
Zeus Internet Marketing
searchspider
http://www.cyber-robotics.com/
Zork
rssspider
http://www.zorkk.com