A Bot http://www.abot.com/ ABCdatos BotLink http://www.robotstxt.org/wc/active/html/abcdatos.html botlink+AEA-abcdatos.com Accelatech RSS Accoona http://accoona.com/about/about_accoona.jsp crawler at accoona dot com Aconon Index raubfische.de Ahoy! http://www.robotstxt.org/wc/active/html/ahoythehomepagefinder.html marclang@cs.washington.edu Alexa http://www.alexa.com/site/help/webmasters Alkaline http://www.robotstxt.org/wc/active/html/Alkaline.html dblock@vestris.com AltaVista Ananzi Anthill http://www.robotstxt.org/wc/active/html/anthill.html info@anthill.org Aport http://www.aport.ru/ Apple RSS Arachnophilia http://www.robotstxt.org/wc/active/html/arachnophilia.html taluskie@utpapa.ph.utexas.edu Araneo http://www.robotstxt.org/wc/active/html/araneo.html araneo@esperantisto.net Architext http://www.atext.com spider@atext.com Arks http://www.robotstxt.org/wc/active/html/arks.html aniruddha.c@usa.net Artabus http://www.artabus.com Ask.com ASpider http://www.robotstxt.org/wc/active/html/aspider.html fredj@pvv.ntnu.no ATN Worldwide http://www.robotstxt.org/wc/active/html/atn.txt.html info@allthatnet.com Atomz atomz.com mike@atomz.com Attributor http://www.attributor.com Auresys http://www.robotstxt.org/wc/active/html/auresys.html mannina@crrm.univ-mrs.fr B Bot http://www.robotstxt.org/wc/active/html/bbot.html poluf1 at yahoo dot co dot uk BackRub http://www.robotstxt.org/wc/active/html/backrub.html page@leland.stanford.edu Baidu http://www.baidu.com/search/spider_jp.html Become http://www.become.com/webmasters.html Begun Robot Crawler http://www.begun.ru support@begun.ru BejiBot Big Brother http://www.robotstxt.org/wc/active/html/bigbrother.html Francois.Pottier@inria.fr Big-Boards.com Bigmir http://www.bigmir.net/ Bitacle http://bitacle.org/ Biz 360 http://www.biz360.com blogsmanager [at] biz360 [dot] com Bjaaland http://www.robotstxt.org/wc/active/html/bjaaland.html tbray@textuality.com Black Widow http://www.robotstxt.org/wc/active/html/blackwidow.html khooghee@marys.smumn.edu BlogCrawler BlogDB RSS http://blogdb.jp BlogFan http://www.blogfan.org Bloglines RSS http://www.bloglines.com BlogPulse RSS BlogSearch RSS http://www.icerocket.com BlogsNow http://www.blogsnow.com/ andreas [at] blogsnow [dot] com BlogStreet RSS http://www.blogstreet.com/ Board Tracker http://www.boardtracker.com/spider.html BoardPulse http://www.boardpulse.com/ support@boardpulse.com BoardReader http://www.boardreader.com/aboutus.asp info@boardreader.com BoardViewer http://www.boardviewer.com/ support@boardviewer.com Boitho http://www.boitho.com/bot.html post [at] boitho [dot] com Borg http://www.robotstxt.org/wc/active/html/borg-bot.html botdev@skunkfarm.com BotW http://botw.org BSpider http://www.robotstxt.org/wc/active/html/bspider.html okumura@rsl.crl.fujixerox.co.jp Bulkfeeds http://bulkfeeds.net CACTVS Chemistry Calif CaRP RSS http://www.biz360.com blogsmanager [at] biz360 [dot] com Charlotte http://www.searchme.com/support/pages/spider.php Checkbot Christ Crawler ChristCrawler.com cIeNcIaFiCcIoN www.cienciaficcion.net Cipinet http://www.cipinet.com/bot.html CJ http://www.cj.com/networkquality/ Clicksor.com http://www.yesup.net/bot.html CLX.ru http://www.clx.ru CMC/0.01 ColdFusion Combine System Comet Systems cometsystems.com ComputingSite Robi ConceptBot Cooby Cooby.de CoolBot Cuil http://www.cuil.com/info/webmaster_info/ http://www.cuil.com/info/contact_us/feedback.php?to=crawler Cuil Spider http://www.cuil.com Cusco CyberSpyder Daypop RSS Dead Link Check http://dlc.sourceforge.net/ martial [at] users [dot] sourceforge [dot] net Deepnet Explorer Desert Realm DesertRealm.com Deweb Die Blinde Kuh http://www.robotstxt.org/wc/active/html/blindekuh.html maschinist@blinde-kuh.de Dienst Digger Digimarc MarcSpider Digimarc Marcspider/CGI Digital Integrity Robot Direct Hit Grabber DNAbot DotBot http://www.dotnetdotcom.org/#info crawler@dotnetdotcom.org dotnetdotcom.org http://www.dotnetdotcom.org crawler@dotnetdotcom.org DotTK SiteCheck http://www.dot.tk DragonBot DWCP (Dridus' Web Cataloging Project) e-Society http://www.yama.info.waseda.ac.jp/~yamana/es/index_eng.htm abuse-es[at] yama [dot] info [dot] waseda [dot] ac [dot] jp EbiNess eBingBong http://www.ebingbong.com/help/ourRobot.php ebingbong@playstarmusic.com Edgeio http://www.edgeio.com EIT Link Verifier Robot Elfin Bot Emacs-w3 Search Engine EnaBall http://www.enaball.com/crawler.html Esther eSyndiCat Bot EuripBot Evliya Celebi Exabot http://www.exabot.com/go/robot Exact Seek www.exactseek.com crawler [at] exactseek [dot]com Exact Seek http://www.askjeevs.com ExaLead http://botspotter.net/bs-389.html ExaLead Beta http://beta.exalead.com/search/C=0/2p=Help.7 crawler@exalead.com Facebook http://www.facebook.com/externalhit_uatext.php FAST / AlltheWeb http://help.yahoo.com/help/us/ysearch/slurp/index.html FastCrawler Feed 24 RSS http://www.feed24.com Feed Blitz http://www.feedblitz.com Feed Parser http://www.feedparser.org FeedBurner RSS http://www.FeedBurner.com FeedHub http://www.feedhub.com Feedster http://www.feedstermedia.com/ FeedValidator Fehlstart Felix IDE FetchRover Fido FindLinks http://wortschatz.uni-leipzig.de/findlinks/ Findroy http://www.findory.com Firebat http://lms.virtual-presence.org Fish Search Fluid Dynamics Forexitalia Spider http://forexitalia.org/ Fouineur Freecrawl FreeWebMonitoring http://www.freewebmonitoring.com FunnelWeb Gais http://gais.cs.ccu.edu.tw/robot.php robot@gais.cs.ccu.edu.tw Gamekit http://www.uchoose.de/crawler/gamekitbot/ gammaSpider Gazz GCreep Genie Bot http://64.5.245.11/faq/faq.html wgao (at) genieknows.com GeoURL http://geourl.org/bot.html GetterroboPlus Puu GetURL Giga Blast http://www.gigablast.com/spider.html Gigabot http://www.gigablast.com/spider.html Girafa http://www.girafa.com/ Goku http://goku.ru/bot.htm bot [at] goku [dot] ru Golem Gonzo crawleradmin [dot] t-info [at] telekom [dot] de Google http://www.google.com/bot.html Google AdSense https://www.google.com/adsense/faq adsense-support@google.com Google FeedFetcher http://www.google.com/feedfetcher.html Google Images http://www.google.com/webmasters/bot.html Google Mobile Spider http://www.google.com/support/webmasters/bin/answer.py?answer=34647&topic=9346 Google Sitemaps Google Wireless Transcoder Gpost http://www.gpost.info/help.php?c=bot Griffon Gromit Grub Client http://grub.org Gulper Guruji http://www.guruji.com/en/WebmasterFAQ.html contact@guruji.com H?m?h?kki http://www.robotstxt.org/wc/active/html/finnish.html Timo.Metsala@www.fi HavIndex Heinrichder Mirago Henry The Mirago Robot HKU WWW Octopus HolyCowDude RSS http://www.holycowdude.com/spider.htm Hometown ht://Dig HTML Gobble HTML Index I, Robot IajaBot IBM Almaden http://www.almaden.ibm.com/cs/crawler crawler@us.ibm.com IBM Planetwide IceRocket http://www.icerocket.com/ Ichiro ichiro [at] nttr [dot] co [dot] jp igdeSpyder http://igde.ru IlTrovatore Setaccio http://www.iltrovatore.it/aiuto/faq.html info@iltrovatore.it Imagelock IncyWincy Indy Library Informant InfoSeek Robot 1.0 Infoseek Sidewinder InfoSpiders Ingrid Inktomi Insitor http://www.insitor.de/ Inspector Web IntelliAgent Intelliseek http://www.intelliseek.com/ Internet Cruiser Internet for learning http://www.ifl.com/ Internet Link Agent Internet Research Institute UK http://iri-uk.com/ coordinator@iri-uk.com Internet Seer Internet Shinchakubin Iron33 Israeli Search Itch http://www.itch.com/infoforwebmasters.html JavaBee JBot JCrawler JetEye http://www.jeteye.com/jetbot.html JoBo Jobot JoeBot JumpStation KaloogaBot http://www.kalooga.com info@kalooga.com Kapsi Images image.kapsi.net Katipo KDD Explorer KIT Fireball KO Yappo LabelGrabber Larbin Legs Link Alarm Link Validator LinkScan LinkWalker Livedoor Checkers Lockon logo.gif Lycos Mac OS X RSS Magpie Mail.Ru http://www.mail.ru portal@corp.mail.ru Majestics MJ12bot Mammoth http://www.sli-systems.com Marvin marvin/infoseek Mattie MediaFox Mercator http://research.compaq.com/SRC/mercator/ MerzScope Meta http://www.meta.com.ua/ MetaGer MindCrawler Miva AlgoFeedback [at] miva [dot] com MLBot http://www.metadatalabs.com/ support@metadatalabs.com MNO GoSearch Moget MOMspider Monster Moreover http://www.moreover.com MSNBot MSRBot http://research.microsoft.com/research/sv/msrbot/ msrbot@microsoft.com Muscat Ferret Mwd.Search Najdi.si www.najdi.si NameProtect NaverBot http://www.spidermatic.com/en/robot-spider/20 nhnbot@naver.com NEC MeshExplorer Nederland.zoek NetCarta WebMap Netcraft Web Server Survey http://news.netcraft.com/ NetMechanic NetNewsWire RSS http://www.newsgator.com/Individuals/NetNewsWire/ NetScoop News is Free RSS http://www.newsisfree.com/robot.php Newscan Online Newstin http://www.newstin.com/info/about_us crawler@newstin.com NextGen Search Bot http://www.zoominfo.com/NextGenSearchBot NHSE Web Forager NimbleCrawler http://www.healthline.com/aboutus.jsp crawler@healthline.com Nomad Norbert http://www.Burf.com Northern Light Nutch http://lucene.apache.org/nutch/bot.html NZ Explorer Occam Ocelli http://www.globalspec.com/Ocelli Omgili http://www.omgili.com/Crawler.html omgilibot Online24-Bot OOZBOT http://www.setooz.com/oozbot.html agentname at setooz dot_com Openfind http://www.openfind.com.tw/robot.html robot-response@openfind.com.tw Openfind data gatherer OpenISearch http://www.openisearch.com/ Orb Search OWPBot http://www.openwhitepages.com Pack Rat PageBoy Panscient http://panscient.com/ ParaSite Patric Pegasus PerlCrawler 1.0 PGP Key Agent Phantom PhpDig Picsearch http://www.picsearch.com/bot.html info@picsearch.com Piltdown Man Pimptrain Pimptrain.com Ping A Link Pioneer Pluck http://www.pluck.com Plumtree Web Accessor Pod Nova http://www.podnova.com Pompos http://dir.com/pompos.html Poppi Popular Iconoclast Portal B Spider Portal Juice PortalJuice.com PSBot Qango http://www.qango.com Radian6 Comment Reader http://www.radian6.com/crawler/ support@radian6.com Radian6 FeedFetcher http://www.radian6.com/crawler support@radian6.com Rambler http://www.rambler.ru/ Raven Search Resume Robot Road Runner: ImageScape Robot RoadHouse Crawling System Robbie RoboCrawl RoboFox Robot Francoroute Robozilla Roverbot RSS Feed Seeker http://www.rss-spider.com/fsb.php RuLeS SafetyNet SBIder RSS http://www.sitesell.com/sbider.html Scharia Science Index ScoutJet http://www.scoutjet.com Scrubby http://www.scrubtheweb.com/ Search NZ http://www.searchnz.co.nz/ SearchProcess Seekbot http://www.seekbot.net/bot.html Senrigan Sensis http://www.sensis.com.au/help.do search_comments\at\sensis\dot\com\dot\au SG Scout ShagSeeker Shai'Hulud Simmany Robot Ver 1.0 Site Searcher Site Valet Site-List RSS http://www.site-list.net SiteTech-Rover SiteUptime http://www.siteuptime.com SiteVibeBot http://www.sitevibe.nl SitiDi SitiDi.net Skymob Skymob.com SLCrawler Sleek Smart Spider Snap Shots http://www.snap.com Snapbot http://www.snap.com SnapPreviewBot http://www.snap.com/snapshots_faq.php Snooper Sogou http://www.sogou.com Sohu Search Solbot Soso http://help.soso.com/webspider.htm sosospider@tencent.com Speedy http://www.entireweb.com/about/search_tech/speedy_spider/ Speedy http://www.entireweb.com/about/search_tech/speedy_spider/ Sphere www.scout.com scout at sphere dot com Sphider Spider Monkey SpiderBot Spiderline Crawler SpiderMan SpiderView Suke Suntek Search Engine Szukacz http://www.szukacz.pl/html/RobotEnglishVersion.html info@szukacz.pl TACH Black Widow Tarantula TarSpider Tcl W3 Robot TechBOT Technorati http://technorati.com/about/ press [at] technorati [dot] com Templeton Teoma/Ask Jeeves http://sp.teoma.com/docs/teoma/about/ The Jubii The NorthStar Robot The NWI Robot The Peregrinator Thumbshots www.thumbshots.de Thunderstone TinEye http://tineye.com/crawler.html crawler@tineye.com Titan TitIn TLSpider Turn it in http://www.turnitin.com/static/company.html Turn it in slysearch http://www.turnitin.com/static/products_services/search_engines.html Turtle http://www.turtle.ru/ Twiceler http://www.cuill.com/twiceler/robot.html Twingbot http://www.twingbot.com/ UCSD Crawl UMBC RSS Unpartisan RSS http://www.unpartisan.com URL Check URL Spider Pro Valkyrie vBSEO http://www.vbseo.com/ Verticrawl Victoria Vision Search Visions http://www.italicvisions.com/ info@italicvisions.com Voila http://www.voila.com/ Voyager VWbot W3C http://validator.w3.org/checklink W3C CSS Validator http://jigsaw.w3.org/css-validator/ W3C Validator http://validator.w3.org/ W3M2 W3mir w@pSpider Walhello Appie http://www.robotstxt.org/wc/active/html/appie.html aimo@walhello.com WallPaper Web Core / Roots Web Moose WebAlta http://www.webalta.net/ru/about_webmaster.html WebAlta http://www.webalta.net/ru/about_webmaster.html WebBandit WebCatcher Webclipping WebCopy WebFetcher WebLayers WebLinker Weblog Monitor WebQuest WebReaper Webs WebSearchBench http://websearchbench.cs.uni-dortmund.de/ WebStolperer WebVac WebWalk WebWalker WebWatch WebWombat http://www.webwombat.com.au/ Wget What U Seek Winona Whitevector Crawler http://www.whitevector.com/ support@whitevector.com Whois DE http://www.whoisde.de Whois Source http://www.whois.sc/info/webmasters/surveybot.html Wild Ferret Web Hopper Willow Windows RSS Platform 1.0 http://blogs.msdn.com/rssteam/archive/2006/04/28/586220.aspx Windows RSS Platform 2.0 http://blogs.msdn.com/rssteam/archive/2008/02/28/the-rss-platform-user-agent-string.aspx WinHTTP Wired Digital WiseNut Worio http://worio.com WorldIndexer http://www.omni-explorer.com www.kolinka.com www.kolinka.com questions [at] kolinka [dot] com WWWC WWWeasel WWWSter WWWWanderer X-Crawler Xenu Link Sleuth http://home.snafu.de/tilman/xenulink.html XGET XYLEME Robot Yahoo Publisher Network http://publisher.yahoo.com/ Yahoo! Blogs http://help.yahoo.com/help/us/ysearch/crawling/crawling-02.html Yahoo! FeedSeeker Yahoo! Slurp http://help.yahoo.com/l/us/yahoo/search/webcrawler/ Yahoo! Vertical Crawler Yandex http://www.yandex.ru/ Yandex Direct http://direct.yandex.ru/ YandexBlog http://blogs.yandex.ru/ Yanga http://www.yanga.co.uk/ support@yanga.co.uk Yanga WorldSearch Bot http://www.yanga.co.uk YebolBot yebolbot@gmail.com Yeti yetibot@naver.com Yeti http://help.naver.com/robots/ Yeti/1.0 +http://help.naver.com/robots/ Yodao http://www.yodao.com/help/webmaster/spider/ Zeus Internet Marketing http://www.cyber-robotics.com/ Zork RSS http://www.zorkk.com