spiders_vbulletin.xml system 1.2

Spiders List

Submit a Spider

Download updated spiders_vbulletin.xml (last update: Fri 7th Nov 2008 12:12am, 480 spiders)

Help and FAQ

Official thread on vbulletin.com

Downloads since Sat 26th Jan 2008: 3,634

Spiders awaiting verification: 3

Current system date/time: Fri 21st Nov 2008 9:27pm

Spiders

Name: A Bot
Ident: abot/
Info (website): http://www.abot.com/
Added on: Tue 19th Feb 2008 11:54pm
Name: ABCdatos BotLink
Ident: ABCdatos
Info (website): http://www.robotstxt.org/wc/active/html/abcdatos.html
Email: botlink+AEA-abcdatos.com
Added on: Tue 19th Feb 2008 11:53pm
Name: Accelatech RSS
Ident: Accelatech RSSCrawler
Added on: Tue 19th Feb 2008 11:55pm
Name: Accoona
Ident: Accoona-AI-Agent
Info (website): http://accoona.com/about/about_accoona.jsp
Email: crawler at accoona dot com
Added on: Tue 19th Feb 2008 11:55pm
Name: Aconon Index
Ident: aconon Index
Info (website): raubfische.de
Added on: Tue 19th Feb 2008 11:56pm
Name: Ahoy!
Ident: Ahoy!
Info (website): http://www.robotstxt.org/wc/active/html/ahoythehomepagefinder.html
Email: marclang@cs.washington.edu
Added on: Tue 19th Feb 2008 11:57pm
Name: Alexa
Ident: ia_archiver
Info (website): http://www.alexa.com/site/help/webmasters
Added on: Sat 26th Jan 2008 3:29pm
Name: Alkaline
Ident: AlkalineBOT
Info (website): http://www.robotstxt.org/wc/active/html/Alkaline.html
Email: dblock@vestris.com
Added on: Tue 19th Feb 2008 11:57pm
Name: AltaVista
Ident: scooter
Added on: Sat 26th Jan 2008 12:26am
Name: Ananzi
Ident: EMC Spider
Added on: Tue 19th Feb 2008 11:58pm
Name: Anthill
Ident: Anthill
Info (website): http://www.robotstxt.org/wc/active/html/anthill.html
Email: info@anthill.org
Added on: Tue 19th Feb 2008 11:58pm
Name: Aport
Ident: Aport
Info (website): http://www.aport.ru/
Country: Russian Federation
Added on: Wed 20th Feb 2008 12:00am
Name: Apple RSS
Ident: AppleSyndication
Country: United States
Added on: Wed 20th Feb 2008 12:00am
Name: Arachnophilia
Ident: Arachnophilia
Info (website): http://www.robotstxt.org/wc/active/html/arachnophilia.html
Email: taluskie@utpapa.ph.utexas.edu
Country: United States
Added on: Wed 20th Feb 2008 12:01am
Name: Araneo
Ident: Araneo
Info (website): http://www.robotstxt.org/wc/active/html/araneo.html
Email: araneo@esperantisto.net
Added on: Wed 20th Feb 2008 12:01am
Name: Architext
Ident: ArchitextSpider
Info (website): http://www.atext.com
Email: spider@atext.com
Added on: Wed 20th Feb 2008 12:02am
Name: Arks
Ident: arks/1.0
Info (website): http://www.robotstxt.org/wc/active/html/arks.html
Email: aniruddha.c@usa.net
Added on: Wed 20th Feb 2008 12:03am
Name: Artabus
Ident: T312461
Info (website): http://www.artabus.com
Added on: Mon 3rd Mar 2008 10:41pm
Name: Ask.com
Ident: Ask Jeeves
Added on: Sat 26th Jan 2008 12:26am
Name: ASpider
Ident: ASpider
Info (website): http://www.robotstxt.org/wc/active/html/aspider.html
Email: fredj@pvv.ntnu.no
Added on: Wed 20th Feb 2008 12:03am
Name: ATN Worldwide
Ident: ATN_Worldwide
Info (website): http://www.robotstxt.org/wc/active/html/atn.txt.html
Email: info@allthatnet.com
Added on: Wed 20th Feb 2008 12:04am
Name: Atomz
Ident: Atomz
Info (website): atomz.com
Email: mike@atomz.com
Added on: Wed 20th Feb 2008 12:04am
Name: Attributor
Ident: attributor/1.13.2
Info (website): http://www.attributor.com
Added on: Tue 24th Jun 2008 3:08am
Name: Auresys
Ident: AURESYS
Info (website): http://www.robotstxt.org/wc/active/html/auresys.html
Email: mannina@crrm.univ-mrs.fr
Added on: Wed 20th Feb 2008 12:05am
Name: B Bot
Ident: bbot
Info (website): http://www.robotstxt.org/wc/active/html/bbot.html
Email: poluf1 at yahoo dot co dot uk
Added on: Wed 20th Feb 2008 12:06am
Name: BackRub
Ident: BackRub
Info (website): http://www.robotstxt.org/wc/active/html/backrub.html
Email: page@leland.stanford.edu
Added on: Wed 20th Feb 2008 12:05am
Name: Baidu
Ident: Baiduspider
Info (website): http://www.baidu.com/search/spider_jp.html
Added on: Tue 12th Feb 2008 4:56pm
Name: Become
Ident: BecomeBot
Info (website): http://www.become.com/webmasters.html
Added on: Wed 20th Feb 2008 12:07am
Name: Begun Robot Crawler
Ident: Begun
Info (website): http://www.begun.ru
Email: support@begun.ru
Country: Russian Federation
Added on: Mon 2nd Jun 2008 2:33pm
Name: BejiBot
Ident: BejiBot
Added on: Tue 4th Mar 2008 5:58pm
Name: Big Brother
Ident: Big Brother
Info (website): http://www.robotstxt.org/wc/active/html/bigbrother.html
Email: Francois.Pottier@inria.fr
Added on: Wed 20th Feb 2008 12:07am
Name: Big-Boards.com
Ident: BigBoardsUpdater
Added on: Thu 6th Nov 2008 11:14pm
Name: Bigmir
Ident: BigmirSpider
Info (website): http://www.bigmir.net/
Added on: Wed 20th Feb 2008 12:08am
Name: Bitacle
Ident: Bitacle bot
Info (website): http://bitacle.org/
Added on: Wed 20th Feb 2008 12:09am
Name: Biz 360
Ident: Biz360 Spider
Info (website): http://www.biz360.com
Email: blogsmanager [at] biz360 [dot] com
Added on: Wed 20th Feb 2008 12:09am
Name: Bjaaland
Ident: Bjaaland
Info (website): http://www.robotstxt.org/wc/active/html/bjaaland.html
Email: tbray@textuality.com
Added on: Wed 20th Feb 2008 12:10am
Name: Black Widow
Ident: BlackWidow
Info (website): http://www.robotstxt.org/wc/active/html/blackwidow.html
Email: khooghee@marys.smumn.edu
Added on: Wed 20th Feb 2008 12:11am
Name: BlogCrawler
Ident: BlogCrawler by Xango
Added on: Wed 20th Feb 2008 12:11am
Name: BlogDB RSS
Ident: blogdb
Info (website): http://blogdb.jp
Country: Japan
Added on: Wed 20th Feb 2008 12:12am
Name: BlogFan
Ident: blog search engine by BlogFan.ORG
Info (website): http://www.blogfan.org
Added on: Wed 20th Feb 2008 12:12am
Name: Bloglines RSS
Ident: Bloglines
Info (website): http://www.bloglines.com
Added on: Wed 20th Feb 2008 12:13am
Name: BlogPulse RSS
Ident: BlogPulse (ISSpider-3.0)
Added on: Wed 20th Feb 2008 12:14am
Name: BlogSearch RSS
Ident: BlogSearch
Info (website): http://www.icerocket.com
Added on: Wed 20th Feb 2008 12:14am
Name: BlogsNow
Ident: BlogsNowBot
Info (website): http://www.blogsnow.com/
Email: andreas [at] blogsnow [dot] com
Added on: Wed 20th Feb 2008 12:15am
Name: BlogStreet RSS
Ident: BlogStreetBot
Info (website): http://www.blogstreet.com/
Added on: Wed 20th Feb 2008 12:15am
Name: Board Tracker
Ident: BoardTracker
Info (website): http://www.boardtracker.com/spider.html
Added on: Fri 29th Feb 2008 6:29am
Name: BoardPulse
Ident: BoardPulse
Info (website): http://www.boardpulse.com/
Email: support@boardpulse.com
Added on: Wed 20th Feb 2008 12:16am
Name: BoardReader
Ident: BoardReader
Info (website): http://www.boardreader.com/aboutus.asp
Email: info@boardreader.com
Added on: Wed 20th Feb 2008 12:17am
Name: BoardViewer
Ident: BoardViewer
Info (website): http://www.boardviewer.com/
Email: support@boardviewer.com
Added on: Wed 20th Feb 2008 12:17am
Name: Boitho
Ident: boitho.com-robot
Info (website): http://www.boitho.com/bot.html
Email: post [at] boitho [dot] com
Added on: Wed 20th Feb 2008 12:18am
Name: Borg
Ident: borg-bot
Info (website): http://www.robotstxt.org/wc/active/html/borg-bot.html
Email: botdev@skunkfarm.com
Added on: Wed 20th Feb 2008 12:18am
Name: BotW
Ident: BOTW Spider
Info (website): http://botw.org
Added on: Tue 4th Mar 2008 5:59pm
Name: BSpider
Ident: BSpider
Info (website): http://www.robotstxt.org/wc/active/html/bspider.html
Email: okumura@rsl.crl.fujixerox.co.jp
Added on: Wed 20th Feb 2008 12:19am
Name: Bulkfeeds
Ident: Bulkfeeds
Info (website): http://bulkfeeds.net
Added on: Wed 20th Feb 2008 12:16am
Name: CACTVS Chemistry
Ident: CACTVS Chemistry Spider
Added on: Wed 20th Feb 2008 12:21am
Name: Calif
Ident: Calif
Added on: Wed 20th Feb 2008 12:21am
Name: CaRP RSS
Ident: CaRP/3.6Evolution
Info (website): http://www.biz360.com
Email: blogsmanager [at] biz360 [dot] com
Added on: Wed 20th Feb 2008 12:21am
Name: Charlotte
Ident: Charlotte
Info (website): http://www.searchme.com/support/pages/spider.php
Added on: Tue 1st Apr 2008 7:56pm
Name: Checkbot
Ident: Checkbot
Added on: Wed 20th Feb 2008 12:22am
Name: Christ Crawler
Ident: ChristCrawler.com
Info (website): ChristCrawler.com
Added on: Wed 20th Feb 2008 12:22am
Name: cIeNcIaFiCcIoN
Ident: www.cienciaficcion.net
Info (website): www.cienciaficcion.net
Added on: Wed 20th Feb 2008 12:23am
Name: Cipinet
Ident: CipinetBot
Info (website): http://www.cipinet.com/bot.html
Added on: Wed 20th Feb 2008 12:23am
Name: CJ
Ident: CJNetworkQuality
Info (website): http://www.cj.com/networkquality/
Added on: Wed 20th Feb 2008 12:24am
Name: Clicksor.com
Ident: YesupBot
Info (website): http://www.yesup.net/bot.html
Added on: Sun 12th Oct 2008 11:04am
Name: CLX.ru
Ident: CLX.ru Bot
Info (website): http://www.clx.ru
Added on: Fri 4th Jul 2008 12:35pm
Name: CMC/0.01
Ident: CMC/0.01
Added on: Wed 20th Feb 2008 12:24am
Name: ColdFusion
Ident: ColdFusion
Added on: Wed 20th Feb 2008 12:25am
Name: Combine System
Ident: combine
Added on: Wed 20th Feb 2008 12:25am
Name: Comet Systems
Ident: Crawler (cometsearch@cometsystems.com)
Info (website): cometsystems.com
Added on: Wed 20th Feb 2008 12:25am
Name: ComputingSite Robi
Ident: ComputingSite Robi
Added on: Wed 20th Feb 2008 12:26am
Name: ConceptBot
Ident: conceptbot
Added on: Wed 20th Feb 2008 12:26am
Name: Cooby
Ident: Cooby.de Crawler
Info (website): Cooby.de
Added on: Wed 20th Feb 2008 12:27am
Name: CoolBot
Ident: CoolBot
Added on: Wed 20th Feb 2008 12:27am
Name: Cuil
Ident: twiceler.
Info (website): http://www.cuil.com/info/webmaster_info/
Email: http://www.cuil.com/info/contact_us/feedback.php?to=crawler
Country: United States
Added on: Fri 19th Sep 2008 7:55am
Name: Cuil Spider
Ident: Twiceler-0.9 http://www.cuil.com/twiceler/robot.html
Info (website): http://www.cuil.com
Added on: Thu 25th Sep 2008 10:27am
Name: Cusco
Ident: Cusco
Added on: Wed 20th Feb 2008 12:27am
Name: CyberSpyder
Ident: CyberSpyder
Added on: Wed 20th Feb 2008 12:27am
Name: Daypop RSS
Ident: daypopbot
Added on: Wed 20th Feb 2008 12:28am
Name: Dead Link Check
Ident: DeadLinkCheck
Info (website): http://dlc.sourceforge.net/
Email: martial [at] users [dot] sourceforge [dot] net
Added on: Wed 20th Feb 2008 12:28am
Name: Deepnet Explorer
Ident: Deepnet Explorer
Added on: Wed 27th Feb 2008 10:24am
Name: Desert Realm
Ident: DesertRealm.com
Info (website): DesertRealm.com
Added on: Wed 20th Feb 2008 12:29am
Name: Deweb
Ident: Deweb
Added on: Wed 20th Feb 2008 12:29am
Name: Die Blinde Kuh
Ident: Die Blinde Kuh
Info (website): http://www.robotstxt.org/wc/active/html/blindekuh.html
Email: maschinist@blinde-kuh.de
Added on: Wed 20th Feb 2008 12:29am
Name: Dienst
Ident: dienstspider
Added on: Wed 20th Feb 2008 12:30am
Name: Digger
Ident: Digger/1.0 JDK/1.3.0
Added on: Wed 20th Feb 2008 12:30am
Name: Digimarc MarcSpider
Ident: Digimarc WebReader
Added on: Wed 20th Feb 2008 12:30am
Name: Digimarc Marcspider/CGI
Ident: Digimarc CGIReader
Added on: Wed 20th Feb 2008 12:31am
Name: Digital Integrity Robot
Ident: DIIbot
Added on: Wed 20th Feb 2008 12:32am
Name: Direct Hit Grabber
Ident: grabber
Added on: Wed 20th Feb 2008 12:32am
Name: DNAbot
Ident: DNAbot/1.0
Added on: Wed 20th Feb 2008 12:33am
Name: DotBot
Ident: DotBot/1.0
Info (website): http://www.dotnetdotcom.org/#info
Email: crawler@dotnetdotcom.org
Added on: Tue 8th Jul 2008 8:35pm
Name: DotTK SiteCheck
Ident: DotTK SiteCheck
Info (website): http://www.dot.tk
Added on: Wed 20th Feb 2008 12:33am
Name: DragonBot
Ident: DragonBot/1.0 libwww/5.0
Added on: Wed 20th Feb 2008 12:33am
Name: DWCP (Dridus' Web Cataloging Project)
Ident: DWCP/2.0
Added on: Wed 20th Feb 2008 12:34am
Name: e-Society
Ident: e-SocietyRobot
Info (website): http://www.yama.info.waseda.ac.jp/~yamana/es/index_eng.htm
Email: abuse-es[at] yama [dot] info [dot] waseda [dot] ac [dot] jp
Added on: Wed 20th Feb 2008 12:34am
Name: EbiNess
Ident: EbiNess/0.01a
Added on: Wed 20th Feb 2008 12:35am
Name: eBingBong
Ident: dragonfly(ebingbong@playstarmusic.com)
Info (website): http://www.ebingbong.com/help/ourRobot.php
Email: ebingbong@playstarmusic.com
Added on: Fri 7th Mar 2008 4:45pm
Name: Edgeio
Ident: edgeio-retriever
Info (website): http://www.edgeio.com
Added on: Wed 20th Feb 2008 12:36am
Name: EIT Link Verifier Robot
Ident: EIT-Link-Verifier-Robot/0.2
Added on: Wed 20th Feb 2008 12:36am
Name: Elfin Bot
Ident: elfinbot
Added on: Wed 20th Feb 2008 12:36am
Name: Emacs-w3 Search Engine
Ident: Emacs-w3/v[0-9\.]+
Added on: Wed 20th Feb 2008 12:37am
Name: EnaBall
Ident: EnaBot
Info (website): http://www.enaball.com/crawler.html
Added on: Fri 7th Mar 2008 12:43pm
Name: Esther
Ident: esther
Added on: Wed 20th Feb 2008 12:37am
Name: eSyndiCat Bot
Ident: eSyndiCat Bot
Added on: Sun 6th Jul 2008 1:08pm
Name: EuripBot
Ident: EuripBot/
Added on: Wed 20th Feb 2008 12:38am
Name: Evliya Celebi
Ident: Evliya Celebi
Added on: Wed 20th Feb 2008 12:38am
Name: Exabot
Ident: Exabot
Info (website): http://www.exabot.com/go/robot
Added on: Tue 12th Feb 2008 4:55pm
Name: Exact Seek
Ident: exactseek-pagereaper
Info (website): www.exactseek.com
Email: crawler [at] exactseek [dot]com
Added on: Wed 20th Feb 2008 12:35am
Name: Exact Seek
Ident: ExactSeek_Spider
Info (website): http://www.askjeevs.com
Added on: Wed 20th Feb 2008 12:39am
Name: ExaLead
Ident: NG/2.0
Info (website): http://botspotter.net/bs-389.html
Country: France
Added on: Wed 20th Feb 2008 12:40am
Name: ExaLead Beta
Ident: ExaBot
Info (website): http://beta.exalead.com/search/C=0/2p=Help.7
Email: crawler@exalead.com
Added on: Wed 20th Feb 2008 12:40am
Name: FAST / AlltheWeb
Ident: fast-webcrawler
Info (website): http://help.yahoo.com/help/us/ysearch/slurp/index.html
Added on: Wed 20th Feb 2008 12:41am
Name: FastCrawler
Ident: FastCrawler
Added on: Wed 20th Feb 2008 12:41am
Name: Feed 24 RSS
Ident: Feed24.com
Info (website): http://www.feed24.com
Added on: Wed 20th Feb 2008 12:42am
Name: Feed Blitz
Ident: FeedBlitz
Info (website): http://www.feedblitz.com
Added on: Wed 20th Feb 2008 12:42am
Name: Feed Parser
Ident: UniversalFeedParser
Info (website): http://www.feedparser.org
Added on: Fri 15th Feb 2008 6:32pm
Name: FeedBurner RSS
Ident: FeedBurner
Info (website): http://www.FeedBurner.com
Added on: Wed 20th Feb 2008 12:43am
Name: FeedHub
Ident: FeedHub MetaDataFetcher
Info (website): http://www.feedhub.com
Added on: Sat 11th Oct 2008 4:02am
Name: Feedster
Ident: Feedster Crawler
Info (website): http://www.feedstermedia.com/
Added on: Wed 20th Feb 2008 12:43am
Name: FeedValidator
Ident: FeedValidator/
Added on: Wed 20th Feb 2008 12:43am
Name: Fehlstart
Ident: FEHLSTART Superspider
Added on: Wed 20th Feb 2008 12:44am
Name: Felix IDE
Ident: FelixIDE
Added on: Wed 20th Feb 2008 12:44am
Name: FetchRover
Ident: ESIRover
Added on: Wed 20th Feb 2008 12:45am
Name: Fido
Ident: fido
Added on: Wed 20th Feb 2008 12:45am
Name: FindLinks
Ident: findlinks
Info (website): http://wortschatz.uni-leipzig.de/findlinks/
Added on: Wed 20th Feb 2008 12:45am
Name: Findroy
Ident: FindoryBot
Info (website): http://www.findory.com
Added on: Wed 20th Feb 2008 12:46am
Name: Firebat
Ident: Firebat
Info (website): http://lms.virtual-presence.org
Added on: Mon 3rd Nov 2008 12:35am
Name: Fish Search
Ident: Fish-Search-Robot
Added on: Wed 20th Feb 2008 12:46am
Name: Fluid Dynamics
Ident: Mozilla/4.0 (compatible: FDSE robot)
Added on: Wed 20th Feb 2008 12:46am
Name: Forexitalia Spider
Ident: libwww-perl/5.810
Info (website): http://forexitalia.org/
Country: Italy
Added on: Thu 11th Sep 2008 7:03am
Name: Fouineur
Ident: fouineur.9bit.qc.ca
Added on: Wed 20th Feb 2008 12:47am
Name: Freecrawl
Ident: Freecrawl
Added on: Wed 20th Feb 2008 12:47am
Name: FreeWebMonitoring
Ident: FreeWebMonitoring
Info (website): http://www.freewebmonitoring.com
Added on: Fri 4th Jul 2008 12:35pm
Name: FunnelWeb
Ident: FunnelWeb
Added on: Wed 20th Feb 2008 12:47am
Name: Gais
Ident: GaisBot
Info (website): http://gais.cs.ccu.edu.tw/robot.php
Email: robot@gais.cs.ccu.edu.tw
Added on: Wed 20th Feb 2008 12:48am
Name: Gamekit
Ident: gamekitbot
Info (website): http://www.uchoose.de/crawler/gamekitbot/
Added on: Wed 20th Feb 2008 12:49am
Name: gammaSpider
Ident: gammaSpider
Added on: Wed 20th Feb 2008 12:49am
Name: Gazz
Ident: gazz
Added on: Wed 20th Feb 2008 12:50am
Name: GCreep
Ident: gcreep
Added on: Wed 20th Feb 2008 12:50am
Name: Genie Bot
Ident: genieBot
Info (website): http://64.5.245.11/faq/faq.html
Email: wgao (at) genieknows.com
Added on: Wed 20th Feb 2008 12:50am
Name: GeoURL
Ident: geourl
Info (website): http://geourl.org/bot.html
Added on: Wed 20th Feb 2008 12:51am
Name: GetterroboPlus Puu
Ident: GetterroboPlus
Added on: Wed 20th Feb 2008 12:51am
Name: GetURL
Ident: GetURL.rexx
Added on: Wed 20th Feb 2008 12:51am
Name: Giga Blast
Ident: Gigabot
Info (website): http://www.gigablast.com/spider.html
Added on: Wed 20th Feb 2008 12:52am
Name: Gigabot
Ident: Gigabot/3.0
Info (website): http://www.gigablast.com/spider.html
Country: United States
Added on: Fri 29th Aug 2008 2:38am
Name: Girafa
Ident: Girafabot
Info (website): http://www.girafa.com/
Added on: Wed 20th Feb 2008 12:52am
Name: Goku
Ident: Goku
Info (website): http://goku.ru/bot.htm
Email: bot [at] goku [dot] ru
Country: Russian Federation
Added on: Wed 20th Feb 2008 12:53am
Name: Golem
Ident: Golem
Added on: Wed 20th Feb 2008 12:53am
Name: Gonzo
Ident: gonzo
Email: crawleradmin [dot] t-info [at] telekom [dot] de
Added on: Wed 20th Feb 2008 12:53am
Name: Google
Ident: Googlebot
Info (website): http://www.google.com/bot.html
Added on: Sat 26th Jan 2008 12:26am
Name: Google AdSense
Ident: Mediapartners-Google
Info (website): https://www.google.com/adsense/faq
Email: adsense-support@google.com
Added on: Sat 26th Jan 2008 12:26am
Name: Google FeedFetcher
Ident: FeedFetcher-Google
Info (website): http://www.google.com/feedfetcher.html
Added on: Sat 26th Jan 2008 3:30pm
Name: Google Images
Ident: Googlebot-Image
Info (website): http://www.google.com/webmasters/bot.html
Country: United States
Added on: Tue 12th Feb 2008 8:54am
Name: Google Mobile Spider
Ident: Googlebot-Mobile
Info (website): http://www.google.com/support/webmasters/bin/answer.py?answer=34647&topic=9346
Added on: Mon 23rd Jun 2008 3:31am
Name: Google Sitemaps
Ident: Google-Sitemaps/1.0
Country: United States
Added on: Thu 2nd Oct 2008 5:14am
Name: Google Wireless Transcoder
Ident: Google Wireless Transcoder
Added on: Mon 17th Mar 2008 11:11pm
Name: Gpost
Ident: Gpostbot
Info (website): http://www.gpost.info/help.php?c=bot
Added on: Wed 20th Feb 2008 12:54am
Name: Griffon
Ident: griffon
Added on: Wed 20th Feb 2008 12:54am
Name: Gromit
Ident: Gromit
Added on: Wed 20th Feb 2008 12:54am
Name: Grub Client
Ident: http://grub.org
Info (website): http://grub.org
Added on: Wed 20th Feb 2008 12:55am
Name: Gulper
Ident: Gulper Web Bot
Added on: Wed 20th Feb 2008 12:55am
Name: Guruji
Ident: GurujiBot
Info (website): http://www.guruji.com/en/WebmasterFAQ.html
Email: contact@guruji.com
Country: India
Added on: Fri 21st Mar 2008 9:28am
Name: H?m?h?kki
Ident: H?m?h?kki
Info (website): http://www.robotstxt.org/wc/active/html/finnish.html
Email: Timo.Metsala@www.fi
Added on: Wed 20th Feb 2008 12:56am
Name: HavIndex
Ident: havIndex
Added on: Wed 20th Feb 2008 12:56am
Name: Heinrichder Mirago
Ident: HeinrichderMiragoRobot
Added on: Wed 20th Feb 2008 12:56am
Name: Henry The Mirago Robot
Ident: HenryTheMiragoRobot
Added on: Wed 20th Feb 2008 12:57am
Name: HKU WWW Octopus
Ident: HKU WWW Robot
Added on: Wed 20th Feb 2008 12:57am
Name: HolyCowDude RSS
Ident: HolyCowDude
Info (website): http://www.holycowdude.com/spider.htm
Added on: Wed 20th Feb 2008 12:58am
Name: Hometown
Ident: Hometown
Added on: Wed 20th Feb 2008 12:58am
Name: ht://Dig
Ident: htdig
Added on: Wed 20th Feb 2008 12:58am
Name: HTML Gobble
Ident: HTMLgobble
Added on: Wed 20th Feb 2008 12:59am
Name: HTML Index
Ident: AITCSRobot
Added on: Wed 20th Feb 2008 12:59am
Name: I, Robot
Ident: I Robot
Added on: Wed 20th Feb 2008 12:59am
Name: IajaBot
Ident: iajaBot
Added on: Wed 20th Feb 2008 1:00am
Name: IBM Almaden
Ident: http://www.almaden.ibm.com/cs/crawler
Info (website): http://www.almaden.ibm.com/cs/crawler
Email: crawler@us.ibm.com
Country: United States
Added on: Sat 26th Jan 2008 12:26am
Name: IBM Planetwide
Ident: IBM_Planetwide
Added on: Wed 20th Feb 2008 1:00am
Name: IceRocket
Ident: +http://www.icerocket.com/
Info (website): http://www.icerocket.com/
Added on: Wed 20th Feb 2008 1:00am
Name: Ichiro
Ident: ichiro
Email: ichiro [at] nttr [dot] co [dot] jp
Country: Japan
Added on: Wed 20th Feb 2008 1:01am
Name: igdeSpyder
Ident: igde
Info (website): http://igde.ru
Added on: Fri 4th Jul 2008 12:36pm
Name: IlTrovatore Setaccio
Ident: IlTrovatore-Setaccio
Info (website): http://www.iltrovatore.it/aiuto/faq.html
Email: info@iltrovatore.it
Country: Italy
Added on: Wed 20th Feb 2008 1:01am
Name: Imagelock
Ident: Mozilla 3.01 PBWF (Win95)
Added on: Wed 20th Feb 2008 1:02am
Name: IncyWincy
Ident: IncyWincy
Added on: Wed 20th Feb 2008 1:02am
Name: Indy Library
Ident: Indy Library
Added on: Sat 23rd Feb 2008 10:05pm
Name: Informant
Ident: Informant
Added on: Wed 20th Feb 2008 1:03am
Name: InfoSeek Robot 1.0
Ident: InfoSeek Robot
Added on: Wed 20th Feb 2008 1:03am
Name: Infoseek Sidewinder
Ident: Infoseek Sidewinder
Added on: Wed 20th Feb 2008 1:03am
Name: InfoSpiders
Ident: InfoSpiders
Added on: Wed 20th Feb 2008 1:03am
Name: Ingrid
Ident: INGRID
Added on: Wed 20th Feb 2008 1:04am
Name: Inktomi
Ident: slurp@inktomi
Added on: Sat 26th Jan 2008 12:26am
Name: Insitor
Ident: Insitor
Info (website): http://www.insitor.de/
Added on: Wed 20th Feb 2008 1:04am
Name: Inspector Web
Ident: inspectorwww
Added on: Wed 20th Feb 2008 1:04am
Name: IntelliAgent
Ident: IAGENT
Added on: Wed 20th Feb 2008 1:06am
Name: Intelliseek
Ident: Intelliseek
Info (website): http://www.intelliseek.com/
Added on: Wed 20th Feb 2008 1:13am
Name: Internet Cruiser
Ident: Internet Cruiser Robot
Added on: Wed 20th Feb 2008 1:13am
Name: Internet for learning
Ident: SCHOOLCARE; SV1; InfoPath.1
Info (website): http://www.ifl.com/
Country: United Kingdom
Added on: Mon 21st Apr 2008 3:32pm
Name: Internet Link Agent
Ident: InternetLinkAgent
Added on: Wed 20th Feb 2008 1:14am
Name: Internet Research Institute UK
Ident: 3GSE bot
Info (website): http://iri-uk.com/
Email: coordinator@iri-uk.com
Country: United Kingdom
Added on: Mon 19th May 2008 6:26am
Name: Internet Seer
Ident: internetseer
Added on: Wed 20th Feb 2008 1:14am
Name: Internet Shinchakubin
Ident: sharp-info-agent
Added on: Wed 20th Feb 2008 1:14am
Name: Iron33
Ident: Iron33
Added on: Wed 20th Feb 2008 1:15am
Name: Israeli Search
Ident: IsraeliSearch
Added on: Wed 20th Feb 2008 1:15am
Name: Itch
Ident: itchBot
Info (website): http://www.itch.com/infoforwebmasters.html
Added on: Wed 20th Feb 2008 1:15am
Name: JavaBee
Ident: JavaBee
Added on: Wed 20th Feb 2008 1:15am
Name: JBot
Ident: JBot
Added on: Wed 20th Feb 2008 1:16am
Name: JCrawler
Ident: JCrawler
Added on: Wed 20th Feb 2008 1:16am
Name: JetEye
Ident: JetBot
Info (website): http://www.jeteye.com/jetbot.html
Added on: Wed 20th Feb 2008 1:16am
Name: JoBo
Ident: JoBo
Added on: Wed 20th Feb 2008 1:16am
Name: Jobot
Ident: Jobot
Added on: Wed 20th Feb 2008 1:17am
Name: JoeBot
Ident: JoeBot
Added on: Wed 20th Feb 2008 1:17am
Name: JumpStation
Ident: jumpstation
Added on: Wed 20th Feb 2008 1:17am
Name: KaloogaBot
Ident: kalooga/KaloogaBot
Info (website): http://www.kalooga.com
Email: info@kalooga.com
Country: Netherlands
Added on: Tue 22nd Jul 2008 6:21pm
Name: Kapsi Images
Ident: image.kapsi.net
Info (website): image.kapsi.net
Added on: Wed 20th Feb 2008 1:02am
Name: Katipo
Ident: Katipo
Added on: Wed 20th Feb 2008 1:17am
Name: KDD Explorer
Ident: KDD-Explorer
Added on: Wed 20th Feb 2008 1:17am
Name: KIT Fireball
Ident: KIT-Fireball
Added on: Wed 20th Feb 2008 1:18am
Name: KO Yappo
Ident: KO_Yappo_Robot
Added on: Wed 20th Feb 2008 1:18am
Name: LabelGrabber
Ident: LabelGrab
Added on: Wed 20th Feb 2008 1:18am
Name: Larbin
Ident: larbin
Added on: Wed 20th Feb 2008 1:18am
Name: Legs
Ident: legs
Added on: Wed 20th Feb 2008 1:19am
Name: Link Alarm
Ident: linkalarm
Added on: Wed 20th Feb 2008 1:19am
Name: Link Validator
Ident: Linkidator
Added on: Wed 20th Feb 2008 1:19am
Name: LinkScan
Ident: LinkScan Server
Added on: Wed 20th Feb 2008 1:19am
Name: LinkWalker
Ident: LinkWalker
Added on: Wed 20th Feb 2008 1:20am
Name: Livedoor Checkers
Ident: livedoorCheckers/
Added on: Wed 20th Feb 2008 1:20am
Name: Lockon
Ident: Lockon
Added on: Wed 20th Feb 2008 1:20am
Name: logo.gif
Ident: logo.gif crawler
Added on: Wed 20th Feb 2008 1:21am
Name: Lycos
Ident: Lycos
Added on: Sat 26th Jan 2008 12:26am
Name: Mac OS X RSS
Ident: Apple-PubSub/59
Added on: Mon 14th Apr 2008 4:15pm
Name: Magpie
Ident: Magpie
Added on: Wed 20th Feb 2008 1:21am
Name: Mail.Ru
Ident: Mail.Ru
Info (website): http://www.mail.ru
Email: portal@corp.mail.ru
Country: Russian Federation
Added on: Mon 2nd Jun 2008 2:28pm
Name: Majestics MJ12bot
Ident: MJ12bot
Added on: Sat 26th Jan 2008 3:28pm
Name: Mammoth
Ident: Mammoth
Info (website): http://www.sli-systems.com
Added on: Wed 20th Feb 2008 1:21am
Name: Marvin
Ident: Marvin
Added on: Wed 20th Feb 2008 1:21am
Name: marvin/infoseek
Ident: marvin/infoseek
Added on: Wed 20th Feb 2008 1:22am
Name: Mattie
Ident: M/3.8
Added on: Wed 20th Feb 2008 1:22am
Name: MediaFox
Ident: MediaFox
Added on: Wed 20th Feb 2008 1:22am
Name: Mercator
Ident: mercator
Info (website): http://research.compaq.com/SRC/mercator/
Added on: Wed 20th Feb 2008 1:22am
Name: MerzScope
Ident: MerzScope
Added on: Wed 20th Feb 2008 1:23am
Name: Meta
Ident: METASpider
Info (website): http://www.meta.com.ua/
Added on: Wed 20th Feb 2008 1:23am
Name: MetaGer
Ident: MetaGer-LinkChecker
Added on: Wed 20th Feb 2008 1:23am
Name: MindCrawler
Ident: MindCrawler
Added on: Wed 20th Feb 2008 1:24am
Name: Miva
Ident: Miva
Email: AlgoFeedback [at] miva [dot] com
Added on: Wed 20th Feb 2008 1:24am
Name: mladci
Ident: smimed.net
Info (website): smimed.net
Email: smiedyal@mail.ru
Added on: Sun 6th Jul 2008 12:42pm
Name: MLBot
Ident: MLBot
Info (website): http://www.metadatalabs.com/
Email: support@metadatalabs.com
Added on: Sun 20th Apr 2008 12:41pm
Name: MNO GoSearch
Ident: UdmSearch
Added on: Wed 20th Feb 2008 1:25am
Name: Moget
Ident: moget
Added on: Wed 20th Feb 2008 1:25am
Name: MOMspider
Ident: MOMspider
Added on: Wed 20th Feb 2008 1:25am
Name: Monster
Ident: Monster
Added on: Wed 20th Feb 2008 1:39am
Name: Moreover
Ident: Moreoverbot
Info (website): http://www.moreover.com
Added on: Wed 20th Feb 2008 1:40am
Name: MSNBot
Ident: MSNBOT
Added on: Sat 26th Jan 2008 12:26am
Name: MSRBot
Ident: MSRBOT
Info (website): http://research.microsoft.com/research/sv/msrbot/
Email: msrbot@microsoft.com
Added on: Tue 12th Aug 2008 10:02pm
Name: Muscat Ferret
Ident: MuscatFerret
Added on: Wed 20th Feb 2008 1:40am
Name: Mwd.Search
Ident: MwdSearch
Added on: Wed 20th Feb 2008 1:41am
Name: Najdi.si
Ident: najdi.si
Info (website): www.najdi.si
Country: Slovenia
Added on: Thu 17th Apr 2008 5:27pm
Name: NameProtect
Ident: NPBot
Added on: Sat 26th Jan 2008 12:26am
Name: NaverBot
Ident: NaverBot
Info (website): http://www.spidermatic.com/en/robot-spider/20
Email: nhnbot@naver.com
Added on: Wed 20th Feb 2008 1:42am
Name: NEC MeshExplorer
Ident: NEC-MeshExplorer
Added on: Wed 20th Feb 2008 1:42am
Name: Nederland.zoek
Ident: Nederland.zoek
Added on: Wed 20th Feb 2008 1:42am
Name: NetCarta WebMap
Ident: NetCarta CyberPilot Pro
Added on: Wed 20th Feb 2008 1:43am
Name: Netcraft Web Server Survey
Ident: Netcraft
Info (website): http://news.netcraft.com/
Added on: Wed 20th Feb 2008 1:43am
Name: NetMechanic
Ident: NetMechanic
Added on: Wed 20th Feb 2008 1:43am
Name: NetNewsWire RSS
Ident: NetNewsWire
Info (website): http://www.newsgator.com/Individuals/NetNewsWire/
Added on: Tue 15th Apr 2008 4:42am
Name: NetScoop
Ident: NetScoop
Added on: Wed 20th Feb 2008 1:43am
Name: News is Free RSS
Ident: NIF
Info (website): http://www.newsisfree.com/robot.php
Added on: Wed 20th Feb 2008 1:45am
Name: Newscan Online
Ident: newscan-online
Added on: Wed 20th Feb 2008 1:44am
Name: Newstin
Ident: (X11; compatible; crawler@newstin.com; HTTPClient 3.1
Info (website): http://www.newstin.com/info/about_us
Email: crawler@newstin.com
Country: Czech Republic
Added on: Sun 27th Jul 2008 10:55am
Name: NextGen Search Bot
Ident: NextGenSearchBot 1
Info (website): http://www.zoominfo.com/NextGenSearchBot
Added on: Wed 20th Feb 2008 1:44am
Name: NHSE Web Forager
Ident: NHSEWalker
Added on: Wed 20th Feb 2008 1:44am
Name: NimbleCrawler
Ident: NimbleCrawler
Info (website): http://www.healthline.com/aboutus.jsp
Email: crawler@healthline.com
Added on: Wed 20th Feb 2008 1:45am
Name: Nomad
Ident: Nomad
Added on: Wed 20th Feb 2008 1:46am
Name: Norbert
Ident: Norbert the Spider
Info (website): http://www.Burf.com
Added on: Wed 20th Feb 2008 1:46am
Name: Northern Light
Ident: Gulliver
Added on: Wed 20th Feb 2008 1:46am
Name: Nutch
Ident: Nutch
Info (website): http://lucene.apache.org/nutch/bot.html
Added on: Thu 6th Nov 2008 11:14pm
Name: NZ Explorer
Ident: explorersearch
Added on: Wed 20th Feb 2008 1:47am
Name: Occam
Ident: Occam
Added on: Wed 20th Feb 2008 1:47am
Name: Ocelli
Ident: Ocelli
Info (website): http://www.globalspec.com/Ocelli
Added on: Wed 20th Feb 2008 1:47am
Name: Omgili
Ident: omgilibot
Info (website): http://www.omgili.com/Crawler.html
Added on: Tue 26th Feb 2008 12:49am
Name: omgilibot
Ident: omgilibot/0.3 +http://www.omgili.com/Crawler.html
Added on: Mon 28th Apr 2008 3:24am
Name: Online24-Bot
Ident: Online24-Bot
Added on: Wed 20th Feb 2008 1:48am
Name: OOZBOT
Ident: OOZBOT
Info (website): http://www.setooz.com/oozbot.html
Email: agentname at setooz dot_com
Added on: Wed 3rd Sep 2008 11:13am
Name: Openfind
Ident: Openbot
Info (website): http://www.openfind.com.tw/robot.html
Email: robot-response@openfind.com.tw
Added on: Wed 20th Feb 2008 1:48am
Name: Openfind data gatherer
Ident: Openfind
Added on: Wed 20th Feb 2008 1:49am
Name: OpenISearch
Ident: OpenISearch
Info (website): http://www.openisearch.com/
Added on: Wed 22nd Oct 2008 10:24am
Name: Orb Search
Ident: Orbsearch
Added on: Wed 20th Feb 2008 1:49am
Name: OWPBot
Ident: OWPBot
Info (website): http://www.openwhitepages.com
Added on: Mon 31st Mar 2008 1:32pm
Name: Pack Rat
Ident: PackRat
Added on: Wed 20th Feb 2008 1:49am
Name: PageBoy
Ident: PageBoy
Added on: Wed 20th Feb 2008 1:49am
Name: Panscient
Ident: panscient.com
Info (website): http://panscient.com/
Country: United States
Added on: Sat 22nd Mar 2008 7:14am
Name: ParaSite
Ident: ParaSite
Added on: Wed 20th Feb 2008 1:49am
Name: Patric
Ident: Patric
Added on: Wed 20th Feb 2008 1:50am
Name: Pegasus
Ident: PEGASUS
Added on: Wed 20th Feb 2008 1:50am
Name: PerlCrawler 1.0
Ident: PerlCrawler/1.0 Xavatoria/2.0
Added on: Wed 20th Feb 2008 1:50am
Name: PGP Key Agent
Ident: PGP-KA
Added on: Wed 20th Feb 2008 1:50am
Name: Phantom
Ident: Duppies
Added on: Wed 20th Feb 2008 1:51am
Name: PhpDig
Ident: phpdig
Added on: Wed 20th Feb 2008 1:51am
Name: Picsearch
Ident: psbot/0.1 (+http://www.picsearch.com/bot.html) (51dc65875976ac434c09274f7e46dec6)
Info (website): http://www.picsearch.com/bot.html
Email: info@picsearch.com
Added on: Tue 29th Jul 2008 12:23pm
Name: Piltdown Man
Ident: PiltdownMan
Added on: Wed 20th Feb 2008 1:51am
Name: Pimptrain
Ident: Pimptrain's robot
Info (website): Pimptrain.com
Added on: Wed 20th Feb 2008 1:51am
Name: Ping A Link
Ident: pingalink
Added on: Wed 20th Feb 2008 1:52am
Name: Pioneer
Ident: Pioneer
Added on: Wed 20th Feb 2008 1:52am
Name: Pluck
Ident: PluckFeedCrawler
Info (website): http://www.pluck.com
Added on: Wed 20th Feb 2008 1:52am
Name: Plumtree Web Accessor
Ident: PlumtreeWebAccessor
Added on: Wed 20th Feb 2008 1:53am
Name: Pod Nova
Ident: PodNova
Info (website): http://www.podnova.com
Added on: Wed 20th Feb 2008 1:53am
Name: Pompos
Ident: Pompos
Info (website): http://dir.com/pompos.html
Added on: Wed 20th Feb 2008 1:53am
Name: Poppi
Ident: Poppi
Added on: Wed 20th Feb 2008 1:53am
Name: Popular Iconoclast
Ident: gestaltIconoclast
Added on: Wed 20th Feb 2008 1:54am
Name: Portal B Spider
Ident: PortalBSpider
Added on: Wed 20th Feb 2008 1:55am
Name: Portal Juice
Ident: PortalJuice.com
Info (website): PortalJuice.com
Added on: Wed 20th Feb 2008 1:54am
Name: PSBot
Ident: psbot
Added on: Wed 20th Feb 2008 1:56am
Name: Qango
Ident: Qango.com Web Directory
Info (website): http://www.qango.com
Added on: Wed 20th Feb 2008 1:56am
Name: Radian6 Comment Reader
Ident: R6_CommentReader
Info (website): http://www.radian6.com/crawler/
Email: support@radian6.com
Added on: Tue 4th Mar 2008 6:01pm
Name: Radian6 FeedFetcher
Ident: R6_FeedFetcher
Info (website): http://www.radian6.com/crawler
Email: support@radian6.com
Added on: Tue 4th Mar 2008 6:01pm
Name: Rambler
Ident: StackRambler
Info (website): http://www.rambler.ru/
Added on: Wed 20th Feb 2008 1:57am
Name: Raven Search
Ident: Raven
Country: Russian Federation
Added on: Wed 20th Feb 2008 1:57am
Name: Resume Robot
Ident: Resume Robot
Added on: Wed 20th Feb 2008 1:57am
Name: Road Runner: ImageScape Robot
Ident: Road Runner: ImageScape Robot
Added on: Wed 20th Feb 2008 2:00am
Name: RoadHouse Crawling System
Ident: RHCS
Added on: Wed 20th Feb 2008 2:01am
Name: Robbie
Ident: Robbie
Added on: Wed 20th Feb 2008 2:01am
Name: RoboCrawl
Ident: RoboCrawl
Added on: Wed 20th Feb 2008 2:01am
Name: RoboFox
Ident: Robofox
Added on: Wed 20th Feb 2008 2:01am
Name: Robot Francoroute
Ident: Robot du CRIM 1.0a
Added on: Wed 20th Feb 2008 2:02am
Name: Robozilla
Ident: Robozilla
Added on: Wed 20th Feb 2008 2:02am
Name: Roverbot
Ident: Roverbot
Added on: Wed 20th Feb 2008 2:02am
Name: RSS Feed Seeker
Ident: RSS-SPIDER
Info (website): http://www.rss-spider.com/fsb.php
Added on: Wed 20th Feb 2008 2:03am
Name: RuLeS
Ident: RuLeS
Added on: Wed 20th Feb 2008 2:03am
Name: SafetyNet
Ident: SafetyNet Robot
Added on: Wed 20th Feb 2008 2:04am
Name: SBIder RSS
Ident: SBIder
Info (website): http://www.sitesell.com/sbider.html
Added on: Wed 20th Feb 2008 2:04am
Name: Scharia
Ident: Scharia
Added on: Wed 20th Feb 2008 2:04am
Name: Science Index
Ident: Science-Index
Added on: Wed 20th Feb 2008 2:04am
Name: ScoutJet
Ident: ScoutJet
Info (website): http://www.scoutjet.com
Country: United States
Added on: Fri 21st Mar 2008 3:07am
Name: Scrubby
Ident: Scrubby/3.0
Info (website): http://www.scrubtheweb.com/
Added on: Sun 18th May 2008 9:12pm
Name: Search NZ
Ident: SearchNZ
Info (website): http://www.searchnz.co.nz/
Added on: Wed 20th Feb 2008 2:05am
Name: SearchProcess
Ident: searchprocess
Added on: Wed 20th Feb 2008 2:05am
Name: Seekbot
Ident: Seekbot
Info (website): http://www.seekbot.net/bot.html
Added on: Wed 20th Feb 2008 2:05am
Name: Senrigan
Ident: Senrigan
Added on: Wed 20th Feb 2008 2:05am
Name: Sensis
Ident: Sensis Web Crawler
Info (website): http://www.sensis.com.au/help.do
Email: search_comments\at\sensis\dot\com\dot\au
Country: Australia
Added on: Wed 20th Feb 2008 2:06am
Name: SG Scout
Ident: SG-Scout
Added on: Wed 20th Feb 2008 2:06am
Name: ShagSeeker
Ident: Shagseeker
Added on: Wed 20th Feb 2008 2:06am
Name: Shai'Hulud
Ident: Shai'Hulud
Added on: Wed 20th Feb 2008 2:06am
Name: Simmany Robot Ver 1.0
Ident: SimBot/1.0
Added on: Wed 20th Feb 2008 2:07am
Name: Site Searcher
Ident: ssearcher100
Added on: Wed 20th Feb 2008 2:07am
Name: Site Valet
Ident: Site Valet
Added on: Wed 20th Feb 2008 2:07am
Name: Site-List RSS
Ident: http://www.site-list.net
Info (website): http://www.site-list.net
Added on: Wed 20th Feb 2008 2:07am
Name: SiteTech-Rover
Ident: SiteTech-Rover
Added on: Wed 20th Feb 2008 2:08am
Name: SiteUptime
Ident: SiteUptime.com
Info (website): http://www.siteuptime.com
Added on: Sun 5th Oct 2008 1:15pm
Name: SiteVibeBot
Ident: SiteVibeBot
Info (website): http://www.sitevibe.nl
Country: Netherlands
Added on: Tue 20th May 2008 3:30pm
Name: SitiDi
Ident: +SitiDi.net/SitiDiBot/
Info (website): SitiDi.net
Added on: Wed 20th Feb 2008 2:08am
Name: Skymob
Ident: aWapClient
Info (website): Skymob.com
Added on: Wed 20th Feb 2008 2:08am
Name: SLCrawler
Ident: SLCrawler
Added on: Wed 20th Feb 2008 2:08am
Name: Sleek
Ident: Sleek Spider
Added on: Wed 20th Feb 2008 2:09am
Name: Smart Spider
Ident: ESISmartSpider
Added on: Wed 20th Feb 2008 2:09am
Name: Snap Shots
Ident: Snapbot
Info (website): http://www.snap.com
Added on: Sat 23rd Feb 2008 10:05pm
Name: Snapbot
Ident: Snapbot/1.0
Info (website): http://www.snap.com
Country: Italy
Added on: Thu 26th Jun 2008 9:35am
Name: SnapPreviewBot
Ident: SnapPreviewBot
Info (website): http://www.snap.com/snapshots_faq.php
Added on: Sun 6th Apr 2008 1:56pm
Name: Snooper
Ident: Snooper
Added on: Wed 20th Feb 2008 2:09am
Name: Sogou
Ident: Sogou web spider
Info (website): http://www.sogou.com
Added on: Fri 4th Jul 2008 12:36pm
Name: Sohu Search
Ident: sohu-search
Added on: Wed 20th Feb 2008 2:09am
Name: Solbot
Ident: Solbot
Added on: Wed 20th Feb 2008 2:09am
Name: Soso
Ident: Sosospider
Info (website): http://help.soso.com/webspider.htm
Email: sosospider@tencent.com
Country: China
Added on: Sat 21st Jun 2008 12:52am
Name: Speedy
Ident: www.entireweb.com/speedy.html
Info (website): http://www.entireweb.com/about/search_tech/speedy_spider/
Added on: Wed 20th Feb 2008 2:09am
Name: Speedy
Ident: Speedy
Info (website): http://www.entireweb.com/about/search_tech/speedy_spider/
Added on: Thu 13th Mar 2008 11:06pm
Name: Sphere
Ident: Sphere Scout
Info (website): www.scout.com
Email: scout at sphere dot com
Added on: Wed 20th Feb 2008 2:10am
Name: Sphider
Ident: Sphider2
Added on: Wed 20th Feb 2008 2:10am
Name: Spider Monkey
Ident: mouse.house
Added on: Wed 20th Feb 2008 2:11am
Name: SpiderBot
Ident: SpiderBot
Added on: Wed 20th Feb 2008 2:10am
Name: Spiderline Crawler
Ident: spiderline
Added on: Wed 20th Feb 2008 2:10am
Name: SpiderMan
Ident: SpiderMan
Added on: Wed 20th Feb 2008 2:10am
Name: SpiderView
Ident: SpiderView
Added on: Wed 20th Feb 2008 2:11am
Name: Suke
Ident: suke
Added on: Wed 20th Feb 2008 2:11am
Name: Suntek Search Engine
Ident: suntek
Added on: Wed 20th Feb 2008 2:11am
Name: Szukacz
Ident: Szukacz
Info (website): http://www.szukacz.pl/html/RobotEnglishVersion.html
Email: info@szukacz.pl
Added on: Wed 20th Feb 2008 2:12am
Name: TACH Black Widow
Ident: Black Widow
Added on: Wed 20th Feb 2008 2:13am
Name: Tarantula
Ident: Tarantula
Added on: Wed 20th Feb 2008 2:13am
Name: TarSpider
Ident: tarspider
Added on: Wed 20th Feb 2008 2:13am
Name: Tcl W3 Robot
Ident: dlw3robot
Added on: Wed 20th Feb 2008 2:13am
Name: TechBOT
Ident: TechBOT
Added on: Wed 20th Feb 2008 2:13am
Name: Technorati
Ident: Technoratibot
Info (website): http://technorati.com/about/
Email: press [at] technorati [dot] com
Country: United States
Added on: Fri 15th Feb 2008 6:38pm
Name: Templeton
Ident: Templeton
Added on: Wed 20th Feb 2008 2:14am
Name: Teoma/Ask Jeeves
Ident: teoma
Info (website): http://sp.teoma.com/docs/teoma/about/
Added on: Wed 20th Feb 2008 2:14am
Name: The Jubii
Ident: JubiiRobot
Added on: Wed 20th Feb 2008 2:14am
Name: The NorthStar Robot
Ident: NorthStar
Added on: Wed 20th Feb 2008 2:15am
Name: The NWI Robot
Ident: w3index
Added on: Wed 20th Feb 2008 2:15am
Name: The Peregrinator
Ident: Peregrinator-Mathematics
Added on: Wed 20th Feb 2008 2:15am
Name: Thumbshots
Ident: thumbshots-de-Bot
Info (website): www.thumbshots.de
Added on: Wed 20th Feb 2008 2:15am
Name: Thunderstone
Ident: T-H-U-N-D-E-R-S-T-O-N-E
Added on: Wed 20th Feb 2008 2:12am
Name: TinEye
Ident: TinEye
Info (website): http://tineye.com/crawler.html
Email: crawler@tineye.com
Added on: Wed 16th Apr 2008 4:29am
Name: Titan
Ident: TITAN
Added on: Wed 20th Feb 2008 2:15am
Name: TitIn
Ident: TitIn
Added on: Wed 20th Feb 2008 2:16am
Name: TLSpider
Ident: TLSpider
Added on: Wed 20th Feb 2008 2:16am
Name: Turn it in
Ident: turnitinbot
Info (website): http://www.turnitin.com/static/company.html
Country: United States
Added on: Sat 26th Jan 2008 12:26am
Name: Turn it in slysearch
Ident: slysearch
Info (website): http://www.turnitin.com/static/products_services/search_engines.html
Added on: Wed 20th Feb 2008 2:16am
Name: Turtle
Ident: TurtleScanner
Info (website): http://www.turtle.ru/
Country: Russian Federation
Added on: Wed 20th Feb 2008 2:17am
Name: Twiceler
Ident: Twiceler
Info (website): http://www.cuill.com/twiceler/robot.html
Added on: Tue 12th Feb 2008 4:58pm
Name: Twingbot
Ident: Twingbot
Info (website): http://www.twingbot.com/
Added on: Tue 12th Feb 2008 4:55pm
Name: UCSD Crawl
Ident: UCSD-Crawler
Added on: Wed 20th Feb 2008 2:18am
Name: UMBC RSS
Ident: UMBC-memeta-Bot
Added on: Wed 20th Feb 2008 2:18am
Name: Unpartisan RSS
Ident: Unpartisan
Info (website): http://www.unpartisan.com
Added on: Wed 20th Feb 2008 2:18am
Name: URL Check
Ident: urlck
Added on: Wed 20th Feb 2008 2:18am
Name: URL Spider Pro
Ident: URL Spider Pro
Added on: Wed 20th Feb 2008 2:18am
Name: Valentin
Ident: yavkurse.ru
Info (website): yavkurse.ru
Email: yavkurseru@mail.ru
Added on: Sat 5th Jul 2008 10:34am
Name: Valkyrie
Ident: Valkyrie
Added on: Wed 20th Feb 2008 2:19am
Name: vBSEO
Ident: Mozilla/4.0 (vBSEO; http://www.vbseo.com)
Info (website): http://www.vbseo.com/
Added on: Tue 15th Apr 2008 4:35am
Name: Verticrawl
Ident: Verticrawl
Added on: Wed 20th Feb 2008 2:19am
Name: Victoria
Ident: Victoria
Added on: Wed 20th Feb 2008 2:19am
Name: Vision Search
Ident: vision-search
Added on: Wed 20th Feb 2008 2:19am
Name: Visions
Ident: Visions Search
Info (website): http://www.italicvisions.com/
Email: info@italicvisions.com
Country: United States
Added on: Sat 19th Apr 2008 10:47am
Name: Voila
Ident: VoilaBot
Info (website): http://www.voila.com/
Added on: Wed 20th Feb 2008 2:19am
Name: Voyager
Ident: Voyager
Added on: Wed 20th Feb 2008 2:19am
Name: vsemuz
Ident: www.vsemuz.ru
Info (website): www.vsemuz.ru
Email: wwvsemuzu@mail.ru
Added on: Fri 4th Jul 2008 1:08pm
Name: VWbot
Ident: VWbot_K
Added on: Wed 20th Feb 2008 2:19am
Name: W3C
Ident: W3C-checklink
Info (website): http://validator.w3.org/checklink
Added on: Wed 20th Feb 2008 2:20am
Name: W3C CSS Validator
Ident: W3C_CSS_Validator
Info (website): http://jigsaw.w3.org/css-validator/
Added on: Wed 20th Feb 2008 2:20am
Name: W3C Validator
Ident: W3C_Validator
Info (website): http://validator.w3.org/
Added on: Wed 20th Feb 2008 2:20am
Name: W3M2
Ident: W3M2
Added on: Wed 20th Feb 2008 2:20am
Name: W3mir
Ident: w3mir
Added on: Wed 20th Feb 2008 2:21am
Name: w@pSpider
Ident: w@pSpider
Added on: Wed 20th Feb 2008 2:21am
Name: Walhello Appie
Ident: appie
Info (website): http://www.robotstxt.org/wc/active/html/appie.html
Email: aimo@walhello.com
Added on: Wed 20th Feb 2008 2:21am
Name: WallPaper
Ident: CrawlPaper
Added on: Wed 20th Feb 2008 2:22am
Name: Web Core / Roots
Ident: root
Added on: Wed 20th Feb 2008 2:22am
Name: Web Moose
Ident: WebMoose
Added on: Wed 20th Feb 2008 2:22am
Name: WebAlta
Ident: WebAlta Crawler
Info (website): http://www.webalta.net/ru/about_webmaster.html
Added on: Tue 4th Mar 2008 11:05pm
Name: WebAlta
Ident: WebAlta
Info (website): http://www.webalta.net/ru/about_webmaster.html
Added on: Sun 6th Jul 2008 9:36am
Name: WebBandit
Ident: WebBandit
Added on: Wed 20th Feb 2008 2:22am
Name: WebCatcher
Ident: WebCatcher
Added on: Wed 20th Feb 2008 2:22am
Name: Webclipping
Ident: Webclipping
Added on: Wed 20th Feb 2008 2:22am
Name: WebCopy
Ident: WebCopy
Added on: Wed 20th Feb 2008 2:22am
Name: WebFetcher
Ident: WebFetcher
Added on: Wed 20th Feb 2008 2:22am
Name: WebLayers
Ident: weblayers
Added on: Wed 20th Feb 2008 2:23am
Name: WebLinker
Ident: WebLinker
Added on: Wed 20th Feb 2008 2:23am
Name: Weblog Monitor
Ident: wlm
Added on: Wed 20th Feb 2008 2:23am
Name: WebQuest
Ident: WebQuest
Added on: Wed 20th Feb 2008 2:23am
Name: WebReaper
Ident: WebReaper
Added on: Wed 20th Feb 2008 2:23am
Name: Webs
Ident: webs@recruit.co.jp
Country: Japan
Added on: Wed 20th Feb 2008 2:23am
Name: WebSearchBench
Ident: websearchbench
Info (website): http://websearchbench.cs.uni-dortmund.de/
Added on: Wed 20th Feb 2008 2:24am
Name: WebStolperer
Ident: WOLP
Added on: Wed 20th Feb 2008 2:24am
Name: WebVac
Ident: webvac
Added on: Wed 20th Feb 2008 2:24am
Name: WebWalk
Ident: webwalk
Added on: Wed 20th Feb 2008 2:24am
Name: WebWalker
Ident: WebWalker
Added on: Wed 20th Feb 2008 2:24am
Name: WebWatch
Ident: WebWatch
Added on: Wed 20th Feb 2008 2:24am
Name: WebWombat
Ident: www.WebWombat.com.au
Info (website): http://www.webwombat.com.au/
Country: Australia
Added on: Mon 28th Jan 2008 4:41pm
Name: Wget
Ident: Wget
Added on: Sat 26th Jan 2008 3:27pm
Name: What U Seek Winona
Ident: whatUseek_winona
Added on: Wed 20th Feb 2008 2:25am
Name: Whitevector Crawler
Ident: Whitevector Crawler
Info (website): http://www.whitevector.com/
Email: support@whitevector.com
Country: Finland
Added on: Mon 13th Oct 2008 6:23am
Name: Whois DE
Ident: www.whoisde.de
Info (website): http://www.whoisde.de
Added on: Thu 28th Feb 2008 5:40am
Name: Whois Source
Ident: SurveyBot
Info (website): http://www.whois.sc/info/webmasters/surveybot.html
Added on: Wed 20th Feb 2008 2:25am
Name: Wild Ferret Web Hopper
Ident: Hazel's Ferret Web hopper
Added on: Wed 20th Feb 2008 2:26am
Name: Willow
Ident: Willow Internet Crawler by Twotrees
Added on: Wed 20th Feb 2008 2:26am
Name: Windows RSS Platform 1.0
Ident: Windows-RSS-Platform/1.0
Info (website): http://blogs.msdn.com/rssteam/archive/2006/04/28/586220.aspx
Added on: Tue 15th Apr 2008 4:36am
Name: Windows RSS Platform 2.0
Ident: Windows-RSS-Platform/2.0
Info (website): http://blogs.msdn.com/rssteam/archive/2008/02/28/the-rss-platform-user-agent-string.aspx
Added on: Tue 15th Apr 2008 4:36am
Name: WinHTTP
Ident: WinHTTP
Added on: Wed 20th Feb 2008 2:26am
Name: Wired Digital
Ident: wired-digital-newsbot
Added on: Wed 20th Feb 2008 2:26am
Name: WiseNut
Ident: zyborg
Added on: Sat 26th Jan 2008 3:31pm
Name: Worio
Ident: woriobot
Info (website): http://worio.com
Added on: Sat 23rd Feb 2008 10:23pm
Name: WorldIndexer
Ident: OmniExplorer_Bot
Info (website): http://www.omni-explorer.com
Added on: Wed 20th Feb 2008 2:27am
Name: www.kolinka.com
Ident: Project Kolinka Forum Search
Info (website): www.kolinka.com
Email: questions [at] kolinka [dot] com
Added on: Wed 20th Feb 2008 1:56am
Name: WWWC
Ident: WWWC
Added on: Wed 20th Feb 2008 2:27am
Name: WWWeasel
Ident: WWWeasel Robot
Added on: Wed 20th Feb 2008 2:27am
Name: WWWSter
Ident: wwwster
Added on: Wed 20th Feb 2008 2:27am
Name: WWWWanderer
Ident: WWWWanderer
Added on: Wed 20th Feb 2008 2:27am
Name: X-Crawler
Ident: TECOMAC-Crawler
Added on: Wed 20th Feb 2008 2:27am
Name: Xenu Link Sleuth
Ident: Xenu
Info (website): http://home.snafu.de/tilman/xenulink.html
Added on: Wed 20th Feb 2008 2:28am
Name: XGET
Ident: XGET
Added on: Wed 20th Feb 2008 2:28am
Name: XYLEME Robot
Ident: cosmos
Added on: Wed 20th Feb 2008 2:29am
Name: Yahoo Publisher Network
Ident: YahooYSMcm
Info (website): http://publisher.yahoo.com/
Country: United States
Added on: Wed 20th Feb 2008 2:29am
Name: Yahoo! Blogs
Ident: Yahoo-Blogs
Info (website): http://help.yahoo.com/help/us/ysearch/crawling/crawling-02.html
Added on: Wed 20th Feb 2008 2:29am
Name: Yahoo! FeedSeeker
Ident: YahooFeedSeeker
Added on: Wed 20th Feb 2008 2:30am
Name: Yahoo! Slurp
Ident: Yahoo! Slurp
Info (website): http://help.yahoo.com/l/us/yahoo/search/webcrawler/
Country: United States
Added on: Sat 26th Jan 2008 12:26am
Name: Yahoo! Vertical Crawler
Ident: Yahoo-VerticalCrawler
Added on: Wed 20th Feb 2008 2:30am
Name: Yandex
Ident: Yandex
Info (website): http://www.yandex.ru/
Country: Russian Federation
Added on: Wed 20th Feb 2008 2:30am
Name: Yandex Direct
Ident: YaDirectBot
Info (website): http://direct.yandex.ru/
Country: Russian Federation
Added on: Tue 8th Jul 2008 7:46am
Name: YandexBlog
Ident: YandexBlog
Info (website): http://blogs.yandex.ru/
Added on: Tue 24th Jun 2008 3:14am
Name: Yanga
Ident: Yanga WorldSearch Bot
Info (website): http://www.yanga.co.uk/
Email: support@yanga.co.uk
Country: United Kingdom
Added on: Wed 8th Oct 2008 12:30pm
Name: Yanga WorldSearch Bot
Ident: Yanga WorldSearch Bot
Info (website): http://www.yanga.co.uk
Country: United Kingdom
Added on: Mon 15th Sep 2008 7:04am
Name: YebolBot
Ident: YebolBot
Email: yebolbot@gmail.com
Added on: Wed 20th Aug 2008 11:31am
Name: Yeti
Ident: yetibot@naver.com
Email: yetibot@naver.com
Added on: Tue 4th Mar 2008 5:58pm
Name: Yeti
Ident: Yeti
Info (website): http://help.naver.com/robots/
Added on: Mon 7th Apr 2008 2:47pm
Name: Yeti/1.0
Ident: Yeti/1.0
Info (website): +http://help.naver.com/robots/
Country: South Korea
Added on: Mon 12th May 2008 3:45pm
Name: Yodao
Ident: YodaoBot
Info (website): http://www.yodao.com/help/webmaster/spider/
Country: China
Added on: Mon 14th Apr 2008 4:16pm
Name: Zeus Internet Marketing
Ident: zeus
Info (website): http://www.cyber-robotics.com/
Added on: Wed 20th Feb 2008 2:31am
Name: Zork RSS
Ident: http://www.zorkk.com
Info (website): http://www.zorkk.com
Added on: Wed 20th Feb 2008 2:31am

Spiders awaiting verification

Name: Ask.com
Ident: ?
Info (website): http://www.ask.com
Added on: Mon 17th Nov 2008 11:00pm
Name: Baiduspider
Ident: Baiduspider+(+http://www.baidu.com/search/spider_jp.html)
Info (website): http://www.baidu.com/search/spider_jp.html
Email: webmaster-jp@baidu.com
Country: Japan
Added on: Thu 20th Nov 2008 8:14am
Name: Twiceler
Ident: Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)
Info (website): http://www.cuil.com/twiceler/robot.html
Country: United States
Added on: Thu 20th Nov 2008 8:16am