User-agent: ABCdatos BotLink Disallow: User-agent: Acme.Spider Disallow: User-agent: Ahoy! The Homepage Finder Disallow: User-agent: Alkaline Disallow: User-agent: ananzi Disallow: User-agent: Anthill Disallow: User-agent: Arachnophilia Disallow: User-agent: Arale Disallow: User-agent: Araneo Disallow: User-agent: AraybOt Disallow: User-agent: ArchitextSpider Disallow: User-agent: Aretha Disallow: User-agent: ARIADNE Disallow: User-agent: arks Disallow: User-agent: AskJeeves Disallow: User-agent: ASpider Disallow: User-agent: ATN Worldwide Disallow: User-agent: Atomz.comSearchRobot Disallow: User-agent: AURESYS Disallow: User-agent: BackRub Disallow: User-agent: baiduspider Disallow: User-agent: BaySpider Disallow: User-agent: BBot Disallow: User-agent: BigBrother Disallow: User-agent: Bjaaland Disallow: User-agent: DieBlindeKuh Disallow: User-agent: Bloodhound Disallow: User-agent: Borg-Bot Disallow: User-agent: BoxSeaBot Disallow: User-agent: bright.netcachingrobot Disallow: User-agent: BSpider Disallow: User-agent: CACTVSChemistrySpider Disallow: User-agent: Calif Disallow: User-agent: Cassandra Disallow: User-agent: Checkbot Disallow: User-agent: ChristCrawler.com Disallow: User-agent: churl Disallow: User-agent: cIeNcIaFiCcIoN.nEt Disallow: User-agent: CMC/0.01 Disallow: User-agent: Collective Disallow: User-agent: CombineSystem Disallow: User-agent: ComputingSiteRobi/1.0 Disallow: User-agent: Conceptbot Disallow: User-agent: ConfuzzledBot Disallow: User-agent: CoolBot Disallow: User-agent: CyberSpyderLinkTest Disallow: User-agent: CydralSpider Disallow: User-agent: DesertRealmSpider Disallow: User-agent: DeWeb(c)Katalog/Index Disallow: User-agent: DienstSpider Disallow: User-agent: DigitalIntegrityRobot Disallow: User-agent: DirectHitGrabber Disallow: User-agent: DNAbot Disallow: User-agent: DragonBot Disallow: User-agent: DWCP(Dridus'WebCatalogingProject) Disallow: User-agent: EbiNess Disallow: User-agent: EITLinkVerifierRobot Disallow: User-agent: ELFINBOT Disallow: User-agent: Emacs-w3SearchEngine Disallow: User-agent: esculapio Disallow: User-agent: Esther Disallow: User-agent: EvliyaCelebi Disallow: User-agent: FastCrawler Disallow: User-agent: FelixIDE Disallow: User-agent: FetchRover Disallow: User-agent: fido Disallow: User-agent: Fishsearch Disallow: User-agent: FluidDynamicsSearchEnginerobot Disallow: User-agent: Fouineur Disallow: User-agent: Freecrawl Disallow: User-agent: FunnelWeb Disallow: User-agent: gammaSpider,FocusedCrawler Disallow: User-agent: gazz Disallow: User-agent: GCreep Disallow: User-agent: GetterroboPlusPuu Disallow: User-agent: GetURL Disallow: User-agent: Gigabot Disallow: User-agent: Golem Disallow: User-agent: Googlebot Disallow: User-agent: Googlebot-Image Disallow: User-agent: Grapnel/0.01Experiment Disallow: User-agent: Griffon Disallow: User-agent: Gromit Disallow: User-agent: Gulliver Disallow: User-agent: GulperBot Disallow: User-agent: Hämähäkki Disallow: User-agent: HamBot Disallow: User-agent: havIndex Disallow: User-agent: HI(HTMLIndex)Search Disallow: User-agent: HometownSpiderPro Disallow: User-agent: ht://Dig Disallow: User-agent: html_analyzer Disallow: User-agent: HTMLgobble Disallow: User-agent: Hyper-Decontextualizer Disallow: User-agent: ia_archiver Disallow: User-agent: iajaBot Disallow: User-agent: IBM_Planetwide Disallow: User-agent: Ingrid Disallow: User-agent: image.kapsi.net Disallow: User-agent: Imagelock Disallow: User-agent: IncyWincy Disallow: User-agent: Informant Disallow: User-agent: InfoSeekRobot1.0 Disallow: User-agent: InfoseekSidewinder Disallow: User-agent: InfoSpiders Disallow: User-agent: InktomiSlurp Disallow: User-agent: InspectorWeb Disallow: User-agent: IntelliAgent Disallow: User-agent: InternetCruiserRobot Disallow: User-agent: InternetShinchakubin Disallow: User-agent: I,Robot Disallow: User-agent: Iron33 Disallow: User-agent: Israeli-search Disallow: User-agent: JavaBee Disallow: User-agent: JBotJavaWebRobot Disallow: User-agent: JCrawler Disallow: User-agent: Jeeves Disallow: User-agent: Jobot Disallow: User-agent: JoeBot Disallow: User-agent: TheJubiiIndexingRobot Disallow: User-agent: JumpStation Disallow: User-agent: Katipo Disallow: User-agent: KDD-Explorer Disallow: User-agent: Kilroy Disallow: User-agent: KIT-Fireball Disallow: User-agent: KO_Yappo_Robot Disallow: User-agent: LabelGrabber Disallow: User-agent: legs Disallow: User-agent: LinkValidator Disallow: User-agent: Lockon Disallow: User-agent: logo.gifCrawler Disallow: User-agent: Lycos Disallow: User-agent: MacWWWWorm Disallow: User-agent: Magpie Disallow: User-agent: marvin/infoseek Disallow: User-agent: Mattie Disallow: User-agent: MediaFox Disallow: User-agent: MerzScope Disallow: User-agent: MindCrawler Disallow: User-agent: mnoGoSearchsearchenginesoftware Disallow: User-agent: MOMspider Disallow: User-agent: Motor Disallow: User-agent: MSNBot Disallow: User-agent: Muncher Disallow: User-agent: Muninn Disallow: User-agent: MuscatFerret Disallow: User-agent: Mwd.Search Disallow: User-agent: NDSpider Disallow: User-agent: NEC-MeshExplorer Disallow: User-agent: Nederland.zoek Disallow: User-agent: NetCartaWebMapEngine Disallow: User-agent: NetScoop Disallow: User-agent: newscan-online Disallow: User-agent: NHSEWebForager Disallow: User-agent: NorthernLightGulliver Disallow: User-agent: TheNorthStarRobot Disallow: User-agent: TheNWIRobot Disallow: User-agent: nzexplorer Disallow: User-agent: ObjectsSearch Disallow: User-agent: Occam Disallow: User-agent: OntoSpider Disallow: User-agent: OpenTextIndexRobot Disallow: User-agent: OrbSearch Disallow: User-agent: PackRat Disallow: User-agent: PageBoy Disallow: User-agent: ParaSite Disallow: User-agent: Patric Disallow: User-agent: pegasus Disallow: User-agent: ThePeregrinator Disallow: User-agent: PerlCrawler1.0 Disallow: User-agent: Phantom Disallow: User-agent: PhpDig Disallow: User-agent: PiltdownMan Disallow: User-agent: Pimptrain.com'srobot Disallow: User-agent: Pioneer Disallow: User-agent: PopularIconoclast Disallow: User-agent: PortalJuiceSpider Disallow: User-agent: PGPKeyAgent Disallow: User-agent: PlumtreeWebAccessor Disallow: User-agent: Poppi Disallow: User-agent: PortalBSpider Disallow: User-agent: psbot Disallow: User-agent: ThePythonRobot Disallow: User-agent: RavenSearch Disallow: User-agent: RBSESpider Disallow: User-agent: ResumeRobot Disallow: User-agent: RoadHouseCrawlingSystem Disallow: User-agent: RixBot Disallow: User-agent: RoadRunner:TheImageScapeRobot Disallow: User-agent: RobbietheRobot Disallow: User-agent: RoboCrawlSpider Disallow: User-agent: RoboFox Disallow: User-agent: RobotFrancoroute Disallow: User-agent: Robozilla Disallow: User-agent: Roverbot Disallow: User-agent: RuLeS Disallow: User-agent: SafetyNetRobot Disallow: User-agent: Scooter Disallow: User-agent: Scrubby Disallow: User-agent: Search.Aus-AU.COM Disallow: User-agent: SearchProcess Disallow: User-agent: Senrigan Disallow: User-agent: SG-Scout Disallow: User-agent: ShagSeeker Disallow: User-agent: Sift Disallow: User-agent: SimmanyRobotVer1.0 Disallow: User-agent: SiteValet Disallow: User-agent: SiteTech-Rover Disallow: User-agent: Skymob.com Disallow: User-agent: SLCrawler Disallow: User-agent: Sleek Disallow: User-agent: Slurp Disallow: User-agent: Snooper Disallow: User-agent: Solbot Disallow: User-agent: SpeedySpider Disallow: User-agent: spider_monkey Disallow: User-agent: SpiderBot Disallow: User-agent: SpiderlineCrawler Disallow: User-agent: SpiderMan Disallow: User-agent: SpiderView(tm) Disallow: User-agent: SiteSearcher Disallow: User-agent: Suke Disallow: User-agent: sunteksearchengine Disallow: User-agent: Sven Disallow: User-agent: TACHBlackWidow Disallow: User-agent: tarspider Disallow: User-agent: TclW3Robot Disallow: User-agent: TechBOT Disallow: User-agent: Templeton Disallow: User-agent: Teoma Disallow: User-agent: TeomaTechnologies Disallow: User-agent: TitIn Disallow: User-agent: TheTkWWWRobot Disallow: User-agent: TLSpider Disallow: User-agent: twiceler Disallow: User-agent: UCSDCrawl Disallow: User-agent: UdmSearch Disallow: User-agent: UptimeBot Disallow: User-agent: URLCheck Disallow: User-agent: URLSpiderPro Disallow: User-agent: Valkyrie Disallow: User-agent: Verticrawl Disallow: User-agent: Victoria Disallow: User-agent: vision-search Disallow: User-agent: void-bot Disallow: User-agent: Voyager Disallow: User-agent: VWbot Disallow: User-agent: W3M2 Disallow: User-agent: w3mir Disallow: User-agent: WallPaper(aliascrawlpaper) Disallow: User-agent: w@pSpiderbywap4.com Disallow: User-agent: WebCatcher Disallow: User-agent: WebCore/Roots Disallow: User-agent: WebCrawler/3.0 Disallow: User-agent: webfetcher Disallow: User-agent: TheWebfootRobot Disallow: User-agent: Webinator Disallow: User-agent: weblayers Disallow: User-agent: WebLinker Disallow: User-agent: WeblogMonitor Disallow: User-agent: TheWebMoose Disallow: User-agent: webs Disallow: User-agent: Websnarf Disallow: User-agent: WebSpider Disallow: User-agent: WebStolperer Disallow: User-agent: WebVac Disallow: User-agent: webwalk Disallow: User-agent: WebWalker Disallow: User-agent: WebWatch Disallow: User-agent: TheWebWombat Disallow: User-agent: WebZinger Disallow: User-agent: whatUseekWinona Disallow: User-agent: WhoWhereRobot Disallow: User-agent: WildFerretWebHopper #1,#2,#3 Disallow: User-agent: WiredDigital Disallow: User-agent: theWorldWideWebWanderer Disallow: User-agent: TheWorldWideWebWorm Disallow: User-agent: WWWCVer0.2.5 Disallow: User-agent: XYLEMERobot Disallow: User-agent: XGET Disallow: User-agent: yahoo-blogs/v3.9 Disallow: User-agent: yahoo-mmcrawler Disallow: User-agent: * Disallow: /