User-agent: ia_archiver Disallow: / User-agent: CS-HKUST-IndexServer/1.0 Disallow: / User-agent: Emacs-w3/v[0-9\.]+ Disallow: / User-agent: Webster Pro Disallow: / User-agent: KIT-Fireball/2.0 libwww/5.0a Disallow: / User-agent: WhoWhere Robot Disallow: / User-agent: SlowBot Disallow: / User-agent: JCrawler/0.2 Disallow: / User-agent: Digimarc WebReader/1.2 Disallow: / User-agent: TeleportPro Disallow: / User-agent: Pioneer Disallow: / User-agent: NetCarta CyberPilot Pro Disallow: / User-agent: Duppies Disallow: / User-agent: Keyword Density/0.9 Disallow: / User-agent: HappyBot (gserver.kw.net) Disallow: / User-agent: asterias Disallow: / User-agent: weblayers/0.0 Disallow: / User-agent: Zeus 32297 Webster Pro V2.9 Win32 Disallow: / User-agent: WWWC/0.25 (Win95) Disallow: / User-agent: jumpstation Disallow: / User-agent: ia_archiver/1.6 Disallow: / User-agent: Mister PiX Disallow: / User-agent: Nederland.zoek Disallow: / User-agent: WebCopier Disallow: /