# exclude help system from robots User-agent: * Disallow: * Disallow: /src/ Disallow: /selfhtml/ Disallow: /manual/ Disallow: /doc/ Disallow: /admin/ Disallow: /tmp/ Disallow: /gif/ Disallow: /inc/ Disallow: /functions/ Disallow: *.inc Disallow: *.txt Disallow: *.gif Disallow: *.php3 Disallow: *.ico Disallow: /home/*/www User-agent: Teleport* Disallow: / User-agent: Webwhacker Disallow: / User-agent: WebDevil Disallow: / User-agent: Webzip Disallow: / User-agent: Net Attache Disallow: / User-agent: SiteSnagger Disallow: / #Keep Rover from grabbing Email addresses from our site User-agent: WX_mail/2.000 Disallow: / User-agent: EmailCollector Disallow: / User-agent: WhoWhere Disallow: / User-Agent: Roverbot Disallow: / User-Agent: ActiveAgent Disallow: / User-agent: EmailSiphon Disallow: /