# Robots.txt file for www.sgtmitch.com # created on 01/23/2003 # DO NOT DELETE! This file tells search robots what pages to index or stay out of! User-agent: * Disallow: /admin/ Disallow: /articles/ Disallow: /cards/ Disallow: /cgi-bin/ Disallow: /chat/ Disallow: /deco/ Disallow: /events/ Disallow: /letters/ Disallow: /links/ Disallow: /list/ Disallow: /metatraffic/ Disallow: /newsarticles/ Disallow: /pics/ Disallow: /reminder/ Disallow: /scripts/ # the following lines prevents BlackWidow (a spammers and hackers robot) to index any pages User-agent: BlackWidow Disallow: /