# All robots will spider the domain User-agent: * Disallow: /cgi-bin/ Disallow: /old_site/ Disallow: /stats/ Disallow: /Templates/ Disallow: /users/