# Robots.txt file from http://www.antidegroup.com/ # # All robots will spider the domain User-agent: * Disallow: /adwords/ Disallow: /calc/ Disallow: /demo/ Disallow: /downloads/ Disallow: /graphics/ Disallow: /include/ Disallow: /flash/ Disallow: /oldsite/ Disallow: /image/ Disallow: /media/ Disallow: /news/ Disallow: /scripts/ Disallow: /stats/ Disallow: /styles/