# Robots.txt file from http://www.searchengineworld.com # # Bans all robots will spider the domain User-agent: * Disallow: /acm/ Disallow: /cgi-bin/ Disallow: /cio/ Disallow: /data/ Disallow: /demo/ Disallow: /disney/ Disallow: /dpa/ Disallow: /entegra/ Disallow: /eweek/ Disallow: /ffun/ Disallow: /georgia/ Disallow: /icc/ Disallow: /irr/ Disallow: /irrdemo/ Disallow: /maine/ Disallow: /mhm/ Disallow: /michigan/ Disallow: /omnibus/ Disallow: /pcm/ Disallow: /pepsi/ Disallow: /pics/ # Following line disallows all entries into /projectNNN dirs Disallow: /project Disallow: /recovery/ Disallow: /rgr/ Disallow: /sodexho/ Disallow: /sweepsclub/ Disallow: /temp/ Disallow: /test/ Disallow: /texas/ Disallow: /toy/ Disallow: /temp Disallow: /weightwatchers Disallow: /wisconsin/ Disallow: /wondertime Disallow: /wwo Disallow: /yil/ Disallow: /yildemo/