# /robots.txt file for http://webcrawler.com/ # mail webmaster@webcrawler.com 
for constructive criticism User-agent: * Disallow: /highroad Disallow: /logs Disallow: 
/Jason Disallow: /littleoldwinemaker Disallow: /old_site Disallow: /prosearch 
Disallow: /cgi-bin Disallow: /shortlands Disallow: /taoproductions Disallow: /Techcom 
Disallow: /TMS Disallow: /eiscanada Disallow: /cashmoney Disallow: /Cashmoney 
Disallow: /Carol Disallow: /letstalksolutions Disallow: /toy