# robots.txt for http://www.thepinewood.com/ # All robots will spider the domain User-agent: * Disallow: /GeneratedItems/ Disallow: /webstats/ Disallow: /shop/