# www.robotstxt.org/ # http://code.google.com/web/controlcrawlindex/ User-agent: * Sitemap: http://www.comedy.co.nz/sitemap Disallow: /aspnet_client/ Disallow: /bin/ Disallow: /config/ Disallow: /data/ Disallow: /macroScripts/ Disallow: /umbraco/ Disallow: /umbraco_client/ Disallow: /usercontrols/ Disallow: /xslt/