« Previous Next »

• 10-22-2009, 4:03 PM

  jojobar Joined on 02-23-2006, 2:09 PM Posts 2

  How can I ask IIS SEO not to crawl certain files... Reply Contact I ran this tool (in localhost) and am getting hundreds of error related to broken link in search.cgi, default.aspx etc. Is there any way for me to ask the SEO tool to ignore these files. I tried putting the following in the robots.txt file but of no avail: Disallow: default.aspx Disallow: /web/Js/ Disallow: /search.cgi Any ideas how to avoid these...

  Tags: disallowignorerobots.txt

• 10-22-2009, 6:59 PM

  In reply to

  CarlosAg Joined on 02-18-2003, 9:23 PM Posts 344	Re: How can I ask IIS SEO not to crawl certain files... Reply Contact Is this running in the root of a Web Site that you, Robots.txt can only be set at the root of a site meaning: http://localhost/robots.txt