How to stop Google trying to index .axd pages.

[kushty]

Hi,

Google throws exceptions when spidering our site and it is always for WebResource.axd and ScriptResource.axd. Is there a way to stop google trying to index them by way of the robots file?

Thanks

Steve

[bogs]

yes... try adding robots.txt... you can either specify a particular page that you don't want to index or the whole site.. this could help: http://www.outfront.net/tutorials_02...ech/robots.htm

[kushty]

Thanks Bogs, think I have found the solution

User-agent: *
Disallow: *.axd$

Steve

[wickedSEO]

Originally Posted by kushty

Hi,

Google throws exceptions when spidering our site and it is always for WebResource.axd and ScriptResource.axd. Is there a way to stop google trying to index them by way of the robots file?

Thanks

Steve

put rel="nofollow" on the link to your targetted page or protect it with robots.txt

[kushty]

Originally Posted by wickedSEO

put rel="nofollow" on the link to your targetted page or protect it with robots.txt

Yes, thanks for your help. We have decided to try the robots.txt way. The rel="nofollow" would be difficult to implement as the.axd pages are generated and not present on the site.

Steve