|
Disallow: /forums/sutra*.html$
Disallow: /forums/ptopic*.html$
Disallow: /forums/ntopic*.html$
Disallow: /forums/ftopic*asc*.html$
From my understanding, this was supposed to not allow Google from crawling duplicate content...not stop it from crawling 'any' content.....but I am a supreme amatuer at this...so I was just following directions
|