View Single Post
Old 09-09-2006, 11:52 AM   #3 (permalink)
CheebaHawk
Inactive
 
CheebaHawk's Avatar
 
Join Date: 08-04-06
Posts: 74
iTrader: 0 / 0%
Latest Blog:
None

CheebaHawk is liked by many
Ok, cool, I knew I was doing something wrong. I was worried about duplicate content as I didn't want my site to be indexed twice with each URL style. So if I remove that line from the robots.txt it should be ok yeah?

P.S. Thanks for the reply...no one else seems to take the "stoner site" too seriously...I really appreciate the help.

P.P.S - I just went and looked over the SEO mod that I used for the static url rewrite...it said to add the following lines...which include the one we are worried about...

Code:
Disallow: forums/post-*.html$ Disallow: forums/updates-topic.html*$ Disallow: forums/stop-updates-topic.html*$ Disallow: forums/ptopic*.html$ Disallow: forums/ntopic*.html$
The rest of the robots.txt was from a generic suggestion from someone at the phpbb board, maybe the error resides there? I can see how the problem could be that line if the MOD instructed me to do it, yes no?

Last edited by CheebaHawk : 09-09-2006 at 11:56 AM.
CheebaHawk is offline   Reply With Quote