Webmaster Forum


Go Back   Webmaster Forum > Marketing Forums > Google Forum
Register FAQ Members List Calendar Search Today's Posts Mark Forums Read

Google Forum Discuss Google related issues.

Ezilon Directory   Improve your ranking, submit to directories   V7N Directory

Reply
 
LinkBack Thread Tools Display Modes
Old 08-31-2006, 12:35 PM   #1 (permalink)
Inactive
 
CheebaHawk's Avatar
 
Join Date: 08-04-06
Posts: 74
iTrader: 0 / 0%
Latest Blog:
None

CheebaHawk is liked by many
Question about duplicate content.

Hey everyone,

I run a forum, its a phpbb, and it was suggested here that I use a mod_rewrite to change my dynamic urls to static. I had to switch hosts and it took me awhile to redo the mod_rewrite and a few of my pages got index under the wrong URL. I was wondering how I can write a robots.txt file to exclude the non static pages. I want to keep the non-static urls because they are used by members here are some examples of the links...

I dont want google to see these pages...

http://www.always420forum.com/forum/viewforum.php?f=*
http://www.always420forum.com/forum/viewtopic.php?t=*

I do want them to see these pages...

http://www.always420forum.com/forum/forum-*.html
http://www.always420forum.com/forum/about*.html

How would on write the robots.txt file? Thanks for the help!

edit- just realized I probably should have put this in the SEO section, I was worrying about duplicate content specifically for google so this is where I was looking...sorry!
CheebaHawk is offline  
Add Post to del.icio.us
Reply With Quote
Sponsored Links
SEO Hosting by HostGator  Advertise Here  Buy Blog Links
Old 09-01-2006, 11:16 AM   #2 (permalink)
Inactive
 
CheebaHawk's Avatar
 
Join Date: 08-04-06
Posts: 74
iTrader: 0 / 0%
Latest Blog:
None

CheebaHawk is liked by many
No one?
CheebaHawk is offline  
Add Post to del.icio.us
Reply With Quote
Old 09-01-2006, 11:34 AM   #3 (permalink)
Inactive
 
wileynet's Avatar
 
Join Date: 08-27-06
Location: Ventura California
Posts: 55
iTrader: 0 / 0%
Latest Blog:
None

wileynet is liked by many
Send a message via ICQ to wileynet Send a message via MSN to wileynet Send a message via Yahoo to wileynet
Quote:
Originally Posted by CheebaHawk
Hey everyone,

I run a forum, its a phpbb, and it was suggested here that I use a mod_rewrite to change my dynamic urls to static. I had to switch hosts and it took me awhile to redo the mod_rewrite and a few of my pages got index under the wrong URL. I was wondering how I can write a robots.txt file to exclude the non static pages. I want to keep the non-static urls because they are used by members here are some examples of the links...

I dont want google to see these pages...

http://www.always420forum.com/forum/viewforum.php?f=*
http://www.always420forum.com/forum/viewtopic.php?t=*

I do want them to see these pages...

http://www.always420forum.com/forum/forum-*.html
http://www.always420forum.com/forum/about*.html

How would on write the robots.txt file? Thanks for the help!

edit- just realized I probably should have put this in the SEO section, I was worrying about duplicate content specifically for google so this is where I was looking...sorry!

Some how you are going to have to have all your static files go into a specific folder. If not your going to have to figure something else out other then a robots.txt file.

Once you have what you want google to not crawl your robot file should be something like ...

User-agent: google
Disallow: /staticForumPages

wileynet is offline  
Add Post to del.icio.us
Reply With Quote
Go Back   Webmaster Forum > Marketing Forums > Google Forum

Reply



Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
Duplicate Content - Help!!! alex06 SEO Forum 4 11-15-2007 09:19 AM
Duplicate content question mauiman Web Directory Issues 3 07-13-2007 05:46 AM
Please Help! is this duplicate content??? sks SEO Forum 2 05-24-2007 07:03 AM
Question about Duplicate Content gobeyond SEO Forum 0 05-04-2007 08:42 AM
Duplicate Content awall19s brother Google Forum 6 01-17-2005 02:39 AM


Sponsor Links
Get exposure! Get exposure! Find Scripts Web Hosting Directory Get exposure! SEO Blog


All times are GMT -7. The time now is 03:28 AM.
© Copyright 2008 V7 Inc