View Single Post
Old 10-05-2007, 10:31 AM   #3 (permalink)
bogs
Contributing Member
 
bogs's Avatar
 
Join Date: 08-01-07
Posts: 1,095
iTrader: 0 / 0%
Latest Blog:
Scottish Fold Cat

bogs is a jewel in the roughbogs is a jewel in the roughbogs is a jewel in the roughbogs is a jewel in the roughbogs is a jewel in the roughbogs is a jewel in the rough
thats right or maybe try this one:

Quote:
Allow Googlebot to index all http pages but no https pages

Each port must have its own robots.txt file. In particular, if you serve content via both http and https, you’ll need a separate robots.txt file for each of these protocols.

For your http protocol (http://yourserver.com/robots.txt)

User-agent: *
Allow: /

For the https protocol (https://yourserver.com/robots.txt)

User-agent: *
Disallow: /


askapache.com

or visit: http://www.askapache.com/seo/seo-with-robotstxt.html
bogs is offline   Reply With Quote