Blocking https pages from Google

[simplyDone]

Hi

I have a site with https versions of other pages on my site which are are for logged in users. Google has indexed these https pages.

How do I stop Google from indexing these https pages, so that only the http versions of the pages are indexed, and so avoid any duplicate content penalties?

Thanks in advance for you help.

[Costin Trifan]

How do I stop Google from indexing these https pages..

by blocking the robots: http://www.robotstxt.org/wc/exclusion.html

[bogs]

thats right or maybe try this one:

Allow Googlebot to index all http pages but no https pages

Each port must have its own robots.txt file. In particular, if you serve content via both http and https, you’ll need a separate robots.txt file for each of these protocols.

For your http protocol (http://yourserver.com/robots.txt)

User-agent: *
Allow: /

For the https protocol (https://yourserver.com/robots.txt)

User-agent: *
Disallow: /


askapache.com

or visit: http://www.askapache.com/seo/seo-with-robotstxt.html

[noob_0001]

Could this be done with Apache?

Couldn't you have a rewrite rule that states that if the user agent is google and the url starts with https then forbidden?

[janhvizdak]

Originally Posted by simplyDone

Hi

I have a site with https versions of other pages on my site which are are for logged in users. Google has indexed these https pages.

How do I stop Google from indexing these https pages, so that only the http versions of the pages are indexed, and so avoid any duplicate content penalties?

Thanks in advance for you help.

When a visitor enters the right login and password, create a cookie which will tell your site engine to allow https. If the cookie doesn't exist, then redirect anyone who is accessing your site through https to an ordinary http.

Simple.

Here is a basic info for 301 redirs: http://www.webconfs.com/how-to-redirect-a-webpage.php

Ah, I forgot... The login form should be accessed through the <form> HTML entity instead of ordinary link.

[Seo Madrid]

You can also add a "nofollow,noindex" tag in the pages that you wan´t not to be indexed.

[olddocks]

Be careful while disallowing certain pages. If you mention something wrong or mess up, Google will de-index your site.

As far as disallowing https pages, best way to do it is create something a subdomain https://secure.domain.com for SSL and then you can restrict that folder in robots.txt

User-agent: *
Disallow: /secure