Webmaster Forum


Go Back   Webmaster Forum > Marketing Forums > SEO Forum
Register FAQ Members List Calendar Search Today's Posts Mark Forums Read

SEO Forum Search engine optimization discussions.

Easy Date   ClickBooth Network   V7N Directory

Reply
 
LinkBack Thread Tools Display Modes
Old 01-28-2008, 03:56 AM   #1 (permalink)
Member
 
Join Date: 08-14-07
Posts: 46
iTrader: 0 / 0%
Latest Blog:
None

Swapna is liked by many
Hiding robots.txt from being visible though a browser

Hi guys,
I want to know if there is any way to block the robots.txt file from being viewable through browser. Of course, the search engine bots must not face any hindrance in reading the robots.txt file, in the process of hiding it.

My site for medical transcription services has got a lot of pages that are used by the in-house sales team to update client testimonials, write articles etc., all without any login or authentication. Such pages, for our interest, better be blocked from search engines and remain out of sight of all external users.

Awaiting a positive response..
Swapna is offline  
Add Post to del.icio.us
Reply With Quote
Sponsored Links
SEO Hosting by HostGator  Advertise Here  Buy Blog Links
Old 01-28-2008, 03:21 PM   #2 (permalink)
v7n Mentor
 
Join Date: 07-24-06
Posts: 650
iTrader: 1 / 100%
Latest Blog:
None

nasty.web is just really nicenasty.web is just really nicenasty.web is just really nicenasty.web is just really nicenasty.web is just really nicenasty.web is just really nicenasty.web is just really nicenasty.web is just really nicenasty.web is just really nicenasty.web is just really nice
You can try to detect the type of the browser and hide robots.txt in some cases. But visitors can easily switch UserAgent in their browsers to GoogleBot, for example. Furthermore, you can try checking visitors IP. Anyway, these tasks sum up into a pretty advanced cloaking script.

I would recommend you to simply add the authentication to your "secret" directories.
nasty.web is offline  
Add Post to del.icio.us
Reply With Quote
Go Back   Webmaster Forum > Marketing Forums > SEO Forum

Reply



Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
Visible shopping cart or not? kmx888 Marketing Forum 8 08-02-2008 11:56 PM
mm_menu and hiding recently made visible layers Good.Things Coding Forum 1 09-27-2007 01:06 PM
hover overline isn't visible in IE6 sachi Coding Forum 9 09-04-2006 10:59 AM


Sponsor Links
Get exposure! Get exposure! Find Scripts Web Hosting Directory Get exposure! SEO Blog


All times are GMT -7. The time now is 07:58 AM.
© Copyright 2008 V7 Inc