Quote:
Originally Posted by 3DProf4online
where is it possible to find robots.txt file in hosting Cpanel?
|
I don't know about CPanel, but one's robots.txt file has nothing to do with control panel, editor, etc. Simply upload a robots.txt file to your web root.
This should get you started in the right direction:
Code:
http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=40360
This is typically very simple stuff.
We recommend that you at least have a robots.txt file in you web root with at least the following content:
You can then apply other rules.
NB: We haven't found that search engines, even Google, really respect the fules set in this file, so if you REALLY need to protect content, don't depend upon this; use a login of some sort.