Webmaster Forum

Webmaster Forum (http://www.v7n.com/forums/index.php)
-   SEO Forum (http://www.v7n.com/forums/forumdisplay.php?f=11)
-   -   what is difference between robot and meta robot (http://www.v7n.com/forums/showthread.php?t=308913)

georgemathew 06-21-2012 06:34 AM

what is difference between robot and meta robot
what is difference between robot and meta robot

digitalseo 06-21-2012 07:40 AM

Hi TS,

Please refer to this link:


The Robots Exclusion Protocol (REP) is a group of web standards that regulate Web robot behavior and search engine indexing.

rankwatch 06-22-2012 09:36 PM

Robots Meta
Definitely Robots Meta Tag are better and superior than Robots.txt Because robots meta tag can pass the link juice while robots.txt prevent to pass the link juice.

Leonie 06-22-2012 10:16 PM

what is difference between robot and meta robot
The difference between robot.txt and robots meta tags is..

robots.txt is at site/folder level while the robots meta directives are at page level.

deryaSavas 06-23-2012 05:50 AM

Leonie is spot on, and I would like to also add;

Much thought and consideration must go into these directives for seo purposes, especially for Google seo, as it follows directives defined for its own user agent "Googlebot"
If you are wanting to control what googlebot does on page level, example (noindex, follow) this at page level means, do not index the page contents, but do follow the links.
I usually work out the files which I do not want to be indexed at all, and place them in a folder, then use robots.txt file and block it that way. But at times I actually need to control it at page level. Thus, depending on your needs, you can surely use them.

Best to read around, and understand what it is, and how to use them. Especially the information provided by Google.
I hope this helps

Shefali 06-25-2012 05:30 AM

Meta tags describes about your website to search engine crawler while robots.txt tells crawler which page of the site to be crawl or not.

yasir24 06-26-2012 04:34 AM

well i use both, as i use blogger platform. I have robot.txt file, which is already set up properly by blogger, and i use robot meta tags too, and i find them more helpful as they are within the page and they invite robots to crawl the pages.

healthspringwc 07-29-2012 10:29 PM

A robots.txt file allows which parts of your Web page robots or crawlers can access. if you don't want the particular web page to be crawled then you can specify using robot.txt file.
Meta tag inclusion describes about the tittle of that web page,which will be easier for meta robot to crawl that page.

c5c1lia 07-31-2012 09:44 PM

Refer to this official Google support link: http://support.google.com/webmasters...rom=35237&rd=1

Hope, it clarifies your query.


Originally Posted by georgemathew (Post 1889453)
what is difference between robot and meta robot

All times are GMT -7. The time now is 07:21 AM.