Webmaster Forum


Go Back   Webmaster Forum > Marketing Forums > SEO Forum

SEO Forum Search engine optimization discussions.


Reply
 
LinkBack Thread Tools Display Modes
Share |
  #1 (permalink)  
Old 08-28-2010, 05:02 AM
Junior Member
 
Join Date: 08-28-10
Posts: 1
iTrader: 0 / 0%
Excluding pages - robots.txt vs meta robots tag

ques:Under what circumstances would you look to exclude pages from search engines using robots.txt vs meta robots tag?

-----------------------------------
 
Reply With Quote
  #2 (permalink)  
Old 08-28-2010, 01:08 PM
Contributing Member
 
Join Date: 06-21-10
Posts: 964
iTrader: 0 / 0%
Its clear. When you want some pages of your website not to be indexed by search engines you use robotx.txt for preventing them from crawling those pages.
 
Reply With Quote
  #3 (permalink)  
Old 08-28-2010, 07:10 PM
Banned
Latest Blog:
None

 
Join Date: 10-03-07
Posts: 151
iTrader: 0 / 0%
Robots.txt is the way to go. That's what google recommends.
 
Reply With Quote
  #4 (permalink)  
Old 08-28-2010, 09:11 PM
AirForce1's Avatar
Contributing Member
 
Join Date: 05-26-09
Posts: 1,875
iTrader: 0 / 0%
Quote:
Originally Posted by Mobile Development View Post
ques:Under what circumstances would you look to exclude pages from search engines using robots.txt vs meta robots tag?

-----------------------------------
Hi,

I think Robots meta tag would usually be applicable to page level while robots.txt would be used at catalog or site level and must appear at the root directory of your sites.

all the best,
__________________
Men, women & kids Nike air jordan shoes, air jordan fusion shoes bargain shop online.
 
Reply With Quote
  #5 (permalink)  
Old 08-30-2010, 05:06 AM
Banned
Latest Blog:
None

 
Join Date: 08-25-10
Location: Pune, Maharashtra, India
Posts: 56
iTrader: 0 / 0%
i think robots.txt is correct way...
 
Reply With Quote
  #6 (permalink)  
Old 08-31-2010, 05:42 PM
Banned
Latest Blog:
None

 
Join Date: 02-15-10
Posts: 603
iTrader: 0 / 0%
Using meta tags is also ok. But that way Google will crawl your site but not index it.
And using robots.txt Google will keep away from the page and not even crawl it.
I normally use meta tags , But Google suggests to use robotx.txt
 
Reply With Quote
  #7 (permalink)  
Old 08-31-2010, 08:45 PM
Junior Member
 
Join Date: 08-31-10
Posts: 9
iTrader: 0 / 0%
using robots.txt is best way
 
Reply With Quote
Go Back   Webmaster Forum > Marketing Forums > SEO Forum

Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
What is meta robots tag & what are its different attibutes? jiten702 SEO Forum 1 06-29-2010 01:32 AM
No Meta Robots for the Pink Bunny WM-Scott SEO Forum 6 03-09-2008 10:51 AM
Robots.txt Shawn Google Forum 7 01-02-2005 03:08 PM
Robots.txt Ricoool Coding Forum 3 06-11-2004 08:00 PM


V7N Network
Get exposure! V7N I Love Photography V7N SEO Blog V7N Directory


All times are GMT -7. The time now is 12:53 AM.
Powered by vBulletin
Copyright © 2000-2013 Jelsoft Enterprises Limited.
Copyright © 2003 - 2013 Escalate Media LP




Search Engine Optimization by vBSEO 3.6.0 RC 2 ©2011, Crawlability, Inc.