Webmaster Forum

Go Back   Webmaster Forum > Marketing Forums > Google Forum

Google Forum Discuss Google related issues.

Closed Thread
Thread Tools Display Modes
Share |
Old 05-28-2016, 03:39 AM
oxsamrion's Avatar
oxsamrion oxsamrion is offline
Contributing Member
Join Date: 08-11-14
Location: Dar es salaam
Posts: 86
iTrader: 0 / 0%
What Is Robot.txt File?

I Want To Know What Is Robot.txt file



Old 05-28-2016, 05:51 AM
nehacoupons nehacoupons is offline
Contributing Member
Join Date: 12-02-15
Location: Delhi
Posts: 64
iTrader: 0 / 0%
Robots.txt is a text file webmasters create to instruct search engines robots how to crawl and index pages on their website. You can mention disallow to block pages which you don't want to show on search engine.
Old 05-30-2016, 12:49 AM
ChrisPersson ChrisPersson is offline
Junior Member
Join Date: 09-29-14
Location: Kolkata
Posts: 17
iTrader: 0 / 0%
Robosts.txt also known as robots exclusion protocol which tells search engine bots to which pages of a website it will crawl or not to crawl. A robots.txt file is uploaded in the root of a website. Generally it contains two types of permissions 1) Allow followed by directories/files/webpages that needed to be crawled by search engine bot. 2) Disallow followed by directories/files/webpages that not needed to be crawled by search engine bot.

Hope this will help.
Old 05-30-2016, 08:02 AM
HTMLBasicTutor's Avatar
HTMLBasicTutor HTMLBasicTutor is offline
Join Date: 10-29-07
Location: Canada
Posts: 26,457
iTrader: 5 / 100%
Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol.
Read more here: About /robots.txt
Go Back   Webmaster Forum > Marketing Forums > Google Forum

Closed Thread

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
importance of Robot.txt file Humak SEO Forum 6 03-18-2008 12:08 PM
Best tutorial for using a robot.txt file? Johnathan Google Forum 5 11-12-2004 02:23 PM
Robot text file. Alan30 Marketing Forum 3 09-17-2004 03:13 PM
Making a robot.txt file edbarton Coding Forum 5 10-13-2003 09:55 AM

V7N Network
Get exposure! V7N I Love Photography V7N SEO Blog V7N Directory

All times are GMT -7. The time now is 06:06 AM.
Powered by vBulletin
Copyright 2000-2014 Jelsoft Enterprises Limited.
Copyright © 2003 - 2018 VIX-WomensForum LLC