Webmaster Forum

Go Back   Webmaster Forum > Marketing Forums > Google Forum

Google Forum Discuss Google related issues.


Closed Thread
 
Thread Tools Display Modes
Share |
  #1  
Old 03-14-2018, 06:40 PM
jeanm jeanm is offline
Junior Member
 
Join Date: 06-10-04
Location: Bunbury, Australia
Posts: 19
iTrader: 0 / 0%
Google and the importance of robots.txt

In recent times website traffic to my business site has decreased. I'm told by someone "knowledgeable" that my robots.txt file is turned off and that I need to turn it on immediately. A search of my website indicates I don't have a robots.txt file there at all. I think when I built the site many years ago that I thought everything on the site should be crawled so I never included one.

Should I include a robots.txt file that disallows nothing and allows everything or is that silly?

Any help with this will be most appreciated. I'm very un-wise on website technical issues.

Thanks in advance.
 

Advertisement

Advertisement

  #2  
Old 03-14-2018, 06:50 PM
HTMLBasicTutor's Avatar
HTMLBasicTutor HTMLBasicTutor is offline
Administrator
 
Join Date: 10-29-07
Location: Canada
Posts: 26,710
iTrader: 5 / 100%
Please search the forums before starting a new thread. If you had you would have seen there is a recent thread on this topic already. Is it necessary to use Robots.txt file?

Learn about robots.txt files - Google Search Console Help

Create a robots.txt file - Google Search Console Help

Robots.txt Specifications - Google Search
 
Go Back   Webmaster Forum > Marketing Forums > Google Forum

Closed Thread


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


V7N Network
Get exposure! V7N I Love Photography V7N SEO Blog V7N Directory


All times are GMT -7. The time now is 05:11 AM.
Powered by vBulletin
Copyright 2000-2014 Jelsoft Enterprises Limited.
Copyright © 2003 - 2018 VIX-WomensForum LLC