Webmaster Forum


Go Back   Webmaster Forum > Marketing Forums > SEO Forum
Q about tweaking my robots.txt file Q about tweaking my robots.txt file
Register FAQ Members List Calendar Search Today's Posts Mark Forums Read

SEO Forum Search engine optimization discussions.

Lionsanime Directory   Improve your ranking, submit to directories   V7N Directory

Reply
 
LinkBack Thread Tools Display Modes
Old 04-13-2008, 07:19 AM   #1 (permalink)
Contributing Member
 
Join Date: 08-21-07
Location: Dover, Pennsylvania, USA
Posts: 102
iTrader: 0 / 0%
Latest Blog:
None

RawDepth is liked by many
Q about tweaking my robots.txt file
Since my site is dynamic I am trying to fine tune my robots.txt file for best indexing results.

If I disallow a folder such as "includes," will this stop robots from accessing needed files for other pages? In other words, if a page from my root directory calls for a file in the "includes" folder, will the robots still retrieve it even though it has been disallowed?
RawDepth is offline  
Add Post to del.icio.us
Reply With Quote
Sponsored Links
SEO Hosting by HostGator  Advertise Here  Buy Blog Links
Old 04-13-2008, 10:11 AM   #2 (permalink)
Contributing Member
 
corneo's Avatar
 
Join Date: 03-06-08
Posts: 474
iTrader: 0 / 0%
Latest Blog:
None

corneo is liked by somebodycorneo is liked by somebodycorneo is liked by somebodycorneo is liked by somebodycorneo is liked by somebody
this may answer a lot of your questions

http://www.outfront.net/tutorials_02...ech/robots.htm
__________________
BannerSwapNetwork
corneo is offline  
Add Post to del.icio.us
Reply With Quote
Old 04-13-2008, 06:01 PM   #3 (permalink)
Junior Member
 
Join Date: 04-13-08
Posts: 24
iTrader: 0 / 0%
Latest Blog:
None

codeslave is liked by many
Unless you are actually linking to your includes folder you don't need to block it. Google will not follow your server side PHP includes to the folder.
codeslave is offline  
Add Post to del.icio.us
Reply With Quote
Go Back   Webmaster Forum > Marketing Forums > SEO Forum

Reply

« Previous Thread | Next Thread »


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes
Linear Mode Linear Mode

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
Need help tweaking script amyintexas Coding Forum 5 12-21-2007 11:51 AM
Google and Robots.txt file noob_0001 Google Forum 0 04-01-2005 09:54 PM
Week 4: Tweaking, Testing and Link building. TanyaMartin Marketing Forum 9 02-07-2005 12:44 AM
Working with the robots.txt file Pannu Marketing Forum 0 05-24-2004 08:10 AM


Sponsor Links
Get exposure! Get exposure! Find Scripts Web Hosting Directory Get exposure! SEO Blog


Site Navigation: v7n Home .::. Graphics .::. Scripts .::. Web Designers .::. SEO Consultants .::. Web Hosting

Partners:V7N Web Directory .::. V7N Technology Blog .::. Host Ratings@V7N .::. V7N Affiliate Program .::. Advertise

All times are GMT -7. The time now is 02:18 PM.
© Copyright 2008 V7 Inc

Contact Us - Internet Marketing - Top