Where to place robots.txt

[scisoft]

Hi.

I have the following structure of my site

www------->stuff/
------->morestuff/
www2------>somestuff/

The site itself is in the www folder. I wish to disallow the /morestuff/ within the www folder.

Should a robots.txt be placed to the www folder or at most top level, the same level as the www folder itself?

If it is in the www folder is the correct path to dissalow morestuff simply
/morestuff/ ?

Sorry for asking such trivial questions, but I have likely messed something
I though I know quite well.

Thank you.

[Shawn]

robots.txt should go in the root html folder..and it's not trivial..it's better to ask then mess something up

[Johan007]

so it shows like this:

http://www.v7n.com/robots.txt

[scisoft]

Originally Posted by Johan007

so it shows like this:

http://www.v7n.com/robots.txt

Well thus the likely error was that I used

Disallow: /www/xxx/

instead of just

Disallow: /xxx/
??

(The robot found pages accessed through a redirect script placed in a "dissalowed" folder)

[imaginemn]

I am sure there are others but here is a good Robots.txt Tutorial page.

http://www.searchengineworld.com/rob...s_tutorial.htm

imaginemn

[I, Brian]

Originally Posted by scisoft

Well thus the likely error was that I used

Disallow: /www/xxx/

instead of just

Disallow: /xxx/
??

(The robot found pages accessed through a redirect script placed in a "dissalowed" folder)

That's right - you need to use relative URLs, *not* relative paths in your robots.txt.