|
Your robots.txt only needs to be placed in the root directory, any references to lower level directories are made from there.
However robots.txt. is an exclusion standard so in terms of "Allowing Crawling" you shouldnt need to do anything except install your forums search engine hack and link to the forum index.
|