Thread: What directory does robots.txt need to be placed in?
View Single Post
Old 04-01-2004, 01:55 PM   #19 (permalink)
Fruit & Veg
Contributing Member
 
Fruit & Veg's Avatar
 
Join Date: 10-13-03
Location: UK
Posts: 370
iTrader: 2 / 100%
Fruit & Veg is just really niceFruit & Veg is just really niceFruit & Veg is just really niceFruit & Veg is just really niceFruit & Veg is just really niceFruit & Veg is just really niceFruit & Veg is just really niceFruit & Veg is just really niceFruit & Veg is just really niceFruit & Veg is just really niceFruit & Veg is just really nice
No, but your forum pages have to be able to be indexed by a search engine.

Robots.txt is mainly used for blocking rather than allowing.
__________________
Individualitee - Great Tshirts
SmartGeezer - UK Men's Clothing Blog
Fruit & Veg is offline   Reply With Quote