timtom:
Quote:
|
If i want google to crawl/index all the pages throughout my site, do i need a robots.txt file?
|
What you need it for is if you have places you *don't* want spidered, like a directory of scripts, or images, that kinda stuff.
You're gonna be spidered otherwise, like it or not.