|
Proper robot.txt, keep SE's out
I'm looking to block all search engines, or any that listen to robots.txt, from a subdomain. Could anyone point me in the right direction to create a proper robots.txt?
I've done some searching and found some conflicting reports. Some say that using the simple disallow agent it will block from the entire server, which is not what I want to do. I simply want to keep them out of a subdomain.
|