|
HI Ed:
You can use a robots.txt file to stop one or all robots from indexing your pages, but you cannot make them visit you on your terms.
To make a robots.txt file just create a plain vanilla text file (notepad or any other text editor will work fine but not Wordpad) then add these lines:
User-agent: *
Disallow: names of pages or directories you do not want spiders to visit one page or directory on a line.
Then save this file to the ROOT directory of you site.
You can do lots more with a robots.txt file, too. There is full information on the protocol at W3C.org
|