Webmaster Forum - View Single Post

1-True-Love.com · 02-06-2005, 09:26 PM

How do I block a robot that does not obey the robots.txt file? Is there some code that I can put in my .htaccess file to prevent an agent like "Mac Finder 1.0.35". It totally went thru my site several times today.

02-06-2005, 09:26 PM	#1 (permalink)
1-True-Love.com Inactive Join Date: 01-04-05 Location: http://www.1-true-love.com/ Posts: 60 iTrader: 0 / 0% Latest Blog: None	How do I block How do I block a robot that does not obey the robots.txt file? Is there some code that I can put in my .htaccess file to prevent an agent like "Mac Finder 1.0.35". It totally went thru my site several times today.