FYI FWIW: The main page on
www.komar.org is spidered daily as can be seen below - you can almost set your watch to it!
alek
64.68.82.185 - - [01/Aug/2004:19:07:08 -0600] "GET / HTTP/1.0" 200 7252 "-" "Googlebot/2.1 (+
http://www.google.com/bot.html)"
64.68.82.27 - - [02/Aug/2004:00:11:22 -0600] "GET / HTTP/1.0" 200 7252 "-" "Googlebot/2.1 (+
http://www.google.com/bot.html)"
64.68.82.169 - - [02/Aug/2004:19:08:57 -0600] "GET / HTTP/1.0" 200 7252 "-" "Googlebot/2.1 (+
http://www.google.com/bot.html)"
64.68.82.168 - - [03/Aug/2004:19:09:53 -0600] "GET / HTTP/1.0" 200 7252 "-" "Googlebot/2.1 (+
http://www.google.com/bot.html)"
64.68.82.47 - - [04/Aug/2004:19:07:24 -0600] "GET / HTTP/1.0" 200 7252 "-" "Googlebot/2.1 (+
http://www.google.com/bot.html)"
64.68.82.170 - - [05/Aug/2004:19:08:40 -0600] "GET / HTTP/1.0" 200 7252 "-" "Googlebot/2.1 (+
http://www.google.com/bot.html)"
64.68.82.167 - - [06/Aug/2004:19:10:03 -0600] "GET / HTTP/1.0" 200 7252 "-" "Googlebot/2.1 (+
http://www.google.com/bot.html)"