Google hits and run away

[scisoft]

Hi.

I am observing a very strange googlebot behaviour at http://www.scisoft.cz
Synonyms:
Frequent Googlebot visit, but in all cases either just the main page is hit and the boot does not spider OR one of the downstairs pages is hit, the boot comes up to the main page and does not follow any more links.
I do not believe that this is normal.


I have asked similar question on a different forum. The moderator took a look at my site headers and found that the server returns an expires date in the past.
I fixed the problem by php, checked on the webmaster-toolkit that the returned expires date is in future.

The googlebot was there and again- hit and run away, no spidering.
There was an alexa bot and spidered most pages OK, just minutes before the last googlebot.
The pages were spidered OK by a major local bot.

The CSS menu at the site is considered to be safe. We have used identical menus on 3 sites before and they were spidered accordingly.

You will probably understand that I am quite upset and will greatly appreciate any suggestions.


Thank you.

[I, Brian]

You have 30 pages spidered:
http://www.google.com/search?num=100...=Google+Search

[scisoft]

You are right.

I did the checks by looking for some low density keywords and my pages were not in the result set. The likely problem is the way how some Czech characters are handled by browser. Sorry again and thank you for your help.

I just hope not do the same mistake for the third time. It seems that googlebot masks itself under different names very frequently.

I still don't see any pagerank on the downstream pages, but just now I found that one of them scores 6 of 180000, so most likely the google toolbar is outdated.

[scisoft]

Just for the record:

I improved my bot detecting soft. Google comes in small herds. It means several googlebots from different IP adresses come within short interval, each one hists a different page and retreats. So they are not exactly spidering my site, they are accessing the pages in some coordinated way, basically one bot one page.

[I, Brian]

If you're having problems with your rankings then it could be an issue of where you're getting your in bound links from - namely, not enough links from not enough different places.

Of course, it could be an issue of the Czech characters - but I couldn't be certain of this.

The toolbar itself only updates publicly about once every 4 weeks or so - as does the backlinks tally found using "link:URL".

Hope that helps a little.

[scisoft]

I hoped for the toolbar beeing lazy, but it updated itself yesterday, judging from a different site.

I am not using Czech characters in the names of my pages or directories.

The link issue is likely. We designed a GPR5 and GPR6 sites, these are our major backlinks. Almost everything else is from GPR2 or bellow, mostly directories or forums. So possibly Google does not consider it worthy to distribute GPR on my downstream pages, perhaps until the site gets a bit older. It drives me nuts anyway.

Thank you for your time.