Google seems to plan new search engine spider

[corsair]

In a search engine discussion forum, a Google employee said that Google might update its database daily this year and that a new Google spider that understands JavaScript might be on the way


Read more: http://www.teiubesc-power.com/news/

[kwvarga]

cool. daily ;0

[corsair]

Feel free to post news!

[kwvarga]

what i think google needs to do is like randomly switch its user-agent to a browser one.. and see if sites are different.. most spammers just do something like if google isin referrer { spam code } that way regular people dont see it.. itd be a good way to get rid of alot of spammers..

[alpha3m]

good point Spear

Ive seen code similair to that. especially in ASP. a lot of companies have their programmers do that to increase their ranking.. ive also seen a lot of hidden layers containing a lot of keywords.. thats just lame if you ask me.

I prefer to do it the correct way.

[spidersam]

Good info. Thanks

[al2six]

spidering every day? if google deep crawls my sites everyday, my bandwidth will go through the roof!

[Avatar]

Originally Posted by theSpear

what i think google needs to do is like randomly switch its user-agent to a browser one.. and see if sites are different.. most spammers just do something like if google isin referrer { spam code } that way regular people dont see it.. itd be a good way to get rid of alot of spammers..

would that not just not penalize sites with dynamic content?

[I, Brian]

Originally Posted by corsair

In a search engine discussion forum, a Google employee said that Google might update its database daily this year and that a new Google spider that understands JavaScript might be on the way


Read more: http://www.teiubesc-power.com/news/

Google are almost there already on both counts.

[al2six]

Originally Posted by I, Brian

Google are almost there already on both counts.

google can understand some javascript? i wasn't aware. any specifics on what javascript google can read and what it can't?

[niceguyeddie]

Originally Posted by Avatar

would that not just not penalize sites with dynamic content?

Curious. What would dynamically driven sites have to do with the user agent?

[spidersam]

It seems like my stuff hasn't been updated in awhile considering all the talk of all the spidering they're doing. A few weeks ago I was moving almost every day, now it's been like 2 weeks since I've seen any placement changes.

[SVB]

Thats good that javascript will be spidered, because I had aot of javascript things that I cold uses for SEO reasons. And indexing every day, think of the competition between sites :-) Non stop action lol

[kwvarga]

Originally Posted by Avatar

would that not just not penalize sites with dynamic content?

well you would spider it.. then spider it again w/ a useragent.. not too much will change.. and if one has 5000 keywords and other has 100.. its kinda obvious.. i mean 1 or 2 could change.. but i imagine if i changed my useragent to google and went around to sites itd be all spam

[Johan007]

Originally Posted by alpha3m

Ive seen code similair to that. especially in ASP. a lot of companies have their programmers do that to increase their ranking.. ive also seen a lot of hidden layers containing a lot of keywords.. thats just lame if you ask me.

Oi I am an ASP man and don’t see how a server side language can be blamed for a client side trick.

[Johan007]

http://www.grub.org/ is a site that has a go at spidering the net on a daily basis but it will tell you its not easy cos it has not done it yet.

[samer]

thanks for the info !