How often does Google crawls your website?

Nikhil · 12-20-2007, 09:14 AM

Folks I am interested in knowing like how often Google bot crawls your site......in the month of December my site was crawled on 1st then it was on 19th.....its evident that my site is not crawled so often.What are the factors does this depend on?

And can you also share how often is your site crawled...

1.Daily
2.Thrice a Week
3.Twice a Week
4.Once a Week
5.Once in two weeks
6.once in a month.

Thanks for your response in advance.

Nikhil

Cars-blog · 12-20-2007, 09:21 AM

My homepage gets crawled once or twice a week but the deeper pages get crawled less often.

StarLab · 12-20-2007, 09:24 AM

Several times per day it seems.

You got me curious, so I checked my Webalizer stats... GoogleBot has made 510 hits so far in December. (my site is just 1 month old)

Submit your site to Google (not actually required to get listed) and install a Google Site Map. Not sure if this is responsible for the frequency or not, but it can't hurt.

I'm sure others will have some tips for you.

Nikhil · 12-20-2007, 09:26 AM

Quote:

Originally Posted by StarLab

Several times per day it seems.

You got me curious, so I checked my Webalizer stats... GoogleBot has made 510 hits so far in December. (my site is just 1 month old)

Submit your site to Google (not actually required to get listed) and install a Google Site Map. Not sure if this is responsible for the frequency or not, but it can't hurt.

I'm sure others will have some tips for you.

510 hits a month...thats making me crazy

x3mario · 12-20-2007, 10:06 AM

Quote:

510 hits a month...

It seems that spiders frequently crawled your site...good figure huh...

StarLab · 12-20-2007, 11:18 AM

That's just so far this month... still 11 days to go...

littlea · 12-20-2007, 11:41 AM

Once or twice a week for me according to my stats.

StarLab · 12-20-2007, 01:20 PM

Another thought... Do you update your content frequently? The bots might be more apt to return more often if it sees constant updates...

Natural Elements · 12-20-2007, 05:11 PM

Several times per day, 912 hits last month seems like the google bot like my site, I don't know how long...

Nikhil · 12-20-2007, 05:49 PM

Quote:

Originally Posted by StarLab

Another thought... Do you update your content frequently? The bots might be more apt to return more often if it sees constant updates...

About once a week.....

Nikhil · 12-20-2007, 05:51 PM

Quote:

Originally Posted by Natural Elements

Several times per day, 912 hits last month seems like the google bot like my site, I don't know how long...

912......freaks - what is the traffic that your site gets in a day ( avg ) ?

Natural Elements · 12-20-2007, 06:12 PM

This is different every day

VirtualHoney · 12-20-2007, 10:35 PM

My website gets crawled about once a week, I think. I have done SEO on it and that seems to help with getting crawled.

phkharat · 12-20-2007, 10:57 PM

The more you update ur site with relevent content, the more will google sends crawl to ur site.

Confused: :-) I mean... your frequent updates will let google put your site in frequent crawling. Making relevent changes once in three or four days is a fair option. But google usually sends crawl once in a week but if it puts ur site into frequent crawl then there may be chances where it could crawl once in 3 days.

WEBcouk · 12-21-2007, 03:18 AM

Hi Nikhil

You will need a lot more content on your site and focus on keywords. The mention will not help Googlebot or any other spider crawl your site but when it does crawl it will help it to come back or rank it as valuable. Otherwise, your site may become buried beneath all the other sites on the web.

There is no solid way to make Google index your site, but there are ways that you can try which will help Google find you and index your site. You can try getting links on sites which have a high (5 or above) page rank, because it is obvious Google crawl these sites often and that way you can be found easier. Submit your site to Google index, DMOZ, Yahoo, MSN, and other search engines, including niche directories in your industry. Make sure you have properly constructed your META-Tags (which it looks like you have. You may want to change the 'title' 'description' and 'keywords' for each page or if not completely change then rearrange them, so that SE's will not see them as duplicate pages and skip indexing them Set-up a proper robots.txt file. Make sure you have a good weblog analyzer to track spiders to your site.

Merry Xmas from,

Darren at WEBcouk.co.uk - Website Design with Passion :-)

Nikhil · 12-21-2007, 03:55 AM

Quote:

Originally Posted by WEBcouk

Hi Nikhil

You will need a lot more content on your site and focus on keywords. The mention will not help Googlebot or any other spider crawl your site but when it does crawl it will help it to come back or rank it as valuable. Otherwise, your site may become buried beneath all the other sites on the web.

There is no solid way to make Google index your site, but there are ways that you can try which will help Google find you and index your site. You can try getting links on sites which have a high (5 or above) page rank, because it is obvious Google crawl these sites often and that way you can be found easier. Submit your site to Google index, DMOZ, Yahoo, MSN, and other search engines, including niche directories in your industry. Make sure you have properly constructed your META-Tags (which it looks like you have. You may want to change the 'title' 'description' and 'keywords' for each page or if not completely change then rearrange them, so that SE's will not see them as duplicate pages and skip indexing them Set-up a proper robots.txt file. Make sure you have a good weblog analyzer to track spiders to your site.

Merry Xmas from,

Darren at WEBcouk.co.uk - Website Design with Passion :-)

Thanks a TON WEBcouk.......great piece of info.

vishald · 12-22-2007, 12:59 AM

Hi Nikhil,

My site get crawled once in two weeks.. have u know whats basic condition for crawling inner pages??

onslaught82 · 12-24-2007, 02:48 PM

I started 2 blogs 1 week ago and googlebot has visited both sites twice. I just submitted sitemaps for those sites today.

Comenius · 12-28-2007, 07:36 PM

My site with regular fresh content gets crawled daily. My other site which is more less static gets crawled far less frequently.

saj · 01-02-2008, 12:51 AM

Quote:

Originally Posted by Nikhil

Folks I am interested in knowing like how often Google bot crawls your site......in the month of December my site was crawled on 1st then it was on 19th.....its evident that my site is not crawled so often.What are the factors does this depend on?

And can you also share how often is your site crawled...

1.Daily
2.Thrice a Week
3.Twice a Week
4.Once a Week
5.Once in two weeks
6.once in a month.

Thanks for your response in advance.

Nikhil

my website gets crawled thrice or Twice a Week.