How to Get Indexed Regularly?

The American Voters · 05-09-2008, 05:14 PM

If I had to pick my weakest point, it would be SEO. I know it's important but it's not exactly defined. Nothing is proven guaranteed.

Obviously I want to make it favor google's algorithm to show up better there as most searches are done there.

Is there a way to make the bot visit daily or is that something google determines on it's own? For example, I posted a blog on the OMG site and within 20 minutes it was indexed already. Is it because the lack of numerous links and no deep crawling needed?

I have job postings that haven't been indexed yet and they've been up for days and it's a much higher traffic site. Is it because the depth of the links?

Anything I can do to make it indexed more regularly? Did I just happen to post my blog at the right time when google bot was on?

lajocar · 05-09-2008, 05:58 PM

You can use Google webmaster tools and set it there by a setting

crawl rate

aVia · 05-09-2008, 06:14 PM

I just check the crawl rate that you said.. I can only choose the normal rate..

The American Voters · 05-09-2008, 07:10 PM

I see normal as well. There's no way to set it in the meta tags? I thought I saw something that says when to re-visit or is that not recognized or just tells them the minimum time they should come back?

Also could you read first post and answer all questions? I'll send $10 paypal if you can take the time to help.

WebGeek182 · 05-09-2008, 08:23 PM

To those who mentioned Google webmaster tools - don't rely on that setting. To get crawled more frequently, create fresh content regularly and build incoming links.

The American Voters · 05-09-2008, 09:30 PM

Quote:

Originally Posted by WebGeek182

To those who mentioned Google webmaster tools - don't rely on that setting. To get crawled more frequently, create fresh content regularly and build incoming links.

My site has had about 10 new pages daily and the one that was indexed within 20 minutes only has one new page a week.

lajocar · 05-09-2008, 11:07 PM

Forum posts can be indexed within minutes in Google

Atl-FredRoe · 05-10-2008, 07:29 AM

What happens is that Google sets a "profile" for your site. You can TRAIN google to come by more often by posting new and original information on a regular basis. For instance I built a website for a client and we posted about 10 new "articles" a day for over a month. And google got trained to come to the site daily and was pretty much always on the site looking for new stuff.

The other way for Google to come by more often is build more links from highly spidered pages. For instance, if I were to put a few links from that first website to another website of mine, I could get google to visit that website more often as well.

So, if you want google to come by more often. Give it a reason to visit. Either lots of regularly updated and fresh content, or tons of incoming links.

HTH

jhen · 05-12-2008, 02:33 AM

Quote:

Originally Posted by lajocar

You can use Google webmaster tools and set it there by a setting

crawl rate

I agree to lajocar..you can use webmaster tools..

coolslko · 05-12-2008, 04:21 AM

By frequently updating or adding fresh content to your website and getting dood traffic from different sources.....having a blog on your site with regular adding fresh content also help googlebot to frequently crawl your site and als index it and also Submitting updated xml sitemap to google whenever you update or add a new content or webpage to google.....

harsha22 · 05-12-2008, 04:58 AM

Add a blog to your site & update it regularly. This will help index the sites easily. This is better than setting the crawl rates in webmaster tools.

pravir · 05-12-2008, 05:11 AM

Add unique content regularly, it provides fresh food to google bot and provoke it to come frequently. Setup a blog and connect your site from it, add regular content in your blog. Blog content is indexed much faster then individual websites. Update your sitemap.xml and submit regularly through webmaster tool account.

Cheers

Bonnie24 · 05-12-2008, 06:32 AM

add new content once in a week, it can be news or some updates, google will index any changes at once.

timefactor · 05-12-2008, 08:47 AM

I've launched an Audio Video forum a month ago, and thru' google webmaster, set the crawl rate as FAST. I can see google bot is following the fresh content instantly, but majority is not showing in google search! I'm sure majority of the posting are fresh content.

francis84 · 05-12-2008, 09:04 AM

For SE spider to crawl or visit your blog / site more frequently, you must update your content frenquently too.

redz · 05-12-2008, 05:06 PM

simple meta tags,headers, and fresh content will get you indexed regularly, if that does not help, just use as suggested above and use the crawl feature of the google webmaster tools.

Atl-FredRoe · 05-12-2008, 05:24 PM

Quote:

Originally Posted by timefactor

I've launched an Audio Video forum a month ago, and thru' google webmaster, set the crawl rate as FAST. I can see google bot is following the fresh content instantly, but majority is not showing in google search! I'm sure majority of the posting are fresh content.

It's not enough to just have a ton of fresh content. If you don't have incoming links, chances are you won't end up getting most of your content indexed(or rather showing up in googles index). Get your incoming link count up, and then think really heavily about your internal linking structure, as that can help to get more of your site indexed, although I don't think you can do much with a forum setup.

HTH