Forum Crawling?

spidersam · 03-23-2004, 09:30 PM

Is there anything special you have to do to make sure a forum is crawled? I made a forum over a week ago, and only the main page is cached so far.

greg · 03-23-2004, 09:48 PM

some forum sofwares are not bot friendly. You can usually find a hack that will help all your pages get crawled.

Also depending on the number of inbound links some bots will only crawl so far. Googlebot is an example of this, they have a tendancy to not go very deep for non-popular websites, just saves on their processing time.

I, Brian · 03-24-2004, 11:58 AM

Patience is required - it may take Google a few weeks to spider any new forum.

You also really ought to install the session Id hack for phpbb's to be spidered. I've heard claims that 2.0.4+ should be spidered automatically, but I'm not convinced that is the case.

spidersam · 03-24-2004, 12:35 PM

I'm running 2.0.6......Where can I get that hack Brian?

cray · 03-24-2004, 03:33 PM

Here ya go http://www.phpbbhacks.com/viewhack.php?id=2040

spidersam · 03-24-2004, 03:44 PM

Thanks!

Who knows what this part does? "also includes many other changes that will help increase your search engine rankings by reducing pagerank drain and greatly improving keyword relevancy. "

I, Brian · 03-25-2004, 02:44 AM

That's actually a different hack...but it includes the session IDs hack.

world4health · 03-25-2004, 06:38 AM

You need to remove the session cookies for spiders, this thread should solve the problem, it did for me: http://www.internet-marketing-resear...topic4774.html

spidersam · 03-25-2004, 08:28 AM

Thanks guys. I think I've got it set.

spidersam · 03-29-2004, 09:12 AM

Quote:

Originally Posted by world4health

You need to remove the session cookies for spiders, this thread should solve the problem, it did for me: http://www.internet-marketing-resear...topic4774.html

world4health,

After you installed, how long was it before you found forum pages in Google's cache?

spidersam · 04-05-2004, 12:58 PM

It's finally indexed!! Muhahaha!!

thebassman · 04-07-2004, 11:09 PM

I've got the above SEO and Session ID mods installed, and my forum is sort of being indexed... however, when I take a look at the googlebot visits to my site, it still shows session IDs and the URL. Can someone explain this to me/help me?

thebassman · 04-08-2004, 12:30 PM

Oh, and also, I have the ezportal installed... is there a way to remove session ids from there? I think that must be causing the problem...

spidersam · 04-08-2004, 12:39 PM

bassman,

i don't know anything about forums, but i installed this guys hack from the second reply to the following post link, and it worked like a charm....as evidence, you have a backlink from my newly anointed PR5 forum, www.lordsrendezvous.com/forums/ from that link competition......it was a 0, it's now a 5....i'm happy with how it worked

http://www.able2know.com/forums/about15132-0.html

thebassman · 04-08-2004, 12:51 PM

I'll give it a read-through... thanks.

GoldDust · 04-09-2004, 02:36 PM

Quote:

Originally Posted by thebassman

I've got the above SEO and Session ID mods installed, and my forum is sort of being indexed... however, when I take a look at the googlebot visits to my site, it still shows session IDs and the URL. Can someone explain this to me/help me?

TheBassman, I have same info showing up oon my last vist states & session id's showing up when i access certian pages on my forum -

AlthoughI have the hack installed!

did you find out what the prob was?

thebassman · 04-09-2004, 03:30 PM

No, haven't figured it out, but it seems google has managed to crawl to threads, though, so I don't think I'm going to worry about it...