Yahoo Conundrum - any thoughts on this one?

jay88 · 12-17-2004, 12:44 PM

I have a site that I have been creating new search engine optimized pages for regularly. I've added about 5 new SEO'd pages per week and have been doing it for a month. So I have 20 brand new SEO'd pages in total. The site had already been indexed by Google, but I have not been able to get these new pages indexed.

Here's the strange thing that I would love to hear some expert opinions on: The very last page I created last week IS THE ONLY ONE now indexed by Yahoo, which seemed to have happened yesterday. None of the other 19 pages that I created and posted before the 20th page are showing up in Yahoo. How can this be? I've never heard of Yahoo or any other search engine for that matter only indexing some pages but not others (assuming all pages are linked up properly, which mine are).

Any thoughts as to how or why this could be and how I can get the other 19 indexed.

jg_v7n · 12-17-2004, 12:54 PM

Make sure that all the new pages are linked from prominent places on your site. Make sure that they have spiderable URL's. Neither Yahoo or Google's spiders are flawless and so there is some inherent randomness to the crawling procedure. Are you sure that your robots.txt allows access to all your pages?

Other than that it is quite possible that they have spidered the new pages, and are simply not showing them. Depending on the age of your site your new pages may be sandboxed for some time (older, more established sites have new pages indexed quicker).

The bottom line is that if you have done everything correctly then it is simply a case of waiting. Your pages will appear in the end.

Dave Hawley · 12-17-2004, 06:20 PM

jay88, as a rule of thumb, the more incoming links (from other sites) you have the more often and deeper you get spidered. The higher your PR the more often and deeper you get spidered.

realestate · 12-20-2004, 04:54 PM

I once created a crap page but never promoted it. For what reason Y! respects it a lot.
it is not even indexed by G! anymore.
Unfortunately I forgot the password, and it links to my competitors in big bold letters.