How to index all pages fast?

davelev · Share | #1 (**permalink**) 02-24-2011, 12:37 PM

Hello,

i have built some sites 4-5 years ago and most of their pages don't show up in Google's cache, they have no PR at all, even though just 1-2 clicks from the main page and event though I struggled to get deep links to them and I even bought major search engine listings, e.g. BOTW, Yahoo Directory...

How can I make the search engine at least SEE all my pages (even if not rank them high at first...)?

Years pass and no results...

How can I increase the Google Page Rank of my pages that are 1-2 click from main page and cannot get any PR... even after 4-5 years?

backlinkexcellence · #2 (**permalink**) 02-24-2011, 12:46 PM

How many links did you build to these inner pages? Where the majority of them nofollow or on noindex pages? Dupe content within your site? Did the links you built have a high PR as well?

Publish content more frequently and the spiders will come. Also make it easy for them to find all your pages by supplying spiders with a proper robots.txt and sitemap.xml and use a good linking structure.

davelev · #3 (**permalink**) 02-24-2011, 12:55 PM

I have several hundred inbound links to various pages. But most of them are low PR, some quite high PR, through... I guess most of them are COMMENTS on blogs...

No duplicate content, but the site is a large directory with many internal links that might make it look like a linkfarm... Prolly that is a problem...

I have no settings of nofollow or noindex... I never use such...

Where do you think I should publish content?

I don't use robots.txt and sitemap.xml at all either. Robots.txt is not so important I guess, but what can you tell me about the sitemap.xml and other things that I wrote about here?

backlinkexcellence · #4 (**permalink**) 02-24-2011, 01:07 PM

Especially if a site is a big directory you want to use a sitemap.xml. Google for tutorials on how to set one up, it should be pretty easy to do. Linking to your inner pages is fine, I don't think you look like a link farm.

Regarding nofollow/noindex, I was asking if the links you built were on pages that had these settings. When you build backlinks, you obviously want to get them from other domains than just your own AND possibly with a high PR and "dofollow". Nofollow links don't transfer the PR, no matter how high it is.

usrecord · #5 (**permalink**) 02-24-2011, 02:15 PM

The best way to get all your pages indexed is to create a sitemap and submit it to google, yahoo and in bing. don't forget also to ping your blog/site if you made any changes on it.

patpat · #6 (**permalink**) 02-24-2011, 06:33 PM

PR is not the point,and have you do seo work better?i think you can check your website deeply for reason

Amit Shrivastava · #7 (**permalink**) 02-28-2011, 10:07 PM

There is way through that you can do..
off page strategy

1. Use the sitemap.xml file.
2. Do proper link building of the home page and then first deep link and then the second deep link on high PR sites.
3.Do social bookmarking of the sites on the following sites like(Digg, Delicious, mixx, stumbleupon etc.)

on page strategy

1. Must change the content, it should be unique.
2.page should not be inactive.

that was some strategy try to follow it.

synapsis · #8 (**permalink**) 02-28-2011, 10:54 PM

I've also been told that pinging your articles is a good way to get search engines to notice them. While I am not a pinging kind of guy, some people swear by it. I have never had to ping a single article in my whole life.

You may want to however come up with an internal linking strategy for your sites, and by doing so it will cause Google to see that your site is strong internally. This will mean Google will easily crawl your site, and any new stuff you put up and in will be easily found.

Dreamrage · #9 (**permalink**) 03-01-2011, 01:17 AM

Quote:

Originally Posted by davelev

Hello,

i have built some sites 4-5 years ago and most of their pages don't show up in Google's cache, they have no PR at all, even though just 1-2 clicks from the main page and event though I struggled to get deep links to them and I even bought major search engine listings, e.g. BOTW, Yahoo Directory...

How can I make the search engine at least SEE all my pages (even if not rank them high at first...)?

Years pass and no results...

How can I increase the Google Page Rank of my pages that are 1-2 click from main page and cannot get any PR... even after 4-5 years?

Hi there. Is there any way I can see the site / sites? If those sites have been around for 4 - 5 years they are well aged and good to be had. Problem is, I don't think it's your backlinks to these sites. What on page optimization have you done?

Let me explain. You can submit url's to the big three (Yahoo, Google and Bing), but the truth is this doesn't always help. There isn't a 100% guarantee that sites will automatically be indexed after submission. It is said ( well from what I have been studying through web ceo) that it is often better for a bot to find a site through backlinks than submission, and often works faster as well, but if you haven't optimized the pages, then bots won't crawl.
A few on page areas you could have a look at are meta details, page titles, alt image tags and even meta keywords.

Try to make sure that these are optimized with your niche keywords. Also, it is true that your content should be unique, and regularly updated, and these you can create adding your keywords in as well.

An internal linking system is a good idea, where you have one page linking to others, and sitemaps are relatively important as well. I do believe that the robots.txt is important. Bots use this to tell whether they can or cannot crawl a page. If the robots.txt is missing, it could have an impact on the site.

There are tons more tips and tricks here online. Look to the SEO tip of the day, (I think its here in this section..), make a cup of coffee, grab a notebook and have a good read through.

Good luck. I hope it all works out for you.

seosaroj · #10 (**permalink**) 03-01-2011, 02:09 AM

Keep updating your content on very regular basis,update your sitemap once in a month.

jamesfreak · #11 (**permalink**) 03-01-2011, 02:24 AM

Add your site to Google Webmaster Tools and then submit your site's sitemap.xml.
If you have not any sitemap.xml then you create it online.
Several tools are available for that..

lawrencia · #12 (**permalink**) 03-01-2011, 03:08 AM

Please check your robots.txt and other common settings.

This kind of thing happened to me in past and it was default robots.txt that was blocking it

Thanks.

synapsis · #13 (**permalink**) 03-01-2011, 08:57 AM

Quote:

Originally Posted by seosaroj

Keep updating your content on very regular basis,update your sitemap once in a month.

Your sitemap should be updated every time you make a change, not once a month. Also depending on your CMS, you should make sure that its automatically done, so you don't have to worry about it. In this days time and age you should never have to worry about updating a sitemap whatsoever. Maybe back in 1994.

As for updating your content regularly, you don't want to over do it - what you want to do is make your updates regularly; meaning, if you update once a week, keep doing it once a week. Google will get used to it and come back every x amount of days.

alaminaffiliate · #14 (**permalink**) 03-01-2011, 09:03 AM

Submit you site to top search engine and try to build some backlinks

mo-sparrow · #15 (**permalink**) 03-01-2011, 09:23 AM

Build backlinks by submitting to quality directories and article directories, do some blog commenting (not high SEO value but does help indexing, even from nofollow) , get social media links , submit a Google sitemap and getting links from Twitter can also help indexing sometimes.

mimo91 · #16 (**permalink**) 03-01-2011, 09:48 AM

you can boost the indexing of your site by :
1-creating sitemap .xml and submit it to google webmaster
2-creating backlink with high page rank sites
3-try to make your content unique
hope this help

superyachtnsw · #17 (**permalink**) 03-02-2011, 11:17 PM

Getting fly in the SE, try to make optimize your all pages with the meta tag, title than create sitemap.xml and robots.txt for your site, after created sitemap.xml and robots.txt, submit into the webmasters..
after the all process completed than doing off page to your website with doing directory submission with the unique IP, Social bookmarking, forum posting with the dofollow attribute.... your website will be indexed soon in the major SE..

rajni12 · #18 (**permalink**) 03-03-2011, 01:24 AM

These are the steps to index all pages by search engine fast

1. Write unique content for your site.
2. Make the interlink strong in both navigation part and body content.
3. Create a xml sitemap and add in webmaster tool.
4. If you can create static html sitemap for the site, it would be also more benifit to be crawled all pages.

marknel · #19 (**permalink**) 03-03-2011, 07:22 AM

If the onpage part is fine then you can link the site to a blog as Google prefers fresh content over everything.

Alfred Schelster · #20 (**permalink**) 03-03-2011, 07:31 AM

One of the fastest way to index your links are pinging it everyday. It was proven and tested. Promise...