Need hosting recommendations for very high traffic site

James Trotta · 01-15-2007, 03:52 PM

I currently use asmallorange but now they say none of their shared or dedicated hosting plans are big enough for me: It's eating a lot of bandwidth, but the concern we have is more the CPU time and memory usage. That affects others on the same server, so upgrading doesn't make it go away for them. And a VPS wouldn't be a viable option because we're talking about an extremely large amount of traffic to deal with.

Basically a few days ago I started getting 10-15 requests/second for favicon.ico on my Movable Type blog thanks to Yahoo. Asmallorange shut me down.

I enabled hotlink protection and got the sites back up. They still couldn't handle all the requests. The host says: "While the hotlink protection does stop some of the bandwidth usage, there is still some used when a request is made to the server for the various response headers sent back to the requesting client. Because of the sheer number of requests coming in, it builds up rather quick."

So who can handle a site that gets lots of requests?

**ToddW** · 01-15-2007, 09:53 PM

Just get a dedicated server from www.theplanet.com

My older model dual xeon was doing 100k+ FULL SIZE imags a day on only one of the many sites I ran/run on the server and it had tons of resources left.

The new Dual Core Xeons are AWESOME but pricey at around $400 a month but if you need resources it has them

James Trotta · 01-15-2007, 11:00 PM

I sent them a quote request. Do they manage the dedicated server? My big problem is I have no idea how to begin administering a server.

**ToddW** · 01-15-2007, 11:03 PM

Quote:

Originally Posted by James Trotta

I sent them a quote request. Do they manage the dedicated server? My big problem is I have no idea how to begin administering a server.

You can buy "managed" but it's PRICEY. Anyplace that manages is pricey.

fermiop · 01-16-2007, 12:27 AM

Or you can hire an admin him to manage your dedi.

Ahosting.biz · 01-18-2007, 02:17 AM

Quote:

Originally Posted by fermiop

Or you can hire an admin him to manage your dedi.

I think that better way - get maneged server.

gannik · 01-19-2007, 03:30 AM

Quote:

Originally Posted by Ahosting.biz

I think that better way - get maneged server.

Maybe you're right here but if the person is not experienced very well. What should he do then?

mwaraitch · 01-19-2007, 03:39 PM

Quote:

Originally Posted by James Trotta

I sent them a quote request. Do they manage the dedicated server? My big problem is I have no idea how to begin administering a server.

You can always have the server managed from a third party. It is not as expensive as is normally precieved.

CJ Jefferson · 01-20-2007, 09:06 AM

James, this isn't a problem I've come across before.

I don't think you shoold be looking for a new host.

It sounds like the problem is not one of your making. It seems unreasonable to that, because a Yahoo bot is out of control, you're going to have to pay quite a high financial penalty.

Have you tried contacting Yahoo directly to tell them what their bot is doing and the financial consequences for you? I'm sure they'd treat your enquiry sympathetically because what the bot is doing isn't in their interests either.

**ToddW** · 01-20-2007, 09:46 AM

Quote:

Originally Posted by CJ Jefferson

James, this isn't a problem I've come across before.

I don't think you shoold be looking for a new host.

It sounds like the problem is not one of your making. It seems unreasonable to that, because a Yahoo bot is out of control, you're going to have to pay quite a high financial penalty.

Have you tried contacting Yahoo directly to tell them what their bot is doing and the financial consequences for you? I'm sure they'd treat your enquiry sympathetically because what the bot is doing isn't in their interests either.

I hope you are joking.

Of course he can ban Yahoo, Google, etc from visiting/spydering his site but in the end he would loose.

MANY people have had to go from shared hosts to dedicated because googlebot pounded their 1000+ page site with their search spyders causing the load and bandwidth to go sky high!

CJ Jefferson · 01-20-2007, 10:21 AM

I did not say James should ban anything.

I said James should make Yahoo aware of the problem. Yahoo is not hammering his site for vast numbers of content pages, it is hammering his site for a favicon. Other sites may be suffering a similar fate and this is in nobody's interests.

James Trotta · 01-20-2007, 07:49 PM

I've sent numerous emails and help messages. I've also tried calling but haven't gotten a real person. I did get someone on SBC live support chat but they couldn't get anything done. Basically I gave up trying to reach Yahoo.

I think with hotlink protection, the 10-15 requests/second will be manageable for a good server. We'll see.

CJ Jefferson · 01-21-2007, 01:57 AM

Thanks James. I had an issue once with Adsense and spidering that had gone on for two or three weeks and I couldn't get resolved. I emailed the adsense blog team about it. (They invite feedback.) I can't be sure it worked but my Adsense contact came back to me very soon afterwards with a solution to my problem:

http://adsense.blogspot.com/

inside-adsense@google.com

If it's not an avenue you've been down yet, maybe the same thing would work with Yahoo Search? Their blog also invites feedback:

http://www.ysearchblog.com/

search-blog-admin@yahoo-inc.com

Best of luck.

while_hm · 01-23-2007, 08:14 AM

Quote:

Originally Posted by James Trotta

I sent them a quote request. Do they manage the dedicated server? My big problem is I have no idea how to begin administering a server.

if u don't have experience, i'll recomend you for the fist time look at vps servers.

imho, it'sthe best choice for you.

cheers