Log in

View Full Version : Server Load Through the Roof


Jason Dunn
10-25-2004, 05:31 PM
Our sites are being slammed by heavy traffic right now, and we're trying to figure out where it's all coming from. Our apologies for the sluggish server response, or if you can't get to the site at all. Even though we have a fairly robust server, it's not enough to handle the load we're getting hit with. For those of you that know anything about Linux servers, this morning we had a load of 229, which is the highest I've ever seen on this box. So, anyone know where we're getting the traffic from? Did you come here from a high-profile link?

Beowulf
10-25-2004, 05:36 PM
I was going to say something earlier to you guys, but I noticed the google spider; specifically the google news spider has massively hiked your rating.

/shurg

these are good problems :)

aristoBrat
10-25-2004, 05:59 PM
Ya'll do have something like AWStats that goes thru the logs and shows were people are being referred from, right? :)

Jason Dunn
10-25-2004, 09:30 PM
I was going to say something earlier to you guys, but I noticed the google spider; specifically the google news spider has massively hiked your rating.

Spiked our rating? What do you mean? We've had a lot of trouble with Google News' bot in the past, to the point where we've had to block quite a few of their IPs...

Jason Dunn
10-25-2004, 09:32 PM
Ya'll do have something like AWStats that goes thru the logs and shows were people are being referred from, right? :)

Yup, but I won't be able to run the logs until tomorrow morning...until then, it's a mystery.

Beowulf
10-25-2004, 09:50 PM
Basically google news has cached all your articles and given them good placement through news.google.com for various searches.

Mike Temporale
10-25-2004, 10:33 PM
Server Load Through the Roof

Looks like it's time to raise the roof. :wink: :lol:

piperzoccofirenzen
10-26-2004, 12:05 AM
I'll (almost) wager REAL and significant money, that it is due to something no server / traffic management sw will track. Sure you'll see some trends... but those will merely be indicators or... "symptoms" of something underneath and behind or essentially "driving" the spike. Unless it is mere coincidence and some of us don't believe there ever really has been such a thing as one of those. (whether or not you get into quantum mechanics OR fate OR providence OR...).

And my wager of what that spike was driven by is, Palm's announcement of their upcoming Treo650. It arrived in my email (server EST time) at approx 11am. So depending on how large Palm's DB is, given they email ALL their past and current customers and more... the Internet itself probably slows notice-ably upon such blasts. Meaning some emails may not arrive for literally hours including spam-and-virus filter processing time w/in many servers, the usual bouncing MOST-inefficiently seemingly around the globe sometimes and all the other usual Internet "traffic patterns" since so few of us are YET on *Real Private* Networks, etc.

Naturally the contributing factors all across the Net may have been that virtually all other sites besides the well-know portal "brands" that came up in Google when I (and obviously others) looked up Smartphone reviews, were QUITE evidently "old" with minimal obvious third party validation as to accuracy, thoroughness and more. (Happily you guys have a bit of an early mover advantage in your segment "below" the known portal brands, who are covering Smart Phone and come up in searches including reviews. Oh and have clearly done a nice job so far leveraging that early mover advantage). Like a few banner ads from industry conferences pertinent to the segment of the given portal, clear lack of reviews of recent product releases ALREADY reviewed by competitor portals, etc. Or dates of posted articles. Took me about 3 minutes flat to weed out the chaf in my google-plus-my-own-pattern-recognition tendencies from having launched so many Internet plays and more over the years. Meaning I found you guys and your posting from early this a.m. regarding this traffic spike that I surfed in upon the wave of, which impressed me in tandem with the other indicators that your site warranted further investigation... and for what this is worth; I haven't signed up to ANY posting facility in years because I simply don't have the time just now - despite fingers flying fast enough on keyboards to generally keep only slightly ahead of my brain. :) So second kudos to you guys! IE: Keep up the Good Work! Careful or someone will buy you soon!

kagayaki1
10-26-2004, 12:52 AM
Took me about 3 minutes flat to weed out the chaf in my google-plus-my-own-pattern-recognition tendencies from having launched so many Internet plays and more over the years.

It took me way more than 3 minutes to read your post. I almost skipped over it as a huge block of posting nothingness, but later reversed because I had to see what someone would write after taking the time to register and make their first post so long for.

Thank you for contributing. Next time, you might try condensing it to something more simple, like "it might be due to the Treo 650 release today." Besides, I'm sure that news isn't very comforting (nor very meaningful) to a site dedicated to MS SmartPhones - news that has deals with a Palm device, with a carrier (Sprint) that doesn't even have a MS Smartphone. :roll:

aristoBrat
10-26-2004, 03:00 AM
Sprint should have their version of the Samsung i600, whatever model number that may be. I remember them releasing it a few months ago.

kagayaki1
10-26-2004, 07:50 AM
Took me about 3 minutes flat to weed out the chaf in my google-plus-my-own-pattern-recognition tendencies from having launched so many Internet plays and more over the years.

It took me way more than 3 minutes to read your post. I almost skipped over it as a huge block of posting nothingness, but later reversed because I had to see what someone would write after taking the time to register and make their first post so long for.

Thank you for contributing. Next time, you might try condensing it to something more simple, like "it might be due to the Treo 650 release today." Besides, I'm sure that news isn't very comforting (nor very meaningful) to a site dedicated to MS SmartPhones - news that has deals with a Palm device, with a carrier (Sprint) that doesn't even have a MS Smartphone. :roll:

Edit: You're right aristoBrat, thanks. Got wrapped up in the moment.