do i need a new server? - GoFuckYourself.com

zentz · 02-18-2009, 01:11 PM

server load on my Dual Xeon 3.0/2G RAM/3x120 RAID 5 averages around 6-8, should i consider getting a new more powerful server?

fris · 02-18-2009, 01:12 PM

maybe tune mysql and apache?

running any cache programs like memcached?

who · 02-18-2009, 01:13 PM

What OS?

zentz · 02-18-2009, 01:15 PM

Debian 4.0

zentz · 02-18-2009, 01:21 PM

The server load is coming from the hotlinking -- there is quite a lot of it and apache is working hard to keep up with the repeated requests.

fris · 02-18-2009, 02:02 PM

only permit your domain from serving images, ignore everything else

Wiredoctor · 02-18-2009, 02:31 PM

It sounds like you need a better host. Throwing more hardware at a problem like this is what inexperienced hosts will do. You need to fix the hotlinkiing problem and tweak your server better. If your host can't fix this then they suck.

ArcherJanvier · 02-18-2009, 03:01 PM

Hi There Zentz,

A load average of 6-8 for esentially a four core server, is definitely overloaded.
Especially if it holds at that level consistantly. Performance will definitely suffer at that level.

You did not mention what OS you are using because that can make a huge difference - and in your options to deal with this.

Adding RAM is usually the quickest way to bring the load averages down.

But ideally, on a four core box, you want that load average at 2 or less.

I also strongly suggest that you explore what is called "null routing" to deal with hotlinkers/freeloaders (assuming you already have sufficient htaccess protection in effect).

Null routing is where you block ip addresses from your server by country of origin. This will elimate server load from countries that don't produce income.

It has become very very common practice, for example, for commercial porn sites to block literally all of mainland China.

You can get a current and constantly updated list of IP assignments by country from http://www.ipdeny.com.

Best regards,

Archer

aniloscash · 02-18-2009, 03:08 PM

are you on nationalnet?

zentz · 02-18-2009, 03:17 PM

Quote:

Originally Posted by Wiredoctor

It sounds like you need a better host. Throwing more hardware at a problem like this is what inexperienced hosts will do. You need to fix the hotlinkiing problem and tweak your server better. If your host can't fix this then they suck.

natnet is the host and the apache has been tweaked already, cant to much more there.

i use that server to host only scripts and html files and the images are hosted on a remote server, thats where the hotlinking is coming from. i am hotlinking to images hosted on a remote server, so any anti-hotlinking protection wouldnt make a big difference.

zentz · 02-18-2009, 03:19 PM

Quote:

Originally Posted by ArcherJanvier

Hi There Zentz,

A load average of 6-8 for esentially a four core server, is definitely overloaded.
Especially if it holds at that level consistantly. Performance will definitely suffer at that level.

You did not mention what OS you are using because that can make a huge difference - and in your options to deal with this.

Adding RAM is usually the quickest way to bring the load averages down.

But ideally, on a four core box, you want that load average at 2 or less.

I also strongly suggest that you explore what is called "null routing" to deal with hotlinkers/freeloaders (assuming you already have sufficient htaccess protection in effect).

Null routing is where you block ip addresses from your server by country of origin. This will elimate server load from countries that don't produce income.

It has become very very common practice, for example, for commercial porn sites to block literally all of mainland China.

You can get a current and constantly updated list of IP assignments by country from http://www.ipdeny.com.

Best regards,

Archer

its a dual xeon with debian 4 as OS.

As i mentioned above the ant-hotlinking wouldnt help cause i am the one hotlinking to a remote server actually

mpahlca · 02-18-2009, 03:37 PM

why not just cache all the images then pull from cache instead of mysql

Ad3pt · 02-18-2009, 03:37 PM

Check disk I/O you may just need to disable logging or add/change your RAID setup. Also put some more ram in it.

ArcherJanvier · 02-18-2009, 03:52 PM

Hi There Zentz,

Yeah, in that case I would definitely start by adding RAM.

I am not all that familiar with Debian and if it supports PAE (RAM addressing above 4GB).

But at very least it should handle 4GB (8GB would be better if supported).

RAM is relatively cheap these days and 2GB is way too little for a dual zeon box which is obviously under a heavy load.

With the added RAM, Apache can cache the most requested files and significantly improve the processor load (load averages).

Best regards,

Archer

TidalWave · 02-18-2009, 04:03 PM

Think about lighttpd instead of Apache if it works with your scripts

Wiredoctor · 02-18-2009, 06:48 PM

Quote:

Originally Posted by zentz

natnet is the host and the apache has been tweaked already, cant to much more there.

i use that server to host only scripts and html files and the images are hosted on a remote server, thats where the hotlinking is coming from. i am hotlinking to images hosted on a remote server, so any anti-hotlinking protection wouldnt make a big difference.

just because you host the main server at nat net means nothing, there are better techs out there. The problem also may have nothing to do with the main server and could be with the media server, in any case there are tons of sites that do way more bw and traffic than you and don't have this problem, so if your 2 hosts together cant fix it you are working with the wrong hosts.

02-18-2009, 01:11 PM	#1
zentz Confirmed User Industry Role: Join Date: Nov 2003 Posts: 8,053	do i need a new server? server load on my Dual Xeon 3.0/2G RAM/3x120 RAID 5 averages around 6-8, should i consider getting a new more powerful server? __________________ Programs that owe me money ---- Epassporte.com ~ $2700 \| Protraffic.com ~ $2600 \| XonDemand.com ~ $3000 Email: [email protected]

02-18-2009, 01:12 PM	#2
fris Too lazy to set a custom title Industry Role: Join Date: Aug 2002 Posts: 55,372	maybe tune mysql and apache? running any cache programs like memcached? __________________ Since 1999: 69 Adult Industry awards for Best Hosting Company and professional excellence. WP Stuff

02-18-2009, 01:15 PM	#4
zentz Confirmed User Industry Role: Join Date: Nov 2003 Posts: 8,053	Debian 4.0 __________________ Programs that owe me money ---- Epassporte.com ~ $2700 \| Protraffic.com ~ $2600 \| XonDemand.com ~ $3000 Email: [email protected]

02-18-2009, 01:21 PM	#5
zentz Confirmed User Industry Role: Join Date: Nov 2003 Posts: 8,053	The server load is coming from the hotlinking -- there is quite a lot of it and apache is working hard to keep up with the repeated requests. __________________ Programs that owe me money ---- Epassporte.com ~ $2700 \| Protraffic.com ~ $2600 \| XonDemand.com ~ $3000 Email: [email protected]

02-18-2009, 02:02 PM	#6
fris Too lazy to set a custom title Industry Role: Join Date: Aug 2002 Posts: 55,372	only permit your domain from serving images, ignore everything else __________________ Since 1999: 69 Adult Industry awards for Best Hosting Company and professional excellence. WP Stuff

02-18-2009, 01:13 PM	#3
who So Fucking Banned Join Date: Aug 2003 Location: ICQ #23642053 Posts: 19,593	What OS?

02-18-2009, 02:31 PM	#7
Wiredoctor Confirmed User Join Date: Dec 2001 Location: The Great USA Posts: 1,632	It sounds like you need a better host. Throwing more hardware at a problem like this is what inexperienced hosts will do. You need to fix the hotlinkiing problem and tweak your server better. If your host can't fix this then they suck.

02-18-2009, 03:01 PM	#8
ArcherJanvier Confirmed User Industry Role: Join Date: Sep 2005 Location: Las Vegas, NV Posts: 194	Hi There Zentz, A load average of 6-8 for esentially a four core server, is definitely overloaded. Especially if it holds at that level consistantly. Performance will definitely suffer at that level. You did not mention what OS you are using because that can make a huge difference - and in your options to deal with this. Adding RAM is usually the quickest way to bring the load averages down. But ideally, on a four core box, you want that load average at 2 or less. I also strongly suggest that you explore what is called "null routing" to deal with hotlinkers/freeloaders (assuming you already have sufficient htaccess protection in effect). Null routing is where you block ip addresses from your server by country of origin. This will elimate server load from countries that don't produce income. It has become very very common practice, for example, for commercial porn sites to block literally all of mainland China. You can get a current and constantly updated list of IP assignments by country from http://www.ipdeny.com. Best regards, Archer Last edited by ArcherJanvier; 02-18-2009 at 03:06 PM..

02-18-2009, 03:08 PM	#9
aniloscash Confirmed User Join Date: Oct 2008 Posts: 1,161	are you on nationalnet? __________________ Got Milf Traffic Contact Me ICQ 473236446 j (at)anilos (dot)com http://www.aniloscash.com

02-18-2009, 03:37 PM	#12
mpahlca Confirmed User Industry Role: Join Date: Feb 2004 Location: Vancouver Posts: 1,821	why not just cache all the images then pull from cache instead of mysql __________________ I could give two shits wether you read this sig or not.

02-18-2009, 03:37 PM	#13
Ad3pt Confirmed User Join Date: Aug 2002 Location: California Posts: 476	Check disk I/O you may just need to disable logging or add/change your RAID setup. Also put some more ram in it. __________________ Don't look here for the joke. It's in your pants. South O - World Class surfer destination since 2001.

02-18-2009, 03:52 PM	#14
ArcherJanvier Confirmed User Industry Role: Join Date: Sep 2005 Location: Las Vegas, NV Posts: 194	Hi There Zentz, Yeah, in that case I would definitely start by adding RAM. I am not all that familiar with Debian and if it supports PAE (RAM addressing above 4GB). But at very least it should handle 4GB (8GB would be better if supported). RAM is relatively cheap these days and 2GB is way too little for a dual zeon box which is obviously under a heavy load. With the added RAM, Apache can cache the most requested files and significantly improve the processor load (load averages). Best regards, Archer

02-18-2009, 04:03 PM	#15
TidalWave Confirmed User Industry Role: Join Date: Sep 2007 Location: Los Angeles Posts: 2,706	Think about lighttpd instead of Apache if it works with your scripts __________________ www.SwiftNode.com