HELP, my servers can't handle the loads! - GoFuckYourself.com

debbieN · 03-03-2005, 03:02 PM

I just purchased my fifth server from EV1.net and it is slower than ever.

I have 300 clients downloading from one of my main site through this server (only one site on this server) Intel Dual Xeon 2.4 Server with 2000gb transfer.

How can I optimize this to handle 600 or more at one time?

Is there a managment company that can do this for me?

help, I'm losing sales.

skillfull · 03-03-2005, 03:03 PM

redirect all your traffic to my sites
it will solve the problem ;)

The Heron · 03-03-2005, 03:04 PM

Might try getting a MANAGED host instead of ev1

Sly · 03-03-2005, 03:05 PM

There are a few management companies that could help you, or you could hire a tech to fix your problem. Talk to JFPDude, he may be able to help you out.

Tony Montana · 03-03-2005, 03:05 PM

What OS do you run?

I could help ya for a price

shuki · 03-03-2005, 03:10 PM

I would suggest JFPDude too. Might want to switch hosts too but that is your choice.

debbieN · 03-03-2005, 03:21 PM

OS - Linux Ensim Pro for Red Hat Enterprise

I only upload twice per day to my three servers that handle my TGP gallery posts. This is the only thing these servers do, gallery submissions.

300 users on one server seem small, but I don't know much about this subject.

all I know is how to get traffic.

Tony Montana · 03-03-2005, 03:26 PM

Quote:

Originally Posted by debbieN

OS - Linux Ensim Pro for Red Hat Enterprise

I only upload twice per day to my three servers that handle my TGP gallery posts. This is the only thing these servers do, gallery submissions.

300 users on one server seem small, but I don't know much about this subject.

all I know is how to get traffic.

What type of connection are your servers on? The problem would not be the server load but connection load if they are just gallery pages..

Could you define users. Are they clients that use some sort of submit script through your site/server?

TurboAngel · 03-03-2005, 03:31 PM

Here's a bump.

CheeseFrog · 03-03-2005, 03:35 PM

Kill your KeepAlives maybe? I know those slowed my server down a lot.

fris · 03-03-2005, 03:38 PM

Quote:

Originally Posted by debbieN

OS - Linux Ensim Pro for Red Hat Enterprise

I only upload twice per day to my three servers that handle my TGP gallery posts. This is the only thing these servers do, gallery submissions.

300 users on one server seem small, but I don't know much about this subject.

all I know is how to get traffic.

gallery submissions are causing this load average?

hah.

you need to learn how to tweak apache.

debbieN · 03-03-2005, 03:40 PM

what company can twik my apche?

wvuatl · 03-03-2005, 03:43 PM

You have to change your Apache HARD_SERVER_LIMIT and update httpd.conf to handle more requests.... hire a Linux System Admin

debbieN · 03-03-2005, 03:45 PM

Fris - I get a lot of hits. 205,720,166 today so far. Sessions is what I have to deal with 18,057 today so far.

kibooh · 03-03-2005, 03:48 PM

Quote:

Originally Posted by fris

you need to learn how to tweak apache.

what he said.

or maybe you should hire someone to do it for you .

skillfull · 03-03-2005, 03:48 PM

18k sessions isnt suppose to cause load on 1 servers if you tweak it correctly...

latinasojourn · 03-03-2005, 03:58 PM

i had similar issues and juicy links referred me to JFPdude and he fixed.

note: these were servers setup by webair, and as others have stated you need your apache custom tuned for load.

JFPdude · 03-03-2005, 03:59 PM

Thanks for the props guys ...

If this is still an issue hit me up on ICQ 4433144

borked · 03-03-2005, 04:16 PM

Quote:

Originally Posted by debbieN

what company can twik my apche?

debbieN - send me your apache config file and I'll add some the tweaks that should help. No cost - they're basic, and will see if it is the problem or at least pinpoint where the problem is.

icq me 283914791

debbieN · 03-03-2005, 04:34 PM

thanks borked but I just spoke with the master - JFPdude

again thanks GFY for the correct information.

flashfire · 03-03-2005, 04:36 PM

your gonna blow your load

LasseKongos · 03-03-2005, 04:36 PM

"my servers can't handle the loads!"

Then help the servers, just swallow!

s9ann0 · 03-03-2005, 04:40 PM

I would turn off keepalive or at least turn the timeout down to 1
strip out all modules you don't need to get the httpd process size down then
rebuild with hard_server_limit 1024 and up maxclients to fit the RAM so it doesn't swap

PbG · 03-03-2005, 10:53 PM

You reallly should consider fully managed hosting ...

Quote:

Originally Posted by debbieN

OS - Linux Ensim Pro for Red Hat Enterprise

I only upload twice per day to my three servers that handle my TGP gallery posts. This is the only thing these servers do, gallery submissions.

300 users on one server seem small, but I don't know much about this subject.

all I know is how to get traffic.

tungsten · 03-03-2005, 10:56 PM

hire a sys admin to look after your server(s)

venus · 03-03-2005, 11:01 PM

whats th eURL to one of your galleries, your problem may be something else

Quote:

Originally Posted by debbieN

Fris - I get a lot of hits. 205,720,166 today so far. Sessions is what I have to deal with 18,057 today so far.

Pornwolf · 03-03-2005, 11:23 PM

You shouldn't have problems with just 300 clients. Call Webair mike. See sig.

SplitInfinity · 03-04-2005, 01:08 AM

For apaches... pre 2.0...

Apache Performance Boost
By: Chris Jester ( [email protected] )

If you are experincing long delays while "Waiting for reply...." with Apache servers you may try the following hack I use frequently to speed up your systems performance. Apache comes with a limit of 256 Child Processes defined in its hard server limit (in the source code). This can kill apache when it is used for a very very busy site.

Normally in the httpd.conf file you can only set a maximum of 256 MaxClients. This is not enough for a busy site. To change this limit (which the makers of apache suggest as well), edit src/includes/httpd.h and change the value of HARD_SERVER_LIMIT. Bump it up to 1024, then set your httpd.conf files MaxClients to like 512. That should be ample. Re-compile apache and you are done.

Note: Linux itself has a "Max Processes" per user limit. Add this to your root .bashrc file:

ulimit -u unlimited

You must exit and re-login before starting your new apache! Otherwise you will run into problems. To verify that you are ready to go, make sure that when you type ulimit -a as root, it shows "unlimited" next to max user processes.

(note: you may also do ulimit -u unlimited at the command prompt before starting httpd instead of adding it to the .bashrc file, but I always forgot, so I just added it in the .bashrc file as a safety net.. Another good place to put ulimit -u unlimited is in the httpd startup file in /etc/rc.d/init.d)

SplitInfinity · 03-04-2005, 01:15 AM

Here is how you can find out if this might be the problem:

On the command line, type: ps -aux|grep httpd|wc -l

It will return a number. If this number is about 300ish or close, but not above,
then its most likely the problem I solve above.

For Apache 2.0, its EASY as pie to fix:

Set these like this:

Timeout 60
KeepAlive On (Set this to off if your site is only doing CGI redirection, but on in most all other cases)
MaxKeepAliveRequests 0
KeepAliveTimeout 20
ServerLimit 1000

<IfModule prefork.c>
StartServers 100
MinSpareServers 5
MaxSpareServers 30
MaxClients 1000
MaxRequestsPerChild 0
</IfModule>

Note, this is all dependant on RAM and PROCESSOR
so if your notice your ram is all eaten up, reduce MaxClients to like 700

(if you didnt know, this is in the file /etc/httpd/conf/httpd.conf)

Edit that file, then do this:
service httpd restart

d00t · 03-04-2005, 01:19 AM

some good free advice from splitinfinity ;)

SplitInfinity · 03-04-2005, 01:37 AM

Suggestion to all: Dont use .htaccess files.
Instead, use the httpd.conf file.
Reason? Performance impact.
Every file that is served by apache is in a directory tree....
And the server needs to check EVERY DIRECTORY along the file
path for an .htaccess file, just to make sure theres none there
and/or of there IS one there...

So think of it like this....
You have something.gif and someone is loading it right now...
Apache says, oh ok....
Lets see... the file is in /home/one/two/three/four/five
Then it says...
is there and .htaccess file in /home?
is there and .htaccess file in /one?
is there and .htaccess file in /two?
is there and .htaccess file in /three?
is there and .htaccess file in /four?
is there and .htaccess file in /five?

Imagine the disk load and etc if you have like 50 thumbnails on your page?

Food for thought GFY'ers
:-)

Weppel · 03-04-2005, 02:44 AM

Quote:

Originally Posted by SplitInfinity

Suggestion to all: Dont use .htaccess files.
Instead, use the httpd.conf file.
Reason? Performance impact.
Every file that is served by apache is in a directory tree....
And the server needs to check EVERY DIRECTORY along the file
path for an .htaccess file, just to make sure theres none there
and/or of there IS one there...

So think of it like this....
You have something.gif and someone is loading it right now...
Apache says, oh ok....
Lets see... the file is in /home/one/two/three/four/five
Then it says...
is there and .htaccess file in /home?
is there and .htaccess file in /one?
is there and .htaccess file in /two?
is there and .htaccess file in /three?
is there and .htaccess file in /four?
is there and .htaccess file in /five?

Imagine the disk load and etc if you have like 50 thumbnails on your page?

Food for thought GFY'ers
:-)

How would you for example prevent hotlinking in the httpd.conf file?

SplitInfinity · 03-04-2005, 02:48 AM

The same way you do it in an .htaccess file, but you put it in the Virtualhost directives in your httpd.conf instead and delete your .htaccess file.
:-)

SplitInfinity · 03-04-2005, 02:49 AM

By doing it that way, apache only has to load them once.... not per hit

03-03-2005, 03:02 PM	#1
debbieN Confirmed User Join Date: Jan 2003 Location: FL, NC(I burned this down), MI Posts: 1,193	HELP, my servers can't handle the loads! I just purchased my fifth server from EV1.net and it is slower than ever. I have 300 clients downloading from one of my main site through this server (only one site on this server) Intel Dual Xeon 2.4 Server with 2000gb transfer. How can I optimize this to handle 600 or more at one time? Is there a managment company that can do this for me? help, I'm losing sales. __________________ don't rent the top room at the Luxor ______________________ Debbie Nomad's Evil Hobby

03-03-2005, 03:03 PM	#2
skillfull Confirmed User Industry Role: Join Date: Apr 2003 Location: Quebec Calisse Posts: 4,716	redirect all your traffic to my sites it will solve the problem ;) __________________ mind at underdark dot cc SEO Analyst Thunder-Ball.net - Member

03-03-2005, 03:05 PM	#4
Sly Let's do some business! Industry Role: Join Date: Sep 2004 Location: Austin, TX Posts: 31,329	There are a few management companies that could help you, or you could hire a tech to fix your problem. Talk to JFPDude, he may be able to help you out. __________________ Vacares - Web Hosting, Domains, O365, Security & More - Paxum and BTC Accepted Windows VPS now available Great for TSS, Nifty Stats, remote work, virtual assistants, etc. Click here for more details.

03-03-2005, 03:05 PM	#5
Tony Montana Confirmed User Join Date: Jan 2005 Posts: 794	What OS do you run? I could help ya for a price __________________ I am a marketing Genius.

03-03-2005, 03:10 PM	#6
shuki Confirmed User Join Date: Aug 2004 Location: Boston Posts: 3,070	I would suggest JFPDude too. Might want to switch hosts too but that is your choice. __________________ Looking to buy established paysites contact me [email protected]

03-03-2005, 03:04 PM	#3
The Heron Confirmed User Industry Role: Join Date: Apr 2001 Location: Michigan Posts: 4,488	Might try getting a MANAGED host instead of ev1

03-03-2005, 03:21 PM	#7
debbieN Confirmed User Join Date: Jan 2003 Location: FL, NC(I burned this down), MI Posts: 1,193	OS - Linux Ensim Pro for Red Hat Enterprise I only upload twice per day to my three servers that handle my TGP gallery posts. This is the only thing these servers do, gallery submissions. 300 users on one server seem small, but I don't know much about this subject. all I know is how to get traffic. __________________ don't rent the top room at the Luxor ______________________ Debbie Nomad's Evil Hobby

03-03-2005, 03:31 PM	#9
TurboAngel H.B.I.C. Industry Role: Join Date: Jun 2003 Location: NC Posts: 30,122	Here's a bump.

03-03-2005, 03:35 PM	#10
CheeseFrog Confirmed User Industry Role: Join Date: Dec 2003 Location: AZ Posts: 1,724	Kill your KeepAlives maybe? I know those slowed my server down a lot. __________________ Cary \| AIM: cheesefrog \| ICQ: 4287002

03-03-2005, 03:40 PM	#12
debbieN Confirmed User Join Date: Jan 2003 Location: FL, NC(I burned this down), MI Posts: 1,193	what company can twik my apche? __________________ don't rent the top room at the Luxor ______________________ Debbie Nomad's Evil Hobby

03-03-2005, 03:43 PM	#13
wvuatl Confirmed User Join Date: May 2004 Location: New Jersey Posts: 604	You have to change your Apache HARD_SERVER_LIMIT and update httpd.conf to handle more requests.... hire a Linux System Admin __________________ Get you some vibrators for women now!

03-03-2005, 03:45 PM	#14
debbieN Confirmed User Join Date: Jan 2003 Location: FL, NC(I burned this down), MI Posts: 1,193	Fris - I get a lot of hits. 205,720,166 today so far. Sessions is what I have to deal with 18,057 today so far. __________________ don't rent the top room at the Luxor ______________________ Debbie Nomad's Evil Hobby

03-03-2005, 03:48 PM	#16
skillfull Confirmed User Industry Role: Join Date: Apr 2003 Location: Quebec Calisse Posts: 4,716	18k sessions isnt suppose to cause load on 1 servers if you tweak it correctly... __________________ mind at underdark dot cc SEO Analyst Thunder-Ball.net - Member

03-03-2005, 03:58 PM	#17
latinasojourn Confirmed User Join Date: Oct 2003 Posts: 3,191	i had similar issues and juicy links referred me to JFPdude and he fixed. note: these were servers setup by webair, and as others have stated you need your apache custom tuned for load.

03-03-2005, 03:59 PM	#18
JFPdude Confirmed User Join Date: Jan 2002 Location: Mountains of Western North Carolina. Posts: 4,027	Thanks for the props guys ... If this is still an issue hit me up on ICQ 4433144

03-03-2005, 04:34 PM	#20
debbieN Confirmed User Join Date: Jan 2003 Location: FL, NC(I burned this down), MI Posts: 1,193	thanks borked but I just spoke with the master - JFPdude again thanks GFY for the correct information. __________________ don't rent the top room at the Luxor ______________________ Debbie Nomad's Evil Hobby

03-03-2005, 04:36 PM	#21
flashfire ICQ 1 6 7 8 5 3 4 9 2 Join Date: Feb 2003 Posts: 13,098	your gonna blow your load

03-03-2005, 04:36 PM	#22
LasseKongos Confirmed User Join Date: Aug 2003 Posts: 4,668	"my servers can't handle the loads!" Then help the servers, just swallow!

03-03-2005, 04:40 PM	#23
s9ann0 Confirmed User Join Date: Sep 2001 Location: Boston Posts: 4,873	I would turn off keepalive or at least turn the timeout down to 1 strip out all modules you don't need to get the httpd process size down then rebuild with hard_server_limit 1024 and up maxclients to fit the RAM so it doesn't swap

03-03-2005, 10:56 PM	#25
tungsten Too lazy to set a custom title Join Date: Mar 2004 Posts: 10,579	hire a sys admin to look after your server(s) __________________ VOYEUR /HOMEMADE, HENTAI / CARTOON, Reality, Amateur, Shemale, Hardcore, Cuckold, Celebrity, Retro/Vintage, ect...ALL OUR SITES >> Unbelievable Ratio \| High % of Rebills \| Bi-Monthly Payments (also to E-Passporte) Ton's of EXCLUSIVE Free content & FHG's \|=> GREAT REVENUE $$$ GUARANTEED!

03-03-2005, 11:23 PM	#27
Pornwolf Drunk and Unruly Join Date: Jan 2002 Location: Hollywood Posts: 22,712	You shouldn't have problems with just 300 clients. Call Webair mike. See sig. __________________ I've trusted my sites to them for over a decade... Webair, bitches.

03-04-2005, 01:08 AM	#28
SplitInfinity Confirmed User Join Date: Dec 2002 Location: San Diego, CA Posts: 3,047	For apaches... pre 2.0... Apache Performance Boost By: Chris Jester ( [email protected] ) If you are experincing long delays while "Waiting for reply...." with Apache servers you may try the following hack I use frequently to speed up your systems performance. Apache comes with a limit of 256 Child Processes defined in its hard server limit (in the source code). This can kill apache when it is used for a very very busy site. Normally in the httpd.conf file you can only set a maximum of 256 MaxClients. This is not enough for a busy site. To change this limit (which the makers of apache suggest as well), edit src/includes/httpd.h and change the value of HARD_SERVER_LIMIT. Bump it up to 1024, then set your httpd.conf files MaxClients to like 512. That should be ample. Re-compile apache and you are done. Note: Linux itself has a "Max Processes" per user limit. Add this to your root .bashrc file: ulimit -u unlimited You must exit and re-login before starting your new apache! Otherwise you will run into problems. To verify that you are ready to go, make sure that when you type ulimit -a as root, it shows "unlimited" next to max user processes. (note: you may also do ulimit -u unlimited at the command prompt before starting httpd instead of adding it to the .bashrc file, but I always forgot, so I just added it in the .bashrc file as a safety net.. Another good place to put ulimit -u unlimited is in the httpd startup file in /etc/rc.d/init.d)

03-04-2005, 01:15 AM	#29
SplitInfinity Confirmed User Join Date: Dec 2002 Location: San Diego, CA Posts: 3,047	Here is how you can find out if this might be the problem: On the command line, type: ps -aux\|grep httpd\|wc -l It will return a number. If this number is about 300ish or close, but not above, then its most likely the problem I solve above. For Apache 2.0, its EASY as pie to fix: Set these like this: Timeout 60 KeepAlive On (Set this to off if your site is only doing CGI redirection, but on in most all other cases) MaxKeepAliveRequests 0 KeepAliveTimeout 20 ServerLimit 1000 <IfModule prefork.c> StartServers 100 MinSpareServers 5 MaxSpareServers 30 MaxClients 1000 MaxRequestsPerChild 0 </IfModule> Note, this is all dependant on RAM and PROCESSOR so if your notice your ram is all eaten up, reduce MaxClients to like 700 (if you didnt know, this is in the file /etc/httpd/conf/httpd.conf) Edit that file, then do this: service httpd restart

03-04-2005, 01:19 AM	#30
d00t Confirmed User Industry Role: Join Date: Sep 2002 Location: In your mind Posts: 3,766	some good free advice from splitinfinity ;)

03-04-2005, 01:37 AM	#31
SplitInfinity Confirmed User Join Date: Dec 2002 Location: San Diego, CA Posts: 3,047	Suggestion to all: Dont use .htaccess files. Instead, use the httpd.conf file. Reason? Performance impact. Every file that is served by apache is in a directory tree.... And the server needs to check EVERY DIRECTORY along the file path for an .htaccess file, just to make sure theres none there and/or of there IS one there... So think of it like this.... You have something.gif and someone is loading it right now... Apache says, oh ok.... Lets see... the file is in /home/one/two/three/four/five Then it says... is there and .htaccess file in /home? is there and .htaccess file in /one? is there and .htaccess file in /two? is there and .htaccess file in /three? is there and .htaccess file in /four? is there and .htaccess file in /five? Imagine the disk load and etc if you have like 50 thumbnails on your page? Food for thought GFY'ers :-)

03-04-2005, 02:48 AM	#33
SplitInfinity Confirmed User Join Date: Dec 2002 Location: San Diego, CA Posts: 3,047	The same way you do it in an .htaccess file, but you put it in the Virtualhost directives in your httpd.conf instead and delete your .htaccess file. :-)

03-04-2005, 02:49 AM	#34
SplitInfinity Confirmed User Join Date: Dec 2002 Location: San Diego, CA Posts: 3,047	By doing it that way, apache only has to load them once.... not per hit