Your server specs. - GoFuckYourself.com

HQ · 09-10-2002, 01:15 PM

What are your server specs? (computer specs, hits/day stats, clickthrus/day, scripted or not, etc.) I need a server upgrade and I'm just curious to how badly I need it.

My specs:
- 400MHz, 512MB RAM,
- 50,000 hits/day (100,000 clickthrus/day estimated).
- running perl/dbi/mysql scripts

As you can see, my CPU needs a boost and my CPU idle is running low.

(And no, this isn't an attempt for a DVD player; give me some help.)

http · 09-10-2002, 01:26 PM

100,000 click thrus out of 50,000 hits...

not bad

davvve · 09-10-2002, 01:30 PM

i'm running a 1.3 ghz for my sites. it got 512 ram and can do well over 100'000 hits per day i believe

salsbury · 09-10-2002, 01:32 PM

if you need more CPU to handle that, i'd say your code needs some work.

50,000 hits per day is less than 1 per second, so your scripts would have to take, on average, longer than a second to run - that's an eternity, really.

there might be ways you can improve performance by tuning Apache, too. if you're hitting swap AT ALL, you need to concentrate on solving that issue before anything else.

notjoe · 09-10-2002, 01:33 PM

Quote:

Originally posted by salsbury
if you need more CPU to handle that, i'd say your code needs some work.

50,000 hits per day is less than 1 per second, so your scripts would have to take, on average, longer than a second to run - that's an eternity, really.

there might be ways you can improve performance by tuning Apache, too. if you're hitting swap AT ALL, you need to concentrate on solving that issue before anything else.

Depends on whether you're forking processes when your script runs or not.

HQ · 09-10-2002, 01:37 PM

not hitting any swap, my processes hardly touch memory at all. mysql is just taking a lot more resources than i thought it would... that's why i'm wondering if it's just my code or if it typical for a 400MHz system to be too slow.

salsbury · 09-10-2002, 01:37 PM

Quote:

Originally posted by notjoe

Depends on whether you're forking processes when your script runs or not.

swap's an issue no matter what, but forking processes will indeed slow things down more, too. post your httpd.conf maybe some things could be tuned there.

salsbury · 09-10-2002, 01:39 PM

Quote:

Originally posted by HQ
not hitting any swap, my processes hardly touch memory at all. mysql is just taking a lot more resources than i thought it would... that's why i'm wondering if it's just my code or if it typical for a 400MHz system to be too slow.

400MHz isn't fast, and upgrading might help, but chances are you could improve performance by reducing complexities in the code, or caching more data. say you do a select query every second that adds up all the values related to a specific key - it might be worthwhile to have a cron job generate that every minute, store it in a separate table, and then you could add the values in the new table to only the most recent values from the old.

yeah, that's a wild "for instance", but it's just an idea. ;)

Brown Bear · 09-10-2002, 01:40 PM

GET MORE RAM!

HQ · 09-10-2002, 01:41 PM

Mem: 517216K av, 499740K used, 17476K free, 653932K shrd, 182812K buff
Swap: 136512K av, 5852K used, 130660K free 112048K cached

HQ · 09-10-2002, 01:42 PM

512 is not enough?

HQ · 09-10-2002, 01:46 PM

basically it is just my new script that is chewing up all the resources, and this is how it works:

- every hit in and hit out is stored to a flat file in raw format.
- every 5 mins a cronjob runs a cgi that goes through all the raw data and queries mysql (my database) and modifies my html (my site). i do this so i don't have to access mysql every hit in and hit out. plus my site does not have to change every hit, every 5 minutes is often enough.

the only thing is that the hits out have to modify my hits owed and all that shit to determine who is owed the next hit and it also checks to make sure unique hits are sent out, etc. that is the problem (because i have so many clickthrus). my hit out exit script code is chewing up all my cpu.

TaDoW · 09-10-2002, 01:47 PM

dual 1.4ghz athlons (98% idle)
1024 mb of pc2100 ddr ram
15,000 rpm 2 meg cache 6 ns seek time SCSI drives
Tyan ThunderK7 motherboard

As rockford fosgate always says, heat is the #1 Killer ... so we put in 12 7200 rpm fans :-D

The thing sounds like a fucking 747 on take off

HQ · 09-10-2002, 01:47 PM

TaDoW, impressive, but how many hits/day and scripts do you run?

TaDoW · 09-10-2002, 01:49 PM

Quote:

Originally posted by HQ
TaDoW, impressive, but how many hits/day and scripts do you run?

not a lot ... depends on the day .. on average, probably 100k hits per day. I have no idea how many scripts it runs ... that's my programmer's job :-)

boldy · 09-10-2002, 01:49 PM

1 x Dual PIII XEON 1 gig ram raid 5 4 x 15k discs (running 500-600 queries a second for http://freetgpsubmitter.com)

1 x P4 512 megs ram raid 1

1 x PIII 1k 512 megs ram no raid

IDE!

1 x PIII 700 256 megs ram no raid IDE! werd ...

1 x PIII 700 1 gig ram plain scsi

All running perl/mysql/php

Brown Bear · 09-10-2002, 01:49 PM

When you're talking about server performance, having more RAM is more important than a faster processor (CPU)

of course, you should upgrade the CPU as well, but if you can only afford to do one thing, its always good to add more memory

HQ · 09-10-2002, 03:37 PM

Quote:

Originally posted by Brown Bear
When you're talking about server performance, having more RAM is more important than a faster processor (CPU)

of course, you should upgrade the CPU as well, but if you can only afford to do one thing, its always good to add more memory

Look at my stats above. Do you think that I need more RAM? (This not meant to be sarcastic; please answer!)

HQ · 09-10-2002, 03:39 PM

Quote:

Originally posted by TaDoW
not a lot ... depends on the day .. on average, probably 100k hits per day. I have no idea how many scripts it runs ... that's my programmer's job :-)

Thanks. Does a script run on every click on one of your sites for example? Does your site have a traffic trading script at all?

notjoe · 09-10-2002, 03:42 PM

Quote:

Originally posted by HQ
basically it is just my new script that is chewing up all the resources, and this is how it works:

- every hit in and hit out is stored to a flat file in raw format.
- every 5 mins a cronjob runs a cgi that goes through all the raw data and queries mysql (my database) and modifies my html (my site). i do this so i don't have to access mysql every hit in and hit out. plus my site does not have to change every hit, every 5 minutes is often enough.

the only thing is that the hits out have to modify my hits owed and all that shit to determine who is owed the next hit and it also checks to make sure unique hits are sent out, etc. that is the problem (because i have so many clickthrus). my hit out exit script code is chewing up all my cpu.

rewrite this all in php/mysql and you'll save yourself huge amounts of resources.

HQ · 09-10-2002, 03:43 PM

Quote:

Originally posted by boldy
1 x Dual PIII XEON 1 gig ram raid 5 4 x 15k discs (running 500-600 queries a second for http://freetgpsubmitter.com)

[cut]

All running perl/mysql/php

500-600 mysql queries / second? Holy shit. Can you explain in more detail what you are doing?

HQ · 09-10-2002, 03:44 PM

Quote:

Originally posted by notjoe
rewrite this all in php/mysql and you'll save yourself huge amounts of resources.

Are you saying php is faster that perl?

notjoe · 09-10-2002, 03:45 PM

Rewrite this all in php/mysql and you'll save yourself huge amounts of resources. You'll want to make sure that PHP is running as a server module.

Having mysql/php handle large amounts of requests is basically what they do best, if your code is done right,there is a reason all highend websites are database driven ;)

Joe

notjoe · 09-10-2002, 03:47 PM

Quote:

Originally posted by HQ

Are you saying php is faster that perl?

PHP is way faster than Perl, even if you have FastCGI running and PHP is a module and isnt forked for each request.

Everytime a CGI is loaded your webserver opens a shell and executed perl -f(?) perlfile.cgi
where as php as a module is all embedded.

You will also need to optimize your database table fields so that your searching takes up a lot less time.

Joe

boldy · 09-10-2002, 03:49 PM

Quote:

Originally posted by notjoe

PHP is way faster than Perl, even if you have FastCGI running and PHP is a module and isnt forked for each request.

Everytime a CGI is loaded your webserver opens a shell and executed perl -f(?) perlfile.cgi
where as php as a module is all embedded.

You will also need to optimize your database table fields so that your searching takes up a lot less time.

Joe

For simple front end webstuff YES, but server side calculations and text parsing NOWAY ...

HQ · 09-10-2002, 03:52 PM

Quote:

Originally posted by notjoe
PHP is way faster than Perl, even if you have FastCGI running and PHP is a module and isnt forked for each request.

Everytime a CGI is loaded your webserver opens a shell and executed perl -f(?) perlfile.cgi
where as php as a module is all embedded.

You will also need to optimize your database table fields so that your searching takes up a lot less time.

The only database queries i do is a "does this searchstring exist in the database?" so if i got a hit from http://www.freegallery.biz/whatever.html, i would check to see if "freegallery.biz" existed in my mysql database. i can't really optimize that anymore. the searchstring field is defined as "UNIQUE index(searchstring)", so it's unique.

notjoe · 09-10-2002, 03:53 PM

Quote:

Originally posted by boldy

For simple front end webstuff YES, but server side calculations and text parsing NOWAY ...

you might have a point on text parsing but i think overall php is a faster languge for web programming, even when it coming to creating sites you can get them done quicker with php.

Joe

eru · 09-10-2002, 03:54 PM

Quad Pentium Xeons (forgot the Ghz)
12GB of RAM -- I think Rambus
2 36.7GB 15000 SCSI3 RAiD setup

HQ · 09-10-2002, 03:54 PM

Quote:

Originally posted by boldy
For simple front end webstuff YES, but server side calculations and text parsing NOWAY ...

Exactly my question. Is PHP really better than PERL for all the text parsing I have to do? This is a traffic trading script, not an HTML design script.

notjoe · 09-10-2002, 03:55 PM

Quote:

Originally posted by HQ

The only database queries i do is a "does this searchstring exist in the database?" so if i got a hit from http://www.freegallery.biz/whatever.html, i would check to see if "freegallery.biz" existed in my mysql database. i can't really optimize that anymore. the searchstring field is defined as "UNIQUE index(searchstring)", so it's unique.

Humor me and rewrite all your perl scripts which are executed from apache to php and tell me how much of a drop off in load on your system there is ;0

Joe

boldy · 09-10-2002, 03:59 PM

Quote:

Originally posted by HQ

500-600 mysql queries / second? Holy shit. Can you explain in more detail what you are doing?

The 500-600 queries a second is the max. the avg of my server is 300 queries a second.

Its a free tgp submitter. 4000 webmasters submitting gallery pages to 1200 TGP sites. 1 gallery page is posted to max 3 tgp sites. Every submission executes 20 queries on my db. Currently we're doing 1.5 million pages a month. You can have a look at it here http://www.freetgpsubmitter.com

B.

HQ · 09-10-2002, 04:01 PM

Quote:

Originally posted by notjoe

Humor me and rewrite all your perl scripts which are executed from apache to php and tell me how much of a drop off in load on your system there is ;0

Joe

I've never programmed in PHP in my entire life... give me one hour and I'll post the results!

HQ · 09-10-2002, 04:03 PM

Quote:

Originally posted by boldy
The 500-600 queries a second is the max. the avg of my server is 300 queries a second.

Its a free tgp submitter. 4000 webmasters submitting gallery pages to 1200 TGP sites. 1 gallery page is posted to max 3 tgp sites. Every submission executes 20 queries on my db. Currently we're doing 1.5 million pages a month. You can have a look at it here http://www.freetgpsubmitter.com

Looking at it now. That is unbelievable to me. 600 queries in a second... wow. I guess there are a lot of factors I don't know about, like the size of your databases and the complexity of your queries, but wow.

boldy · 09-10-2002, 04:03 PM

Quote:

Originally posted by HQ

I've never programmed in PHP in my entire life... give me one hour and I'll post the results!

HQ, i can help you. Or with your perl code. Or to rewrite it into PHP for you. Let me know ... tomorrow, because i'm off to the coffin right now

HQ · 09-10-2002, 04:09 PM

Quote:

Originally posted by boldy
HQ, i can help you. Or with your perl code. Or to rewrite it into PHP for you. Let me know ... tomorrow, because i'm off to the coffin right now

Thanks for the offer. An ICQ msg is awaiting you. ttyl.

McAttack · 09-10-2002, 06:40 PM

Quote:

Originally posted by eru
Quad Pentium Xeons (forgot the Ghz)
12GB of RAM -- I think Rambus
2 36.7GB 15000 SCSI3 RAiD setup

WOW. I want one. NO! I want 5 of them!!! What would I do with them? I'd slap in some Sound cards, put some 6.1 speakers on them, and blast www.hamsterdance.com to the max! That's some serious power man, can I ask you SOME of the sites taht you have running on here? Do you by any chance own www.nasa.com ?

HQ · 09-10-2002, 06:47 PM

Quote:

Originally posted by eru
Quad Pentium Xeons (forgot the Ghz)
12GB of RAM -- I think Rambus
2 36.7GB 15000 SCSI3 RAiD setup

Until McAttack pointed it out, I missed your post! Awesome server!!!

09-10-2002, 01:30 PM	#3
davvve Confirmed User Join Date: Mar 2002 Location: Europe / India Posts: 560	i'm running a 1.3 ghz for my sites. it got 512 ram and can do well over 100'000 hits per day i believe __________________ Graphic Artist- $1400 \| Developer - $1400 Email/MSN: [email protected]

09-10-2002, 01:32 PM	#4
salsbury Confirmed User Join Date: Feb 2002 Location: Seattle Posts: 1,070	if you need more CPU to handle that, i'd say your code needs some work. 50,000 hits per day is less than 1 per second, so your scripts would have to take, on average, longer than a second to run - that's an eternity, really. there might be ways you can improve performance by tuning Apache, too. if you're hitting swap AT ALL, you need to concentrate on solving that issue before anything else. __________________

09-10-2002, 01:40 PM	#9
Brown Bear Confirmed User Join Date: May 2002 Posts: 4,982	GET MORE RAM! __________________ Surrender all your independent thinking and Click Here for re-programming.

09-10-2002, 01:49 PM	#16
boldy Macdaddy coder Industry Role: Join Date: Feb 2002 Location: MacDaddy pimp coder Posts: 2,806	1 x Dual PIII XEON 1 gig ram raid 5 4 x 15k discs (running 500-600 queries a second for http://freetgpsubmitter.com) 1 x P4 512 megs ram raid 1 1 x PIII 1k 512 megs ram no raid IDE! 1 x PIII 700 256 megs ram no raid IDE! werd ... 1 x PIII 700 1 gig ram plain scsi All running perl/mysql/php __________________ MacDaddy Coder.

09-10-2002, 01:49 PM	#17
Brown Bear Confirmed User Join Date: May 2002 Posts: 4,982	When you're talking about server performance, having more RAM is more important than a faster processor (CPU) of course, you should upgrade the CPU as well, but if you can only afford to do one thing, its always good to add more memory __________________ Surrender all your independent thinking and Click Here for re-programming.

09-10-2002, 01:15 PM	#1
HQ Confirmed User Join Date: Jan 2001 Posts: 3,539	Your server specs. What are your server specs? (computer specs, hits/day stats, clickthrus/day, scripted or not, etc.) I need a server upgrade and I'm just curious to how badly I need it. My specs: - 400MHz, 512MB RAM, - 50,000 hits/day (100,000 clickthrus/day estimated). - running perl/dbi/mysql scripts As you can see, my CPU needs a boost and my CPU idle is running low. (And no, this isn't an attempt for a DVD player; give me some help.)

09-10-2002, 01:26 PM	#2
http Confirmed User Join Date: Oct 2001 Posts: 1,811	100,000 click thrus out of 50,000 hits... not bad

09-10-2002, 01:37 PM	#6
HQ Confirmed User Join Date: Jan 2001 Posts: 3,539	not hitting any swap, my processes hardly touch memory at all. mysql is just taking a lot more resources than i thought it would... that's why i'm wondering if it's just my code or if it typical for a 400MHz system to be too slow.

09-10-2002, 01:41 PM	#10
HQ Confirmed User Join Date: Jan 2001 Posts: 3,539	Mem: 517216K av, 499740K used, 17476K free, 653932K shrd, 182812K buff Swap: 136512K av, 5852K used, 130660K free 112048K cached

09-10-2002, 01:42 PM	#11
HQ Confirmed User Join Date: Jan 2001 Posts: 3,539	512 is not enough?

09-10-2002, 01:46 PM	#12
HQ Confirmed User Join Date: Jan 2001 Posts: 3,539	basically it is just my new script that is chewing up all the resources, and this is how it works: - every hit in and hit out is stored to a flat file in raw format. - every 5 mins a cronjob runs a cgi that goes through all the raw data and queries mysql (my database) and modifies my html (my site). i do this so i don't have to access mysql every hit in and hit out. plus my site does not have to change every hit, every 5 minutes is often enough. the only thing is that the hits out have to modify my hits owed and all that shit to determine who is owed the next hit and it also checks to make sure unique hits are sent out, etc. that is the problem (because i have so many clickthrus). my hit out exit script code is chewing up all my cpu.

09-10-2002, 01:47 PM	#13
TaDoW Confirmed User Join Date: Sep 2001 Location: Where It Rains Posts: 3,875	dual 1.4ghz athlons (98% idle) 1024 mb of pc2100 ddr ram 15,000 rpm 2 meg cache 6 ns seek time SCSI drives Tyan ThunderK7 motherboard As rockford fosgate always says, heat is the #1 Killer ... so we put in 12 7200 rpm fans :-D The thing sounds like a fucking 747 on take off

09-10-2002, 03:45 PM	#23
notjoe Confirmed User Industry Role: Join Date: May 2002 Location: Toronto, Canada Posts: 5,599	Rewrite this all in php/mysql and you'll save yourself huge amounts of resources. You'll want to make sure that PHP is running as a server module. Having mysql/php handle large amounts of requests is basically what they do best, if your code is done right,there is a reason all highend websites are database driven ;) Joe

09-10-2002, 03:54 PM	#28
eru Confirmed User Join Date: Mar 2002 Location: Hawai'i Posts: 2,612	Quad Pentium Xeons (forgot the Ghz) 12GB of RAM -- I think Rambus 2 36.7GB 15000 SCSI3 RAiD setup __________________ <font color="#FFFFFF" size="2" face="Verdana">This thread will self-destruct in 5 seconds.</font><font color="#FFFFFF" face="Verdana"><br> <br> <font size="1">In the meantime, consider hosting with <a href="http://www.choopa.com"><font color="#00FF00">Choopa</font></a> -- The only provider with 9 x 1000mbps Transit Redundancy</font></font>