really big error_log - GoFuckYourself.com

kenny · 07-07-2002, 03:38 PM

My /usr/local/apache/logs/error_log was almost 5 gigs in size, due to broken ssi commands after I changed servers causing the website not to respond, they had to pay some tech to figure it out. Pretty fucked up huh?

mike503 · 07-07-2002, 03:55 PM

apachectl stop

rm error_log

apachectl start

problem solved. or mv it somewhere, if you want a backup that badly.

be sure to gzip though.

kenny · 07-07-2002, 04:06 PM

I had no idea a big error log would cause httpd to stop working,
we kept seeing "httpd dead but subsys is locked" on the "httpd status" command thought something was really fucked up for awhile. I learned today that there is a million unix commands I don't understand

mike503 · 07-07-2002, 04:15 PM

the bigger the files get the more resources (in theory) they'll eat. although i don't know the technical specifics of file I/O and shit in linux and other unices, it does keep the file open but may be able to flush the memory each write.. problem is opening the file to append it may need to open the huge file. but again, i'm not on that level of technical knowledge.

kenny · 07-07-2002, 04:23 PM

Don't I feel stupid. spent 8 hours reading old apache yahoo forums and surfing google for answers, and the whole time the answer was in my sig

RK · 07-07-2002, 05:02 PM

Quote:

Originally posted by kenny
My /usr/local/apache/logs/error_log was almost 5 gigs in size, due to broken ssi commands after I changed servers causing the website not to respond

I see this fairly often on servers that are not managed properly. Apache usually stops working at 2 GB, I believe that has something to do with maximum file size limit, not any problem with too much resources being used. 5 GB is much less common, what version of Apache and OS are you using?

I just usually send the main error log to /dev/null and the virtual host error logs to users directory after a server is running.

toddler · 07-07-2002, 05:32 PM

kenny, find a new admin, one who knows
how write a 3 line log rotate script.

i ran into this type of thing A LOT when
i was running efront's servers. and their
webmasters would insist it be fixed
without shutting down httpd.

one thing you can do to blow out
the logs, is

cp /dev/null /path/to/logfile

will zero out the file.

note, depending on the os, if you do this
while the server is running, you may have some issues, depending on whether the app has an open file handle to the log. in which case you'll see it as 0 bytes in a long list (ls -l), but you won't have the space back in
a df output. if that happens, send apache
a HUP. (apachectl restart should work fine)

again, get a new admin, the one you have doesn't seem to be able find his/her ass with both hands and a mirror.

t

mike503 · 07-07-2002, 09:13 PM

there's a "rotatelogs" script that comes with apache.. put that down too, it'll help. (you could even rig it to gzip old logfiles too..if it doesn't already.)

Dreamman010 · 07-07-2002, 10:35 PM

Currently, my apache logfile size is

11326424423

Which is 11.3Gb. I am having no problems though but i'm going to delete it.

darksoul · 07-08-2002, 03:20 AM

Apache doesn't care about huge files.
to quickly remove a big file do
promt# cat /dev/null > /path/to/file
this way you won't need to restart apache.
and if you don't need error logs link the file to /dev/null
ln -s /dev/null /path/to/error_log

07-07-2002, 03:38 PM	#1
kenny Confirmed User Industry Role: Join Date: Mar 2002 Posts: 7,245	really big error_log My /usr/local/apache/logs/error_log was almost 5 gigs in size, due to broken ssi commands after I changed servers causing the website not to respond, they had to pay some tech to figure it out. Pretty fucked up huh? __________________ 7

07-07-2002, 03:55 PM	#2
mike503 Confirmed User Industry Role: Join Date: May 2002 Location: oregon. Posts: 2,243	apachectl stop rm error_log apachectl start problem solved. or mv it somewhere, if you want a backup that badly. be sure to gzip though. __________________ php/mysql guru. hosting, coding, all that jazz.

07-07-2002, 04:06 PM	#3
kenny Confirmed User Industry Role: Join Date: Mar 2002 Posts: 7,245	I had no idea a big error log would cause httpd to stop working, we kept seeing "httpd dead but subsys is locked" on the "httpd status" command thought something was really fucked up for awhile. I learned today that there is a million unix commands I don't understand __________________ 7

07-07-2002, 04:15 PM	#4
mike503 Confirmed User Industry Role: Join Date: May 2002 Location: oregon. Posts: 2,243	the bigger the files get the more resources (in theory) they'll eat. although i don't know the technical specifics of file I/O and shit in linux and other unices, it does keep the file open but may be able to flush the memory each write.. problem is opening the file to append it may need to open the huge file. but again, i'm not on that level of technical knowledge. __________________ php/mysql guru. hosting, coding, all that jazz.

07-07-2002, 04:23 PM	#5
kenny Confirmed User Industry Role: Join Date: Mar 2002 Posts: 7,245	Don't I feel stupid. spent 8 hours reading old apache yahoo forums and surfing google for answers, and the whole time the answer was in my sig __________________ 7

07-07-2002, 05:32 PM	#7
toddler Confirmed User Join Date: Jun 2002 Location: austin, tx Posts: 1,911	kenny, find a new admin, one who knows how write a 3 line log rotate script. i ran into this type of thing A LOT when i was running efront's servers. and their webmasters would insist it be fixed without shutting down httpd. one thing you can do to blow out the logs, is cp /dev/null /path/to/logfile will zero out the file. note, depending on the os, if you do this while the server is running, you may have some issues, depending on whether the app has an open file handle to the log. in which case you'll see it as 0 bytes in a long list (ls -l), but you won't have the space back in a df output. if that happens, send apache a HUP. (apachectl restart should work fine) again, get a new admin, the one you have doesn't seem to be able find his/her ass with both hands and a mirror. t __________________ http://www.flickr.com/photos/zoddler/

07-07-2002, 09:13 PM	#8
mike503 Confirmed User Industry Role: Join Date: May 2002 Location: oregon. Posts: 2,243	there's a "rotatelogs" script that comes with apache.. put that down too, it'll help. (you could even rig it to gzip old logfiles too..if it doesn't already.) __________________ php/mysql guru. hosting, coding, all that jazz.

07-07-2002, 10:35 PM	#9
Dreamman010 Confirmed User Join Date: Jan 2002 Location: Toronto, ON, Canada Posts: 1,081	Currently, my apache logfile size is 11326424423 Which is 11.3Gb. I am having no problems though but i'm going to delete it. __________________ <a href="http://www2.famoushost.com/home.php" target="_blank"><b><FONT COLOR="FFFF00">www.FamousHost.com</font></b></a><br>Free Hosting With No Headers, Real FTP, <u>Get listed on the biggest TGP's with us!</u>

07-08-2002, 03:20 AM	#10
darksoul Confirmed User Join Date: Apr 2002 Location: /root/ Posts: 4,997	Apache doesn't care about huge files. to quickly remove a big file do promt# cat /dev/null > /path/to/file this way you won't need to restart apache. and if you don't need error logs link the file to /dev/null ln -s /dev/null /path/to/error_log __________________ 1337 5y54\|)m1n: 157717888 BM-2cUBw4B2fgiYAfjkE7JvWaJMiUXD96n9tN Cambooth