Logfile data limits - GoFuckYourself.com

kenny · 09-05-2002, 04:05 PM

I always used ".txt" files to log data for scripts, The only problem is that ".txt" files don't hold enough data, is there a different file type I can use that allows more data to be stored?

NetRodent · 09-05-2002, 04:35 PM

What platform are you on? How much data are you trying to store? The file extension really shouldn't affect the amount of data a file a capable of holding. The limitation might be in your file system.

faytl · 09-05-2002, 06:26 PM

Probably not the best idea to let log files just grow and grow, but to instead use some sort of reporting system on the log which will cycle the logs and then extract and compress the data which is useful. In the case of Apache logs, something like webalizer will scan the log, pull out the data you need for a month, save it in it's own format (which has a huge size difference to straight text) and then truncate the original log file, ready to build up again.

09-05-2002, 04:05 PM	#1
kenny Confirmed User Industry Role: Join Date: Mar 2002 Posts: 7,245	Logfile data limits I always used ".txt" files to log data for scripts, The only problem is that ".txt" files don't hold enough data, is there a different file type I can use that allows more data to be stored?

09-05-2002, 04:35 PM	#2
NetRodent Confirmed User Join Date: Jan 2002 Location: In the walls of your house. Posts: 3,985	What platform are you on? How much data are you trying to store? The file extension really shouldn't affect the amount of data a file a capable of holding. The limitation might be in your file system.

09-05-2002, 06:26 PM	#3
faytl Confirmed User Join Date: Jul 2002 Location: Australia Posts: 121	Probably not the best idea to let log files just grow and grow, but to instead use some sort of reporting system on the log which will cycle the logs and then extract and compress the data which is useful. In the case of Apache logs, something like webalizer will scan the log, pull out the data you need for a month, save it in it's own format (which has a huge size difference to straight text) and then truncate the original log file, ready to build up again.