Tech Any good tool for Viewing Apache Logs? - GoFuckYourself.com

Cyber Fucker · 03-17-2017, 05:33 AM

My logs are starting to be very massive and messy, I need something that can filter things out.
Do you know any good software that can handle very large logs and help with filtering them?
I mean something local like apacheviewer not serwer site stats awstats, webalizer etc.

Paz · 03-17-2017, 06:43 AM

Do you have any budget? WebLogExpert is handy for filtering and can cope with a gig quite easily if you have the patience - 10-15 mins or so.

They do a 30 day trial.

Klen · 03-17-2017, 07:22 AM

If you want to shrink log, you should set log not to write anything what is not important. For example, image access is one of things which generate huge log while in reality you dont need it, as for example if you have a page with 100 images, it will be logged 100 lines everytime when someone loads that page. That is how i resolved problem with toobig log.

Cyber Fucker · 03-17-2017, 08:13 AM

Quote:

Originally Posted by Paz

Do you have any budget? WebLogExpert is handy for filtering and can cope with a gig quite easily if you have the patience - 10-15 mins or so.

They do a 30 day trial.

Thanks, I will take a look.

Quote:

Originally Posted by KlenTelaris

If you want to shrink log, you should set log not to write anything what is not important. For example, image access is one of things which generate huge log while in reality you dont need it, as for example if you have a page with 100 images, it will be logged 100 lines everytime when someone loads that page. That is how i resolved problem with toobig log.

Unfortunately, image case is crucial here. But yeah, I've already filtered out some irrelevant stuff in the config like "apache dummy connections".

Klen · 03-17-2017, 08:15 AM

Quote:

Originally Posted by Cyber Fucker

Thanks, I will take a look.

Unfortunately, image case is crucial here. But yeah, I've already filtered out some irrelevant stuff in the config like "apache dummy connections".

Well, even in that case you could separate image access to different log file so you can navigate faster.

Cyber Fucker · 03-17-2017, 08:31 AM

Quote:

Originally Posted by KlenTelaris

Well, even in that case you could separate image access to different log file so you can navigate faster.

Hmm that could be a good idea if it's doable. I haven't thought about it..

Klen · 03-17-2017, 08:41 AM

Quote:

Originally Posted by Cyber Fucker

Hmm that could be a good idea if it's doable. I haven't thought about it..

It is, here is nice article about it:
How do I... Customize Apache Server log files to track my Web site? - TechRepublic

shake · 03-17-2017, 09:23 AM

You can run the Elk stack on a digitalocean node for $10 a month, or on a machine in your house. Very powerful.

03-17-2017, 05:33 AM	#1
Cyber Fucker Hmm Industry Role: Join Date: Sep 2005 Location: On an endless road around the world for rock and roll. Posts: 12,642	Any good tool for Viewing Apache Logs? My logs are starting to be very massive and messy, I need something that can filter things out. Do you know any good software that can handle very large logs and help with filtering them? I mean something local like apacheviewer not serwer site stats awstats, webalizer etc. __________________

03-17-2017, 07:22 AM	#3
Klen Industry Role: Join Date: Aug 2006 Location: Little Vienna Posts: 32,234	If you want to shrink log, you should set log not to write anything what is not important. For example, image access is one of things which generate huge log while in reality you dont need it, as for example if you have a page with 100 images, it will be logged 100 lines everytime when someone loads that page. That is how i resolved problem with toobig log. __________________ For GFY administration inquiries- email info at gfy.com or send PM. For advertising inquiries - email marketing at gfy.com Inquiries which are not related to administration or advertising on GFY wont be processed.

03-17-2017, 09:23 AM	#8
shake frc Industry Role: Join Date: Jul 2003 Location: Bitcoin wallet Posts: 4,663	You can run the Elk stack on a digitalocean node for $10 a month, or on a machine in your house. Very powerful. __________________ Crazy fast VPS for $10 a month. Try with $20 free credit

03-17-2017, 06:43 AM	#2
Paz Confirmed User Industry Role: Join Date: Jun 2012 Posts: 457	Do you have any budget? WebLogExpert is handy for filtering and can cope with a gig quite easily if you have the patience - 10-15 mins or so. They do a 30 day trial.