Web log analysis and load balanced servers

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • BRISK
    Too lazy to set a custom title
    • Feb 2003
    • 12240

    #1

    Web log analysis and load balanced servers

    Does anyone have suggestions for the best way to view visitor stats for a website that uses multiple servers in a load balanced environment?

    Is it possible to get a program like AWStats to look at the log files from multiple servers and report it as if it was just one server?

    I post on GFY so that when people ask me what I do,
    I can tell them that I work with the mentally retarded.
  • SinisterStudios
    Confirmed User
    • Nov 2003
    • 3087

    #2
    Originally posted by BRISK
    Does anyone have suggestions for the best way to view visitor stats for a website that uses multiple servers in a load balanced environment?

    Is it possible to get a program like AWStats to look at the log files from multiple servers and report it as if it was just one server?

    Depends on how your load balancing them, do you have a director and children under that or are you doing round robin style balancing?
    SEOIP.com
    Multiple IP Webhosting
    Shared and Dedicated IP's - Multiple Class A's - From $1.99/ip

    Comment

    • BRISK
      Too lazy to set a custom title
      • Feb 2003
      • 12240

      #3
      Originally posted by SinisterStudios
      Depends on how your load balancing them, do you have a director and children under that or are you doing round robin style balancing?
      Right now using round robin, but thinking of using a proper hardware load balancer in the future. So I'd be interested in hearing about any methods of doing this.
      I post on GFY so that when people ask me what I do,
      I can tell them that I work with the mentally retarded.

      Comment

      • BRISK
        Too lazy to set a custom title
        • Feb 2003
        • 12240

        #4
        ????????
        I post on GFY so that when people ask me what I do,
        I can tell them that I work with the mentally retarded.

        Comment

        • aflex
          Confirmed User
          • Oct 2002
          • 3127

          #5
          Originally posted by BRISK
          Right now using round robin, but thinking of using a proper hardware load balancer in the future. So I'd be interested in hearing about any methods of doing this.
          F5 BIG IP 9.x <--the hardware you need

          9.x has a few traffic analysis tools but not as deep as browser types, reffering url, etc that you would find with like webalizer logs. It also uses iRules so that you can shape your traffic and send them to different servers/pages upon setting a variable.

          if you have specific q's about BIG IP, i'm on ICQ


          i'm not sure how to add web logs from diff servers to make them viewable as youre requesting but i'm sure theres a way
          Last edited by aflex; 01-23-2006, 06:45 PM.
          self made mothafucka.

          buying premium domains & developed sites with revenue/traffic -> adaptweb at gmail.com

          Comment

          • disregard
            Confirmed User
            • May 2004
            • 118

            #6
            It is possible regardless of how you load balance. Hit me on msn if you want someone to implement it for you.

            someblackdude at hotmail dot com
            house o' fart

            Comment

            • zagi
              Confirmed User
              • Jan 2004
              • 1238

              #7
              After you collect your logs cat them into 1 big file on a central log processing server

              cat /server-file-1 >> /total
              cat /server-file-2 >> /total
              ...

              Then run the web analyzer on /total file

              simple as pie
              Managed US/NL Hosting [ [Reality Check Network ]
              Dell XEON Servers + 1/2/3 TB Packages ICQ: 4-930-562

              Comment

              Working...