Comments on: Check how much web bandwidth your users are using

By: volksman

volksman — Wed, 16 Apr 2008 12:08:34 +0000

Thanks!!!

By: Timucin Kizilay

Timucin Kizilay — Wed, 16 Apr 2008 06:01:58 +0000

Thank you Jacom, and thank you Nick.
I was looking for a script like this for my server. I do not know Perl so I’ll try the Python version.
Now I have another question for you. My log files are in /var/log/apache2/site/ directory. the log files in /var/log are being rotated daily by the system but the apache logs are growing all the time. How can I rotate them automatically like the log files in /var/log ? My server is an ubuntu server edition 7.10.

By: Nick Presta

Nick Presta — Wed, 16 Apr 2008 03:11:42 +0000

Great little tool.

I thought it would be a good exercise to do something like this in Python, so here it goes:
http://nickpresta.ath.cx/lab/python/bwlog

It doesn’t handle rotating logs like yours does, but its simple enough for me.

By: rhesa

rhesa — Tue, 15 Apr 2008 22:44:07 +0000

Here’s an even terser solution (skipping the stuff around the loop):

@ARGV = glob(”/home/${cuser}.logs/*.access.log*” );
while() {
# split etc
}

That’s a useful idiom, which I keep forgetting myself

By: rhesa

rhesa — Tue, 15 Apr 2008 20:16:53 +0000

Hmm, sorry about that. How do you do code on this blog?

Anyway, the while() should read while(<$fh>)…

By: rhesa

rhesa — Tue, 15 Apr 2008 20:14:50 +0000

It’s pretty inefficient to first copy all the logs in a directory to a file in /tmp, and then to slurp that entire file into memory.

Let me try improving that a bit (and I do hope code remains intact):

#!/usr/bin/perl -w


my $month = shift

    or die "Usage: ckbw month\nPrints the bandwidth used in a month.\nUse shorthand notation (ie, Jan, Feb, Mar)\n";
my $cuser = $ENV{"USER"};

my $total = 0;
#find all of the log files for the user

for my $logfile ( glob( "/home/"${cuser}.logs/*.access.log*" ) ) {

    open my $fh, $logfile or do {

        warn "couldn't open $logfile: $! (skipping)";

        next;

    };
    while(< $fh>) {

        my @linesep = split / /;
        #check the month

        if($linesep[3] =~ m/$month/i) {

            #make sure there is an actual value

            if($linesep[9] =~ m/\d/) {

                $total += $linesep[9];

            }

        }

    }

}

print “Bandwidth totals:\n”; print $total.” bytes\n”; $total /= 1024; print $total.” KB\n”; $total /= 1024; print $total.” MB\n”; $total /= 1024; print $total.” GB\n”; [fixed formatting -Jacob]