Untitled » logfiles http://ammonlauritzen.com/blog and still for good reason. Tue, 13 Dec 2011 21:29:14 +0000 en hourly 1 http://wordpress.org/?v=3.1.2 dead simple traditional style rotation http://ammonlauritzen.com/blog/2010/02/05/dead-simple-traditional-style-rotation/ http://ammonlauritzen.com/blog/2010/02/05/dead-simple-traditional-style-rotation/#comments Fri, 05 Feb 2010 17:51:26 +0000 Ammon http://ammonlauritzen.com/blog/?p=1105 In response to my two-step rotation post earlier this week, I figure I may as well share the logic I use for a more traditional logfile rotation scheme.

I think this is as simple as I can possibly make it:

<?
define( 'MAX_COPIES', 3 );
$back_fname = "/path/to/log/file/abc.log";

function trace( $msg ) {
    echo "- $msg\n";
}

exec( "ls -r ${back_fname}*", $copies, $succ );
while( count($copies)>= MAX_COPIES ) {
    $fname = array_shift($copies);
    trace( "deleting ".$fname );
}
$next = count($copies);
while( $fname = array_shift($copies) ) {
    --$next;
    trace( "rotating $fname -> $next" );
    rename( $fname, "$back_fname.$next" );
}

trace( "creating $back_fname" );
touch( $back_fname );
?>

A sample series of executions might look like this:

ammon@wernstrom:/path/to/log/file$ touch abc.log
ammon@wernstrom:/path/to/log/file$ php rotate.php
- rotating /path/to/log/file/abc.log -> 0
- creating /path/to/log/file/abc.log
ammon@wernstrom:/path/to/log/file$ php rotate.php
- rotating /path/to/log/file/abc.log.0 -> 1
- rotating /path/to/log/file/abc.log -> 0
- creating /path/to/log/file/abc.log
ammon@wernstrom:/path/to/log/file$ php rotate.php
- rotating /path/to/log/file/abc.log.1 -> 2
- rotating /path/to/log/file/abc.log.0 -> 1
- rotating /path/to/log/file/abc.log -> 0
- creating /path/to/log/file/abc.log
ammon@wernstrom:/path/to/log/file$ php rotate.php
- deleting /path/to/log/file/abc.log.2
- rotating /path/to/log/file/abc.log.1 -> 2
- rotating /path/to/log/file/abc.log.0 -> 1
- rotating /path/to/log/file/abc.log -> 0
- creating /path/to/log/file/abc.log

This doesn't have any failsafes, doesn't compress anything, depends on an external call to 'ls', and it actually deletes old files in stead of overwriting them... but it is the shortest, simplest method I've come up with to get the job done.

If I feel like making this a full-fledged series, I might actually post a more thorough implementation later ;)

]]> http://ammonlauritzen.com/blog/2010/02/05/dead-simple-traditional-style-rotation/feed/ 0 simple two-step logfile rotation http://ammonlauritzen.com/blog/2010/02/03/simple-two-step-logfile-rotation/ http://ammonlauritzen.com/blog/2010/02/03/simple-two-step-logfile-rotation/#comments Wed, 03 Feb 2010 19:23:08 +0000 Ammon http://ammonlauritzen.com/blog/?p=1103 This is the result of 10 minutes of pounding on the keyboard after yet another disappointing experience with trying to get logrotate to do something vaguely more flexible.

This simple script scans all normal files in a log directory, and if they are older than a certain cutoff, moves them into a holding directory for old logs. Future passes will check files in the old directory for another age setting and will delete them. That's all there is to it.

Configure your cutoffs, directories of interest, and optionally plug in a better logging mechanism and you're set. (Oh, and change the #! if necessary, of course).

#!/usr/bin/php
<?
$cutoff_rotate = "3 days";
$cutoff_delete = "7 days";
$dir_log = "/logs";
$dir_old = "/logs.old";

function trace( $msg, $debug = FALSE ) {
    // appropriate logging mechanism can be plugged in here
    echo "[] $msg\n";
}

// scan old files for deletion
if( is_dir($dir_old) ) {
    $dh = opendir( $dir_old );
    if( $dh !== FALSE ) {
        chdir( $dir_old );
        trace( "scanning $dir_old for logs more than $cutoff_delete old" );
        $cutoff = strtotime( "-$cutoff_delete" );
        trace( "cutoff is ".date('r',$cutoff) );
        while( ($file = readdir($dh)) !== FALSE ) {
            if( is_dir($file) ) {
                trace( "skipping $file", true );
                continue;
            } else {
                $ts = filemtime($file);
                if( $ts <$cutoff ) {
                    trace( "deleting $file, ".date('r',$ts) );
                    $succ = @unlink($file);
                    if( !$succ )
                        trace( "failed to unlink $file!" );
                } else {
                    trace( "ignoring $file, ".date('r',$ts), true );
                }
            }
        }
    }
    closedir( $dh );
} else {
    trace( "no old log dir $dir_old to scan yet" );
}

// scan current files for rotation
if( file_exists($dir_old) ) {
    trace( "creating $dir_old" );
    $succ = @mkdir( $dir_old, 0775, true );
    if( !$succ ) {
        trace( "mkdir failed, aborting rotation" );
        exit( 1 );
    }
}
if( is_dir($dir_log) ) {
    $dh = opendir( $dir_log );
    if( $dh !== FALSE ) {
        chdir( $dir_log );
        trace( "scanning $dir_log for logs more than $cutoff_rotate old" );
        $cutoff = strtotime( "-$cutoff_delete" );
        trace( "cutoff is ".date('r',$cutoff) );
        while( ($file = readdir($dh)) !== FALSE ) {
            if( is_dir($file) ) {
                trace( "skipping $file", true );
                continue;
            } else {
                $ts = filemtime($file);
                if( $ts <$cutoff ) {
                    trace( "rotating $file, ".date('r',$ts), true );
                    $succ = @rename( $file, $dir_old );
                    if( !$succ )
                        trace( "failed to rotate $file!" );
                } else {
                    trace( "ignoring $file, ".date('r',$ts), true );
                }
            }
        }
    }
    closedir( $dh );
}
?>

]]> http://ammonlauritzen.com/blog/2010/02/03/simple-two-step-logfile-rotation/feed/ 2