logtools

logtools is a log files analysis and filtering framework.

logtools encompasses of a few easy-to-use, easy to configure command-line tools, typically used in conjunction with Apache logs.

The idea is to standardize log parsing and filtering using a coherent configuration methodology and UNIX command-line interface (STDIN input streaming, command-line piping etc.) so as to create a consistent environment for creating reports, charts and other such log mining artifacts that are typically employed in a Website context.

Use case examples (Assuming a configured ~/.logtoolsrc, see Documentation):

 * Get aggregated (IP, Country) count for all Bot visits:

 cat access_log.2010-05-15 | filterbots --print --reverse | geoip | sort | uniq -c | sort -k1,1nr

 * Get a random sampling of 50 lines from an arbitrarily large input log stream:

 cat error_log.1 | filterbots --print | logsample -n50

Requirements:

• Python