pgBadger

pgBadger is an open source and cross-platform software project that has been designed from the ground up to act as a command-line software written in Perl, which can be used by system administrators and database developers to analyze PostgreSQL database logs much faster than if they were using other tools.

Supports detailed reports

Key features include support for viewing detailed reports about SQL queries, including overall statistics, queries that were very slow, queries that took up a lot of time, the most frequently used queries, queries that generated a large number of temporary files, queries that waited the most, queries that generated the biggest temporary files, as well as the most frequent errors.

Supports pie charts

The application also provides users with support for pie charts, allowing them to lock statistics, view queries by type, including delete, insert, select and update, view sessions per user, client or database, view connections per user, client or database, view histogram of query times, display auto-analyze and auto-vacuum per table, as well as to show distribution of queries type per application or database.

Supports time-based charts

In addition to the above, pgBadger also supports time-based charts, which can display statistics about SQL queries, statistics about checkpoints, temporary file statistics, auto-analyze and auto-vacuum statistics, as well as histograms of hourly events or errors, and query duration/count.

Under the hood and supported OSes

The program is written entirely in the Perl programming language, which means that it is a platform-independent application designed to support all GNU/Linux distributions, various BSD flavors, as well as the Microsoft Windows and Mac OS X operating systems. Both 32-bit and 64-bit hardware platforms are supported at this moment.

What is new in this release:

• This release fix some issues and adds some new features. It adds a new option -B or --bar-graph to use bar instead of line in graphs. It will also keep tick formatting when zooming.
• The release also add a new program: pgbadger_tools to demonstrate how to works with pgBadger binary files to build your own new feature. The first tools 'explain-slowest' allow printing of top slowest queries as EXPLAIN statements. There's also additionnal options to execute automatically the statements with EXPLAIN ANALYZE and get the execution plan. See help of the program for more information or the README file in the tools directory.
• Some modifications will change certain behavior:
• The -T | --title text value will now be displayed instead of the pgBadger label right after the logo. report. It was previously displayed on mouse over the pgBadger label.
• Changes:
• Change -T | --title position on pgBadger report. Title now override the pgBadger label. Thanks to Julien Rouhauld for the patch.
• Add --file-per-query and --format-query option to write each slowest query in separate file named qryXXX.sql and perform minimal formating of the queries. Thanks to Rodolphe Quiedeville for the patch.
• Remove debug query from explain-slowest tool.
• Fix surge in sessions number report when an exclusion or inclusion option (dbname, user, appname, etc.) is used. Thanks to suyah for the report.
• Fix fatal error when remote log file is 0 size. Thanks to Julien Rouhaud for the report.
• Allow pgbadger_tools --explain-slowest to automatically execute the EXPLAIN statements an report the plan. See pgbadger_tools --help for more explanation.
• Add --analyze option to replace EXPLAIN statements by EXPLAIN (ANALYZE, VERBOSE, BUFFERS).
• Move pgbadger_tools program and README.tools into the tools/ subdirectory with removing the extension. Add more comments and explanations.
• Fix case where die with interrupt signal is received when using -e option. Thanks to Lloyd Albin for the report.
• Add a new program pgbadger_tools to demonstrate how to deal with pgBadger binary files to build your own new feature. The first one 'explain-slowest' allow printing of top slowest queries as EXPLAIN statements.
• Keep tick formatting when zooming. Thanks to Julien Rouhaud for the patch.
• Fix automatic detection of rsyslogd logs. Thanks to David Day for the report.
• Fix issue in calculating min/max/avg in "General Activity" report. It was build on the sum of queries duration per minutes instead of each duration. Thanks to Jayadevan M for the report.
• The same issue remains with percentile that are build using the sum of duration per minutes and doesn't represent the real queries duration.
• This commit also include a modification in convert_time() method to reports milliseconds.
• Add -B or --bar-graph command line option to use bar instead of line in graph. Thanks to Bart Dopheide for the suggestion.
• Fix Checkpoint Wal files usage graph title.

What is new in version 7.3:

• This release fix some issues and adds some new features. It adds a new option -B or --bar-graph to use bar instead of line in graphs. It will also keep tick formatting when zooming.
• The release also add a new program: pgbadger_tools to demonstrate how to works with pgBadger binary files to build your own new feature. The first tools 'explain-slowest' allow printing of top slowest queries as EXPLAIN statements. There's also additionnal options to execute automatically the statements with EXPLAIN ANALYZE and get the execution plan. See help of the program for more information or the README file in the tools directory.
• Some modifications will change certain behavior:
• The -T | --title text value will now be displayed instead of the pgBadger label right after the logo. report. It was previously displayed on mouse over the pgBadger label.
• Changes:
• Change -T | --title position on pgBadger report. Title now override the pgBadger label. Thanks to Julien Rouhauld for the patch.
• Add --file-per-query and --format-query option to write each slowest query in separate file named qryXXX.sql and perform minimal formating of the queries. Thanks to Rodolphe Quiedeville for the patch.
• Remove debug query from explain-slowest tool.
• Fix surge in sessions number report when an exclusion or inclusion option (dbname, user, appname, etc.) is used. Thanks to suyah for the report.
• Fix fatal error when remote log file is 0 size. Thanks to Julien Rouhaud for the report.
• Allow pgbadger_tools --explain-slowest to automatically execute the EXPLAIN statements an report the plan. See pgbadger_tools --help for more explanation.
• Add --analyze option to replace EXPLAIN statements by EXPLAIN (ANALYZE, VERBOSE, BUFFERS).
• Move pgbadger_tools program and README.tools into the tools/ subdirectory with removing the extension. Add more comments and explanations.
• Fix case where die with interrupt signal is received when using -e option. Thanks to Lloyd Albin for the report.
• Add a new program pgbadger_tools to demonstrate how to deal with pgBadger binary files to build your own new feature. The first one 'explain-slowest' allow printing of top slowest queries as EXPLAIN statements.
• Keep tick formatting when zooming. Thanks to Julien Rouhaud for the patch.
• Fix automatic detection of rsyslogd logs. Thanks to David Day for the report.
• Fix issue in calculating min/max/avg in "General Activity" report. It was build on the sum of queries duration per minutes instead of each duration. Thanks to Jayadevan M for the report.
• The same issue remains with percentile that are build using the sum of duration per minutes and doesn't represent the real queries duration.
• This commit also include a modification in convert_time() method to reports milliseconds.
• Add -B or --bar-graph command line option to use bar instead of line in graph. Thanks to Bart Dopheide for the suggestion.
• Fix Checkpoint Wal files usage graph title.

What is new in version 7.1:

• This release fix some issues and adds some new features. It adds a new option -B or --bar-graph to use bar instead of line in graphs. It will also keep tick formatting when zooming.
• The release also add a new program: pgbadger_tools to demonstrate how to works with pgBadger binary files to build your own new feature. The first tools 'explain-slowest' allow printing of top slowest queries as EXPLAIN statements. There's also additionnal options to execute automatically the statements with EXPLAIN ANALYZE and get the execution plan. See help of the program for more information or the README file in the tools directory.
• Some modifications will change certain behavior:
• The -T | --title text value will now be displayed instead of the pgBadger label right after the logo. report. It was previously displayed on mouse over the pgBadger label.
• Changes:
• Change -T | --title position on pgBadger report. Title now override the pgBadger label. Thanks to Julien Rouhauld for the patch.
• Add --file-per-query and --format-query option to write each slowest query in separate file named qryXXX.sql and perform minimal formating of the queries. Thanks to Rodolphe Quiedeville for the patch.
• Remove debug query from explain-slowest tool.
• Fix surge in sessions number report when an exclusion or inclusion option (dbname, user, appname, etc.) is used. Thanks to suyah for the report.
• Fix fatal error when remote log file is 0 size. Thanks to Julien Rouhaud for the report.
• Allow pgbadger_tools --explain-slowest to automatically execute the EXPLAIN statements an report the plan. See pgbadger_tools --help for more explanation.
• Add --analyze option to replace EXPLAIN statements by EXPLAIN (ANALYZE, VERBOSE, BUFFERS).
• Move pgbadger_tools program and README.tools into the tools/ subdirectory with removing the extension. Add more comments and explanations.
• Fix case where die with interrupt signal is received when using -e option. Thanks to Lloyd Albin for the report.
• Add a new program pgbadger_tools to demonstrate how to deal with pgBadger binary files to build your own new feature. The first one 'explain-slowest' allow printing of top slowest queries as EXPLAIN statements.
• Keep tick formatting when zooming. Thanks to Julien Rouhaud for the patch.
• Fix automatic detection of rsyslogd logs. Thanks to David Day for the report.
• Fix issue in calculating min/max/avg in "General Activity" report. It was build on the sum of queries duration per minutes instead of each duration. Thanks to Jayadevan M for the report.
• The same issue remains with percentile that are build using the sum of duration per minutes and doesn't represent the real queries duration.
• This commit also include a modification in convert_time() method to reports milliseconds.
• Add -B or --bar-graph command line option to use bar instead of line in graph. Thanks to Bart Dopheide for the suggestion.
• Fix Checkpoint Wal files usage graph title.

What is new in version 7.0:

• This release fix some issues and adds some new features. It adds a new option -B or --bar-graph to use bar instead of line in graphs. It will also keep tick formatting when zooming.
• The release also add a new program: pgbadger_tools to demonstrate how to works with pgBadger binary files to build your own new feature. The first tools 'explain-slowest' allow printing of top slowest queries as EXPLAIN statements. There's also additionnal options to execute automatically the statements with EXPLAIN ANALYZE and get the execution plan. See help of the program for more information or the README file in the tools directory.
• Some modifications will change certain behavior:
• The -T | --title text value will now be displayed instead of the pgBadger label right after the logo. report. It was previously displayed on mouse over the pgBadger label.
• Changes:
• Change -T | --title position on pgBadger report. Title now override the pgBadger label. Thanks to Julien Rouhauld for the patch.
• Add --file-per-query and --format-query option to write each slowest query in separate file named qryXXX.sql and perform minimal formating of the queries. Thanks to Rodolphe Quiedeville for the patch.
• Remove debug query from explain-slowest tool.
• Fix surge in sessions number report when an exclusion or inclusion option (dbname, user, appname, etc.) is used. Thanks to suyah for the report.
• Fix fatal error when remote log file is 0 size. Thanks to Julien Rouhaud for the report.
• Allow pgbadger_tools --explain-slowest to automatically execute the EXPLAIN statements an report the plan. See pgbadger_tools --help for more explanation.
• Add --analyze option to replace EXPLAIN statements by EXPLAIN (ANALYZE, VERBOSE, BUFFERS).
• Move pgbadger_tools program and README.tools into the tools/ subdirectory with removing the extension. Add more comments and explanations.
• Fix case where die with interrupt signal is received when using -e option. Thanks to Lloyd Albin for the report.
• Add a new program pgbadger_tools to demonstrate how to deal with pgBadger binary files to build your own new feature. The first one 'explain-slowest' allow printing of top slowest queries as EXPLAIN statements.
• Keep tick formatting when zooming. Thanks to Julien Rouhaud for the patch.
• Fix automatic detection of rsyslogd logs. Thanks to David Day for the report.
• Fix issue in calculating min/max/avg in "General Activity" report. It was build on the sum of queries duration per minutes instead of each duration. Thanks to Jayadevan M for the report.
• The same issue remains with percentile that are build using the sum of duration per minutes and doesn't represent the real queries duration.
• This commit also include a modification in convert_time() method to reports milliseconds.
• Add -B or --bar-graph command line option to use bar instead of line in graph. Thanks to Bart Dopheide for the suggestion.
• Fix Checkpoint Wal files usage graph title.

What is new in version 6.4:

• This release fix some issues and adds some new features. It adds a new option -B or --bar-graph to use bar instead of line in graphs. It will also keep tick formatting when zooming.
• The release also add a new program: pgbadger_tools to demonstrate how to works with pgBadger binary files to build your own new feature. The first tools 'explain-slowest' allow printing of top slowest queries as EXPLAIN statements. There's also additionnal options to execute automatically the statements with EXPLAIN ANALYZE and get the execution plan. See help of the program for more information or the README file in the tools directory.
• Some modifications will change certain behavior:
• The -T | --title text value will now be displayed instead of the pgBadger label right after the logo. report. It was previously displayed on mouse over the pgBadger label.
• Changes:
• Change -T | --title position on pgBadger report. Title now override the pgBadger label. Thanks to Julien Rouhauld for the patch.
• Add --file-per-query and --format-query option to write each slowest query in separate file named qryXXX.sql and perform minimal formating of the queries. Thanks to Rodolphe Quiedeville for the patch.
• Remove debug query from explain-slowest tool.
• Fix surge in sessions number report when an exclusion or inclusion option (dbname, user, appname, etc.) is used. Thanks to suyah for the report.
• Fix fatal error when remote log file is 0 size. Thanks to Julien Rouhaud for the report.
• Allow pgbadger_tools --explain-slowest to automatically execute the EXPLAIN statements an report the plan. See pgbadger_tools --help for more explanation.
• Add --analyze option to replace EXPLAIN statements by EXPLAIN (ANALYZE, VERBOSE, BUFFERS).
• Move pgbadger_tools program and README.tools into the tools/ subdirectory with removing the extension. Add more comments and explanations.
• Fix case where die with interrupt signal is received when using -e option. Thanks to Lloyd Albin for the report.
• Add a new program pgbadger_tools to demonstrate how to deal with pgBadger binary files to build your own new feature. The first one 'explain-slowest' allow printing of top slowest queries as EXPLAIN statements.
• Keep tick formatting when zooming. Thanks to Julien Rouhaud for the patch.
• Fix automatic detection of rsyslogd logs. Thanks to David Day for the report.
• Fix issue in calculating min/max/avg in "General Activity" report. It was build on the sum of queries duration per minutes instead of each duration. Thanks to Jayadevan M for the report.
• The same issue remains with percentile that are build using the sum of duration per minutes and doesn't represent the real queries duration.
• This commit also include a modification in convert_time() method to reports milliseconds.
• Add -B or --bar-graph command line option to use bar instead of line in graph. Thanks to Bart Dopheide for the suggestion.
• Fix Checkpoint Wal files usage graph title.

What is new in version 6.2:

• This release fix some issues and adds some new features. It adds a new option -B or --bar-graph to use bar instead of line in graphs. It will also keep tick formatting when zooming.
• The release also add a new program: pgbadger_tools to demonstrate how to works with pgBadger binary files to build your own new feature. The first tools 'explain-slowest' allow printing of top slowest queries as EXPLAIN statements. There's also additionnal options to execute automatically the statements with EXPLAIN ANALYZE and get the execution plan. See help of the program for more information or the README file in the tools directory.
• Some modifications will change certain behavior:
• The -T | --title text value will now be displayed instead of the pgBadger label right after the logo. report. It was previously displayed on mouse over the pgBadger label.
• Changes:
• Change -T | --title position on pgBadger report. Title now override the pgBadger label. Thanks to Julien Rouhauld for the patch.
• Add --file-per-query and --format-query option to write each slowest query in separate file named qryXXX.sql and perform minimal formating of the queries. Thanks to Rodolphe Quiedeville for the patch.
• Remove debug query from explain-slowest tool.
• Fix surge in sessions number report when an exclusion or inclusion option (dbname, user, appname, etc.) is used. Thanks to suyah for the report.
• Fix fatal error when remote log file is 0 size. Thanks to Julien Rouhaud for the report.
• Allow pgbadger_tools --explain-slowest to automatically execute the EXPLAIN statements an report the plan. See pgbadger_tools --help for more explanation.
• Add --analyze option to replace EXPLAIN statements by EXPLAIN (ANALYZE, VERBOSE, BUFFERS).
• Move pgbadger_tools program and README.tools into the tools/ subdirectory with removing the extension. Add more comments and explanations.
• Fix case where die with interrupt signal is received when using -e option. Thanks to Lloyd Albin for the report.
• Add a new program pgbadger_tools to demonstrate how to deal with pgBadger binary files to build your own new feature. The first one 'explain-slowest' allow printing of top slowest queries as EXPLAIN statements.
• Keep tick formatting when zooming. Thanks to Julien Rouhaud for the patch.
• Fix automatic detection of rsyslogd logs. Thanks to David Day for the report.
• Fix issue in calculating min/max/avg in "General Activity" report. It was build on the sum of queries duration per minutes instead of each duration. Thanks to Jayadevan M for the report.
• The same issue remains with percentile that are build using the sum of duration per minutes and doesn't represent the real queries duration.
• This commit also include a modification in convert_time() method to reports milliseconds.
• Add -B or --bar-graph command line option to use bar instead of line in graph. Thanks to Bart Dopheide for the suggestion.
• Fix Checkpoint Wal files usage graph title.

What is new in version 5.0:

• This new major release adds some new features like incremental mode and a SQL queries times histogram.
• There is also an hourly graphic representation of the count and average duration of top normalized queries, and the same for errors or events (you will be able to see graphically at which hours they are occurring the most often).

What is new in version 4.1:

• This version fixes two major bugs and some other minor issues.
• There's also a new command line option --exclude-appname that allow exclusion from the report of queries generated by a specific program, like pg_dump.
• Documentation has been updated with a new chapter about building incremental reports.

What is new in version 4.0:

• This release comes with a bunch of new features including a complete overhaul for the HTML reports, some new statistics, compatibility with PostgreSQL 9.3, and Time Period Exclusion.

What is new in version 3.5:

• The last release of the 3.x branch, this is a bugfix release which also adds some pretty printing of the Y axis number on graphs and a new graph which groups queries duration series (which was shown as second Y axis on graphs), as well as a new graph with the number of temporary files (which was also used as second Y axis).

What is new in version 3.4:

• This version added many graphical improvements and improved rendering of logs over a few hours.
• Bugs were fixed, especially in reports of queries that generate the most temporary files.

What is new in version 3.3:

• This version adds four more useful reports about queries that generate locks and temporary files.
• Another new report about restart points and several bugsfixes or cosmetic changes.
• Support for parallel processing under Windows has been removed.

What is new in version 3.2:

• This is mainly a bugfix release, which also adds escaping of HTML code inside queries and adds Min/Max reports with Average duration in all queries reports.

What is new in version 3.1:

• This is a quick release to fix missing reports of most frequent errors and slowest normalized queries in the previous version published yesterday.

Requirements:

• Perl