Phoronix Test Suite

Phoronix Test Suite is a unique and open source application that allows anyone to effortlessly benchmark and stress test a wide range of hardware components under any Linux-based operating system.

It has been designed from the ground up by Michael Larabel who owns the Phoronix Media company, including the website with the same name, as a platform-independent application that supports Linux, BSD, Solaris, Microsoft Windows and Mac OS X operating systems.

An easy-to-use and clean benchmarking environment

The application provides users with an easy-to-use and clean benchmarking environment that enables them to create both high quality and quantitative tests for almost any hardware component, including graphics cards, hard disk drives, solid state drives, monitors, processors, RAM, sound cards, and many others.

The program integrates well with the OpenBenchmarking.org website, allowing users to upload results and compare benchmarks. Additionally, users can do side-by-side results comparisons and crowd-sourced aggregated results analysis.

Features at a glance

Key features include over 450 test profiles and 100 test suites, extensible (XML-based) testing architecture, automated test downloading and installation, state-of-the-art module-based plugin architecture, integrated results viewer, as well as support for SVG/PNG graph rendering and PDF result reports.

In addition, it comes with built-in dependency management support, embedded to cloud scale, in-depth hardware and software detection, autonomous batch mode support, result reporting and uploading, benchmark comparisons, module framework, system monitoring support, and comprehensive HTML documentation.

Another interesting feature is the integration with the Phoromatic remote management system, allowing users to run scheduled tests across multiple operating systems, run remote tests, as well as per-commit Git testing.

Bottom line

Considering the fact that, probably just like any other application out there, Phoronix Test Suite began as a simple set of scripts a decade ago, it had enough time to mature and become what it is today, the world’s most comprehensive benchmarking and testing platform for the open source ecosystem.

What is new in this release:

• Various minor BSD support improvements.
• A phoronix-test-suite list-not-installed-tests has been added for convenience of seeing tests available that aren't currently installed on the system, rather than using just list-installed-tests or list-tests.
• A phoronix-test-suite php-conf sub-command that just provides some PHP-related diagnostics information about PHP extensions being used or not.
• Detection for the QupZilla browser when no other browser or alias is present on the system for being able to auto-launch the results viewer.
• Phodevi has been support for reporting overclocked memory frequencies when properly exposed via dmidecode.
• The PTS External Dependencies XML has been added with optional dependency support for Python SciPy and Python SciKit Learn packages, which is needed by the new scikit-learn test profile.

What is new in version 6.2.0:

• New Phoromatic UI:
• Since the open-source Phoromatic Server was merged into the mainline Phoronix Test Suite code-base in Phoronix Test Suite 5, our test orchestration and management component has seen many significant additions throughout the 5.x releases. With Phoronix Test Suite 6.0, many new features continue to be added to the built-in Phoromatic server and client. One of the visible changes with Phoronix Test Suite 6.0 is that the site layout has been revised and there's initial support for mobile devices. The theme has also been updated to be more cohesive with the new result viewer and Phoronix Test Suite site layout.
• New Result Viewer:
• The local Phoronix Test Suite result viewer has been completely rewritten. Previously the viewer relied upon XSL for styling the result viewer, but with the browser support for it beginning to sway, the new viewer has been written to just utilize HTML and JavaScript for processing the XML result data. This new viewer has been tested on all major web-browsers and is working out much better. Beyond the internal changes, the default theme of the result viewer has been updated to better jive with the new Phoronix-Test-Suite.com site that rolled out some weeks ago.
• More Phoromatic Additions:
• The Phoromatic Server now has a new settings option for auto-authenticating new clients to automatically approve new systems attempting to connect to a Phoromatic account. The Phoromatic Server now also has support for exporting results as XML directly from the web interface, alongside the PDF and CSV result exporting. The Phoromatic Server also now has a test profiles page for showing basic test information along with results associated with a given test, similar to functionality found on OpenBenchmarking.org.
• Low-Level Improvements:
• A lot of the internal, low-level code of the Phoronix Test Suite's pts-core was significantly reworked. In fact, a lot of code that dates back to Phoronix Test Suite pre-1.0 was rewritten to take advantage of modern PTS interfaces and new PHP language features. This rework yields significant speed improvements (covered in the next section) while allowing for new functionality to be more easily implemented thanks to the cleaner and more streamlined code-base. When the Phoronix Test Suite was originally written, it wasn't designed around the yet-to-be-conceived OpenBenchmarking.org and Phoromatic while the new code does better accommodate these new components and other yet-to-be-announced features. In particular, Phoronix Test Suite 6.0 should respond much better for doing big data analytics on massive performance result sets.
• Greater Performance:
• While the pre-Hammerfest code works fine for all users running the Phoronix Test Suite individually and just running as many benchmarks to your delight on a system, the low-level re-work was driven in part for ensuring greater efficiency out of companies running their own internal Phoromatic or OpenBenchmarking.org servers. Phoronix Test Suite 6.0 may not seem much faster when you're just running a couple benchmarks on the system, but when rendering thousands of results in real-time for display, there's a dramatic speed-up.
• When using the Phoronix Test Suite's own self-hosting benchmarking (phoronix-test-suite debug-self-test or phoronix-test-suite benchmark pts-self-test for it in the self-hosting test profile mode), the performance improvements of Phoronix Test Suite 6.0 are quite clear. The total time of the test that stresses all of the hot code-paths of the software dropped from 617 seconds to complete to just over 200 seconds... In other words, about three times faster all through this Phoronix Test Suite update with the same PHP stack.
• One of the big focuses with the low-level re-work for Phoronix Test Suite 6.0 was on improving the graph rendering process: from the parsing of the result XML to generating the respective SVG or PNG graphs and then passing them off to the local result viewer, PDF result file, or dynamically serving them on OpenBenchmarking.org or Phoromatic. Thanks to the successful rework, the graph rendering process is significantly faster. With all of the internal tests done, this graph rendering process is about 4x faster than Phoronix Test Suite 5.8! If you're just running the Phoronix Test Suite locally you may not notice any difference when it already took less than one second, but on OpenBenchmarking.org where millions of graphs are rendered each month, it's a big impact on system resources. This is also of much benefit to our LinuxBenchmarking.com reference tracker where now it takes significantly less time to dynamically pull up a lot of historical benchmark results. For Phoromatic users, it will also mean much less time is needed when running large comparisons on existing results or looking at the performance of your systems under test for several months/years.
• Besides being much faster, pts-core uses significantly less memory during these heavy tasks. With Phoronix Test Suite 5.8.1 the peak memory usage came up to almost 1GB when rendering thousands of results at once while now with Phoronix Test Suite 6.0 the peak memory usage is around a 4x improvement. Again, this will be most dramatic for Phoromatic and OpenBenchmarking.org users.
• Lastly, another low-level improvement made was a big rework that happened within the graphing code (pts_Graph). The changes will allow for our graphs to be richer and more extensible moving forward, but an immediate win -- besides partially allowing the faster performance -- is that pts_Graph takes care of generating more-optimized SVG graphs. Common graph types are now roughly half the size as with previous versions of the Phoronix Test Suite. PNG/JPEG graphs continue to be supported for integration into PDF files as well as for supporting legacy web browsers.
• Reworked Sensor Monitoring:
• There was a significant rework to how the Phodevi's (Phoronix Device Interface) sensor monitoring works. The new sensor framework is now properly multi-threaded, much more extensible, and now also supports the dynamic creation of sensors in cases of desiring to monitor CPU usage or temperatures on a per-core basis rather than just the overall package or when looking to otherwise sub-divide the sensor data. The Phoronix Test Suite sensors behave in the same way via the MONITOR= environment variable and phoronix-test-suite system-sensors.
• Phodevi Support Additions:
• There's now support for the GPU thermal monitoring on more hardware (including the NVIDIA Jetson TX1), version detection for the X.Org Server running as non-root on Debian, NVMe solid-state storage detection, AMDGPU DRM detection, BcacheFS super-block detection, and more.
• Linux Perf Subsystem Module:
• There's a new module called linux_perf that supports reporting various Linux perf subsystem performance counters on a per-test-run basis. This module is automatically loaded when the LINUX_PERF=1 environment variable is set prior to running the Phoronix Test Suite.
• Performance-Per-Dollar Module:
• Another new Phoronix Test Suite module provides automated performance-per-dollar graphs based upon the user-supplied price information for the component/system under test. It's an easy way of running a cost analysis to complement the raw performance figures. This module is enabled automatically via the COST_PERF_PER_DOLLAR= environment variable and setting it to the dollar value desired for the current test run.
• Plus More:
• There's also various improvements in other areas of the Phoronix Test Suite, Windows support updates, DragonFlyBSD external dependency handling via DPorts pkg rather than pkgsrc, pass/fail testing improvements, the estimated date/time for test completion is now shown on the CLI besides the estimated time remaining, better support for stateless systems, and other smaller changes.

What is new in version 6.0.1 / 6.2.0 Milestone 5:

• New Phoromatic UI:
• Since the open-source Phoromatic Server was merged into the mainline Phoronix Test Suite code-base in Phoronix Test Suite 5, our test orchestration and management component has seen many significant additions throughout the 5.x releases. With Phoronix Test Suite 6.0, many new features continue to be added to the built-in Phoromatic server and client. One of the visible changes with Phoronix Test Suite 6.0 is that the site layout has been revised and there's initial support for mobile devices. The theme has also been updated to be more cohesive with the new result viewer and Phoronix Test Suite site layout.
• New Result Viewer:
• The local Phoronix Test Suite result viewer has been completely rewritten. Previously the viewer relied upon XSL for styling the result viewer, but with the browser support for it beginning to sway, the new viewer has been written to just utilize HTML and JavaScript for processing the XML result data. This new viewer has been tested on all major web-browsers and is working out much better. Beyond the internal changes, the default theme of the result viewer has been updated to better jive with the new Phoronix-Test-Suite.com site that rolled out some weeks ago.
• More Phoromatic Additions:
• The Phoromatic Server now has a new settings option for auto-authenticating new clients to automatically approve new systems attempting to connect to a Phoromatic account. The Phoromatic Server now also has support for exporting results as XML directly from the web interface, alongside the PDF and CSV result exporting. The Phoromatic Server also now has a test profiles page for showing basic test information along with results associated with a given test, similar to functionality found on OpenBenchmarking.org.
• Low-Level Improvements:
• A lot of the internal, low-level code of the Phoronix Test Suite's pts-core was significantly reworked. In fact, a lot of code that dates back to Phoronix Test Suite pre-1.0 was rewritten to take advantage of modern PTS interfaces and new PHP language features. This rework yields significant speed improvements (covered in the next section) while allowing for new functionality to be more easily implemented thanks to the cleaner and more streamlined code-base. When the Phoronix Test Suite was originally written, it wasn't designed around the yet-to-be-conceived OpenBenchmarking.org and Phoromatic while the new code does better accommodate these new components and other yet-to-be-announced features. In particular, Phoronix Test Suite 6.0 should respond much better for doing big data analytics on massive performance result sets.
• Greater Performance:
• While the pre-Hammerfest code works fine for all users running the Phoronix Test Suite individually and just running as many benchmarks to your delight on a system, the low-level re-work was driven in part for ensuring greater efficiency out of companies running their own internal Phoromatic or OpenBenchmarking.org servers. Phoronix Test Suite 6.0 may not seem much faster when you're just running a couple benchmarks on the system, but when rendering thousands of results in real-time for display, there's a dramatic speed-up.
• When using the Phoronix Test Suite's own self-hosting benchmarking (phoronix-test-suite debug-self-test or phoronix-test-suite benchmark pts-self-test for it in the self-hosting test profile mode), the performance improvements of Phoronix Test Suite 6.0 are quite clear. The total time of the test that stresses all of the hot code-paths of the software dropped from 617 seconds to complete to just over 200 seconds... In other words, about three times faster all through this Phoronix Test Suite update with the same PHP stack.
• One of the big focuses with the low-level re-work for Phoronix Test Suite 6.0 was on improving the graph rendering process: from the parsing of the result XML to generating the respective SVG or PNG graphs and then passing them off to the local result viewer, PDF result file, or dynamically serving them on OpenBenchmarking.org or Phoromatic. Thanks to the successful rework, the graph rendering process is significantly faster. With all of the internal tests done, this graph rendering process is about 4x faster than Phoronix Test Suite 5.8! If you're just running the Phoronix Test Suite locally you may not notice any difference when it already took less than one second, but on OpenBenchmarking.org where millions of graphs are rendered each month, it's a big impact on system resources. This is also of much benefit to our LinuxBenchmarking.com reference tracker where now it takes significantly less time to dynamically pull up a lot of historical benchmark results. For Phoromatic users, it will also mean much less time is needed when running large comparisons on existing results or looking at the performance of your systems under test for several months/years.
• Besides being much faster, pts-core uses significantly less memory during these heavy tasks. With Phoronix Test Suite 5.8.1 the peak memory usage came up to almost 1GB when rendering thousands of results at once while now with Phoronix Test Suite 6.0 the peak memory usage is around a 4x improvement. Again, this will be most dramatic for Phoromatic and OpenBenchmarking.org users.
• Lastly, another low-level improvement made was a big rework that happened within the graphing code (pts_Graph). The changes will allow for our graphs to be richer and more extensible moving forward, but an immediate win -- besides partially allowing the faster performance -- is that pts_Graph takes care of generating more-optimized SVG graphs. Common graph types are now roughly half the size as with previous versions of the Phoronix Test Suite. PNG/JPEG graphs continue to be supported for integration into PDF files as well as for supporting legacy web browsers.
• Reworked Sensor Monitoring:
• There was a significant rework to how the Phodevi's (Phoronix Device Interface) sensor monitoring works. The new sensor framework is now properly multi-threaded, much more extensible, and now also supports the dynamic creation of sensors in cases of desiring to monitor CPU usage or temperatures on a per-core basis rather than just the overall package or when looking to otherwise sub-divide the sensor data. The Phoronix Test Suite sensors behave in the same way via the MONITOR= environment variable and phoronix-test-suite system-sensors.
• Phodevi Support Additions:
• There's now support for the GPU thermal monitoring on more hardware (including the NVIDIA Jetson TX1), version detection for the X.Org Server running as non-root on Debian, NVMe solid-state storage detection, AMDGPU DRM detection, BcacheFS super-block detection, and more.
• Linux Perf Subsystem Module:
• There's a new module called linux_perf that supports reporting various Linux perf subsystem performance counters on a per-test-run basis. This module is automatically loaded when the LINUX_PERF=1 environment variable is set prior to running the Phoronix Test Suite.
• Performance-Per-Dollar Module:
• Another new Phoronix Test Suite module provides automated performance-per-dollar graphs based upon the user-supplied price information for the component/system under test. It's an easy way of running a cost analysis to complement the raw performance figures. This module is enabled automatically via the COST_PERF_PER_DOLLAR= environment variable and setting it to the dollar value desired for the current test run.
• Plus More:
• There's also various improvements in other areas of the Phoronix Test Suite, Windows support updates, DragonFlyBSD external dependency handling via DPorts pkg rather than pkgsrc, pass/fail testing improvements, the estimated date/time for test completion is now shown on the CLI besides the estimated time remaining, better support for stateless systems, and other smaller changes.

What is new in version 6.0.0:

• New Phoromatic UI:
• Since the open-source Phoromatic Server was merged into the mainline Phoronix Test Suite code-base in Phoronix Test Suite 5, our test orchestration and management component has seen many significant additions throughout the 5.x releases. With Phoronix Test Suite 6.0, many new features continue to be added to the built-in Phoromatic server and client. One of the visible changes with Phoronix Test Suite 6.0 is that the site layout has been revised and there's initial support for mobile devices. The theme has also been updated to be more cohesive with the new result viewer and Phoronix Test Suite site layout.
• New Result Viewer:
• The local Phoronix Test Suite result viewer has been completely rewritten. Previously the viewer relied upon XSL for styling the result viewer, but with the browser support for it beginning to sway, the new viewer has been written to just utilize HTML and JavaScript for processing the XML result data. This new viewer has been tested on all major web-browsers and is working out much better. Beyond the internal changes, the default theme of the result viewer has been updated to better jive with the new Phoronix-Test-Suite.com site that rolled out some weeks ago.
• More Phoromatic Additions:
• The Phoromatic Server now has a new settings option for auto-authenticating new clients to automatically approve new systems attempting to connect to a Phoromatic account. The Phoromatic Server now also has support for exporting results as XML directly from the web interface, alongside the PDF and CSV result exporting. The Phoromatic Server also now has a test profiles page for showing basic test information along with results associated with a given test, similar to functionality found on OpenBenchmarking.org.
• Low-Level Improvements:
• A lot of the internal, low-level code of the Phoronix Test Suite's pts-core was significantly reworked. In fact, a lot of code that dates back to Phoronix Test Suite pre-1.0 was rewritten to take advantage of modern PTS interfaces and new PHP language features. This rework yields significant speed improvements (covered in the next section) while allowing for new functionality to be more easily implemented thanks to the cleaner and more streamlined code-base. When the Phoronix Test Suite was originally written, it wasn't designed around the yet-to-be-conceived OpenBenchmarking.org and Phoromatic while the new code does better accommodate these new components and other yet-to-be-announced features. In particular, Phoronix Test Suite 6.0 should respond much better for doing big data analytics on massive performance result sets.
• Greater Performance:
• While the pre-Hammerfest code works fine for all users running the Phoronix Test Suite individually and just running as many benchmarks to your delight on a system, the low-level re-work was driven in part for ensuring greater efficiency out of companies running their own internal Phoromatic or OpenBenchmarking.org servers. Phoronix Test Suite 6.0 may not seem much faster when you're just running a couple benchmarks on the system, but when rendering thousands of results in real-time for display, there's a dramatic speed-up.
• When using the Phoronix Test Suite's own self-hosting benchmarking (phoronix-test-suite debug-self-test or phoronix-test-suite benchmark pts-self-test for it in the self-hosting test profile mode), the performance improvements of Phoronix Test Suite 6.0 are quite clear. The total time of the test that stresses all of the hot code-paths of the software dropped from 617 seconds to complete to just over 200 seconds... In other words, about three times faster all through this Phoronix Test Suite update with the same PHP stack.
• One of the big focuses with the low-level re-work for Phoronix Test Suite 6.0 was on improving the graph rendering process: from the parsing of the result XML to generating the respective SVG or PNG graphs and then passing them off to the local result viewer, PDF result file, or dynamically serving them on OpenBenchmarking.org or Phoromatic. Thanks to the successful rework, the graph rendering process is significantly faster. With all of the internal tests done, this graph rendering process is about 4x faster than Phoronix Test Suite 5.8! If you're just running the Phoronix Test Suite locally you may not notice any difference when it already took less than one second, but on OpenBenchmarking.org where millions of graphs are rendered each month, it's a big impact on system resources. This is also of much benefit to our LinuxBenchmarking.com reference tracker where now it takes significantly less time to dynamically pull up a lot of historical benchmark results. For Phoromatic users, it will also mean much less time is needed when running large comparisons on existing results or looking at the performance of your systems under test for several months/years.
• Besides being much faster, pts-core uses significantly less memory during these heavy tasks. With Phoronix Test Suite 5.8.1 the peak memory usage came up to almost 1GB when rendering thousands of results at once while now with Phoronix Test Suite 6.0 the peak memory usage is around a 4x improvement. Again, this will be most dramatic for Phoromatic and OpenBenchmarking.org users.
• Lastly, another low-level improvement made was a big rework that happened within the graphing code (pts_Graph). The changes will allow for our graphs to be richer and more extensible moving forward, but an immediate win -- besides partially allowing the faster performance -- is that pts_Graph takes care of generating more-optimized SVG graphs. Common graph types are now roughly half the size as with previous versions of the Phoronix Test Suite. PNG/JPEG graphs continue to be supported for integration into PDF files as well as for supporting legacy web browsers.
• Reworked Sensor Monitoring:
• There was a significant rework to how the Phodevi's (Phoronix Device Interface) sensor monitoring works. The new sensor framework is now properly multi-threaded, much more extensible, and now also supports the dynamic creation of sensors in cases of desiring to monitor CPU usage or temperatures on a per-core basis rather than just the overall package or when looking to otherwise sub-divide the sensor data. The Phoronix Test Suite sensors behave in the same way via the MONITOR= environment variable and phoronix-test-suite system-sensors.
• Phodevi Support Additions:
• There's now support for the GPU thermal monitoring on more hardware (including the NVIDIA Jetson TX1), version detection for the X.Org Server running as non-root on Debian, NVMe solid-state storage detection, AMDGPU DRM detection, BcacheFS super-block detection, and more.
• Linux Perf Subsystem Module:
• There's a new module called linux_perf that supports reporting various Linux perf subsystem performance counters on a per-test-run basis. This module is automatically loaded when the LINUX_PERF=1 environment variable is set prior to running the Phoronix Test Suite.
• Performance-Per-Dollar Module:
• Another new Phoronix Test Suite module provides automated performance-per-dollar graphs based upon the user-supplied price information for the component/system under test. It's an easy way of running a cost analysis to complement the raw performance figures. This module is enabled automatically via the COST_PERF_PER_DOLLAR= environment variable and setting it to the dollar value desired for the current test run.
• Plus More:
• There's also various improvements in other areas of the Phoronix Test Suite, Windows support updates, DragonFlyBSD external dependency handling via DPorts pkg rather than pkgsrc, pass/fail testing improvements, the estimated date/time for test completion is now shown on the CLI besides the estimated time remaining, better support for stateless systems, and other smaller changes.

What is new in version 5.8.0:

• MIPS support improvements
• Faster rendering of result files and other data processing improvements
• Stress-run improvements
• System sensor monitoring via the Phoromatic UI
• Addition of the Phoromatic Results Export Viewer
• Various Linux hardware & software detection improvements
• Allow Phoronix Test Suite clients to be self-updated via update script passed from the Phoromatic Server
• Mongoose web server support for the Phoromatic Server's HTTP instance
• Support viewing system client logs via the Phoromatic Server UI
• Numerous other improvements to Phoromatic

What is new in version 5.6.0 / 5.8.0 Milestone 5:

• pts-core: Start moving possible deployment scripts into deploy/ directory
• pts-core: Move phoromatic-client and phoromatic-server Upstart job files to deploy/
• pts-core: Move phoromatic-client and phoromatic-server systemd service files to deploy/
• pts-core: Add very basic result-file-to-json sub-command
• pts-core: Drop AnonymousHardwareReporting / AnonymousSoftwareReporting as no longer used on OpenBenchmarking.org
• Pull in JuJu scripts from https://github.com/juju-solutions/pts to deploy/juju
• phodevi: More allowance for clients to recover Internet connection / server communication failure
• phoromatic: Clean-up main page schedule for schedules with no associated systems
• phoromatic: Show matching ticket results in the compare results column on results page
• phoromatic: Allow results page to be limited to particular hash or ticket matches
• phoromatic: Allow results page search box to also search system's hardware/software components
• phoromatic: Fix for removing a system from all groups on the "system group editing" systems page
• phoromatic: Allow per-system overriding of whether automatic power-offs of system are permitted
• phoromatic: Get rid of block-poweroff file check in client module now that it can be done per-system from server-side
• phoromatic: Allow WoL power-ups for honoring benchmark tickets
• phoromatic: Unify more code from start.php into phoromatic_server
• phoromatic: Always unset the GRUB recordfail when applicable
• phoromatic: Add "System Maintenance Table"
• phoromatic: Add "PowerOnSystemDaily" setting option to ensure regardless of schedule that systems will at least power-up/communicate daily if enabled
• phoromatic: New checkbox handling on results page to manage comparisons and multi-delete results
• phoromatic: Start work on new main page

What is new in version 5.6.0 / 5.8.0 Milestone 1:

• pts-core: Start moving possible deployment scripts into deploy/ directory
• pts-core: Move phoromatic-client and phoromatic-server Upstart job files to deploy/
• pts-core: Move phoromatic-client and phoromatic-server systemd service files to deploy/
• pts-core: Add very basic result-file-to-json sub-command
• pts-core: Drop AnonymousHardwareReporting / AnonymousSoftwareReporting as no longer used on OpenBenchmarking.org
• Pull in JuJu scripts from https://github.com/juju-solutions/pts to deploy/juju
• phodevi: More allowance for clients to recover Internet connection / server communication failure
• phoromatic: Clean-up main page schedule for schedules with no associated systems
• phoromatic: Show matching ticket results in the compare results column on results page
• phoromatic: Allow results page to be limited to particular hash or ticket matches
• phoromatic: Allow results page search box to also search system's hardware/software components
• phoromatic: Fix for removing a system from all groups on the "system group editing" systems page
• phoromatic: Allow per-system overriding of whether automatic power-offs of system are permitted
• phoromatic: Get rid of block-poweroff file check in client module now that it can be done per-system from server-side
• phoromatic: Allow WoL power-ups for honoring benchmark tickets
• phoromatic: Unify more code from start.php into phoromatic_server
• phoromatic: Always unset the GRUB recordfail when applicable
• phoromatic: Add "System Maintenance Table"
• phoromatic: Add "PowerOnSystemDaily" setting option to ensure regardless of schedule that systems will at least power-up/communicate daily if enabled
• phoromatic: New checkbox handling on results page to manage comparisons and multi-delete results
• phoromatic: Start work on new main page

What is new in version 5.4.1 / 5.6 Milestone 3:

• phoromatic: Allow triggers to be deleted
• phoromatic: Rely on caching for determining pre-existing cached test profiles from the web UI
• phoromatic: Add result RSS support
• phoromatic: Add new option to results page
• phoromatic: Enforce new PTS sign-on whenever the PTS core version changes due to potential interface changes
• phoromatic: Working build suite page
• phoromatic: Add support for local suites page
• phoromatic: Add benchmark page
• phoromatic: Add support for viewing issued benchmark tickets
• phoromatic: Add option to force rebuild of results databases
• phoromatic: Prepend system ID to result string when running multiple tests without variables

What is new in version 5.6 Milestone 1:

• pts-core: Add "short" display mode
• pts-core: Add stress-run command to allow for concurrent stress testing / burn-in / torture testing
• pts-core: Add TOTAL_LOOP_TIME support to stress-run
• pts-core: Add TOTAL_LOOP_TIME=infinite support to stress-run for testing in an infinite loop
• pts-core: Add support for libframetime output result parsing
• phoromatic: Initial commit of basic tracker page
• phoromatic: Better recovery of existing Phoromatic accounts on reloaded systems where the machine self ID changed
• timed_screenshot: Fix for crash when PHP GD missing

What is new in version 5.4.1:

• Updated AppData XML for the Phoronix Test Suite.
• The result parser in pts-core now has improved support for parsing CSV frame latency dumps as needed by newer test profiles, currently is needed by the new test of Civilization: Beyond Earth.
• The phoronix-test-suite enterprise-setup sub-command. See the documentation for more details.
• Various Phoromatic Server updates, including improved result strings when merging random result files, reporting of the IP/MAC addresses on the system claim page, and other minor enhancements.

What is new in version 5.4.0:

• Major overhaul to the built-in Phoromatic Server
• Avahi zero-conf networking support
• Improved download cache handling
• IBM POWER8 hardware detection improvements
• Various code refactoring & other improvements

What is new in version 5.4.0 Milestone 6:

• pts-core: Fix result merging when PTS test identifier is null, use title string instead as identifier
• pts-core: Check for PHP Sockets support
• pts-core: Enhanced make-download-cache
• pts-core: Enhance PHP_BIN detection
• pts-core: Use system's zip library if PHP ZIP is not available
• phoromatic: Upstart phoromatic-server job is working (tested on Scientific Linux 6.6)
• phoromatic: Add "Run Test Schedule Now" button to test schedule page to allow for easy one-time/manual testing
• phoromatic: Add some basic statistics to the rootadmin page
• phoromatic: Allow the PhoromaticStorage location to be modified from the webUI when logging in as rootadmin
• phoromatic: Allow the download cache location to be modified from the webUI when logging in as rootadmin
• phoromatic: Allow the network proxy details to be modified from the webUI when logging in as rootadmin
• phoromatic: Allow the HTTP / WebSocket ports to be modified from the webUI when logging in as rootadmin
• phoromatic: Increase memory_limit on download cache downloads
• phoromatic: Expose all possible video modes as test options
• phoromatic: Show recent triggers on a test schedule's page
• phoromatic: Add "Upload results to OpenBenchmarking.org" option to settings page
• phoromatic: Fix for deactivating options on settings page
• phoromatic: Remember last successful Phoromatic Server connection
• phoromatic: Add reboot and shutdown commands to Phoromatic module

What is new in version 5.4.0 Milestone 5:

• pts-core: Improvements when running as a systemd service / daemon
• pts-core: Prefer firefox over Epiphany browser
• phoromatic: Implement email notifications on result uploads
• phoromatic: Implement email notifications on system generated errors/warnings
• phoromatic: Implement email notifications on new systems added
• phoromatic: Allow easily comparing a result file to other results for that given schedule ID
• phoromatic: Improve formatting of lists
• phoromatic: Add times viewed to results
• phoromatic: Add "show only results with variation" to result viewing page
• phoromatic: Add result flagging to the main page
• phoromatic: Allow other/unscheduled test results to be uploaded to the Phoromatic Server using the phoromatic.upload-result sub-command
• phoromatic: Show file/path locations when starting the Phoromatic Server
• phoromatic: Use a randomly chosen available port by default when starting the Phoromatic Server if no ports are defined
• phoromatic: Add basic root administrator support to the Phoronix web interface
• pts_Graph: Shrink size of sub-title text strings when they're too long

What is new in version 5.4.0 Milestone 4:

• pts-core: Add 3840 x 2160 (4K UHD) to more of the mode-setting fall-back modes
• pts-core: Start working on support for using standard Linux file-system hierarchy when running as root as a service
• pts-core: Add PhoromaticStorage option to Phoronix Test Suite user configuration XML file
• phoromatic: Reporting of overall result counts for given test schedules
• phoromatic: Report benchmarking / test run errors to server
• phoromatic: Show system errors/warnings from the Phoromatic web UI
• phoromatic: Don't attempt to re-run test schedules on clients if they previously reported errors/warnings for that schedule / trigger ID combination
• phoromatic: Usernames need to be at least four characters long
• phoromatic: Add a schedule overview to the schedules page
• phoromatic: Add today's scheduled events to the side bar
• phoromatic: Improve result identifier / title reporting for results
• phoromatic: Implement "Power User" account level
• phoromatic: Add normalize results option to the phoromatic result page
• phoromatic: Support for jumping to test results page for XXX past days of test from schedule page
• phodevi: IBM POWER hardware detection improvements

What is new in version 5.4.0 Milestone 3:

• Refinements to the Phoromatic web-user interface.
• Basic service logging capabilities for Phoromatic client/servers initiated by systemd, etc.
• Support for attempting to download files multiple times from remote download caches in case of connection/service failures.
• A new scheduler creation interface from the Phoromatic web UI along with complete editing support.
• Re-working of the "system groups" Phoromatic feature and should now be fully working and feature complete.
• Support for Phoromatic users to create multiple users associated with the same account data, including support for "viewer accounts" that can view but not manipulate the account data.
• An activity stream for showing Phoromatic user data associated with a particular account.
• Support for merging results from the Phoromatic web UI.
• Support for deleting results from the Phoromatic web UI.
• Other improvements and refinements to the Phoronix Test Suite and Phoromatic code.

What is new in version 5.4.0 Milestone 1:

• pts-core: Sanitize pts_result_file user strings
• pts-core: Don't set memory_limit with HHVM
• pts-core: Drop phoromatic_legacy support (old Phoromatic.com version)
• system_monitor: Correct perf-per-Watt calculation for LIB results
• phodevi: Support Nouveau's pstate formatting changes to read core/mem MHz on newer kernels
• phodevi: Support for reading monitor EDID over sysfs, decoding descriptors, and obtaining monitor name (should improve monitor name reporting for Intel Linux systems)
• phodevi: Improved SoC detection
• pts_LineGraph: Alignment fix for keys

What is new in version 5.2.1:

• pts-core: Add VDPAU as a dependency to the xorg-video external dependency on more platforms
• pts-core: Don't check OpenBenchmarking.org credentials when the network is down
• pts-core: Rework result-file-to-text sub-command, show text-based graph results
• phodevi: Improve NVIDIA binary driver GPU utilization detection
• phodevi: Add DDE / Deepin Desktop Environment detection
• pts_Graph: Few minor graph alignment corrections

What is new in version 5.2.0:

• Tech Preview / Experimental Built-In Phoromatic Server
• Result graphing improvements, including new box plot graphs
• Phodevi software & hardware detection improvements
• Phodevi Radeon GPU usage reporting via RadeonTOP
• New Phoronix Test Suite sub-command options
• Bug-fixes and other minor enhancements

What is new in version 5.2 Milestone 4:

• pts-core: Always report the CPU scaling governor to the system table
• pts-core: Add auto-sort-result-file option
• phoromatic: Improve the systems' page
• phoromatic: Allow up to three connection failures before quitting
• pts_Graph: Improved, cleaner, and more accurate rendering of the pts_OverViewGraph
• pts_Graph: Make the horizontal box chart graph in good shape
• pts_Graph: Revert earlier render_graph_value_ticks() change by mufasa72 as it produced inaccurate tick values
• pts_Graph: use the horizontal box plot when rendering frame times for large number of results
• pts_Graph: Various other graphing improvements

What is new in version 5.2 Milestone 2:

• pts-core: Add RUN_TESTS_IN_RANDOM_ORDER environment variable to cause tests to run in a random order
• pts-core: Add sdl2-development to PTS External Dependencies
• pts-core: Fix regression from 5.2m1 that broke some areas of the GUI / web interface
• pts_Graph: Render min/avg/max stats at top of line graphs (thanks to mufasa72)

What is new in version 5.2 Milestone 1:

• The most notable work going on with Phoronix Test Suite 5.2 is the porting of Phoromatic to the modern PTS interfaces. With Phoronix Test Suite 5.2 it's possible to launch a local Phoromatic server instance via simply running phoronix-test-suite start-phoromatic-server and from there it will self-host all of its needs (with the only possible new requirement being PHP5 SQLite support). However, for today's first milestone release the support isn't quite in shape. The web interface is very different from the former Phoromatic code and I'm still porting the code to work with the new interfaces.
• The new Phoromatic code with PTS 5.2m1 will work with for setting up systems and basic scheduling but isn't yet functional. Hopefully in the next week will have all of the code fully-functional against the latest PTS interfaces. Ideally there won't be any API or database schema breaks but I am not making any guarantees prior to the official 5.2.0 release. For organizations needing to host their results "behind the firewall" and outside of the OpenBenchmarking.org spectrum that will still require a commercial support license via the Phoronix Test Suite.
• Besides the ongoing Phoromatic porting to support a self-hosting server from the Phoronix Test Suite client, other changes include various fixes, better support for outside environment variables, support for a range of test inputs to be supported, batch-run fixes, improvements for NVIDIA GPU core frequency detection on modern GPUs, and GPU usage reporting via the optional radeontop binary.

What is new in version 5.0.1:

• More helpers have been added when entering invalid arguments to various phoronix-test-suite sub-commands.
• External dependency improvements (32/64-bit Ubuntu fixes, added PCRE throughout).
• HTTPS OpenBenchmarking.org communication is disabled by default to workaround reported proxy issues.
• A edit-result-file sub-command has been added for changing a saved result file's title and description strings after the testing process. There's also a fix for ensuring result file descriptions properly update.
• An AppData file is now shipped with the Phoronix Test Suite.
• Various Arch Linux benchmarking improvements in better handling its stock PHP configuration and other system differences.
• Other minor enhancements.

What is new in version 5.0.0 Milestone 1:

• pts-core: Add web-server-launcher support
• pts-core: Support starting HHVM as a web server
• pts-core: Startup speed optimizations
• pts-core: Cleaned up code error reporting/handling
• pts-core: Add server remote access and password options to user-config.xml user configuration options
• pts-core: Adjust handling of PTS OpenBenchmarking.org downloading of test profile order and hash handling
• pts-core: Reduce unnecessary communication with OpenBenchmarking.org network server
• pts-core: Support system identifier strings up to 64 characters
• pts-core: Add LIMIT_ELAPSED_TEST_TIME to limit the amount of time (in minutes) for a given Phoronix Test Suite process to complete its testing
• pts-core: Allow null descriptor strings
• pts-core: Fix regex for version string
• pts-core: Random fixes
• phodevi: Various improvements
• phodevi: Improved disk scheduler fallback reporting
• documentation: Update to point out new Git location at github.com/phoronix-test-suite/ over Phorogit
• nye_Xml: Fix for writing zeros in XML tags when using the "when not empty" function

What is new in version 4.8.6:

• DragonFlyBSD 3.6.0 support improvements.
• Support for passing of test arguments to pre/interim/post test profile script hooks and support for debugging of these scripts within the existing debug-run mode.
• Improvements for reading the terminal width. There's also some minor text formatting tweaks.
• Phoronix Device Interface (Phodevi) improvements of reading monitor information on the binary NVIDIA Linux driver, improved multi-monitor resolution detection under X11 environments, and other tweaks.
• Various bug-fixes.

What is new in version 4.8.5:

• pts-core: Improve formatting of interrupt messages with the (default) concise display mode
• pts-core: Don't remove test install files on installation failures
• pts-core: Allow download-test-files command to use OpenBenchmarking.org IDs
• pts-core: Don't dynamically increase the test run count when dealing with cache shares
• pts-core: Fix for not opening the web-browser in batch mode
• pts-core: Add zypper SUSE help support when not finding PHP
• phodevi: Add support for Nouveau PSTATE parsing on Linux 3.13+
• phodevi: Recognize 'HIS' (Hightech Information System) graphics cards
• phodevi: Recognize 'ZOTAC' graphics cards
• phodevi: Fix redundant monitor model reporting detection on Catalyst
• phodevi: Add support for NVIDIA-Settings GPUUtilization in gpu.usage sensor