Version 6.3.1

Enhancements

• Allow for random IO workloads via fio (#67)

Fixes

• Replaced the base Docker image with a CUDA base from NGC to resolve a container build issue (#39, #82)

Dependency Updates

• Upgraded urllib3 to 1.26.5 (#81)

Version 6.3.0

Enhancements

• Added support for 125KB IO workload to FIO (#73)

Fixes

• Added six as a dependency for the wheel as docker-py throws errors without it after a recent update (#78)

Version 6.2.0

Enhancements

• Add and document common non-zero exit codes (#25)
• Added parser for mdtest results (#41, #42)
• Added a tool to ensure all passed hosts are unique to avoid running multiple tests on the same host (#46)
• Added instructions on running Bobber on non-DGX platforms (#56)
• Added steps for installing via nvidia-pyindex (#51)
• Annotated the analysis sub-module (#43)
• Added baseline for DGX A100 PODs up to 8 nodes (#52)
• Augmented Docker error handling (#48)
• Allow pauses between tests to allow filesystem cleanup to occur (#44)
• Automatically generate a baseline file based on parsed results (#55)
• Optionally save JSON data from the parser to reduce bloat (#62)
• Added GitLab Continuous Integration support to run tests against GPUs (#75)

Fixes

• Removed the NCCL-max default from the parser to apply the system defaults (#64)
• Fixed the filename for FIO IOPs tests (#72)
• Fixed an issue creating TFRecords with Imageinary (#76)

Dependency Updates

• Upgraded Imageinary to 1.1.2 (#59)

Known Issues

• Recent versions of docker-py throw errors as they rely on a dependency to be installed that isn't listed. To workaround this, either upgrade to version 6.3.0 or newer of Bobber or manually install six.

Version 6.1.1

Fixes

• Added a flag to skip a false-positive for a security issue (#37)
• Updated the MLPerf parser path in the documentation (#34)
• Fixed error thrown while using run-all command (#32)

Version 6.1.0

Enhancements

• Updated MLPerf RN50 parser to display filesystem path under test (#29)
• Added documentation on building from source (#23)
• Added a --version flag (#27)
• Added a custom baseline config tool (#17)
• Renamed the Docker document (#13)
• Added a --verbose flag to the results parser (#6)
• Added support for GitHub Actions (#4)

Fixes

• Removed unused commands from the package (#18)
• Now handling errors while attempting to parse results from an empty directory (#21)
• Fixed an issue with the wheel's metadata information (#24)
• Removed memory restriction on containers which caused issues with IOPS tests for dual-socket systems (#22)

Known Issues

• Attempting to run the run-all command will throw an error (see #31). A temporary workaround is to run the individual run-X commands where X is individual tests.

Version 6.0.0

Initial public release of Bobber

Known Issues

• For default --iops-threads values on dual-socket systems, the fio IOPS test will occasionally timeout and terminate the test prematurely. See #20.