v5.0.0

v5.0.0 - No More Ginkgo

Our first release of 2024 is a big one. We are releasing our first v5.x.x release, now without the ginkgo dependency. A lot of work has gone into removing this underlying dependency from the test suite. As far as the end-user knows, everything should act very similar to the previous v4.x.x releases.

The CLI has undergone a good quality-of-life update as well which now shows each test and its corresponding Passed/Failed/Skipped state in realtime.

Bug Fixes

• Fix for the webserver kubeconfig file handling. by @greyerof in #1625
• Graceful exit when no kubeconfig is configured by @edcdavid in #1668
• Revert "Only capture ctrl-c while tests are running" by @edcdavid in #1693
• Only capture ctrl-c while tests are running by @edcdavid in #1694
• Only capture ctrl-c while tests are running by @edcdavid in #1699
• Move flags processing to run function by @edcdavid in #1696
• The find command requires a directory as the first argument by @rdavid in #1709
• Add operator versions by @rdavid in #1708
• Rename poststart test by @edcdavid in #1698
• Fix for fatal error in diagnostics by @edcdavid in #1715
• give precedence to the KUBECONFIG variable instead of the $HOME/.kube/config kubeconfig by @edcdavid in #1755
• autodiscover: delete deprecated default operator label by @jmontesi in #1760
• Bug fix: adjust logic in testPodClusterRoleBindings by @jmontesi in #1792

WebServer Improvements

• webserver: add implementation for uploading tnf config file and add all the fields by @aabughosh in #1644
• webserver: add tests as a table allowing the user to select an option by @aabughosh in #1662

Unit Tests

• Remove gotools; adjust expected/actual by @sebrandon1 in #1667
• Additional unit test coverage by @sebrandon1 in #1780

Documentation Improvements

• docs: add CNFCERT demo by @jmontesi in #1757
• docs: fix CNFCERT demo path by @jmontesi in #1758

Claim File Output Improvements

• Switch to 1-to-1 TestID to Result struct by @sebrandon1 in #1666
• re-add logs in claim file by @edcdavid in #1725
• flags: change "claimloc" for "output-dir" by @jmontesi in #1726
• version: bump claim file format version by @jmontesi in #1738

CLI Improvements

• cli: display information about the CNFCERT run by @jmontesi in #1690
• CLI output improvements: check's elapsed time and last log trace. by @greyerof in #1745
• CLI output: non-tty mode improvements. by @greyerof in #1750
• cli: fix typo in skip reason by @jmontesi in #1756
• cli: cover all possible skip paths to print it in the CLI output by @jmontesi in #1765

Logging Improvements

• log: add new log package that uses slog as global logger by @jmontesi in #1663
• log: remove logrus and migrate all logs to slog by @jmontesi in #1703
• log: add log file to the results tar archive by @jmontesi in #1710
• log: set the configured log level to multiloggers by @jmontesi in #1711
• log: remove loghelper package by @jmontesi in #1721
• observability: review logs by @jmontesi in #1761
• manageability: review logs by @jmontesi in #1770
• operator: review logs by @jmontesi in #1772
• performance: review logs by @jmontesi in #1777
• networking: review logs by @jmontesi in #1782
• certification: review logs by @jmontesi in #1783
• access-control: review logs by @jmontesi in #1787
• platform: review logs by @jmontesi in #1791
• lifecycle: logs review by @jmontesi in #1789
• preflight: review logs by @jmontesi in #1793

Parser Improvements

• Bump parser version to v0.2.0 by @edcdavid in #1676
• extracts results.html from tar.gz and debug mode by @edcdavid in #1706
• update the version of the claim release by @aabughosh in #1784

CI Improvements

• Switch gradetool image to latest by @sebrandon1 in #1681
• Enable QE nightlies for ginkgo_removal by @sebrandon1 in #1723
• Revert "Enable QE nightlies for ginkgo_removal" by @sebrandon1 in #1724
• Enable QE PR tests by @sebrandon1 in #1748
• Remove self-hosted, kind-based QE nightlies by @sebrandon1 in #1776
• Add retries for -partner setup calls by @sebrandon1 in #1775
• Adjust the directories cleaned up in QE nightlies by @sebrandon1 in #1806

Operator Tool Improvements

• Updating Telco list by @edcdavid in #1712
• skip operator if claim file couldn't be parsed by @edcdavid in #1714
• batch operator script - fix long term errors by @edcdavid in #1741

ginkgo_removal work

• Dependency updates for ginkgo removal branch by @sebrandon1 in #1615
• ginkgo_removal branch: enable github checks on new PRs. by @greyerof in #1608
• Fixed deadlock in check.SetResult(). by @greyerof in #1619
• Transition manageability suite to ginkgoless by @sebrandon1 in #1614
• Transition performance suite to ginkgoless. by @greyerof in #1620
• Transition certification suite to ginkgoless. by @greyerof in #1622
• Rebase the ginkgo_removal branch with main by @sebrandon1 in #1642
• Allow more than one skip functions per check. by @greyerof in #1645
• Transition accesscontrol suite to ginkgoless by @sebrandon1 in #1616
• Transition networking suite to ginkgoless by @sebrandon1 in #1621
• Transition lifecycle suite to ginkgoless by @sebrandon1 in #1627
• Lifecycle ts: fix to avoid some checks to be skipped. by @greyerof in #1655
• Load the checks' database using a standard function instead of init() by @jmontesi in #1664
• Transition platform-alteration suite to ginkgoless. by @greyerof in #1658
• Adding the operator suite to the ginkgoless branch by @edcdavid in #1672
• Transition preflight suite to ginkgoless. by @greyerof in #1670
• Bugfix: skip execution of remaining checks on error/panic. by @greyerof in #1687
• Remove ginkgo.AbortSuite by @sebrandon1 in #1679
• Add JUnit XML output by @sebrandon1 in #1691
• Switch skip for nodePort test by @sebrandon1 in #1701
• Remove early return with empty objects by @sebrandon1 in #1702
• Add return code if test suite has a failure by @sebrandon1 in #1704
• Non graceful abort for unrecoverable/critical failures inside checkFn. by @greyerof in #1713
• Remove early return in networking suite by @sebrandon1 in #1717
• Consolidate checksGroup.Add calls by @sebrandon1 in #1719
• Merge branch 'main' into ginkgo_removal by @greyerof in #1739
• Properly use TNF_ENABLE_XML_CREATION by @ramperher in #1751
• Merge branch 'main' into ginkgo_removal by @greyerof in #1752
• Adjust location of the XML output file by @sebrandon1 in #1753
• Adjust XML output by @sebrandon1 in #1759
• Merge branch 'main' into ginkgo_removal by @greyerof in #1771
• Merge branch 'main' into ginkgo_removal by @greyerof in #1773
• Ginkgo removal branch merged into main. by @greyerof in #1774
• Remove ginkgo_removal refs by @sebrandon1 in #1778
• More consolidation to checksGroup.Add calls by @sebrandon1 in #1779
• Delete some Ginkgo references by @jmontesi in #1794
• Fix helmVersion test by @sebrandon1 in #1801

Dependency Updates

• Bump github.com/test-network-function/privileged-daemonset from 1.0.15 to 1.0.16 by @dependabot in #1695
• Update Go to v1.21.5 by @sebrandon1 in #1697
• Bump actions/setup-go from 4 to 5 by @dependabot in #1700
• Bump github/codeql-action from 2 to 3 by @dependabot in #1722
• Bump actions/upload-artifact from 3 to 4 by @dependabot in #1729
• Bump helm.sh/helm/v3 from 3.13.2 to 3.13.3 by @dependabot in #1735
• Bump github.com/test-network-function/privileged-daemonset from 1.0.16 to 1.0.18 by @dependabot in #1742
• Bump github.com/mittwald/go-helm-client from 0.12.4 to 0.12.5 by @dependabot in #1746
• Update operator-sdk to v1.33.0 by @sebrandon1 in #1747
• Bump golang.org/x/crypto from 0.15.0 to 0.17.0 by @dependabot in #1749
• Bump github.com/go-logr/logr from 1.3.0 to 1.4.0 by @dependabot in #1763
• Bump github.com/containerd/containerd from 1.7.6 to 1.7.11 by @dependabot in #1764
• go.mod: bump test-network-function-claim to v1.0.33 by @jmontesi in #1762
• Bump github.com/go-logr/logr from 1.4.0 to 1.4.1 by @dependabot in #1766
• Bump github.com/deckarep/golang-set/v2 from 2.5.0 to 2.6.0 by @dependabot in #1768
• Bump golang.org/x/term from 0.15.0 to 0.16.0 by @dependabot in #1785
• bump parser version to 0.4.3 by @edcdavid in #1790
• Bump github.com/mittwald/go-helm-client from 0.12.5 to 0.12.7 by @dependabot in #1786
• bumping claim format to 0.4.0 by @edcdavid in #1796
• build(deps): bump github.com/operator-framework/api from 0.20.0 to 0.21.0 by @dependabot in #1795
• Remove dependency with golang-set by @jmontesi in #1798
• build(deps): bump ubi8/ubi from 8.9-1028 to 8.9-1107 by @dependabot in #1800
• build(deps): bump ubi8/ubi-minimal from 8.9-1029 to 8.9-1108 by @dependabot in #1799
• Update Go to v1.21.6 by @sebrandon1 in #1804

Other Changes

• testhelper: remove unused functions by @jmontesi in #1716
• to add a msg about the k8s bug by @aabughosh in #1720
• Delete chaos testing suite by @jmontesi in #1797

Full Changelog: v4.5.7...v5.0.0