pytest
# or, for increased verbosity
pytest -v
Some tests are disabled by default, some can be disabled manually. Defaults are stored in the pytest.ini
file. To overwrite them, use -m
argument.
For example, to run just the Zypper tests, execute
pytest -m "functional and zypper"
or, to disable DBus tests, run
pytest -m "not dbus"
When debugging, you may want to add --failed-first
argument, so previously failed tests are run first:
pytest --ff
To test specific class or function, use ::
as separator:
pytest test/test_i18n.py::TestI18N::test_text_width
To only run tests containing some substring, run
pytest -k cache
# or, to omit the summary, run
pytest -k cache --no-summary
To run tests in virtual machine or container without GUI, where DBus is not running, you can start it on-demand:
dbus-run-session pytest
To disable pytest-randomly plugin, run
pytest -p no:randomly test/
After all the tests are run, a warnings summary is displayed with the list of deprecations. It can be disabled with --disable-warnings
. Whole summary can be disabled with --no-summary
.
To compute coverage, run
coverage run
# display ASCII report
coverage report
# generate interactive HTML report to htmlcov/
coverage html
# generate XML report readable by tools like IDEs
# - PyCharm: Run > Show Coverage Data (Ctrl+Alt+6)
coverage xml
You can use Podman to run the test suite, ensuring your local setup does not differ from CI.
First, pick which container you'll want to use: CentOS Stream 9, Fedora latest, Fedora Rawhide, ...:
IMAGE="quay.io/centos/centos:stream9"
IMAGE="registry.fedoraproject.org/fedora:latest"
IMAGE="registry.fedoraproject.org/fedora:rawhide"
Enter the container (assuming you are in the project root) and run a pre-test script that will set install the dependencies and compile C extensions:
podman run -it --rm --name subscription-manager -v .:/subscription-manager --privileged $IMAGE bash
cd /subscription-manager/
bash scripts/container-pre-test.sh
Then you can run the test suite. You have to use dbus-run-session
wrapper, because D-Bus is not running in containers:
SUBMAN_TEST_IN_CONTAINER=1 dbus-run-session python3 -m pytest
It is necessary to clone candlepin
repo.
cd ~/src
git clone https://github.com/candlepin/candlepin.git
cd candlepin
export CANDLEPIN_VAGRANT_NO_NFS=1
export CANDLEPIN_DEPLOY_ARGS="-gTa"
vagrant up
See README.md
in the repo or their documentation for more details.
An URL of this server is candlepin.example.com
by default.