Skip to content
This repository has been archived by the owner on Aug 9, 2024. It is now read-only.

Change random property invalidation to full coverage #6

Open
robinmackaij opened this issue Dec 6, 2021 · 0 comments
Open

Change random property invalidation to full coverage #6

robinmackaij opened this issue Dec 6, 2021 · 0 comments

Comments

@robinmackaij
Copy link
Collaborator

Currently, the validation of 4xx codes randomly selects one of the properties that, when invalidated, will cause the desired error response. To improve the coverage and remove the possibility of flaky tests (due to a faulty property not being hit every test run), this should be changed.

Target implementation:

  • loop over all properties, return generator with each invalidated data set
    • remove every required property
    • violate every constraint
    • invalid type for each property
  • perform request for each invalidated data set and perform all validations

Question: fail test case on first fail or continue with remaining properties / invalidations?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant