remove default threshold in test #1725
AdriMarteau
started this conversation in
Ideas
Replies: 1 comment
-
Hey @kevinmessiaen and @mattbit, what is your opinion on that? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Setting default threshold like
1
for accuracy test can have some limitation or risks.On the risk side, a model with 100% accuracy is most likely a spurious one and the test would pass.
Also, this make it less transparent as to the parameters reported when executing the test like in
Suite.run
.Removing the default value would also raise an error when defining the test and force the developper to better think about a proper level.
Beta Was this translation helpful? Give feedback.
All reactions