We want to report a failure for a large amount of tests failures and not fail the test suite for smaller failures. The test suite is complex and will be flaky due to how we are automating it, and since these are smoke tests, we shouldn't be too concerned if a few tests fail.
We want to report a failure for a large amount of tests failures and not fail the test suite for smaller failures. The test suite is complex and will be flaky due to how we are automating it, and since these are smoke tests, we shouldn't be too concerned if a few tests fail.