Test Quarantine
complete
C
Cooing Rook
At scale, we often have the case where a test is either flakey or failing consistently that has made it's way into the main branch. We'd like a way to quickly make it so these tests pass across all of our pipeline runs across all JUnit type reports. Essentially I'd like to have a user interface to say "This test on this pipeline or project or across all projects across anything should be marked as pass".
Ideally I'd also be able to create a ticket based on this, and have a link to the pass/fail rate of that test like we have in the Unit Tests Metrics dashboard.
Even more ideal, we could use those Unit Tests Metrics to discover and suggest tests that may need to go into the Test Quarantine
Log In
R
Rohan Bhaumik
updated the status to
complete
R
Rohan Bhaumik
We recently introduced Harness Test Management that natively detects flaky tests and allows you to set quarantine policies. https://developer.harness.io/docs/continuous-integration/use-ci/run-tests/test-management/ci-test-management-overview/
If you're using Harness CI, you can get started using the docs above. Excited to hear what you think
This post was marked as
in progress
N
Nofar Bluestein
updated the status to
long-term