xunit like jenkins plugin that will warn qa when developers skip or disable tests
| Affects | Status | Importance | Assigned to | Milestone | |
|---|---|---|---|---|---|
| Ubuntu CI Engine |
New
|
Undecided
|
Unassigned | ||
Bug Description
Summary:
We need an xunit like plugin for the new ci engine to warn qa when tests are disabled or skipped in ci. The results must to be held outside of the code base.
see:
https:/
steps:
1. run tests from project with gtest, qttestlib and subunit tests
expected results:
1. The ci engine records xUnit test results
2. The CI engine marks the build unstable or failed depending thresholds like the xunit plugin, if tests are being skipped or if the number of tests that were run decrease it should fail or be marked unstable.
3. When a build is marked unstable or failed an email is sent to stakeholders with a warning about skipped tests.
4. running the ci a second time should not trigger the failed/unstable state if all other tests pass (if a feature is removed to a different codebase it's tests will also be removed, so it could be ok to remove tests)
5. a line chart is displayed with number of total tests overtime
