What happens:
If you run the Launchpad tests with --subunit, it will report the layer setup and teardown notices as tests, which they aren't. This leads to test count inflation, which gets very confusing for developers (especially when you're running parallel tests, which means that you add about 20 such notices per lxc instance).
Proposed solution (from lifeless):
- Update the zope.testing subunit support so that layer setup and teardown messages are tagged with "layer".
- Subunit needs to know about tags.
- Testr needs to not count or record layer-tagged things as tests.
- Testr should still dump the layer-tagged messages to the raw stream on disk.
What happens:
If you run the Launchpad tests with --subunit, it will report the layer setup and teardown notices as tests, which they aren't. This leads to test count inflation, which gets very confusing for developers (especially when you're running parallel tests, which means that you add about 20 such notices per lxc instance).
Proposed solution (from lifeless):
- Update the zope.testing subunit support so that layer setup and teardown messages are tagged with "layer".
- Subunit needs to know about tags.
- Testr needs to not count or record layer-tagged things as tests.
- Testr should still dump the layer-tagged messages to the raw stream on disk.