When we build subunit for the Fedora Linux distribution, we run the test suite to catch bugs we may have introduced via packaging. However, test_subunit_tags.py sometimes succeeds and sometimes fails. We have seen the failures with versions 1.2.0 and 1.3.0. Typically, the test will fail on only one architecture out of the 7 we support. Also typically, if we simply try running the build again immediately after a failure, it succeeds the second time.
This is typical output from the test when it fails:
Tests running...
======================================================================
FAIL: subunit.tests.test_subunit_tags.TestSubUnitTags.test_add_tag
----------------------------------------------------------------------
Traceback (most recent call last):
File "/builddir/build/BUILD/subunit-1.3.0/python3/python/subunit/tests/test_subunit_tags.py", line 68, in test_add_tag
self.assertThat(reference, Contains(self.filtered.getvalue()))
File "/usr/lib/python3.7/site-packages/testtools/testcase.py", line 498, in assertThat
raise mismatch_error
testtools.matchers._impl.MismatchError: b'\xb3)\x82\x17\x04test\x02\x03foo\x04quux\xa6\xe1\xde\xec\xb3)\x83\x1b\x04test\x03\x04quux\x03foo\x03bar\xaf\xbd\x9d\xd6' not in [b'\xb3)\x82\x17\x04test\x02\x04quux\x03foo\x05\x97n\x86\xb3)\x83\x1b\x04test\x03\x03bar\x04quux\x03fooqn\xab)', b'\xb3)\x82\x17\x04test\x02\x04quux\x03foo\x05\x97n\x86\xb3)\x83\x1b\x04test\x03\x04quux\x03foo\x03bar\xaf\xbd\x9d\xd6', b'\xb3)\x82\x17\x04test\x02\x04quux\x03foo\x05\x97n\x86\xb3)\x83\x1b\x04test\x03\x04quux\x03bar\x03foo\x03\x04b\r', b'\xb3)\x82\x17\x04test\x02\x04quux\x03foo\x05\x97n\x86\xb3)\x83\x1b\x04test\x03\x03bar\x03foo\x04quux\xd2\x18\x1bC', b'\xb3)\x82\x17\x04test\x02\x03foo\x04quux\xa6\xe1\xde\xec\xb3)\x83\x1b\x04test\x03\x03foo\x04quux\x03bar\x08\xc2X\x83', b'\xb3)\x82\x17\x04test\x02\x03foo\x04quux\xa6\xe1\xde\xec\xb3)\x83\x1b\x04test\x03\x03bar\x03foo\x04quux\xd2\x18\x1bC', b'\xb3)\x82\x17\x04test\x02\x03foo\x04quux\xa6\xe1\xde\xec\xb3)\x83\x1b\x04test\x03\x03foo\x03bar\x04quux:\x05e\x80']
Ran 532 tests in 2.450s
FAILED (failures=1)
make[1]: *** [Makefile:1596: check-local] Error 1
make[1]: Leaving directory '/builddir/build/BUILD/subunit-1.3.0/python3'
subunit-
Tests running...
=======
FAIL: subunit.
-------
Traceback (most recent call last):
File "/builddir/
self.
File "/usr/lib/
raise mismatch_error
testtools.
Ran 526 tests in 3.232s
FAILED (failures=1)
make[1]: Leaving directory '/builddir/
Once it failed on ppc64le <https:/
Because of that I cannot rebuild subunit against Perl 5.28. This issue will become visible when I merge f29-perl side-tag into f29 tag in Koji.