Ubuntu
linux-hwe-5.4 package

zfs-linux/0.7.5-1ubuntu16.11 ADT test failure with linux-hwe-5.4/5.4.0-79.88~18.04.1

Bug #1934910 reported by Kleber Sacilotto de Souza
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
linux-hwe-5.4 (Ubuntu)
New
Undecided
Unassigned
Bionic
New
Undecided
Unassigned
zfs-linux (Ubuntu)
Fix Released
Medium
Colin Ian King
Xenial
Fix Released
Medium
Colin Ian King
Bionic
Fix Released
Medium
Colin Ian King
Focal
Fix Released
Medium
Colin Ian King
Groovy
Fix Released
Medium
Colin Ian King
Hirsute
Fix Released
Medium
Colin Ian King
Impish
Fix Released
Medium
Colin Ian King

Bug Description

== zfs-linux SRU ==

IMPISH, HIRSUTE, GROOVY, FOCAL, BIONIC, XENIAL

[Impact]

The zfs debian scrub test sometimes times out on slower test systems
because scrub can take a while to complete and the scrub test can
time out. The test needs some more intelligence to detect this
and a longer time out for slower systems.

The fix now polls the scrub completion more thoroughly and increases
timeout to 15 minutes.

[Test Plan]

Run the test with autopkgtest on slow file systems. With the fix the test
has longer timeout and will pass rather than fail with a timeout. e.g.

autopkgtest zfs-linux_2.0.3-8ubuntu5.dsc -- null

[Where problems could occur]

The timeout is hard coded to 15 minutes. This should be enough for slow
devices with the small ZFS volume set used by this test. However, it may
still fail if the backing store is really slow. However, we don't want the
test to be blocked indefinitely waiting for a timeout, so a 15 minute
scrub timeout seems to be long enough to be more than reasonable. Any longer and it's highly likely that the scrub has hung.

[Other Info]

This test is almost identical to the same scrub test run from the kernel
team autotest zfs smoke test, so it has been exercised regularly and is
known to reliably.

-------------------------------------------------------------------------

This is a scripted bug report about ADT failures while running zfs-linux tests for linux-hwe-5.4/5.4.0-79.88~18.04.1 on bionic. Whether this is caused by the dep8 tests of the tested source or the kernel has yet to be determined.

Testing failed on:
    amd64: https://autopkgtest.ubuntu.com/results/autopkgtest-bionic/bionic/amd64/z/zfs-linux/20210703_080055_ead94@/log.gz
    arm64: https://autopkgtest.ubuntu.com/results/autopkgtest-bionic/bionic/arm64/z/zfs-linux/20210703_075255_bdb56@/log.gz
    ppc64el: https://autopkgtest.ubuntu.com/results/autopkgtest-bionic/bionic/ppc64el/z/zfs-linux/20210703_074629_bdb56@/log.gz
    s390x: https://autopkgtest.ubuntu.com/results/autopkgtest-bionic/bionic/s390x/z/zfs-linux/20210703_074343_3aa5c@/log.gz

This is a similar issue as reported on bug 1885289, which was fixed on autotest-client-tests ubuntu_zfs_smoke_test. However, the ADT tests don't use autotest, the test script run comes from the zfs-linux dkms source package, debian/tests/kernel-smoke-test-scrub.

See original description
Kleber Sacilotto de Souza (kleber-souza)
tags: added: kernel-adt-failure
description: updated
Revision history for this message
Colin Ian King (colin-king) wrote :

From the look of this (and some quick testing on a VM), the scrub is taking ~10 minutes and I suspect that the test is timing out before the scrub completes. I've bumped it to 15 minutes,

https://kernel.ubuntu.com/git/ubuntu/autotest-client-tests.git/commit/?id=e5905f5f0b83764301f2869d644e71c6a96a8ae9

Can this test be re-run to see if this addresses the failure?

Colin Ian King (colin-king)
no longer affects: linux-hwe-5.4 (Ubuntu Xenial)
no longer affects: linux-hwe-5.4 (Ubuntu Focal)
no longer affects: linux-hwe-5.4 (Ubuntu Groovy)
no longer affects: linux-hwe-5.4 (Ubuntu Hirsute)
no longer affects: linux-hwe-5.4 (Ubuntu Impish)
Colin Ian King (colin-king)
description: updated
Colin Ian King (colin-king)
no longer affects: zfs-linux (Ubuntu Groovy)
Colin Ian King (colin-king)
no longer affects: linux-hwe-5.4 (Ubuntu Groovy)
Changed in zfs-linux (Ubuntu Xenial):
assignee: nobody → Colin Ian King (colin-king)
Changed in zfs-linux (Ubuntu Bionic):
assignee: nobody → Colin Ian King (colin-king)
Changed in zfs-linux (Ubuntu Focal):
assignee: nobody → Colin Ian King (colin-king)
assignee: Colin Ian King (colin-king) → nobody
Changed in zfs-linux (Ubuntu Groovy):
assignee: nobody → Colin Ian King (colin-king)
Changed in zfs-linux (Ubuntu Hirsute):
assignee: nobody → Colin Ian King (colin-king)
Changed in zfs-linux (Ubuntu Impish):
assignee: nobody → Colin Ian King (colin-king)
Changed in zfs-linux (Ubuntu Focal):
assignee: nobody → Colin Ian King (colin-king)
Changed in zfs-linux (Ubuntu Xenial):
importance: Undecided → Medium
Changed in zfs-linux (Ubuntu Bionic):
importance: Undecided → Medium
Changed in zfs-linux (Ubuntu Focal):
importance: Undecided → Medium
Changed in zfs-linux (Ubuntu Groovy):
importance: Undecided → Medium
Changed in zfs-linux (Ubuntu Hirsute):
importance: Undecided → Medium
Changed in zfs-linux (Ubuntu Impish):
importance: Undecided → Medium
Changed in zfs-linux (Ubuntu Xenial):
status: New → In Progress
Changed in zfs-linux (Ubuntu Bionic):
status: New → In Progress
Changed in zfs-linux (Ubuntu Focal):
status: New → In Progress
Changed in zfs-linux (Ubuntu Groovy):
status: New → In Progress
Changed in zfs-linux (Ubuntu Hirsute):
status: New → In Progress
Changed in zfs-linux (Ubuntu Impish):
status: New → In Progress
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package zfs-linux - 2.0.3-8ubuntu5

---------------
zfs-linux (2.0.3-8ubuntu5) impish; urgency=medium

  * Improve scrub testing in kernel-smoke-test-scrub (LP: #1934910)
    On some slower small memory systems we need to check until resilvering
    has completed. The most reliably method is to poll on a scrub until
    it finishes successfully. Give up after ~10 minutes and flag a failure
    if the scrub can't start or complete successfully.

 -- Colin Ian King <email address hidden> Thu, 8 Jul 2021 08:51:21 +0100

Changed in zfs-linux (Ubuntu Impish):
status: In Progress → Fix Released
Revision history for this message
Brian Murray (brian-murray) wrote : Please test proposed package

Hello Kleber, or anyone else affected,

Accepted zfs-linux into hirsute-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/zfs-linux/2.0.2-1ubuntu5.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-hirsute to verification-done-hirsute. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-hirsute. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Changed in zfs-linux (Ubuntu Hirsute):
status: In Progress → Fix Committed
Changed in zfs-linux (Ubuntu Groovy):
status: In Progress → Fix Committed
Revision history for this message
Brian Murray (brian-murray) wrote :

Hello Kleber, or anyone else affected,

Accepted zfs-linux into groovy-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/zfs-linux/0.8.4-1ubuntu11.3 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-groovy to verification-done-groovy. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-groovy. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Changed in zfs-linux (Ubuntu Focal):
status: In Progress → Fix Committed
Revision history for this message
Brian Murray (brian-murray) wrote :

Hello Kleber, or anyone else affected,

Accepted zfs-linux into focal-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/zfs-linux/0.8.3-1ubuntu12.11 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-focal to verification-done-focal. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-focal. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Changed in zfs-linux (Ubuntu Bionic):
status: In Progress → Fix Committed
Revision history for this message
Brian Murray (brian-murray) wrote :

Hello Kleber, or anyone else affected,

Accepted zfs-linux into bionic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/zfs-linux/0.7.5-1ubuntu16.12 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-bionic to verification-done-bionic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-bionic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Revision history for this message
Brian Murray (brian-murray) wrote :

Hello Kleber, or anyone else affected,

Accepted zfs-linux into xenial-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/zfs-linux/0.6.5.6-0ubuntu30 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-xenial to verification-done-xenial. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-xenial. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Changed in zfs-linux (Ubuntu Xenial):
status: In Progress → Fix Committed
Revision history for this message
Colin Ian King (colin-king) wrote :

Tested with Hirsute zfsutils-linux 2.02-1ubuntu5.1 - PASSED regression tests.

Revision history for this message
Colin Ian King (colin-king) wrote :

Tested with Groovy zfsutils-linux-0.8.4-1ubuntu11.3 - PASSED regression tests.

tags: added: verification-done-groovy verification-needed-hirsute
Revision history for this message
Colin Ian King (colin-king) wrote :

Tested with Focal zfsutils-linux-0.8.3-1ubuntu12.11 - PASSED regression tests.

Revision history for this message
Colin Ian King (colin-king) wrote :

Tested with Bionic zfsutils-linux-0.7.5-1ubuntu16.12 - PASSED regression tests.

Revision history for this message
Colin Ian King (colin-king) wrote :

Tested with Xenial zfsutils-linux-0.6.5.6-0ubuntu30 - PASSED regression tests.

tags: added: verification-done-hirsute
removed: verification-needed-hirsute
tags: added: verification-done-bionic verification-done-focal verification-done-xenial
Revision history for this message
Colin Ian King (colin-king) wrote :

All tested and passed the ADT tests (the fix was in respect to fixing the scrub sub test).

Revision history for this message
Chris Halse Rogers (raof) wrote :

Looks like this is ready for release. Should it be released? We'd normally mark uploads that only fix autopkgtests as block-proposed, to keep them in proposed until there's a user-visible change, but this looks like it unblocks unrelated packages, so maybe should go through?

Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package zfs-linux - 2.0.2-1ubuntu5.1

---------------
zfs-linux (2.0.2-1ubuntu5.1) hirsute; urgency=medium

  * Improve scrub testing in kernel-smoke-test-scrub (LP: #1934910)
    On some slower small memory systems we need to check until resilvering
    has completed. The most reliably method is to poll on a scrub until
    it finishes successfully. Give up after ~15 minutes and flag a failure
    if the scrub can't start or complete successfully.

 -- Colin Ian King <email address hidden> Thu, 8 Jul 2021 08:51:21 +0100

Changed in zfs-linux (Ubuntu Hirsute):
status: Fix Committed → Fix Released
Revision history for this message
Brian Murray (brian-murray) wrote : Update Released

The verification of the Stable Release Update for zfs-linux has completed successfully and the package is now being released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package zfs-linux - 0.8.4-1ubuntu11.3

---------------
zfs-linux (0.8.4-1ubuntu11.3) groovy; urgency=medium

  * Improve scrub testing in kernel-smoke-test-scrub (LP: #1934910)
    On some slower small memory systems we need to check until resilvering
    has completed. The most reliably method is to poll on a scrub until
    it finishes successfully. Give up after ~15 minutes and flag a failure
    if the scrub can't start or complete successfully.

 -- Colin Ian King <email address hidden> Thu, 8 Jul 2021 08:51:21 +0100

Changed in zfs-linux (Ubuntu Groovy):
status: Fix Committed → Fix Released
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package zfs-linux - 0.8.3-1ubuntu12.11

---------------
zfs-linux (0.8.3-1ubuntu12.11) focal; urgency=medium

  * Improve scrub testing in kernel-smoke-test-scrub (LP: #1934910)
    On some slower small memory systems we need to check until resilvering
    has completed. The most reliably method is to poll on a scrub until
    it finishes successfully. Give up after ~15 minutes and flag a failure
    if the scrub can't start or complete successfully.

 -- Colin Ian King <email address hidden> Thu, 8 Jul 2021 08:51:21 +0100

Changed in zfs-linux (Ubuntu Focal):
status: Fix Committed → Fix Released
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package zfs-linux - 0.6.5.6-0ubuntu30

---------------
zfs-linux (0.6.5.6-0ubuntu30) xenial; urgency=medium

  * Improve scrub testing in kernel-smoke-test-scrub (LP: #1934910)
    On some slower small memory systems we need to check until resilvering
    has completed. The most reliably method is to poll on a scrub until
    it finishes successfully. Give up after ~15 minutes and flag a failure
    if the scrub can't start or complete successfully.

 -- Colin Ian King <email address hidden> Thu, 8 Jul 2021 08:51:21 +0100

Changed in zfs-linux (Ubuntu Xenial):
status: Fix Committed → Fix Released
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package zfs-linux - 0.7.5-1ubuntu16.12

---------------
zfs-linux (0.7.5-1ubuntu16.12) bionic; urgency=medium

  * Improve scrub testing in kernel-smoke-test-scrub (LP: #1934910)
    On some slower small memory systems we need to check until resilvering
    has completed. The most reliably method is to poll on a scrub until
    it finishes successfully. Give up after ~15 minutes and flag a failure
    if the scrub can't start or complete successfully.

 -- Colin Ian King <email address hidden> Thu, 8 Jul 2021 08:51:21 +0100

Changed in zfs-linux (Ubuntu Bionic):
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.