Backport 17.11.5 to Bionic and Cosmic

Bug #1817675 reported by Christian Ehrhardt 
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
dpdk (Ubuntu)
Fix Released
Undecided
Unassigned
Bionic
Fix Released
Undecided
Unassigned
Cosmic
Fix Released
Undecided
Unassigned

Bug Description

[Impact]

 * After 17.11.5 being released:
   http://mails.dpdk.org/archives/announce/2019-February/000244.html
   We want to backport this stable release to the releases that have
   17.11.x which are currently Bionic and Cosmic.

 * This update includes bugfixes only following the SRU policy
   exception defined at :
   https://wiki.ubuntu.com/StableReleaseUpdates/DPDK.

 * We also consider adding a fix (that will most likely be in next
   stable) that fixes DKMS build against kernel 5.0 in preparation
   for the 5.0 based HWE kernel that will arrive in Bionic at some
   point

[Major Changes]
 * No new features added, just a bugfix release, we had no
   17.11.4 update yet so this covers both:
   https://doc.dpdk.org/guides-17.11/rel_notes/release_17_11.html#id4
   https://doc.dpdk.org/guides-17.11/rel_notes/release_17_11.html#id5

[Test Plan]

* See https://wiki.ubuntu.com/StableReleaseUpdates/DPDK#SRU_TestVerify
  I'll run those and attach a log.
  In addition I'll ask a few peers to evaluate it as well before we
  push it to SRU.

[Regression Potential]

Upstream performs extensive testing before release, giving us a high degree of confidence in the general case. There problems are most likely to manifest in Ubuntu-specific integrations, such as in relation to the versions of dependencies available and other packaging-specific matters.

[Notes]
I already prepared the changes for the shared Debian/Ubuntu deb_dpdk project and base on that will create backports for Cosmic/Bionic in a PPA for the usual pre MRE evaluation we agreed on.

There are two more bugs part of the MRE:
- bug 1799397 which just happened to exist on LP but is a normal part of
  the MRE (it is upstream, tested and discussed there and part of the MRE
  verification)
- bug 1814919 which will only be in the next stable release but we need it
  to be ready for Linux 5.0 based HWE kernels. Adding it on this upload
  makes sure this works, SRU verification will be done on the bug itself
  (as it would not be part of the MRE verification process by default)

Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

These are the changes that are derived from 18.11.x which is in Disco already.
Disco will - independent to this bug get 18.11.1 but the TL;DR is this is only relevant for Bionic and Cosmic - setting bug tasks accordingly.

Changed in dpdk (Ubuntu):
status: New → Fix Released
Changed in dpdk (Ubuntu Bionic):
status: New → In Progress
Changed in dpdk (Ubuntu Cosmic):
status: New → In Progress
description: updated
Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

1.0.0 (10:08:38): phys (BM) tests
  1.1.0 (10:08:38): initialize environment
    1.1.1 (10:10:21): testpmd => Pass
    1.1.2 (10:11:04): check testpmd output => Pass
2.0.0 (10:11:04): prep virtual test environment

1.0.0 (10:13:11): virt tests
  1.1.0 (10:13:11): initialize environment
3.0.0 (10:14:25): performance tests
  3.1.0 (10:14:25): prep benchmarks
  3.2.0 (10:14:48): performance tests
    3.2.1 (10:14:56): test guest-openvswitch for OVS-5CPU => Pass
    3.2.2 (11:09:02): test guest-dpdk-vhost-user-singleq for OVSDPDK => Pass
    3.2.3 (12:01:36): test guest-dpdk-vhost-user-multiq for OVSDPDK-tuned => Pass
4.0.0 (12:11:13): endurance checks
  4.1.0 (12:11:13): prep endurance tests
    4.1.1 (12:22:42): start stop guests (server) => Pass
    4.1.2 (13:43:02): add/remove ports (server) => Pass

Pre-test look good, I'll poll a few more testers if they want to participate

Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

I got the confirmation by Mellanox that checks on the PPA are complete and that it is ok.

Thereby all pre-checks are done and this can go to the SRU queue in -unapproved ... uploaded.

Once accepted by the SRU team I'll rerun the internal regression check again on -proposed and we are good to go then.

Revision history for this message
Brian Murray (brian-murray) wrote : Please test proposed package

Hello Christian, or anyone else affected,

Accepted dpdk into cosmic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/dpdk/17.11.5-0~ubuntu18.10.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-cosmic to verification-done-cosmic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-cosmic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Changed in dpdk (Ubuntu Cosmic):
status: In Progress → Fix Committed
tags: added: verification-needed verification-needed-cosmic
Revision history for this message
Brian Murray (brian-murray) wrote :

Hello Christian, or anyone else affected,

Accepted dpdk into bionic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/dpdk/17.11.5-0~ubuntu18.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-bionic to verification-done-bionic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-bionic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Changed in dpdk (Ubuntu Bionic):
status: In Progress → Fix Committed
tags: added: verification-needed-bionic
Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

This is about 17.11.x versions (pre vhost-userclient) so we are testing the vhost-user-server mode as usual for these versions.

Bionic:
1.0.0 (06:33:36): phys (BM) tests
  1.1.0 (06:33:36): initialize environment
    1.1.1 (06:36:20): testpmd => Pass
    1.1.2 (06:37:17): check testpmd output => Pass
2.0.0 (06:37:17): prep virtual test environment

1.0.0 (06:38:59): virt tests
  1.1.0 (06:38:59): initialize environment
3.0.0 (06:39:49): performance tests
  3.1.0 (06:39:49): prep benchmarks
  3.2.0 (06:41:30): performance tests
    3.2.1 (06:41:38): test guest-openvswitch for OVS-5CPU => Pass
    3.2.2 (07:34:56): test guest-dpdk-vhost-user-singleq for OVSDPDK => Pass
    3.2.3 (08:25:46): test guest-dpdk-vhost-user-multiq for OVSDPDK-tuned => Pass
4.0.0 (09:18:39): endurance checks
  4.1.0 (09:18:39): prep endurance tests
    4.1.1 (09:28:21): start stop guests (server) => Pass
    4.1.2 (10:47:39): add/remove ports (server) => Pass
  4.2.0 (11:00:11): Final cleanup+ echo ''

Settign Bionic to verified, upgrading for Cosmic ...

tags: added: verification-done-bionic
removed: verification-needed-bionic
Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

The OVS-DPDK tests had an issue at first, but it turned out to be just a cleanup of old test artifacts that was missing - the actual traffic was working and fast.

1.0.0 (14:04:16): phys (BM) tests
  1.1.0 (14:04:16): initialize environment
    1.1.1 (14:06:30): testpmd => Pass
    1.1.2 (14:07:29): check testpmd output => Pass
2.0.0 (14:07:29): prep virtual test environment

1.0.0 (14:09:15): virt tests
  1.1.0 (14:09:15): initialize environment
3.0.0 (14:10:05): performance tests
  3.1.0 (14:10:05): prep benchmarks
  3.2.0 (14:10:26): performance tests
    3.2.1 (14:10:42): test guest-openvswitch for OVS-5CPU => Pass
    3.2.2 (14:49:41): test guest-dpdk-vhost-user-singleq for OVSDPDK => Pass
    3.2.3 (15:26:40): test guest-dpdk-vhost-user-multiq for OVSDPDK-tuned => Pass
4.0.0 (16:20:02): endurance checks
  4.1.0 (16:20:02): prep endurance tests
    4.1.1 (16:30:29): start stop guests (server) => Pass
    4.1.2 (17:30:55): add/remove ports (server) => Pass
  4.2.0 (17:45:11): Final cleanup+ echo ''

Cosmic verified as well

tags: added: verification-done verification-done-cosmic
removed: verification-needed verification-needed-cosmic
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package dpdk - 17.11.5-0~ubuntu18.10.1

---------------
dpdk (17.11.5-0~ubuntu18.10.1) cosmic; urgency=medium

  * New upstream release 17.11.5; for a full list of changes see:
    https://doc.dpdk.org/guides-17.11/rel_notes/release_17_11.html#id4
    https://doc.dpdk.org/guides-17.11/rel_notes/release_17_11.html#id5
    Among many other fixes this closes the following bugs:
    - request to merge 17.11.5 (LP: #1817675)
    - issues with -mavx512f on recent Skylake chips (LP: #1799397)
    - Drop d/p/net-mlx5-fix-build-with-rdma-core-v19.patch which is part of
      17.11.4
  * d/p/*kni-fix-build*: fix build with kernel 5.0 (LP: #1814919)
    as preparation for a HWE kernel based on the 5.0 version of 19.04

 -- Christian Ehrhardt <email address hidden> Tue, 26 Feb 2019 12:34:12 +0100

Changed in dpdk (Ubuntu Cosmic):
status: Fix Committed → Fix Released
Revision history for this message
Brian Murray (brian-murray) wrote : Update Released

The verification of the Stable Release Update for dpdk has completed successfully and the package has now been released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package dpdk - 17.11.5-0~ubuntu18.04.1

---------------
dpdk (17.11.5-0~ubuntu18.04.1) bionic; urgency=medium

  * New upstream release 17.11.5; for a full list of changes see:
    https://doc.dpdk.org/guides-17.11/rel_notes/release_17_11.html#id4
    https://doc.dpdk.org/guides-17.11/rel_notes/release_17_11.html#id5
    Among many other fixes this closes the following bugs:
    - request to merge 17.11.5 (LP: #1817675)
    - issues with -mavx512f on recent Skylake chips (LP: #1799397)
    - Drop d/p/net-mlx5-fix-build-with-rdma-core-v19.patch which is part of
      17.11.4
  * d/p/*kni-fix-build*: fix build with kernel 5.0 (LP: #1814919)
    as preparation for a HWE kernel based on the 5.0 version of 19.04

 -- Christian Ehrhardt <email address hidden> Tue, 26 Feb 2019 12:34:12 +0100

Changed in dpdk (Ubuntu Bionic):
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.