ubuntu-kvm-unit test failed with sprs test on ppc64le

qemu-2.7.1 built from source still got this issue.
But it can be fixed by using qemu-2.10.0 built from source.

# export QEMU=/home/ubuntu/qemu-2.10.0/ppc64-softmmu/qemu-system-ppc64
# MIGRATION=yes TESTNAME=sprs TIMEOUT=90s ACCEL= ./powerpc/run powerpc/sprs.elf -smp 1 -append '-w'
run_migration timeout -k 1s --foreground 90s /home/ubuntu/qemu-2.10.0/ppc64-softmmu/qemu-system-ppc64 -nodefaults -machine pseries,accel=kvm -bios powerpc/boot_rom.bin -display none -serial stdio -kernel powerpc/sprs.elf -smp 1 -append -w # -initrd /tmp/tmp.dKAYkHnAZh
Settings SPRs to 0xcafefacec0debabe...
Now migrate the VM, then press a key or send NMI...

Checking SPRs...
PASS: SPR 3: 0x0000000000debabe <==> 0x0000000000debabe
PASS: SPR 13: 0xcafefacec0debabe <==> 0xcafefacec0debabe
PASS: SPR 17: 0x0000000000debabe <==> 0x0000000000debabe
PASS: SPR 18: 0x00000000c0debabe <==> 0x00000000c0debabe
PASS: SPR 19: 0xcafefacec0debabe <==> 0xcafefacec0debabe
PASS: SPR 29: 0xcafefacec0debabe <==> 0xcafefacec0debabe
PASS: SPR 61: 0x4054504440541014 <==> 0x4054504440541014
PASS: SPR 153: 0x0a00000000000084 <==> 0x0a00000000000084
PASS: SPR 157: 0xcfffffcfc0cfffff <==> 0xcfffffcfc0cfffff
PASS: SPR 159: 0x00000000c0debabe <==> 0x00000000c0debabe
PASS: SPR 256: 0x00000000c0debabe <==> 0x00000000c0debabe
PASS: SPR 259: 0xcafefacec0debabe <==> 0xcafefacec0debabe
PASS: SPR 274: 0xcafefacec0debabe <==> 0xcafefacec0debabe
PASS: SPR 275: 0xcafefacec0debabe <==> 0xcafefacec0debabe
PASS: SPR 769: 0xcafefacec0debabe <==> 0xcafefacec0debabe
PASS: SPR 770: 0xcafefacec006babe <==> 0xcafefacec006babe
PASS: SPR 771: 0x00000000c0debabe <==> 0x00000000c0debabe
PASS: SPR 772: 0x00000000c0debabe <==> 0x00000000c0debabe
PASS: SPR 773: 0x00000000c0debabe <==> 0x00000000c0debabe
PASS: SPR 774: 0x00000000c0debabe <==> 0x00000000c0debabe
PASS: SPR 775: 0x00000000c0debabe <==> 0x00000000c0debabe
PASS: SPR 776: 0x00000000c0debabe <==> 0x00000000c0debabe
PASS: SPR 779: 0x00000000fa8b1afe <==> 0x00000000fa8b1afe
PASS: SPR 780: 0xcafefacec0debabc <==> 0xcafefacec0debabc
PASS: SPR 781: 0xcafefacec0debabe <==> 0xcafefacec0debabe
PASS: SPR 782: 0xcafefacec0debabe <==> 0xcafefacec0debabe
PASS: SPR 784: 0xcafefacec0debabe <==> 0xcafefacec0debabe
PASS: SPR 785: 0xcafefacec0debabe <==> 0xcafefacec0debabe
PASS: SPR 786: 0xcafefacec006babe <==> 0xcafefacec006babe
PASS: SPR 787: 0x00000000c0debabe <==> 0x00000000c0debabe
PASS: SPR 788: 0x00000000c0debabe <==> 0x00000000c0debabe
PASS: SPR 789: 0x00000000c0debabe <==> 0x00000000c0debabe
PASS: SPR 790: 0x00000000c0debabe <==> 0x00000000c0debabe
PASS: SPR 791: 0x00000000c0debabe <==> 0x00000000c0debabe
PASS: SPR 792: 0x00000000c0debabe <==> 0x00000000c0debabe
PASS: SPR 795: 0x00000000fa8b1afe <==> 0x00000000fa8b1afe
PASS: SPR 796: 0xcafefacec0debabc <==> 0xcafefacec0debabc
PASS: SPR 797: 0xcafefacec0debabe <==> 0xcafefacec0debabe
PASS: SPR 798: 0xcafefacec0debabe <==> 0xcafefacec0debabe
PASS: SPR 800: 0x80000000c0000000 <==> 0x80000000c0000000
PASS: SPR 801: 0x0000000080000000 <==> 0x0000000080000000
PASS: SPR 802: 0x80000000c0000000 <==> 0x80000000c0000000
PASS: SPR 803: 0x0000000080000000 <==> 0x0000000080000000
PASS: SPR 804: 0xcafefacec0debabe <==> 0xcafefacec0d...

This bug is missing log files that will aid in diagnosing the problem. While running an Ubuntu kernel (not a mainline or third-party kernel) please enter the following command in a terminal window:

apport-collect 1723904

and then change the status of the bug to 'Confirmed'.

If, due to the nature of the issue you have encountered, you are unable to run this command, please add a comment stating that fact and change the bug status to 'Confirmed'.

This change has been made by an automated script, maintained by the Ubuntu Kernel Team.

As with bug 1712803 please outline the steps to get the test elf image and then we should mirror to IBM so they can check which ppc changes would be needed. Based on knowing that we can then decide to SRU or not.

Steps to reproduce:
1. deploy xenial + HWE kernel on a ppc64el box
2. sudo apt-get install qemu-kvm -y
3. git clone --depth=1 https://git.kernel.org/pub/scm/virt/kvm/kvm-unit-tests.git
4. cd kvm-unit-tests
5. ./configure --endian=little; make
6. sudo ppc64_cpu --smt=off
7. sudo ./run_tests -v

From here you will see it's using the elf file from kvm-unit-tests/powerpc and failed with 3 tests:
 - spapr_hcall (bug 1712803)
 - emulator (bug 1723914)
 - sprs (bug 1723904)

To run it with a newer qemu built from source:
1. wget http://download.qemu-project.org/qemu-2.10.0.tar.xz
2. tar -xf qemu-2.10.0.tar.xz
3. cd qemu-2.10.0
4. ./configure; make
5. cd ~/kvm-unit-tests
6. sudo su
7. export QEMU=/home/ubuntu/qemu-2.10.0/ppc64-softmmu/qemu-system-ppc64
8. ./run_test -v

Default Comment by Bridge

For Zesty with the kvm-unit-test code from upstream, it will hang with this test on ppc64le now, bug 1740017

------- Comment From <email address hidden> 2018-03-29 16:23 EDT-------
Some SPR registers were not yet defined in qemu 2.5 and therefore are failing this test. The problem is gone from qemu 2.6. Sending the backport patches to Canonical team.

Hi @paelzer,

Here are the backport patches. Let me know if there are any problems.

The attachment "canonical_sprs_backport.patch" seems to be a patch. If it isn't, please remove the "patch" flag from the attachment, remove the "patch" tag, and if you are a member of the ~ubuntu-reviewers, unsubscribe the team.

[This is an automated message performed by a Launchpad user owned by ~brian-murray, for any issues please contact him.]

I plan to combine this with the fix for bug 1723914 which would allow you to only run one verification for both.

Since the fix is in 2.9 only Xenial is considered for the SRU as >=Artful is good

SRU Template prepared

Once ppa is built:
- Regression tests
- per case tests

Note: test build in ppa at https://launchpad.net/~ci-train-ppa-service/+archive/ubuntu/3224

Tested the new build with the outlined testcase:
  MIGRATION=yes TESTNAME=sprs TIMEOUT=90s ACCEL= ./powerpc/run powerpc/sprs.elf -smp 1 -append '-w'
  PASS sprs

Regression tests started on all arches

Regression tests good as well, moving it to x-unapproved for the SRU Team to consider.
=> qemu_2.5+dfsg-5ubuntu10.25_source.changes

An upload of qemu to xenial-proposed has been rejected from the upload queue for the following reason: "What is the reason that the previous security update".

Pressed enter too soon so my rejection message was cut:
"What is the reason that the previous security update's patched have been removed/disabled? Do they introduce any regressions that we didn't know about? Or maybe the new patches also address the CVEs ? If so, this should be mentioned in the changelog and/or forwarded to the security team. New SRUs should not overwrite -security changes - all pockets should have security fixes."

Hello Po-Hsu, or anyone else affected,

Accepted qemu into xenial-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/qemu/1:2.5+dfsg-5ubuntu10.25 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed.Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-xenial to verification-done-xenial. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-xenial. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

same test as the other bug - so same update

# sudo ./run_tests.sh -v
[...]
TESTNAME=emulator TIMEOUT=90s ACCEL= ./powerpc/run powerpc/emulator.elf -smp 1
FAIL emulator
SKIP h_cede_tm (test marked as manual run only)
MIGRATION=yes TESTNAME=sprs TIMEOUT=90s ACCEL= ./powerpc/run powerpc/sprs.elf -smp 1 -append '-w'
FAIL sprs

Upgrade to fix (no issues on upgrade)

# sudo ./run_tests.sh -v
[...]
TESTNAME=emulator TIMEOUT=90s ACCEL= ./powerpc/run powerpc/emulator.elf -smp 1
PASS emulator
SKIP h_cede_tm (test marked as manual run only)
MIGRATION=yes TESTNAME=sprs TIMEOUT=90s ACCEL= ./powerpc/run powerpc/sprs.elf -smp 1 -append '-w'
PASS sprs

This bug was fixed in the package qemu - 1:2.5+dfsg-5ubuntu10.25

---------------
qemu (1:2.5+dfsg-5ubuntu10.25) xenial; urgency=medium

  [ Murilo Opsfelder Araújo ]
  * debian/patches/ubuntu/lp-1723914-ppc64-set-msr-register.patch:
    properly set MSR register for ppc64 targets (LP: #1723914)

  [ Yasmin Beatriz Alves da Silva ]
  * debian/patches/ubuntu/lp-1723904-sprs-backport.patch:
    Fix handling of Power8 special purpose registers (LP: #1723904)

 -- Christian Ehrhardt <email address hidden> Wed, 04 Apr 2018 12:46:15 +0200

The verification of the Stable Release Update for qemu has completed successfully and the package has now been released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.