Comment 2 for bug 2029917

Revision history for this message
Po-Hsu Lin (cypressyew) wrote : Re: [Potential Regression] cpuset_hotplug in ubuntu_ltp_controllers triggers kernel bug (arch/x86/xen/spinlock.c:62) and kernel panic on AWS cloud c3.xlarge

This issue can be reproduced with X-aws-hwe (4.15.0-1160-aws), passed with X-aws-hwe 4.15.0-1158-aws
I was unable to find X-aws-hwe 4.15.0-1159 to test.

[ 1121.855862] kernel BUG at /build/linux-aws-hwe-dFjJIX/linux-aws-hwe-4.15.0/arch/x86/xen/spinlock.c:69!
[ 1121.857747] invalid opcode: 0000 [#1] SMP PTI
[ 1121.858746] Modules linked in: sb_edac i2c_piix4 intel_rapl_perf serio_raw nfsd auth_rpcgss nfs_acl lockd grace sunrpc ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi autofs4 btrfs zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc cirrus ttm drm_kms_helper syscopyarea aesni_intel sysfillrect sysimgblt fb_sys_fops aes_x86_64 crypto_simd glue_helper drm cryptd i2c_core ixgbevf pata_acpi
[ 1121.868747] CPU: 1 PID: 13 Comm: cpuhp/1 Not tainted 4.15.0-1160-aws #173~16.04.1-Ubuntu
[ 1121.870378] Hardware name: Xen HVM domU, BIOS 4.11.amazon 08/24/2006
[ 1121.871665] RIP: 0010:dummy_handler+0x4/0x10
[ 1121.872535] RSP: 0000:ffff92f327a43e38 EFLAGS: 00010046
[ 1121.873589] RAX: ffffffffa6e2ac40 RBX: ffff92f320d8ee80 RCX: 0000000000000000
[ 1121.875039] RDX: 0000000000400e00 RSI: 0000000000000000 RDI: 000000000000003b
[ 1121.876472] RBP: ffff92f327a43e38 R08: ffff92f32161e400 R09: ffff92f327002480
[ 1121.877908] R10: 0000000000000000 R11: 0000000000000040 R12: 000000000000003b
[ 1121.879346] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
[ 1121.880781] FS: 0000000000000000(0000) GS:ffff92f327a40000(0000) knlGS:0000000000000000
[ 1121.882404] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1121.883574] CR2: 0000000000000000 CR3: 00000001bf00a001 CR4: 00000000001606e0
[ 1121.885023] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1121.886472] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1121.887918] Call Trace:
[ 1121.888436] <IRQ>
[ 1121.888871] __handle_irq_event_percpu+0x84/0x1a0
[ 1121.889836] handle_irq_event_percpu+0x32/0x80
[ 1121.890756] handle_percpu_irq+0x3d/0x60
[ 1121.891571] generic_handle_irq+0x28/0x40
[ 1121.892399] handle_irq_for_port+0x82/0xf0
[ 1121.893246] evtchn_2l_handle_events+0x1a7/0x270
[ 1121.894200] __xen_evtchn_do_upcall+0x76/0xe0
[ 1121.895111] xen_evtchn_do_upcall+0x2b/0x50
[ 1121.895974] xen_hvm_callback_vector+0x90/0xa0
[ 1121.896887] </IRQ>
[ 1121.897339] RIP: 0010:_raw_spin_unlock_irqrestore+0x15/0x20
[ 1121.898482] RSP: 0000:ffffa2abc0d37d08 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff0c
[ 1121.900019] RAX: 0000000000000001 RBX: ffff92f32161e400 RCX: 000000000002cc00
[ 1121.901461] RDX: 0000000000000001 RSI: 0000000000000246 RDI: 0000000000000246
[ 1121.902912] RBP: ffffa2abc0d37d08 R08: ffff92f32161e470 R09: ffff92f327002480
[ 1121.904363] R10: ffff92f32161e4a4 R11: 0000000000000246 R12: 0000000000000000
[ 1121.905816] R13: ffff92f320d8ee80 R14: 000000000000003b R15: ffff92f32161e560
[ 1121.907274] __setup_irq+0x449/0x740
[ 1121.908018] request_threaded_irq+0x101/0x1b0
[ 1121.908913] bind_ipi_to_irqhandler+0xcc/0x1f0
[ 1121.909829] ? xen_qlock_wait+0x80/0x80
[ 1121.910629] xen_init_lock_cpu+0x97/0xf0
[ 1121.912626] ? skx_uncore_pci_init+0x40/0x40
[ 1121.914659] xen_cpu_up_online+0xe/0x20
[ 1121.916587] cpuhp_invoke_callback+0xb2/0x5c0
[ 1121.918585] ? schedule+0x36/0x80
[ 1121.920338] cpuhp_thread_fun+0xce/0x160
[ 1121.922184] smpboot_thread_fn+0x11a/0x170
[ 1121.924015] kthread+0x105/0x140
[ 1121.925643] ? sort_range+0x30/0x30
[ 1121.927300] ? kthread_bind+0x40/0x40
[ 1121.928922] ret_from_fork+0x35/0x40
[ 1121.930527] Code: 5e 5d c3 44 89 ef e8 1c 04 57 00 84 c0 74 de 44 89 ef e8 b0 df 56 00 eb de 44 89 ef e8 36 04 57 00 eb d4 0f 1f 40 00 55 48 89 e5 <0f> 0b 66 2e 0f 1f 84 00 00 00 00 00 80 3d f9 e6 1f 01 00 55 48
[ 1121.936061] RIP: dummy_handler+0x4/0x10 RSP: ffff92f327a43e38
[ 1121.938150] ---[ end trace 7f404ac02d38ea24 ]---
[ 1121.939992] Kernel panic - not syncing: Fatal exception in interrupt
[ 1121.942253] Kernel Offset: 0x25e00000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)