------- Comment From <email address hidden> 2017-04-06 11:53 EDT------- Same procedure as every kernel, /var/log/syslog:
Apr 6 16:17:29 mclint multipathd[881]: mpatha: sda - tur checker timed out Apr 6 16:17:29 mclint multipathd[881]: 8:0: reinstated Apr 6 16:17:29 mclint multipathd[881]: mpatha: sdb - tur checker timed out Apr 6 16:17:29 mclint multipathd[881]: 8:16: reinstated Apr 6 16:17:29 mclint multipathd[881]: mpatha: sdd - tur checker timed out Apr 6 16:17:29 mclint multipathd[881]: 8:48: reinstated Apr 6 16:17:29 mclint multipathd[881]: mpatha: sdc - tur checker timed out Apr 6 16:17:29 mclint multipathd[881]: 8:32: reinstated
/dev/sclp_line0:
? 361.418628! INFO: task kworker/1:4:860 blocked for more than 120 seconds. ? 361.418635! Not tainted 4.4.0-72-generic #93-Ubuntu ? 361.418637! "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. ? 361.418722! INFO: task cpuplugd:2310 blocked for more than 120 seconds. ? 361.418723! Not tainted 4.4.0-72-generic #93-Ubuntu ? 361.418723! "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. ? 361.418766! INFO: task irqbalance:2416 blocked for more than 120 seconds. ? 361.418767! Not tainted 4.4.0-72-generic #93-Ubuntu ? 361.418768! "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. ? 361.418806! INFO: task kworker/0:2H:3403 blocked for more than 120 seconds. ? 361.418807! Not tainted 4.4.0-72-generic #93-Ubuntu ? 361.418808! "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. ? 361.418990! INFO: task kworker/0:9:4449 blocked for more than 120 seconds. ? 361.418991! Not tainted 4.4.0-72-generic #93-Ubuntu ? 361.418992! "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. ? 481.420013! INFO: task kworker/1:4:860 blocked for more than 120 seconds. ? 481.420020! Not tainted 4.4.0-72-generic #93-Ubuntu ? 481.420021! "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. ? 481.420091! INFO: task systemd-timesyn:1766 blocked for more than 120 seconds . ? 481.420093! Not tainted 4.4.0-72-generic #93-Ubuntu ? 481.420093! "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. ? 481.420136! INFO: task rs:main Q:Reg:2023 blocked for more than 120 seconds. ? 481.420137! Not tainted 4.4.0-72-generic #93-Ubuntu ? 481.420138! "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. ? 481.420250! INFO: task cpuplugd:2310 blocked for more than 120 seconds. ? 481.420251! Not tainted 4.4.0-72-generic #93-Ubuntu ? 481.420252! "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. ? 481.420291! INFO: task irqbalance:2416 blocked for more than 120 seconds. ? 481.420292! Not tainted 4.4.0-72-generic #93-Ubuntu ? 481.420293! "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Dump:
KERNEL: /usr/lib/debug/boot/vmlinux-4.4.0-72-generic DUMPFILE: mclint_20170406_kernel_4_4_0-72_without_openafs.dump CPUS: 1 DATE: Thu Apr 6 16:43:18 2017 UPTIME: 00:29:55 LOAD AVERAGE: 9.99, 9.56, 7.51 TASKS: 403 NODENAME: mclint RELEASE: 4.4.0-72-generic VERSION: #93-Ubuntu SMP Fri Mar 31 14:06:48 UTC 2017 MACHINE: s390x (unknown Mhz) MEMORY: 7.8 GB PANIC: "" PID: 0 COMMAND: "swapper/0" TASK: bad528 [THREAD_INFO: b78000] CPU: 0 STATE: TASK_RUNNING INFO: no panic task found
The bz2-compressed dump is already uploaded to Box.
------- Comment From <email address hidden> 2017-04-06 11:53 EDT-------
Same procedure as every kernel, /var/log/syslog:
Apr 6 16:17:29 mclint multipathd[881]: mpatha: sda - tur checker timed out
Apr 6 16:17:29 mclint multipathd[881]: 8:0: reinstated
Apr 6 16:17:29 mclint multipathd[881]: mpatha: sdb - tur checker timed out
Apr 6 16:17:29 mclint multipathd[881]: 8:16: reinstated
Apr 6 16:17:29 mclint multipathd[881]: mpatha: sdd - tur checker timed out
Apr 6 16:17:29 mclint multipathd[881]: 8:48: reinstated
Apr 6 16:17:29 mclint multipathd[881]: mpatha: sdc - tur checker timed out
Apr 6 16:17:29 mclint multipathd[881]: 8:32: reinstated
/dev/sclp_line0:
? 361.418628! INFO: task kworker/1:4:860 blocked for more than 120 seconds. kernel/ hung_task_ timeout_ secs" disables this kernel/ hung_task_ timeout_ secs" disables this kernel/ hung_task_ timeout_ secs" disables this kernel/ hung_task_ timeout_ secs" disables this kernel/ hung_task_ timeout_ secs" disables this kernel/ hung_task_ timeout_ secs" disables this timesyn: 1766 blocked for more than 120 seconds kernel/ hung_task_ timeout_ secs" disables this kernel/ hung_task_ timeout_ secs" disables this kernel/ hung_task_ timeout_ secs" disables this kernel/ hung_task_ timeout_ secs" disables this
? 361.418635! Not tainted 4.4.0-72-generic #93-Ubuntu
? 361.418637! "echo 0 > /proc/sys/
message.
? 361.418722! INFO: task cpuplugd:2310 blocked for more than 120 seconds.
? 361.418723! Not tainted 4.4.0-72-generic #93-Ubuntu
? 361.418723! "echo 0 > /proc/sys/
message.
? 361.418766! INFO: task irqbalance:2416 blocked for more than 120 seconds.
? 361.418767! Not tainted 4.4.0-72-generic #93-Ubuntu
? 361.418768! "echo 0 > /proc/sys/
message.
? 361.418806! INFO: task kworker/0:2H:3403 blocked for more than 120 seconds.
? 361.418807! Not tainted 4.4.0-72-generic #93-Ubuntu
? 361.418808! "echo 0 > /proc/sys/
message.
? 361.418990! INFO: task kworker/0:9:4449 blocked for more than 120 seconds.
? 361.418991! Not tainted 4.4.0-72-generic #93-Ubuntu
? 361.418992! "echo 0 > /proc/sys/
message.
? 481.420013! INFO: task kworker/1:4:860 blocked for more than 120 seconds.
? 481.420020! Not tainted 4.4.0-72-generic #93-Ubuntu
? 481.420021! "echo 0 > /proc/sys/
message.
? 481.420091! INFO: task systemd-
.
? 481.420093! Not tainted 4.4.0-72-generic #93-Ubuntu
? 481.420093! "echo 0 > /proc/sys/
message.
? 481.420136! INFO: task rs:main Q:Reg:2023 blocked for more than 120 seconds.
? 481.420137! Not tainted 4.4.0-72-generic #93-Ubuntu
? 481.420138! "echo 0 > /proc/sys/
message.
? 481.420250! INFO: task cpuplugd:2310 blocked for more than 120 seconds.
? 481.420251! Not tainted 4.4.0-72-generic #93-Ubuntu
? 481.420252! "echo 0 > /proc/sys/
message.
? 481.420291! INFO: task irqbalance:2416 blocked for more than 120 seconds.
? 481.420292! Not tainted 4.4.0-72-generic #93-Ubuntu
? 481.420293! "echo 0 > /proc/sys/
message.
Dump:
KERNEL: /usr/lib/ debug/boot/ vmlinux- 4.4.0-72- generic 20170406_ kernel_ 4_4_0-72_ without_ openafs. dump
DUMPFILE: mclint_
CPUS: 1
DATE: Thu Apr 6 16:43:18 2017
UPTIME: 00:29:55
LOAD AVERAGE: 9.99, 9.56, 7.51
TASKS: 403
NODENAME: mclint
RELEASE: 4.4.0-72-generic
VERSION: #93-Ubuntu SMP Fri Mar 31 14:06:48 UTC 2017
MACHINE: s390x (unknown Mhz)
MEMORY: 7.8 GB
PANIC: ""
PID: 0
COMMAND: "swapper/0"
TASK: bad528 [THREAD_INFO: b78000]
CPU: 0
STATE: TASK_RUNNING
INFO: no panic task found
The bz2-compressed dump is already uploaded to Box.