kernel BUG at /build/buildd/linux- 2.6.32/kernel/cred.c:168

Hi Anthony,

Please be sure to confirm this issue exists with the latest development release of Ubuntu. ISO CD images are available from http://cdimage.ubuntu.com/daily/current/ . If the issue remains, please run the following command from a Terminal (Applications->Accessories->Terminal). It will automatically gather and attach updated debug information to this report.

apport-collect -p linux 606892

Also, if you could test the latest upstream kernel available that would be great. It will allow additional upstream developers to examine the issue. Refer to https://wiki.ubuntu.com/KernelMainlineBuilds . Once you've tested the upstream kernel, please remove the 'needs-upstream-testing' tag. This can be done by clicking on the yellow pencil icon next to the tag located at the bottom of the bug description and deleting the 'needs-upstream-testing' text. Please let us know your results.

Thanks in advance.

    [This is an automated message. Apologies if it has reached you inappropriately; please just reply to this message indicating so.]

Dear Jeremy

Unfortunately I do not know how to replicate this bug so could not really test properly, also the server is in production so it would be a breach of contract to run a development kernel on it.

If the bug does reappear I will be sure to do apport-collect, however does that command still work properly after a hard reboot?

I've been seeing this sort of thing on 2.6.32-24 also. Filed an upstream bug about it.

I upgraded the kernel to the latest version:

uname -a
Linux byron 2.6.32-24-server #41-Ubuntu SMP Thu Aug 19 02:47:08 UTC 2010 x86_64 GNU/Linux

and within a few hours the issue has reappeared. I attach a log of the console output. Again the kernel locked up, unable even to respond to Magic SysRq.

I notice that the same as last time, the process munin-node is implicated. I will disable munin-node for now, but clearly a user-mode process should not be able to lock up the kernel.

[20265.245221] ------------[ cut here ]------------
[20265.260159] kernel BUG at /build/buildd/linux-2.6.32/kernel/cred.c:168!
[20265.276697] invalid opcode: 0000 [#1] SMP
[20265.290483] last sysfs file: /sys/devices/system/cpu/cpu15/cache/index2/shared_cpu_map
[20265.317858] CPU 9
[20265.330789] Modules linked in: ip6table_filter ip6_tables ipt_MASQUERADE iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack ipt_REJECT xt_tcpudp iptable_filter ip_tables x_tables nfsd kvm_intel lockd nfs_acl kvm auth_rpcgss sunrpc exportfs 8021q garp fbcon tileblit bridge font bitblit stp softcursor vga16fb vgastate ipmi_si psmouse ipmi_devintf serio_raw ioatdma ipmi_msghandler joydev usbhid hid igb 3w_9xxx dca
[20265.372725] Pid: 30950, comm: munin-node Not tainted 2.6.32-24-server #41-Ubuntu X8DTU
[20265.372727] RIP: 0010:[<ffffffff8108b48e>] [<ffffffff8108b48e>] __put_cred+0x3e/0x50
[20265.372736] RSP: 0018:ffff8809a3537ed8 EFLAGS: 00010202
[20265.372738] RAX: 0000000000000001 RBX: ffff880622f68fc0 RCX: 00000000ffffffff
[20265.372740] RDX: 00000000ffffffff RSI: ffff880622f68fc0 RDI: ffff880622f68fc0
[20265.372742] RBP: ffff8809a3537ed8 R08: 0000000000000000 R09: ffff880c225d78e0
[20265.372745] R10: 00000000000000c0 R11: 0000000000000000 R12: ffff880622f683c0
[20265.372747] R13: ffff880c21d496f0 R14: 0000000000000001 R15: 0000000000000001
[20265.372750] FS: 00007f5012e9a700(0000) GS:ffff880016ea0000(0000) knlGS:0000000000000000
[20265.372752] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[20265.372755] CR2: 00007f5011f99240 CR3: 00000009a3b31000 CR4: 00000000000026e0
[20265.372757] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000

I notice that there is an upstream patch for this precise issue which I suggest be put into the Ubuntu kernel.

http://git.kernel.org/?p=linux/kernel/git/torvalds/linux-2.6.git;a=commitdiff_plain;h=de09a9771a5346029f4d11e4ac886be7f9bfdd75

I am therefore removing the needs-upstream-testing flag in the hope that this issue can now be dealt with by Ubuntu.

apport information

apport information

apport information

apport information

apport information

apport information

apport information

apport information

apport information

Same here once on one of seven compute nodes after over a week of computing
with that particular kernel. That certainly shows it's hard to reproduce.

I am affected by this bug on a daily basis with the most recent Ubuntu kernel.
Running sudo seem to trigger the problem.

2.6.32-26-server #48-Ubuntu SMP:

[ 294.112155] ------------[ cut here ]------------
[ 294.112159] kernel BUG at /build/buildd/linux-2.6.32/kernel/cred.c:168!
[ 294.112161] invalid opcode: 0000 [#1] SMP
[ 294.112163] last sysfs file: /sys/devices/pci0000:00/0000:00:1c.1/0000:03:00.0/net/wlan0/operstate
[ 294.112165] CPU 0
[ 294.112166] Modules linked in: binfmt_misc ppdev parport_pc ipt_MASQUERADE iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack ipt_REJECT xt_tcpudp iptable_filter ip_tables x_tables bridge stp kvm_intel kvm nls_utf8 cifs nfsd exportfs nfs lockd nfs_acl auth_rpcgss fbcon tileblit font bitblit softcursor vga16fb vgastate snd_hda_codec_conexant thinkpad_acpi sunrpc arc4 snd_hda_intel snd_hda_codec snd_hwdep snd_pcm_oss snd_mixer_oss snd_pcm snd_seq_dummy pcmcia snd_seq_oss snd_seq_midi iwlagn snd_rawmidi radeon iwlcore ttm snd_seq_midi_event drm_kms_helper snd_seq mac80211 snd_timer snd_seq_device uvcvideo yenta_socket ricoh_mmc videodev v4l1_compat v4l2_compat_ioctl32 rsrc_nonstatic pcmcia_core snd psmouse serio_raw cfg80211 sdhci_pci sdhci led_class nvram tpm_tis tpm tpm_bios drm i2c_algo_bit video output soundcore snd_page_alloc intel_agp lp parport ohci1394 dm_raid45 usb_storage xor ieee1394 e1000e ahci
[ 294.112216] Pid: 15091, comm: sudo Not tainted 2.6.32-26-server #48-Ubuntu 40613VG
[ 294.112218] RIP: 0010:[<ffffffff8108a64e>] [<ffffffff8108a64e>] __put_cred+0x3e/0x50
[ 294.112225] RSP: 0018:ffff8800bdaa9f18 EFLAGS: 00010202
[ 294.112226] RAX: 0000000000000001 RBX: ffff880102bedb40 RCX: 00000000ffffffff
[ 294.112228] RDX: 00000000ffffffff RSI: ffff880102bedb40 RDI: ffff880102bedb40
[ 294.112229] RBP: ffff8800bdaa9f18 R08: 0000000000000000 R09: 0000000000000000
[ 294.112231] R10: 0000000000000000 R11: 0000000000000246 R12: ffff880102bed0c0
[ 294.112233] R13: ffff8801183a96e0 R14: 0000000000000000 R15: 0000000000000001
[ 294.112235] FS: 00002b34d4f18c00(0000) GS:ffff880005600000(0000) knlGS:0000000000000000
[ 294.112236] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 294.112238] CR2: 00002b34d49a5355 CR3: 00000000ba0cc000 CR4: 00000000000426f0
[ 294.112240] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 294.112241] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 294.112243] Process sudo (pid: 15091, threadinfo ffff8800bdaa8000, task ffff8801183a96e0)
[ 294.112244] Stack:
[ 294.112245] ffff8800bdaa9f48 ffffffff8108acc1 ffff8800bdaa9f38 ffff880102bed0c0
[ 294.112248] <0> 0000000000000000 ffff880102bedb40 ffff8800bdaa9f78 ffffffff8107cd3a
[ 294.112251] <0> 0000000000000000 000000000041e992 00000000016bfd00 0000000000000001
[ 294.112254] Call Trace:
[ 294.112257] [<ffffffff8108acc1>] commit_creds+0x121/0x1e0
[ 294.112260] [<ffffffff8107cd3a>] sys_setuid+0xda/0x100
[ 294.112264] [<ffffffff810121b2>] system_call_fastpath+0x16/0x1b
[ 294.112265] Code: 8b 04 25 c0 cb 00 00 48 3b b8 48 04 00 00 74 23 48 3b b8 40 04 00 00 74 16 48 83 ef 80 48 c7 c6 b0 a6 08 81 e8 74 e9 03 00 c9 c3 <0f> 0b eb fe 0f 0b eb fe...

while true; do
   sudo ls;
done

immediately causes an Oops.

Regards,

-p.

I'm seeing the same thing that Peter Wahlman reports. Here's the output from one of my servers:

Jan 19 16:23:13 kernel: [640271.778354] ------------[ cut here ]------------
Jan 19 16:23:13 kernel: [640271.783516] kernel BUG at /build/buildd/linux-2.6.32/kernel
/cred.c:168!
Jan 19 16:23:13 kernel: [640271.788785] invalid opcode: 0000 [#1] SMP
Jan 19 16:23:13 kernel: [640271.794625] last sysfs file: /sys/devices/pci0000:00/0000:0
0:1c.4/0000:02:00.1/irq
Jan 19 16:23:13 kernel: [640271.806738] CPU 2
Jan 19 16:23:13 kernel: [640271.813323] Modules linked in: nfp kvm_intel kvm bridge stp
 fbcon lp tileblit font bitblit softcursor vga16fb vgastate bnx2 power_meter parport dell_wmi shpchp
dcdbas xfs exportfs mptsas mptscsih mptbase scsi_transport_sas
Jan 19 16:23:13 kernel: [640271.839128] Pid: 22152, comm: sudo Not tainted 2.6.32-27-se
rver #49-Ubuntu PowerEdge R310
Jan 19 16:23:13 kernel: [640271.857099] RIP: 0010:[<ffffffff8108a7ae>] [<ffffffff8108a
7ae>] __put_cred+0x3e/0x50
Jan 19 16:23:13 kernel: [640271.877475] RSP: 0018:ffff8800b187df08 EFLAGS: 00010202
Jan 19 16:23:13 kernel: [640271.888184] RAX: 0000000000000001 RBX: ffff88010300f980 RCX
: 00000000ffffffff
Jan 19 16:23:13 kernel: [640271.911071] RDX: 00000000ffffffff RSI: ffff88010300f980 RDI
: ffff88010300f980
Jan 19 16:23:13 kernel: [640271.935858] RBP: ffff8800b187df08 R08: 0000000000000000 R09
: ffff8800b1b60040
Jan 19 16:23:13 kernel: [640271.962432] R10: 00007ffc5d188f98 R11: 0000000000000246 R12
: ffff88010300f5c0
Jan 19 16:23:13 kernel: [640271.989093] R13: ffff880232e044a0 R14: ffff88010300f980 R15
: 0000000000000001
Jan 19 16:23:13 kernel: [640272.016052] FS: 00007ffc5d7b0700(0000) GS:ffff880008e40000
(0000) knlGS:0000000000000000
Jan 19 16:23:13 kernel: [640272.043282] CS: 0010 DS: 0000 ES: 0000 CR0: 00000000800500
33
Jan 19 16:23:13 kernel: [640272.057416] CR2: 00007ffc5d710000 CR3: 00000000a334a000 CR4
: 00000000000026e0
Jan 19 16:23:13 kernel: [640272.085660] DR0: 0000000000000000 DR1: 0000000000000000 DR2
: 0000000000000000
Jan 19 16:23:13 kernel: [640272.114818] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7
: 0000000000000400
Jan 19 16:23:13 kernel: [640272.144811] Process sudo (pid: 22152, threadinfo ffff8800b1
87c000, task ffff880232e044a0)
Jan 19 16:23:13 kernel: [640272.176015] Stack:
Jan 19 16:23:13 kernel: [640272.191270] ffff8800b187df38 ffffffff8108ae21 ffff8800b187
df38 ffff88010300f5c0
Jan 19 16:23:13 kernel: [640272.206914] <0> 0000000000000000 00000000ffffffff ffff8800b
187df78 ffffffff8107c9e6
Jan 19 16:23:13 kernel: [640272.237830] <0> ffff8800b187df78 0000000000000004 000000000
0000004 00007fff476ba6a0
Jan 19 16:23:13 kernel: [640272.283543] Call Trace:
Jan 19 16:23:13 kernel: [640272.298684] [<ffffffff8108ae21>] commit_creds+0x121/0x1e0
Jan 19 16:23:13 kernel: [640272.313701] [<ffffffff8107c9e6>] sys_setregid+0xe6/0x140
Jan 19 16:23:13 kernel: [640272.328061] [<ffffffff810121b2>] system_call_fastpath+0x16
/0x1b
Jan 19 16:23:13 kernel: [640272.342596] Code: 8b 04 25 c0 cb 00 00 48 3b b8 48 04 00 00
 74 23 48 3b b8 40 04 00 00 74 16 48 83 ef 80 48 c7 c6 10 a8 08 81 e8 a4 e8 03 00 c9 c3 <0f> 0b eb fe
 0f 0b eb fe 0f 0...

I can also replicate this by running

while true; do
  sudo ls
done