I am experiencing at one of our compute node hypervisor. kernel version we are using is 4.4.0-83, but seems to be having the issue reported in this report.
[Mon Aug 7 00:19:42 2017] nova-compute invoked oom-killer: gfp_mask=0x2c200ca, order=0, oom_score_adj=0
[Mon Aug 7 00:19:42 2017] nova-compute cpuset=/ mems_allowed=0-1
[Mon Aug 7 00:19:42 2017] CPU: 7 PID: 2164484 Comm: nova-compute Tainted: G OE 4.4.0-83-generic #106-Ubuntu
[Mon Aug 7 00:19:42 2017] Hardware name: Dell Inc. PowerEdge R730/072T6D, BIOS 2.4.3 01/17/2017
[Mon Aug 7 00:19:42 2017] 0000000000000286 00000000d6004dce ffff88014e753a50 ffffffff813f9513
[Mon Aug 7 00:19:42 2017] ffff88014e753c08 ffff883fecf88e00 ffff88014e753ac0 ffffffff8120b53e
[Mon Aug 7 00:19:42 2017] 0000000000000015 0000000000000000 ffff881fe883b740 ffff883fe94f7000
[Mon Aug 7 00:19:42 2017] Call Trace:
[Mon Aug 7 00:19:42 2017] [<ffffffff813f9513>] dump_stack+0x63/0x90
[Mon Aug 7 00:19:42 2017] [<ffffffff81391c64>] ? apparmor_capable+0xc4/0x1b0
[Mon Aug 7 00:19:42 2017] [<ffffffff81192ae2>] oom_kill_process+0x202/0x3c0
[Mon Aug 7 00:19:42 2017] [<ffffffff81192f09>] out_of_memory+0x219/0x460
[Mon Aug 7 00:19:42 2017] [<ffffffff81198ef8>] __alloc_pages_slowpath.constprop.88+0x938/0xad0
[Mon Aug 7 00:19:42 2017] [<ffffffff81199316>] __alloc_pages_nodemask+0x286/0x2a0
[Mon Aug 7 00:19:42 2017] [<ffffffff811e467d>] alloc_pages_vma+0xad/0x250
[Mon Aug 7 00:19:42 2017] [<ffffffff811fad53>] do_huge_pmd_wp_page+0x153/0xb70
[Mon Aug 7 00:19:42 2017] [<ffffffff811c1a5f>] handle_mm_fault+0x90f/0x1820
[Mon Aug 7 00:19:42 2017] [<ffffffff8106b802>] ? do_page_fault+0x22/0x30
[Mon Aug 7 00:19:42 2017] [<ffffffff81842cf8>] ? page_fault+0x28/0x30
[Mon Aug 7 00:19:42 2017] [<ffffffff8106b577>] __do_page_fault+0x197/0x400
[Mon Aug 7 00:19:42 2017] [<ffffffff8106b802>] do_page_fault+0x22/0x30
[Mon Aug 7 00:19:42 2017] [<ffffffff81842cf8>] page_fault+0x28/0x30
[Mon Aug 7 00:19:42 2017] Mem-Info:
[Mon Aug 7 00:19:42 2017] active_anon:61350709 inactive_anon:2118817 isolated_anon:0 active_file:0 inactive_file:0 isolated_file:32 unevictable:915 dirty:0 writeback:8 unstable:0 slab_reclaimable:14082 slab_unreclaimable:64456 mapped:3492 shmem:329012 pagetables:142167 bounce:0 free:260204 free_pcp:4111 free_cma:0
[Tue Aug 8 05:50:08 2017] apt-check invoked oom-killer: gfp_mask=0x24201ca, order=0, oom_score_adj=0
[Tue Aug 8 05:50:08 2017] apt-check cpuset=/ mems_allowed=0-1
[Tue Aug 8 05:50:08 2017] CPU: 11 PID: 2538289 Comm: apt-check Tainted: G OE 4.4.0-83-generic #106-Ubuntu
[Tue Aug 8 05:50:08 2017] Hardware name: Dell Inc. PowerEdge R730/072T6D, BIOS 2.4.3 01/17/2017
[Tue Aug 8 05:50:08 2017] 0000000000000286 000000005e467cc9 ffff8820b44a39f8 ffffffff813f9513
[Tue Aug 8 05:50:08 2017] ffff8820b44a3bb0 ffff881fec15b800 ffff8820b44a3a68 ffffffff8120b53e
[Tue Aug 8 05:50:08 2017] 0000000000000015 ffffffff81e42ac0 ffff883fe996f980 ffffffffffffff04
[Tue Aug 8 05:50:08 2017] Call Trace:
[Tue Aug 8 05:50:08 2017] [<ffffffff813f9513>] dump_stack+0x63/0x90
[Tue Aug 8 05:50:08 2017] [<ffffffff8134544d>] ? cap_capable+0xd/0x70
[Tue Aug 8 05:50:08 2017] [<ffffffff81192ae2>] oom_kill_process+0x202/0x3c0
[Tue Aug 8 05:50:08 2017] [<ffffffff81192f09>] out_of_memory+0x219/0x460
[Tue Aug 8 05:50:08 2017] [<ffffffff81198ef8>] __alloc_pages_slowpath.constprop.88+0x938/0xad0
[Tue Aug 8 05:50:08 2017] [<ffffffff81199316>] __alloc_pages_nodemask+0x286/0x2a0
[Tue Aug 8 05:50:08 2017] [<ffffffff811e2e3c>] alloc_pages_current+0x8c/0x110
[Tue Aug 8 05:50:08 2017] [<ffffffff8118f0ab>] __page_cache_alloc+0xab/0xc0
[Tue Aug 8 05:50:08 2017] [<ffffffff811915ba>] filemap_fault+0x14a/0x3f0
[Tue Aug 8 05:50:08 2017] [<ffffffff812a3506>] ext4_filemap_fault+0x36/0x50
[Tue Aug 8 05:50:08 2017] [<ffffffff811be5d0>] __do_fault+0x50/0xe0
[Tue Aug 8 05:50:08 2017] [<ffffffff811c20f2>] handle_mm_fault+0xfa2/0x1820
[Tue Aug 8 05:50:08 2017] [<ffffffff8106b577>] __do_page_fault+0x197/0x400
[Tue Aug 8 05:50:08 2017] [<ffffffff8106b802>] do_page_fault+0x22/0x30
[Tue Aug 8 05:50:08 2017] [<ffffffff81842cf8>] page_fault+0x28/0x30
[Tue Aug 8 05:50:08 2017] Mem-Info:
[Tue Aug 8 05:50:08 2017] active_anon:61377850 inactive_anon:2049156 isolated_anon:0 active_file:0 inactive_file:0 isolated_file:0 unevictable:915 dirty:0 writeback:0 unstable:0 slab_reclaimable:15329 slab_unreclaimable:101408 mapped:3655 shmem:338468 pagetables:141874 bounce:0 free:260450 free_pcp:2714 free_cma:0
Linux rcgpudc1rh31-02 4.4.0-83-generic #106-Ubuntu SMP Mon Jun 26 17:54:43 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
Hi
I am experiencing at one of our compute node hypervisor. kernel version we are using is 4.4.0-83, but seems to be having the issue reported in this report.
[Mon Aug 7 00:19:42 2017] nova-compute invoked oom-killer: gfp_mask=0x2c200ca, order=0, oom_score_adj=0 513>] dump_stack+ 0x63/0x90 c64>] ? apparmor_ capable+ 0xc4/0x1b0 ae2>] oom_kill_ process+ 0x202/0x3c0 f09>] out_of_ memory+ 0x219/0x460 ef8>] __alloc_ pages_slowpath. constprop. 88+0x938/ 0xad0 316>] __alloc_ pages_nodemask+ 0x286/0x2a0 67d>] alloc_pages_ vma+0xad/ 0x250 d53>] do_huge_ pmd_wp_ page+0x153/ 0xb70 a5f>] handle_ mm_fault+ 0x90f/0x1820 802>] ? do_page_ fault+0x22/ 0x30 cf8>] ? page_fault+ 0x28/0x30 577>] __do_page_ fault+0x197/ 0x400 802>] do_page_ fault+0x22/ 0x30 cf8>] page_fault+ 0x28/0x30 anon:61350709 inactive_ anon:2118817 isolated_anon:0
active_ file:0 inactive_file:0 isolated_file:32
unevictable: 915 dirty:0 writeback:8 unstable:0
slab_reclaimabl e:14082 slab_unreclaima ble:64456
mapped: 3492 shmem:329012 pagetables:142167 bounce:0
free:260204 free_pcp:4111 free_cma:0
[Mon Aug 7 00:19:42 2017] nova-compute cpuset=/ mems_allowed=0-1
[Mon Aug 7 00:19:42 2017] CPU: 7 PID: 2164484 Comm: nova-compute Tainted: G OE 4.4.0-83-generic #106-Ubuntu
[Mon Aug 7 00:19:42 2017] Hardware name: Dell Inc. PowerEdge R730/072T6D, BIOS 2.4.3 01/17/2017
[Mon Aug 7 00:19:42 2017] 0000000000000286 00000000d6004dce ffff88014e753a50 ffffffff813f9513
[Mon Aug 7 00:19:42 2017] ffff88014e753c08 ffff883fecf88e00 ffff88014e753ac0 ffffffff8120b53e
[Mon Aug 7 00:19:42 2017] 0000000000000015 0000000000000000 ffff881fe883b740 ffff883fe94f7000
[Mon Aug 7 00:19:42 2017] Call Trace:
[Mon Aug 7 00:19:42 2017] [<ffffffff813f9
[Mon Aug 7 00:19:42 2017] [<ffffffff81391
[Mon Aug 7 00:19:42 2017] [<ffffffff81192
[Mon Aug 7 00:19:42 2017] [<ffffffff81192
[Mon Aug 7 00:19:42 2017] [<ffffffff81198
[Mon Aug 7 00:19:42 2017] [<ffffffff81199
[Mon Aug 7 00:19:42 2017] [<ffffffff811e4
[Mon Aug 7 00:19:42 2017] [<ffffffff811fa
[Mon Aug 7 00:19:42 2017] [<ffffffff811c1
[Mon Aug 7 00:19:42 2017] [<ffffffff8106b
[Mon Aug 7 00:19:42 2017] [<ffffffff81842
[Mon Aug 7 00:19:42 2017] [<ffffffff8106b
[Mon Aug 7 00:19:42 2017] [<ffffffff8106b
[Mon Aug 7 00:19:42 2017] [<ffffffff81842
[Mon Aug 7 00:19:42 2017] Mem-Info:
[Mon Aug 7 00:19:42 2017] active_
[Tue Aug 8 05:50:08 2017] apt-check invoked oom-killer: gfp_mask=0x24201ca, order=0, oom_score_adj=0 513>] dump_stack+ 0x63/0x90 44d>] ? cap_capable+ 0xd/0x70 ae2>] oom_kill_ process+ 0x202/0x3c0 f09>] out_of_ memory+ 0x219/0x460 ef8>] __alloc_ pages_slowpath. constprop. 88+0x938/ 0xad0 316>] __alloc_ pages_nodemask+ 0x286/0x2a0 e3c>] alloc_pages_ current+ 0x8c/0x110 0ab>] __page_ cache_alloc+ 0xab/0xc0 5ba>] filemap_ fault+0x14a/ 0x3f0 506>] ext4_filemap_ fault+0x36/ 0x50 5d0>] __do_fault+ 0x50/0xe0 0f2>] handle_ mm_fault+ 0xfa2/0x1820 577>] __do_page_ fault+0x197/ 0x400 802>] do_page_ fault+0x22/ 0x30 cf8>] page_fault+ 0x28/0x30 anon:61377850 inactive_ anon:2049156 isolated_anon:0
active_ file:0 inactive_file:0 isolated_file:0
unevictable: 915 dirty:0 writeback:0 unstable:0
slab_reclaimabl e:15329 slab_unreclaima ble:101408
mapped: 3655 shmem:338468 pagetables:141874 bounce:0
free:260450 free_pcp:2714 free_cma:0
[Tue Aug 8 05:50:08 2017] apt-check cpuset=/ mems_allowed=0-1
[Tue Aug 8 05:50:08 2017] CPU: 11 PID: 2538289 Comm: apt-check Tainted: G OE 4.4.0-83-generic #106-Ubuntu
[Tue Aug 8 05:50:08 2017] Hardware name: Dell Inc. PowerEdge R730/072T6D, BIOS 2.4.3 01/17/2017
[Tue Aug 8 05:50:08 2017] 0000000000000286 000000005e467cc9 ffff8820b44a39f8 ffffffff813f9513
[Tue Aug 8 05:50:08 2017] ffff8820b44a3bb0 ffff881fec15b800 ffff8820b44a3a68 ffffffff8120b53e
[Tue Aug 8 05:50:08 2017] 0000000000000015 ffffffff81e42ac0 ffff883fe996f980 ffffffffffffff04
[Tue Aug 8 05:50:08 2017] Call Trace:
[Tue Aug 8 05:50:08 2017] [<ffffffff813f9
[Tue Aug 8 05:50:08 2017] [<ffffffff81345
[Tue Aug 8 05:50:08 2017] [<ffffffff81192
[Tue Aug 8 05:50:08 2017] [<ffffffff81192
[Tue Aug 8 05:50:08 2017] [<ffffffff81198
[Tue Aug 8 05:50:08 2017] [<ffffffff81199
[Tue Aug 8 05:50:08 2017] [<ffffffff811e2
[Tue Aug 8 05:50:08 2017] [<ffffffff8118f
[Tue Aug 8 05:50:08 2017] [<ffffffff81191
[Tue Aug 8 05:50:08 2017] [<ffffffff812a3
[Tue Aug 8 05:50:08 2017] [<ffffffff811be
[Tue Aug 8 05:50:08 2017] [<ffffffff811c2
[Tue Aug 8 05:50:08 2017] [<ffffffff8106b
[Tue Aug 8 05:50:08 2017] [<ffffffff8106b
[Tue Aug 8 05:50:08 2017] [<ffffffff81842
[Tue Aug 8 05:50:08 2017] Mem-Info:
[Tue Aug 8 05:50:08 2017] active_
Linux rcgpudc1rh31-02 4.4.0-83-generic #106-Ubuntu SMP Mon Jun 26 17:54:43 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux