Re: -mm: xfs lockdep warning
From: Torsten Kaiser
Date: Thu Oct 07 2010 - 11:15:57 EST
On Thu, Oct 7, 2010 at 4:05 PM, Tejun Heo <tj@xxxxxxxxxx> wrote:
> Hello,
>
> On 10/07/2010 03:21 PM, Torsten Kaiser wrote:
>>> Can you test whether the following patch fix the issue?
>>
>> Yes. After adding this patch to 2.6.36-rc6 it survived my testcase. It
>> first seems to get stuck again, but after less then a minute the
>> system recovered and all compiles finished successfully.
>>
>> I suspect the combination of CFLAGs, the gcc version and maybe even
>> changes in KOffice from 2.2.1 to 2.2.2 are import for my testcase. It
>> looks like at the start of the complies something is really eating an
>> enormous amount of memory and I did not hit such a case with earlier
>> kernels.
>
> It's great to hear that the patch helped but would you be able to
:-(
The second try with the patched 2.6.36-rc6 got stuck again.
> repeat the same test w/ 2.6.35 and see whether there's any noticeable
> difference?
I just tested vanilla 2.6.35, userspace and the testcase as with the
2.6.36-rc6 kernel.
Behavior was the same as with the first try of the patched 2.6.36-rc6:
The testcase started to build up CPU load and memory pressure, then
the mouse got stuck. After ~1 min the system recovered and KDE became
usable again. (Compile just finish OK)
vmstat 60 from 2.6.35:
2 0 0 2365848 1060 742072 0 0 205 7 6467 12252 26 5 62 8
17 0 0 837936 1060 1079520 0 0 1025 24 2210 13483 69 20 8 2
18 0 0 694296 1060 1127728 0 0 231 14 626 1883 74 26 0 0
20 0 0 228540 124 998440 0 0 48 12 604 1820 72 28 0 0
23 1 24 195456 52 657216 0 0 339 11 563 1669 84 16 0 0
0 42 937144 14004 0 164352 0 15617 290 15633 827 1254 24 9 1 66
21 1 861184 776104 0 149908 998 3852 2790 3902 1137 2454 45 15 0 40
21 0 798544 1131964 0 190004 212 0 530 15 599 1469 87 13 0 0
12 1 779488 1536772 0 225312 195 0 398 12 534 1087 88 12 0 0
11 0 620620 2201408 0 273976 1338 0 1638 40 851 2281 75 19 3 3
12 1 588196 1572564 0 344232 521 0 1326 152 787 1888 86 14 0 0
8 0 510876 2286000 0 311464 127 0 442 398 758 1558 88 12 0 0
> Some level of stuttering is expected if the system is hit
> with sudden huge spike of memory pressure but let's see if it has
> regressed somehow.
Yes, if a swapstorm occurs, I can live with a (short) "lockup". For
example compiling openoffice on tmpfs is a case where I have seen
similar short periods of the mouse getting stuck. But with 2.6.36-rc5
it was the first time that the system did not seem to recover, so I
think it should count as a regression compared to 2.6.35.
As the second try with the patched 2.6.36-rc6 got stuck again, could
it be that your patch is incomplete?
>From drivers/md/dm-crypt.c:
cc->io_queue = create_singlethread_workqueue("kcryptd_io");
cc->crypt_queue = create_singlethread_workqueue("kcryptd");
Do these workqueues also need WQ_MEM_RECLAIM?
I have attached the SysRq-M output from the patched -rc6. The symptoms
were the same as with the unpatched kernel. The system got stuck, the
hung_task_timeout triggered for a numer of programs in sync_page() or
do_lookup() and one kworker/1:1:496 was probable the nail in the
coffin.
Do you want me to do more tests with 2.6.35 or the patched .36-rc6? Or
any other patch I should try?
Torsten
[ 646.760693] SysRq : Show Memory
[ 657.523845] SysRq : Changing Loglevel
[ 657.527640] Loglevel set to 6
[ 659.770834] SysRq : Show Memory
[ 659.774109] Mem-Info:
[ 659.776450] Node 0 DMA per-cpu:
[ 659.779709] CPU 0: hi: 0, btch: 1 usd: 0
[ 659.780824] CPU 1: hi: 0, btch: 1 usd: 0
[ 659.780824] CPU 2: hi: 0, btch: 1 usd: 0
[ 659.780824] CPU 3: hi: 0, btch: 1 usd: 0
[ 659.780824] Node 0 DMA32 per-cpu:
[ 659.780824] CPU 0: hi: 186, btch: 31 usd: 0
[ 659.780824] CPU 1: hi: 186, btch: 31 usd: 0
[ 659.780824] CPU 2: hi: 186, btch: 31 usd: 0
[ 659.780824] CPU 3: hi: 186, btch: 31 usd: 0
[ 659.780824] Node 1 DMA32 per-cpu:
[ 659.780824] CPU 0: hi: 186, btch: 31 usd: 0
[ 659.780824] CPU 1: hi: 186, btch: 31 usd: 0
[ 659.780824] CPU 2: hi: 186, btch: 31 usd: 0
[ 659.840014] CPU 3: hi: 186, btch: 31 usd: 0
[ 659.840014] Node 1 Normal per-cpu:
[ 659.840014] CPU 0: hi: 186, btch: 31 usd: 0
[ 659.840014] CPU 1: hi: 186, btch: 31 usd: 0
[ 659.840014] CPU 2: hi: 186, btch: 31 usd: 0
[ 659.840014] CPU 3: hi: 186, btch: 31 usd: 0
[ 659.840014] active_anon:677975 inactive_anon:261811 isolated_anon:1496
[ 659.840014] active_file:411 inactive_file:459 isolated_file:0
[ 659.840014] unevictable:1352 dirty:0 writeback:170816 unstable:0
[ 659.840014] free:3585 slab_reclaimable:8839 slab_unreclaimable:37060
[ 659.840014] mapped:1587 shmem:23114 pagetables:10122 bounce:0
[ 659.840014] Node 0 DMA free:8036kB min:28kB low:32kB high:40kB active_anon:3736kB inactive_anon:3984kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15768kB mlocked:0kB dirty:0kB writeback:560kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:156kB kernel_stack:0kB pagetables:16kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1181 all_unreclaimable? no
[ 659.840014] lowmem_reserve[]: 0 2004 2004 2004
[ 659.840014] Node 0 DMA32 free:3176kB min:4036kB low:5044kB high:6052kB active_anon:1363688kB inactive_anon:454876kB active_file:1608kB inactive_file:1820kB unevictable:580kB isolated(anon):1280kB isolated(file):0kB present:2052320kB mlocked:580kB dirty:0kB writeback:402768kB mapped:4068kB shmem:11732kB slab_reclaimable:17924kB slab_unreclaimable:77816kB kernel_stack:1984kB pagetables:24012kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:137356 all_unreclaimable? no
[ 659.840014] lowmem_reserve[]: 0 0 0 0
[ 659.840014] Node 1 DMA32 free:2340kB min:3036kB low:3792kB high:4552kB active_anon:1136304kB inactive_anon:379920kB active_file:0kB inactive_file:0kB unevictable:1276kB isolated(anon):3296kB isolated(file):0kB present:1544000kB mlocked:1276kB dirty:0kB writeback:221672kB mapped:0kB shmem:76796kB slab_reclaimable:10652kB slab_unreclaimable:30568kB kernel_stack:296kB pagetables:5036kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:120927 all_unreclaimable? no
[ 659.840014] lowmem_reserve[]: 0 0 505 505
[ 659.840014] Node 1 Normal free:788kB min:1016kB low:1268kB high:1524kB active_anon:208172kB inactive_anon:208512kB active_file:36kB inactive_file:16kB unevictable:3552kB isolated(anon):1408kB isolated(file):0kB present:517120kB mlocked:3552kB dirty:0kB writeback:58264kB mapped:2280kB shmem:3928kB slab_reclaimable:6780kB slab_unreclaimable:39700kB kernel_stack:1128kB pagetables:11424kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:89156 all_unreclaimable? no
[ 659.840014] lowmem_reserve[]: 0 0 0 0
[ 659.840014] Node 0 DMA: 43*4kB 1*8kB 3*16kB 2*32kB 1*64kB 2*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 1*4096kB = 8036kB
[ 659.840014] Node 0 DMA32: 276*4kB 7*8kB 0*16kB 1*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 3176kB
[ 659.840014] Node 1 DMA32: 49*4kB 2*8kB 7*16kB 1*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2340kB
[ 659.840014] Node 1 Normal: 21*4kB 10*8kB 7*16kB 0*32kB 0*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 788kB
[ 659.840014] 206580 total pagecache pages
[ 659.840014] 181890 pages in swap cache
[ 659.840014] Swap cache stats: add 251105, delete 69215, find 11614/11665
[ 659.840014] Free swap = 9000388kB
[ 659.840014] Total swap = 10000316kB
[ 659.840014] 1048575 pages RAM
[ 659.840014] 33808 pages reserved
[ 659.840014] 62524 pages shared
[ 659.840014] 996022 pages non-shared
[ 692.249734] SysRq : Show Memory
[ 692.252998] Mem-Info:
[ 692.255347] Node 0 DMA per-cpu:
[ 692.258615] CPU 0: hi: 0, btch: 1 usd: 0
[ 692.259723] CPU 1: hi: 0, btch: 1 usd: 0
[ 692.259723] CPU 2: hi: 0, btch: 1 usd: 0
[ 692.259723] CPU 3: hi: 0, btch: 1 usd: 0
[ 692.259723] Node 0 DMA32 per-cpu:
[ 692.259723] CPU 0: hi: 186, btch: 31 usd: 0
[ 692.259723] CPU 1: hi: 186, btch: 31 usd: 0
[ 692.259723] CPU 2: hi: 186, btch: 31 usd: 0
[ 692.259723] CPU 3: hi: 186, btch: 31 usd: 0
[ 692.259723] Node 1 DMA32 per-cpu:
[ 692.259723] CPU 0: hi: 186, btch: 31 usd: 0
[ 692.259723] CPU 1: hi: 186, btch: 31 usd: 0
[ 692.259723] CPU 2: hi: 186, btch: 31 usd: 0
[ 692.259723] CPU 3: hi: 186, btch: 31 usd: 0
[ 692.259723] Node 1 Normal per-cpu:
[ 692.259723] CPU 0: hi: 186, btch: 31 usd: 0
[ 692.259723] CPU 1: hi: 186, btch: 31 usd: 0
[ 692.259723] CPU 2: hi: 186, btch: 31 usd: 0
[ 692.259723] CPU 3: hi: 186, btch: 31 usd: 0
[ 692.259723] active_anon:677453 inactive_anon:261670 isolated_anon:1473
[ 692.259723] active_file:72 inactive_file:42 isolated_file:0
[ 692.259723] unevictable:1352 dirty:0 writeback:184172 unstable:0
[ 692.259723] free:3710 slab_reclaimable:8763 slab_unreclaimable:38996
[ 692.259723] mapped:832 shmem:20558 pagetables:10122 bounce:0
[ 692.259723] Node 0 DMA free:8040kB min:28kB low:32kB high:40kB active_anon:3736kB inactive_anon:3996kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15768kB mlocked:0kB dirty:0kB writeback:1476kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:156kB kernel_stack:0kB pagetables:16kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:743 all_unreclaimable? no
[ 692.259723] lowmem_reserve[]: 0 2004 2004 2004
[ 692.259723] Node 0 DMA32 free:3544kB min:4036kB low:5044kB high:6052kB active_anon:1362472kB inactive_anon:454652kB active_file:252kB inactive_file:156kB unevictable:580kB isolated(anon):768kB isolated(file):0kB present:2052320kB mlocked:580kB dirty:0kB writeback:416996kB mapped:1048kB shmem:5908kB slab_reclaimable:17636kB slab_unreclaimable:84436kB kernel_stack:1984kB pagetables:24012kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:85247 all_unreclaimable? no
[ 692.259723] lowmem_reserve[]: 0 0 0 0
[ 692.259723] Node 1 DMA32 free:2352kB min:3036kB low:3792kB high:4552kB active_anon:1135940kB inactive_anon:379184kB active_file:0kB inactive_file:0kB unevictable:1276kB isolated(anon):4100kB isolated(file):0kB present:1544000kB mlocked:1276kB dirty:0kB writeback:234936kB mapped:0kB shmem:73664kB slab_reclaimable:10652kB slab_unreclaimable:30632kB kernel_stack:296kB pagetables:5036kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:74277 all_unreclaimable? no
[ 692.259723] lowmem_reserve[]: 0 0 505 505
[ 692.259723] Node 1 Normal free:904kB min:1016kB low:1268kB high:1524kB active_anon:207664kB inactive_anon:208812kB active_file:36kB inactive_file:12kB unevictable:3552kB isolated(anon):1024kB isolated(file):0kB present:517120kB mlocked:3552kB dirty:0kB writeback:83280kB mapped:2280kB shmem:2660kB slab_reclaimable:6764kB slab_unreclaimable:40760kB kernel_stack:1128kB pagetables:11424kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 692.259723] lowmem_reserve[]: 0 0 0 0
[ 692.259723] Node 0 DMA: 44*4kB 1*8kB 3*16kB 2*32kB 1*64kB 2*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 1*4096kB = 8040kB
[ 692.259723] Node 0 DMA32: 338*4kB 10*8kB 6*16kB 1*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 3544kB
[ 692.259723] Node 1 DMA32: 46*4kB 1*8kB 3*16kB 2*32kB 2*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2352kB
[ 692.259723] Node 1 Normal: 88*4kB 3*8kB 3*16kB 1*32kB 1*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 904kB
[ 692.259723] 216617 total pagecache pages
[ 692.259723] 195285 pages in swap cache
[ 692.259723] Swap cache stats: add 265249, delete 69964, find 11614/11666
[ 692.259723] Free swap = 8943908kB
[ 692.259723] Total swap = 10000316kB
[ 692.259723] 1048575 pages RAM
[ 692.259723] 33808 pages reserved
[ 692.259723] 50180 pages shared
[ 692.259723] 996672 pages non-shared
[ 721.740042] INFO: task kworker/1:1:496 blocked for more than 120 seconds.
[ 721.747127] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 721.755350] ffff88007ffe1bb0 0000000000000046 ffff88007ffe1b10 ffffffff81082de0
[ 721.763158] 0000000000012780 ffff88007ff88b60 ffff88007ff88db8 ffff88007ffe1fd8
[ 721.770975] ffff88007ff88dc0 ffff88007ffe0010 0000000000012780 ffff88007ffe1fd8
[ 721.778783] Call Trace:
[ 721.781363] [<ffffffff81082de0>] ? mempool_alloc_slab+0x10/0x20
[ 721.787657] [<ffffffff8156661d>] schedule_timeout+0x19d/0x200
[ 721.793777] [<ffffffff8102f559>] ? enqueue_task_fair+0x159/0x180
[ 721.800170] [<ffffffff81565ace>] wait_for_common+0xfe/0x170
[ 721.806108] [<ffffffff81035da0>] ? default_wake_function+0x0/0x10
[ 721.812588] [<ffffffff81565be8>] wait_for_completion+0x18/0x20
[ 721.818785] [<ffffffff8105335d>] kthread_create+0x8d/0x110
[ 721.824628] [<ffffffff8104f2c0>] ? worker_thread+0x0/0x370
[ 721.830475] [<ffffffff81031a3d>] ? finish_task_switch+0x3d/0xc0
[ 721.836762] [<ffffffff810b914c>] ? kmem_cache_alloc+0x8c/0xa0
[ 721.842825] [<ffffffff8104f04f>] create_worker+0xff/0x170
[ 721.848479] [<ffffffff8104f14d>] manage_workers+0x8d/0x200
[ 721.854239] [<ffffffff8104f5ba>] worker_thread+0x2fa/0x370
[ 721.859987] [<ffffffff8104f2c0>] ? worker_thread+0x0/0x370
[ 721.865748] [<ffffffff810530d6>] kthread+0x96/0xa0
[ 721.870758] [<ffffffff81003154>] kernel_thread_helper+0x4/0x10
[ 721.876870] [<ffffffff81053040>] ? kthread+0x0/0xa0
[ 721.881998] [<ffffffff81003150>] ? kernel_thread_helper+0x0/0x10
[ 721.888281] INFO: task X:2546 blocked for more than 120 seconds.
[ 721.894501] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 721.902611] ffff880006b35d78 0000000000003082 ffff88011fc04c20 0000000000000001
[ 721.910415] 0000000000012780 ffff88000781b330 ffff88000781b588 ffff880006b35fd8
[ 721.918205] ffff88000781b590 ffff880006b34010 0000000000012780 ffff880006b35fd8
[ 721.926090] Call Trace:
[ 721.928556] [<ffffffff81080bb0>] ? sync_page+0x0/0x50
[ 721.933884] [<ffffffff81566372>] io_schedule+0x42/0x60
[ 721.939146] [<ffffffff81080bed>] sync_page+0x3d/0x50
[ 721.944275] [<ffffffff81566732>] __wait_on_bit_lock+0x52/0xb0
[ 721.950153] [<ffffffff81080b92>] __lock_page+0x62/0x70
[ 721.955411] [<ffffffff81053590>] ? wake_bit_function+0x0/0x40
[ 721.961313] [<ffffffff8109ad61>] handle_mm_fault+0xa01/0xa20
[ 721.967094] [<ffffffff810244e0>] do_page_fault+0x100/0x270
[ 721.972728] [<ffffffff815682df>] page_fault+0x1f/0x30
[ 721.977917] INFO: task virtuoso-t:3276 blocked for more than 120 seconds.
[ 721.984792] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 721.992707] ffff88006702dd78 0000000000000086 ffff88011fc04c20 0000000000000001
[ 722.000237] 0000000000012780 ffff880073e738e0 ffff880073e73b38 ffff88006702dfd8
[ 722.007744] ffff880073e73b40 ffff88006702c010 0000000000012780 ffff88006702dfd8
[ 722.015333] Call Trace:
[ 722.017799] [<ffffffff81080bb0>] ? sync_page+0x0/0x50
[ 722.023012] [<ffffffff81566372>] io_schedule+0x42/0x60
[ 722.028255] [<ffffffff81080bed>] sync_page+0x3d/0x50
[ 722.033709] [<ffffffff81566732>] __wait_on_bit_lock+0x52/0xb0
[ 722.039764] [<ffffffff81080b92>] __lock_page+0x62/0x70
[ 722.045234] [<ffffffff81053590>] ? wake_bit_function+0x0/0x40
[ 722.051231] [<ffffffff8109ad61>] handle_mm_fault+0xa01/0xa20
[ 722.057185] [<ffffffff810244e0>] do_page_fault+0x100/0x270
[ 722.062957] [<ffffffff815682df>] page_fault+0x1f/0x30
[ 722.068272] INFO: task as:8337 blocked for more than 120 seconds.
[ 722.074568] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 722.082652] ffff88003dd1fd78 0000000000000086 ffff88011fc04c20 0000000000000001
[ 722.090459] 0000000000012780 ffff880048e56660 ffff880048e568b8 ffff88003dd1ffd8
[ 722.098154] ffff880048e568c0 ffff88003dd1e010 0000000000012780 ffff88003dd1ffd8
[ 722.105875] Call Trace:
[ 722.108427] [<ffffffff81080bb0>] ? sync_page+0x0/0x50
[ 722.113850] [<ffffffff81566372>] io_schedule+0x42/0x60
[ 722.119317] [<ffffffff81080bed>] sync_page+0x3d/0x50
[ 722.124578] [<ffffffff81566732>] __wait_on_bit_lock+0x52/0xb0
[ 722.130706] [<ffffffff81080b92>] __lock_page+0x62/0x70
[ 722.136174] [<ffffffff81053590>] ? wake_bit_function+0x0/0x40
[ 722.142275] [<ffffffff8109ad61>] handle_mm_fault+0xa01/0xa20
[ 722.148289] [<ffffffff810a01bc>] ? do_brk+0x25c/0x340
[ 722.153698] [<ffffffff810244e0>] do_page_fault+0x100/0x270
[ 722.159545] [<ffffffff815682df>] page_fault+0x1f/0x30
[ 722.164958] INFO: task cc1plus:9239 blocked for more than 120 seconds.
[ 722.171820] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 722.180031] ffff8800c4e1fd78 0000000000000082 ffff88011fc04c20 0000000000000001
[ 722.187813] 0000000000012780 ffff8800cdee5550 ffff8800cdee57a8 ffff8800c4e1ffd8
[ 722.195609] ffff8800cdee57b0 ffff8800c4e1e010 0000000000012780 ffff8800c4e1ffd8
[ 722.203377] Call Trace:
[ 722.205922] [<ffffffff81080bb0>] ? sync_page+0x0/0x50
[ 722.211298] [<ffffffff81566372>] io_schedule+0x42/0x60
[ 722.216756] [<ffffffff81080bed>] sync_page+0x3d/0x50
[ 722.222027] [<ffffffff81566732>] __wait_on_bit_lock+0x52/0xb0
[ 722.228063] [<ffffffff81080b92>] __lock_page+0x62/0x70
[ 722.233475] [<ffffffff81053590>] ? wake_bit_function+0x0/0x40
[ 722.239540] [<ffffffff8109ad61>] handle_mm_fault+0xa01/0xa20
[ 722.245532] [<ffffffff810244e0>] do_page_fault+0x100/0x270
[ 722.251303] [<ffffffff815682df>] page_fault+0x1f/0x30
[ 722.256652] INFO: task cc1plus:12681 blocked for more than 120 seconds.
[ 722.263531] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 722.271722] ffff8800c7fdfd78 0000000000000086 ffff88011fc04c20 0000000000000001
[ 722.279487] 0000000000012780 ffff8800cdee0000 ffff8800cdee0258 ffff8800c7fdffd8
[ 722.287207] ffff8800cdee0260 ffff8800c7fde010 0000000000012780 ffff8800c7fdffd8
[ 722.294929] Call Trace:
[ 722.297448] [<ffffffff81080bb0>] ? sync_page+0x0/0x50
[ 722.302790] [<ffffffff81566372>] io_schedule+0x42/0x60
[ 722.308215] [<ffffffff81080bed>] sync_page+0x3d/0x50
[ 722.313505] [<ffffffff81566732>] __wait_on_bit_lock+0x52/0xb0
[ 722.319533] [<ffffffff81080b92>] __lock_page+0x62/0x70
[ 722.324961] [<ffffffff81053590>] ? wake_bit_function+0x0/0x40
[ 722.331045] [<ffffffff8109ad61>] handle_mm_fault+0xa01/0xa20
[ 722.336988] [<ffffffff810244e0>] do_page_fault+0x100/0x270
[ 722.342830] [<ffffffff815682df>] page_fault+0x1f/0x30
[ 722.348180] INFO: task cc1plus:13371 blocked for more than 120 seconds.
[ 722.355065] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 722.363467] ffff88010742bd78 0000000000000086 ffff88011fc04c20 0000000000000001
[ 722.370997] 0000000000012780 ffff8800cdee05b0 ffff8800cdee0808 ffff88010742bfd8
[ 722.378512] ffff8800cdee0810 ffff88010742a010 0000000000012780 ffff88010742bfd8
[ 722.386076] Call Trace:
[ 722.388534] [<ffffffff81080bb0>] ? sync_page+0x0/0x50
[ 722.393720] [<ffffffff81566372>] io_schedule+0x42/0x60
[ 722.398965] [<ffffffff81080bed>] sync_page+0x3d/0x50
[ 722.404086] [<ffffffff81566732>] __wait_on_bit_lock+0x52/0xb0
[ 722.409934] [<ffffffff81080b92>] __lock_page+0x62/0x70
[ 722.415205] [<ffffffff81053590>] ? wake_bit_function+0x0/0x40
[ 722.421125] [<ffffffff8109ad61>] handle_mm_fault+0xa01/0xa20
[ 722.426869] [<ffffffff810244e0>] do_page_fault+0x100/0x270
[ 722.432486] [<ffffffff815682df>] page_fault+0x1f/0x30
[ 722.437640] INFO: task make:13846 blocked for more than 120 seconds.
[ 722.444054] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 722.451935] ffff880104533b88 0000000000000086 ffff8800cb19e760 0000000000000202
[ 722.459417] 0000000000012780 ffff880080c64fa0 ffff880080c651f8 ffff880104533fd8
[ 722.466936] ffff880080c65200 ffff880104532010 0000000000012780 ffff880104533fd8
[ 722.474774] Call Trace:
[ 722.477240] [<ffffffff81080bb0>] ? sync_page+0x0/0x50
[ 722.482442] [<ffffffff81080bb0>] ? sync_page+0x0/0x50
[ 722.487615] [<ffffffff81566372>] io_schedule+0x42/0x60
[ 722.492919] [<ffffffff81080bed>] sync_page+0x3d/0x50
[ 722.498007] [<ffffffff81566867>] __wait_on_bit+0x57/0x80
[ 722.503467] [<ffffffff81080d8e>] wait_on_page_bit+0x6e/0x80
[ 722.509168] [<ffffffff81053590>] ? wake_bit_function+0x0/0x40
[ 722.515080] [<ffffffff81092454>] shmem_getpage+0x5b4/0x860
[ 722.520723] [<ffffffff81092d46>] shmem_file_aio_read+0x1e6/0x380
[ 722.526909] [<ffffffff810bfc52>] do_sync_read+0xd2/0x110
[ 722.532415] [<ffffffff811d49aa>] ? security_file_permission+0x6a/0x70
[ 722.539040] [<ffffffff810bff95>] vfs_read+0xc5/0x180
[ 722.544209] [<ffffffff810c063c>] sys_read+0x4c/0x80
[ 722.549255] [<ffffffff8100242b>] system_call_fastpath+0x16/0x1b
[ 722.555373] INFO: task cc1plus:13856 blocked for more than 120 seconds.
[ 722.562112] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 722.570090] ffff8800dca63bc8 0000000000000086 ffff8800dca63b68 ffffffff8102f559
[ 722.577673] 0000000000012780 ffff88010e79ec10 ffff88010e79ee68 ffff8800dca63fd8
[ 722.585582] ffff88010e79ee70 ffff8800dca62010 0000000000012780 ffff8800dca63fd8
[ 722.593122] Call Trace:
[ 722.595595] [<ffffffff8102f559>] ? enqueue_task_fair+0x159/0x180
[ 722.601747] [<ffffffff81566e91>] __mutex_lock_slowpath+0xe1/0x160
[ 722.608054] [<ffffffff810d3252>] ? __d_lookup+0xa2/0x140
[ 722.613595] [<ffffffff8156692e>] mutex_lock+0x1e/0x40
[ 722.618845] [<ffffffff810cb1ba>] do_lookup+0xfa/0x170
[ 722.624140] [<ffffffff810cbcb5>] link_path_walk+0x4d5/0x9c0
[ 722.629913] [<ffffffff810cc2b0>] path_walk+0x60/0xe0
[ 722.635095] [<ffffffff810cc383>] do_path_lookup+0x53/0x60
[ 722.640720] [<ffffffff810ccfc3>] user_path_at+0x53/0xa0
[ 722.646154] [<ffffffff810a374d>] ? page_add_new_anon_rmap+0x7d/0xc0
[ 722.652664] [<ffffffff8109ab32>] ? handle_mm_fault+0x7d2/0xa20
[ 722.658702] [<ffffffff810c4187>] vfs_fstatat+0x37/0x70
[ 722.664051] [<ffffffff810c4296>] vfs_stat+0x16/0x20
[ 722.669121] [<ffffffff810c42bf>] sys_newstat+0x1f/0x50
[ 722.674494] [<ffffffff8102450c>] ? do_page_fault+0x12c/0x270
[ 722.680361] [<ffffffff815682df>] ? page_fault+0x1f/0x30
[ 722.685786] [<ffffffff8100242b>] system_call_fastpath+0x16/0x1b
[ 722.691940] INFO: task cc1plus:13859 blocked for more than 120 seconds.
[ 722.698644] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 722.706623] ffff8800c4dc1bc8 0000000000000086 ffff8800c4dc1b68 ffffffff00000000
[ 722.714199] 0000000000012780 ffff88010e79be90 ffff88010e79c0e8 ffff8800c4dc1fd8
[ 722.721837] ffff88010e79c0f0 ffff8800c4dc0010 0000000000012780 ffff8800c4dc1fd8
[ 722.729431] Call Trace:
[ 722.731929] [<ffffffff81566e91>] __mutex_lock_slowpath+0xe1/0x160
[ 722.738191] [<ffffffff810d3252>] ? __d_lookup+0xa2/0x140
[ 722.743690] [<ffffffff8156692e>] mutex_lock+0x1e/0x40
[ 722.748907] [<ffffffff810cb1ba>] do_lookup+0xfa/0x170
[ 722.754202] [<ffffffff810cbcb5>] link_path_walk+0x4d5/0x9c0
[ 722.759980] [<ffffffff810cc2b0>] path_walk+0x60/0xe0
[ 722.765173] [<ffffffff810cc383>] do_path_lookup+0x53/0x60
[ 722.770800] [<ffffffff810ccfc3>] user_path_at+0x53/0xa0
[ 722.776223] [<ffffffff810a374d>] ? page_add_new_anon_rmap+0x7d/0xc0
[ 722.782743] [<ffffffff8109ab32>] ? handle_mm_fault+0x7d2/0xa20
[ 722.788797] [<ffffffff810c4187>] vfs_fstatat+0x37/0x70
[ 722.794111] [<ffffffff810c4296>] vfs_stat+0x16/0x20
[ 722.799138] [<ffffffff810c42bf>] sys_newstat+0x1f/0x50
[ 722.804494] [<ffffffff8102450c>] ? do_page_fault+0x12c/0x270
[ 722.810378] [<ffffffff815682df>] ? page_fault+0x1f/0x30
[ 722.815795] [<ffffffff8100242b>] system_call_fastpath+0x16/0x1b
[ 736.990877] SysRq : Show Memory
[ 736.994135] Mem-Info:
[ 736.996476] Node 0 DMA per-cpu:
[ 736.999744] CPU 0: hi: 0, btch: 1 usd: 0
[ 737.000866] CPU 1: hi: 0, btch: 1 usd: 0
[ 737.000866] CPU 2: hi: 0, btch: 1 usd: 0
[ 737.000866] CPU 3: hi: 0, btch: 1 usd: 0
[ 737.000866] Node 0 DMA32 per-cpu:
[ 737.000866] CPU 0: hi: 186, btch: 31 usd: 0
[ 737.000866] CPU 1: hi: 186, btch: 31 usd: 0
[ 737.000866] CPU 2: hi: 186, btch: 31 usd: 0
[ 737.000866] CPU 3: hi: 186, btch: 31 usd: 0
[ 737.000866] Node 1 DMA32 per-cpu:
[ 737.000866] CPU 0: hi: 186, btch: 31 usd: 0
[ 737.000866] CPU 1: hi: 186, btch: 31 usd: 0
[ 737.000866] CPU 2: hi: 186, btch: 31 usd: 0
[ 737.000866] CPU 3: hi: 186, btch: 31 usd: 0
[ 737.000866] Node 1 Normal per-cpu:
[ 737.000866] CPU 0: hi: 186, btch: 31 usd: 0
[ 737.000866] CPU 1: hi: 186, btch: 31 usd: 0
[ 737.000866] CPU 2: hi: 186, btch: 31 usd: 0
[ 737.000866] CPU 3: hi: 186, btch: 31 usd: 0
[ 737.000866] active_anon:677421 inactive_anon:261648 isolated_anon:1537
[ 737.000866] active_file:55 inactive_file:17 isolated_file:0
[ 737.000866] unevictable:1352 dirty:0 writeback:185484 unstable:0
[ 737.000866] free:3559 slab_reclaimable:8759 slab_unreclaimable:39192
[ 737.000866] mapped:790 shmem:20039 pagetables:10122 bounce:0
[ 737.100049] Node 0 DMA free:8040kB min:28kB low:32kB high:40kB active_anon:3736kB inactive_anon:4012kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15768kB mlocked:0kB dirty:0kB writeback:1476kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:156kB kernel_stack:0kB pagetables:16kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 737.100049] lowmem_reserve[]: 0 2004 2004 2004
[ 737.100049] Node 0 DMA32 free:3080kB min:4036kB low:5044kB high:6052kB active_anon:1362344kB inactive_anon:454652kB active_file:204kB inactive_file:40kB unevictable:580kB isolated(anon):768kB isolated(file):0kB present:2052320kB mlocked:580kB dirty:0kB writeback:417620kB mapped:884kB shmem:5900kB slab_reclaimable:17620kB slab_unreclaimable:85076kB kernel_stack:1984kB pagetables:24012kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:413 all_unreclaimable? no
[ 737.100049] lowmem_reserve[]: 0 0 0 0
[ 737.100049] Node 1 DMA32 free:2348kB min:3036kB low:3792kB high:4552kB active_anon:1135940kB inactive_anon:379172kB active_file:0kB inactive_file:0kB unevictable:1276kB isolated(anon):4100kB isolated(file):0kB present:1544000kB mlocked:1276kB dirty:0kB writeback:237876kB mapped:0kB shmem:71704kB slab_reclaimable:10652kB slab_unreclaimable:30636kB kernel_stack:296kB pagetables:5036kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:716 all_unreclaimable? no
[ 737.100049] lowmem_reserve[]: 0 0 505 505
[ 737.100049] Node 1 Normal free:768kB min:1016kB low:1268kB high:1524kB active_anon:207664kB inactive_anon:208556kB active_file:16kB inactive_file:28kB unevictable:3552kB isolated(anon):1280kB isolated(file):0kB present:517120kB mlocked:3552kB dirty:0kB writeback:84964kB mapped:2276kB shmem:2552kB slab_reclaimable:6764kB slab_unreclaimable:40900kB kernel_stack:1128kB pagetables:11424kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:391 all_unreclaimable? no
[ 737.100049] lowmem_reserve[]: 0 0 0 0
[ 737.100049] Node 0 DMA: 44*4kB 1*8kB 3*16kB 2*32kB 1*64kB 2*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 1*4096kB = 8040kB
[ 737.100049] Node 0 DMA32: 266*4kB 0*8kB 0*16kB 1*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 3080kB
[ 737.100049] Node 1 DMA32: 45*4kB 1*8kB 3*16kB 2*32kB 2*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2348kB
[ 737.100049] Node 1 Normal: 54*4kB 3*8kB 3*16kB 1*32kB 1*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 768kB
[ 737.100049] 217413 total pagecache pages
[ 737.100049] 196596 pages in swap cache
[ 737.100049] Swap cache stats: add 266560, delete 69964, find 11614/11666
[ 737.100049] Free swap = 8938664kB
[ 737.100049] Total swap = 10000316kB
[ 737.100049] 1048575 pages RAM
[ 737.100049] 33808 pages reserved
[ 737.100049] 50100 pages shared
[ 737.100049] 996764 pages non-shared
[ 747.384761] SysRq : Show Memory
[ 747.388025] Mem-Info:
[ 747.390366] Node 0 DMA per-cpu:
[ 747.393633] CPU 0: hi: 0, btch: 1 usd: 0
[ 747.394750] CPU 1: hi: 0, btch: 1 usd: 0
[ 747.394750] CPU 2: hi: 0, btch: 1 usd: 0
[ 747.394750] CPU 3: hi: 0, btch: 1 usd: 0
[ 747.394750] Node 0 DMA32 per-cpu:
[ 747.394750] CPU 0: hi: 186, btch: 31 usd: 0
[ 747.394750] CPU 1: hi: 186, btch: 31 usd: 0
[ 747.394750] CPU 2: hi: 186, btch: 31 usd: 0
[ 747.394750] CPU 3: hi: 186, btch: 31 usd: 0
[ 747.394750] Node 1 DMA32 per-cpu:
[ 747.394750] CPU 0: hi: 186, btch: 31 usd: 0
[ 747.394750] CPU 1: hi: 186, btch: 31 usd: 0
[ 747.394750] CPU 2: hi: 186, btch: 31 usd: 0
[ 747.394750] CPU 3: hi: 186, btch: 31 usd: 0
[ 747.394750] Node 1 Normal per-cpu:
[ 747.394750] CPU 0: hi: 186, btch: 31 usd: 0
[ 747.394750] CPU 1: hi: 186, btch: 31 usd: 0
[ 747.394750] CPU 2: hi: 186, btch: 31 usd: 0
[ 747.394750] CPU 3: hi: 186, btch: 31 usd: 0
[ 747.394750] active_anon:677421 inactive_anon:261648 isolated_anon:1537
[ 747.394750] active_file:11 inactive_file:11 isolated_file:0
[ 747.394750] unevictable:1352 dirty:0 writeback:185484 unstable:0
[ 747.394750] free:3613 slab_reclaimable:8755 slab_unreclaimable:39192
[ 747.394750] mapped:740 shmem:20039 pagetables:10122 bounce:0
[ 747.394750] Node 0 DMA free:8040kB min:28kB low:32kB high:40kB active_anon:3736kB inactive_anon:4012kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15768kB mlocked:0kB dirty:0kB writeback:1476kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:156kB kernel_stack:0kB pagetables:16kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 747.394750] lowmem_reserve[]: 0 2004 2004 2004
[ 747.394750] Node 0 DMA32 free:3296kB min:4036kB low:5044kB high:6052kB active_anon:1362344kB inactive_anon:454724kB active_file:28kB inactive_file:16kB unevictable:580kB isolated(anon):768kB isolated(file):0kB present:2052320kB mlocked:580kB dirty:0kB writeback:417620kB mapped:684kB shmem:5900kB slab_reclaimable:17604kB slab_unreclaimable:85076kB kernel_stack:1984kB pagetables:24012kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 747.394750] lowmem_reserve[]: 0 0 0 0
[ 747.394750] Node 1 DMA32 free:2348kB min:3036kB low:3792kB high:4552kB active_anon:1135940kB inactive_anon:379284kB active_file:0kB inactive_file:0kB unevictable:1276kB isolated(anon):4100kB isolated(file):0kB present:1544000kB mlocked:1276kB dirty:0kB writeback:237876kB mapped:0kB shmem:71704kB slab_reclaimable:10652kB slab_unreclaimable:30636kB kernel_stack:296kB pagetables:5036kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 747.394750] lowmem_reserve[]: 0 0 505 505
[ 747.394750] Node 1 Normal free:768kB min:1016kB low:1268kB high:1524kB active_anon:207664kB inactive_anon:208572kB active_file:16kB inactive_file:28kB unevictable:3552kB isolated(anon):1280kB isolated(file):0kB present:517120kB mlocked:3552kB dirty:0kB writeback:84964kB mapped:2276kB shmem:2552kB slab_reclaimable:6764kB slab_unreclaimable:40900kB kernel_stack:1128kB pagetables:11424kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 747.394750] lowmem_reserve[]: 0 0 0 0
[ 747.394750] Node 0 DMA: 44*4kB 1*8kB 3*16kB 2*32kB 1*64kB 2*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 1*4096kB = 8040kB
[ 747.394750] Node 0 DMA32: 302*4kB 5*8kB 2*16kB 1*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 3296kB
[ 747.394750] Node 1 DMA32: 45*4kB 1*8kB 3*16kB 2*32kB 2*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2348kB
[ 747.394750] Node 1 Normal: 54*4kB 3*8kB 3*16kB 1*32kB 1*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 768kB
[ 747.730058] 217363 total pagecache pages
[ 747.730058] 196596 pages in swap cache
[ 747.730058] Swap cache stats: add 266560, delete 69964, find 11614/11666
[ 747.730058] Free swap = 8938664kB
[ 747.730058] Total swap = 10000316kB
[ 747.730058] 1048575 pages RAM
[ 747.730058] 33808 pages reserved
[ 747.730058] 48587 pages shared
[ 747.730058] 996797 pages non-shared
[ 765.630495] SysRq : Show Memory
[ 765.633743] Mem-Info:
[ 765.636069] Node 0 DMA per-cpu:
[ 765.639295] CPU 0: hi: 0, btch: 1 usd: 0
[ 765.640488] CPU 1: hi: 0, btch: 1 usd: 0
[ 765.640488] CPU 2: hi: 0, btch: 1 usd: 0
[ 765.640488] CPU 3: hi: 0, btch: 1 usd: 0
[ 765.640488] Node 0 DMA32 per-cpu:
[ 765.640488] CPU 0: hi: 186, btch: 31 usd: 0
[ 765.640488] CPU 1: hi: 186, btch: 31 usd: 0
[ 765.640488] CPU 2: hi: 186, btch: 31 usd: 0
[ 765.640488] CPU 3: hi: 186, btch: 31 usd: 0
[ 765.640488] Node 1 DMA32 per-cpu:
[ 765.640488] CPU 0: hi: 186, btch: 31 usd: 0
[ 765.640488] CPU 1: hi: 186, btch: 31 usd: 0
[ 765.640488] CPU 2: hi: 186, btch: 31 usd: 0
[ 765.640488] CPU 3: hi: 186, btch: 31 usd: 0
[ 765.640488] Node 1 Normal per-cpu:
[ 765.640488] CPU 0: hi: 186, btch: 31 usd: 0
[ 765.640488] CPU 1: hi: 186, btch: 31 usd: 0
[ 765.640488] CPU 2: hi: 186, btch: 31 usd: 0
[ 765.640488] CPU 3: hi: 186, btch: 31 usd: 0
[ 765.640488] active_anon:677421 inactive_anon:261658 isolated_anon:1537
[ 765.640488] active_file:3 inactive_file:11 isolated_file:0
[ 765.640488] unevictable:1352 dirty:0 writeback:185934 unstable:0
[ 765.640488] free:3549 slab_reclaimable:8755 slab_unreclaimable:39259
[ 765.640488] mapped:732 shmem:19874 pagetables:10122 bounce:0
[ 765.640488] Node 0 DMA free:8040kB min:28kB low:32kB high:40kB active_anon:3736kB inactive_anon:3988kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15768kB mlocked:0kB dirty:0kB writeback:1476kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:156kB kernel_stack:0kB pagetables:16kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 765.640488] lowmem_reserve[]: 0 2004 2004 2004
[ 765.640488] Node 0 DMA32 free:3036kB min:4036kB low:5044kB high:6052kB active_anon:1362344kB inactive_anon:454840kB active_file:12kB inactive_file:32kB unevictable:580kB isolated(anon):768kB isolated(file):0kB present:2052320kB mlocked:580kB dirty:0kB writeback:417620kB mapped:684kB shmem:5900kB slab_reclaimable:17604kB slab_unreclaimable:85332kB kernel_stack:1984kB pagetables:24012kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 765.640488] lowmem_reserve[]: 0 0 0 0
[ 765.845104] Node 1 DMA32 free:2348kB min:3036kB low:3792kB high:4552kB active_anon:1135940kB inactive_anon:379248kB active_file:0kB inactive_file:0kB unevictable:1276kB isolated(anon):4100kB isolated(file):0kB present:1544000kB mlocked:1276kB dirty:0kB writeback:239616kB mapped:0kB shmem:71100kB slab_reclaimable:10652kB slab_unreclaimable:30636kB kernel_stack:296kB pagetables:5036kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 765.845104] lowmem_reserve[]: 0 0 505 505
[ 765.845104] Node 1 Normal free:788kB min:1016kB low:1268kB high:1524kB active_anon:207664kB inactive_anon:208556kB active_file:0kB inactive_file:12kB unevictable:3552kB isolated(anon):1280kB isolated(file):0kB present:517120kB mlocked:3552kB dirty:0kB writeback:85024kB mapped:2244kB shmem:2496kB slab_reclaimable:6764kB slab_unreclaimable:40912kB kernel_stack:1128kB pagetables:11424kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 765.845104] lowmem_reserve[]: 0 0 0 0
[ 765.845104] Node 0 DMA: 44*4kB 1*8kB 3*16kB 2*32kB 1*64kB 2*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 1*4096kB = 8040kB
[ 765.845104] Node 0 DMA32: 255*4kB 0*8kB 0*16kB 1*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 3036kB
[ 765.845104] Node 1 DMA32: 45*4kB 1*8kB 3*16kB 2*32kB 2*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2348kB
[ 765.845104] Node 1 Normal: 55*4kB 5*8kB 3*16kB 1*32kB 1*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 788kB
[ 765.845104] 217638 total pagecache pages
[ 765.845104] 197044 pages in swap cache
[ 765.845104] Swap cache stats: add 267008, delete 69964, find 11614/11666
[ 765.845104] Free swap = 8936872kB
[ 765.845104] Total swap = 10000316kB
[ 765.845104] 1048575 pages RAM
[ 765.845104] 33808 pages reserved
[ 765.845104] 48325 pages shared
[ 765.845104] 996865 pages non-shared