OOM killer invoked on 2.6.24.4

[Marco Barbero]

Hi list

ProLiant DL360 G5, Dual Xeon E5345  @ 2.33GHz, 4Gb RAM
kernel 2.6.24.4
samba/slapd/heartbeat/drbd/mon

Last night mon trigger failover because slapd died.
This was in messages:


Jun 14 01:00:17 pippo kernel: sendmail-mta invoked oom-killer:
gfp_mask=0x800d0, order=0, oomkilladj=0
Jun 14 01:00:17 pippo kernel: Pid: 4520, comm: sendmail-mta Not
tainted 2.6.24.4 #2
Jun 14 01:00:17 pippo kernel:  [<c014a819>] oom_kill_process+0x54/0xf8
Jun 14 01:00:17 pippo kernel:  [<c014ac00>] out_of_memory+0x15c/0x190
Jun 14 01:00:17 pippo kernel:  [<c014c7b2>] __alloc_pages+0x239/0x2c7
Jun 14 01:00:17 pippo kernel:  [<c01661d5>] cp_new_stat64+0xfc/0x10e
Jun 14 01:00:17 pippo kernel:  [<c014c879>] __get_free_pages+0x39/0x47
Jun 14 01:00:17 pippo kernel:  [<c018f8cd>] proc_file_read+0x78/0x237
Jun 14 01:00:17 pippo kernel:  [<c018f855>] proc_file_read+0x0/0x237
Jun 14 01:00:17 pippo kernel:  [<c018c3c1>] proc_reg_read+0x5c/0x6f
Jun 14 01:00:17 pippo kernel:  [<c018c365>] proc_reg_read+0x0/0x6f
Jun 14 01:00:17 pippo kernel:  [<c0163f99>] vfs_read+0x9f/0x121
Jun 14 01:00:17 pippo kernel:  [<c0164396>] sys_read+0x41/0x67
Jun 14 01:00:17 pippo kernel:  [<c0103d56>] sysenter_past_esp+0x5f/0x85
Jun 14 01:00:17 pippo kernel:  =======================
Jun 14 01:00:17 pippo kernel: Mem-info:
Jun 14 01:00:17 pippo kernel: DMA per-cpu:
Jun 14 01:00:17 pippo kernel: CPU    0: Hot: hi:    0, btch:   1 usd:
 0   Cold: hi:    0, btch:   1 usd:   0
Jun 14 01:00:17 pippo kernel: CPU    1: Hot: hi:    0, btch:   1 usd:
 0   Cold: hi:    0, btch:   1 usd:   0
Jun 14 01:00:17 pippo kernel: CPU    2: Hot: hi:    0, btch:   1 usd:
 0   Cold: hi:    0, btch:   1 usd:   0
Jun 14 01:00:17 pippo kernel: CPU    3: Hot: hi:    0, btch:   1 usd:
 0   Cold: hi:    0, btch:   1 usd:   0
Jun 14 01:00:17 pippo kernel: CPU    4: Hot: hi:    0, btch:   1 usd:
 0   Cold: hi:    0, btch:   1 usd:   0
Jun 14 01:00:17 pippo kernel: CPU    5: Hot: hi:    0, btch:   1 usd:
 0   Cold: hi:    0, btch:   1 usd:   0
Jun 14 01:00:17 pippo kernel: CPU    6: Hot: hi:    0, btch:   1 usd:
 0   Cold: hi:    0, btch:   1 usd:   0
Jun 14 01:00:17 pippo kernel: CPU    7: Hot: hi:    0, btch:   1 usd:
 0   Cold: hi:    0, btch:   1 usd:   0
Jun 14 01:00:17 pippo kernel: Normal per-cpu:
Jun 14 01:00:17 pippo kernel: CPU    0: Hot: hi:  186, btch:  31 usd:
116   Cold: hi:   62, btch:  15 usd:  61
Jun 14 01:00:17 pippo kernel: CPU    1: Hot: hi:  186, btch:  31 usd:
37   Cold: hi:   62, btch:  15 usd:  49
Jun 14 01:00:17 pippo kernel: CPU    2: Hot: hi:  186, btch:  31 usd:
107   Cold: hi:   62, btch:  15 usd:  61
Jun 14 01:00:17 pippo kernel: CPU    3: Hot: hi:  186, btch:  31 usd:
41   Cold: hi:   62, btch:  15 usd:  56
Jun 14 01:00:17 pippo kernel: CPU    4: Hot: hi:  186, btch:  31 usd:
13   Cold: hi:   62, btch:  15 usd:   0
Jun 14 01:00:17 pippo kernel: CPU    5: Hot: hi:  186, btch:  31 usd:
167   Cold: hi:   62, btch:  15 usd:  59
Jun 14 01:00:17 pippo kernel: CPU    6: Hot: hi:  186, btch:  31 usd:
61   Cold: hi:   62, btch:  15 usd:   0
Jun 14 01:00:17 pippo kernel: CPU    7: Hot: hi:  186, btch:  31 usd:
102   Cold: hi:   62, btch:  15 usd:   0
Jun 14 01:00:17 pippo kernel: HighMem per-cpu:
Jun 14 01:00:17 pippo kernel: CPU    0: Hot: hi:  186, btch:  31 usd:
 2   Cold: hi:   62, btch:  15 usd:   0
Jun 14 01:00:17 pippo kernel: CPU    1: Hot: hi:  186, btch:  31 usd:
33   Cold: hi:   62, btch:  15 usd:   0
Jun 14 01:00:17 pippo kernel: CPU    2: Hot: hi:  186, btch:  31 usd:
91   Cold: hi:   62, btch:  15 usd:  12
Jun 14 01:00:17 pippo kernel: CPU    3: Hot: hi:  186, btch:  31 usd:
172   Cold: hi:   62, btch:  15 usd:   7
Jun 14 01:00:17 pippo kernel: CPU    4: Hot: hi:  186, btch:  31 usd:
16   Cold: hi:   62, btch:  15 usd:   0
Jun 14 01:00:17 pippo kernel: CPU    5: Hot: hi:  186, btch:  31 usd:
63   Cold: hi:   62, btch:  15 usd:  11
Jun 14 01:00:17 pippo kernel: CPU    6: Hot: hi:  186, btch:  31 usd:
83   Cold: hi:   62, btch:  15 usd:   0
Jun 14 01:00:17 pippo kernel: CPU    7: Hot: hi:  186, btch:  31 usd:
41   Cold: hi:   62, btch:  15 usd:   0
Jun 14 01:00:17 pippo kernel: Active:63299 inactive:6580 dirty:93
writeback:0 unstable:0
Jun 14 01:00:17 pippo kernel:  free:745742 slab:211387 mapped:4303
pagetables:412 bounce:0
Jun 14 01:00:17 pippo kernel: DMA free:3548kB min:68kB low:84kB
high:100kB active:0kB inactive:4kB present:16256kB pages_scanned:25
all_unreclaimable? yes
Jun 14 01:00:17 pippo kernel: lowmem_reserve[]: 0 873 4810 4810
Jun 14 01:00:17 pippo kernel: Normal free:3736kB min:3744kB low:4680kB
high:5616kB active:4616kB inactive:4672kB present:894080kB
pages_scanned:14277 all_unreclaimable? yes
Jun 14 01:00:17 pippo kernel: lowmem_reserve[]: 0 0 31496 31496
Jun 14 01:00:17 pippo kernel: HighMem free:2975684kB min:512kB
low:4736kB high:8960kB active:248580kB inactive:21644kB
present:4031488kB pages_scanned:0 all_unreclaimable? no
Jun 14 01:00:17 pippo kernel: lowmem_reserve[]: 0 0 0 0
Jun 14 01:00:17 pippo kernel: DMA: 7*4kB 2*8kB 1*16kB 1*32kB 2*64kB
0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3548kB
Jun 14 01:00:17 pippo kernel: Normal: 58*4kB 5*8kB 2*16kB 2*32kB
5*64kB 2*128kB 1*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 3760kB
Jun 14 01:00:17 pippo kernel: HighMem: 7371*4kB 5859*8kB 7946*16kB
6213*32kB 4077*64kB 3064*128kB 1859*256kB 889*512kB 452*1024kB
161*2048kB 48*4096kB = 2975684kB
Jun 14 01:00:17 pippo kernel: Swap cache: add 32, delete 32, find
16/19, race 0+0
Jun 14 01:00:17 pippo kernel: Free swap  = 3903752kB
Jun 14 01:00:17 pippo kernel: Total swap = 3903752kB
Jun 14 01:00:17 pippo kernel: Free swap:       3903752kB
Jun 14 01:00:17 pippo kernel: 1245183 pages of RAM
Jun 14 01:00:17 pippo kernel: 1015807 pages of HIGHMEM
Jun 14 01:00:17 pippo kernel: 207787 reserved pages
Jun 14 01:00:17 pippo kernel: 19533 pages shared
Jun 14 01:00:17 pippo kernel: 0 pages swap cached
Jun 14 01:00:17 pippo kernel: 93 pages dirty
Jun 14 01:00:17 pippo kernel: 0 pages writeback
Jun 14 01:00:17 pippo kernel: 4303 pages mapped
Jun 14 01:00:17 pippo kernel: 211387 pages slab
Jun 14 01:00:17 pippo kernel: 412 pages pagetables
Jun 14 01:00:17 pippo kernel: Out of memory: kill process 6873 (slapd)
score 5003 or a child
Jun 14 01:00:17 pippo kernel: Killed process 6873 (slapd)



Anyone can help me in understanding what went wrong? And if I need to
upgrade to last kernel version?
Thanks in advance
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/