error in /usr/src/linux/fs/reiserfs/prints.c line 362

From: Guillaume
Date: Fri Dec 31 2004 - 07:59:44 EST


The server has started to refuse all connections after several days of functioning correctly. After a reboot it worked well during 5 hours until it crashed in exactly the same manner and after analyzing the logs I came accross the following message.

(This machine is a biprocessor AMD MP 2800+, motherboard tyan S2469 but it has ECC RAM Registered (3Go) and SCSI hard drives)

At the moment the crash occured there was a heavy load on the postfix mail queue

Dec 30 14:00:38 lanai -- MARK --
Dec 30 14:20:38 lanai -- MARK --
Dec 30 14:24:31 lanai kernel: <1>Unable to handle kernel paging request at virtual address 00008804
Dec 30 14:24:31 lanai kernel: c01aa27b
Dec 30 14:24:31 lanai kernel: PREEMPT SMP
Dec 30 14:24:31 lanai kernel: Modules linked in: capability commoncap 8250 serial_core unix
Dec 30 14:24:31 lanai kernel: CPU: 1
Dec 30 14:24:31 lanai kernel: EIP: 0060:[reiserfs_allocate_blocks_for_region+2987/5792] Not tainted VLI
Dec 30 14:24:31 lanai kernel: EFLAGS: 00010246 (2.6.9)
Dec 30 14:24:31 lanai kernel: EIP is at reiserfs_allocate_blocks_for_region+0xbab/0x16a0
Dec 30 14:24:31 lanai kernel: eax: 00008804 ebx: ea0ea910 ecx: 00000fff edx: 868b042f
Dec 30 14:24:31 lanai kernel: esi: f7e57d74 edi: ea0ea910 ebp: 00000000 esp: cb62fccc
Dec 30 14:24:31 lanai kernel: ds: 007b es: 007b ss: 0068
Dec 30 14:24:31 lanai kernel: Process procmail (pid: 12316, threadinfo=cb62e000 task=d35334d0)
Dec 30 14:24:31 lanai kernel: Stack: 00000246 cb62febc f3ba3414 cb62fe1c cb62fd4c f3ba3414 c37a7e34 00000004
Dec 30 14:24:31 lanai kernel: 00000000 00008804 f7e57d74 00000050 0000000c 00010000 00010050 00001000
Dec 30 14:24:31 lanai kernel: cb62e000 00000000 00000000 00000000 00000000 c37a7e34 f3ba33c0 00000000
Dec 30 14:24:31 lanai kernel: Call Trace:
Dec 30 14:24:31 lanai kernel: [reiserfs_prepare_file_region_for_write+1493/2720] reiserfs_prepare_file_region_for_write+0x5d5/0xaa0
Dec 30 14:24:31 lanai kernel: [reiserfs_file_write+1353/1952] reiserfs_file_write+0x549/0x7a0
Dec 30 14:24:31 lanai kernel: [link_path_walk+2628/3424] link_path_walk+0xa44/0xd60
Dec 30 14:24:31 lanai kernel: [cache_free_debugcheck+297/608] cache_free_debugcheck+0x129/0x260
Dec 30 14:24:31 lanai kernel: [cp_new_stat64+253/288] cp_new_stat64+0xfd/0x120
Dec 30 14:24:31 lanai kernel: [reiserfs_file_write+0/1952] reiserfs_file_write+0x0/0x7a0
Dec 30 14:24:31 lanai kernel: [vfs_write+216/320] vfs_write+0xd8/0x140
Dec 30 14:24:31 lanai kernel: [sys_write+81/128] sys_write+0x51/0x80
Dec 30 14:24:31 lanai kernel: [syscall_call+7/11] syscall_call+0x7/0xb
Dec 30 14:24:31 lanai kernel: Code: 24 90 01 00 00 48 39 c5 74 3c 8b 07 a8 10 0f 85 6c ff ff ff 8b 44 24 6c 8b 54 24 50 8b 04 82 89 44 24 20 f0 0f ba 2f 04 8b 86 9c <00> 00 00 89 47 1c 8b 54 24 20 89 57 14 ff 44 24 6c f0 0f ba 2f
Dec 30 14:24:31 lanai kernel: <1>Unable to handle kernel paging request at virtual address 00178801
Dec 30 14:24:31 lanai kernel: c01aa27b
Dec 30 14:24:31 lanai kernel: PREEMPT SMP
Dec 30 14:24:31 lanai kernel: Modules linked in: capability commoncap 8250 serial_core unix
Dec 30 14:24:31 lanai kernel: CPU: 1
Dec 30 14:24:31 lanai kernel: EIP: 0060:[reiserfs_allocate_blocks_for_region+2987/5792] Not tainted VLI
Dec 30 14:24:31 lanai kernel: EFLAGS: 00010246 (2.6.9)
Dec 30 14:24:31 lanai kernel: EIP is at reiserfs_allocate_blocks_for_region+0xbab/0x16a0
Dec 30 14:24:31 lanai kernel: eax: 00178801 ebx: e766d58c ecx: 00000fff edx: 868b042f
Dec 30 14:24:31 lanai kernel: esi: f7e57d74 edi: e766d58c ebp: 00000000 esp: d6941ccc
Dec 30 14:24:31 lanai kernel: ds: 007b es: 007b ss: 0068
Dec 30 14:24:31 lanai kernel: Process bounce (pid: 12063, threadinfo=d6940000 task=c5f7d9d0)
Dec 30 14:24:31 lanai kernel: Stack: 00000246 d6941ebc f4ecf414 d6941e1c d6941d4c f4ecf414 c37a7e60 00000004
Dec 30 14:24:31 lanai kernel: 00000000 00178801 f7e57d74 00000050 0000000c 00010000 00010050 00001000
Dec 30 14:24:31 lanai kernel: d6940000 00000000 00000000 00000000 00000000 c37a7e60 f4ecf3c0 00000000
Dec 30 14:24:31 lanai kernel: Call Trace:
Dec 30 14:24:31 lanai kernel: [reiserfs_prepare_file_region_for_write+1493/2720] reiserfs_prepare_file_region_for_write+0x5d5/0xaa0
Dec 30 14:24:31 lanai kernel: [reiserfs_file_write+1353/1952] reiserfs_file_write+0x549/0x7a0
Dec 30 14:24:31 lanai kernel: [journal_end+160/192] journal_end+0xa0/0xc0
Dec 30 14:24:31 lanai kernel: [check_poison_obj+47/480] check_poison_obj+0x2f/0x1e0
Dec 30 14:24:31 lanai kernel: [cache_alloc_debugcheck_after+114/368] cache_alloc_debugcheck_after+0x72/0x170
Dec 30 14:24:31 lanai kernel: [may_open+89/608] may_open+0x59/0x260
Dec 30 14:24:31 lanai kernel: [kmem_cache_alloc+106/160] kmem_cache_alloc+0x6a/0xa0
Dec 30 14:24:31 lanai kernel: [flock_lock_file+310/464] flock_lock_file+0x136/0x1d0
Dec 30 14:24:31 lanai kernel: [flock_lock_file_wait+38/256] flock_lock_file_wait+0x26/0x100
Dec 30 14:24:31 lanai kernel: [cache_alloc_debugcheck_after+114/368] cache_alloc_debugcheck_after+0x72/0x170
Dec 30 14:24:31 lanai kernel: [reiserfs_file_write+0/1952] reiserfs_file_write+0x0/0x7a0
Dec 30 14:24:31 lanai kernel: [vfs_write+216/320] vfs_write+0xd8/0x140
Dec 30 14:24:31 lanai kernel: [sys_write+81/128] sys_write+0x51/0x80
Dec 30 14:24:31 lanai kernel: [syscall_call+7/11] syscall_call+0x7/0xb
Dec 30 14:24:31 lanai kernel: Code: 24 90 01 00 00 48 39 c5 74 3c 8b 07 a8 10 0f 85 6c ff ff ff 8b 44 24 6c 8b 54 24 50 8b 04 82 89 44 24 20 f0 0f ba 2f 04 8b 86 9c <00> 00 00 89 47 1c 8b 54 24 20 89 57 14 ff 44 24 6c f0 0f ba 2f
Dec 30 14:40:38 lanai -- MARK --
Dec 30 14:53:13 lanai syslogd 1.4.1#15: restart.
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4872 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4871 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4870 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4818 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4817 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4780 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4779 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4778 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4777 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4529 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4528 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4527 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4526 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4525 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4524 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4443 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4441 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4440 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4439 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4344 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4227 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4226 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 4225 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 3831 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 3600 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 3599 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 3598 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 3025 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 3024 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 2682 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 2681 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 2147 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 2146 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 2145 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: Removing [2 1997 0x0 SD]..done
Dec 30 14:53:13 lanai kernel: ReiserFS: sda10: There were 162 uncompleted unlinks/truncates. Completed
Dec 30 14:53:13 lanai kernel: ReiserFS: sda11: found reiserfs format "3.6" with standard journal
Dec 30 14:53:13 lanai kernel: ReiserFS: sda11: warning: CONFIG_REISERFS_CHECK is set ON
Dec 30 14:53:13 lanai kernel: ReiserFS: sda11: warning: - it is slow mode for debugging.
Dec 30 14:53:13 lanai kernel: ReiserFS: sda11: using ordered data mode
Dec 30 14:53:13 lanai kernel: ReiserFS: sda11: journal params: device sda11, size 8192, journal first block 18, max trans len 1024, max batch 900, max commit age 30, max trans age 30
Dec 30 14:53:13 lanai kernel: ReiserFS: sda11: checking transaction log (sda11)
Dec 30 14:53:13 lanai kernel: ReiserFS: sda11: Using r5 hash to sort names
Dec 30 14:53:13 lanai kernel: e1000: eth0: e1000_watchdog: NIC Link is Up 100 Mbps Full Duplex
Dec 30 14:53:13 lanai kernel: Serial: 8250/16550 driver $Revision: 1.90 $ 8 ports, IRQ sharing disabled
Dec 30 14:53:13 lanai kernel: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
Dec 30 14:53:13 lanai kernel: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
Dec 30 14:53:13 lanai kernel: Capability LSM initialized
Dec 30 15:13:13 lanai -- MARK --
Dec 30 15:33:13 lanai -- MARK --
Dec 30 15:53:13 lanai -- MARK --
Dec 30 16:13:13 lanai -- MARK --
Dec 30 16:33:13 lanai -- MARK --
Dec 30 16:53:14 lanai -- MARK --
Dec 30 17:13:14 lanai -- MARK --
Dec 30 17:33:14 lanai -- MARK --
Dec 30 17:43:56 lanai kernel: ReiserFS: sda6: warning: vs-8301: reiserfs_kmalloc: allocated memory 200096
Dec 30 18:13:14 lanai -- MARK --
Dec 30 18:33:14 lanai -- MARK --
Dec 30 18:53:14 lanai -- MARK --
Dec 30 19:13:14 lanai -- MARK --


lanai:~# cat /proc/cpuinfo
processor : 0
vendor_id : AuthenticAMD
cpu family : 6
model : 10
model name : AMD Athlon(tm) MP 2800+
stepping : 0
cpu MHz : 2134.402
cache size : 512 KB
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 1
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 mmx fxsr sse syscall mp mmxext 3dnowext 3dnow
bogomips : 4194.30

processor : 1
vendor_id : AuthenticAMD
cpu family : 6
model : 10
model name : AMD Athlon(tm) Processor
stepping : 0
cpu MHz : 2134.402
cache size : 512 KB
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 1
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 mmx fxsr sse syscall mp mmxext 3dnowext 3dnow
bogomips : 4259.84


lanai:~# uname -a
Linux lanai 2.6.9 #1 SMP Fri Dec 24 12:45:27 CET 2004 i686 GNU/Linux

lanai:~# procinfo
Linux 2.6.9 (root@lanai) (gcc ) #à[ÿ· 2CPU [lanai.(none)]

Memory: Total Used Free Shared Buffers
Mem: 3113688 2369512 744176 0 181812
Swap: 578300 0 578300

Bootup: Fri Dec 31 13:14:13 2004 Load average: 1.33 0.44 0.58 9/205 4189

user : 0:09:11.28 12.4% page in : 0
nice : 0:00:00.00 0.0% page out: 0
system: 0:02:33.20 3.4% swap in : 0
idle : 0:51:00.30 68.8% swap out: 0
uptime: 0:37:03.98 context : 1830416

irq 0: 2222582 timer irq 7: 2
irq 1: 8 i8042 irq 8: 1 rtc
irq 2: 0 cascade [4] irq 16: 315388 aic79xx
irq 3: 2 irq 17: 30 aic79xx
irq 4: 1650 serial irq 19: 79448 eth0
irq 6: 2

lanai:~# lsmod
Module Size Used by
capability 4104 0
commoncap 6144 1 capability
8250 21824 2
serial_core 20608 1 8250
unix 24212 920

I use : debian sarge
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/