* Re: Bug report : reproducible memory allocator bug in 2.6.20-rc6
2007-01-28 20:25 ` Bug report : reproducible memory allocator bug in 2.6.19.2 Martin J. Bligh
@ 2007-01-28 21:05 ` Mathieu Desnoyers
2007-01-30 3:27 ` Bug report : reproducible memory bug (hardware failure, sorry) Mathieu Desnoyers
1 sibling, 0 replies; 4+ messages in thread
From: Mathieu Desnoyers @ 2007-01-28 21:05 UTC (permalink / raw)
To: Martin J. Bligh; +Cc: linux-kernel, Andrew Morton, Ingo Molnar
* Martin J. Bligh (mbligh@mbligh.org) wrote:
> Mathieu Desnoyers wrote:
> >Hi,
> >
> >Trying to build cross-compilers (or kernels) on a 2-way x86_64 (amd64) with
> >make -j3 triggers the following OOPS after about 30 minutes on
> >2.6.19.2. Due to the amount of time and the heavy load it takes before it
> >happens, I suspect a race condition. Memtest86 tests passed ok. The
> >amount of swap used when the condition happens is about 52k and stable
> >(only ~800MB/1GB are used).
> >
> >I am going to give it a look, but I suspect you might help narrowing it
> >down more quickly. Any insight would be appreciated.
>
> Mmm. that's going to be messy to debug ... but didn't we already know
> that kernel was racy? Or is 2.6.19.2 after that fix already? Does 20-rc6
> still break?
>
Hi Martin,
I hoped it would go away magically too, but here is a similar list bug
happening on 2.6.20-rc6, this time from "release_pages".
-- SUMMARY ---
list_del corruption. next->prev should be ffff81003b5315d8, but was ffff81003b21e1d0
------------[ cut here ]------------
kernel BUG at /home/compudj/git/linux-2.6-lttng/lib/list_debug.c:72!
invalid opcode: 0000 [1] SMP
CPU 1
Modules linked in: ipv6 ppdev lp parport_serial dm_snapshot dm_mirror dm_mod sbp2 loop ide_cd cdrom eth1394 snd_hda_intel snd_hda_codec snd_pcm_oss snd_mixer_oss snd_pcm amd74xx snd_timer snd serio_raw soundcore i2c_nforce2 ohci_hcd psmouse pcspkr ohci1394 ieee1394 i2c_core parport_pc parport ehci_hcd snd_page_alloc forcedeth floppy ext3 jbd mbcache sd_mod generic ide_core ata_generic sata_nv libata scsi_mod evdev
Pid: 11807, comm: ld Not tainted 2.6.20-rc6 #1
RIP: 0010:[<ffffffff803298e4>] [<ffffffff803298e4>] list_del+0x3f/0x5b
RSP: 0018:ffff81001774fc68 EFLAGS: 00010096
RAX: 0000000000000058 RBX: ffff81003b531590 RCX: ffffffff806096b8
RDX: ffff81001c86d100 RSI: 0000000000000001 RDI: 0000000000000096
RBP: ffff81001774fc68 R08: 0000000000000002 R09: 0000000000000080
R10: 0000000000000080 R11: ffff810001020b00 R12: ffff81000000b440
R13: ffff81000101ea28 R14: 0000000000000000 R15: 000000000000000e
FS: 00002acae32b3c80(0000) GS:ffff8100011af138(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00002acae3108150 CR3: 0000000000201000 CR4: 00000000000006e0
Process ld (pid: 11807, threadinfo ffff81001774e000, task ffff81001c86d100)
Stack: ffff81001774fd28 ffffffff8020b142 0000000000000000 0000000000000000
ffff81003ba5ca80 ffff81003b10e938 ffff81003bd46c40 ffff81003b21e188
ffff81003bbf4790 ffff81003b165128 ffff81003af43958 ffff81003b8c19e0
Call Trace:
[<ffffffff8020b142>] release_pages+0xdb/0x18a
[<ffffffff8020e44d>] free_pages_and_swap_cache+0x7b/0x96
[<ffffffff80207d6d>] unmap_vmas+0x437/0x6ff
[<ffffffff802396ed>] exit_mmap+0x7a/0xf1
[<ffffffff8023b8af>] mmput+0x3d/0x8f
[<ffffffff8023ffe6>] exit_mm+0xe1/0xea
[<ffffffff8021490a>] do_exit+0x230/0x83d
[<ffffffff802621ca>] trace_hardirqs_on_thunk+0x35/0x37
[<ffffffff80247481>] debug_mutex_init+0x0/0x45
[<ffffffff8024accc>] sys_exit_group+0x12/0x14
[<ffffffff8025b11e>] system_call+0x7e/0x83
--- whole dmesg ----
root (hd0,0)
Filesystem type is ext2fs, partition type 0x83
kernel /vmlinuz root=/dev/sda2 ro console=tty0 console=ttyS0,38400n8
[Linux-bzImage, setup=0x1e00, size=0x1a25e1]
initrd /initrd.img
[Linux-initrd @ 0x37c66000, 0x389efd bytes]
savedefault
0000:04:08.0: ttyS0 at I/O 0xc880 (irq = 19) is a 16550A
RAMDISK driver initialized: 16 RAM disks of 65536K size 1024 blocksize
usbmon: debugfs is not available
PNP: PS/2 Controller [PNP0303:PS2K] at 0x60,0x64 irq 1
PNP: PS/2 controller doesn't have AUX irq; using default 12
serio: i8042 KBD port at 0x60,0x64 irq 1
serio: i8042 AUX port at 0x60,0x64 irq 12
mice: PS/2 mouse device common for all mice
TCP bic registered
NET: Registered protocol family 1
NET: Registered protocol family 17
NET: Registered protocol family 8
NET: Registered protocol family 20
input: AT Translated Set 2 keyboard as /class/input/input0
ACPI: (supports S0 S1 S3 S4 S5)
Freeing unused kernel memory: 296k freed
SCSI subsystem initialized
ACPI: PCI Interrupt Link [LSA0] enabled at IRQ 23
ACPI: PCI Interrupt 0000:00:0e.0[A] -> Link [LSA0] -> GSI 23 (level, low) -> IRQ 23
ata1: SATA max UDMA/133 cmd 0xE800 ctl 0xE482 bmdma 0xE000 irq 23
ata2: SATA max UDMA/133 cmd 0xE400 ctl 0xE082 bmdma 0xE008 irq 23
scsi0 : sata_nv
ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
ata1.00: ATA-7, max UDMA/133, 390721968 sectors: LBA48 NCQ (depth 0/32)
ata1.00: ata1: dev 0 multi count 16
ata1.00: configured for UDMA/133
scsi1 : sata_nv
ata2: SATA link down (SStatus 0 SControl 300)
ATA: abnormal status 0x7F on port 0xE407
scsi 0:0:0:0: Direct-Access ATA ST3200827AS 3.AA PQ: 0 ANSI: 5
ACPI: PCI Interrupt Link [LSA1] enabled at IRQ 22
ACPI: PCI Interrupt 0000:00:0f.0[A] -> Link [LSA1] -> GSI 22 (level, low) -> IRQ 22
ata3: SATA max UDMA/133 cmd 0xDC00 ctl 0xD882 bmdma 0xD400 irq 22
ata4: SATA max UDMA/133 cmd 0xD800 ctl 0xD482 bmdma 0xD408 irq 22
scsi2 : sata_nv
ata3: SATA link down (SStatus 0 SControl 300)
ATA: abnormal status 0x7F on port 0xDC07
scsi3 : sata_nv
ata4: SATA link down (SStatus 0 SControl 300)
ATA: abnormal status 0x7F on port 0xD807
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
SCSI device sda: 390721968 512-byte hdwr sectors (200050 MB)
sda: Write Protect is off
SCSI device sda: write cache: enabled, read cache: enabled, doesn't support DPO or FUA
SCSI device sda: 390721968 512-byte hdwr sectors (200050 MB)
sda: Write Protect is off
SCSI device sda: write cache: enabled, read cache: enabled, doesn't support DPO or FUA
sda: sda1 sda2 sda3 < sda5 sda6 >
sd 0:0:0:0: Attached scsi disk sda
kjournald starting. Commit interval 5 seconds
EXT3-fs: mounted filesystem with ordered data mode.
Switching root ...
INIT: version 2.86 booting
Starting the hotplug events dispatcher: udevd.
Synthesizing the initial hotplug events...done.
Waiting for /dev to be fully populated...Floppy drive(s): fd0 is 1.44M
FDC 0 is a post-1991 82077
forcedeth.c: Reverse Engineered nForce ethernet driver. Version 0.59.
ACPI: PCI Interrupt Link [LMAC] enabled at IRQ 21
ACPI: PCI Interrupt 0000:00:14.0[A] -> Link [LMAC] -> GSI 21 (level, low) -> IRQ 21
forcedeth: using HIGHDMA
parport: PnPBIOS parport detected.
parport0: PC-style at 0x378, irq 7 [PCSPP]
eth0: forcedeth.c: subsystem: 01043:8141 bound to 0000:00:14.0
ACPI: PCI Interrupt Link [LUB2] enabled at IRQ 20
ACPI: PCI Interrupt 0000:00:0b.1[B] -> Link [LUB2] -> GSI 20 (level, low) -> IRQ 20
ehci_hcd 0000:00:0b.1: EHCI Host Controller
ehci_hcd 0000:00:0b.1: new USB bus registered, assigned bus number 1
ehci_hcd 0000:00:0b.1: debug port 1
ehci_hcd 0000:00:0b.1: irq 20, io mem 0xfebdfc00
ehci_hcd 0000:00:0b.1: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004
usb usb1: configuration #1 chosen from 1 choice
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 8 ports detected
input: PC Speaker as /class/input/input1
ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 18
ACPI: PCI Interrupt 0000:04:05.0[A] -> Link [LNKD] -> <6>i2c_adapter i2c-0: nForce2 SMBus adapter at 0x600
i2c_adapter i2c-1: nForce2 SMBus adapter at 0x700
GSI 18 (level, low) -> IRQ 18
ohci1394: fw-host0: OHCI-1394 1.0 (PCI): IRQ=[18] MMIO=[faaff800-faafffff] Max Packet=[2048] IR/IT contexts=[4/8]
ACPI: PCI Interrupt Link [LUB0] enabled at IRQ 23
ACPI: PCI Interrupt 0000:00:0b.0[A] -> Link [LUB0] -> GSI 23 (level, low) -> IRQ 23
ohci_hcd 0000:00:0b.0: OHCI Host Controller
ohci_hcd 0000:00:0b.0: new USB bus registered, assigned bus number 2
ohci_hcd 0000:00:0b.0: irq 23, io mem 0xfebde000
usb usb2: configuration #1 chosen from 1 choice
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 8 ports detected
NFORCE-MCP51: IDE controller at PCI slot 0000:00:0d.0
NFORCE-MCP51: chipset revision 161
NFORCE-MCP51: not 100% native mode: will probe irqs later
NFORCE-MCP51: 0000:00:0d.0 (rev a1) UDMA133 controller
ide0: BM-DMA at 0xffa0-0xffa7, BIOS settings: hda:DMA, hdb:DMA
ide1: BM-DMA at 0xffa8-0xffaf, BIOS settings: hdc:pio, hdd:pio
hda: HL-DT-ST DVDRAM GSA-H10N, ATAPI CD/DVD-ROM drive
eth1394: eth0: IEEE-1394 IPv4 over 1394 Ethernet (fw-host0)
hdb: LITE-ON CD-ROM LTN-5291S, ATAPI CD/DVD-ROM drive
ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
ACPI: PCI Interrupt Link [LAZA] enabled at IRQ 22
ACPI: PCI Interrupt 0000:00:10.1[B] -> Link [LAZA] -> GSI 22 (level, low) -> IRQ 22
hda: ATAPI 48X DVD-ROM DVD-R-RAM CD-R/RW drive, 2048kB Cache, UDMA(33)
Uniform CD-ROM driver Revision: 3.20
hdb: ATAPI 52X CD-ROM drive, 96kB Cache, UDMA(33)
done.
Activating swap...Adding 2000052k swap on /dev/sda5. Priority:-1 extents:1 across:2000052k
done.
Checking root file system...fsck 1.40-WIP (14-Nov-2006)
/dev/sda2: clean, 246842/4889248EXT3 FS on sda2, files, 2723904/internal journal
9765511 blocks
done.
Setting the system clock again..
Cleaning up ifupdown....
Loading modules...loop: loaded (max 8 devices)
done.
Loading device-mapper supportdevice-mapper: ioctl: 4.11.0-ioctl (2006-10-12) initialised: dm-devel@redhat.com
.
Checking file systems...fsck 1.40-WIP (14-Nov-2006)
/dev/sda1: clean, 54/122880 files, 61989/489948 blocks
/dev/sda6: clean, 1190226/12222464 files, 5154123/24414775 blocks
done.
Setting kernel variables...error: "net.ipv4.netfilter.ip_conntrack_tcp_be_liberal" is an unknown key
failed.
Mounting local filesystems...kjournald starting. Commit interval 5 seconds
EXT3 FS on sda1, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting. Commit interval 5 seconds
EXT3 FS on sda6, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
done.
Activating swapfile swap...done.
Detecting hardware...Setting up networking....
Configuring network interfaces...done.
Starting portmap daemon....
Setting console screen modes and fonts.
Setting up ALSA...done.
INIT: Entering runlevel: 2
Starting system log daemon: syslogd.
Starting kernel log daemon: klogd.
Starting portmap daemon...Already running..
Starting BitTorrent tracker: disabled in /etc/default/bittorrent.
Starting Common Unix Printing System: cupsdlp0: using parport0 (interrupt-driven).
ppdev: user-space parallel port driver
.
Starting system message bus: dbus.
Starting Hardware abstraction layer: hald.
Starting Avahi mDNS/DNS-SD Daemon: avahi-daemonNET: Registered protocol family 10
lo: Disabled Privacy Extensions
.
Starting MTA: exim4.
Starting printer spooler: lpd.
Starting internet superserver: inetd.
Starting OpenBSD Secure Shell server: sshd.
Starting GNOME Display Manager: gdm.
Starting NFS common utilities: statd.
Starting deferred execution scheduler: atd.
Starting periodic command scheduler: crond.
Debian GNU/Linux 4.0 amd64 ttyS0
amd64 login:
list_del corruption. next->prev should be ffff81003b5315d8, but was ffff81003b21e1d0
------------[ cut here ]------------
kernel BUG at /home/compudj/git/linux-2.6-lttng/lib/list_debug.c:72!
invalid opcode: 0000 [1] SMP
CPU 1
Modules linked in: ipv6 ppdev lp parport_serial dm_snapshot dm_mirror dm_mod sbp2 loop ide_cd cdrom eth1394 snd_hda_intel snd_hda_codec snd_pcm_oss snd_mixer_oss snd_pcm amd74xx snd_timer snd serio_raw soundcore i2c_nforce2 ohci_hcd psmouse pcspkr ohci1394 ieee1394 i2c_core parport_pc parport ehci_hcd snd_page_alloc forcedeth floppy ext3 jbd mbcache sd_mod generic ide_core ata_generic sata_nv libata scsi_mod evdev
Pid: 11807, comm: ld Not tainted 2.6.20-rc6 #1
RIP: 0010:[<ffffffff803298e4>] [<ffffffff803298e4>] list_del+0x3f/0x5b
RSP: 0018:ffff81001774fc68 EFLAGS: 00010096
RAX: 0000000000000058 RBX: ffff81003b531590 RCX: ffffffff806096b8
RDX: ffff81001c86d100 RSI: 0000000000000001 RDI: 0000000000000096
RBP: ffff81001774fc68 R08: 0000000000000002 R09: 0000000000000080
R10: 0000000000000080 R11: ffff810001020b00 R12: ffff81000000b440
R13: ffff81000101ea28 R14: 0000000000000000 R15: 000000000000000e
FS: 00002acae32b3c80(0000) GS:ffff8100011af138(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00002acae3108150 CR3: 0000000000201000 CR4: 00000000000006e0
Process ld (pid: 11807, threadinfo ffff81001774e000, task ffff81001c86d100)
Stack: ffff81001774fd28 ffffffff8020b142 0000000000000000 0000000000000000
ffff81003ba5ca80 ffff81003b10e938 ffff81003bd46c40 ffff81003b21e188
ffff81003bbf4790 ffff81003b165128 ffff81003af43958 ffff81003b8c19e0
Call Trace:
[<ffffffff8020b142>] release_pages+0xdb/0x18a
[<ffffffff8020e44d>] free_pages_and_swap_cache+0x7b/0x96
[<ffffffff80207d6d>] unmap_vmas+0x437/0x6ff
[<ffffffff802396ed>] exit_mmap+0x7a/0xf1
[<ffffffff8023b8af>] mmput+0x3d/0x8f
[<ffffffff8023ffe6>] exit_mm+0xe1/0xea
[<ffffffff8021490a>] do_exit+0x230/0x83d
[<ffffffff802621ca>] trace_hardirqs_on_thunk+0x35/0x37
[<ffffffff80247481>] debug_mutex_init+0x0/0x45
[<ffffffff8024accc>] sys_exit_group+0x12/0x14
[<ffffffff8025b11e>] system_call+0x7e/0x83
Code: 0f 0b eb fe 48 89 48 08 48 89 01 48 c7 47 08 00 02 20 00 48
RIP [<ffffffff803298e4>] list_del+0x3f/0x5b
RSP <ffff81001774fc68>
<1>Fixing recursive fault but reboot is needed!
NMI Watchdog detected LOCKUP on CPU 0
CPU 0
Modules linked in: ipv6 ppdev lp parport_serial dm_snapshot dm_mirror dm_mod sbp2 loop ide_cd cdrom eth1394 snd_hda_intel snd_hda_codec snd_pcm_oss snd_mixer_oss snd_pcm amd74xx snd_timer snd serio_raw soundcore i2c_nforce2 ohci_hcd psmouse pcspkr ohci1394 ieee1394 i2c_core parport_pc parport ehci_hcd snd_page_alloc forcedeth floppy ext3 jbd mbcache sd_mod generic ide_core ata_generic sata_nv libata scsi_mod evdev
Pid: 11821, comm: sh Not tainted 2.6.20-rc6 #1
RIP: 0010:[<ffffffff802078be>] [<ffffffff802078be>] _raw_spin_lock+0x81/0xf9
RSP: 0000:ffff810002317cb8 EFLAGS: 00000046
RAX: 0000000000000000 RBX: ffff81000000b700 RCX: 00000000f6a35d61
RDX: 000000000000033a RSI: ffff8100178608c0 RDI: 0000000000000001
RBP: ffff810002317cd8 R08: 0000000000000002 R09: 0000000000000001
R10: 0000000000000000 R11: 0000000000000001 R12: 0000000006ab296d
R13: 0000000000000001 R14: 0000000077c3cc34 R15: ffff81001dcc6bb8
FS: 00002b12d23036d0(0000) GS:ffffffff80548000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00000000005be064 CR3: 000000002a9e2000 CR4: 00000000000006e0
Process sh (pid: 11821, threadinfo ffff810002316000, task ffff810017860140)
Stack: ffff81000000b700 ffff81000000b440 ffff810001019480 0000000000000000
ffff810002317cf8 ffffffff80262975 ffff81003b7347d0 ffff81003b498cf0
ffff810002317d28 ffffffff8020d436 0000000000000012 ffff81003b542cb0
Call Trace:
[<ffffffff80262975>] _spin_lock_irq+0x33/0x38
[<ffffffff8020d436>] __pagevec_lru_add_active+0x62/0xdf
[<ffffffff8020ffa0>] lru_cache_add_active+0x4f/0x51
[<ffffffff802106f3>] do_wp_page+0x401/0x4aa
[<ffffffff80208ff9>] __handle_mm_fault+0x96b/0x9e2
[<ffffffff8020aab5>] do_page_fault+0x364/0x817
[<ffffffff8020ab74>] do_page_fault+0x423/0x817
[<ffffffff802629e0>] _spin_unlock_irq+0x2b/0x31
[<ffffffff802629e0>] _spin_unlock_irq+0x2b/0x31
[<ffffffff80228ebd>] do_sigaction+0x17a/0x190
[<ffffffff802621ca>] trace_hardirqs_on_thunk+0x35/0x37
[<ffffffff80262c8d>] error_exit+0x0/0x96
Code: 7f 55 bf 01 00 00 00 49 ff c4 e8 d2 53 00 00 4d 39 f4 75 e6
NMI Watchdog detected LOCKUP on CPU 1
CPU 1
Modules linked in: ipv6 ppdev lp parport_serial dm_snapshot dm_mirror dm_mod sbp2 loop ide_cd cdrom eth1394 snd_hda_intel snd_hda_codec snd_pcm_oss snd_mixer_oss snd_pcm amd74xx snd_timer snd serio_raw soundcore i2c_nforce2 ohci_hcd psmouse pcspkr ohci1394 ieee1394 i2c_core parport_pc parport ehci_hcd snd_page_alloc forcedeth floppy ext3 jbd mbcache sd_mod generic ide_core ata_generic sata_nv libata scsi_mod evdev
Pid: 11815, comm: sh Not tainted 2.6.20-rc6 #1
RIP: 0010:[<ffffffff802078b8>] [<ffffffff802078b8>] _raw_spin_lock+0x7b/0xf9
RSP: 0000:ffff810024e4fcb8 EFLAGS: 00000083
RAX: 000000000000000a RBX: ffff81000000b700 RCX: 00000000f7837878
RDX: 000000000000033d RSI: ffff810024e4fcd8 RDI: 0000000000000001
RBP: ffff810024e4fcd8 R08: 0000000000000002 R09: 0000000000000001
R10: 0000000000000000 R11: 0000000000000001 R12: 000000000b7745fb
R13: 0000000000000001 R14: 0000000077c3cc34 R15: ffff81000fc4cc80
FS: 00002b7057d366d0(0000) GS:ffff8100011af138(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00002b7057899398 CR3: 0000000023ebe000 CR4: 00000000000006e0
Process sh (pid: 11815, threadinfo ffff810024e4e000, task ffff81002cd0d080)
Stack: ffff81000000b700 ffff81000000b440 ffff810001022480 0000000000000000
ffff810024e4fcf8 ffffffff80262975 ffff81003bdc0ea0 ffff81003ba5ca80
ffff810024e4fd28 ffffffff8020d436 0000000000000012 ffff81003be9b508
Call Trace:
[<ffffffff80262975>] _spin_lock_irq+0x33/0x38
[<ffffffff8020d436>] __pagevec_lru_add_active+0x62/0xdf
[<ffffffff8020ffa0>] lru_cache_add_active+0x4f/0x51
[<ffffffff802106f3>] do_wp_page+0x401/0x4aa
[<ffffffff80208ff9>] __handle_mm_fault+0x96b/0x9e2
[<ffffffff8020aab5>] do_page_fault+0x364/0x817
[<ffffffff8020ab74>] do_page_fault+0x423/0x817
[<ffffffff802629e0>] _spin_unlock_irq+0x2b/0x31
[<ffffffff8025fe30>] thread_return+0x88/0x12d
[<ffffffff80262c8d>] error_exit+0x0/0x96
Code: 31 c0 87 03 85 c0 7f 55 bf 01 00 00 00 49 ff c4 e8 d2 53 00
--- ksymoops ---
kernel BUG at /home/compudj/git/linux-2.6-lttng/lib/list_debug.c:72!
CPU 1
Pid: 11807, comm: ld Not tainted 2.6.20-rc6 #1
RIP: 0010:[<ffffffff803298e4>] [<ffffffff803298e4>] list_del+0x3f/0x5b
RSP: 0018:ffff81001774fc68 EFLAGS: 00010096
RAX: 0000000000000058 RBX: ffff81003b531590 RCX: ffffffff806096b8
RDX: ffff81001c86d100 RSI: 0000000000000001 RDI: 0000000000000096
RBP: ffff81001774fc68 R08: 0000000000000002 R09: 0000000000000080
R10: 0000000000000080 R11: ffff810001020b00 R12: ffff81000000b440
R13: ffff81000101ea28 R14: 0000000000000000 R15: 000000000000000e
FS: 00002acae32b3c80(0000) GS:ffff8100011af138(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00002acae3108150 CR3: 0000000000201000 CR4: 00000000000006e0
Stack: ffff81001774fd28 ffffffff8020b142 0000000000000000 0000000000000000
ffff81003ba5ca80 ffff81003b10e938 ffff81003bd46c40 ffff81003b21e188
ffff81003bbf4790 ffff81003b165128 ffff81003af43958 ffff81003b8c19e0
Call Trace:
[<ffffffff8020b142>] release_pages+0xdb/0x18a
[<ffffffff8020e44d>] free_pages_and_swap_cache+0x7b/0x96
[<ffffffff80207d6d>] unmap_vmas+0x437/0x6ff
[<ffffffff802396ed>] exit_mmap+0x7a/0xf1
[<ffffffff8023b8af>] mmput+0x3d/0x8f
[<ffffffff8023ffe6>] exit_mm+0xe1/0xea
[<ffffffff8021490a>] do_exit+0x230/0x83d
[<ffffffff802621ca>] trace_hardirqs_on_thunk+0x35/0x37
[<ffffffff80247481>] debug_mutex_init+0x0/0x45
[<ffffffff8024accc>] sys_exit_group+0x12/0x14
[<ffffffff8025b11e>] system_call+0x7e/0x83
Code: 0f 0b eb fe 48 89 48 08 48 89 01 48 c7 47 08 00 02 20 00 48
>>RIP; ffffffff803298e4 <list_del+3f/5b> <=====
>>RBX; ffff81003b531590 <phys_startup_64+ffff81003b331490/ffffffff7fffff00>
>>RCX; ffffffff806096b8 <printk_buf.20305+58/400>
>>RDX; ffff81001c86d100 <phys_startup_64+ffff81001c66d000/ffffffff7fffff00>
>>RBP; ffff81001774fc68 <phys_startup_64+ffff81001754fb68/ffffffff7fffff00>
>>R11; ffff810001020b00 <phys_startup_64+ffff810000e20a00/ffffffff7fffff00>
>>R12; ffff81000000b440 <phys_startup_64+ffff80ffffe0b340/ffffffff7fffff00>
>>R13; ffff81000101ea28 <phys_startup_64+ffff810000e1e928/ffffffff7fffff00>
Trace; ffffffff8020b142 <release_pages+db/18a>
Trace; ffffffff8020e44d <free_pages_and_swap_cache+7b/96>
Trace; ffffffff80207d6d <unmap_vmas+437/6ff>
Trace; ffffffff802396ed <exit_mmap+7a/f1>
Trace; ffffffff8023b8af <mmput+3d/8f>
Trace; ffffffff8023ffe6 <exit_mm+e1/ea>
Trace; ffffffff8021490a <do_exit+230/83d>
Trace; ffffffff802621ca <trace_hardirqs_on_thunk+35/37>
Trace; ffffffff80247481 <debug_mutex_init+0/45>
Trace; ffffffff8024accc <sys_exit_group+12/14>
Trace; ffffffff8025b11e <system_call+7e/83>
Code; ffffffff803298e4 <list_del+3f/5b>
0000000000000000 <_RIP>:
Code; ffffffff803298e4 <list_del+3f/5b> <=====
0: 0f 0b ud2a <=====
Code; ffffffff803298e6 <list_del+41/5b>
2: eb fe jmp 2 <_RIP+0x2>
Code; ffffffff803298e8 <list_del+43/5b>
4: 48 89 48 08 mov %rcx,0x8(%rax)
Code; ffffffff803298ec <list_del+47/5b>
8: 48 89 01 mov %rax,(%rcx)
Code; ffffffff803298ef <list_del+4a/5b>
b: 48 c7 47 08 00 02 20 movq $0x200200,0x8(%rdi)
Code; ffffffff803298f6 <list_del+51/5b>
12: 00
Code; ffffffff803298f7 <list_del+52/5b>
13: 48 00 00 rex64 add %al,(%rax)
NMI Watchdog detected LOCKUP on CPU 0
CPU 0
Pid: 11821, comm: sh Not tainted 2.6.20-rc6 #1
RIP: 0010:[<ffffffff802078be>] [<ffffffff802078be>] _raw_spin_lock+0x81/0xf9
RSP: 0000:ffff810002317cb8 EFLAGS: 00000046
RAX: 0000000000000000 RBX: ffff81000000b700 RCX: 00000000f6a35d61
RDX: 000000000000033a RSI: ffff8100178608c0 RDI: 0000000000000001
RBP: ffff810002317cd8 R08: 0000000000000002 R09: 0000000000000001
R10: 0000000000000000 R11: 0000000000000001 R12: 0000000006ab296d
R13: 0000000000000001 R14: 0000000077c3cc34 R15: ffff81001dcc6bb8
FS: 00002b12d23036d0(0000) GS:ffffffff80548000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00000000005be064 CR3: 000000002a9e2000 CR4: 00000000000006e0
Stack: ffff81000000b700 ffff81000000b440 ffff810001019480 0000000000000000
ffff810002317cf8 ffffffff80262975 ffff81003b7347d0 ffff81003b498cf0
ffff810002317d28 ffffffff8020d436 0000000000000012 ffff81003b542cb0
Call Trace:
[<ffffffff80262975>] _spin_lock_irq+0x33/0x38
[<ffffffff8020d436>] __pagevec_lru_add_active+0x62/0xdf
[<ffffffff8020ffa0>] lru_cache_add_active+0x4f/0x51
[<ffffffff802106f3>] do_wp_page+0x401/0x4aa
[<ffffffff80208ff9>] __handle_mm_fault+0x96b/0x9e2
[<ffffffff8020aab5>] do_page_fault+0x364/0x817
[<ffffffff8020ab74>] do_page_fault+0x423/0x817
[<ffffffff802629e0>] _spin_unlock_irq+0x2b/0x31
[<ffffffff802629e0>] _spin_unlock_irq+0x2b/0x31
[<ffffffff80228ebd>] do_sigaction+0x17a/0x190
[<ffffffff802621ca>] trace_hardirqs_on_thunk+0x35/0x37
[<ffffffff80262c8d>] error_exit+0x0/0x96
Code: 7f 55 bf 01 00 00 00 49 ff c4 e8 d2 53 00 00 4d 39 f4 75 e6
>>RIP; ffffffff802078be <_raw_spin_lock+81/f9> <=====
>>RBX; ffff81000000b700 <phys_startup_64+ffff80ffffe0b600/ffffffff7fffff00>
>>RCX; 00000000f6a35d61 <phys_startup_64+f6835c61/ffffffff7fffff00>
>>RSI; ffff8100178608c0 <phys_startup_64+ffff8100176607c0/ffffffff7fffff00>
>>RBP; ffff810002317cd8 <phys_startup_64+ffff810002117bd8/ffffffff7fffff00>
>>R12; 0000000006ab296d <phys_startup_64+68b286d/ffffffff7fffff00>
>>R14; 0000000077c3cc34 <phys_startup_64+77a3cb34/ffffffff7fffff00>
>>R15; ffff81001dcc6bb8 <phys_startup_64+ffff81001dac6ab8/ffffffff7fffff00>
Trace; ffffffff80262975 <_spin_lock_irq+33/38>
Trace; ffffffff8020d436 <__pagevec_lru_add_active+62/df>
Trace; ffffffff8020ffa0 <lru_cache_add_active+4f/51>
Trace; ffffffff802106f3 <do_wp_page+401/4aa>
Trace; ffffffff80208ff9 <__handle_mm_fault+96b/9e2>
Trace; ffffffff8020aab5 <do_page_fault+364/817>
Trace; ffffffff8020ab74 <do_page_fault+423/817>
Trace; ffffffff802629e0 <_spin_unlock_irq+2b/31>
Trace; ffffffff802629e0 <_spin_unlock_irq+2b/31>
Trace; ffffffff80228ebd <do_sigaction+17a/190>
Trace; ffffffff802621ca <trace_hardirqs_on_thunk+35/37>
Trace; ffffffff80262c8d <error_exit+0/96>
Code; ffffffff802078be <_raw_spin_lock+81/f9>
0000000000000000 <_RIP>:
Code; ffffffff802078be <_raw_spin_lock+81/f9> <=====
0: 7f 55 jg 57 <_RIP+0x57> <=====
Code; ffffffff802078c0 <_raw_spin_lock+83/f9>
2: bf 01 00 00 00 mov $0x1,%edi
Code; ffffffff802078c5 <_raw_spin_lock+88/f9>
7: 49 ff c4 inc %r12
Code; ffffffff802078c8 <_raw_spin_lock+8b/f9>
a: e8 d2 53 00 00 callq 53e1 <_RIP+0x53e1>
Code; ffffffff802078cd <_raw_spin_lock+90/f9>
f: 4d 39 f4 cmp %r14,%r12
Code; ffffffff802078d0 <_raw_spin_lock+93/f9>
12: 75 e6 jne fffffffffffffffa <_RIP+0xfffffffffffffffa>
NMI Watchdog detected LOCKUP on CPU 1
CPU 1
Pid: 11815, comm: sh Not tainted 2.6.20-rc6 #1
RIP: 0010:[<ffffffff802078b8>] [<ffffffff802078b8>] _raw_spin_lock+0x7b/0xf9
RSP: 0000:ffff810024e4fcb8 EFLAGS: 00000083
RAX: 000000000000000a RBX: ffff81000000b700 RCX: 00000000f7837878
RDX: 000000000000033d RSI: ffff810024e4fcd8 RDI: 0000000000000001
RBP: ffff810024e4fcd8 R08: 0000000000000002 R09: 0000000000000001
R10: 0000000000000000 R11: 0000000000000001 R12: 000000000b7745fb
R13: 0000000000000001 R14: 0000000077c3cc34 R15: ffff81000fc4cc80
FS: 00002b7057d366d0(0000) GS:ffff8100011af138(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00002b7057899398 CR3: 0000000023ebe000 CR4: 00000000000006e0
Stack: ffff81000000b700 ffff81000000b440 ffff810001022480 0000000000000000
ffff810024e4fcf8 ffffffff80262975 ffff81003bdc0ea0 ffff81003ba5ca80
ffff810024e4fd28 ffffffff8020d436 0000000000000012 ffff81003be9b508
Call Trace:
[<ffffffff80262975>] _spin_lock_irq+0x33/0x38
[<ffffffff8020d436>] __pagevec_lru_add_active+0x62/0xdf
[<ffffffff8020ffa0>] lru_cache_add_active+0x4f/0x51
[<ffffffff802106f3>] do_wp_page+0x401/0x4aa
[<ffffffff80208ff9>] __handle_mm_fault+0x96b/0x9e2
[<ffffffff8020aab5>] do_page_fault+0x364/0x817
[<ffffffff8020ab74>] do_page_fault+0x423/0x817
[<ffffffff802629e0>] _spin_unlock_irq+0x2b/0x31
[<ffffffff8025fe30>] thread_return+0x88/0x12d
[<ffffffff80262c8d>] error_exit+0x0/0x96
Code: 31 c0 87 03 85 c0 7f 55 bf 01 00 00 00 49 ff c4 e8 d2 53 00
>>RIP; ffffffff802078b8 <_raw_spin_lock+7b/f9> <=====
>>RBX; ffff81000000b700 <phys_startup_64+ffff80ffffe0b600/ffffffff7fffff00>
>>RCX; 00000000f7837878 <phys_startup_64+f7637778/ffffffff7fffff00>
>>RSI; ffff810024e4fcd8 <phys_startup_64+ffff810024c4fbd8/ffffffff7fffff00>
>>RBP; ffff810024e4fcd8 <phys_startup_64+ffff810024c4fbd8/ffffffff7fffff00>
>>R12; 000000000b7745fb <phys_startup_64+b5744fb/ffffffff7fffff00>
>>R14; 0000000077c3cc34 <phys_startup_64+77a3cb34/ffffffff7fffff00>
>>R15; ffff81000fc4cc80 <phys_startup_64+ffff81000fa4cb80/ffffffff7fffff00>
Trace; ffffffff80262975 <_spin_lock_irq+33/38>
Trace; ffffffff8020d436 <__pagevec_lru_add_active+62/df>
Trace; ffffffff8020ffa0 <lru_cache_add_active+4f/51>
Trace; ffffffff802106f3 <do_wp_page+401/4aa>
Trace; ffffffff80208ff9 <__handle_mm_fault+96b/9e2>
Trace; ffffffff8020aab5 <do_page_fault+364/817>
Trace; ffffffff8020ab74 <do_page_fault+423/817>
Trace; ffffffff802629e0 <_spin_unlock_irq+2b/31>
Trace; ffffffff8025fe30 <thread_return+88/12d>
Trace; ffffffff80262c8d <error_exit+0/96>
Code; ffffffff802078b8 <_raw_spin_lock+7b/f9>
0000000000000000 <_RIP>:
Code; ffffffff802078b8 <_raw_spin_lock+7b/f9> <=====
0: 31 c0 xor %eax,%eax <=====
Code; ffffffff802078ba <_raw_spin_lock+7d/f9>
2: 87 03 xchg %eax,(%rbx)
Code; ffffffff802078bc <_raw_spin_lock+7f/f9>
4: 85 c0 test %eax,%eax
Code; ffffffff802078be <_raw_spin_lock+81/f9>
6: 7f 55 jg 5d <_RIP+0x5d>
Code; ffffffff802078c0 <_raw_spin_lock+83/f9>
8: bf 01 00 00 00 mov $0x1,%edi
Code; ffffffff802078c5 <_raw_spin_lock+88/f9>
d: 49 ff c4 inc %r12
Code; ffffffff802078c8 <_raw_spin_lock+8b/f9>
10: e8 d2 53 00 00 callq 53e7 <_RIP+0x53e7>
Call Trace:
[<ffffffff80262975>] _spin_lock_irq+0x33/0x38
[<ffffffff8020d436>] __pagevec_lru_add_active+0x62/0xdf
[<ffffffff80215c6f>] __lru_add_drain+0x49/0x4d
[<ffffffff8022e562>] lru_add_drain+0x11/0x13
[<ffffffff8023969a>] exit_mmap+0x27/0xf1
[<ffffffff8023b8af>] mmput+0x3d/0x8f
[<ffffffff8023ffe6>] exit_mm+0xe1/0xea
[<ffffffff8021490a>] do_exit+0x230/0x83d
[<ffffffff80267306>] sync_regs+0x0/0x71
[<ffffffff80272c5b>] nmi_watchdog_tick+0x151/0x23b
[<ffffffff80267e1d>] default_do_nmi+0x83/0x1c8
[<ffffffff80272d89>] do_nmi+0x44/0x6f
[<ffffffff80262f7f>] nmi+0x7f/0x80
[<ffffffff802078be>] _raw_spin_lock+0x81/0xf9
[<ffffffff8020d436>] __pagevec_lru_add_active+0x62/0xdf
[<ffffffff8020ffa0>] lru_cache_add_active+0x4f/0x51
[<ffffffff802106f3>] do_wp_page+0x401/0x4aa
[<ffffffff80208ff9>] __handle_mm_fault+0x96b/0x9e2
[<ffffffff8020aab5>] do_page_fault+0x364/0x817
[<ffffffff8020ab74>] do_page_fault+0x423/0x817
[<ffffffff802629e0>] _spin_unlock_irq+0x2b/0x31
[<ffffffff802629e0>] _spin_unlock_irq+0x2b/0x31
[<ffffffff80228ebd>] do_sigaction+0x17a/0x190
[<ffffffff802621ca>] trace_hardirqs_on_thunk+0x35/0x37
[<ffffffff80262c8d>] error_exit+0x0/0x96
Call Trace:
[<ffffffff80262975>] _spin_lock_irq+0x33/0x38
[<ffffffff8020d436>] __pagevec_lru_add_active+0x62/0xdf
[<ffffffff80215c6f>] __lru_add_drain+0x49/0x4d
[<ffffffff8022e562>] lru_add_drain+0x11/0x13
[<ffffffff8023969a>] exit_mmap+0x27/0xf1
[<ffffffff8023b8af>] mmput+0x3d/0x8f
[<ffffffff8023ffe6>] exit_mm+0xe1/0xea
[<ffffffff8021490a>] do_exit+0x230/0x83d
[<ffffffff80267306>] sync_regs+0x0/0x71
[<ffffffff80272c5b>] nmi_watchdog_tick+0x151/0x23b
[<ffffffff80267e1d>] default_do_nmi+0x83/0x1c8
[<ffffffff80272d89>] do_nmi+0x44/0x6f
[<ffffffff80262f7f>] nmi+0x7f/0x80
[<ffffffff802078b8>] _raw_spin_lock+0x7b/0xf9
[<ffffffff8020d436>] __pagevec_lru_add_active+0x62/0xdf
[<ffffffff8020ffa0>] lru_cache_add_active+0x4f/0x51
[<ffffffff802106f3>] do_wp_page+0x401/0x4aa
[<ffffffff80208ff9>] __handle_mm_fault+0x96b/0x9e2
[<ffffffff8020aab5>] do_page_fault+0x364/0x817
[<ffffffff8020ab74>] do_page_fault+0x423/0x817
[<ffffffff802629e0>] _spin_unlock_irq+0x2b/0x31
[<ffffffff8025fe30>] thread_return+0x88/0x12d
[<ffffffff80262c8d>] error_exit+0x0/0x96
Warning (Oops_read): Code line not seen, dumping what data is available
Trace; ffffffff80262975 <_spin_lock_irq+33/38>
Trace; ffffffff8020d436 <__pagevec_lru_add_active+62/df>
Trace; ffffffff80215c6f <__lru_add_drain+49/4d>
Trace; ffffffff8022e562 <lru_add_drain+11/13>
Trace; ffffffff8023969a <exit_mmap+27/f1>
Trace; ffffffff8023b8af <mmput+3d/8f>
Trace; ffffffff8023ffe6 <exit_mm+e1/ea>
Trace; ffffffff8021490a <do_exit+230/83d>
Trace; ffffffff80267306 <sync_regs+0/71>
Trace; ffffffff80272c5b <nmi_watchdog_tick+151/23b>
Trace; ffffffff80267e1d <default_do_nmi+83/1c8>
Trace; ffffffff80272d89 <do_nmi+44/6f>
Trace; ffffffff80262f7f <nmi+7f/80>
Trace; ffffffff802078be <_raw_spin_lock+81/f9>
Trace; ffffffff8020d436 <__pagevec_lru_add_active+62/df>
Trace; ffffffff8020ffa0 <lru_cache_add_active+4f/51>
Trace; ffffffff802106f3 <do_wp_page+401/4aa>
Trace; ffffffff80208ff9 <__handle_mm_fault+96b/9e2>
Trace; ffffffff8020aab5 <do_page_fault+364/817>
Trace; ffffffff8020ab74 <do_page_fault+423/817>
Trace; ffffffff802629e0 <_spin_unlock_irq+2b/31>
Trace; ffffffff802629e0 <_spin_unlock_irq+2b/31>
Trace; ffffffff80228ebd <do_sigaction+17a/190>
Trace; ffffffff802621ca <trace_hardirqs_on_thunk+35/37>
Trace; ffffffff80262c8d <error_exit+0/96>
Trace; ffffffff80262975 <_spin_lock_irq+33/38>
Trace; ffffffff8020d436 <__pagevec_lru_add_active+62/df>
Trace; ffffffff80215c6f <__lru_add_drain+49/4d>
Trace; ffffffff8022e562 <lru_add_drain+11/13>
Trace; ffffffff8023969a <exit_mmap+27/f1>
Trace; ffffffff8023b8af <mmput+3d/8f>
Trace; ffffffff8023ffe6 <exit_mm+e1/ea>
Trace; ffffffff8021490a <do_exit+230/83d>
Trace; ffffffff80267306 <sync_regs+0/71>
Trace; ffffffff80272c5b <nmi_watchdog_tick+151/23b>
Trace; ffffffff80267e1d <default_do_nmi+83/1c8>
Trace; ffffffff80272d89 <do_nmi+44/6f>
Trace; ffffffff80262f7f <nmi+7f/80>
Trace; ffffffff802078b8 <_raw_spin_lock+7b/f9>
Trace; ffffffff8020d436 <__pagevec_lru_add_active+62/df>
Trace; ffffffff8020ffa0 <lru_cache_add_active+4f/51>
Trace; ffffffff802106f3 <do_wp_page+401/4aa>
Trace; ffffffff80208ff9 <__handle_mm_fault+96b/9e2>
Trace; ffffffff8020aab5 <do_page_fault+364/817>
Trace; ffffffff8020ab74 <do_page_fault+423/817>
Trace; ffffffff802629e0 <_spin_unlock_irq+2b/31>
Trace; ffffffff8025fe30 <thread_return+88/12d>
Trace; ffffffff80262c8d <error_exit+0/96>
0000:04:08.0: ttyS0 at I/O 0xc880 (irq = 19) is a 16550A
ehci_hcd 0000:00:0b.1: debug port 1
9765511 blocks
lo: Disabled Privacy Extensions
3 warnings and 1 error issued. Results may not be reliable.
--
OpenPGP public key: http://krystal.dyndns.org:8080/key/compudj.gpg
Key fingerprint: 8CD5 52C3 8E3C 4140 715F BA06 3F25 A8FE 3BAE 9A68
^ permalink raw reply [flat|nested] 4+ messages in thread