* Re: RFC: Reproducible oops with lockdep on count_matching_names() [not found] ` <1194001120.27652.353.camel@twins> @ 2007-11-03 19:58 ` Luis R. Rodriguez [not found] ` <43e72e890711031258g4ccd9cd0hc4520e9473f6ce49-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org> 0 siblings, 1 reply; 8+ messages in thread From: Luis R. Rodriguez @ 2007-11-03 19:58 UTC (permalink / raw) To: Peter Zijlstra Cc: Michael Wu, linux-wireless, John W. Linville, Ingo Molnar, Johannes Berg, linux-kernel, Michael Chan, netdev, Michael Buesch On 11/2/07, Peter Zijlstra <peterz@infradead.org> wrote: > On Thu, 2007-11-01 at 19:26 -0400, Michael Wu wrote: > > On Thursday 01 November 2007 15:17:16 Luis R. Rodriguez wrote: > > > mcgrof@pogo:~/devel/wireless-2.6$ git-describe > > > v2.6.24-rc1-146-g2280253 > > > > > > So I hit segfault with lockdep on count_matching_names() on the > > > strcmp() multiple times now. This is reproducible and with different > > > wireless drivers. > > > > > I've found the problem. It appears to be in lockdep. struct lock_class has a > > const char *name field which points to a statically allocated string that > > comes from the code which uses the lock. If that code/string is in a module > > and gets unloaded, the pointer in |name| is no longer valid. Next time this > > field is dereferenced (count_matching_names, in this case), we crash. > > > > The following patch fixes the issue but there's probably a better way. > > Thanks, and indeed. From my understanding lockdep_free_key_range() > should destroy all classes of a module on module unload. > > So I'm not quite sure what has gone wrong here.. I've tried digging more and just am still not sure what caused this. At first I thought perhaps all_lock_classes list had some element not yet removed as lockdep_free_key_range() iterates over the hash tables but this doesn't seem to be the case. I was using SLAB and ran into other strange oops, as the one below, but after switching to SLUB, after Michael Buesch's suggestion that one went away... The lockdep segfault is still present, however. Just not sure what's going on. Any ideas? ----- oops with slab, not reproducible with slub: mcgrof@pogo:~$ sudo rmmod tg3 mcgrof@pogo:~$ sudo rmmod sr_mod *** dmesg -c ACPI: PCI interrupt for device 0000:02:00.0 disabled BUG: unable to handle kernel paging request at virtual address f88a4a05 printing eip: f88a4a05 *pde = 02000067 *pte = 00000000 Oops: 0000 [#1] Modules linked in: sr_mod uinput thinkpad_acpi hwmon backlight nvram ipv6 acpi_cpufreq cpufreq_userspace cpufreq_powersave cpufreq_ondemand cpufreq_conservative dock arc4 ecb blkcipher cryptomgr crypto_algapi rc80211_simple ath5k mac80211 cfg80211 pcmcia crc32 snd_hda_intel snd_pcm_oss snd_mixer_oss snd_pcm snd_page_alloc snd_hwdep snd_seq_oss ipw2200 snd_seq_midi_event ieee80211 ieee80211_crypt sg ehci_hcd uhci_hcd yenta_socket rsrc_nonstatic snd_seq snd_timer snd_seq_device firmware_class cdrom pcmcia_core usbcore evdev rng_core rtc snd soundcore Pid: 2908, comm: modprobe Not tainted (2.6.24-rc1 #18) EIP: 0060:[<f88a4a05>] EFLAGS: 00010086 CPU: 0 EIP is at 0xf88a4a05 EAX: c20b75c8 EBX: c2f86f38 ECX: f88a4a05 EDX: c2f86f38 ESI: c20b75c8 EDI: c2f89c00 EBP: c3897bfc ESP: c3897be0 DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 0068 Process modprobe (pid: 2908, ti=c3896000 task=c3935150 task.ti=c3896000) Stack: c01b2afc c2f82d98 c3897bf4 c01ba8b6 c2f86f38 c20b75c8 c2f82c00 c3897c24 c02186dd c2f86f38 c3897c24 c01b54c0 c20b75c8 00000001 c20b75c8 c2f86f38 c20b75c8 c3897c30 c01b54ed 00000001 c3897c54 c01b556c 00000001 c3897cd4 Call Trace: [<c0104cec>] show_trace_log_lvl+0x1a/0x2f [<c0104d9e>] show_stack_log_lvl+0x9d/0xa5 [<c0104e53>] show_registers+0xad/0x17c [<c0105017>] die+0xf5/0x1c6 [<c0112715>] do_page_fault+0x450/0x537 [<c02a835a>] error_code+0x6a/0x70 [<c02186dd>] scsi_request_fn+0x5f/0x2ec [<c01b54ed>] __generic_unplug_device+0x20/0x23 [<c01b556c>] blk_execute_rq_nowait+0x7c/0x8f [<c01b69e5>] blk_execute_rq+0xb1/0xcf [<c0217f53>] scsi_execute+0xc4/0xd7 [<c0218014>] scsi_execute_req+0xae/0xcb [<f885f571>] sr_probe+0x1d5/0x557 [sr_mod] [<c020fd33>] driver_probe_device+0xe8/0x168 [<c020fec9>] __driver_attach+0x6a/0xa1 [<c020f271>] bus_for_each_dev+0x36/0x5b [<c020fb7f>] driver_attach+0x19/0x1b [<c020f556>] bus_add_driver+0x73/0x1aa [<c02100a5>] driver_register+0x67/0x6c [<c021b4f8>] scsi_register_driver+0xf/0x11 [<f8863023>] init_sr+0x23/0x3d [sr_mod] [<c013a461>] sys_init_module+0x1142/0x1262 [<c0103d7e>] sysenter_past_esp+0x5f/0xa5 ======================= Code: Bad EIP value. EIP: [<f88a4a05>] 0xf88a4a05 SS:ESP 0068:c3897be0 Luis ^ permalink raw reply [flat|nested] 8+ messages in thread
[parent not found: <43e72e890711031258g4ccd9cd0hc4520e9473f6ce49-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>]
* Re: RFC: Reproducible oops with lockdep on count_matching_names() [not found] ` <43e72e890711031258g4ccd9cd0hc4520e9473f6ce49-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org> @ 2007-11-03 20:06 ` Michael Buesch [not found] ` <200711032106.56569.mb-fseUSCV1ubazQB+pC5nmwQ@public.gmane.org> 0 siblings, 1 reply; 8+ messages in thread From: Michael Buesch @ 2007-11-03 20:06 UTC (permalink / raw) To: Luis R. Rodriguez Cc: Peter Zijlstra, Michael Wu, linux-wireless, John W. Linville, Ingo Molnar, Johannes Berg, linux-kernel-u79uwXL29TY76Z2rM5mHXA, Michael Chan, netdev-u79uwXL29TY76Z2rM5mHXA On Saturday 03 November 2007 20:58:09 Luis R. Rodriguez wrote: > I was using SLAB and ran into other strange oops, as the one below, > but after switching to SLUB, after Michael Buesch's suggestion that > one went away... The lockdep segfault is still present, however. Who is responsible for slab btw? I mean, someone should be interested in getting this bug fixed. :) When using slab I see random corruptions. I think related to rmmod, but I'm not sure. I don't see this with slub. -- Greetings Michael. ^ permalink raw reply [flat|nested] 8+ messages in thread
[parent not found: <200711032106.56569.mb-fseUSCV1ubazQB+pC5nmwQ@public.gmane.org>]
* Re: RFC: Reproducible oops with lockdep on count_matching_names() [not found] ` <200711032106.56569.mb-fseUSCV1ubazQB+pC5nmwQ@public.gmane.org> @ 2007-11-05 12:00 ` Peter Zijlstra 2007-11-05 12:23 ` Pekka Enberg 0 siblings, 1 reply; 8+ messages in thread From: Peter Zijlstra @ 2007-11-05 12:00 UTC (permalink / raw) To: Michael Buesch Cc: Luis R. Rodriguez, Michael Wu, linux-wireless, John W. Linville, Ingo Molnar, Johannes Berg, linux-kernel-u79uwXL29TY76Z2rM5mHXA, Michael Chan, netdev-u79uwXL29TY76Z2rM5mHXA, Pekka Enberg, Christoph Lameter On Sat, 2007-11-03 at 21:06 +0100, Michael Buesch wrote: > On Saturday 03 November 2007 20:58:09 Luis R. Rodriguez wrote: > > I was using SLAB and ran into other strange oops, as the one below, > > but after switching to SLUB, after Michael Buesch's suggestion that > > one went away... The lockdep segfault is still present, however. > > Who is responsible for slab btw? > I mean, someone should be interested in getting this bug fixed. :) > When using slab I see random corruptions. I think related to rmmod, but > I'm not sure. I don't see this with slub. Pekka and Christoph do most SLAB work. the snipped oops: > ----- oops with slab, not reproducible with slub: > > mcgrof@pogo:~$ sudo rmmod tg3 > mcgrof@pogo:~$ sudo rmmod sr_mod > > *** dmesg -c > > ACPI: PCI interrupt for device 0000:02:00.0 disabled > BUG: unable to handle kernel paging request at virtual address f88a4a05 > printing eip: f88a4a05 *pde = 02000067 *pte = 00000000 > Oops: 0000 [#1] > Modules linked in: sr_mod uinput thinkpad_acpi hwmon backlight nvram > ipv6 acpi_cpufreq cpufreq_userspace cpufreq_powersave cpufreq_ondemand > cpufreq_conservative dock arc4 ecb blkcipher cryptomgr crypto_algapi > rc80211_simple ath5k mac80211 cfg80211 pcmcia crc32 snd_hda_intel > snd_pcm_oss snd_mixer_oss snd_pcm snd_page_alloc snd_hwdep snd_seq_oss > ipw2200 snd_seq_midi_event ieee80211 ieee80211_crypt sg ehci_hcd > uhci_hcd yenta_socket rsrc_nonstatic snd_seq snd_timer snd_seq_device > firmware_class cdrom pcmcia_core usbcore evdev rng_core rtc snd > soundcore > > Pid: 2908, comm: modprobe Not tainted (2.6.24-rc1 #18) > EIP: 0060:[<f88a4a05>] EFLAGS: 00010086 CPU: 0 > EIP is at 0xf88a4a05 > EAX: c20b75c8 EBX: c2f86f38 ECX: f88a4a05 EDX: c2f86f38 > ESI: c20b75c8 EDI: c2f89c00 EBP: c3897bfc ESP: c3897be0 > DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 0068 > Process modprobe (pid: 2908, ti=c3896000 task=c3935150 task.ti=c3896000) > Stack: c01b2afc c2f82d98 c3897bf4 c01ba8b6 c2f86f38 c20b75c8 c2f82c00 c3897c24 > c02186dd c2f86f38 c3897c24 c01b54c0 c20b75c8 00000001 c20b75c8 c2f86f38 > c20b75c8 c3897c30 c01b54ed 00000001 c3897c54 c01b556c 00000001 c3897cd4 > Call Trace: > [<c0104cec>] show_trace_log_lvl+0x1a/0x2f > [<c0104d9e>] show_stack_log_lvl+0x9d/0xa5 > [<c0104e53>] show_registers+0xad/0x17c > [<c0105017>] die+0xf5/0x1c6 > [<c0112715>] do_page_fault+0x450/0x537 > [<c02a835a>] error_code+0x6a/0x70 > [<c02186dd>] scsi_request_fn+0x5f/0x2ec > [<c01b54ed>] __generic_unplug_device+0x20/0x23 > [<c01b556c>] blk_execute_rq_nowait+0x7c/0x8f > [<c01b69e5>] blk_execute_rq+0xb1/0xcf > [<c0217f53>] scsi_execute+0xc4/0xd7 > [<c0218014>] scsi_execute_req+0xae/0xcb > [<f885f571>] sr_probe+0x1d5/0x557 [sr_mod] > [<c020fd33>] driver_probe_device+0xe8/0x168 > [<c020fec9>] __driver_attach+0x6a/0xa1 > [<c020f271>] bus_for_each_dev+0x36/0x5b > [<c020fb7f>] driver_attach+0x19/0x1b > [<c020f556>] bus_add_driver+0x73/0x1aa > [<c02100a5>] driver_register+0x67/0x6c > [<c021b4f8>] scsi_register_driver+0xf/0x11 > [<f8863023>] init_sr+0x23/0x3d [sr_mod] > [<c013a461>] sys_init_module+0x1142/0x1262 > [<c0103d7e>] sysenter_past_esp+0x5f/0xa5 > ======================= > Code: Bad EIP value. > EIP: [<f88a4a05>] 0xf88a4a05 SS:ESP 0068:c3897be0 > ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: RFC: Reproducible oops with lockdep on count_matching_names() 2007-11-05 12:00 ` Peter Zijlstra @ 2007-11-05 12:23 ` Pekka Enberg [not found] ` <84144f020711050423r7a1f0e55g36c8c5ad29bfc700-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org> 0 siblings, 1 reply; 8+ messages in thread From: Pekka Enberg @ 2007-11-05 12:23 UTC (permalink / raw) To: Peter Zijlstra Cc: Michael Buesch, Luis R. Rodriguez, Michael Wu, linux-wireless, John W. Linville, Ingo Molnar, Johannes Berg, linux-kernel-u79uwXL29TY76Z2rM5mHXA, Michael Chan, netdev-u79uwXL29TY76Z2rM5mHXA, Christoph Lameter Hi Michael, On Sat, 2007-11-03 at 21:06 +0100, Michael Buesch wrote: > Who is responsible for slab btw? > I mean, someone should be interested in getting this bug fixed. :) > When using slab I see random corruptions. I think related to rmmod, but > I'm not sure. I don't see this with slub. Is CONFIG_DEBUG_SLAB enabled? Usually these kind of random corruptions are caused by someone passing a bad pointer to kfree() or kmem_cache_free(). Pekka ^ permalink raw reply [flat|nested] 8+ messages in thread
[parent not found: <84144f020711050423r7a1f0e55g36c8c5ad29bfc700-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>]
* Re: RFC: Reproducible oops with lockdep on count_matching_names() [not found] ` <84144f020711050423r7a1f0e55g36c8c5ad29bfc700-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org> @ 2007-11-05 13:03 ` Michael Buesch [not found] ` <200711051403.39479.mb-fseUSCV1ubazQB+pC5nmwQ@public.gmane.org> 0 siblings, 1 reply; 8+ messages in thread From: Michael Buesch @ 2007-11-05 13:03 UTC (permalink / raw) To: Pekka Enberg Cc: Peter Zijlstra, Luis R. Rodriguez, Michael Wu, linux-wireless, John W. Linville, Ingo Molnar, Johannes Berg, linux-kernel-u79uwXL29TY76Z2rM5mHXA, Michael Chan, netdev-u79uwXL29TY76Z2rM5mHXA, Christoph Lameter On Monday 05 November 2007 13:23:50 Pekka Enberg wrote: > Hi Michael, > > On Sat, 2007-11-03 at 21:06 +0100, Michael Buesch wrote: > > Who is responsible for slab btw? > > I mean, someone should be interested in getting this bug fixed. :) > > When using slab I see random corruptions. I think related to rmmod, but > > I'm not sure. I don't see this with slub. > > Is CONFIG_DEBUG_SLAB enabled? Usually these kind of random corruptions > are caused by someone passing a bad pointer to kfree() or > kmem_cache_free(). Yeah. What I also saw was random "one-bit-errors" once and then on rmmod of modules. I have absolutely no idea how they were caused, though (I read the freeing codes of the stuff hundreds of times). I don't have any of the oops messages anymore. But I do _not_ see this behaviour with slub anymore. -- Greetings Michael. ^ permalink raw reply [flat|nested] 8+ messages in thread
[parent not found: <200711051403.39479.mb-fseUSCV1ubazQB+pC5nmwQ@public.gmane.org>]
* Re: RFC: Reproducible oops with lockdep on count_matching_names() [not found] ` <200711051403.39479.mb-fseUSCV1ubazQB+pC5nmwQ@public.gmane.org> @ 2007-11-05 13:56 ` Pekka Enberg [not found] ` <84144f020711050556m6675ea90g1b6c8054a3940ec0-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org> 0 siblings, 1 reply; 8+ messages in thread From: Pekka Enberg @ 2007-11-05 13:56 UTC (permalink / raw) To: Michael Buesch Cc: Peter Zijlstra, Luis R. Rodriguez, Michael Wu, linux-wireless, John W. Linville, Ingo Molnar, Johannes Berg, linux-kernel-u79uwXL29TY76Z2rM5mHXA, Michael Chan, netdev-u79uwXL29TY76Z2rM5mHXA, Christoph Lameter Hi Michael, On Monday 05 November 2007 13:23:50 Pekka Enberg wrote: > > Is CONFIG_DEBUG_SLAB enabled? Usually these kind of random corruptions > > are caused by someone passing a bad pointer to kfree() or > > kmem_cache_free(). On 11/5/07, Michael Buesch <mb-fseUSCV1ubazQB+pC5nmwQ@public.gmane.org> wrote: > Yeah. > > What I also saw was random "one-bit-errors" once and then on rmmod of modules. > I have absolutely no idea how they were caused, though (I read the freeing > codes of the stuff hundreds of times). I don't have any of the oops messages > anymore. > But I do _not_ see this behaviour with slub anymore. It is possible that the corruption is still there but SLUB doesn't show it. Have you tried with slub_debug enabled? Anyway, looking at the oops: > BUG: unable to handle kernel paging request at virtual address f88a4a05 > printing eip: f88a4a05 *pde = 02000067 *pte = 00000000 > > EIP: 0060:[<f88a4a05>] EFLAGS: 00010086 CPU: 0 > EIP is at 0xf88a4a05 > EAX: c20b75c8 EBX: c2f86f38 ECX: f88a4a05 EDX: c2f86f38 > ESI: c20b75c8 EDI: c2f89c00 EBP: c3897bfc ESP: c3897be0 > DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 0068 > Process modprobe (pid: 2908, ti=c3896000 task=c3935150 task.ti=c3896000) > Stack: c01b2afc c2f82d98 c3897bf4 c01ba8b6 c2f86f38 c20b75c8 c2f82c00 c3897c24 > c02186dd c2f86f38 c3897c24 c01b54c0 c20b75c8 00000001 c20b75c8 c2f86f38 > c20b75c8 c3897c30 c01b54ed 00000001 c3897c54 c01b556c 00000001 c3897cd4 > Call Trace: > [<c0104cec>] show_trace_log_lvl+0x1a/0x2f > [<c0104d9e>] show_stack_log_lvl+0x9d/0xa5 > [<c0104e53>] show_registers+0xad/0x17c > [<c0105017>] die+0xf5/0x1c6 > [<c0112715>] do_page_fault+0x450/0x537 > [<c02a835a>] error_code+0x6a/0x70 > [<c02186dd>] scsi_request_fn+0x5f/0x2ec > [<c01b54ed>] __generic_unplug_device+0x20/0x23 We jump to a bogus address 0xf88a4a05 via a function pointer from scsi_request_fn(). Can you work out the exact file and line for scsi_request_fn+0x5f (look for "gdb vmlinux" in Documentation/BUG-HUNTING) please? Pekka ^ permalink raw reply [flat|nested] 8+ messages in thread
[parent not found: <84144f020711050556m6675ea90g1b6c8054a3940ec0-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>]
* Re: RFC: Reproducible oops with lockdep on count_matching_names() [not found] ` <84144f020711050556m6675ea90g1b6c8054a3940ec0-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org> @ 2007-11-05 14:26 ` Michael Buesch 2007-11-05 18:47 ` Christoph Lameter 0 siblings, 1 reply; 8+ messages in thread From: Michael Buesch @ 2007-11-05 14:26 UTC (permalink / raw) To: Pekka Enberg Cc: Peter Zijlstra, Luis R. Rodriguez, Michael Wu, linux-wireless, John W. Linville, Ingo Molnar, Johannes Berg, linux-kernel-u79uwXL29TY76Z2rM5mHXA, Michael Chan, netdev-u79uwXL29TY76Z2rM5mHXA, Christoph Lameter On Monday 05 November 2007 14:56:22 Pekka Enberg wrote: > Hi Michael, > > On Monday 05 November 2007 13:23:50 Pekka Enberg wrote: > > > Is CONFIG_DEBUG_SLAB enabled? Usually these kind of random corruptions > > > are caused by someone passing a bad pointer to kfree() or > > > kmem_cache_free(). > > On 11/5/07, Michael Buesch <mb-fseUSCV1ubazQB+pC5nmwQ@public.gmane.org> wrote: > > Yeah. > > > > What I also saw was random "one-bit-errors" once and then on rmmod of modules. > > I have absolutely no idea how they were caused, though (I read the freeing > > codes of the stuff hundreds of times). I don't have any of the oops messages > > anymore. > > But I do _not_ see this behaviour with slub anymore. > > It is possible that the corruption is still there but SLUB doesn't > show it. Have you tried with slub_debug enabled? Hm, I don't really remember. Though, I usually have all almost kernel-hacking options enabled. I'll check and enable some more. > > BUG: unable to handle kernel paging request at virtual address f88a4a05 > > printing eip: f88a4a05 *pde = 02000067 *pte = 00000000 > > > > EIP: 0060:[<f88a4a05>] EFLAGS: 00010086 CPU: 0 > > EIP is at 0xf88a4a05 > > EAX: c20b75c8 EBX: c2f86f38 ECX: f88a4a05 EDX: c2f86f38 > > ESI: c20b75c8 EDI: c2f89c00 EBP: c3897bfc ESP: c3897be0 > > DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 0068 > > Process modprobe (pid: 2908, ti=c3896000 task=c3935150 task.ti=c3896000) > > Stack: c01b2afc c2f82d98 c3897bf4 c01ba8b6 c2f86f38 c20b75c8 c2f82c00 c3897c24 > > c02186dd c2f86f38 c3897c24 c01b54c0 c20b75c8 00000001 c20b75c8 c2f86f38 > > c20b75c8 c3897c30 c01b54ed 00000001 c3897c54 c01b556c 00000001 c3897cd4 > > Call Trace: > > [<c0104cec>] show_trace_log_lvl+0x1a/0x2f > > [<c0104d9e>] show_stack_log_lvl+0x9d/0xa5 > > [<c0104e53>] show_registers+0xad/0x17c > > [<c0105017>] die+0xf5/0x1c6 > > [<c0112715>] do_page_fault+0x450/0x537 > > [<c02a835a>] error_code+0x6a/0x70 > > [<c02186dd>] scsi_request_fn+0x5f/0x2ec > > [<c01b54ed>] __generic_unplug_device+0x20/0x23 > > We jump to a bogus address 0xf88a4a05 via a function pointer from > scsi_request_fn(). Can you work out the exact file and line for > scsi_request_fn+0x5f (look for "gdb vmlinux" in > Documentation/BUG-HUNTING) please? That'd be Luis' task then :) -- Greetings Michael. ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: RFC: Reproducible oops with lockdep on count_matching_names() 2007-11-05 14:26 ` Michael Buesch @ 2007-11-05 18:47 ` Christoph Lameter 0 siblings, 0 replies; 8+ messages in thread From: Christoph Lameter @ 2007-11-05 18:47 UTC (permalink / raw) To: Michael Buesch Cc: Pekka Enberg, Peter Zijlstra, Luis R. Rodriguez, Michael Wu, linux-wireless, John W. Linville, Ingo Molnar, Johannes Berg, linux-kernel, Michael Chan, netdev On Mon, 5 Nov 2007, Michael Buesch wrote: > Hm, I don't really remember. Though, I usually have all almost kernel-hacking > options enabled. > I'll check and enable some more. slub_debug must be specified on the command line. Alternately switch on CONFIG_SLUB_DEBUG_ON in the .config to force it to be always on. ^ permalink raw reply [flat|nested] 8+ messages in thread
end of thread, other threads:[~2007-11-05 18:47 UTC | newest]
Thread overview: 8+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
[not found] <20071101191716.GA3201@pogo>
[not found] ` <200711011926.07641.flamingice@sourmilk.net>
[not found] ` <1194001120.27652.353.camel@twins>
2007-11-03 19:58 ` RFC: Reproducible oops with lockdep on count_matching_names() Luis R. Rodriguez
[not found] ` <43e72e890711031258g4ccd9cd0hc4520e9473f6ce49-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2007-11-03 20:06 ` Michael Buesch
[not found] ` <200711032106.56569.mb-fseUSCV1ubazQB+pC5nmwQ@public.gmane.org>
2007-11-05 12:00 ` Peter Zijlstra
2007-11-05 12:23 ` Pekka Enberg
[not found] ` <84144f020711050423r7a1f0e55g36c8c5ad29bfc700-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2007-11-05 13:03 ` Michael Buesch
[not found] ` <200711051403.39479.mb-fseUSCV1ubazQB+pC5nmwQ@public.gmane.org>
2007-11-05 13:56 ` Pekka Enberg
[not found] ` <84144f020711050556m6675ea90g1b6c8054a3940ec0-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2007-11-05 14:26 ` Michael Buesch
2007-11-05 18:47 ` Christoph Lameter
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).