From mboxrd@z Thu Jan 1 00:00:00 1970 From: Ingo Molnar Subject: Re: [bug, netconsole, SLUB] BUG skbuff_head_cache: Poison overwritten Date: Mon, 21 Jul 2008 11:41:10 +0200 Message-ID: <20080721094110.GA16029@elte.hu> References: <20080717214222.GA29449@elte.hu> <20080718091146.GQ6875@elte.hu> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: QUOTED-PRINTABLE Cc: linux-kernel@vger.kernel.org, netdev@vger.kernel.org, Vegard Nossum , "Rafael J. Wysocki" , cl@linux-foundation.org, davem@davemloft.net, johnpol@2ka.mipt.ru To: Pekka J Enberg Return-path: Received: from mx2.mail.elte.hu ([157.181.151.9]:59565 "EHLO mx2.mail.elte.hu" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1755246AbYGUJli (ORCPT ); Mon, 21 Jul 2008 05:41:38 -0400 Content-Disposition: inline In-Reply-To: <20080718091146.GQ6875@elte.hu> Sender: netdev-owner@vger.kernel.org List-ID: update about this problem: just triggered another colorful crash, see=20 below. This was with the 4K object dump patch already, maybe the dump=20 gives a clue? The upstream base of this test kernel was v2.6.26-5253-g14b395e - i.e.=20 post the big networking pull, but this problem predates it. (It first=20 triggered after v2.6.26) All the crashes trigger in or close to networking code - not a single=20 block IO DMA or other DMA crash happened so far, and no filesystem=20 corruptions or anything like that which would signal hw trouble. Ingo ------------------> initcall sctp_init+0x0/0x697 returned 0 after 9 msecs calling powernowk8_init+0x0/0x6e initcall powernowk8_init+0x0/0x6e returned -19 after 0 msecs calling hpet_insert_resource+0x0/0x1e initcall hpet_insert_resource+0x0/0x1e returned 0 after 0 msecs calling lapic_insert_resource+0x0/0x44 initcall lapic_insert_resource+0x0/0x44 returned 0 after 0 msecs calling init_lapic_nmi_sysfs+0x0/0x33 initcall init_lapic_nmi_sysfs+0x0/0x33 returned 0 after 0 msecs =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D BUG skbuff_head_cache: Poison overwritten -----------------------------------------------------------------------= ------ INFO: 0xf7ccc100-0xf7ccc103. First byte 0x0 instead of 0x6b INFO: Allocated in __alloc_skb+0x30/0x10e age=3D1 cpu=3D1 pid=3D1 INFO: Freed in __kfree_skb+0x63/0x66 age=3D1 cpu=3D0 pid=3D0 INFO: Slab 0xc1c34ca0 objects=3D16 used=3D1 fp=3D0xf7ccc100 flags=3D0x4= 00000c3 INFO: Object 0xf7ccc100 @offset=3D256 fp=3D0xf7ccc200 Bytes b4 0xf7ccc0f0: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a Z= ZZZZZZZZZZZZZZZ Object 0xf7ccc100: 00 00 00 00 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b .= =2E..kkkkkkkkkkkk Object 0xf7ccc110: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b k= kkkkkkkkkkkkkkk Object 0xf7ccc120: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b k= kkkkkkkkkkkkkkk Object 0xf7ccc130: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b k= kkkkkkkkkkkkkkk Object 0xf7ccc140: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b k= kkkkkkkkkkkkkkk Object 0xf7ccc150: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b k= kkkkkkkkkkkkkkk Object 0xf7ccc160: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b k= kkkkkkkkkkkkkkk Object 0xf7ccc170: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b k= kkkkkkkkkkkkkkk Object 0xf7ccc180: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b k= kkkkkkkkkkkkkkk Object 0xf7ccc190: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b k= kkkkkkkkkkkkkkk Object 0xf7ccc1a0: 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b 6b a5 k= kkkkkkkkkkkkkk=EF=BF=BD Redzone 0xf7ccc1b0: bb bb bb bb =EF= =BF=BD=EF=BF=BD=EF=BF=BD=EF=BF=BD =20 Padding 0xf7ccc1d8: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a Z= ZZZZZZZZZZZZZZZ Padding 0xf7ccc1e8: 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a 5a Z= ZZZZZZZZZZZZZZZ Padding 0xf7ccc1f8: 5a 5a 5a 5a 5a 5a 5a 5a Z= ZZZZZZZ =20 Pid: 1, comm: swapper Not tainted 2.6.26-tip #3261 [] print_trailer+0xd1/0xd9 [] check_bytes_and_report+0x73/0x8f [] check_object+0xa5/0x15a [] __slab_alloc+0x2fb/0x3c8 [] kmem_cache_alloc+0x4b/0xa8 [] ? __alloc_skb+0x30/0x10e [] ? __alloc_skb+0x30/0x10e [] __alloc_skb+0x30/0x10e [] alloc_skb+0xc/0xe [] find_skb+0x28/0x66 [] netpoll_send_udp+0x2b/0x1cf [] ? _spin_lock_irqsave+0x4b/0x55 [] write_msg+0x79/0xac [] ? write_msg+0x0/0xac [] __call_console_drivers+0x56/0x63 [] _call_console_drivers+0x57/0x5b [] release_console_sem+0x112/0x1a5 [] vprintk+0x344/0x35e