From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S933305Ab0JRUhx (ORCPT ); Mon, 18 Oct 2010 16:37:53 -0400 Received: from mout6.freenet.de ([195.4.92.96]:46176 "EHLO mout6.freenet.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S933203Ab0JRUhw (ORCPT ); Mon, 18 Oct 2010 16:37:52 -0400 Message-ID: <4CBCB014.9080108@freenet.de> Date: Mon, 18 Oct 2010 22:37:40 +0200 From: Patrick Ringl User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.11) Gecko/20100713 Thunderbird/3.0.6 MIME-Version: 1.0 To: Herbert Xu CC: Patrick Ringl , netdev@vger.kernel.org, linux-kernel@vger.kernel.org, bridge@lists.linux-foundation.org Subject: Re: 2.6.36-rc7: net/bridge causes temporary network I/O lockups [2] References: <4CB9EBC3.4070905@freenet.de> <20101018161656.GA2403@gondor.apana.org.au> In-Reply-To: <20101018161656.GA2403@gondor.apana.org.au> Content-Type: multipart/mixed; boundary="------------000701080606070908060701" Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This is a multi-part message in MIME format. --------------000701080606070908060701 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit On 10/18/2010 06:16 PM, Herbert Xu wrote: > On Sat, Oct 16, 2010 at 08:15:31PM +0200, Patrick Ringl wrote: > >> Hi, >> >> okay I narrowed down the issue. I watched all function calls of the >> 'bridge' module with the help of a small systemtap probe of mine. I >> first traced a timespan where the issue did not occur, then one where it >> did and composed an intersection of these two: >> > I can't reproduce this problem here so I'll need your help to > track it down. > > Can you see if you can relate the lock-ups to specific events > such as a particular packet being sent through the bridge? > The problem is definitely somewhere in the 2.6.34 commit regarding IGMP snooping (when disabling it, everything works). I have attached a tcpdump log of data coming through the bridge and data coming through an attached port (eth1). The lockups are easily spotted, since I use mtr to constantly ping the problematic machine, and there aren't any incoming/outgoing packets during the lockup. > If we can recreate the problem on demand that that helps us to > find the root cause. > > You mentioned that you took packet dumps on the system. If you > can show us the packets through the bridge and its ports when > the problem occurs that would be great. > > Thanks, > Anything else I could possibly provide? :-) regards, Patrick --------------000701080606070908060701 Content-Type: application/octet-stream; name="dump_br0" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="dump_br0" 1MOyoQIABAAAAAAAAAAAAP//AAABAAAAHa28TMVGCwBOAAAATgAAANhdTIB5bwAeZREzIAgA RQAAQKv1AAABAYpiwKgBA8CoARIIAMV6DAMmggAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAB2tvEznRgsATgAAAE4AAAAAHmURMyDYXUyAeW8IAEUAAEBeuAAAQAGYn8Co ARLAqAEDAADNegwDJoIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAdrbxM 3EgLAE4AAABOAAAA2F1MgHlvAB5lETMgCABFAABAq/YAAAEBimHAqAEDwKgBEggA+7NRXaru AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHa28TP1ICwBOAAAATgAAAAAe ZREzINhdTIB5bwgARQAAQF65AABAAZiewKgBEsCoAQMAAAO0UV2q7gAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAB6tvExYRAsATgAAAE4AAADYXUyAeW8AHmURMyAIAEUA AECr9wAAAQGKYMCoAQPAqAESCADEegwDJ4IAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAerbxMeUQLAE4AAABOAAAAAB5lETMg2F1MgHlvCABFAABAXroAAEABmJ3AqAES wKgBAwAAzHoMAyeCAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHq28TCtL CwBOAAAATgAAANhdTIB5bwAeZREzIAgARQAAQKv4AAABAYpfwKgBA8CoARIIAPqzUV2r7gAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAB6tvExMSwsATgAAAE4AAAAAHmUR MyDYXUyAeW8IAEUAAEBeuwAAQAGYnMCoARLAqAEDAAACtFFdq+4AAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAfrbxMSBQJAC4AAAAuAAAAAQBeAAAB2F1MgHlvCABGwAAg AABAAAECBBcAAAAA4AAAAZQEAAARZO6bAAAAAB+tvExnFAkAVgAAAFYAAAAzMwAAAADYXUyA eW+G3WAAAAAgAAABAAAAAAAAAAAAAAAAAAAAAP8CAAAAAAAAAAAAAAAAAAE6AAUCAAAAAIIA esED6AAAAAAAAAAAAAAAAAAAAAAAAB+tvExLRQsATgAAAE4AAADYXUyAeW8AHmURMyAIAEUA AECr+QAAAQGKXsCoAQPAqAESCADDegwDKIIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAfrbxMbUULAE4AAABOAAAAAB5lETMg2F1MgHlvCABFAABAXrwAAEABmJvAqAES wKgBAwAAy3oMAyiCAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAH628TO9M CwBOAAAATgAAANhdTIB5bwAeZREzIAgARQAAQKv6AAABAYpdwKgBA8CoARIIAPmzUV2s7gAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAB+tvEwQTQsATgAAAE4AAAAAHmUR MyDYXUyAeW8IAEUAAEBevQAAQAGYmsCoARLAqAEDAAABtFFdrO4AAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAgrbxMC0YLAE4AAABOAAAA2F1MgHlvAB5lETMgCABFAABA q/sAAAEBilzAqAEDwKgBEggAwnoMAymCAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAIK28TCxGCwBOAAAATgAAAAAeZREzINhdTIB5bwgARQAAQF6+AABAAZiZwKgBEsCo AQMAAMp6DAMpggAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACCtvEzATgsA TgAAAE4AAADYXUyAeW8AHmURMyAIAEUAAECr/AAAAQGKW8CoAQPAqAESCAD4s1Fdre4AAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAgrbxM4k4LAE4AAABOAAAAAB5lETMg 2F1MgHlvCABFAABAXr8AAEABmJjAqAESwKgBAwAAALRRXa3uAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAJa28TOtfDAAuAAAALgAAAAEAXgAAAgAbnv6nBAgARsAAIAAA QAABAkJrwKgBAuAAAAKUBAAAFgAJ/eAAAAImrbxMxz0AAC4AAAAuAAAAAQBeAAD7AB5lETMg CABGwAAgAABAAAECQXHAqAED4AAA+5QEAAAWAAkE4AAA+yatvEyJDggALgAAAC4AAAABAF4A ABYAG57+pwQIAEbAACAAAEAAAQJCV8CoAQLgAAAWlAQAABYACengAAAWNa28TJUIDAA8AAAA PAAAAP///////wAeZREzIAgGAAEIAAYEAAEAHmURMyDAqAEDAAAAAAAAwKgBEgAAAAAAAAAA AAAAAAAAy4X/pjWtvEynCAwAKgAAACoAAAAAHmURMyDYXUyAeW8IBgABCAAGBAAC2F1MgHlv wKgBEgAeZREzIMCoAQM1rbxMXA4MAE4AAABOAAAA2F1MgHlvAB5lETMgCABFAABArCUAAAEB ijLAqAEDwKgBEggArXoMAz6CAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA Na28TIEODABOAAAATgAAAAAeZREzINhdTIB5bwgARQAAQF7AAABAAZiXwKgBEsCoAQMAALV6 DAM+ggAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADWtvEy5DgwATgAAAE4A AADYXUyAeW8AHmURMyAIAEUAAECsJgAAAQGKMcCoAQPAqAESCADjs1Fdwu4AAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA1rbxMww4MAE4AAABOAAAAAB5lETMg2F1MgHlv CABFAABAXsEAAEABmJbAqAESwKgBAwAA67NRXcLuAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAANq28TAm/CwBOAAAATgAAANhdTIB5bwAeZREzIAgARQAAQKwnAAABAYow wKgBA8CoARIIAKx6DAM/ggAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADat vEwrvwsATgAAAE4AAAAAHmURMyDYXUyAeW8IAEUAAEBewgAAQAGYlcCoARLAqAEDAAC0egwD P4IAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA2rbxMpdULAE4AAABOAAAA 2F1MgHlvAB5lETMgCABFAABArCgAAAEBii/AqAEDwKgBEggA4rNRXcPuAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAANq28TMjVCwBOAAAATgAAAAAeZREzINhdTIB5bwgA RQAAQF7DAABAAZiUwKgBEsCoAQMAAOqzUV3D7gAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAA== --------------000701080606070908060701 Content-Type: application/octet-stream; name="dump_eth1" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="dump_eth1" 1MOyoQIABAAAAAAAAAAAAP//AAABAAAAHa28TKxGCwBOAAAATgAAANhdTIB5bwAeZREzIAgA RQAAQKv1AAABAYpiwKgBA8CoARIIAMV6DAMmggAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAB2tvEztRgsATgAAAE4AAAAAHmURMyDYXUyAeW8IAEUAAEBeuAAAQAGYn8Co ARLAqAEDAADNegwDJoIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAdrbxM w0gLAE4AAABOAAAA2F1MgHlvAB5lETMgCABFAABAq/YAAAEBimHAqAEDwKgBEggA+7NRXaru AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHa28TANJCwBOAAAATgAAAAAe ZREzINhdTIB5bwgARQAAQF65AABAAZiewKgBEsCoAQMAAAO0UV2q7gAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAB6tvEw+RAsATgAAAE4AAADYXUyAeW8AHmURMyAIAEUA AECr9wAAAQGKYMCoAQPAqAESCADEegwDJ4IAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAerbxMf0QLAE4AAABOAAAAAB5lETMg2F1MgHlvCABFAABAXroAAEABmJ3AqAES wKgBAwAAzHoMAyeCAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHq28TBFL CwBOAAAATgAAANhdTIB5bwAeZREzIAgARQAAQKv4AAABAYpfwKgBA8CoARIIAPqzUV2r7gAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAB6tvExSSwsATgAAAE4AAAAAHmUR MyDYXUyAeW8IAEUAAEBeuwAAQAGYnMCoARLAqAEDAAACtFFdq+4AAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAfrbxMMkULAE4AAABOAAAA2F1MgHlvAB5lETMgCABFAABA q/kAAAEBil7AqAEDwKgBEggAw3oMAyiCAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAH628THNFCwBOAAAATgAAAAAeZREzINhdTIB5bwgARQAAQF68AABAAZibwKgBEsCo AQMAAMt6DAMoggAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAB+tvEzVTAsA TgAAAE4AAADYXUyAeW8AHmURMyAIAEUAAECr+gAAAQGKXcCoAQPAqAESCAD5s1FdrO4AAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAfrbxMFk0LAE4AAABOAAAAAB5lETMg 2F1MgHlvCABFAABAXr0AAEABmJrAqAESwKgBAwAAAbRRXazuAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAIK28TPFFCwBOAAAATgAAANhdTIB5bwAeZREzIAgARQAAQKv7 AAABAYpcwKgBA8CoARIIAMJ6DAMpggAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAACCtvEwyRgsATgAAAE4AAAAAHmURMyDYXUyAeW8IAEUAAEBevgAAQAGYmcCoARLAqAED AADKegwDKYIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAgrbxMp04LAE4A AABOAAAA2F1MgHlvAB5lETMgCABFAABAq/wAAAEBilvAqAEDwKgBEggA+LNRXa3uAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAIK28TOhOCwBOAAAATgAAAAAeZREzINhd TIB5bwgARQAAQF6/AABAAZiYwKgBEsCoAQMAAAC0UV2t7gAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAACCtvEwbWg0ALgAAAC4AAAABAF4AAAHYXUyAeW8IAEbAACAAAEAA AQIEFwAAAADgAAABlAQAABFk7psAAAAAIK28TCpaDQBWAAAAVgAAADMzAAAAANhdTIB5b4bd YAAAACAAAAEAAAAAAAAAAAAAAAAAAAAA/wIAAAAAAAAAAAAAAAAAAToABQIAAAAAggB6wQPo AAAAAAAAAAAAAAAAAAAAAAAAJa28TMlfDAA8AAAAPAAAAAEAXgAAAgAbnv6nBAgARsAAIAAA QAABAkJrwKgBAuAAAAKUBAAAFgAJ/eAAAAIAAAAAAAAAAAAARP3WKSatvEylPQAAPAAAADwA AAABAF4AAPsAHmURMyAIAEbAACAAAEAAAQJBccCoAQPgAAD7lAQAABYACQTgAAD7AAAAAAAA AAAAAHykwK0mrbxMZw4IADwAAAA8AAAAAQBeAAAWABue/qcECABGwAAgAABAAAECQlfAqAEC 4AAAFpQEAAAWAAnp4AAAFgAAAAAAAAAAAADAFD2YNa28TIcIDAA8AAAAPAAAAP///////wAe ZREzIAgGAAEIAAYEAAEAHmURMyDAqAEDAAAAAAAAwKgBEgAAAAAAAAAAAAAAAAAAy4X/pjWt vEytCAwAKgAAACoAAAAAHmURMyDYXUyAeW8IBgABCAAGBAAC2F1MgHlvwKgBEgAeZREzIMCo AQM1rbxMQw4MAE4AAABOAAAA2F1MgHlvAB5lETMgCABFAABArCUAAAEBijLAqAEDwKgBEggA rXoMAz6CAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAANa28TIgODABOAAAA TgAAAAAeZREzINhdTIB5bwgARQAAQF7AAABAAZiXwKgBEsCoAQMAALV6DAM+ggAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADWtvEyzDgwATgAAAE4AAADYXUyAeW8AHmUR MyAIAEUAAECsJgAAAQGKMcCoAQPAqAESCADjs1Fdwu4AAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAA1rbxMxg4MAE4AAABOAAAAAB5lETMg2F1MgHlvCABFAABAXsEAAEAB mJbAqAESwKgBAwAA67NRXcLuAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA Nq28TPG+CwBOAAAATgAAANhdTIB5bwAeZREzIAgARQAAQKwnAAABAYowwKgBA8CoARIIAKx6 DAM/ggAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADatvEwxvwsATgAAAE4A AAAAHmURMyDYXUyAeW8IAEUAAEBewgAAQAGYlcCoARLAqAEDAAC0egwDP4IAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA2rbxMjdULAE4AAABOAAAA2F1MgHlvAB5lETMg CABFAABArCgAAAEBii/AqAEDwKgBEggA4rNRXcPuAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAANq28TM7VCwBOAAAATgAAAAAeZREzINhdTIB5bwgARQAAQF7DAABAAZiU wKgBEsCoAQMAAOqzUV3D7gAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA== --------------000701080606070908060701--