From mboxrd@z Thu Jan 1 00:00:00 1970 From: Shawn Bohrer Subject: cxgb4 mbox4 errors listening to multiple multicast addresses Date: Thu, 10 May 2012 15:14:08 -0500 Message-ID: <20120510201408.GA4709@BohrerMBP.rgmadvisors.com> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Cc: netdev@vger.kernel.org To: dm@chelsio.com Return-path: Received: from na3sys009aog131.obsmtp.com ([74.125.149.247]:40372 "EHLO na3sys009aog131.obsmtp.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1753140Ab2EJUOW (ORCPT ); Thu, 10 May 2012 16:14:22 -0400 Received: by mail-yw0-f51.google.com with SMTP id n12so1941531yhn.10 for ; Thu, 10 May 2012 13:14:19 -0700 (PDT) Content-Disposition: inline Sender: netdev-owner@vger.kernel.org List-ID: Hello, I'm testing some Chelsio T4 cards (T420-CR) and they seem to reliably fail if I try to receiving multicast data on a number of different addresses. Actually it they fail even before any data is sent, so it must be simply subscribing to the multicast addresses that is the problem. See below for an example. $ uname -r 3.3.1 $ ethtool -i eth6 driver: cxgb4 version: 1.3.0-ko firmware-version: 1.3.10.0, TP 0.1.7.0 bus-info: 0000:04:00.4 supports-statistics: yes supports-test: no supports-eeprom-access: yes supports-register-dump: yes I've got vlan824 configured to use eth6. So if with iperf I can do: $ route add -net 224.0.0.0 netmask 240.0.0.0 dev vlan824 $ for x in $(seq 1 95); do iperf -s -u -B 224.4.4.${x} -p 500${x} & done $ dmesg | grep cxgb4 [ 10.847870] cxgb4 0000:04:00.4: irq 77 for MSI/MSI-X [ 10.847877] cxgb4 0000:04:00.4: irq 78 for MSI/MSI-X [ 10.847882] cxgb4 0000:04:00.4: irq 79 for MSI/MSI-X [ 10.847888] cxgb4 0000:04:00.4: irq 80 for MSI/MSI-X [ 10.847893] cxgb4 0000:04:00.4: irq 81 for MSI/MSI-X [ 10.847898] cxgb4 0000:04:00.4: irq 82 for MSI/MSI-X [ 10.847903] cxgb4 0000:04:00.4: irq 83 for MSI/MSI-X [ 10.847908] cxgb4 0000:04:00.4: irq 84 for MSI/MSI-X [ 10.847913] cxgb4 0000:04:00.4: irq 85 for MSI/MSI-X [ 10.847918] cxgb4 0000:04:00.4: irq 86 for MSI/MSI-X [ 10.847923] cxgb4 0000:04:00.4: irq 87 for MSI/MSI-X [ 10.847928] cxgb4 0000:04:00.4: irq 88 for MSI/MSI-X [ 10.847933] cxgb4 0000:04:00.4: irq 89 for MSI/MSI-X [ 10.847938] cxgb4 0000:04:00.4: irq 90 for MSI/MSI-X [ 10.847943] cxgb4 0000:04:00.4: irq 91 for MSI/MSI-X [ 10.847948] cxgb4 0000:04:00.4: irq 92 for MSI/MSI-X [ 10.847953] cxgb4 0000:04:00.4: irq 93 for MSI/MSI-X [ 10.847957] cxgb4 0000:04:00.4: irq 94 for MSI/MSI-X [ 10.847962] cxgb4 0000:04:00.4: irq 95 for MSI/MSI-X [ 10.847967] cxgb4 0000:04:00.4: irq 96 for MSI/MSI-X [ 10.847972] cxgb4 0000:04:00.4: irq 97 for MSI/MSI-X [ 10.847977] cxgb4 0000:04:00.4: irq 98 for MSI/MSI-X [ 10.847981] cxgb4 0000:04:00.4: irq 99 for MSI/MSI-X [ 10.847986] cxgb4 0000:04:00.4: irq 100 for MSI/MSI-X [ 10.847991] cxgb4 0000:04:00.4: irq 101 for MSI/MSI-X [ 10.847996] cxgb4 0000:04:00.4: irq 102 for MSI/MSI-X [ 10.848001] cxgb4 0000:04:00.4: irq 103 for MSI/MSI-X [ 10.848005] cxgb4 0000:04:00.4: irq 104 for MSI/MSI-X [ 10.848010] cxgb4 0000:04:00.4: irq 105 for MSI/MSI-X [ 10.848016] cxgb4 0000:04:00.4: irq 106 for MSI/MSI-X [ 10.848021] cxgb4 0000:04:00.4: irq 107 for MSI/MSI-X [ 10.848025] cxgb4 0000:04:00.4: irq 108 for MSI/MSI-X [ 10.848032] cxgb4 0000:04:00.4: irq 109 for MSI/MSI-X [ 10.848036] cxgb4 0000:04:00.4: irq 110 for MSI/MSI-X [ 10.848041] cxgb4 0000:04:00.4: irq 111 for MSI/MSI-X [ 10.848046] cxgb4 0000:04:00.4: irq 112 for MSI/MSI-X [ 10.848051] cxgb4 0000:04:00.4: irq 113 for MSI/MSI-X [ 10.848055] cxgb4 0000:04:00.4: irq 114 for MSI/MSI-X [ 10.848060] cxgb4 0000:04:00.4: irq 115 for MSI/MSI-X [ 10.848065] cxgb4 0000:04:00.4: irq 116 for MSI/MSI-X [ 10.848069] cxgb4 0000:04:00.4: irq 117 for MSI/MSI-X [ 10.848074] cxgb4 0000:04:00.4: irq 118 for MSI/MSI-X [ 10.848079] cxgb4 0000:04:00.4: irq 119 for MSI/MSI-X [ 10.848083] cxgb4 0000:04:00.4: irq 120 for MSI/MSI-X [ 10.848088] cxgb4 0000:04:00.4: irq 121 for MSI/MSI-X [ 10.848093] cxgb4 0000:04:00.4: irq 122 for MSI/MSI-X [ 10.848098] cxgb4 0000:04:00.4: irq 123 for MSI/MSI-X [ 10.848103] cxgb4 0000:04:00.4: irq 124 for MSI/MSI-X [ 10.848107] cxgb4 0000:04:00.4: irq 125 for MSI/MSI-X [ 10.848112] cxgb4 0000:04:00.4: irq 126 for MSI/MSI-X [ 10.848116] cxgb4 0000:04:00.4: irq 127 for MSI/MSI-X [ 10.848121] cxgb4 0000:04:00.4: irq 128 for MSI/MSI-X [ 10.848480] cxgb4 0000:04:00.4: eth4: Chelsio T420-LL-CR rev 2 10GBASE-R SFP+ RNIC PCIe x8 5 GT/s MSI-X [ 10.848482] cxgb4 0000:04:00.4: eth4: S/N: PT18110977, E/C: 01234567890123 [ 10.848714] cxgb4 0000:04:00.4: eth5: Chelsio T420-LL-CR rev 2 10GBASE-R SFP+ RNIC PCIe x8 5 GT/s MSI-X [ 10.848716] cxgb4 0000:04:00.4: eth5: S/N: PT18110977, E/C: 01234567890123 [ 10.850726] iw_cxgb4:Chelsio T4 RDMA Driver - version 0.1 [ 17.958293] iw_cxgb4:0000:04:00.4: Up [ 17.979873] cxgb4 0000:04:00.4: eth6: link up, 10Gbps, full-duplex, Tx/Rx PAUSE [ 17.979876] cxgb4 0000:04:00.4: eth6: passive DA module inserted [ 685.517044] cxgb4 0000:04:00.4: mbox 4: 150004c400000c02 800f01005e04040f 83ff01005e040401 0 0 0 0 0 [ 685.529179] cxgb4 0000:04:00.4: mbox 4: 150004c400000c02 800f01005e04040f 83ff01005e040401 0 0 0 0 0 [ 685.542396] cxgb4 0000:04:00.4: mbox 4: 150004c400000c02 800f01005e04040f 83ff01005e040401 83ff01005e040403 0 0 0 0 [ 685.555827] cxgb4 0000:04:00.4: mbox 4: 150004c400000c02 800f01005e04040f 83ff01005e040401 83ff01005e040403 0 0 0 0 [ 685.570377] cxgb4 0000:04:00.4: mbox 4: 150004c400000c03 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 0 0 0 [ 685.585110] cxgb4 0000:04:00.4: mbox 4: 150004c400000c03 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 0 0 0 [ 685.600915] cxgb4 0000:04:00.4: mbox 4: 150004c400000c03 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 0 0 [ 685.616945] cxgb4 0000:04:00.4: mbox 4: 150004c400000c03 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 0 0 [ 685.633943] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 0 [ 685.651269] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 0 [ 685.669648] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 685.688434] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 685.708128] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 685.726910] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 685.746620] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 685.765403] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 685.785103] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 685.803889] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 685.823559] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 685.842345] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 685.862060] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 685.880845] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 685.900669] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 685.919454] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 685.939104] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 685.957888] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 685.977570] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 685.996352] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.016043] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.034827] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.054675] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.073462] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.093201] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.111984] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.131681] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.150483] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.170134] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.188919] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.208593] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.227376] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.247074] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.265857] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.285532] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.304318] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.323965] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.342749] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.362423] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.381208] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.400882] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.419686] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.439341] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.458129] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.477762] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.496542] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.516173] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.534959] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.554585] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.573368] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.593006] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.611788] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.631453] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.650237] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.669893] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.688680] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.708360] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.727145] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.746777] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.765562] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.785242] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.804028] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.824719] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.843501] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.863170] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.881953] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.901648] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.920429] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.940061] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.958854] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.978518] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 686.997301] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.016940] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.035726] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.055372] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.074157] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.093794] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.112576] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.132207] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.150988] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.170634] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.189421] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.209058] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.227856] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.247488] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.266267] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.285905] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.304689] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.324333] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.343120] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.362756] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.381539] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.401179] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.419964] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.439623] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.458407] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.478076] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.496866] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.516497] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.535280] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.554924] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.573713] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.593351] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.612138] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.631793] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.650573] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.670222] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.689008] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.708652] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.727437] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.747071] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.765869] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.785510] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.804295] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.823948] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.842733] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.862379] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.881165] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.900829] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.919610] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.939241] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.958025] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.978719] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 687.997502] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.017145] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.035943] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.055583] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.074365] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.094004] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.112787] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.132430] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.151211] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.170856] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.189642] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.209303] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.228086] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.247714] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.266496] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.286143] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.304930] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.324558] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.343343] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.362973] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.381759] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.401398] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.420179] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.439808] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.458591] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.478220] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.497003] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.516654] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.535434] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.555081] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.573877] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.593508] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.612291] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.631928] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.650712] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.670347] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.689131] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.708761] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.727547] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.747188] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.765970] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.785608] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 [ 688.804391] cxgb4 0000:04:00.4: mbox 4: 150004c400000c04 800f01005e04040f 83ff01005e040401 83ff01005e040403 83ff01005e040412 83ff01005e04040e 83ff01005e040425 83ff01005e040413 Then on a second machine, I set up the iperf client to send the multicast data. machine2 $ route add -net 224.0.0.0 netmask 240.0.0.0 dev vlan824 machine2 $ for x in $(seq 1 95); do iperf -u -c 224.4.4.${x} -p 500${x} -l 100 -b 10M & done The receiver will receive some of the packets on a few of the addresses, but most of the addresses never receive anything. I realize this could be because we are simply dropping packets, but even running a single instance of the iperf client on machine2 for many of the addresses causes no packets to be received for example: machine2 $ iperf -u -c 224.4.4.65 -p 50065 -l 100 -b 10M Is there any translation of those cryptic mbox 4 errors? Thanks, Shawn -- --------------------------------------------------------------- This email, along with any attachments, is confidential. If you believe you received this message in error, please contact the sender immediately and delete all copies of the message. Thank you.