* bnx2x kerneloops
@ 2011-11-02 11:04 Carlos Peón Costa
2011-11-02 11:54 ` Dmitry Kravkov
0 siblings, 1 reply; 5+ messages in thread
From: Carlos Peón Costa @ 2011-11-02 11:04 UTC (permalink / raw)
To: netdev
Hello, can anybody help to debug this issue?
Thanks.
kernel 2.6.32-131.17.1.el6.x86_64 (RH 6.1)
ethtool -i eth0:driver: bnx2xversion: 1.62.00-6firmware-version: bc 5.2.7 phy baa0.105bus-info: 0000:02:00.0
Oct 31 10:40:34 apache1-pro kernel: NETDEV WATCHDOG: eth0 (bnx2x): transmit queue 6 timed out
Oct 31 10:40:34 apache1-pro kernel: Modules linked in: autofs4 nfs lockd fscache nfs_acl auth_rpcgss sunrpc pcc_cpufreq bonding ipv6 xt_recent ipt_LOG xt_limit nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_hashlimit iptable_filter ip_tables dm_mirror dm_region_hash dm_log power_meter ipmi_si ipmi_msghandler hpwdt hpilo sg bnx2x libcrc32c mdio microcode serio_raw iTCO_wdt iTCO_vendor_support i7core_edac edac_core shpchp ext4 mbcache jbd2 sd_mod crc_t10dif hpsa qla2xxx scsi_transport_fc scsi_tgt radeon ttm drm_kms_helper drm hwmon i2c_algo_bit i2c_core dm_mod [last unloaded: scsi_wait_scan]
Oct 31 10:40:34 apache1-pro kernel: Pid: 0, comm: swapper Not tainted 2.6.32-131.17.1.el6.x86_64 #1
Oct 31 10:40:34 apache1-pro kernel: Call Trace:
Oct 31 10:40:34 apache1-pro kernel: [] ? warn_slowpath_common+0x87/0xc0
Oct 31 10:40:34 apache1-pro kernel: [] ? warn_slowpath_fmt+0x46/0x50
Oct 31 10:40:34 apache1-pro kernel: [] ? dev_watchdog+0x26d/0x280
Oct 31 10:40:34 apache1-pro kernel: [] ? rh_timer_func+0x0/0x10
Oct 31 10:40:34 apache1-pro kernel: [] ? usb_hcd_poll_rh_status+0x141/0x180
Oct 31 10:40:34 apache1-pro kernel: [] ? read_tsc+0x9/0x20
Oct 31 10:40:34 apache1-pro kernel: [] ? dev_watchdog+0x0/0x280
Oct 31 10:40:34 apache1-pro kernel: [] ? run_timer_softirq+0x197/0x340
Oct 31 10:40:34 apache1-pro kernel: [] ? __do_softirq+0xc1/0x1d0
Oct 31 10:40:34 apache1-pro kernel: [] ? handle_IRQ_event+0x60/0x170
Oct 31 10:40:34 apache1-pro kernel: [] ? call_softirq+0x1c/0x30
Oct 31 10:40:34 apache1-pro kernel: [] ? do_softirq+0x65/0xa0
Oct 31 10:40:34 apache1-pro kernel: [] ? irq_exit+0x85/0x90
Oct 31 10:40:34 apache1-pro kernel: [] ? do_IRQ+0x75/0xf0
Oct 31 10:40:34 apache1-pro kernel: [] ? ret_from_intr+0x0/0x11
Oct 31 10:40:34 apache1-pro kernel: [] ? intel_idle+0xde/0x170
Oct 31 10:40:34 apache1-pro kernel: [] ? intel_idle+0xc1/0x170
Oct 31 10:40:34 apache1-pro kernel: [] ? cpuidle_idle_call+0xa7/0x140
Oct 31 10:40:34 apache1-pro kernel: [] ? cpu_idle+0xb6/0x110
Oct 31 10:40:34 apache1-pro kernel: [] ? rest_init+0x7a/0x80
Oct 31 10:40:34 apache1-pro kernel: [] ? start_kernel+0x41d/0x429
Oct 31 10:40:34 apache1-pro kernel: [] ? x86_64_start_reservations+0x125/0x129
Oct 31 10:40:34 apache1-pro kernel: [] ? x86_64_start_kernel+0xfa/0x109
Oct 31 10:40:34 apache1-pro kernel: ---[ end trace 77e43a1d40d78daf ]---
Oct 31 10:40:36 apache1-pro abrt: Kerneloops: Reported 1 kernel oopses to Abrt
Oct 31 10:40:36 apache1-pro abrtd: Directory 'kerneloops-1320054036-2000-1' creation detected
Oct 31 10:40:36 apache1-pro abrtd: Registered Database plugin 'SQLite3'
Oct 31 10:40:36 apache1-pro kernel: [bnx2x_chip_cleanup:7211(eth0)]timeout waiting for queue[6]
Oct 31 10:40:36 apache1-pro abrtd: New crash /var/spool/abrt/kerneloops-1320054036-2000-1, processing
Oct 31 10:40:46 apache1-pro kernel: [bnx2x_wait_ramrod:6305(eth0)]timeout waiting for state c0000 on IDX [6]
Oct 31 10:40:46 apache1-pro kernel: bnx2x 0000:02:00.0: firmware: requesting bnx2x/bnx2x-e1h-6.2.9.0.fw
Oct 31 10:40:46 apache1-pro kernel: bnx2x 0000:02:00.0: eth0: using MSI-X IRQs: sp 53 fp[0] 55 ... fp[7] 62
Oct 31 10:40:47 apache1-pro kernel: bonding: bond0: link status definitely down for interface eth0, disabling it
Oct 31 10:40:47 apache1-pro kernel: bonding: bond0: making interface eth1 the new active one.
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_attn_int_deasserted3:3142(eth1)]MC assert!
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_attn_int_deasserted3:3147(eth1)]driver assert
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:894(eth1)]begin crash dump -----------------
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:901(eth1)]def_idx(0x726) def_att_idx(0x8) attn_state(0x1) spq_prod_idx(0x2f)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:906(eth1)]DSB: attn bits(0x0) ack(0x1) id(0x10) idx(0x8)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:907(eth1)] def (0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x72d 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0) igu_sb_id(0x10) igu_seg_id (0x0) pf_id(0x1) vnic_id(0x0) vf_id(0xff) vf_valid (0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:951(eth1)]fp0: rx_bd_prod(0xbba) rx_bd_cons(0x9f3) rx_comp_prod(0xbc8) rx_comp_cons(0xa00) *rx_cons_sb(0x9ff)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:955(eth1)] rx_sge_prod(0x400) last_max_sge(0x0) fp_hc_idx(0x9ec)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:962(eth1)]fp0: tx_pkt_prod(0x0) tx_pkt_cons(0x0) tx_bd_prod(0x0) tx_bd_cons(0x0) *tx_cons_sb(0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:973(eth1)] run indexes (0x9ec 0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:979(eth1)] indexes (0x0 0x9ff 0x0 0x0 0x0 0x0 0x0 0x0)pf_id(0x1) vf_id (0xff) vf_valid(0x0) vnic_id(0x0) same_igu_sb_1b(0x1)
Oct 31 10:40:47 apache1-pro kernel: SM[0] __flags (0x0) igu_sb_id (0x1) igu_seg_id(0x0) time_to_expire (0x6ca43fd0) timer_value(0xff)
Oct 31 10:40:47 apache1-pro kernel: SM[1] __flags (0x0) igu_sb_id (0x1) igu_seg_id(0x0) time_to_expire (0xffffffff) timer_value(0xff)
Oct 31 10:40:47 apache1-pro kernel: INDEX[0] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[1] flags (0x2) timeout (0x6)
Oct 31 10:40:47 apache1-pro kernel: INDEX[2] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[3] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[4] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[5] flags (0x2) timeout (0xc)
Oct 31 10:40:47 apache1-pro kernel: INDEX[6] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[7] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:951(eth1)]fp1: rx_bd_prod(0x1c5) rx_bd_cons(0x0) rx_comp_prod(0x1c9) rx_comp_cons(0x1) *rx_cons_sb(0x1)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:955(eth1)] rx_sge_prod(0x400) last_max_sge(0x0) fp_hc_idx(0x1)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:962(eth1)]fp1: tx_pkt_prod(0x1) tx_pkt_cons(0x0) tx_bd_prod(0x2) tx_bd_cons(0x0) *tx_cons_sb(0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:973(eth1)] run indexes (0x1 0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:979(eth1)] indexes (0x0 0x1 0x0 0x0 0x0 0x0 0x0 0x0)pf_id(0x1) vf_id (0xff) vf_valid(0x0) vnic_id(0x0) same_igu_sb_1b(0x1)
Oct 31 10:40:47 apache1-pro kernel: SM[0] __flags (0x0) igu_sb_id (0x2) igu_seg_id(0x0) time_to_expire (0x216116) timer_value(0xff)
Oct 31 10:40:47 apache1-pro kernel: SM[1] __flags (0x0) igu_sb_id (0x2) igu_seg_id(0x0) time_to_expire (0xffffffff) timer_value(0xff)
Oct 31 10:40:47 apache1-pro kernel: INDEX[0] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[1] flags (0x2) timeout (0x6)
Oct 31 10:40:47 apache1-pro kernel: INDEX[2] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[3] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[4] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[5] flags (0x2) timeout (0xc)
Oct 31 10:40:47 apache1-pro kernel: INDEX[6] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[7] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:951(eth1)]fp2: rx_bd_prod(0x1dc) rx_bd_cons(0x17) rx_comp_prod(0x1e0) rx_comp_cons(0x18) *rx_cons_sb(0x18)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:955(eth1)] rx_sge_prod(0x400) last_max_sge(0x0) fp_hc_idx(0x18)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:962(eth1)]fp2: tx_pkt_prod(0x1) tx_pkt_cons(0x0) tx_bd_prod(0x2) tx_bd_cons(0x0) *tx_cons_sb(0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:973(eth1)] run indexes (0x18 0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:979(eth1)] indexes (0x0 0x18 0x0 0x0 0x0 0x0 0x0 0x0)pf_id(0x1) vf_id (0xff) vf_valid(0x0) vnic_id(0x0) same_igu_sb_1b(0x1)
Oct 31 10:40:47 apache1-pro kernel: SM[0] __flags (0x0) igu_sb_id (0x3) igu_seg_id(0x0) time_to_expire (0x6cab8f35) timer_value(0xff)
Oct 31 10:40:47 apache1-pro kernel: SM[1] __flags (0x0) igu_sb_id (0x3) igu_seg_id(0x0) time_to_expire (0xffffffff) timer_value(0xff)
Oct 31 10:40:47 apache1-pro kernel: INDEX[0] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[1] flags (0x2) timeout (0x6)
Oct 31 10:40:47 apache1-pro kernel: INDEX[2] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[3] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[4] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[5] flags (0x2) timeout (0xc)
Oct 31 10:40:47 apache1-pro kernel: INDEX[6] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[7] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:951(eth1)]fp3: rx_bd_prod(0x1ce) rx_bd_cons(0x9) rx_comp_prod(0x1d2) rx_comp_cons(0xa) *rx_cons_sb(0xa)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:955(eth1)] rx_sge_prod(0x400) last_max_sge(0x0) fp_hc_idx(0xa)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:962(eth1)]fp3: tx_pkt_prod(0x1) tx_pkt_cons(0x0) tx_bd_prod(0x2) tx_bd_cons(0x0) *tx_cons_sb(0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:973(eth1)] run indexes (0xa 0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:979(eth1)] indexes (0x0 0xa 0x0 0x0 0x0 0x0 0x0 0x0)pf_id(0x1) vf_id (0xff) vf_valid(0x0) vnic_id(0x0) same_igu_sb_1b(0x1)
Oct 31 10:40:47 apache1-pro kernel: SM[0] __flags (0x0) igu_sb_id (0x4) igu_seg_id(0x0) time_to_expire (0x6b22e5c4) timer_value(0xff)
Oct 31 10:40:47 apache1-pro kernel: SM[1] __flags (0x0) igu_sb_id (0x4) igu_seg_id(0x0) time_to_expire (0xffffffff) timer_value(0xff)
Oct 31 10:40:47 apache1-pro kernel: INDEX[0] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[1] flags (0x2) timeout (0x6)
Oct 31 10:40:47 apache1-pro kernel: INDEX[2] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[3] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[4] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[5] flags (0x2) timeout (0xc)
Oct 31 10:40:47 apache1-pro kernel: INDEX[6] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[7] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:951(eth1)]fp4: rx_bd_prod(0x1c5) rx_bd_cons(0x0) rx_comp_prod(0x1c9) rx_comp_cons(0x1) *rx_cons_sb(0x1)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:955(eth1)] rx_sge_prod(0x400) last_max_sge(0x0) fp_hc_idx(0x1)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:962(eth1)]fp4: tx_pkt_prod(0x0) tx_pkt_cons(0x0) tx_bd_prod(0x0) tx_bd_cons(0x0) *tx_cons_sb(0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:973(eth1)] run indexes (0x1 0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:979(eth1)] indexes (0x0 0x1 0x0 0x0 0x0 0x0 0x0 0x0)pf_id(0x1) vf_id (0xff) vf_valid(0x0) vnic_id(0x0) same_igu_sb_1b(0x1)
Oct 31 10:40:47 apache1-pro kernel: SM[0] __flags (0x0) igu_sb_id (0x5) igu_seg_id(0x0) time_to_expire (0x21787e) timer_value(0xff)
Oct 31 10:40:47 apache1-pro kernel: SM[1] __flags (0x0) igu_sb_id (0x5) igu_seg_id(0x0) time_to_expire (0xffffffff) timer_value(0xff)
Oct 31 10:40:47 apache1-pro kernel: INDEX[0] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[1] flags (0x2) timeout (0x6)
Oct 31 10:40:47 apache1-pro kernel: INDEX[2] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[3] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[4] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[5] flags (0x2) timeout (0xc)
Oct 31 10:40:47 apache1-pro kernel: INDEX[6] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[7] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:951(eth1)]fp5: rx_bd_prod(0x1c5) rx_bd_cons(0x0) rx_comp_prod(0x1c9) rx_comp_cons(0x1) *rx_cons_sb(0x1)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:955(eth1)] rx_sge_prod(0x400) last_max_sge(0x0) fp_hc_idx(0x1)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:962(eth1)]fp5: tx_pkt_prod(0x0) tx_pkt_cons(0x0) tx_bd_prod(0x0) tx_bd_cons(0x0) *tx_cons_sb(0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:973(eth1)] run indexes (0x1 0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:979(eth1)] indexes (0x0 0x1 0x0 0x0 0x0 0x0 0x0 0x0)pf_id(0x1) vf_id (0xff) vf_valid(0x0) vnic_id(0x0) same_igu_sb_1b(0x1)
Oct 31 10:40:47 apache1-pro kernel: SM[0] __flags (0x0) igu_sb_id (0x7) igu_seg_id(0x0) time_to_expire (0x218814) timer_value(0xff)
Oct 31 10:40:47 apache1-pro kernel: SM[1] __flags (0x0) igu_sb_id (0x7) igu_seg_id(0x0) time_to_expire (0xffffffff) timer_value(0xff)
Oct 31 10:40:47 apache1-pro kernel: INDEX[0] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[1] flags (0x2) timeout (0x6)
Oct 31 10:40:47 apache1-pro kernel: INDEX[2] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[3] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[4] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[5] flags (0x2) timeout (0xc)
Oct 31 10:40:47 apache1-pro kernel: INDEX[6] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[7] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:951(eth1)]fp7: rx_bd_prod(0x1d7) rx_bd_cons(0x12) rx_comp_prod(0x1db) rx_comp_cons(0x13) *rx_cons_sb(0x13)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:955(eth1)] rx_sge_prod(0x400) last_max_sge(0x0) fp_hc_idx(0x13)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:962(eth1)]fp7: tx_pkt_prod(0x0) tx_pkt_cons(0x0) tx_bd_prod(0x0) tx_bd_cons(0x0) *tx_cons_sb(0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:973(eth1)] run indexes (0x13 0x0)
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:979(eth1)] indexes (0x0 0x13 0x0 0x0 0x0 0x0 0x0 0x0)pf_id(0x1) vf_id (0xff) vf_valid(0x0) vnic_id(0x0) same_igu_sb_1b(0x1)
Oct 31 10:40:47 apache1-pro kernel: SM[0] __flags (0x0) igu_sb_id (0x8) igu_seg_id(0x0) time_to_expire (0x664cc527) timer_value(0xff)
Oct 31 10:40:47 apache1-pro kernel: SM[1] __flags (0x0) igu_sb_id (0x8) igu_seg_id(0x0) time_to_expire (0xffffffff) timer_value(0xff)
Oct 31 10:40:47 apache1-pro kernel: INDEX[0] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[1] flags (0x2) timeout (0x6)
Oct 31 10:40:47 apache1-pro kernel: INDEX[2] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[3] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[4] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[5] flags (0x2) timeout (0xc)
Oct 31 10:40:47 apache1-pro kernel: INDEX[6] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: INDEX[7] flags (0x0) timeout (0x0)
Oct 31 10:40:47 apache1-pro kernel: begin fw dump (mark 0xaf8e4)
Oct 31 10:40:47 apache1-pro kernel: nt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0Ap^AÈ->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x18:n 0x558=>0x6669746c
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x1c:n 0x55c=>0x74636e75
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x20:n 0x560=>0x5f6e6f69
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x24:n 0x564=>0x632d4c42
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x28:n 0x568=>0x6164415f
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x2c:n 0x56c=>0x72657470
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x30:n 0x570=>0x4b9000
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x34:n 0x574=>0x4e034e50
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x38:n 0x578=>0x4345412f
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x3c:n 0x57c=>0x412f4e03
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x40:n 0x580=>0x300a4e53
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x44:n 0x584=>0x34333231
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x48:n 0x588=>0x38373635
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x38:n 0x578=>0x4345412f
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x3c:n 0x57c=>0x412f4e03
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x40:n 0x580=>0x300a4e53
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x44:n 0x584=>0x34333231
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x48:n 0x588=>0x38373635
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x4c:n 0x58c=>0x44e4d39
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x50:n 0x590=>0x34653431
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x54:n 0x594=>0xf285652
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x58:n 0x598=>0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x5c:n 0x59c=>0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x60:n 0x5a0=>0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x64:n 0x5a4=>0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x68:n 0x5a8=>0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x6c:n 0x5ac=>0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x70:n 0x5b0=>0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x74:n 0x5b4=>0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x78:n 0x5b8=>0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x200
Oct 31 10:40:47 apache1-pro kernel: vpd[1]: a 0x7c:n 0x5bc=>0x78000000
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x200->0x0
Oct 31 10:40:47 apache1-pro kernel: f0: LOAD_REQ
Oct 31 10:40:47 apache1-pro kernel: p0: PMF->f0
Oct 31 10:40:47 apache1-pro kernel: f0: LOAD_DONE
Oct 31 10:40:47 apache1-pro kernel: evnt[0] 0x0->0x1000
Oct 31 10:40:47 apache1-pro kernel: evnt[0] 0x1000->0x0
Oct 31 10:40:47 apache1-pro kernel: f1: LOAD_REQ
Oct 31 10:40:47 apache1-pro kernel: p1: PMF->f1
Oct 31 10:40:47 apache1-pro kernel: f1: LOAD_DONE
Oct 31 10:40:47 apache1-pro kernel: evnt[0] 0x0->0x1000
Oct 31 10:40:47 apache1-pro kernel: evnt[0] 0x1000->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[0] 0x0->0x1000
Oct 31 10:40:47 apache1-pro kernel: evnt[0] 0x1000->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x1000
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x1000->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x1000
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x1000->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x0->0x1000
Oct 31 10:40:47 apache1-pro kernel: evnt[1] 0x1000->0x0
Oct 31 10:40:47 apache1-pro kernel: f0: UNLOAD_REQ_WOL_DIS
Oct 31 10:40:47 apache1-pro kernel: f0: UNLOAD_DONE
Oct 31 10:40:47 apache1-pro kernel: f0: LOAD_REQ
Oct 31 10:40:47 apache1-pro kernel: p0: PMF->f0
Oct 31 10:40:47 apache1-pro kernel: f0: LOAD_DONE
Oct 31 10:40:47 apache1-pro kernel: evnt[0] 0x0->0x1000
Oct 31 10:40:47 apache1-pro kernel: evnt[0] 0x1000->0x0
Oct 31 10:40:47 apache1-pro kernel: evnt[0] 0x0->0x1000
Oct 31 10:40:47 apache1-pro kernel: end of fw dump
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_mc_assert:732(eth1)]XSTORM_ASSERT_LIST_INDEX 0x2
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_mc_assert:749(eth1)]XSTORM_ASSERT_INDEX 0x0 = 0x00000000 0x00000000 0x00000000 0x00010014
Oct 31 10:40:47 apache1-pro kernel: [bnx2x_panic_dump:1099(eth1)]end crash dump -----------------
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: bnx2x kerneloops
2011-11-02 11:04 bnx2x kerneloops Carlos Peón Costa
@ 2011-11-02 11:54 ` Dmitry Kravkov
2011-11-02 11:59 ` Carlos Peón Costa
0 siblings, 1 reply; 5+ messages in thread
From: Dmitry Kravkov @ 2011-11-02 11:54 UTC (permalink / raw)
To: Carlos Peón Costa; +Cc: netdev@vger.kernel.org
On Wed, 2011-11-02 at 04:04 -0700, Carlos Peón Costa wrote:
> Hello, can anybody help to debug this issue?
> Thanks.
Which HW you are using?
> kernel 2.6.32-131.17.1.el6.x86_64 (RH 6.1)
This is not "GA" kernel for RHEL6.1, do your know if bnx2x sources
differs from 2.6.32-131.0.15?
^ permalink raw reply [flat|nested] 5+ messages in thread
* RE: bnx2x kerneloops
2011-11-02 11:54 ` Dmitry Kravkov
@ 2011-11-02 11:59 ` Carlos Peón Costa
2011-11-02 18:19 ` Dmitry Kravkov
0 siblings, 1 reply; 5+ messages in thread
From: Carlos Peón Costa @ 2011-11-02 11:59 UTC (permalink / raw)
To: dmitry; +Cc: netdev
Hi, It's a HP BL460c G6.
Regards.
02:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM57711E 10-Gigabit PCIe Subsystem: Hewlett-Packard Company NC532i Dual Port 10GbE Multifunction BL-C Adapter Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR- FastB2B- DisINTx+ Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx- Latency: 0, Cache Line Size: 64 bytes Interrupt: pin A routed to IRQ 28 Region 0: Memory at fb000000 (64-bit, non-prefetchable) [size=8M] Region 2: Memory at fa800000 (64-bit, non-prefetchable) [size=8M] [virtual] Expansion ROM at e4000000 [disabled] [size=64K] Capabilities: [48] Power Management version 3 Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+) Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=1 PME- Capabilities: [50] Vital Product Data Product Name: HP_NC532i_DP_10GbE_Multifunction_BL-c_Adapter Read-only fields: [PN] Part number: N/A [EC] Engineering changes: N/A [SN] Serial number: 0123456789 [MN] Manufacture ID: 31 34 65 34 [RV] Reserved: checksum good, 39 byte(s) reserved End Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+ Address: 0000000000000000 Data: 0000 Capabilities: [a0] MSI-X: Enable+ Count=17 Masked- Vector table: BAR=0 offset=00440000 PBA: BAR=0 offset=00441800 Capabilities: [ac] Express (v2) Endpoint, MSI 00 DevCap: MaxPayload 512 bytes, PhantFunc 0, Latency L0s <1us, L1 <2us ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset- DevCtl: Report errors: Correctable- Non-Fatal+ Fatal+ Unsupported- RlxdOrd+ ExtTag- PhantFunc- AuxPwr+ NoSnoop+ MaxPayload 256 bytes, MaxReadReq 4096 bytes DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend- LnkCap: Port #0, Speed 5GT/s, Width x8, ASPM L0s L1, Latency L0 <4us, L1 <4us ClockPM- Surprise- LLActRep- BwNot- LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk- ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- LnkSta: Speed 5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt- DevCap2: Completion Timeout: Range ABCD, TimeoutDis+ DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS- Compliance De-emphasis: -6dB LnkSta2: Current De-emphasis Level: -6dB Capabilities: [100] Device Serial Number d8-d3-85-ff-fe-59-86-48 Capabilities: [110] Advanced Error Reporting UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol- UESvrt: DLP- SDES+ TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr- CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr- AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn- Capabilities: [150] Power Budgeting <?> Capabilities: [160] Virtual Channel <?> Kernel driver in use: bnx2x Kernel modules: bnx2x
----------------------------------------
> Subject: Re: bnx2x kerneloops
> From: dmitry@broadcom.com
> To: carlospeon@hotmail.com
> CC: netdev@vger.kernel.org
> Date: Wed, 2 Nov 2011 13:54:05 +0200
>
> Which HW you are using?
^ permalink raw reply [flat|nested] 5+ messages in thread
* RE: bnx2x kerneloops
2011-11-02 11:59 ` Carlos Peón Costa
@ 2011-11-02 18:19 ` Dmitry Kravkov
[not found] ` <SNT113-W9B428C68CF654B313283EDBD50@phx.gbl>
0 siblings, 1 reply; 5+ messages in thread
From: Dmitry Kravkov @ 2011-11-02 18:19 UTC (permalink / raw)
To: Carlos Peón Costa; +Cc: netdev@vger.kernel.org
On Wed, 2011-11-02 at 04:59 -0700, Carlos Peón Costa wrote:
>
> Hi, It's a HP BL460c G6.
> Regards.
It looks like problem happened before the WATCHDOG, FW has asserted for
some reason.
Can you provide /var/log/messages and describe in details the scenario?
Thanks
^ permalink raw reply [flat|nested] 5+ messages in thread
* RE: bnx2x kerneloops
[not found] ` <SNT113-W9B428C68CF654B313283EDBD50@phx.gbl>
@ 2011-11-03 8:09 ` Carlos Peón Costa
0 siblings, 0 replies; 5+ messages in thread
From: Carlos Peón Costa @ 2011-11-03 8:09 UTC (permalink / raw)
To: netdev
Yes of course.
I attach the /var/log/messages file, before the Watchdog I only can see:
Oct 31 10:40:10 apache1-pro kernel: do_IRQ: 4.227 No irq handler for vector (irq -1)
The scenario: web server with ~ 15.000 tcp connections (established + time wait + close wait) and two Broadcom NICs in active/passive bonding. The web server is behind a load balancer.
Thanks.
> Subject: RE: bnx2x kerneloops
> From: dmitry@broadcom.com
> To: carlospeon@hotmail.com
> CC: netdev@vger.kernel.org
> Date: Wed, 2 Nov 2011 20:19:41 +0200
>
> It looks like problem happened before the WATCHDOG, FW has asserted for
> some reason.
> Can you provide /var/log/messages and describe in details the scenario?
> Thanks
>
^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2011-11-03 8:09 UTC | newest]
Thread overview: 5+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2011-11-02 11:04 bnx2x kerneloops Carlos Peón Costa
2011-11-02 11:54 ` Dmitry Kravkov
2011-11-02 11:59 ` Carlos Peón Costa
2011-11-02 18:19 ` Dmitry Kravkov
[not found] ` <SNT113-W9B428C68CF654B313283EDBD50@phx.gbl>
2011-11-03 8:09 ` Carlos Peón Costa
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox