Re: no-carrier on qlogic 8242 10gig with linux 3.x running xen

[Andrew Cooper <andrew.cooper3@citrix.com>]

On 28/03/12 10:55, Kristoffer Harthing Egefelt wrote:
> This is ip a showing no-carrier, even if the NIC is upped with ip link set
> dev eth0 up
>
> *ip a *
> 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN 
>     link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
>     inet 127.0.0.1/8 scope host lo
>     inet6 ::1/128 scope host 
>        valid_lft forever preferred_lft forever
> 2: eth0: <NO-CARRIER,BROADCAST,MULTICAST,PROMISC,UP> mtu 1500 qdisc
> pfifo_fast state DOWN qlen 1000
>     link/ether 24:b6:fd:64:1e:45 brd ff:ff:ff:ff:ff:ff
> 3: eth1: <NO-CARRIER,BROADCAST,MULTICAST,PROMISC,UP> mtu 1500 qdisc
> pfifo_fast state DOWN qlen 1000
>     link/ether 24:b6:fd:64:1e:46 brd ff:ff:ff:ff:ff:ff
>
> *This is ifconfig:*
> eth0      Link encap:Ethernet  HWaddr 24:b6:fd:64:1e:45  
>           UP BROADCAST PROMISC MULTICAST  MTU:1500  Metric:1
>           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
>           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
>           collisions:0 txqueuelen:1000 
>           RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)
>           Interrupt:175 
>
> *Interrupt 175 does not exist in /proc/interrupts*
>
> *This is dmesg while loading the qlcnic driver*
> [   12.009860] qlcnic 0000:03:00.0: phy port: 0 switch_mode: 0,
> [   12.009862] 	max_tx_q: 1 max_rx_q: 8 min_tx_bw: 0x0,
> [   12.009864] 	max_tx_bw: 0x64 max_mtu:0x2580, capabilities: 0x6affae
> [   12.025831] qlcnic 0000:03:00.0: failed card response code:0x10
> [   12.025889] qlcnic 0000:03:00.0: Can't get template size 16
> [   12.025893] qlcnic 0000:03:00.0: firmware v4.7.83
> [   12.057837] qlcnic: 24:b6:fd:64:1e:45: QME8242-k 10GbE Dual Port
> Mezzanine Card Board Chip rev 0x54
> [   12.058243] qlcnic 0000:03:00.0: using msi-x interrupts
> [   12.058810] qlcnic 0000:03:00.0: eth0: XGbE port initialized
> [   12.058844] xen: registering gsi 38 triggering 0 polarity 1
> [   12.058856] xen_map_pirq_gsi: returning irq 38 for gsi 38
> [   12.058859] xen: --> pirq=38 -> irq=38 (gsi=38)
> [   12.058863] Already setup the GSI :38
>
> *Interrupt 38 does not exist in /proc/interrupts*
>
> This is before any network configuration is run.
> /etc/network/interfaces is disabled - I run openvswitch and do all network
> configuration in some custom scripts. 
>
> Without xen it works - the irq's exist.

The IRQs listed when querying the hardware are the Xen IRQs, not dom0 IRQs.

You can find the mapping with the 'i' debug key.

If you have a Xen serial console:
   CTRL-a three times to switch input to Xen, followed by 'i'

If you are using xl, then something like:
   xl debug-keys 'i'
   xl dmesg | less

~Andrew

> --
> View this message in context: http://xen.1045712.n5.nabble.com/no-carrier-on-qlogic-8242-10gig-with-linux-3-x-running-xen-tp5597283p5599996.html
> Sent from the Xen - Dev mailing list archive at Nabble.com.
>
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xen.org
> http://lists.xen.org/xen-devel

-- 
Andrew Cooper - Dom0 Kernel Engineer, Citrix XenServer
T: +44 (0)1223 225 900, http://www.citrix.com