Re: Lose XHCI Device on HP Ivybridge While Resuming on Battery

[Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>]

On Mon, Mar 05, 2012 at 11:11:10AM -0500, Tom Goetz wrote:
> After resuming more than once on battery these HP Ivybridge laptops, the XHCI devices stop working. Have anyone seen this before? I wanted to check before diving in deeper. Let me know if you have any ideas. Thanks!
> 
> Facts
> 	- Xen 4.0.3, Linux 3.2.7 PVOPs
> 	- Happens on HP Ivybridge. Doesn't happen on very similar HP Sandybridge Clash system.
> 	- Happens on battery, but not on AC.

Did you guys try to limit the C-state? say max_cstate=2 ?

> 	- Doesn't happen on first suspend/resume. First resume may be long. Don't have enough sample to be sure of this.
> 	- CPU power governor doesn't effect the issue. Happens irregardless of governor.
> 	- Seems to effect MSI devices only.
> 	- IRQ changes appear in good resume case. Not just bad.
>  
> I've diffed lspci output across a working resume on AC and across a bad resume on battery. There seem to be the differences unique to the bad case:
> 
>  00:14.0 USB controller: Intel Corporation Panther Point USB xHCI Host Controller (rev 04) (prog-if 30 [XHCI])
>  Subsystem: Hewlett-Packard Company Device 179b
> -Flags: bus master, medium devsel, latency 0, IRQ 326
> +Flags: medium devsel, IRQ 327                             <-------------- lose bus master, latency 0
>  Memory at 94720000 (64-bit, non-prefetchable) [size=64K]
>  Capabilities: [70] Power Management version 2
>  Capabilities: [80] MSI: Enable+ Count=1/8 Maskable- 64bit+
>  Kernel driver in use: xhci_hcd
>  Kernel modules: xhci-hcd
> 
> --- 
> 
>  00:19.0 Ethernet controller: Intel Corporation 82579LM Gigabit Network Connection (rev 04)
>  Subsystem: Hewlett-Packard Company Device 179b
> -Flags: bus master, fast devsel, latency 0, IRQ 327
> -Memory at 94700000 (32-bit, non-prefetchable) [size=128K]
> -Memory at 9473a000 (32-bit, non-prefetchable) [size=4K]
> -I/O ports at 4060 [size=32]
> +Flags: fast devsel, IRQ 20                           <-------------- lose bus master, latency 0
> +Memory at 94700000 (32-bit, non-prefetchable) [disabled] [size=128K]   <------ becomes disabled
> +Memory at 9473a000 (32-bit, non-prefetchable) [disabled] [size=4K]     <------ becomes disabled
> +I/O ports at 4060 [disabled] [size=32]                                 <------ becomes disabled
>  Capabilities: [c8] Power Management version 2
> -Capabilities: [d0] MSI: Enable+ Count=1/1 Maskable- 64bit+
> +Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+    <---- toggle enable polarity
>  Capabilities: [e0] PCI Advanced Features
>  Kernel driver in use: e1000e
>  Kernel modules: e1000e
> 
> ---
> 
>  00:1a.0 USB controller: Intel Corporation Panther Point USB Enhanced Host Controller #2 (rev 04) (prog-if 20 [EHCI])
>  Subsystem: Hewlett-Packard Company Device 179b
> -Flags: bus master, medium devsel, latency 0, IRQ 16
> +Flags: medium devsel, IRQ 16                           <-------------- lose bus master, latency 0
>  Memory at 94739000 (32-bit, non-prefetchable) [size=1K]
>  Capabilities: [50] Power Management version 2
>  Capabilities: [58] Debug port: BAR=1 offset=00a0
>  Capabilities: [98] PCI Advanced Features
>  Kernel driver in use: ehci_hcd
>  Kernel modules: ehci-hcd
> 
> syslog looks like this for both good and bad resumes:
> 
> Mar  5 15:48:51 newt kernel: [  289.730303] xhci_hcd 0000:00:14.0: can't derive routing for PCI INT A
> Mar  5 15:48:51 newt kernel: [  289.730311] xhci_hcd 0000:00:14.0: PCI INT A: no GSI - using ISA IRQ 10
> Mar  5 15:48:51 newt kernel: [  289.730319] xen: registering gsi 10 triggering 0 polarity 1
> Mar  5 15:48:51 newt kernel: [  289.730327] xen_map_pirq_gsi: returning irq 10 for gsi 10
> Mar  5 15:48:51 newt kernel: [  289.730332] xen: --> pirq=10 -> irq=10 (gsi=10)
> Mar  5 15:48:51 newt kernel: [  289.730337] Already setup the GSI :10
> Mar  5 15:48:51 newt kernel: [  289.730445] xhci_hcd 0000:00:14.0: setting latency timer to 64
> Mar  5 15:48:51 newt kernel: [  289.730455] xhci_hcd 0000:00:14.0: xHCI Host Controller
> Mar  5 15:48:51 newt kernel: [  289.730687] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3
> Mar  5 15:48:51 newt kernel: [  289.730826] xhci_hcd 0000:00:14.0: cache line size of 64 is not supported
> Mar  5 15:48:51 newt kernel: [  289.730858] xhci_hcd 0000:00:14.0: irq 10, io mem 0x94720000
> Mar  5 15:48:51 newt kernel: [  289.731470] xHCI xhci_add_endpoint called for root hub
> Mar  5 15:48:51 newt kernel: [  289.731477] xHCI xhci_check_bandwidth called for root hub
> Mar  5 15:48:51 newt kernel: [  289.731551] hub 3-0:1.0: USB hub found
> Mar  5 15:48:51 newt kernel: [  289.731568] hub 3-0:1.0: 4 ports detected
> Mar  5 15:48:51 newt kernel: [  289.843501] xhci_hcd 0000:00:14.0: xHCI Host Controller
> Mar  5 15:48:51 newt kernel: [  289.843722] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4
> Mar  5 15:48:51 newt kernel: [  289.844015] xHCI xhci_add_endpoint called for root hub
> Mar  5 15:48:51 newt kernel: [  289.844021] xHCI xhci_check_bandwidth called for root hub
> Mar  5 15:48:51 newt kernel: [  289.844084] hub 4-0:1.0: USB hub found
> Mar  5 15:48:51 newt kernel: [  289.844104] hub 4-0:1.0: 4 ports detected
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xen.org
> http://lists.xen.org/xen-devel