linux-ide.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
* Hotplug borked after suspend/resume in Linux-3.3 ?
@ 2012-04-17 20:38 Mark Lord
  2012-04-17 20:48 ` Mark Lord
  2012-04-17 20:50 ` Jeff Garzik
  0 siblings, 2 replies; 37+ messages in thread
From: Mark Lord @ 2012-04-17 20:38 UTC (permalink / raw)
  To: Tejun Heo, Jeff Garzik, IDE/ATA development list

Okay, so why isn't SATA hotplug working in linux-3.3.2 ?
I don't know when it stopped working, but it's a blooming pain in the sysadmin.

I need to hotplug a SATA drive into an AHCI port,
preferably without having to reboot first.

Is there a patch available already for this regression?

Thanks

^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-17 20:38 Hotplug borked after suspend/resume in Linux-3.3 ? Mark Lord
@ 2012-04-17 20:48 ` Mark Lord
  2012-04-17 20:51   ` Tejun Heo
                     ` (2 more replies)
  2012-04-17 20:50 ` Jeff Garzik
  1 sibling, 3 replies; 37+ messages in thread
From: Mark Lord @ 2012-04-17 20:48 UTC (permalink / raw)
  To: Tejun Heo, Jeff Garzik, IDE/ATA development list

On 12-04-17 04:38 PM, Mark Lord wrote:
> Okay, so why isn't SATA hotplug working in linux-3.3.2 ?
> I don't know when it stopped working, but it's a blooming pain in the sysadmin.
> 
> I need to hotplug a SATA drive into an AHCI port,
> preferably without having to reboot first.
> 
> Is there a patch available already for this regression?


Answering my own question, this patch appears to address the issue.
I'll test and report back again shortly:

    http://patchwork.ozlabs.org/patch/146326/

Odd that it's been sitting in various people's inboxes since 3.3-rc1
and hasn't been pushed out yet.



^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-17 20:38 Hotplug borked after suspend/resume in Linux-3.3 ? Mark Lord
  2012-04-17 20:48 ` Mark Lord
@ 2012-04-17 20:50 ` Jeff Garzik
  2012-04-17 21:07   ` Mark Lord
  2012-04-17 21:14   ` Mark Lord
  1 sibling, 2 replies; 37+ messages in thread
From: Jeff Garzik @ 2012-04-17 20:50 UTC (permalink / raw)
  To: Mark Lord; +Cc: Tejun Heo, IDE/ATA development list, Lin Ming

On 04/17/2012 04:38 PM, Mark Lord wrote:
> Okay, so why isn't SATA hotplug working in linux-3.3.2 ?
> I don't know when it stopped working, but it's a blooming pain in the sysadmin.
>
> I need to hotplug a SATA drive into an AHCI port,
> preferably without having to reboot first.
>
> Is there a patch available already for this regression?

hrm...  smells like runtime PM stuff.

Can you try "libata: disable runtime pm for hotpluggable port"?

You probably have to edit ahci_port_pluggable() to make it 
unconditionally return true.

	Jeff



^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-17 20:48 ` Mark Lord
@ 2012-04-17 20:51   ` Tejun Heo
  2012-04-17 20:53   ` Mark Lord
  2012-04-17 20:57   ` Jeff Garzik
  2 siblings, 0 replies; 37+ messages in thread
From: Tejun Heo @ 2012-04-17 20:51 UTC (permalink / raw)
  To: Mark Lord; +Cc: Jeff Garzik, IDE/ATA development list

Hello,

On Tue, Apr 17, 2012 at 1:48 PM, Mark Lord <kernel@teksavvy.com> wrote:
> On 12-04-17 04:38 PM, Mark Lord wrote:
>> Okay, so why isn't SATA hotplug working in linux-3.3.2 ?
>> I don't know when it stopped working, but it's a blooming pain in the sysadmin.
>>
>> I need to hotplug a SATA drive into an AHCI port,
>> preferably without having to reboot first.
>>
>> Is there a patch available already for this regression?
>
> Answering my own question, this patch appears to address the issue.
> I'll test and report back again shortly:
>
>    http://patchwork.ozlabs.org/patch/146326/
>
> Odd that it's been sitting in various people's inboxes since 3.3-rc1
> and hasn't been pushed out yet.

This really is a userland policy problem and
unconditionally/automatically disabling PM on hotplug ports is just
trading one PITA for another.

Thanks.

-- 
tejun

^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-17 20:48 ` Mark Lord
  2012-04-17 20:51   ` Tejun Heo
@ 2012-04-17 20:53   ` Mark Lord
  2012-04-17 21:02     ` Mark Lord
  2012-04-17 21:04     ` Hotplug borked after suspend/resume in Linux-3.3 ? Jeff Garzik
  2012-04-17 20:57   ` Jeff Garzik
  2 siblings, 2 replies; 37+ messages in thread
From: Mark Lord @ 2012-04-17 20:53 UTC (permalink / raw)
  To: Tejun Heo, Jeff Garzik, IDE/ATA development list

On 12-04-17 04:48 PM, Mark Lord wrote:
> On 12-04-17 04:38 PM, Mark Lord wrote:
>> Okay, so why isn't SATA hotplug working in linux-3.3.2 ?
>> I don't know when it stopped working, but it's a blooming pain in the sysadmin.
>>
>> I need to hotplug a SATA drive into an AHCI port,
>> preferably without having to reboot first.
>>
>> Is there a patch available already for this regression?
> 
> 
> Answering my own question, this patch appears to address the issue.
> I'll test and report back again shortly:
> 
>     http://patchwork.ozlabs.org/patch/146326/
> 
> Odd that it's been sitting in various people's inboxes since 3.3-rc1
> and hasn't been pushed out yet.

Ahh.. perhaps because it doesn't fix the problem I'm seeing here.

Oh well, anyone else got a fix for this regression yet?
Even doing a rescan-scsi-bus doesn't work on the closed down ports.

Basically, any unoccupied AHCI port is dead to the world
after a simple suspend/resume (RAM) cycle.  On one of my machines
I can hot unplug/replug the ExpressCard adapter to recover,
but that doesn't work so well for built-in SATA/eSATA ports.

Thanks.


^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-17 20:48 ` Mark Lord
  2012-04-17 20:51   ` Tejun Heo
  2012-04-17 20:53   ` Mark Lord
@ 2012-04-17 20:57   ` Jeff Garzik
  2012-04-17 21:05     ` Mark Lord
  2 siblings, 1 reply; 37+ messages in thread
From: Jeff Garzik @ 2012-04-17 20:57 UTC (permalink / raw)
  To: Mark Lord; +Cc: Tejun Heo, IDE/ATA development list

On 04/17/2012 04:48 PM, Mark Lord wrote:
> On 12-04-17 04:38 PM, Mark Lord wrote:
>> Okay, so why isn't SATA hotplug working in linux-3.3.2 ?
>> I don't know when it stopped working, but it's a blooming pain in the sysadmin.
>>
>> I need to hotplug a SATA drive into an AHCI port,
>> preferably without having to reboot first.
>>
>> Is there a patch available already for this regression?
>
>
> Answering my own question, this patch appears to address the issue.
> I'll test and report back again shortly:
>
>      http://patchwork.ozlabs.org/patch/146326/
>
> Odd that it's been sitting in various people's inboxes since 3.3-rc1
> and hasn't been pushed out yet.

The vast majority of "hotpluggable" ports are not necessarily covered by 
this patch.

	Jeff




^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-17 20:53   ` Mark Lord
@ 2012-04-17 21:02     ` Mark Lord
  2012-04-17 21:05       ` cwillu
  2012-04-17 21:04     ` Hotplug borked after suspend/resume in Linux-3.3 ? Jeff Garzik
  1 sibling, 1 reply; 37+ messages in thread
From: Mark Lord @ 2012-04-17 21:02 UTC (permalink / raw)
  To: Tejun Heo, Jeff Garzik, IDE/ATA development list

On 12-04-17 04:53 PM, Mark Lord wrote:
> On 12-04-17 04:48 PM, Mark Lord wrote:
>> On 12-04-17 04:38 PM, Mark Lord wrote:
>>> Okay, so why isn't SATA hotplug working in linux-3.3.2 ?
>>> I don't know when it stopped working, but it's a blooming pain in the sysadmin.
>>>
>>> I need to hotplug a SATA drive into an AHCI port,
>>> preferably without having to reboot first.
>>>
>>> Is there a patch available already for this regression?
>>
>>
>> Answering my own question, this patch appears to address the issue.
>> I'll test and report back again shortly:
>>
>>     http://patchwork.ozlabs.org/patch/146326/
>>
>> Odd that it's been sitting in various people's inboxes since 3.3-rc1
>> and hasn't been pushed out yet.
> 
> Ahh.. perhaps because it doesn't fix the problem I'm seeing here.
> 
> Oh well, anyone else got a fix for this regression yet?
> Even doing a rescan-scsi-bus doesn't work on the closed down ports.
> 
> Basically, any unoccupied AHCI port is dead to the world
> after a simple suspend/resume (RAM) cycle.  On one of my machines
> I can hot unplug/replug the ExpressCard adapter to recover,
> but that doesn't work so well for built-in SATA/eSATA ports.


Mmm.. on my little Atom ZBOX systems, the patch linked above
"Patchwork [v2] libata: disable runtime pm for hotpluggable port"
_does_ appear to fix the issue.

Maybe my notebook is suffering from the ExpressCard not being resumed properly,
which would be a PCI issue most likely.

Anyway, one issue at a time:  The "disable runtime pm" patch seems to
be the regression fix I'm looking for here so that I can use SATA hotplug
after a suspend/resume.

Why isn't this upstream as a regression fix yet?

Thanks

^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-17 20:53   ` Mark Lord
  2012-04-17 21:02     ` Mark Lord
@ 2012-04-17 21:04     ` Jeff Garzik
  1 sibling, 0 replies; 37+ messages in thread
From: Jeff Garzik @ 2012-04-17 21:04 UTC (permalink / raw)
  To: Mark Lord; +Cc: Tejun Heo, IDE/ATA development list

On 04/17/2012 04:53 PM, Mark Lord wrote:
> Basically, any unoccupied AHCI port is dead to the world
> after a simple suspend/resume (RAM) cycle.  On one of my machines
> I can hot unplug/replug the ExpressCard adapter to recover,
> but that doesn't work so well for built-in SATA/eSATA ports.

Did you change the patch as requested in the email from 10 min ago?

	Jeff




^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-17 21:02     ` Mark Lord
@ 2012-04-17 21:05       ` cwillu
  2012-04-18 17:10         ` Martin Mokrejs
  0 siblings, 1 reply; 37+ messages in thread
From: cwillu @ 2012-04-17 21:05 UTC (permalink / raw)
  To: Mark Lord; +Cc: Tejun Heo, Jeff Garzik, IDE/ATA development list

On Tue, Apr 17, 2012 at 3:02 PM, Mark Lord <kernel@teksavvy.com> wrote:
> On 12-04-17 04:53 PM, Mark Lord wrote:
>> On 12-04-17 04:48 PM, Mark Lord wrote:
>>> On 12-04-17 04:38 PM, Mark Lord wrote:
>>>> Okay, so why isn't SATA hotplug working in linux-3.3.2 ?
>>>> I don't know when it stopped working, but it's a blooming pain in the sysadmin.
>>>>
>>>> I need to hotplug a SATA drive into an AHCI port,
>>>> preferably without having to reboot first.
>>>>
>>>> Is there a patch available already for this regression?
>>>
>>>
>>> Answering my own question, this patch appears to address the issue.
>>> I'll test and report back again shortly:
>>>
>>>     http://patchwork.ozlabs.org/patch/146326/
>>>
>>> Odd that it's been sitting in various people's inboxes since 3.3-rc1
>>> and hasn't been pushed out yet.
>>
>> Ahh.. perhaps because it doesn't fix the problem I'm seeing here.
>>
>> Oh well, anyone else got a fix for this regression yet?
>> Even doing a rescan-scsi-bus doesn't work on the closed down ports.
>>
>> Basically, any unoccupied AHCI port is dead to the world
>> after a simple suspend/resume (RAM) cycle.  On one of my machines
>> I can hot unplug/replug the ExpressCard adapter to recover,
>> but that doesn't work so well for built-in SATA/eSATA ports.
>
>
> Mmm.. on my little Atom ZBOX systems, the patch linked above
> "Patchwork [v2] libata: disable runtime pm for hotpluggable port"
> _does_ appear to fix the issue.
>
> Maybe my notebook is suffering from the ExpressCard not being resumed properly,
> which would be a PCI issue most likely.
>
> Anyway, one issue at a time:  The "disable runtime pm" patch seems to
> be the regression fix I'm looking for here so that I can use SATA hotplug
> after a suspend/resume.
>
> Why isn't this upstream as a regression fix yet?
>
> Thanks
> --
> To unsubscribe from this list: send the line "unsubscribe linux-ide" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

echo on > /sys/devices/pci0000:00/0000:00:1f.2/ata5/power/control
echo on > /sys/devices/pci0000:00/0000:00:1f.2/ata5/host4/power/control
echo '- - -' > /sys/devices/pci0000:00/0000:00:1f.2/ata5/host4/scsi_host/host4/scan

Substituting the appropriate values to poke the right devices

^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-17 20:57   ` Jeff Garzik
@ 2012-04-17 21:05     ` Mark Lord
  2012-04-17 21:10       ` Jeff Garzik
  0 siblings, 1 reply; 37+ messages in thread
From: Mark Lord @ 2012-04-17 21:05 UTC (permalink / raw)
  To: Jeff Garzik; +Cc: Tejun Heo, IDE/ATA development list

On 12-04-17 04:57 PM, Jeff Garzik wrote:
> On 04/17/2012 04:48 PM, Mark Lord wrote:
>> On 12-04-17 04:38 PM, Mark Lord wrote:
>>> Okay, so why isn't SATA hotplug working in linux-3.3.2 ?
>>> I don't know when it stopped working, but it's a blooming pain in the sysadmin.
>>>
>>> I need to hotplug a SATA drive into an AHCI port,
>>> preferably without having to reboot first.
>>>
>>> Is there a patch available already for this regression?
>>
>>
>> Answering my own question, this patch appears to address the issue.
>> I'll test and report back again shortly:
>>
>>      http://patchwork.ozlabs.org/patch/146326/
>>
>> Odd that it's been sitting in various people's inboxes since 3.3-rc1
>> and hasn't been pushed out yet.
> 
> The vast majority of "hotpluggable" ports are not necessarily covered by this patch.


And what majority of ports are currently broken by linux-3.3 ?
Any idea of what the offending commit may have been,
so I can test against that and perhaps get it reverted then?

So far, my sample of three systems are all broken with this kernel.
That's definitely "regression" territory.  :)


^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-17 20:50 ` Jeff Garzik
@ 2012-04-17 21:07   ` Mark Lord
  2012-04-17 21:14   ` Mark Lord
  1 sibling, 0 replies; 37+ messages in thread
From: Mark Lord @ 2012-04-17 21:07 UTC (permalink / raw)
  To: Jeff Garzik; +Cc: Tejun Heo, IDE/ATA development list, Lin Ming

On 12-04-17 04:50 PM, Jeff Garzik wrote:
> On 04/17/2012 04:38 PM, Mark Lord wrote:
>> Okay, so why isn't SATA hotplug working in linux-3.3.2 ?
>> I don't know when it stopped working, but it's a blooming pain in the sysadmin.
>>
>> I need to hotplug a SATA drive into an AHCI port,
>> preferably without having to reboot first.
>>
>> Is there a patch available already for this regression?
> 
> hrm...  smells like runtime PM stuff.
> 
> Can you try "libata: disable runtime pm for hotpluggable port"?
> 
> You probably have to edit ahci_port_pluggable() to make it unconditionally return true.

Rebuilding / reboot shortly.


^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-17 21:05     ` Mark Lord
@ 2012-04-17 21:10       ` Jeff Garzik
  2012-04-17 21:16         ` Mark Lord
  2012-04-18  1:52         ` Lin Ming
  0 siblings, 2 replies; 37+ messages in thread
From: Jeff Garzik @ 2012-04-17 21:10 UTC (permalink / raw)
  To: Mark Lord; +Cc: Tejun Heo, IDE/ATA development list

On 04/17/2012 05:05 PM, Mark Lord wrote:
> On 12-04-17 04:57 PM, Jeff Garzik wrote:
>> On 04/17/2012 04:48 PM, Mark Lord wrote:
>>> On 12-04-17 04:38 PM, Mark Lord wrote:
>>>> Okay, so why isn't SATA hotplug working in linux-3.3.2 ?
>>>> I don't know when it stopped working, but it's a blooming pain in the sysadmin.
>>>>
>>>> I need to hotplug a SATA drive into an AHCI port,
>>>> preferably without having to reboot first.
>>>>
>>>> Is there a patch available already for this regression?
>>>
>>>
>>> Answering my own question, this patch appears to address the issue.
>>> I'll test and report back again shortly:
>>>
>>>       http://patchwork.ozlabs.org/patch/146326/
>>>
>>> Odd that it's been sitting in various people's inboxes since 3.3-rc1
>>> and hasn't been pushed out yet.
>>
>> The vast majority of "hotpluggable" ports are not necessarily covered by this patch.
>
>
> And what majority of ports are currently broken by linux-3.3 ?
> Any idea of what the offending commit may have been,
> so I can test against that and perhaps get it reverted then?
>
> So far, my sample of three systems are all broken with this kernel.
> That's definitely "regression" territory.  :)

Right -- rather than breaking a bunch and fixing a few, we might just 
need to revert the runtime pm stuff altogether.

Commits to look at include

	966f1212e1ac5fe3ddf04479d21488ddb36a2608
	33574d68ae41ccbc6686cfabd965c685285c58a0
	e90b1e5a6e04c8892007ff8db20ef6d4fbdb5402
	9ee4f3933930abf5cc34f8e9d69fe0e08c18f602
	5ef41082912bdfcb33fa53b8dba2ad17dea2ef90
	9a6d6a2ddabbd32c07f6a38b659e5f3db319fa5a


^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-17 20:50 ` Jeff Garzik
  2012-04-17 21:07   ` Mark Lord
@ 2012-04-17 21:14   ` Mark Lord
  1 sibling, 0 replies; 37+ messages in thread
From: Mark Lord @ 2012-04-17 21:14 UTC (permalink / raw)
  To: Jeff Garzik; +Cc: Tejun Heo, IDE/ATA development list, Lin Ming

On 12-04-17 04:50 PM, Jeff Garzik wrote:
> On 04/17/2012 04:38 PM, Mark Lord wrote:
>> Okay, so why isn't SATA hotplug working in linux-3.3.2 ?
>> I don't know when it stopped working, but it's a blooming pain in the sysadmin.
>>
>> I need to hotplug a SATA drive into an AHCI port,
>> preferably without having to reboot first.
>>
>> Is there a patch available already for this regression?
> 
> hrm...  smells like runtime PM stuff.
> 
> Can you try "libata: disable runtime pm for hotpluggable port"?
> 
> You probably have to edit ahci_port_pluggable() to make it unconditionally return true.

Okay tried the ahci_port_pluggable() hack, no difference.
The patch above fixes the issue on two systems here with motherboard SATA,
and has zero effect on the AHCI ExpressCard in my notebook.

The notebook issue is definitely PCIe hotplug b0rkage, not libata.
I fixed that once, a few years ago, but it seems to have crept back
into the kernel again when I wasn't paying close attention.

Dunno when, could have been there for ages now.

But the libata regression is new.  And fixable here, at least.
I think whatever broke it should get reverted ASAP until you are
happy with a more permanent solution.

Otherwise the solution above is what I'm now patching into all of my systems here.

Cheers

^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-17 21:10       ` Jeff Garzik
@ 2012-04-17 21:16         ` Mark Lord
       [not found]           ` <CAF1ivSbEWJ18vV1ZqTnzWuZ5AXKwj+0pPPzCWUmnT_JKwKKQ2w@mail.gmail.com>
  2012-04-18  1:52         ` Lin Ming
  1 sibling, 1 reply; 37+ messages in thread
From: Mark Lord @ 2012-04-17 21:16 UTC (permalink / raw)
  To: Jeff Garzik; +Cc: Tejun Heo, IDE/ATA development list

On 12-04-17 05:10 PM, Jeff Garzik wrote:
> On 04/17/2012 05:05 PM, Mark Lord wrote:
>> On 12-04-17 04:57 PM, Jeff Garzik wrote:
>>> On 04/17/2012 04:48 PM, Mark Lord wrote:
>>>> On 12-04-17 04:38 PM, Mark Lord wrote:
>>>>> Okay, so why isn't SATA hotplug working in linux-3.3.2 ?
>>>>> I don't know when it stopped working, but it's a blooming pain in the sysadmin.
>>>>>
>>>>> I need to hotplug a SATA drive into an AHCI port,
>>>>> preferably without having to reboot first.
>>>>>
>>>>> Is there a patch available already for this regression?
>>>>
>>>>
>>>> Answering my own question, this patch appears to address the issue.
>>>> I'll test and report back again shortly:
>>>>
>>>>       http://patchwork.ozlabs.org/patch/146326/
>>>>
>>>> Odd that it's been sitting in various people's inboxes since 3.3-rc1
>>>> and hasn't been pushed out yet.
>>>
>>> The vast majority of "hotpluggable" ports are not necessarily covered by this patch.
>>
>>
>> And what majority of ports are currently broken by linux-3.3 ?
>> Any idea of what the offending commit may have been,
>> so I can test against that and perhaps get it reverted then?
>>
>> So far, my sample of three systems are all broken with this kernel.
>> That's definitely "regression" territory.  :)
> 
> Right -- rather than breaking a bunch and fixing a few, we might just need to revert the runtime pm
> stuff altogether.
> 
> Commits to look at include
> 
>     966f1212e1ac5fe3ddf04479d21488ddb36a2608
>     33574d68ae41ccbc6686cfabd965c685285c58a0
>     e90b1e5a6e04c8892007ff8db20ef6d4fbdb5402
>     9ee4f3933930abf5cc34f8e9d69fe0e08c18f602
>     5ef41082912bdfcb33fa53b8dba2ad17dea2ef90
>     9a6d6a2ddabbd32c07f6a38b659e5f3db319fa5a
> 

Or perhaps there's a simpler solution/patch, maybe a one-liner
to change the boot-up default to "no runtime PM until enabled" or something.

Probably less risky if the changes are as pervasive as you suggest.


^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
       [not found]           ` <CAF1ivSbEWJ18vV1ZqTnzWuZ5AXKwj+0pPPzCWUmnT_JKwKKQ2w@mail.gmail.com>
@ 2012-04-18  1:29             ` Lin Ming
  2012-04-18  1:37               ` Mark Lord
  0 siblings, 1 reply; 37+ messages in thread
From: Lin Ming @ 2012-04-18  1:29 UTC (permalink / raw)
  To: kernel; +Cc: Jeff Garzik, Tejun Heo, linux-ide


> On 12-04-17 05:10 PM, Jeff Garzik wrote:
> > On 04/17/2012 05:05 PM, Mark Lord wrote:
> >> On 12-04-17 04:57 PM, Jeff Garzik wrote:
> >>> On 04/17/2012 04:48 PM, Mark Lord wrote:
> >>>> On 12-04-17 04:38 PM, Mark Lord wrote:
> >>>>> Okay, so why isn't SATA hotplug working in linux-3.3.2 ?
> >>>>> I don't know when it stopped working, but it's a blooming pain in the sysadmin.
> >>>>>
> >>>>> I need to hotplug a SATA drive into an AHCI port,
> >>>>> preferably without having to reboot first.
> >>>>>
> >>>>> Is there a patch available already for this regression?
> >>>>
> >>>>
> >>>> Answering my own question, this patch appears to address the issue.
> >>>> I'll test and report back again shortly:
> >>>>
> >>>>       http://patchwork.ozlabs.org/patch/146326/
> >>>>
> >>>> Odd that it's been sitting in various people's inboxes since 3.3-rc1
> >>>> and hasn't been pushed out yet.
> >>>
> >>> The vast majority of "hotpluggable" ports are not necessarily covered by this patch.
> >>
> >>
> >> And what majority of ports are currently broken by linux-3.3 ?
> >> Any idea of what the offending commit may have been,
> >> so I can test against that and perhaps get it reverted then?
> >>
> >> So far, my sample of three systems are all broken with this kernel.
> >> That's definitely "regression" territory.  :)
> >
> > Right -- rather than breaking a bunch and fixing a few, we might just need to revert the runtime pm
> > stuff altogether.
> >
> > Commits to look at include
> >
> >     966f1212e1ac5fe3ddf04479d21488ddb36a2608
> >     33574d68ae41ccbc6686cfabd965c685285c58a0
> >     e90b1e5a6e04c8892007ff8db20ef6d4fbdb5402
> >     9ee4f3933930abf5cc34f8e9d69fe0e08c18f602
> >     5ef41082912bdfcb33fa53b8dba2ad17dea2ef90
> >     9a6d6a2ddabbd32c07f6a38b659e5f3db319fa5a
> >
> 
> Or perhaps there's a simpler solution/patch, maybe a one-liner
> to change the boot-up default to "no runtime PM until enabled" or something.
> 
> Probably less risky if the changes are as pervasive as you suggest.

Hi Mark,

I'm working on the hotplug issue fix.

Before the fix is ready, here is the one-line patch.
Could you give it a try?

Thanks.

>From 06aa5b161ea8d94c222deb572f6628c8dda49939 Mon Sep 17 00:00:00 2001
From: Lin Ming <ming.m.lin@intel.com>
Date: Wed, 18 Apr 2012 09:13:41 +0800
Subject: [PATCH] libata: forbid port runtime pm by default

Forbid port runtime pm by default because it has known hotplug issue.
User can allow it by, for example

echo auto > /sys/devices/pci0000:00/0000:00:1f.2/ata2/power/control

Signed-off-by: Lin Ming <ming.m.lin@intel.com>
---
 drivers/ata/libata-transport.c |    1 +
 1 files changed, 1 insertions(+), 0 deletions(-)

diff --git a/drivers/ata/libata-transport.c b/drivers/ata/libata-transport.c
index 74aaee3..c341904 100644
--- a/drivers/ata/libata-transport.c
+++ b/drivers/ata/libata-transport.c
@@ -294,6 +294,7 @@ int ata_tport_add(struct device *parent,
 	device_enable_async_suspend(dev);
 	pm_runtime_set_active(dev);
 	pm_runtime_enable(dev);
+	pm_runtime_forbid(dev);
 
 	transport_add_device(dev);
 	transport_configure_device(dev);
-- 
1.7.2.5





^ permalink raw reply related	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-18  1:29             ` Lin Ming
@ 2012-04-18  1:37               ` Mark Lord
  2012-04-18  1:46                 ` Mark Lord
  0 siblings, 1 reply; 37+ messages in thread
From: Mark Lord @ 2012-04-18  1:37 UTC (permalink / raw)
  To: Lin Ming; +Cc: Jeff Garzik, Tejun Heo, linux-ide

On 12-04-17 09:29 PM, Lin Ming wrote:
>
> I'm working on the hotplug issue fix.
> 
> Before the fix is ready, here is the one-line patch.
> Could you give it a try?
..
> --- a/drivers/ata/libata-transport.c
> +++ b/drivers/ata/libata-transport.c
> @@ -294,6 +294,7 @@ int ata_tport_add(struct device *parent,
>  	device_enable_async_suspend(dev);
>  	pm_runtime_set_active(dev);
>  	pm_runtime_enable(dev);
> +	pm_runtime_forbid(dev);
>  
..

I'm rebuilding the kernel right now.. should take about 5min or less to test.


^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-18  1:37               ` Mark Lord
@ 2012-04-18  1:46                 ` Mark Lord
  2012-04-18  6:18                   ` Jeff Garzik
  0 siblings, 1 reply; 37+ messages in thread
From: Mark Lord @ 2012-04-18  1:46 UTC (permalink / raw)
  To: Lin Ming; +Cc: Jeff Garzik, Tejun Heo, linux-ide

On 12-04-17 09:37 PM, Mark Lord wrote:
> On 12-04-17 09:29 PM, Lin Ming wrote:
>>
>> I'm working on the hotplug issue fix.
>>
>> Before the fix is ready, here is the one-line patch.
>> Could you give it a try?
> ..
>> --- a/drivers/ata/libata-transport.c
>> +++ b/drivers/ata/libata-transport.c
>> @@ -294,6 +294,7 @@ int ata_tport_add(struct device *parent,
>>  	device_enable_async_suspend(dev);
>>  	pm_runtime_set_active(dev);
>>  	pm_runtime_enable(dev);
>> +	pm_runtime_forbid(dev);
>>  
> ..
> 
> I'm rebuilding the kernel right now.. should take about 5min or less to test.

Yeah, that (by itself) is enough to make things work again.
This looks like the one-liner that we really need upstream and in -stable.

Jeff?

I'll now use it instead of the (much larger) "v2 disable runtime pm" thing.



^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-17 21:10       ` Jeff Garzik
  2012-04-17 21:16         ` Mark Lord
@ 2012-04-18  1:52         ` Lin Ming
  2012-04-18  2:28           ` Jeff Garzik
  1 sibling, 1 reply; 37+ messages in thread
From: Lin Ming @ 2012-04-18  1:52 UTC (permalink / raw)
  To: Jeff Garzik; +Cc: Mark Lord, Tejun Heo, IDE/ATA development list

On Wed, Apr 18, 2012 at 5:10 AM, Jeff Garzik <jgarzik@pobox.com> wrote:
> On 04/17/2012 05:05 PM, Mark Lord wrote:
>>
>> On 12-04-17 04:57 PM, Jeff Garzik wrote:
>>>
>>> On 04/17/2012 04:48 PM, Mark Lord wrote:
>>>>
>>>> On 12-04-17 04:38 PM, Mark Lord wrote:
>>>>>
>>>>> Okay, so why isn't SATA hotplug working in linux-3.3.2 ?
>>>>> I don't know when it stopped working, but it's a blooming pain in the
>>>>> sysadmin.
>>>>>
>>>>> I need to hotplug a SATA drive into an AHCI port,
>>>>> preferably without having to reboot first.
>>>>>
>>>>> Is there a patch available already for this regression?
>>>>
>>>>
>>>>
>>>> Answering my own question, this patch appears to address the issue.
>>>> I'll test and report back again shortly:
>>>>
>>>>      http://patchwork.ozlabs.org/patch/146326/
>>>>
>>>> Odd that it's been sitting in various people's inboxes since 3.3-rc1
>>>> and hasn't been pushed out yet.
>>>
>>>
>>> The vast majority of "hotpluggable" ports are not necessarily covered by
>>> this patch.
>>
>>
>>
>> And what majority of ports are currently broken by linux-3.3 ?
>> Any idea of what the offending commit may have been,
>> so I can test against that and perhaps get it reverted then?
>>
>> So far, my sample of three systems are all broken with this kernel.
>> That's definitely "regression" territory.  :)
>
>
> Right -- rather than breaking a bunch and fixing a few, we might just need
> to revert the runtime pm stuff altogether.

Hi Jeff,

I'm working on the hotplug issue fix.
How about below suggestion:

1) forbid port runtime pm by default, user can allow it on demand by
sysfs interface
2) then driver to allow port runtime pm if it supports hotplug well

ZPODD feature relies on port runtime suspend/resume to enter/exit zero
power state.
[PATCH v3 0/7] SATA ZPODD support
https://lkml.org/lkml/2012/3/28/20

So we really need port runtime pm support.

Thanks,
Lin Ming

>
> Commits to look at include
>
>        966f1212e1ac5fe3ddf04479d21488ddb36a2608
>        33574d68ae41ccbc6686cfabd965c685285c58a0
>        e90b1e5a6e04c8892007ff8db20ef6d4fbdb5402
>        9ee4f3933930abf5cc34f8e9d69fe0e08c18f602
>        5ef41082912bdfcb33fa53b8dba2ad17dea2ef90
>        9a6d6a2ddabbd32c07f6a38b659e5f3db319fa5a
>

^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-18  1:52         ` Lin Ming
@ 2012-04-18  2:28           ` Jeff Garzik
  0 siblings, 0 replies; 37+ messages in thread
From: Jeff Garzik @ 2012-04-18  2:28 UTC (permalink / raw)
  To: Lin Ming; +Cc: Mark Lord, Tejun Heo, IDE/ATA development list

On 04/17/2012 09:52 PM, Lin Ming wrote:
> I'm working on the hotplug issue fix.
> How about below suggestion:
>
> 1) forbid port runtime pm by default, user can allow it on demand by
> sysfs interface
> 2) then driver to allow port runtime pm if it supports hotplug well

That seems reasonable.

	Jeff





^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-18  1:46                 ` Mark Lord
@ 2012-04-18  6:18                   ` Jeff Garzik
  0 siblings, 0 replies; 37+ messages in thread
From: Jeff Garzik @ 2012-04-18  6:18 UTC (permalink / raw)
  To: Mark Lord; +Cc: Lin Ming, Tejun Heo, linux-ide

On 04/17/2012 09:46 PM, Mark Lord wrote:
> On 12-04-17 09:37 PM, Mark Lord wrote:
>> On 12-04-17 09:29 PM, Lin Ming wrote:
>>>
>>> I'm working on the hotplug issue fix.
>>>
>>> Before the fix is ready, here is the one-line patch.
>>> Could you give it a try?
>> ..
>>> --- a/drivers/ata/libata-transport.c
>>> +++ b/drivers/ata/libata-transport.c
>>> @@ -294,6 +294,7 @@ int ata_tport_add(struct device *parent,
>>>   	device_enable_async_suspend(dev);
>>>   	pm_runtime_set_active(dev);
>>>   	pm_runtime_enable(dev);
>>> +	pm_runtime_forbid(dev);
>>>
>> ..
>>
>> I'm rebuilding the kernel right now.. should take about 5min or less to test.
>
> Yeah, that (by itself) is enough to make things work again.
> This looks like the one-liner that we really need upstream and in -stable.
>
> Jeff?
>
> I'll now use it instead of the (much larger) "v2 disable runtime pm" thing.

Yeah I like that a -whole- lot better...

Will push upstream tomorrow.




^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-17 21:05       ` cwillu
@ 2012-04-18 17:10         ` Martin Mokrejs
  2012-04-18 17:29           ` Jeff Garzik
  0 siblings, 1 reply; 37+ messages in thread
From: Martin Mokrejs @ 2012-04-18 17:10 UTC (permalink / raw)
  To: cwillu; +Cc: Mark Lord, Tejun Heo, Jeff Garzik, IDE/ATA development list

[-- Attachment #1: Type: text/plain, Size: 6081 bytes --]



cwillu wrote:
> On Tue, Apr 17, 2012 at 3:02 PM, Mark Lord <kernel@teksavvy.com> wrote:
>> On 12-04-17 04:53 PM, Mark Lord wrote:
>>> On 12-04-17 04:48 PM, Mark Lord wrote:
>>>> On 12-04-17 04:38 PM, Mark Lord wrote:
>>>>> Okay, so why isn't SATA hotplug working in linux-3.3.2 ?
>>>>> I don't know when it stopped working, but it's a blooming pain in the sysadmin.
>>>>>
>>>>> I need to hotplug a SATA drive into an AHCI port,
>>>>> preferably without having to reboot first.
>>>>>
>>>>> Is there a patch available already for this regression?
>>>>
>>>>
>>>> Answering my own question, this patch appears to address the issue.
>>>> I'll test and report back again shortly:
>>>>
>>>>     http://patchwork.ozlabs.org/patch/146326/
>>>>
>>>> Odd that it's been sitting in various people's inboxes since 3.3-rc1
>>>> and hasn't been pushed out yet.
>>>
>>> Ahh.. perhaps because it doesn't fix the problem I'm seeing here.
>>>
>>> Oh well, anyone else got a fix for this regression yet?
>>> Even doing a rescan-scsi-bus doesn't work on the closed down ports.
>>>
>>> Basically, any unoccupied AHCI port is dead to the world
>>> after a simple suspend/resume (RAM) cycle.  On one of my machines
>>> I can hot unplug/replug the ExpressCard adapter to recover,
>>> but that doesn't work so well for built-in SATA/eSATA ports.
>>
>>
>> Mmm.. on my little Atom ZBOX systems, the patch linked above
>> "Patchwork [v2] libata: disable runtime pm for hotpluggable port"
>> _does_ appear to fix the issue.
>>
>> Maybe my notebook is suffering from the ExpressCard not being resumed properly,
>> which would be a PCI issue most likely.
>>
>> Anyway, one issue at a time:  The "disable runtime pm" patch seems to
>> be the regression fix I'm looking for here so that I can use SATA hotplug
>> after a suspend/resume.
>>
>> Why isn't this upstream as a regression fix yet?
>>
>> Thanks
>> --
>> To unsubscribe from this list: send the line "unsubscribe linux-ide" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> 
> echo on > /sys/devices/pci0000:00/0000:00:1f.2/ata5/power/control
> echo on > /sys/devices/pci0000:00/0000:00:1f.2/ata5/host4/power/control
> echo '- - -' > /sys/devices/pci0000:00/0000:00:1f.2/ata5/host4/scsi_host/host4/scan
> 
> Substituting the appropriate values to poke the right devices

I am having same issue with my laptop ... I have two external SATA disks (1TB and 3TB) and
an eSATA to SATA cable. When I plugin one of the disks (the 1TB in this test) into the
eSATA socket it gets detected. When I unplug the disk, dmesg receives:

[ 3155.563123] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4090000 action 0xe frozen
[ 3155.563132] ata6: irq_stat 0x00400040, connection status changed
[ 3155.563141] ata6: SError: { PHYRdyChg 10B8B DevExch }
[ 3155.563157] ata6: hard resetting link
[ 3156.306517] ata6: SATA link down (SStatus 0 SControl 300)
[ 3161.299061] ata6: hard resetting link
[ 3161.648549] ata6: SATA link down (SStatus 0 SControl 300)
[ 3161.648567] ata6: limiting SATA link speed to 1.5 Gbps
[ 3166.641111] ata6: hard resetting link
[ 3166.990595] ata6: SATA link down (SStatus 0 SControl 310)
[ 3166.990611] ata6.00: disabled
[ 3167.010556] ata6: EH complete
[ 3167.010576] ata6.00: detaching (SCSI 5:0:0:0)
[ 3167.011128] sd 5:0:0:0: [sdc] Synchronizing SCSI cache
[ 3167.011153] sd 5:0:0:0: [sdc]  Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
[ 3167.011157] sd 5:0:0:0: [sdc] Stopping disk
[ 3167.011164] sd 5:0:0:0: [sdc] START_STOP FAILED
[ 3167.011166] sd 5:0:0:0: [sdc]  Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK

Now the eSATA port seems dead and I cannot get the other drive recognized at all
when plugged into the eSATA slot. No, I did not suspend my laptop in between at all,
the hotplug feature itself is not working. While reading this post, I did *while having
the eSATA port seemingly dead*:

# lspci
00:00.0 Host bridge: Intel Corporation 2nd Generation Core Processor Family DRAM Controller (rev 09)
00:02.0 VGA compatible controller: Intel Corporation 2nd Generation Core Processor Family Integrated Graphics Controller (rev 09)
00:16.0 Communication controller: Intel Corporation 6 Series/C200 Series Chipset Family MEI Controller #1 (rev 04)
00:1a.0 USB controller: Intel Corporation 6 Series/C200 Series Chipset Family USB Enhanced Host Controller #2 (rev 05)
00:1b.0 Audio device: Intel Corporation 6 Series/C200 Series Chipset Family High Definition Audio Controller (rev 05)
00:1c.0 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 1 (rev b5)
00:1c.1 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 2 (rev b5)
00:1c.3 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 4 (rev b5)
00:1c.4 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 5 (rev b5)
00:1c.7 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 8 (rev b5)
00:1d.0 USB controller: Intel Corporation 6 Series/C200 Series Chipset Family USB Enhanced Host Controller #1 (rev 05)
00:1f.0 ISA bridge: Intel Corporation HM67 Express Chipset Family LPC Controller (rev 05)
00:1f.2 SATA controller: Intel Corporation 6 Series/C200 Series Chipset Family 6 port SATA AHCI Controller (rev 05)
00:1f.3 SMBus: Intel Corporation 6 Series/C200 Series Chipset Family SMBus Controller (rev 05)
05:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168B PCI Express Gigabit Ethernet controller (rev 06)
09:00.0 Network controller: Intel Corporation Centrino Wireless-N 1030 (rev 34)
0b:00.0 USB controller: Texas Instruments Device 8241 (rev 02)
# cat /sys/devices/pci0000:00/0000:00:1f.2/ata6/power/control
auto
#

Fix: I got my 3TB disk detected by this single command:

# echo on >  /sys/devices/pci0000:00/0000:00:1f.2/ata6/power/control
#

This is a Dell Vostro 3550 with A09 BIOS. Same happend with 3.4-rc3 kernel.

I can do some more testing if you want me to.
Best,
Martin

[-- Attachment #2: dmesg-3.3.2-3TB_disk_detected_only_after_power-control_auto_to_on_change.txt --]
[-- Type: text/plain, Size: 67503 bytes --]

[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 3.3.2-default (root@vostro) (gcc version 4.5.3 (Gentoo 4.5.3-r2 p1.1, pie-0.4.7) ) #4 SMP Sun Apr 15 11:51:10 MEST 2012
[    0.000000] Command line: root=/dev/sda5 pciehp.pciehp_debug=1
[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  BIOS-e820: 0000000000000000 - 000000000009d400 (usable)
[    0.000000]  BIOS-e820: 000000000009d400 - 00000000000a0000 (reserved)
[    0.000000]  BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved)
[    0.000000]  BIOS-e820: 0000000000100000 - 0000000020000000 (usable)
[    0.000000]  BIOS-e820: 0000000020000000 - 0000000020200000 (reserved)
[    0.000000]  BIOS-e820: 0000000020200000 - 0000000040000000 (usable)
[    0.000000]  BIOS-e820: 0000000040000000 - 0000000040200000 (reserved)
[    0.000000]  BIOS-e820: 0000000040200000 - 00000000da4e5000 (usable)
[    0.000000]  BIOS-e820: 00000000da4e5000 - 00000000da528000 (ACPI NVS)
[    0.000000]  BIOS-e820: 00000000da528000 - 00000000da793000 (usable)
[    0.000000]  BIOS-e820: 00000000da793000 - 00000000da967000 (reserved)
[    0.000000]  BIOS-e820: 00000000da967000 - 00000000daa89000 (usable)
[    0.000000]  BIOS-e820: 00000000daa89000 - 00000000dad68000 (reserved)
[    0.000000]  BIOS-e820: 00000000dad68000 - 00000000dafe8000 (ACPI NVS)
[    0.000000]  BIOS-e820: 00000000dafe8000 - 00000000db000000 (ACPI data)
[    0.000000]  BIOS-e820: 00000000db800000 - 00000000dfa00000 (reserved)
[    0.000000]  BIOS-e820: 00000000f8000000 - 00000000fc000000 (reserved)
[    0.000000]  BIOS-e820: 00000000fec00000 - 00000000fec01000 (reserved)
[    0.000000]  BIOS-e820: 00000000fed00000 - 00000000fed04000 (reserved)
[    0.000000]  BIOS-e820: 00000000fed1c000 - 00000000fed20000 (reserved)
[    0.000000]  BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
[    0.000000]  BIOS-e820: 00000000ff000000 - 0000000100000000 (reserved)
[    0.000000]  BIOS-e820: 0000000100000000 - 000000041fe00000 (usable)
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] DMI 2.6 present.
[    0.000000] DMI: Dell Inc. Vostro 3550/0JGC48, BIOS A09 09/30/2011
[    0.000000] e820 update range: 0000000000000000 - 0000000000010000 (usable) ==> (reserved)
[    0.000000] e820 remove range: 00000000000a0000 - 0000000000100000 (usable)
[    0.000000] No AGP bridge found
[    0.000000] last_pfn = 0x41fe00 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: uncachable
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF uncachable
[    0.000000]   C0000-CFFFF write-protect
[    0.000000]   D0000-E7FFF uncachable
[    0.000000]   E8000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 000000000 mask C00000000 write-back
[    0.000000]   1 base 400000000 mask FE0000000 write-back
[    0.000000]   2 base 0DB800000 mask FFF800000 uncachable
[    0.000000]   3 base 0DC000000 mask FFC000000 uncachable
[    0.000000]   4 base 0E0000000 mask FE0000000 uncachable
[    0.000000]   5 base 41FE00000 mask FFFE00000 uncachable
[    0.000000]   6 disabled
[    0.000000]   7 disabled
[    0.000000]   8 disabled
[    0.000000]   9 disabled
[    0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
[    0.000000] e820 update range: 00000000db800000 - 0000000100000000 (usable) ==> (reserved)
[    0.000000] last_pfn = 0xdaa89 max_arch_pfn = 0x400000000
[    0.000000] initial memory mapped : 0 - 20000000
[    0.000000] Base memory trampoline at [ffff880000098000] 98000 size 20480
[    0.000000] init_memory_mapping: 0000000000000000-00000000daa89000
[    0.000000]  0000000000 - 00daa00000 page 2M
[    0.000000]  00daa00000 - 00daa89000 page 4k
[    0.000000] kernel direct mapping tables up to daa89000 @ 1fffa000-20000000
[    0.000000] init_memory_mapping: 0000000100000000-000000041fe00000
[    0.000000]  0100000000 - 041fe00000 page 2M
[    0.000000] kernel direct mapping tables up to 41fe00000 @ daa77000-daa89000
[    0.000000] ACPI: RSDP 00000000000f0410 00024 (v02   DELL)
[    0.000000] ACPI: XSDT 00000000dafe8078 00074 (v01 DELL    WN09    01072009 AMI  00010013)
[    0.000000] ACPI: FACP 00000000daff1d08 000F4 (v04   DELL     WN09 01072009 AMI  00010013)
[    0.000000] ACPI: DSDT 00000000dafe8180 09B85 (v02   DELL     WN09 00000000 INTL 20051117)
[    0.000000] ACPI: FACS 00000000dafe3f80 00040
[    0.000000] ACPI: APIC 00000000daff1e00 00072 (v03   DELL     WN09 01072009 AMI  00010013)
[    0.000000] ACPI: MCFG 00000000daff1e78 0003C (v01   DELL     WN09 01072009 MSFT 00000097)
[    0.000000] ACPI: SSDT 00000000daff1eb8 004B0 (v01 TrmRef PtidDevc 00001000 INTL 20091112)
[    0.000000] ACPI: SLIC 00000000daff2368 00176 (v01 DELL    WN09    01072009 AMI  00010013)
[    0.000000] ACPI: HPET 00000000daff24e0 00038 (v01   DELL     WN09 01072009 AMI. 00000004)
[    0.000000] ACPI: SSDT 00000000daff2518 00846 (v01  PmRef  Cpu0Ist 00003000 INTL 20051117)
[    0.000000] ACPI: SSDT 00000000daff2d60 00996 (v01  PmRef    CpuPm 00003000 INTL 20051117)
[    0.000000] ACPI: DMAR 00000000daff36f8 000E8 (v01 INTEL      SNB  00000001 INTL 00000001)
[    0.000000] ACPI: OSFR 00000000daff37e0 00086 (v01 DELL    M08     07DB091E ASL  00000061)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at 0000000000000000-000000041fe00000
[    0.000000] Initmem setup node 0 0000000000000000-000000041fe00000
[    0.000000]   NODE_DATA [000000041fdfb000 - 000000041fdfffff]
[    0.000000]  [ffffea0000000000-ffffea000e7fffff] PMD -> [ffff88040f400000-ffff88041d5fffff] on node 0
[    0.000000] Zone PFN ranges:
[    0.000000]   DMA      0x00000010 -> 0x00001000
[    0.000000]   DMA32    0x00001000 -> 0x00100000
[    0.000000]   Normal   0x00100000 -> 0x0041fe00
[    0.000000] Movable zone start PFN for each node
[    0.000000] Early memory PFN ranges
[    0.000000]     0: 0x00000010 -> 0x0000009d
[    0.000000]     0: 0x00000100 -> 0x00020000
[    0.000000]     0: 0x00020200 -> 0x00040000
[    0.000000]     0: 0x00040200 -> 0x000da4e5
[    0.000000]     0: 0x000da528 -> 0x000da793
[    0.000000]     0: 0x000da967 -> 0x000daa89
[    0.000000]     0: 0x00100000 -> 0x0041fe00
[    0.000000] On node 0 totalpages: 4170239
[    0.000000]   DMA zone: 56 pages used for memmap
[    0.000000]   DMA zone: 5 pages reserved
[    0.000000]   DMA zone: 3920 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 14280 pages used for memmap
[    0.000000]   DMA32 zone: 875690 pages, LIFO batch:31
[    0.000000]   Normal zone: 44793 pages used for memmap
[    0.000000]   Normal zone: 3231495 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ2 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] SMP: Allowing 4 CPUs, 0 hotplug CPUs
[    0.000000] nr_irqs_gsi: 40
[    0.000000] PM: Registered nosave memory: 000000000009d000 - 000000000009e000
[    0.000000] PM: Registered nosave memory: 000000000009e000 - 00000000000a0000
[    0.000000] PM: Registered nosave memory: 00000000000a0000 - 00000000000e0000
[    0.000000] PM: Registered nosave memory: 00000000000e0000 - 0000000000100000
[    0.000000] PM: Registered nosave memory: 0000000020000000 - 0000000020200000
[    0.000000] PM: Registered nosave memory: 0000000040000000 - 0000000040200000
[    0.000000] PM: Registered nosave memory: 00000000da4e5000 - 00000000da528000
[    0.000000] PM: Registered nosave memory: 00000000da793000 - 00000000da967000
[    0.000000] PM: Registered nosave memory: 00000000daa89000 - 00000000dad68000
[    0.000000] PM: Registered nosave memory: 00000000dad68000 - 00000000dafe8000
[    0.000000] PM: Registered nosave memory: 00000000dafe8000 - 00000000db000000
[    0.000000] PM: Registered nosave memory: 00000000db000000 - 00000000db800000
[    0.000000] PM: Registered nosave memory: 00000000db800000 - 00000000dfa00000
[    0.000000] PM: Registered nosave memory: 00000000dfa00000 - 00000000f8000000
[    0.000000] PM: Registered nosave memory: 00000000f8000000 - 00000000fc000000
[    0.000000] PM: Registered nosave memory: 00000000fc000000 - 00000000fec00000
[    0.000000] PM: Registered nosave memory: 00000000fec00000 - 00000000fec01000
[    0.000000] PM: Registered nosave memory: 00000000fec01000 - 00000000fed00000
[    0.000000] PM: Registered nosave memory: 00000000fed00000 - 00000000fed04000
[    0.000000] PM: Registered nosave memory: 00000000fed04000 - 00000000fed1c000
[    0.000000] PM: Registered nosave memory: 00000000fed1c000 - 00000000fed20000
[    0.000000] PM: Registered nosave memory: 00000000fed20000 - 00000000fee00000
[    0.000000] PM: Registered nosave memory: 00000000fee00000 - 00000000fee01000
[    0.000000] PM: Registered nosave memory: 00000000fee01000 - 00000000ff000000
[    0.000000] PM: Registered nosave memory: 00000000ff000000 - 0000000100000000
[    0.000000] Allocating PCI resources starting at dfa00000 (gap: dfa00000:18600000)
[    0.000000] setup_percpu: NR_CPUS:4 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1
[    0.000000] PERCPU: Embedded 25 pages/cpu @ffff88041fa00000 s71936 r8192 d22272 u524288
[    0.000000] pcpu-alloc: s71936 r8192 d22272 u524288 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 0 1 2 3 
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 4111105
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: root=/dev/sda5 pciehp.pciehp_debug=1
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] xsave/xrstor: enabled xstate_bv 0x7, cntxt size 0x340
[    0.000000] Checking aperture...
[    0.000000] No AGP bridge found
[    0.000000] Memory: 16372232k/17299456k available (5635k kernel code, 618500k absent, 308724k reserved, 3582k data, 544k init)
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU dyntick-idle grace-period acceleration is enabled.
[    0.000000] NR_IRQS:4352 nr_irqs:712 16
[    0.000000] Extended CMOS year: 2000
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] hpet clockevent registered
[    0.000000] Fast TSC calibration using PIT
[    0.010000] Detected 2793.599 MHz processor.
[    0.000002] Calibrating delay loop (skipped), value calculated using timer frequency.. 5587.19 BogoMIPS (lpj=27935990)
[    0.000191] pid_max: default: 32768 minimum: 301
[    0.001151] Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.004157] Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[    0.005538] Mount-cache hash table entries: 256
[    0.005738] CPU: Physical Processor ID: 0
[    0.005831] CPU: Processor Core ID: 0
[    0.005926] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[    0.005927] ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8)
[    0.006119] mce: CPU supports 7 MCE banks
[    0.006221] CPU0: Thermal monitoring enabled (TM1)
[    0.006319] using mwait in idle threads.
[    0.006471] ACPI: Core revision 20120111
[    0.022703] DMAR: Host address width 36
[    0.022795] DMAR: DRHD base: 0x000000fed90000 flags: 0x0
[    0.022895] IOMMU 0: reg_base_addr fed90000 ver 1:0 cap c0000020e60262 ecap f0101a
[    0.023040] DMAR: DRHD base: 0x000000fed91000 flags: 0x1
[    0.023136] IOMMU 1: reg_base_addr fed91000 ver 1:0 cap c9008020660262 ecap f0105a
[    0.023281] DMAR: RMRR base: 0x000000dad53000 end: 0x000000dad61fff
[    0.023375] DMAR: RMRR base: 0x000000db800000 end: 0x000000df9fffff
[    0.023541] IOAPIC id 2 under DRHD base  0xfed91000 IOMMU 1
[    0.023636] HPET id 0 under DRHD base 0xfed91000
[    0.023729] HPET id 0 under DRHD base 0xfed91000
[    0.023822] HPET id 0 under DRHD base 0xfed91000
[    0.023914] HPET id 0 under DRHD base 0xfed91000
[    0.024006] HPET id 0 under DRHD base 0xfed91000
[    0.024100] HPET id 0 under DRHD base 0xfed91000
[    0.024193] HPET id 0 under DRHD base 0xfed91000
[    0.024284] HPET id 0 under DRHD base 0xfed91000
[    0.024536] Enabled IRQ remapping in x2apic mode
[    0.024629] Enabling x2apic
[    0.024720] Enabled x2apic
[    0.024813] Switched APIC routing to cluster x2apic.
[    0.025330] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.125279] CPU0: Intel(R) Core(TM) i7-2640M CPU @ 2.80GHz stepping 07
[    0.236481] Performance Events: PEBS fmt1+, SandyBridge events, Intel PMU driver.
[    0.236745] PEBS disabled due to CPU errata.
[    0.236839] ... version:                3
[    0.236930] ... bit width:              48
[    0.237023] ... generic registers:      4
[    0.237116] ... value mask:             0000ffffffffffff
[    0.237210] ... max period:             000000007fffffff
[    0.237304] ... fixed-purpose events:   3
[    0.237396] ... event mask:             000000070000000f
[    0.237575] NMI watchdog enabled, takes one hw-pmu counter.
[    0.237747] Booting Node   0, Processors  #1
[    0.237833] smpboot cpu 1: start_ip = 98000
[    0.270332] NMI watchdog enabled, takes one hw-pmu counter.
[    0.270501]  #2
[    0.270543] smpboot cpu 2: start_ip = 98000
[    0.301729] NMI watchdog enabled, takes one hw-pmu counter.
[    0.301904]  #3 Ok.
[    0.301994] smpboot cpu 3: start_ip = 98000
[    0.333081] NMI watchdog enabled, takes one hw-pmu counter.
[    0.333198] Brought up 4 CPUs
[    0.333290] Total of 4 processors activated (22348.79 BogoMIPS).
[    0.336311] devtmpfs: initialized
[    0.336532] PM: Registering ACPI NVS region at da4e5000 (274432 bytes)
[    0.336639] PM: Registering ACPI NVS region at dad68000 (2621440 bytes)
[    0.336858] xor: automatically using best checksumming function: generic_sse
[    0.386255]    generic_sse: 12451.600 MB/sec
[    0.386349] xor: using function: generic_sse (12451.600 MB/sec)
[    0.386578] print_constraints: dummy: 
[    0.386744] NET: Registered protocol family 16
[    0.387135] ACPI: bus type pci registered
[    0.387334] PCI: MMCONFIG for domain 0000 [bus 00-3f] at [mem 0xf8000000-0xfbffffff] (base 0xf8000000)
[    0.387483] PCI: MMCONFIG at [mem 0xf8000000-0xfbffffff] reserved in E820
[    0.393926] PCI: Using configuration type 1 for base access
[    0.400067] bio: create slab <bio-0> at 0
[    0.565998] raid6: int64x1   2925 MB/s
[    0.735742] raid6: int64x2   3000 MB/s
[    0.905488] raid6: int64x4   2722 MB/s
[    1.075223] raid6: int64x8   1726 MB/s
[    1.244962] raid6: sse2x1    7569 MB/s
[    1.414703] raid6: sse2x2    9247 MB/s
[    1.584446] raid6: sse2x4   10583 MB/s
[    1.584535] raid6: using algorithm sse2x4 (10583 MB/s)
[    1.584672] ACPI: Added _OSI(Module Device)
[    1.584765] ACPI: Added _OSI(Processor Device)
[    1.584858] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.584953] ACPI: Added _OSI(Processor Aggregator Device)
[    1.586240] ACPI: EC: Look up EC in DSDT
[    1.587558] ACPI: Executed 1 blocks of module-level executable AML code
[    1.592596] [Firmware Bug]: ACPI: BIOS _OSI(Linux) query ignored
[    1.597038] ACPI: SSDT 00000000dad51698 0064F (v01  PmRef  Cpu0Cst 00003001 INTL 20051117)
[    1.597578] ACPI: Dynamic OEM Table Load:
[    1.597748] ACPI: SSDT           (null) 0064F (v01  PmRef  Cpu0Cst 00003001 INTL 20051117)
[    1.598250] ACPI: SSDT 00000000dad52a98 00303 (v01  PmRef    ApIst 00003000 INTL 20051117)
[    1.598826] ACPI: Dynamic OEM Table Load:
[    1.598996] ACPI: SSDT           (null) 00303 (v01  PmRef    ApIst 00003000 INTL 20051117)
[    1.599388] ACPI: SSDT 00000000dad50d98 00119 (v01  PmRef    ApCst 00003000 INTL 20051117)
[    1.599916] ACPI: Dynamic OEM Table Load:
[    1.600085] ACPI: SSDT           (null) 00119 (v01  PmRef    ApCst 00003000 INTL 20051117)
[    1.600870] ACPI: Interpreter enabled
[    1.600963] ACPI: (supports S0 S1 S3 S4 S5)
[    1.601271] ACPI: Using IOAPIC for interrupt routing
[    1.626745] ACPI: No dock devices found.
[    1.626842] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.627315] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-3e])
[    1.627849] pci_root PNP0A08:00: host bridge window [io  0x0000-0x0cf7]
[    1.627947] pci_root PNP0A08:00: host bridge window [io  0x0d00-0xffff]
[    1.628044] pci_root PNP0A08:00: host bridge window [mem 0x000a0000-0x000bffff]
[    1.628190] pci_root PNP0A08:00: host bridge window [mem 0x000d0000-0x000d3fff]
[    1.628334] pci_root PNP0A08:00: host bridge window [mem 0x000d4000-0x000d7fff]
[    1.628479] pci_root PNP0A08:00: host bridge window [mem 0x000d8000-0x000dbfff]
[    1.628625] pci_root PNP0A08:00: host bridge window [mem 0x000dc000-0x000dffff]
[    1.628768] pci_root PNP0A08:00: host bridge window [mem 0x000e0000-0x000e3fff]
[    1.628912] pci_root PNP0A08:00: host bridge window [mem 0x000e4000-0x000e7fff]
[    1.629056] pci_root PNP0A08:00: host bridge window [mem 0xdfa00000-0xfeafffff]
[    1.629201] pci_root PNP0A08:00: host bridge window [mem 0xfed40000-0xfed44fff]
[    1.629389] PCI host bridge to bus 0000:00
[    1.629484] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7]
[    1.629580] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff]
[    1.629676] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
[    1.629775] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff]
[    1.629872] pci_bus 0000:00: root bus resource [mem 0x000d4000-0x000d7fff]
[    1.629969] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff]
[    1.630065] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff]
[    1.630163] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff]
[    1.630260] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff]
[    1.630356] pci_bus 0000:00: root bus resource [mem 0xdfa00000-0xfeafffff]
[    1.630453] pci_bus 0000:00: root bus resource [mem 0xfed40000-0xfed44fff]
[    1.630555] pci 0000:00:00.0: [8086:0104] type 0 class 0x000600
[    1.630589] pci 0000:00:02.0: [8086:0126] type 0 class 0x000300
[    1.630598] pci 0000:00:02.0: reg 10: [mem 0xf6800000-0xf6bfffff 64bit]
[    1.630603] pci 0000:00:02.0: reg 18: [mem 0xe0000000-0xefffffff 64bit pref]
[    1.630607] pci 0000:00:02.0: reg 20: [io  0xf000-0xf03f]
[    1.630657] pci 0000:00:16.0: [8086:1c3a] type 0 class 0x000780
[    1.630679] pci 0000:00:16.0: reg 10: [mem 0xf7f0a000-0xf7f0a00f 64bit]
[    1.630753] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
[    1.630787] pci 0000:00:1a.0: [8086:1c2d] type 0 class 0x000c03
[    1.630807] pci 0000:00:1a.0: reg 10: [mem 0xf7f08000-0xf7f083ff]
[    1.630894] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[    1.630920] pci 0000:00:1b.0: [8086:1c20] type 0 class 0x000403
[    1.630935] pci 0000:00:1b.0: reg 10: [mem 0xf7f00000-0xf7f03fff 64bit]
[    1.631000] pci 0000:00:1b.0: PME# supported from D0 D3hot D3cold
[    1.631025] pci 0000:00:1c.0: [8086:1c10] type 1 class 0x000604
[    1.631101] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    1.631130] pci 0000:00:1c.1: [8086:1c12] type 1 class 0x000604
[    1.631206] pci 0000:00:1c.1: PME# supported from D0 D3hot D3cold
[    1.631233] pci 0000:00:1c.3: [8086:1c16] type 1 class 0x000604
[    1.631309] pci 0000:00:1c.3: PME# supported from D0 D3hot D3cold
[    1.631340] pci 0000:00:1c.4: [8086:1c18] type 1 class 0x000604
[    1.631471] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold
[    1.631512] pci 0000:00:1c.7: [8086:1c1e] type 1 class 0x000604
[    1.631642] pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
[    1.631682] pci 0000:00:1d.0: [8086:1c26] type 0 class 0x000c03
[    1.631702] pci 0000:00:1d.0: reg 10: [mem 0xf7f07000-0xf7f073ff]
[    1.631789] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[    1.631816] pci 0000:00:1f.0: [8086:1c4b] type 0 class 0x000601
[    1.631937] pci 0000:00:1f.2: [8086:1c03] type 0 class 0x000106
[    1.631955] pci 0000:00:1f.2: reg 10: [io  0xf0b0-0xf0b7]
[    1.631963] pci 0000:00:1f.2: reg 14: [io  0xf0a0-0xf0a3]
[    1.631971] pci 0000:00:1f.2: reg 18: [io  0xf090-0xf097]
[    1.631979] pci 0000:00:1f.2: reg 1c: [io  0xf080-0xf083]
[    1.631986] pci 0000:00:1f.2: reg 20: [io  0xf060-0xf07f]
[    1.631994] pci 0000:00:1f.2: reg 24: [mem 0xf7f06000-0xf7f067ff]
[    1.632037] pci 0000:00:1f.2: PME# supported from D3hot
[    1.632058] pci 0000:00:1f.3: [8086:1c22] type 0 class 0x000c05
[    1.632072] pci 0000:00:1f.3: reg 10: [mem 0xf7f05000-0xf7f050ff 64bit]
[    1.632093] pci 0000:00:1f.3: reg 20: [io  0xf040-0xf05f]
[    1.632161] pci 0000:00:1c.0: PCI bridge to [bus 03-04]
[    1.632328] pci 0000:05:00.0: [10ec:8168] type 0 class 0x000200
[    1.632347] pci 0000:05:00.0: reg 10: [io  0xe000-0xe0ff]
[    1.632381] pci 0000:05:00.0: reg 18: [mem 0xf1104000-0xf1104fff 64bit pref]
[    1.632402] pci 0000:05:00.0: reg 20: [mem 0xf1100000-0xf1103fff 64bit pref]
[    1.632493] pci 0000:05:00.0: supports D1 D2
[    1.632494] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    1.644392] pci 0000:00:1c.1: PCI bridge to [bus 05-06]
[    1.644532] pci 0000:00:1c.1:   bridge window [io  0xe000-0xefff]
[    1.644540] pci 0000:00:1c.1:   bridge window [mem 0xf1100000-0xf11fffff 64bit pref]
[    1.644743] pci 0000:09:00.0: [8086:008a] type 0 class 0x000280
[    1.644890] pci 0000:09:00.0: reg 10: [mem 0xf7e00000-0xf7e01fff 64bit]
[    1.645560] pci 0000:09:00.0: PME# supported from D0 D3hot D3cold
[    1.664476] pci 0000:00:1c.3: PCI bridge to [bus 09-0a]
[    1.664574] pci 0000:00:1c.3:   bridge window [mem 0xf7e00000-0xf7efffff]
[    1.664674] pci 0000:0b:00.0: [104c:8241] type 0 class 0x000c03
[    1.664699] pci 0000:0b:00.0: reg 10: [mem 0xf7d00000-0xf7d0ffff 64bit]
[    1.664718] pci 0000:0b:00.0: reg 18: [mem 0xf7d10000-0xf7d11fff 64bit]
[    1.664823] pci 0000:0b:00.0: supports D1 D2
[    1.664824] pci 0000:0b:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    1.684328] pci 0000:00:1c.4: PCI bridge to [bus 0b-0c]
[    1.684473] pci 0000:00:1c.4:   bridge window [mem 0xf7d00000-0xf7dfffff]
[    1.684553] pci 0000:00:1c.7: PCI bridge to [bus 11-16]
[    1.684650] pci 0000:00:1c.7:   bridge window [io  0xc000-0xdfff]
[    1.684656] pci 0000:00:1c.7:   bridge window [mem 0xf6c00000-0xf7cfffff]
[    1.684665] pci 0000:00:1c.7:   bridge window [mem 0xf0000000-0xf10fffff 64bit pref]
[    1.684694] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
[    1.684863] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.RP01._PRT]
[    1.684900] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.RP02._PRT]
[    1.684939] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.RP04._PRT]
[    1.684976] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.RP05._PRT]
[    1.685028] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.RP08._PRT]
[    1.685158]  pci0000:00: Requesting ACPI _OSC control (0x1d)
[    1.685462]  pci0000:00: ACPI _OSC control (0x19) granted
[    1.690225] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    1.690793] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 *5 6 10 11 12 14 15)
[    1.691357] ACPI: PCI Interrupt Link [LNKC] (IRQs *3 4 5 6 10 11 12 14 15)
[    1.691920] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 *10 11 12 14 15)
[    1.692482] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 10 11 12 14 15) *0, disabled.
[    1.693171] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 11 12 14 15) *0, disabled.
[    1.693858] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 *5 6 10 11 12 14 15)
[    1.694424] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 *5 6 10 11 12 14 15)
[    1.695075] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[    1.695228] vgaarb: loaded
[    1.695318] vgaarb: bridge control possible 0000:00:02.0
[    1.695564] SCSI subsystem initialized
[    1.695743] libata version 3.00 loaded.
[    1.695870] usbcore: registered new interface driver usbfs
[    1.695988] usbcore: registered new interface driver hub
[    1.696112] usbcore: registered new device driver usb
[    1.696612] wmi: Mapper loaded
[    1.696748] Advanced Linux Sound Architecture Driver Version 1.0.24.
[    1.696843] PCI: Using ACPI for IRQ routing
[    1.698853] PCI: pci_cache_line_size set to 64 bytes
[    1.698985] reserve RAM buffer: 000000000009d400 - 000000000009ffff 
[    1.698987] reserve RAM buffer: 00000000da4e5000 - 00000000dbffffff 
[    1.698990] reserve RAM buffer: 00000000da793000 - 00000000dbffffff 
[    1.698993] reserve RAM buffer: 00000000daa89000 - 00000000dbffffff 
[    1.698995] reserve RAM buffer: 000000041fe00000 - 000000041fffffff 
[    1.699130] Bluetooth: Core ver 2.16
[    1.699241] NET: Registered protocol family 31
[    1.699335] Bluetooth: HCI device and connection manager initialized
[    1.699432] Bluetooth: HCI socket layer initialized
[    1.699526] Bluetooth: L2CAP socket layer initialized
[    1.699624] Bluetooth: SCO socket layer initialized
[    1.699782] cfg80211: Calling CRDA to update world regulatory domain
[    1.699962] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    1.700407] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    1.702511] Switching to clocksource hpet
[    1.702680] pnp: PnP ACPI init
[    1.702781] ACPI: bus type pnp registered
[    1.703114] pnp 00:00: [bus 00-3e]
[    1.703116] pnp 00:00: [io  0x0000-0x0cf7 window]
[    1.703118] pnp 00:00: [io  0x0cf8-0x0cff]
[    1.703120] pnp 00:00: [io  0x0d00-0xffff window]
[    1.703122] pnp 00:00: [mem 0x000a0000-0x000bffff window]
[    1.703123] pnp 00:00: [mem 0x000c0000-0x000c3fff window]
[    1.703125] pnp 00:00: [mem 0x000c4000-0x000c7fff window]
[    1.703126] pnp 00:00: [mem 0x000c8000-0x000cbfff window]
[    1.703128] pnp 00:00: [mem 0x000cc000-0x000cffff window]
[    1.703130] pnp 00:00: [mem 0x000d0000-0x000d3fff window]
[    1.703131] pnp 00:00: [mem 0x000d4000-0x000d7fff window]
[    1.703133] pnp 00:00: [mem 0x000d8000-0x000dbfff window]
[    1.703134] pnp 00:00: [mem 0x000dc000-0x000dffff window]
[    1.703136] pnp 00:00: [mem 0x000e0000-0x000e3fff window]
[    1.703137] pnp 00:00: [mem 0x000e4000-0x000e7fff window]
[    1.703139] pnp 00:00: [mem 0x000e8000-0x000ebfff window]
[    1.703141] pnp 00:00: [mem 0x000ec000-0x000effff window]
[    1.703142] pnp 00:00: [mem 0x000f0000-0x000fffff window]
[    1.703144] pnp 00:00: [mem 0xdfa00000-0xfeafffff window]
[    1.703145] pnp 00:00: [mem 0xfed40000-0xfed44fff window]
[    1.703214] pnp 00:00: Plug and Play ACPI device, IDs PNP0a08 PNP0a03 (active)
[    1.703228] pnp 00:01: [io  0x0000-0x001f]
[    1.703230] pnp 00:01: [io  0x0081-0x0091]
[    1.703231] pnp 00:01: [io  0x0093-0x009f]
[    1.703233] pnp 00:01: [io  0x00c0-0x00df]
[    1.703235] pnp 00:01: [dma 4]
[    1.703277] pnp 00:01: Plug and Play ACPI device, IDs PNP0200 (active)
[    1.703285] pnp 00:02: [mem 0xff000000-0xffffffff]
[    1.703324] pnp 00:02: Plug and Play ACPI device, IDs INT0800 (active)
[    1.703400] pnp 00:03: [mem 0xfed00000-0xfed003ff]
[    1.703441] pnp 00:03: Plug and Play ACPI device, IDs PNP0103 (active)
[    1.703453] pnp 00:04: [io  0x002e-0x002f]
[    1.703455] pnp 00:04: [io  0x004e-0x004f]
[    1.703456] pnp 00:04: [io  0x0061]
[    1.703457] pnp 00:04: [io  0x0063]
[    1.703459] pnp 00:04: [io  0x0065]
[    1.703460] pnp 00:04: [io  0x0067]
[    1.703461] pnp 00:04: [io  0x0070]
[    1.703462] pnp 00:04: [io  0x0080]
[    1.703464] pnp 00:04: [io  0x0092]
[    1.703465] pnp 00:04: [io  0x00b2-0x00b3]
[    1.703466] pnp 00:04: [io  0x0680-0x069f]
[    1.703468] pnp 00:04: [io  0x1000-0x100f]
[    1.703469] pnp 00:04: [io  0xffff]
[    1.703470] pnp 00:04: [io  0xffff]
[    1.703471] pnp 00:04: [io  0x0400-0x0453]
[    1.703473] pnp 00:04: [io  0x0458-0x047f]
[    1.703474] pnp 00:04: [io  0x0500-0x057f]
[    1.703475] pnp 00:04: [io  0x164e-0x164f]
[    1.703530] system 00:04: [io  0x0680-0x069f] has been reserved
[    1.703629] system 00:04: [io  0x1000-0x100f] has been reserved
[    1.703725] system 00:04: [io  0xffff] has been reserved
[    1.703820] system 00:04: [io  0xffff] has been reserved
[    1.703914] system 00:04: [io  0x0400-0x0453] has been reserved
[    1.704010] system 00:04: [io  0x0458-0x047f] has been reserved
[    1.704105] system 00:04: [io  0x0500-0x057f] has been reserved
[    1.704201] system 00:04: [io  0x164e-0x164f] has been reserved
[    1.704307] system 00:04: Plug and Play ACPI device, IDs PNP0c02 (active)
[    1.704316] pnp 00:05: [io  0x0070-0x0077]
[    1.704325] pnp 00:05: [irq 8]
[    1.704371] pnp 00:05: Plug and Play ACPI device, IDs PNP0b00 (active)
[    1.704399] pnp 00:06: [io  0x0454-0x0457]
[    1.704458] system 00:06: [io  0x0454-0x0457] has been reserved
[    1.704554] system 00:06: Plug and Play ACPI device, IDs INT3f0d PNP0c02 (active)
[    1.704563] pnp 00:07: [io  0x00f0-0x00ff]
[    1.704569] pnp 00:07: [irq 13]
[    1.704618] pnp 00:07: Plug and Play ACPI device, IDs PNP0c04 (active)
[    1.704634] pnp 00:08: [io  0x0010-0x001f]
[    1.704636] pnp 00:08: [io  0x0022-0x003f]
[    1.704637] pnp 00:08: [io  0x0044-0x005f]
[    1.704638] pnp 00:08: [io  0x0068-0x006f]
[    1.704639] pnp 00:08: [io  0x0072-0x007f]
[    1.704641] pnp 00:08: [io  0x0080]
[    1.704642] pnp 00:08: [io  0x0084-0x0086]
[    1.704644] pnp 00:08: [io  0x0088]
[    1.704645] pnp 00:08: [io  0x008c-0x008e]
[    1.704647] pnp 00:08: [io  0x0090-0x009f]
[    1.704648] pnp 00:08: [io  0x00a2-0x00bf]
[    1.704649] pnp 00:08: [io  0x00e0-0x00ef]
[    1.704650] pnp 00:08: [io  0x04d0-0x04d1]
[    1.704652] pnp 00:08: [mem 0xfe800000-0xfe802fff]
[    1.704712] system 00:08: [io  0x04d0-0x04d1] has been reserved
[    1.704812] system 00:08: [mem 0xfe800000-0xfe802fff] has been reserved
[    1.704908] system 00:08: Plug and Play ACPI device, IDs PNP0c02 (active)
[    1.704925] pnp 00:09: [irq 12]
[    1.704970] pnp 00:09: Plug and Play ACPI device, IDs DLL04b3 SYN0600 SYN0002 PNP0f13 (active)
[    1.704984] pnp 00:0a: [io  0x0060]
[    1.704985] pnp 00:0a: [io  0x0064]
[    1.704987] pnp 00:0a: [io  0x0062]
[    1.704988] pnp 00:0a: [io  0x0066]
[    1.704994] pnp 00:0a: [irq 1]
[    1.705036] pnp 00:0a: Plug and Play ACPI device, IDs PNP0303 (active)
[    1.705226] pnp 00:0b: [mem 0xfed1c000-0xfed1ffff]
[    1.705228] pnp 00:0b: [mem 0xfed10000-0xfed17fff]
[    1.705229] pnp 00:0b: [mem 0xfed18000-0xfed18fff]
[    1.705231] pnp 00:0b: [mem 0xfed19000-0xfed19fff]
[    1.705232] pnp 00:0b: [mem 0xf8000000-0xfbffffff]
[    1.705234] pnp 00:0b: [mem 0xfed20000-0xfed3ffff]
[    1.705235] pnp 00:0b: [mem 0xfed90000-0xfed93fff]
[    1.705236] pnp 00:0b: [mem 0xfed45000-0xfed8ffff]
[    1.705238] pnp 00:0b: [mem 0xff000000-0xffffffff]
[    1.705239] pnp 00:0b: [mem 0xfee00000-0xfeefffff]
[    1.705241] pnp 00:0b: [mem 0xdfa00000-0xdfa00fff]
[    1.705310] system 00:0b: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    1.705409] system 00:0b: [mem 0xfed10000-0xfed17fff] has been reserved
[    1.705506] system 00:0b: [mem 0xfed18000-0xfed18fff] has been reserved
[    1.705603] system 00:0b: [mem 0xfed19000-0xfed19fff] has been reserved
[    1.705700] system 00:0b: [mem 0xf8000000-0xfbffffff] has been reserved
[    1.705798] system 00:0b: [mem 0xfed20000-0xfed3ffff] has been reserved
[    1.705895] system 00:0b: [mem 0xfed90000-0xfed93fff] has been reserved
[    1.705992] system 00:0b: [mem 0xfed45000-0xfed8ffff] has been reserved
[    1.706090] system 00:0b: [mem 0xff000000-0xffffffff] has been reserved
[    1.706186] system 00:0b: [mem 0xfee00000-0xfeefffff] could not be reserved
[    1.706283] system 00:0b: [mem 0xdfa00000-0xdfa00fff] has been reserved
[    1.706380] system 00:0b: Plug and Play ACPI device, IDs PNP0c02 (active)
[    1.706438] pnp 00:0c: [irq 20]
[    1.706498] pnp 00:0c: Plug and Play ACPI device, IDs SMO8800 (active)
[    1.706608] pnp 00:0d: [mem 0x20000000-0x201fffff]
[    1.706609] pnp 00:0d: [mem 0x40000000-0x401fffff]
[    1.706681] system 00:0d: [mem 0x20000000-0x201fffff] has been reserved
[    1.706780] system 00:0d: [mem 0x40000000-0x401fffff] has been reserved
[    1.706878] system 00:0d: Plug and Play ACPI device, IDs PNP0c01 (active)
[    1.706919] pnp: PnP ACPI: found 14 devices
[    1.707012] ACPI: ACPI bus type pnp unregistered
[    1.715402] PCI: max bus depth: 1 pci_try_num: 2
[    1.715449] pci 0000:00:1c.0: PCI bridge to [bus 03-04]
[    1.715552] pci 0000:00:1c.1: PCI bridge to [bus 05-06]
[    1.715648] pci 0000:00:1c.1:   bridge window [io  0xe000-0xefff]
[    1.715748] pci 0000:00:1c.1:   bridge window [mem 0xf1100000-0xf11fffff 64bit pref]
[    1.715896] pci 0000:00:1c.3: PCI bridge to [bus 09-0a]
[    1.715994] pci 0000:00:1c.3:   bridge window [mem 0xf7e00000-0xf7efffff]
[    1.716094] pci 0000:00:1c.4: PCI bridge to [bus 0b-0c]
[    1.716193] pci 0000:00:1c.4:   bridge window [mem 0xf7d00000-0xf7dfffff]
[    1.716301] pci 0000:00:1c.7: PCI bridge to [bus 11-16]
[    1.716397] pci 0000:00:1c.7:   bridge window [io  0xc000-0xdfff]
[    1.716498] pci 0000:00:1c.7:   bridge window [mem 0xf6c00000-0xf7cfffff]
[    1.716596] pci 0000:00:1c.7:   bridge window [mem 0xf0000000-0xf10fffff 64bit pref]
[    1.716786] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7]
[    1.716788] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff]
[    1.716789] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff]
[    1.716791] pci_bus 0000:00: resource 7 [mem 0x000d0000-0x000d3fff]
[    1.716792] pci_bus 0000:00: resource 8 [mem 0x000d4000-0x000d7fff]
[    1.716794] pci_bus 0000:00: resource 9 [mem 0x000d8000-0x000dbfff]
[    1.716795] pci_bus 0000:00: resource 10 [mem 0x000dc000-0x000dffff]
[    1.716797] pci_bus 0000:00: resource 11 [mem 0x000e0000-0x000e3fff]
[    1.716799] pci_bus 0000:00: resource 12 [mem 0x000e4000-0x000e7fff]
[    1.716800] pci_bus 0000:00: resource 13 [mem 0xdfa00000-0xfeafffff]
[    1.716802] pci_bus 0000:00: resource 14 [mem 0xfed40000-0xfed44fff]
[    1.716804] pci_bus 0000:05: resource 0 [io  0xe000-0xefff]
[    1.716805] pci_bus 0000:05: resource 2 [mem 0xf1100000-0xf11fffff 64bit pref]
[    1.716807] pci_bus 0000:09: resource 1 [mem 0xf7e00000-0xf7efffff]
[    1.716809] pci_bus 0000:0b: resource 1 [mem 0xf7d00000-0xf7dfffff]
[    1.716810] pci_bus 0000:11: resource 0 [io  0xc000-0xdfff]
[    1.716812] pci_bus 0000:11: resource 1 [mem 0xf6c00000-0xf7cfffff]
[    1.716813] pci_bus 0000:11: resource 2 [mem 0xf0000000-0xf10fffff 64bit pref]
[    1.716864] NET: Registered protocol family 2
[    1.717215] IP route cache hash table entries: 524288 (order: 10, 4194304 bytes)
[    1.718174] TCP established hash table entries: 524288 (order: 11, 8388608 bytes)
[    1.719400] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    1.719624] TCP: Hash tables configured (established 524288 bind 65536)
[    1.719721] TCP reno registered
[    1.719829] UDP hash table entries: 8192 (order: 6, 262144 bytes)
[    1.719978] UDP-Lite hash table entries: 8192 (order: 6, 262144 bytes)
[    1.720173] NET: Registered protocol family 1
[    1.721603] pci 0000:00:02.0: Boot video device
[    1.962404] PCI: CLS 64 bytes, default 64
[    1.962463] DMAR: No ATSR found
[    1.962580] IOMMU 0 0xfed90000: using Queued invalidation
[    1.962675] IOMMU 1 0xfed91000: using Queued invalidation
[    1.962770] IOMMU: Setting RMRR:
[    1.962871] IOMMU: Setting identity map for device 0000:00:02.0 [0xdb800000 - 0xdf9fffff]
[    1.963369] IOMMU: Setting identity map for device 0000:00:1d.0 [0xdad53000 - 0xdad61fff]
[    1.963534] IOMMU: Setting identity map for device 0000:00:1a.0 [0xdad53000 - 0xdad61fff]
[    1.963688] IOMMU: Prepare 0-16MiB unity mapping for LPC
[    1.963789] IOMMU: Setting identity map for device 0000:00:1f.0 [0x0 - 0xffffff]
[    1.964222] PCI-DMA: Intel(R) Virtualization Technology for Directed I/O
[    1.967156] microcode: CPU0 sig=0x206a7, pf=0x10, revision=0x1b
[    1.967260] microcode: CPU1 sig=0x206a7, pf=0x10, revision=0x1b
[    1.967362] microcode: CPU2 sig=0x206a7, pf=0x10, revision=0x1b
[    1.967465] microcode: CPU3 sig=0x206a7, pf=0x10, revision=0x1b
[    1.967613] microcode: Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    1.968715] sha1_ssse3: Using AVX optimized SHA-1 implementation
[    1.969976] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    1.971860] DLM installed
[    1.972089] msgmni has been set to 32105
[    1.973444] NET: Registered protocol family 38
[    1.973540] async_tx: api initialized (async)
[    1.973672] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
[    1.973818] io scheduler noop registered
[    1.973910] io scheduler deadline registered
[    1.974020] io scheduler cfq registered (default)
[    1.974455] pcieport 0000:00:1c.7: irq 42 for MSI/MSI-X
[    1.974678] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    1.974862] pciehp 0000:00:1c.7:pcie04: Hotplug Controller:
[    1.974957] pciehp 0000:00:1c.7:pcie04:   Seg/Bus/Dev/Func/IRQ : 0000:00:1c.7 IRQ 42
[    1.975102] pciehp 0000:00:1c.7:pcie04:   Vendor ID            : 0x8086
[    1.975198] pciehp 0000:00:1c.7:pcie04:   Device ID            : 0x1c1e
[    1.975295] pciehp 0000:00:1c.7:pcie04:   Subsystem ID         : 0x04b3
[    1.975391] pciehp 0000:00:1c.7:pcie04:   Subsystem Vendor ID  : 0x1028
[    1.975489] pciehp 0000:00:1c.7:pcie04:   PCIe Cap offset      : 0x40
[    1.975586] pciehp 0000:00:1c.7:pcie04:   PCI resource [13]     : [io  0xc000-0xdfff]
[    1.975731] pciehp 0000:00:1c.7:pcie04:   PCI resource [14]     : [mem 0xf6c00000-0xf7cfffff]
[    1.975878] pciehp 0000:00:1c.7:pcie04:   PCI resource [15]     : [mem 0xf0000000-0xf10fffff 64bit pref]
[    1.976025] pciehp 0000:00:1c.7:pcie04: Slot Capabilities      : 0x003cb260
[    1.976123] pciehp 0000:00:1c.7:pcie04:   Physical Slot Number : 7
[    1.976220] pciehp 0000:00:1c.7:pcie04:   Attention Button     :  no
[    1.976316] pciehp 0000:00:1c.7:pcie04:   Power Controller     :  no
[    1.976412] pciehp 0000:00:1c.7:pcie04:   MRL Sensor           :  no
[    1.976508] pciehp 0000:00:1c.7:pcie04:   Attention Indicator  :  no
[    1.976604] pciehp 0000:00:1c.7:pcie04:   Power Indicator      :  no
[    1.976700] pciehp 0000:00:1c.7:pcie04:   Hot-Plug Surprise    : yes
[    1.976796] pciehp 0000:00:1c.7:pcie04:   EMI Present          :  no
[    1.976892] pciehp 0000:00:1c.7:pcie04:   Command Completed    :  no
[    1.976991] pciehp 0000:00:1c.7:pcie04: Slot Status            : 0x0000
[    1.977088] pciehp 0000:00:1c.7:pcie04: Slot Control           : 0x0000
[    1.977186] pciehp 0000:00:1c.7:pcie04: Link Active Reporting supported
[    1.977194] pciehp 0000:00:1c.7:pcie04: HPC vendor_id 8086 device_id 1c1e ss_vid 1028 ss_did 4b3
[    1.977343] pciehp 0000:00:1c.7:pcie04: Registering domain:bus:dev=0000:11:00 sun=7
[    1.977396] pciehp 0000:00:1c.7:pcie04: pciehp_get_power_status: SLOTCTRL 58 value read 28
[    1.977398] pciehp 0000:00:1c.7:pcie04: service driver pciehp loaded
[    1.977426] pciehp: pcie_port_service_register = 0
[    1.977427] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    1.977523] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.978121] intel_idle: MWAIT substates: 0x21120
[    1.978122] intel_idle: v0.4 model 0x2A
[    1.978123] intel_idle: lapic_timer_reliable_states 0xffffffff
[    1.978222] ACPI: AC Adapter [AC] (on-line)
[    1.978427] input: Lid Switch as /devices/LNXSYSTM:00/device:00/PNP0C0D:00/input/input0
[    1.979682] ACPI: Lid Switch [LID0]
[    1.979835] input: Power Button as /devices/LNXSYSTM:00/device:00/PNP0C0C:00/input/input1
[    1.979984] ACPI: Power Button [PWRB]
[    1.980130] input: Sleep Button as /devices/LNXSYSTM:00/device:00/PNP0C0E:00/input/input2
[    1.980277] ACPI: Sleep Button [SBTN]
[    1.980429] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3
[    1.980574] ACPI: Power Button [PWRF]
[    1.989206] thermal LNXTHERM:00: registered as thermal_zone0
[    1.989301] ACPI: Thermal Zone [THM] (64 C)
[    1.989522] GHES: HEST is not enabled!
[    2.012659] ACPI: Battery Slot [BAT0] (battery present)
[    2.015747] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
[    2.016654] Non-volatile memory driver v1.3
[    2.017081] i8k: unable to get SMM BIOS version
[    2.020915] Dell laptop SMM driver v1.14 21/02/2005 Massimo Dal Zotto (dz@debian.org)
[    2.021136] Linux agpgart interface v0.103
[    2.021275] agpgart-intel 0000:00:00.0: Intel Sandybridge Chipset
[    2.021452] agpgart-intel 0000:00:00.0: detected gtt size: 2097152K total, 262144K mappable
[    2.022625] agpgart-intel 0000:00:00.0: detected 65536K stolen memory
[    2.022878] agpgart-intel 0000:00:00.0: AGP aperture is 256M @ 0xe0000000
[    2.023072] ipmi message handler version 39.2
[    2.023172] Hangcheck: starting hangcheck timer 0.9.1 (tick is 180 seconds, margin is 60 seconds).
[    2.023318] Hangcheck: Using getrawmonotonic().
[    2.023452] [drm] Initialized drm 1.1.0 20060810
[    2.023561] i915 0000:00:02.0: setting latency timer to 64
[    2.057402] mtrr: type mismatch for e0000000,10000000 old: write-back new: write-combining
[    2.057549] [drm] MTRR allocation failed.  Graphics performance may suffer.
[    2.058216] i915 0000:00:02.0: irq 43 for MSI/MSI-X
[    2.058224] [drm] Supports vblank timestamp caching Rev 1 (10.10.2010).
[    2.058321] [drm] Driver supports precise vblank timestamp query.
[    2.058444] vgaarb: device changed decodes: PCI:0000:00:02.0,olddecodes=io+mem,decodes=io+mem:owns=io+mem
[    3.086096] Refined TSC clocksource calibration: 2793.654 MHz.
[    3.086194] Switching to clocksource tsc
[    3.147541] fbcon: inteldrmfb (fb0) is primary device
[    3.648956] Console: switching to colour frame buffer device 170x48
[    3.651683] fb0: inteldrmfb frame buffer device
[    3.651684] drm: registered panic notifier
[    3.652902] acpi device:34: registered as cooling_device4
[    3.653142] input: Video Bus as /devices/LNXSYSTM:00/device:00/PNP0A08:00/LNXVIDEO:00/input/input4
[    3.653192] ACPI: Video Device [GFX0] (multi-head: yes  rom: no  post: no)
[    3.653254] [drm] Initialized i915 1.6.0 20080730 for 0000:00:02.0 on minor 0
[    3.654220] loop: module loaded
[    3.654368] ahci 0000:00:1f.2: version 3.0
[    3.654415] ahci 0000:00:1f.2: irq 44 for MSI/MSI-X
[    3.654441] ahci: SSS flag set, parallel bus scan disabled
[    3.669727] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x31 impl SATA mode
[    3.669838] ahci 0000:00:1f.2: flags: 64bit ncq sntf stag pm led clo pio slum part ems sxs apst 
[    3.669880] ahci 0000:00:1f.2: setting latency timer to 64
[    3.710544] scsi0 : ahci
[    3.710684] scsi1 : ahci
[    3.710797] scsi2 : ahci
[    3.710911] scsi3 : ahci
[    3.711019] scsi4 : ahci
[    3.711126] scsi5 : ahci
[    3.711469] ata1: SATA max UDMA/133 abar m2048@0xf7f06000 port 0xf7f06100 irq 44
[    3.711504] ata2: DUMMY
[    3.712456] ata3: DUMMY
[    3.713388] ata4: DUMMY
[    3.714309] ata5: SATA max UDMA/133 abar m2048@0xf7f06000 port 0xf7f06300 irq 44
[    3.715262] ata6: SATA max UDMA/133 abar m2048@0xf7f06000 port 0xf7f06380 irq 44
[    3.716355] tun: Universal TUN/TAP device driver, 1.6
[    3.717279] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
[    3.718270] r8169 Gigabit Ethernet driver 2.3LK-NAPI loaded
[    3.719305] r8169 0000:05:00.0: irq 45 for MSI/MSI-X
[    3.719459] r8169 0000:05:00.0: eth0: RTL8168e/8111e at 0xffffc900065d2000, 18:03:73:a0:6f:6a, XID 0c200000 IRQ 45
[    3.720430] r8169 0000:05:00.0: eth0: jumbo features [frames: 9200 bytes, tx checksumming: ko]
[    3.721425] VMware vmxnet3 virtual NIC driver - version 1.1.29.0-k-NAPI
[    3.722436] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    3.723416] ehci_hcd 0000:00:1a.0: setting latency timer to 64
[    3.723420] ehci_hcd 0000:00:1a.0: EHCI Host Controller
[    3.724367] ehci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    3.725338] ehci_hcd 0000:00:1a.0: debug port 2
[    3.730133] ehci_hcd 0000:00:1a.0: cache line size of 64 is not supported
[    3.730146] ehci_hcd 0000:00:1a.0: irq 16, io mem 0xf7f08000
[    3.749582] ehci_hcd 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    3.750609] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    3.751529] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.752449] usb usb1: Product: EHCI Host Controller
[    3.753358] usb usb1: Manufacturer: Linux 3.3.2-default ehci_hcd
[    3.754277] usb usb1: SerialNumber: 0000:00:1a.0
[    3.755307] hub 1-0:1.0: USB hub found
[    3.756222] hub 1-0:1.0: 2 ports detected
[    3.757210] ehci_hcd 0000:00:1d.0: setting latency timer to 64
[    3.757213] ehci_hcd 0000:00:1d.0: EHCI Host Controller
[    3.758138] ehci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    3.759089] ehci_hcd 0000:00:1d.0: debug port 2
[    3.763896] ehci_hcd 0000:00:1d.0: cache line size of 64 is not supported
[    3.763907] ehci_hcd 0000:00:1d.0: irq 23, io mem 0xf7f07000
[    3.779536] ehci_hcd 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    3.780545] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    3.781451] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.782343] usb usb2: Product: EHCI Host Controller
[    3.783229] usb usb2: Manufacturer: Linux 3.3.2-default ehci_hcd
[    3.784117] usb usb2: SerialNumber: 0000:00:1d.0
[    3.785098] hub 2-0:1.0: USB hub found
[    3.785969] hub 2-0:1.0: 2 ports detected
[    3.786883] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    3.787817] xhci_hcd 0000:0b:00.0: xHCI Host Controller
[    3.788701] xhci_hcd 0000:0b:00.0: new USB bus registered, assigned bus number 3
[    3.789789] xhci_hcd 0000:0b:00.0: irq 16, io mem 0xf7d00000
[    3.790777] xhci_hcd 0000:0b:00.0: irq 46 for MSI/MSI-X
[    3.790782] xhci_hcd 0000:0b:00.0: irq 47 for MSI/MSI-X
[    3.790787] xhci_hcd 0000:0b:00.0: irq 48 for MSI/MSI-X
[    3.790791] xhci_hcd 0000:0b:00.0: irq 49 for MSI/MSI-X
[    3.790795] xhci_hcd 0000:0b:00.0: irq 50 for MSI/MSI-X
[    3.790893] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002
[    3.791822] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.792748] usb usb3: Product: xHCI Host Controller
[    3.793658] usb usb3: Manufacturer: Linux 3.3.2-default xhci_hcd
[    3.794591] usb usb3: SerialNumber: 0000:0b:00.0
[    3.795598] xHCI xhci_add_endpoint called for root hub
[    3.795600] xHCI xhci_check_bandwidth called for root hub
[    3.795639] hub 3-0:1.0: USB hub found
[    3.796572] hub 3-0:1.0: 2 ports detected
[    3.797538] xhci_hcd 0000:0b:00.0: xHCI Host Controller
[    3.798466] xhci_hcd 0000:0b:00.0: new USB bus registered, assigned bus number 4
[    3.799410] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003
[    3.800343] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.801256] usb usb4: Product: xHCI Host Controller
[    3.802148] usb usb4: Manufacturer: Linux 3.3.2-default xhci_hcd
[    3.803036] usb usb4: SerialNumber: 0000:0b:00.0
[    3.803974] xHCI xhci_add_endpoint called for root hub
[    3.803976] xHCI xhci_check_bandwidth called for root hub
[    3.804013] hub 4-0:1.0: USB hub found
[    3.804888] hub 4-0:1.0: 2 ports detected
[    3.805860] usbcore: registered new interface driver uas
[    3.806809] i8042: PNP: PS/2 Controller [PNP0303:KBC,PNP0f13:PS2] at 0x60,0x64 irq 1,12
[    3.809846] serio: i8042 KBD port at 0x60,0x64 irq 1
[    3.810746] serio: i8042 AUX port at 0x60,0x64 irq 12
[    3.811749] mousedev: PS/2 mouse device common for all mice
[    3.812911] rtc_cmos 00:05: RTC can wake from S4
[    3.813904] rtc_cmos 00:05: rtc core: registered rtc_cmos as rtc0
[    3.814824] rtc0: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    3.815741] i2c /dev entries driver
[    3.817237] Linux media interface: v0.10
[    3.818153] Linux video capture interface: v2.00
[    3.819070] gspca_main: v2.14.0 registered
[    3.820009] usbcore: registered new interface driver uvcvideo
[    3.820923] USB Video Class driver (1.1.1)
[    3.821936] coretemp coretemp.0: TjMax is 100 degrees C
[    3.821952] coretemp coretemp.0: TjMax is 100 degrees C
[    3.821965] coretemp coretemp.0: TjMax is 100 degrees C
[    3.821995] i2c-core: driver [max6639] using legacy suspend method
[    3.822922] i2c-core: driver [max6639] using legacy resume method
[    3.823836] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.07
[    3.824831] iTCO_wdt: Found a Cougar Point TCO device (Version=2, TCOBASE=0x0460)
[    3.825799] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0)
[    3.826720] iTCO_vendor_support: vendor-support=0
[    3.827003] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input5
[    3.828616] md: linear personality registered for level -1
[    3.829581] md: raid0 personality registered for level 0
[    3.830535] md: raid1 personality registered for level 1
[    3.831472] md: raid10 personality registered for level 10
[    3.832403] md: raid6 personality registered for level 6
[    3.833331] md: raid5 personality registered for level 5
[    3.834243] md: raid4 personality registered for level 4
[    3.835192] device-mapper: uevent: version 1.0.3
[    3.836157] device-mapper: ioctl: 4.22.0-ioctl (2011-10-19) initialised: dm-devel@redhat.com
[    3.837138] device-mapper: dm-log-userspace: version 1.1.0 loaded
[    3.838088] usbcore: registered new interface driver btusb
[    3.839078] cpuidle: using governor ladder
[    3.840109] cpuidle: using governor menu
[    3.841070] sdhci: Secure Digital Host Controller Interface driver
[    3.841988] sdhci: Copyright(c) Pierre Ossman
[    3.843547] dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.2)
[    3.845358] usbcore: registered new interface driver usbhid
[    3.846282] usbhid: USB HID core driver
[    3.847269] mei 0000:00:16.0: setting latency timer to 64
[    3.847316] mei 0000:00:16.0: irq 51 for MSI/MSI-X
[    3.874899] input: Dell WMI hotkeys as /devices/virtual/input/input6
[    3.886054] intel_oaktrail: Platform not recognized (You could try the module's force-parameter)
[    3.886265] snd_hda_intel 0000:00:1b.0: irq 52 for MSI/MSI-X
[    4.059178] ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[    4.065643] ata1.00: ACPI cmd 00/00:00:00:00:00:a0 (NOP) rejected by device (Stat=0x51 Err=0x04)
[    4.066975] ata1.00: ATA-8: WDC WD7500BPKT-75PK4T0, 01.01A01, max UDMA/133
[    4.068028] ata1.00: 1465149168 sectors, multi 16: LBA48 NCQ (depth 31/32), AA
[    4.069133] usb 1-1: new high-speed USB device number 2 using ehci_hcd
[    4.074032] ata1.00: ACPI cmd 00/00:00:00:00:00:a0 (NOP) rejected by device (Stat=0x51 Err=0x04)
[    4.075380] ata1.00: configured for UDMA/133
[    4.089322] scsi 0:0:0:0: Direct-Access     ATA      WDC WD7500BPKT-7 01.0 PQ: 0 ANSI: 5
[    4.090982] sd 0:0:0:0: [sda] 1465149168 512-byte logical blocks: (750 GB/698 GiB)
[    4.092020] sd 0:0:0:0: [sda] 4096-byte physical blocks
[    4.093188] sd 0:0:0:0: [sda] Write Protect is off
[    4.093198] sd 0:0:0:0: Attached scsi generic sg0 type 0
[    4.095217] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    4.095271] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    4.192104]  sda: sda1 sda2 sda3 sda4 < sda5 sda6 >
[    4.194227] sd 0:0:0:0: [sda] Attached SCSI disk
[    4.219324] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    4.220424] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    4.222038] hub 1-1:1.0: USB hub found
[    4.223188] hub 1-1:1.0: 6 ports detected
[    4.338875] usb 2-1: new high-speed USB device number 2 using ehci_hcd
[    4.438601] ata5: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[    4.443006] ata5.00: ATAPI: PLDS DVD+/-RW DS-8A8SH, KD11, max UDMA/100
[    4.449817] ata5.00: configured for UDMA/100
[    4.457853] scsi 4:0:0:0: CD-ROM            PLDS     DVD+-RW DS-8A8SH KD11 PQ: 0 ANSI: 5
[    4.467362] sr0: scsi3-mmc drive: 24x/24x writer dvd-ram cd/rw xa/form2 cdda tray
[    4.468497] cdrom: Uniform CD-ROM driver Revision: 3.20
[    4.469899] sr 4:0:0:0: Attached scsi CD-ROM sr0
[    4.470047] sr 4:0:0:0: Attached scsi generic sg1 type 5
[    4.488920] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
[    4.490041] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    4.491691] hub 2-1:1.0: USB hub found
[    4.492910] hub 2-1:1.0: 8 ports detected
[    4.499854] input: HDA Digital PCBeep as /devices/pci0000:00/0000:00:1b.0/input/input7
[    4.520063] HDMI hot plug event: Codec=3 Pin=5 Presence_Detect=1 ELD_Valid=1
[    4.521142] HDMI status: Codec=3 Pin=5 Presence_Detect=1 ELD_Valid=1
[    4.522217] HDMI status: Codec=3 Pin=5 Presence_Detect=1 ELD_Valid=1
[    4.525800] HDMI: detected monitor PLB2403WS at connection type HDMI
[    4.526871] HDMI: available speakers: FL/FR
[    4.527941] HDMI: supports coding type LPCM: channels = 2, rates = 32000 44100 48000, bits = 24
[    4.529026] HDMI hot plug event: Codec=3 Pin=5 Presence_Detect=1 ELD_Valid=1
[    4.530174] HDMI status: Codec=3 Pin=5 Presence_Detect=1 ELD_Valid=1
[    4.537866] HDMI: detected monitor PLB2403WS at connection type HDMI
[    4.537949] HDMI: detected monitor PLB2403WS at connection type HDMI
[    4.537950] HDMI: available speakers: FL/FR
[    4.537952] HDMI: supports coding type LPCM: channels = 2, rates = 32000 44100 48000, bits = 24
[    4.542110] HDMI: available speakers: FL/FR
[    4.543152] HDMI: supports coding type LPCM: channels = 2, rates = 32000 44100 48000, bits = 24
[    4.544326] input: HDA Intel PCH HDMI/DP,pcm=3 as /devices/pci0000:00/0000:00:1b.0/sound/card0/input8
[    4.545525] input: HDA Intel PCH Mic as /devices/pci0000:00/0000:00:1b.0/sound/card0/input9
[    4.546706] input: HDA Intel PCH Headphone as /devices/pci0000:00/0000:00:1b.0/sound/card0/input10
[    4.548455] ALSA device list:
[    4.549534]   #0: HDA Intel PCH at 0xf7f00000 irq 52
[    4.550617] TCP cubic registered
[    4.551656] NET: Registered protocol family 17
[    4.552817] Bluetooth: RFCOMM TTY layer initialized
[    4.553880] Bluetooth: RFCOMM socket layer initialized
[    4.554947] Bluetooth: RFCOMM ver 1.11
[    4.555955] Bluetooth: BNEP (Ethernet Emulation) ver 1.3
[    4.556996] Bluetooth: BNEP filters: protocol multicast
[    4.558003] Bluetooth: HIDP (Human Interface Emulation) ver 1.2
[    4.559462] sctp: Hash tables configured (established 65536 bind 65536)
[    4.560698] Registering the dns_resolver key type
[    4.562179] PM: Checking hibernation image partition /dev/sda6
[    4.562184] PM: Hibernation image partition 8:6 present
[    4.562186] PM: Looking for hibernation image.
[    4.598431] PM: Image not found (code -22)
[    4.598438] PM: Hibernation image not present or could not be loaded.
[    4.598464] registered taskstats version 1
[    4.600656] rtc_cmos 00:05: setting system clock to 2012-04-18 16:01:36 UTC (1334764896)
[    4.602603] BIOS EDD facility v0.16 2004-Jun-25, 1 devices found
[    4.608342] usb 3-1: new low-speed USB device number 2 using xhci_hcd
[    4.662315] usb 3-1: New USB device found, idVendor=046d, idProduct=c050
[    4.663291] usb 3-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    4.664163] usb 3-1: Product: USB-PS/2 Optical Mouse
[    4.665044] usb 3-1: Manufacturer: Logitech
[    4.666108] usb 3-1: ep 0x81 - rounding interval to 64 microframes, ep desc says 80 microframes
[    4.683576] input: Logitech USB-PS/2 Optical Mouse as /devices/pci0000:00/0000:00:1c.4/0000:0b:00.0/usb3/3-1/3-1:1.0/input/input11
[    4.684923] generic-usb 0003:046D:C050.0001: input,hidraw0: USB HID v1.10 Mouse [Logitech USB-PS/2 Optical Mouse] on usb-0000:0b:00.0-1/input0
[    4.758284] usb 1-1.5: new high-speed USB device number 3 using ehci_hcd
[    4.808548] input: DualPoint Stick as /devices/platform/i8042/serio1/input/input12
[    4.818027] ata6: SATA link down (SStatus 0 SControl 300)
[    4.823260] input: AlpsPS/2 ALPS DualPoint TouchPad as /devices/platform/i8042/serio1/input/input13
[    4.827179] md: Waiting for all devices to be available before autodetect
[    4.828185] md: If you don't use raid, use raid=noautodetect
[    4.829524] md: Autodetecting RAID arrays.
[    4.830520] md: Scanned 0 and added 0 devices.
[    4.831504] md: autorun ...
[    4.832463] md: ... autorun DONE.
[    4.875541] usb 1-1.5: New USB device found, idVendor=05ca, idProduct=1820
[    4.876590] usb 1-1.5: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    4.877552] usb 1-1.5: Product: Laptop_Integrated_Webcam_FHD
[    4.878517] usb 1-1.5: Manufacturer: CN01MWM9724871A4KB28A00
[    4.880518] uvcvideo: Found UVC 1.00 device Laptop_Integrated_Webcam_FHD (05ca:1820)
[    4.883488] input: Laptop_Integrated_Webcam_FHD as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.5/1-1.5:1.0/input/input14
[    4.899587] kjournald starting.  Commit interval 5 seconds
[    4.899817] EXT3-fs (sda5): mounted filesystem with writeback data mode
[    4.899824] VFS: Mounted root (ext3 filesystem) readonly on device 8:5.
[    4.948915] devtmpfs: mounted
[    4.950050] Freeing unused kernel memory: 544k freed
[    4.957983] usb 2-1.2: new low-speed USB device number 3 using ehci_hcd
[    5.076369] usb 2-1.2: New USB device found, idVendor=04f2, idProduct=0116
[    5.077419] usb 2-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    5.078382] usb 2-1.2: Product: USB Keyboard
[    5.079312] usb 2-1.2: Manufacturer: CHICONY
[    5.085522] input: CHICONY USB Keyboard as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.2/2-1.2:1.0/input/input15
[    5.086699] generic-usb 0003:04F2:0116.0002: input,hidraw1: USB HID v1.10 Keyboard [CHICONY USB Keyboard] on usb-0000:00:1d.0-1.2/input0
[    5.167664] usb 2-1.3: new full-speed USB device number 4 using ehci_hcd
[    5.278997] usb 2-1.3: New USB device found, idVendor=138a, idProduct=0011
[    5.280085] usb 2-1.3: New USB device strings: Mfr=0, Product=0, SerialNumber=1
[    5.281070] usb 2-1.3: SerialNumber: 56ed5821afe2
[    5.357379] usb 2-1.6: new high-speed USB device number 5 using ehci_hcd
[    5.723209] usb 2-1.6: New USB device found, idVendor=0bda, idProduct=0138
[    5.724294] usb 2-1.6: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    5.725279] usb 2-1.6: Product: USB2.0-CRW
[    5.726276] usb 2-1.6: Manufacturer: Generic
[    5.727277] usb 2-1.6: SerialNumber: 20090516388200000
[    8.361452] udevd[1759]: starting version 171
[   10.938763] ACPI Warning: 0x000000000000f040-0x000000000000f05f SystemIO conflicts with Region \_SB_.PCI0.SBUS.SMBI 1 (20120111/utaddress-251)
[   10.938769] ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
[   11.796381] Initializing USB Mass Storage driver...
[   11.796478] scsi6 : usb-storage 2-1.6:1.0
[   11.796557] usbcore: registered new interface driver usb-storage
[   11.796560] USB Mass Storage support registered.
[   11.867354] Intel(R) Wireless WiFi Link AGN driver for Linux, in-tree:d
[   11.867356] Copyright(c) 2003-2011 Intel Corporation
[   11.867495] iwlwifi 0000:09:00.0: pci_resource_len = 0x00002000
[   11.867497] iwlwifi 0000:09:00.0: pci_resource_base = ffffc90006684000
[   11.867499] iwlwifi 0000:09:00.0: HW Revision ID = 0x34
[   11.867595] iwlwifi 0000:09:00.0: irq 53 for MSI/MSI-X
[   11.867629] iwlwifi 0000:09:00.0: CONFIG_IWLWIFI_DEBUG enabled
[   11.867630] iwlwifi 0000:09:00.0: CONFIG_IWLWIFI_DEBUGFS disabled
[   11.867631] iwlwifi 0000:09:00.0: CONFIG_IWLWIFI_DEVICE_TRACING disabled
[   11.867633] iwlwifi 0000:09:00.0: CONFIG_IWLWIFI_DEVICE_TESTMODE disabled
[   11.867634] iwlwifi 0000:09:00.0: CONFIG_IWLWIFI_P2P disabled
[   11.867640] iwlwifi 0000:09:00.0: Detected Intel(R) Centrino(R) Wireless-N 1030 BGN, REV=0xB0
[   11.867708] iwlwifi 0000:09:00.0: L1 Disabled; Enabling L0S
[   11.884825] iwlwifi 0000:09:00.0: device EEPROM VER=0x71a, CALIB=0x6
[   11.884826] iwlwifi 0000:09:00.0: Device SKU: 0x150
[   11.884828] iwlwifi 0000:09:00.0: Valid Tx ant: 0x1, Valid Rx ant: 0x3
[   11.884837] iwlwifi 0000:09:00.0: Tunable channels: 13 802.11bg, 0 802.11a channels
[   11.884976] iwlwifi 0000:09:00.0: RF_KILL bit toggled to disable radio.
[   12.035535] iwlwifi 0000:09:00.0: loaded firmware version 17.168.5.2 build 35905
[   12.035642] Registered led device: phy0-led
[   12.035704] ieee80211 phy0: Selected rate control algorithm 'iwl-agn-rs'
[   12.781795] EXT3-fs (sda5): using internal journal
[   12.789361] scsi 6:0:0:0: Direct-Access     Generic- Multi-Card       1.00 PQ: 0 ANSI: 0 CCS
[   12.789497] sd 6:0:0:0: Attached scsi generic sg2 type 0
[   12.979352] Adding 4998972k swap on /dev/sda6.  Priority:-1 extents:1 across:4998972k 
[   16.520207] r8169 0000:05:00.0: eth0: unable to load firmware patch rtl_nic/rtl8168e-2.fw (-2)
[   16.544277] r8169 0000:05:00.0: eth0: link down
[   16.544283] r8169 0000:05:00.0: eth0: link down
[   18.705548] r8169 0000:05:00.0: eth0: link up
[   19.961996] sd 6:0:0:0: [sdb] Attached SCSI removable disk
[   23.555074] microcode: CPU0 updated to revision 0x25, date = 2011-10-11
[   23.555444] microcode: CPU1 updated to revision 0x25, date = 2011-10-11
[   23.555798] microcode: CPU2 updated to revision 0x25, date = 2011-10-11
[   23.556169] microcode: CPU3 updated to revision 0x25, date = 2011-10-11
[   24.030001] [drm] Changing LVDS panel from (+hsync, -vsync) to (-hsync, -vsync)
[   24.271868] HDMI hot plug event: Codec=3 Pin=5 Presence_Detect=0 ELD_Valid=1
[   24.271925] HDMI status: Codec=3 Pin=5 Presence_Detect=0 ELD_Valid=0
[   24.488888] HDMI hot plug event: Codec=3 Pin=5 Presence_Detect=1 ELD_Valid=1
[   24.488933] HDMI status: Codec=3 Pin=5 Presence_Detect=1 ELD_Valid=1
[   24.788284] HDMI status: Codec=3 Pin=5 Presence_Detect=1 ELD_Valid=1
[   24.791790] HDMI: detected monitor PLB2403WS at connection type HDMI
[   24.791792] HDMI: available speakers: FL/FR
[   24.791794] HDMI: supports coding type LPCM: channels = 2, rates = 32000 44100 48000, bits = 24
[   25.523579] r8169 0000:05:00.0: eth0: link down
[   28.481778] r8169 0000:05:00.0: eth0: link up
[   48.293857] [drm] Changing LVDS panel from (-hsync, -vsync) to (+hsync, -vsync)
[   48.537518] HDMI hot plug event: Codec=3 Pin=5 Presence_Detect=0 ELD_Valid=1
[   48.537554] HDMI status: Codec=3 Pin=5 Presence_Detect=0 ELD_Valid=0
[   48.752748] HDMI hot plug event: Codec=3 Pin=5 Presence_Detect=1 ELD_Valid=1
[   48.752793] HDMI status: Codec=3 Pin=5 Presence_Detect=1 ELD_Valid=1
[   49.052127] HDMI status: Codec=3 Pin=5 Presence_Detect=1 ELD_Valid=1
[   49.055652] HDMI: detected monitor PLB2403WS at connection type HDMI
[   49.055654] HDMI: available speakers: FL/FR
[   49.055656] HDMI: supports coding type LPCM: channels = 2, rates = 32000 44100 48000, bits = 24
[   49.891069] HDMI hot plug event: Codec=3 Pin=5 Presence_Detect=0 ELD_Valid=1
[   49.891114] HDMI status: Codec=3 Pin=5 Presence_Detect=0 ELD_Valid=0
[   50.050912] HDMI hot plug event: Codec=3 Pin=5 Presence_Detect=1 ELD_Valid=1
[   50.050968] HDMI status: Codec=3 Pin=5 Presence_Detect=1 ELD_Valid=1
[   50.350183] HDMI status: Codec=3 Pin=5 Presence_Detect=1 ELD_Valid=1
[   50.353690] HDMI: detected monitor PLB2403WS at connection type HDMI
[   50.353694] HDMI: available speakers: FL/FR
[   50.353697] HDMI: supports coding type LPCM: channels = 2, rates = 32000 44100 48000, bits = 24
[   52.912322] ata1.00: configured for UDMA/133
[   52.912325] ata1: EH complete
[   90.627674] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4050000 action 0xe frozen
[   90.627678] ata6: irq_stat 0x00400040, connection status changed
[   90.627682] ata6: SError: { PHYRdyChg CommWake DevExch }
[   90.627690] ata6: hard resetting link
[   96.401640] ata6: link is slow to respond, please be patient (ready=0)
[   97.959329] ata6: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[   98.177189] ata6.00: ATA-8: WDC WD10TPVT-00HT5T0, 01.01A01, max UDMA/133
[   98.177199] ata6.00: 1953525168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
[   98.183134] ata6.00: configured for UDMA/133
[   98.198960] ata6: EH complete
[   98.199115] scsi 5:0:0:0: Direct-Access     ATA      WDC WD10TPVT-00H 01.0 PQ: 0 ANSI: 5
[   98.199238] sd 5:0:0:0: [sdc] 1953525168 512-byte logical blocks: (1.00 TB/931 GiB)
[   98.199265] sd 5:0:0:0: Attached scsi generic sg3 type 0
[   98.199309] sd 5:0:0:0: [sdc] Write Protect is off
[   98.199312] sd 5:0:0:0: [sdc] Mode Sense: 00 3a 00 00
[   98.199376] sd 5:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   98.204428]  sdc: sdc1
[   98.204785] sd 5:0:0:0: [sdc] Attached SCSI disk
[  118.094916] kjournald starting.  Commit interval 5 seconds
[  118.095572] EXT3-fs (sdc1): using internal journal
[  118.095580] EXT3-fs (sdc1): mounted filesystem with writeback data mode
[ 3155.563123] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4090000 action 0xe frozen
[ 3155.563132] ata6: irq_stat 0x00400040, connection status changed
[ 3155.563141] ata6: SError: { PHYRdyChg 10B8B DevExch }
[ 3155.563157] ata6: hard resetting link
[ 3156.306517] ata6: SATA link down (SStatus 0 SControl 300)
[ 3161.299061] ata6: hard resetting link
[ 3161.648549] ata6: SATA link down (SStatus 0 SControl 300)
[ 3161.648567] ata6: limiting SATA link speed to 1.5 Gbps
[ 3166.641111] ata6: hard resetting link
[ 3166.990595] ata6: SATA link down (SStatus 0 SControl 310)
[ 3166.990611] ata6.00: disabled
[ 3167.010556] ata6: EH complete
[ 3167.010576] ata6.00: detaching (SCSI 5:0:0:0)
[ 3167.011128] sd 5:0:0:0: [sdc] Synchronizing SCSI cache
[ 3167.011153] sd 5:0:0:0: [sdc]  Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
[ 3167.011157] sd 5:0:0:0: [sdc] Stopping disk
[ 3167.011164] sd 5:0:0:0: [sdc] START_STOP FAILED
[ 3167.011166] sd 5:0:0:0: [sdc]  Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
[ 3491.087950] ata6: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[ 3491.343510] ata6.00: ATA-8: ST3000DM001-9YN166, CC4C, max UDMA/133
[ 3491.343520] ata6.00: 5860533168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
[ 3491.344372] ata6.00: configured for UDMA/133
[ 3491.357767] scsi 5:0:0:0: Direct-Access     ATA      ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 5
[ 3491.357905] sd 5:0:0:0: [sdc] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
[ 3491.357907] sd 5:0:0:0: [sdc] 4096-byte physical blocks
[ 3491.357974] sd 5:0:0:0: [sdc] Write Protect is off
[ 3491.357978] sd 5:0:0:0: [sdc] Mode Sense: 00 3a 00 00
[ 3491.358000] sd 5:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 3491.358068] sd 5:0:0:0: Attached scsi generic sg3 type 0
[ 3491.391882]  sdc: sdc1
[ 3491.392269] sd 5:0:0:0: [sdc] Attached SCSI disk

^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-18 17:10         ` Martin Mokrejs
@ 2012-04-18 17:29           ` Jeff Garzik
  2012-04-18 17:44             ` Martin Mokrejs
  2012-05-19 23:58             ` [PATCH 3.3.y] libata: forbid port runtime pm by default, fixing regression Jonathan Nieder
  0 siblings, 2 replies; 37+ messages in thread
From: Jeff Garzik @ 2012-04-18 17:29 UTC (permalink / raw)
  To: Martin Mokrejs; +Cc: cwillu, Mark Lord, Tejun Heo, IDE/ATA development list

On 04/18/2012 01:10 PM, Martin Mokrejs wrote:
> Fix: I got my 3TB disk detected by this single command:
>
> # echo on>   /sys/devices/pci0000:00/0000:00:1f.2/ata6/power/control
> #
>
> This is a Dell Vostro 3550 with A09 BIOS. Same happend with 3.4-rc3 kernel.
>
> I can do some more testing if you want me to.
> Best,
> Martin


Can you test this one-line patch from Lin Ming?  Hopefully there is zero 
sysfs twiddling required with this one...

--- a/drivers/ata/libata-transport.c
+++ b/drivers/ata/libata-transport.c
@@ -294,6 +294,7 @@ int ata_tport_add(struct device *parent,
  	device_enable_async_suspend(dev);
  	pm_runtime_set_active(dev);
  	pm_runtime_enable(dev);
+	pm_runtime_forbid(dev);

  	transport_add_device(dev);
  	transport_configure_device(dev);



^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-18 17:29           ` Jeff Garzik
@ 2012-04-18 17:44             ` Martin Mokrejs
  2012-04-18 18:23               ` Martin Mokrejs
  2012-04-18 18:32               ` Martin Mokrejs
  2012-05-19 23:58             ` [PATCH 3.3.y] libata: forbid port runtime pm by default, fixing regression Jonathan Nieder
  1 sibling, 2 replies; 37+ messages in thread
From: Martin Mokrejs @ 2012-04-18 17:44 UTC (permalink / raw)
  To: Jeff Garzik
  Cc: Martin Mokrejs, cwillu, Mark Lord, Tejun Heo,
	IDE/ATA development list



Jeff Garzik wrote:
> On 04/18/2012 01:10 PM, Martin Mokrejs wrote:
>> Fix: I got my 3TB disk detected by this single command:
>>
>> # echo on>   /sys/devices/pci0000:00/0000:00:1f.2/ata6/power/control
>> #
>>
>> This is a Dell Vostro 3550 with A09 BIOS. Same happend with 3.4-rc3 kernel.
>>
>> I can do some more testing if you want me to.
>> Best,
>> Martin
> 
> 
> Can you test this one-line patch from Lin Ming?  Hopefully there is zero sysfs twiddling required with this one...
> 
> --- a/drivers/ata/libata-transport.c
> +++ b/drivers/ata/libata-transport.c
> @@ -294,6 +294,7 @@ int ata_tport_add(struct device *parent,
>      device_enable_async_suspend(dev);
>      pm_runtime_set_active(dev);
>      pm_runtime_enable(dev);
> +    pm_runtime_forbid(dev);
> 
>      transport_add_device(dev);
>      transport_configure_device(dev);

Works! (the src tree has some pcieh patches so can re-test in a while on vanilla kernel
sources if you want me to confirm that). Just too many patches to try. ;-)

[cut]
[   19.629276] EXT3-fs (sda5): using internal journal
[   19.894238] Adding 4998972k swap on /dev/sda6.  Priority:-1 extents:1 across:4998972k 
[   25.615229] r8169 0000:05:00.0: eth0: unable to load firmware patch rtl_nic/rtl8168e-2.fw (-2)
[   25.638382] r8169 0000:05:00.0: eth0: link down
[   25.638413] r8169 0000:05:00.0: eth0: link down
[   27.396716] r8169 0000:05:00.0: eth0: link up
[   31.405068] microcode: CPU0 updated to revision 0x25, date = 2011-10-11
[   31.405417] microcode: CPU1 updated to revision 0x25, date = 2011-10-11
[   31.405747] microcode: CPU2 updated to revision 0x25, date = 2011-10-11
[   31.406086] microcode: CPU3 updated to revision 0x25, date = 2011-10-11
[   31.566473] [drm] Changing LVDS panel from (+hsync, -vsync) to (-hsync, -vsync)
[   33.296080] r8169 0000:05:00.0: eth0: link down
[   35.674572] r8169 0000:05:00.0: eth0: link up
[   41.896276] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4050000 action 0xe frozen
[   41.896285] ata6: irq_stat 0x00400040, connection status changed
[   41.896293] ata6: SError: { PHYRdyChg CommWake DevExch }
[   41.896313] ata6: hard resetting link
[   42.639279] ata6: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[   42.681085] ata6.00: ATA-8: WDC WD10TPVT-00HT5T0, 01.01A01, max UDMA/133
[   42.681096] ata6.00: 1953525168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
[   42.686541] ata6.00: configured for UDMA/133
[   42.686560] ata6: EH complete
[   42.686706] scsi 5:0:0:0: Direct-Access     ATA      WDC WD10TPVT-00H 01.0 PQ: 0 ANSI: 5
[   42.686833] sd 5:0:0:0: [sdc] 1953525168 512-byte logical blocks: (1.00 TB/931 GiB)
[   42.686959] sd 5:0:0:0: [sdc] Write Protect is off
[   42.686961] sd 5:0:0:0: [sdc] Mode Sense: 00 3a 00 00
[   42.686992] sd 5:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   42.687000] sd 5:0:0:0: Attached scsi generic sg3 type 0
[   42.696794]  sdc: sdc1
[   42.697115] sd 5:0:0:0: [sdc] Attached SCSI disk
[   56.259694] [drm] Changing LVDS panel from (-hsync, -vsync) to (+hsync, -vsync)
[   61.127682] ata1.00: configured for UDMA/133
[   61.127685] ata1: EH complete
[   61.277874] ata6.00: configured for UDMA/133
[   61.277878] ata6: EH complete
[   98.163139] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4090000 action 0xe frozen
[   98.163148] ata6: irq_stat 0x00400040, connection status changed
[   98.163156] ata6: SError: { PHYRdyChg 10B8B DevExch }
[   98.163173] ata6: hard resetting link
[   98.905476] ata6: SATA link down (SStatus 0 SControl 300)
[  103.898017] ata6: hard resetting link
[  104.247521] ata6: SATA link down (SStatus 0 SControl 300)
[  104.247540] ata6: limiting SATA link speed to 1.5 Gbps
[  109.240197] ata6: hard resetting link
[  109.589549] ata6: SATA link down (SStatus 0 SControl 310)
[  109.589568] ata6.00: disabled
[  109.609519] ata6: EH complete
[  109.609543] ata6.00: detaching (SCSI 5:0:0:0)
[  109.610027] sd 5:0:0:0: [sdc] Synchronizing SCSI cache
[  109.610058] sd 5:0:0:0: [sdc]  Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
[  109.610062] sd 5:0:0:0: [sdc] Stopping disk
[  109.610070] sd 5:0:0:0: [sdc] START_STOP FAILED
[  109.610072] sd 5:0:0:0: [sdc]  Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
[  140.043217] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4050002 action 0xe frozen
[  140.043226] ata6: irq_stat 0x00400040, connection status changed
[  140.043234] ata6: SError: { RecovComm PHYRdyChg CommWake DevExch }
[  140.043253] ata6: limiting SATA link speed to 1.5 Gbps
[  140.043261] ata6: hard resetting link
[  141.322298] ata6: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
[  141.332583] ata6.00: ATA-8: ST3000DM001-9YN166, CC4C, max UDMA/133
[  141.332593] ata6.00: 5860533168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
[  141.333407] ata6.00: configured for UDMA/133
[  141.352233] ata6: EH complete
[  141.352384] scsi 5:0:0:0: Direct-Access     ATA      ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 5
[  141.352518] sd 5:0:0:0: [sdc] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
[  141.352521] sd 5:0:0:0: [sdc] 4096-byte physical blocks
[  141.352540] sd 5:0:0:0: Attached scsi generic sg3 type 0
[  141.352575] sd 5:0:0:0: [sdc] Write Protect is off
[  141.352578] sd 5:0:0:0: [sdc] Mode Sense: 00 3a 00 00
[  141.352601] sd 5:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[  141.400394]  sdc: sdc1
[  141.400833] sd 5:0:0:0: [sdc] Attached SCSI disk

Martin

^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-18 17:44             ` Martin Mokrejs
@ 2012-04-18 18:23               ` Martin Mokrejs
  2012-04-18 18:32               ` Martin Mokrejs
  1 sibling, 0 replies; 37+ messages in thread
From: Martin Mokrejs @ 2012-04-18 18:23 UTC (permalink / raw)
  To: Jeff Garzik; +Cc: cwillu, Mark Lord, Tejun Heo, IDE/ATA development list

Martin Mokrejs wrote:
> 
> 
> Jeff Garzik wrote:
>> On 04/18/2012 01:10 PM, Martin Mokrejs wrote:
>>> Fix: I got my 3TB disk detected by this single command:
>>>
>>> # echo on>   /sys/devices/pci0000:00/0000:00:1f.2/ata6/power/control
>>> #
>>>
>>> This is a Dell Vostro 3550 with A09 BIOS. Same happend with 3.4-rc3 kernel.
>>>
>>> I can do some more testing if you want me to.
>>> Best,
>>> Martin
>>
>>
>> Can you test this one-line patch from Lin Ming?  Hopefully there is zero sysfs twiddling required with this one...
>>
>> --- a/drivers/ata/libata-transport.c
>> +++ b/drivers/ata/libata-transport.c
>> @@ -294,6 +294,7 @@ int ata_tport_add(struct device *parent,
>>      device_enable_async_suspend(dev);
>>      pm_runtime_set_active(dev);
>>      pm_runtime_enable(dev);
>> +    pm_runtime_forbid(dev);
>>
>>      transport_add_device(dev);
>>      transport_configure_device(dev);
> 
> Works! (the src tree has some pcieh patches so can re-test in a while on vanilla kernel
> sources if you want me to confirm that). Just too many patches to try. ;-)

Just confirming that it fixed even plain 3.4-rc3 as well.

Martin

^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-18 17:44             ` Martin Mokrejs
  2012-04-18 18:23               ` Martin Mokrejs
@ 2012-04-18 18:32               ` Martin Mokrejs
  2012-04-19  1:31                 ` Lin Ming
       [not found]                 ` <CAF1ivSYqzjv10F+sdYkR_jdTZvzKP1=_ZwgNDj2njnmb6uaenA@mail.gmail.com>
  1 sibling, 2 replies; 37+ messages in thread
From: Martin Mokrejs @ 2012-04-18 18:32 UTC (permalink / raw)
  To: Jeff Garzik; +Cc: cwillu, Mark Lord, Tejun Heo, IDE/ATA development list

Martin Mokrejs wrote:
> 
> 
> Jeff Garzik wrote:
>> On 04/18/2012 01:10 PM, Martin Mokrejs wrote:
>>> Fix: I got my 3TB disk detected by this single command:
>>>
>>> # echo on>   /sys/devices/pci0000:00/0000:00:1f.2/ata6/power/control
>>> #
>>>
>>> This is a Dell Vostro 3550 with A09 BIOS. Same happend with 3.4-rc3 kernel.
>>>
>>> I can do some more testing if you want me to.
>>> Best,
>>> Martin
>>
>>
>> Can you test this one-line patch from Lin Ming?  Hopefully there is zero sysfs twiddling required with this one...
>>
>> --- a/drivers/ata/libata-transport.c
>> +++ b/drivers/ata/libata-transport.c
>> @@ -294,6 +294,7 @@ int ata_tport_add(struct device *parent,
>>      device_enable_async_suspend(dev);
>>      pm_runtime_set_active(dev);
>>      pm_runtime_enable(dev);
>> +    pm_runtime_forbid(dev);
>>
>>      transport_add_device(dev);
>>      transport_configure_device(dev);


There is one more minor issue. I cannot get my disk re-dectected at 3Gbps. Here is when I plugged it in
for the very first time after bootup (plain 3.4-rc3 with the above one-line fix):

[  146.876489] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4050000 action 0xe frozen
[  146.876499] ata6: irq_stat 0x00400040, connection status changed
[  146.876508] ata6: SError: { PHYRdyChg CommWake DevExch }
[  146.876527] ata6: hard resetting link
[  147.619956] ata6: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[  147.869349] ata6.00: ATA-8: ST3000DM001-9YN166, CC4C, max UDMA/133
[  147.869360] ata6.00: 5860533168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
[  147.870126] ata6.00: configured for UDMA/133
[  147.870131] ata6: EH complete
[  147.870220] scsi 5:0:0:0: Direct-Access     ATA      ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 5
[  147.870391] sd 5:0:0:0: [sdc] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
[  147.870393] sd 5:0:0:0: [sdc] 4096-byte physical blocks
[  147.870396] sd 5:0:0:0: Attached scsi generic sg3 type 0
[  147.870434] sd 5:0:0:0: [sdc] Write Protect is off
[  147.870436] sd 5:0:0:0: [sdc] Mode Sense: 00 3a 00 00
[  147.870460] sd 5:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[  147.904848]  sdc: sdc1
[  147.905196] sd 5:0:0:0: [sdc] Attached SCSI disk


Here is what happens on re-plug of the device. It is a 3.5" drive and the line
[  617.838013] ata6: hard resetting link
happens too early. I can hear the drive is still spinning up, it can't be ready yet.
I think the delay should be increased.


[  617.837966] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4050002 action 0xe frozen
[  617.837976] ata6: irq_stat 0x00400040, connection status changed
[  617.837984] ata6: SError: { RecovComm PHYRdyChg CommWake DevExch }
[  617.838004] ata6: limiting SATA link speed to 1.5 Gbps
[  617.838013] ata6: hard resetting link
[  623.610941] ata6: link is slow to respond, please be patient (ready=0)
[  627.864604] ata6: COMRESET failed (errno=-16)
[  627.864615] ata6: hard resetting link
[  629.931538] ata6: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
[  629.932355] ata6.00: ATA-8: ST3000DM001-9YN166, CC4C, max UDMA/133
[  629.932365] ata6.00: 5860533168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
[  629.933170] ata6.00: configured for UDMA/133
[  629.951629] ata6: EH complete
[  629.951700] scsi 5:0:0:0: Direct-Access     ATA      ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 5
[  629.951816] sd 5:0:0:0: [sdc] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
[  629.951819] sd 5:0:0:0: [sdc] 4096-byte physical blocks
[  629.951842] sd 5:0:0:0: Attached scsi generic sg3 type 0
[  629.951875] sd 5:0:0:0: [sdc] Write Protect is off
[  629.951877] sd 5:0:0:0: [sdc] Mode Sense: 00 3a 00 00
[  629.951901] sd 5:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[  629.995970]  sdc: sdc1
[  629.996359] sd 5:0:0:0: [sdc] Attached SCSI disk


Martin


^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-18 18:32               ` Martin Mokrejs
@ 2012-04-19  1:31                 ` Lin Ming
       [not found]                 ` <CAF1ivSYqzjv10F+sdYkR_jdTZvzKP1=_ZwgNDj2njnmb6uaenA@mail.gmail.com>
  1 sibling, 0 replies; 37+ messages in thread
From: Lin Ming @ 2012-04-19  1:31 UTC (permalink / raw)
  To: Martin Mokrejs
  Cc: Jeff Garzik, cwillu, Mark Lord, Tejun Heo,
	IDE/ATA development list

On Thu, Apr 19, 2012 at 2:32 AM, Martin Mokrejs
<mmokrejs@fold.natur.cuni.cz> wrote:
> Martin Mokrejs wrote:
>>
>>
>> Jeff Garzik wrote:
>>> On 04/18/2012 01:10 PM, Martin Mokrejs wrote:
>>>> Fix: I got my 3TB disk detected by this single command:
>>>>
>>>> # echo on>   /sys/devices/pci0000:00/0000:00:1f.2/ata6/power/control
>>>> #
>>>>
>>>> This is a Dell Vostro 3550 with A09 BIOS. Same happend with 3.4-rc3 kernel.
>>>>
>>>> I can do some more testing if you want me to.
>>>> Best,
>>>> Martin
>>>
>>>
>>> Can you test this one-line patch from Lin Ming?  Hopefully there is zero sysfs twiddling required with this one...
>>>
>>> --- a/drivers/ata/libata-transport.c
>>> +++ b/drivers/ata/libata-transport.c
>>> @@ -294,6 +294,7 @@ int ata_tport_add(struct device *parent,
>>>      device_enable_async_suspend(dev);
>>>      pm_runtime_set_active(dev);
>>>      pm_runtime_enable(dev);
>>> +    pm_runtime_forbid(dev);
>>>
>>>      transport_add_device(dev);
>>>      transport_configure_device(dev);
>
>
> There is one more minor issue. I cannot get my disk re-dectected at 3Gbps. Here is when I plugged it in
> for the very first time after bootup (plain 3.4-rc3 with the above one-line fix):

Hi Martin,

I'm looking at this issue now.

Thanks for test and report.

Lin Ming

^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
       [not found]                 ` <CAF1ivSYqzjv10F+sdYkR_jdTZvzKP1=_ZwgNDj2njnmb6uaenA@mail.gmail.com>
@ 2012-04-19  8:16                   ` Lin Ming
  2012-04-19 17:28                     ` Martin Mokrejs
                                       ` (2 more replies)
  0 siblings, 3 replies; 37+ messages in thread
From: Lin Ming @ 2012-04-19  8:16 UTC (permalink / raw)
  To: Martin Mokrejs
  Cc: Jeff Garzik, cwillu, Mark Lord, Tejun Heo,
	IDE/ATA development list, Gwendal Grignou, Grant Grundler

On Thu, Apr 19, 2012 at 2:32 AM, Martin Mokrejs <mmokrejs@fold.natur.cuni.cz> wrote:
> Martin Mokrejs wrote:
>>
>>
>> Jeff Garzik wrote:
>>> On 04/18/2012 01:10 PM, Martin Mokrejs wrote:
>>>> Fix: I got my 3TB disk detected by this single command:
>>>>
>>>> # echo on>   /sys/devices/pci0000:00/0000:00:1f.2/ata6/power/control
>>>> #
>>>>
>>>> This is a Dell Vostro 3550 with A09 BIOS. Same happend with 3.4-rc3 kernel.
>>>>
>>>> I can do some more testing if you want me to.
>>>> Best,
>>>> Martin
>>>
>>>
>>> Can you test this one-line patch from Lin Ming?  Hopefully there is zero sysfs twiddling required with this one...
>>>
>>> --- a/drivers/ata/libata-transport.c
>>> +++ b/drivers/ata/libata-transport.c
>>> @@ -294,6 +294,7 @@ int ata_tport_add(struct device *parent,
>>>      device_enable_async_suspend(dev);
>>>      pm_runtime_set_active(dev);
>>>      pm_runtime_enable(dev);
>>> +    pm_runtime_forbid(dev);
>>>
>>>      transport_add_device(dev);
>>>      transport_configure_device(dev);
>
>
> There is one more minor issue. I cannot get my disk re-dectected at 3Gbps. Here is when I plugged it in
> for the very first time after bootup (plain 3.4-rc3 with the above one-line fix):

I did bisect and found that this is a really old regression introduced
in 2.6.37-rc1 with below commit.

commit d9027470b88631d0956ac37cdadfdeb9cdcf2c99
Author: Gwendal Grignou <gwendal@google.com>
Date:   Tue May 25 12:31:38 2010 -0700

    [libata] Add ATA transport class

    This is a scheleton for libata transport class.
    All information is read only, exporting information from libata:
    - ata_port class: one per ATA port
    - ata_link class: one per ATA port or 15 for SATA Port Multiplier
    - ata_device class: up to 2 for PATA link, usually one for SATA.

    Signed-off-by: Gwendal Grignou <gwendal@google.com>
    Reviewed-by: Grant Grundler <grundler@google.com>
    Signed-off-by: Jeff Garzik <jgarzik@redhat.com>


Here is the patch to fix it.

Gwendal and Grant,

Would you help to review it?


>From f696daec7ff63e9b3697e8f7ef8f985152667965 Mon Sep 17 00:00:00 2001
From: Lin Ming <ming.m.lin@intel.com>
Date: Thu, 19 Apr 2012 15:45:51 +0800
Subject: [PATCH] libata: clear error mask of old error history

The old error history was cleared in ata_ering_clear().
It only sets ATA_EFLAG_OLD_ER eflags, but the err_mask was not cleared.
So ata_ering_map() still iterates the old error history.

This causes problem, for example, wrong probe trials count were returned in
ata_eh_schedule_probe(), which in turn causes SATA link speed to be slowed down
to 1.5Gbps.

Reported-by: Martin Mokrejs <mmokrejs@fold.natur.cuni.cz>
Signed-off-by: Lin Ming <ming.m.lin@intel.com>
---
 drivers/ata/libata-eh.c |    3 ++-
 1 files changed, 2 insertions(+), 1 deletions(-)

diff --git a/drivers/ata/libata-eh.c b/drivers/ata/libata-eh.c
index c61316e..4c6f49b 100644
--- a/drivers/ata/libata-eh.c
+++ b/drivers/ata/libata-eh.c
@@ -419,9 +419,10 @@ int ata_ering_map(struct ata_ering *ering,
 	return rc;
 }
 
-int ata_ering_clear_cb(struct ata_ering_entry *ent, void *void_arg)
+static int ata_ering_clear_cb(struct ata_ering_entry *ent, void *void_arg)
 {
 	ent->eflags |= ATA_EFLAG_OLD_ER;
+	ent->err_mask = 0;
 	return 0;
 }
 
-- 
1.7.2.5



>
> [  146.876489] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4050000 action 0xe frozen
> [  146.876499] ata6: irq_stat 0x00400040, connection status changed
> [  146.876508] ata6: SError: { PHYRdyChg CommWake DevExch }
> [  146.876527] ata6: hard resetting link
> [  147.619956] ata6: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
> [  147.869349] ata6.00: ATA-8: ST3000DM001-9YN166, CC4C, max UDMA/133
> [  147.869360] ata6.00: 5860533168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
> [  147.870126] ata6.00: configured for UDMA/133
> [  147.870131] ata6: EH complete
> [  147.870220] scsi 5:0:0:0: Direct-Access     ATA      ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 5
> [  147.870391] sd 5:0:0:0: [sdc] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
> [  147.870393] sd 5:0:0:0: [sdc] 4096-byte physical blocks
> [  147.870396] sd 5:0:0:0: Attached scsi generic sg3 type 0
> [  147.870434] sd 5:0:0:0: [sdc] Write Protect is off
> [  147.870436] sd 5:0:0:0: [sdc] Mode Sense: 00 3a 00 00
> [  147.870460] sd 5:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
> [  147.904848]  sdc: sdc1
> [  147.905196] sd 5:0:0:0: [sdc] Attached SCSI disk
>
>
> Here is what happens on re-plug of the device. It is a 3.5" drive and the line
> [  617.838013] ata6: hard resetting link
> happens too early. I can hear the drive is still spinning up, it can't be ready yet.
> I think the delay should be increased.
>
>
> [  617.837966] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4050002 action 0xe frozen
> [  617.837976] ata6: irq_stat 0x00400040, connection status changed
> [  617.837984] ata6: SError: { RecovComm PHYRdyChg CommWake DevExch }
> [  617.838004] ata6: limiting SATA link speed to 1.5 Gbps
> [  617.838013] ata6: hard resetting link
> [  623.610941] ata6: link is slow to respond, please be patient (ready=0)
> [  627.864604] ata6: COMRESET failed (errno=-16)
> [  627.864615] ata6: hard resetting link
> [  629.931538] ata6: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
> [  629.932355] ata6.00: ATA-8: ST3000DM001-9YN166, CC4C, max UDMA/133
> [  629.932365] ata6.00: 5860533168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
> [  629.933170] ata6.00: configured for UDMA/133
> [  629.951629] ata6: EH complete
> [  629.951700] scsi 5:0:0:0: Direct-Access     ATA      ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 5
> [  629.951816] sd 5:0:0:0: [sdc] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
> [  629.951819] sd 5:0:0:0: [sdc] 4096-byte physical blocks
> [  629.951842] sd 5:0:0:0: Attached scsi generic sg3 type 0
> [  629.951875] sd 5:0:0:0: [sdc] Write Protect is off
> [  629.951877] sd 5:0:0:0: [sdc] Mode Sense: 00 3a 00 00
> [  629.951901] sd 5:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
> [  629.995970]  sdc: sdc1
> [  629.996359] sd 5:0:0:0: [sdc] Attached SCSI disk
>
>
> Martin



^ permalink raw reply related	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-19  8:16                   ` Lin Ming
@ 2012-04-19 17:28                     ` Martin Mokrejs
  2012-04-19 18:22                     ` Martin Mokrejs
  2012-04-20  2:37                     ` Grant Grundler
  2 siblings, 0 replies; 37+ messages in thread
From: Martin Mokrejs @ 2012-04-19 17:28 UTC (permalink / raw)
  To: Lin Ming
  Cc: Martin Mokrejs, Jeff Garzik, cwillu, Mark Lord, Tejun Heo,
	IDE/ATA development list, Gwendal Grignou, Grant Grundler

Could be the 3Gbps vs. 1.5Gbps link speed negotation be related to the
"Intel® 6 Series Express Chipset B2 stepping" chips issue? Applies to those
having enabled SATA ports 2-5. And this is my case:

[    3.037832] ahci 0000:00:1f.2: version 3.0
[    3.037880] ahci 0000:00:1f.2: irq 44 for MSI/MSI-X
[    3.037906] ahci: SSS flag set, parallel bus scan disabled
[    3.048233] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x31 impl SATA mode
[    3.048335] ahci 0000:00:1f.2: flags: 64bit ncq sntf stag pm led clo pio slum part ems sxs apst 
[    3.048371] ahci 0000:00:1f.2: setting latency timer to 64
[    3.088902] scsi0 : ahci
[    3.089010] scsi1 : ahci
[    3.089098] scsi2 : ahci
[    3.089185] scsi3 : ahci
[    3.089272] scsi4 : ahci
[    3.089361] scsi5 : ahci
[    3.090528] ata1: SATA max UDMA/133 abar m2048@0xf7f06000 port 0xf7f06100 irq 44
[    3.091400] ata2: DUMMY
[    3.092262] ata3: DUMMY
[    3.093112] ata4: DUMMY
[    3.093952] ata5: SATA max UDMA/133 abar m2048@0xf7f06000 port 0xf7f06300 irq 44
[    3.094803] ata6: SATA max UDMA/133 abar m2048@0xf7f06000 port 0xf7f06380 irq 44

http://support.dell.com/support/topics/global.aspx/support/kcs/document?c=us&cs=04&docid=389728&l=en&s=bsd
http://www.intel.com/support/chipsets/6/sb/CS-032521.htm
http://www.intel.com/support/chipsets/6/sb/CS-032521.htm

Martin



Lin Ming wrote:
> On Thu, Apr 19, 2012 at 2:32 AM, Martin Mokrejs <mmokrejs@fold.natur.cuni.cz> wrote:
>> Martin Mokrejs wrote:
>>>
>>>
>>> Jeff Garzik wrote:
>>>> On 04/18/2012 01:10 PM, Martin Mokrejs wrote:
>>>>> Fix: I got my 3TB disk detected by this single command:
>>>>>
>>>>> # echo on>   /sys/devices/pci0000:00/0000:00:1f.2/ata6/power/control
>>>>> #
>>>>>
>>>>> This is a Dell Vostro 3550 with A09 BIOS. Same happend with 3.4-rc3 kernel.
>>>>>
>>>>> I can do some more testing if you want me to.
>>>>> Best,
>>>>> Martin
>>>>
>>>>
>>>> Can you test this one-line patch from Lin Ming?  Hopefully there is zero sysfs twiddling required with this one...
>>>>
>>>> --- a/drivers/ata/libata-transport.c
>>>> +++ b/drivers/ata/libata-transport.c
>>>> @@ -294,6 +294,7 @@ int ata_tport_add(struct device *parent,
>>>>      device_enable_async_suspend(dev);
>>>>      pm_runtime_set_active(dev);
>>>>      pm_runtime_enable(dev);
>>>> +    pm_runtime_forbid(dev);
>>>>
>>>>      transport_add_device(dev);
>>>>      transport_configure_device(dev);
>>
>>
>> There is one more minor issue. I cannot get my disk re-dectected at 3Gbps. Here is when I plugged it in
>> for the very first time after bootup (plain 3.4-rc3 with the above one-line fix):
> 
> I did bisect and found that this is a really old regression introduced
> in 2.6.37-rc1 with below commit.
> 
> commit d9027470b88631d0956ac37cdadfdeb9cdcf2c99
> Author: Gwendal Grignou <gwendal@google.com>
> Date:   Tue May 25 12:31:38 2010 -0700
> 
>     [libata] Add ATA transport class
> 
>     This is a scheleton for libata transport class.
>     All information is read only, exporting information from libata:
>     - ata_port class: one per ATA port
>     - ata_link class: one per ATA port or 15 for SATA Port Multiplier
>     - ata_device class: up to 2 for PATA link, usually one for SATA.
> 
>     Signed-off-by: Gwendal Grignou <gwendal@google.com>
>     Reviewed-by: Grant Grundler <grundler@google.com>
>     Signed-off-by: Jeff Garzik <jgarzik@redhat.com>
> 
> 
> Here is the patch to fix it.
> 
> Gwendal and Grant,
> 
> Would you help to review it?
> 
> 
>>From f696daec7ff63e9b3697e8f7ef8f985152667965 Mon Sep 17 00:00:00 2001
> From: Lin Ming <ming.m.lin@intel.com>
> Date: Thu, 19 Apr 2012 15:45:51 +0800
> Subject: [PATCH] libata: clear error mask of old error history
> 
> The old error history was cleared in ata_ering_clear().
> It only sets ATA_EFLAG_OLD_ER eflags, but the err_mask was not cleared.
> So ata_ering_map() still iterates the old error history.
> 
> This causes problem, for example, wrong probe trials count were returned in
> ata_eh_schedule_probe(), which in turn causes SATA link speed to be slowed down
> to 1.5Gbps.
> 
> Reported-by: Martin Mokrejs <mmokrejs@fold.natur.cuni.cz>
> Signed-off-by: Lin Ming <ming.m.lin@intel.com>
> ---
>  drivers/ata/libata-eh.c |    3 ++-
>  1 files changed, 2 insertions(+), 1 deletions(-)
> 
> diff --git a/drivers/ata/libata-eh.c b/drivers/ata/libata-eh.c
> index c61316e..4c6f49b 100644
> --- a/drivers/ata/libata-eh.c
> +++ b/drivers/ata/libata-eh.c
> @@ -419,9 +419,10 @@ int ata_ering_map(struct ata_ering *ering,
>  	return rc;
>  }
>  
> -int ata_ering_clear_cb(struct ata_ering_entry *ent, void *void_arg)
> +static int ata_ering_clear_cb(struct ata_ering_entry *ent, void *void_arg)
>  {
>  	ent->eflags |= ATA_EFLAG_OLD_ER;
> +	ent->err_mask = 0;
>  	return 0;
>  }
>  

^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-19  8:16                   ` Lin Ming
  2012-04-19 17:28                     ` Martin Mokrejs
@ 2012-04-19 18:22                     ` Martin Mokrejs
  2012-04-20  1:46                       ` Lin Ming
  2012-04-20  2:37                     ` Grant Grundler
  2 siblings, 1 reply; 37+ messages in thread
From: Martin Mokrejs @ 2012-04-19 18:22 UTC (permalink / raw)
  To: Lin Ming
  Cc: Jeff Garzik, cwillu, Mark Lord, Tejun Heo,
	IDE/ATA development list, Gwendal Grignou, Grant Grundler

Hi Lin,

Lin Ming wrote:
> On Thu, Apr 19, 2012 at 2:32 AM, Martin Mokrejs <mmokrejs@fold.natur.cuni.cz> wrote:
>> Martin Mokrejs wrote:
>>>
>>>
>>> Jeff Garzik wrote:
>>>> On 04/18/2012 01:10 PM, Martin Mokrejs wrote:
>>>>> Fix: I got my 3TB disk detected by this single command:
>>>>>
>>>>> # echo on>   /sys/devices/pci0000:00/0000:00:1f.2/ata6/power/control
>>>>> #
>>>>>
>>>>> This is a Dell Vostro 3550 with A09 BIOS. Same happend with 3.4-rc3 kernel.
>>>>>
>>>>> I can do some more testing if you want me to.
>>>>> Best,
>>>>> Martin
>>>>
>>>>
>>>> Can you test this one-line patch from Lin Ming?  Hopefully there is zero sysfs twiddling required with this one...
>>>>
>>>> --- a/drivers/ata/libata-transport.c
>>>> +++ b/drivers/ata/libata-transport.c
>>>> @@ -294,6 +294,7 @@ int ata_tport_add(struct device *parent,
>>>>      device_enable_async_suspend(dev);
>>>>      pm_runtime_set_active(dev);
>>>>      pm_runtime_enable(dev);
>>>> +    pm_runtime_forbid(dev);
>>>>
>>>>      transport_add_device(dev);
>>>>      transport_configure_device(dev);
>>
>>
>> There is one more minor issue. I cannot get my disk re-dectected at 3Gbps. Here is when I plugged it in
>> for the very first time after bootup (plain 3.4-rc3 with the above one-line fix):
> 
> I did bisect and found that this is a really old regression introduced
> in 2.6.37-rc1 with below commit.
> 
> commit d9027470b88631d0956ac37cdadfdeb9cdcf2c99
> Author: Gwendal Grignou <gwendal@google.com>
> Date:   Tue May 25 12:31:38 2010 -0700
> 
>     [libata] Add ATA transport class
> 
>     This is a scheleton for libata transport class.
>     All information is read only, exporting information from libata:
>     - ata_port class: one per ATA port
>     - ata_link class: one per ATA port or 15 for SATA Port Multiplier
>     - ata_device class: up to 2 for PATA link, usually one for SATA.
> 
>     Signed-off-by: Gwendal Grignou <gwendal@google.com>
>     Reviewed-by: Grant Grundler <grundler@google.com>
>     Signed-off-by: Jeff Garzik <jgarzik@redhat.com>
> 
> 
> Here is the patch to fix it.
> 
> Gwendal and Grant,
> 
> Would you help to review it?
> 
> 
>>From f696daec7ff63e9b3697e8f7ef8f985152667965 Mon Sep 17 00:00:00 2001
> From: Lin Ming <ming.m.lin@intel.com>
> Date: Thu, 19 Apr 2012 15:45:51 +0800
> Subject: [PATCH] libata: clear error mask of old error history
> 
> The old error history was cleared in ata_ering_clear().
> It only sets ATA_EFLAG_OLD_ER eflags, but the err_mask was not cleared.
> So ata_ering_map() still iterates the old error history.
> 
> This causes problem, for example, wrong probe trials count were returned in
> ata_eh_schedule_probe(), which in turn causes SATA link speed to be slowed down
> to 1.5Gbps.
> 
> Reported-by: Martin Mokrejs <mmokrejs@fold.natur.cuni.cz>
> Signed-off-by: Lin Ming <ming.m.lin@intel.com>
> ---
>  drivers/ata/libata-eh.c |    3 ++-
>  1 files changed, 2 insertions(+), 1 deletions(-)
> 
> diff --git a/drivers/ata/libata-eh.c b/drivers/ata/libata-eh.c
> index c61316e..4c6f49b 100644
> --- a/drivers/ata/libata-eh.c
> +++ b/drivers/ata/libata-eh.c
> @@ -419,9 +419,10 @@ int ata_ering_map(struct ata_ering *ering,
>  	return rc;
>  }
>  
> -int ata_ering_clear_cb(struct ata_ering_entry *ent, void *void_arg)
> +static int ata_ering_clear_cb(struct ata_ering_entry *ent, void *void_arg)
>  {
>  	ent->eflags |= ATA_EFLAG_OLD_ER;
> +	ent->err_mask = 0;
>  	return 0;
>  }
>  

Confirming this patch fixed my problem. If you would like to improve something, add
some 1.5Gbp to 3.0Gbps re-negotiation. As you can see belo, I was desperate and plugged
in the cable just when kernel lowered the speed to 1.5Gbps. It seems it cannot re-negotiate
to go back up again. Tested 3.4-rc3 with some patches for pciehp from Yinghai, SATA
hotplug fix (lin Min), and for some reason have still reverted patch
486b10b9f43500741cd63a878d0ef23cd87fc66d (just for completeness).


I plugged in the cable.

[   75.818463] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4050000 action 0xe frozen
[   75.818472] ata6: irq_stat 0x00400040, connection status changed
[   75.818481] ata6: SError: { PHYRdyChg CommWake DevExch }
[   75.818500] ata6: hard resetting link
[   76.557738] ata6: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[   76.558554] ata6.00: ATA-8: ST3000DM001-9YN166, CC4C, max UDMA/133
[   76.558564] ata6.00: 5860533168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
[   76.559365] ata6.00: configured for UDMA/133
[   76.577645] ata6: EH complete
[   76.577802] scsi 5:0:0:0: Direct-Access     ATA      ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 5
[   76.577926] sd 5:0:0:0: [sdc] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
[   76.577929] sd 5:0:0:0: [sdc] 4096-byte physical blocks
[   76.577949] sd 5:0:0:0: Attached scsi generic sg3 type 0
[   76.577983] sd 5:0:0:0: [sdc] Write Protect is off
[   76.577986] sd 5:0:0:0: [sdc] Mode Sense: 00 3a 00 00
[   76.578010] sd 5:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   76.618312]  sdc: sdc1
[   76.618641] sd 5:0:0:0: [sdc] Attached SCSI disk

Unplugged the cable.

[   80.966608] ata6: exception Emask 0x50 SAct 0x0 SErr 0x4090800 action 0xe frozen
[   80.966617] ata6: irq_stat 0x00400040, connection status changed
[   80.966625] ata6: SError: { HostInt PHYRdyChg 10B8B DevExch }
[   80.966643] ata6: hard resetting link
[   81.710063] ata6: SATA link down (SStatus 0 SControl 300)
[   84.575097] ata6: hard resetting link
[   84.915290] ata6: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[   84.916778] ata6.00: configured for UDMA/133
[   84.935231] ata6: EH complete
[   90.042553] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4090000 action 0xe frozen
[   90.042562] ata6: irq_stat 0x00400040, connection status changed
[   90.042570] ata6: SError: { PHYRdyChg 10B8B DevExch }
[   90.042587] ata6: hard resetting link
[   90.786545] ata6: SATA link down (SStatus 0 SControl 300)
[   95.779093] ata6: hard resetting link
[   96.128574] ata6: SATA link down (SStatus 0 SControl 300)
[   96.128593] ata6: limiting SATA link speed to 1.5 Gbps

I plugged in the cable before the "SCSI" was disabled.

[   98.697321] ata6: hard resetting link
[   99.044242] ata6: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
[   99.045842] ata6.00: configured for UDMA/133
[   99.064156] ata6: EH complete
[  141.857958] EXT4-fs (sdc1): mounted filesystem with ordered data mode. Opts: (null)

I unounted the disk and unplugged the cable.

[  150.645109] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4090000 action 0xe frozen
[  150.645119] ata6: irq_stat 0x00400040, connection status changed
[  150.645127] ata6: SError: { PHYRdyChg 10B8B DevExch }
[  150.645144] ata6: hard resetting link
[  151.386278] ata6: SATA link down (SStatus 0 SControl 310)
[  156.378946] ata6: hard resetting link
[  156.728320] ata6: SATA link down (SStatus 0 SControl 310)
[  161.720864] ata6: hard resetting link
[  162.070361] ata6: SATA link down (SStatus 0 SControl 310)
[  162.070380] ata6.00: disabled
[  162.090321] ata6: EH complete
[  162.090345] ata6.00: detaching (SCSI 5:0:0:0)
[  162.090801] sd 5:0:0:0: [sdc] Synchronizing SCSI cache
[  162.090834] sd 5:0:0:0: [sdc]  Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
[  162.090837] sd 5:0:0:0: [sdc] Stopping disk
[  162.090843] sd 5:0:0:0: [sdc] START_STOP FAILED
[  162.090844] sd 5:0:0:0: [sdc]  Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK

I plugged in the cable.

[  169.586995] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4050002 action 0xe frozen
[  169.587005] ata6: irq_stat 0x00400040, connection status changed
[  169.587012] ata6: SError: { RecovComm PHYRdyChg CommWake DevExch }
[  169.587032] ata6: hard resetting link
[  170.328067] ata6: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[  170.328913] ata6.00: ATA-8: ST3000DM001-9YN166, CC4C, max UDMA/133
[  170.328923] ata6.00: 5860533168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
[  170.329731] ata6.00: configured for UDMA/133
[  170.347972] ata6: EH complete
[  170.348131] scsi 5:0:0:0: Direct-Access     ATA      ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 5
[  170.348243] sd 5:0:0:0: [sdc] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
[  170.348246] sd 5:0:0:0: [sdc] 4096-byte physical blocks
[  170.348272] sd 5:0:0:0: Attached scsi generic sg3 type 0
[  170.348300] sd 5:0:0:0: [sdc] Write Protect is off
[  170.348302] sd 5:0:0:0: [sdc] Mode Sense: 00 3a 00 00
[  170.348324] sd 5:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[  170.390492]  sdc: sdc1
[  170.390860] sd 5:0:0:0: [sdc] Attached SCSI disk

Unplugged the cable.

[  180.819680] ata6: exception Emask 0x50 SAct 0x0 SErr 0x4090800 action 0xe frozen
[  180.819689] ata6: irq_stat 0x00400040, connection status changed
[  180.819697] ata6: SError: { HostInt PHYRdyChg 10B8B DevExch }
[  180.819714] ata6: hard resetting link
[  181.561332] ata6: SATA link down (SStatus 0 SControl 300)
[  186.553880] ata6: hard resetting link
[  186.903376] ata6: SATA link down (SStatus 0 SControl 300)
[  186.903395] ata6: limiting SATA link speed to 1.5 Gbps
[  191.896050] ata6: hard resetting link
[  192.245416] ata6: SATA link down (SStatus 0 SControl 310)
[  192.245434] ata6.00: disabled
[  192.265374] ata6: EH complete
[  192.265398] ata6.00: detaching (SCSI 5:0:0:0)
[  192.265878] sd 5:0:0:0: [sdc] Synchronizing SCSI cache
[  192.265906] sd 5:0:0:0: [sdc]  Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
[  192.265909] sd 5:0:0:0: [sdc] Stopping disk
[  192.265916] sd 5:0:0:0: [sdc] START_STOP FAILED
[  192.265917] sd 5:0:0:0: [sdc]  Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK

I plugged in the cable.

[  194.436542] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4050002 action 0xe frozen
[  194.436551] ata6: irq_stat 0x00400040, connection status changed
[  194.436559] ata6: SError: { RecovComm PHYRdyChg CommWake DevExch }
[  194.436578] ata6: hard resetting link
[  195.181045] ata6: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[  195.181795] ata6.00: ATA-8: ST3000DM001-9YN166, CC4C, max UDMA/133
[  195.181805] ata6.00: 5860533168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
[  195.182571] ata6.00: configured for UDMA/133
[  195.200953] ata6: EH complete
[  195.201110] scsi 5:0:0:0: Direct-Access     ATA      ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 5
[  195.201243] sd 5:0:0:0: [sdc] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
[  195.201246] sd 5:0:0:0: [sdc] 4096-byte physical blocks
[  195.201270] sd 5:0:0:0: Attached scsi generic sg3 type 0
[  195.201314] sd 5:0:0:0: [sdc] Write Protect is off
[  195.201317] sd 5:0:0:0: [sdc] Mode Sense: 00 3a 00 00
[  195.201344] sd 5:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[  195.239595]  sdc: sdc1
[  195.240020] sd 5:0:0:0: [sdc] Attached SCSI disk




^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-19 18:22                     ` Martin Mokrejs
@ 2012-04-20  1:46                       ` Lin Ming
  0 siblings, 0 replies; 37+ messages in thread
From: Lin Ming @ 2012-04-20  1:46 UTC (permalink / raw)
  To: Martin Mokrejs
  Cc: Jeff Garzik, cwillu, Mark Lord, Tejun Heo,
	IDE/ATA development list, Gwendal Grignou, Grant Grundler

On Thu, 2012-04-19 at 20:22 +0200, Martin Mokrejs wrote:
> Hi Lin,
> 
> Lin Ming wrote:
> > On Thu, Apr 19, 2012 at 2:32 AM, Martin Mokrejs <mmokrejs@fold.natur.cuni.cz> wrote:
> >> Martin Mokrejs wrote:
> >>>
> >>>
> >>> Jeff Garzik wrote:
> >>>> On 04/18/2012 01:10 PM, Martin Mokrejs wrote:
> >>>>> Fix: I got my 3TB disk detected by this single command:
> >>>>>
> >>>>> # echo on>   /sys/devices/pci0000:00/0000:00:1f.2/ata6/power/control
> >>>>> #
> >>>>>
> >>>>> This is a Dell Vostro 3550 with A09 BIOS. Same happend with 3.4-rc3 kernel.
> >>>>>
> >>>>> I can do some more testing if you want me to.
> >>>>> Best,
> >>>>> Martin
> >>>>
> >>>>
> >>>> Can you test this one-line patch from Lin Ming?  Hopefully there is zero sysfs twiddling required with this one...
> >>>>
> >>>> --- a/drivers/ata/libata-transport.c
> >>>> +++ b/drivers/ata/libata-transport.c
> >>>> @@ -294,6 +294,7 @@ int ata_tport_add(struct device *parent,
> >>>>      device_enable_async_suspend(dev);
> >>>>      pm_runtime_set_active(dev);
> >>>>      pm_runtime_enable(dev);
> >>>> +    pm_runtime_forbid(dev);
> >>>>
> >>>>      transport_add_device(dev);
> >>>>      transport_configure_device(dev);
> >>
> >>
> >> There is one more minor issue. I cannot get my disk re-dectected at 3Gbps. Here is when I plugged it in
> >> for the very first time after bootup (plain 3.4-rc3 with the above one-line fix):
> > 
> > I did bisect and found that this is a really old regression introduced
> > in 2.6.37-rc1 with below commit.
> > 
> > commit d9027470b88631d0956ac37cdadfdeb9cdcf2c99
> > Author: Gwendal Grignou <gwendal@google.com>
> > Date:   Tue May 25 12:31:38 2010 -0700
> > 
> >     [libata] Add ATA transport class
> > 
> >     This is a scheleton for libata transport class.
> >     All information is read only, exporting information from libata:
> >     - ata_port class: one per ATA port
> >     - ata_link class: one per ATA port or 15 for SATA Port Multiplier
> >     - ata_device class: up to 2 for PATA link, usually one for SATA.
> > 
> >     Signed-off-by: Gwendal Grignou <gwendal@google.com>
> >     Reviewed-by: Grant Grundler <grundler@google.com>
> >     Signed-off-by: Jeff Garzik <jgarzik@redhat.com>
> > 
> > 
> > Here is the patch to fix it.
> > 
> > Gwendal and Grant,
> > 
> > Would you help to review it?
> > 
> > 
> >>From f696daec7ff63e9b3697e8f7ef8f985152667965 Mon Sep 17 00:00:00 2001
> > From: Lin Ming <ming.m.lin@intel.com>
> > Date: Thu, 19 Apr 2012 15:45:51 +0800
> > Subject: [PATCH] libata: clear error mask of old error history
> > 
> > The old error history was cleared in ata_ering_clear().
> > It only sets ATA_EFLAG_OLD_ER eflags, but the err_mask was not cleared.
> > So ata_ering_map() still iterates the old error history.
> > 
> > This causes problem, for example, wrong probe trials count were returned in
> > ata_eh_schedule_probe(), which in turn causes SATA link speed to be slowed down
> > to 1.5Gbps.
> > 
> > Reported-by: Martin Mokrejs <mmokrejs@fold.natur.cuni.cz>
> > Signed-off-by: Lin Ming <ming.m.lin@intel.com>
> > ---
> >  drivers/ata/libata-eh.c |    3 ++-
> >  1 files changed, 2 insertions(+), 1 deletions(-)
> > 
> > diff --git a/drivers/ata/libata-eh.c b/drivers/ata/libata-eh.c
> > index c61316e..4c6f49b 100644
> > --- a/drivers/ata/libata-eh.c
> > +++ b/drivers/ata/libata-eh.c
> > @@ -419,9 +419,10 @@ int ata_ering_map(struct ata_ering *ering,
> >  	return rc;
> >  }
> >  
> > -int ata_ering_clear_cb(struct ata_ering_entry *ent, void *void_arg)
> > +static int ata_ering_clear_cb(struct ata_ering_entry *ent, void *void_arg)
> >  {
> >  	ent->eflags |= ATA_EFLAG_OLD_ER;
> > +	ent->err_mask = 0;
> >  	return 0;
> >  }
> >  
> 
> Confirming this patch fixed my problem. If you would like to improve something, add
> some 1.5Gbp to 3.0Gbps re-negotiation. As you can see belo, I was desperate and plugged
> in the cable just when kernel lowered the speed to 1.5Gbps. It seems it cannot re-negotiate
> to go back up again. Tested 3.4-rc3 with some patches for pciehp from Yinghai, SATA
> hotplug fix (lin Min), and for some reason have still reverted patch
> 486b10b9f43500741cd63a878d0ef23cd87fc66d (just for completeness).
> 
> 
> I plugged in the cable.
> 
> [   75.818463] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4050000 action 0xe frozen
> [   75.818472] ata6: irq_stat 0x00400040, connection status changed
> [   75.818481] ata6: SError: { PHYRdyChg CommWake DevExch }
> [   75.818500] ata6: hard resetting link
> [   76.557738] ata6: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
> [   76.558554] ata6.00: ATA-8: ST3000DM001-9YN166, CC4C, max UDMA/133
> [   76.558564] ata6.00: 5860533168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
> [   76.559365] ata6.00: configured for UDMA/133
> [   76.577645] ata6: EH complete
> [   76.577802] scsi 5:0:0:0: Direct-Access     ATA      ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 5
> [   76.577926] sd 5:0:0:0: [sdc] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
> [   76.577929] sd 5:0:0:0: [sdc] 4096-byte physical blocks
> [   76.577949] sd 5:0:0:0: Attached scsi generic sg3 type 0
> [   76.577983] sd 5:0:0:0: [sdc] Write Protect is off
> [   76.577986] sd 5:0:0:0: [sdc] Mode Sense: 00 3a 00 00
> [   76.578010] sd 5:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
> [   76.618312]  sdc: sdc1
> [   76.618641] sd 5:0:0:0: [sdc] Attached SCSI disk
> 
> Unplugged the cable.
> 
> [   80.966608] ata6: exception Emask 0x50 SAct 0x0 SErr 0x4090800 action 0xe frozen
> [   80.966617] ata6: irq_stat 0x00400040, connection status changed
> [   80.966625] ata6: SError: { HostInt PHYRdyChg 10B8B DevExch }
> [   80.966643] ata6: hard resetting link
> [   81.710063] ata6: SATA link down (SStatus 0 SControl 300)
> [   84.575097] ata6: hard resetting link
> [   84.915290] ata6: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
> [   84.916778] ata6.00: configured for UDMA/133
> [   84.935231] ata6: EH complete
> [   90.042553] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4090000 action 0xe frozen
> [   90.042562] ata6: irq_stat 0x00400040, connection status changed
> [   90.042570] ata6: SError: { PHYRdyChg 10B8B DevExch }
> [   90.042587] ata6: hard resetting link
> [   90.786545] ata6: SATA link down (SStatus 0 SControl 300)
> [   95.779093] ata6: hard resetting link
> [   96.128574] ata6: SATA link down (SStatus 0 SControl 300)
> [   96.128593] ata6: limiting SATA link speed to 1.5 Gbps
> 
> I plugged in the cable before the "SCSI" was disabled.
> 
> [   98.697321] ata6: hard resetting link
> [   99.044242] ata6: SATA link up 1.5 Gbps (SStatus 113 SControl 310)

SATA link can't go back up to 3.0 Gbps.

I can reproduce this issue too.
Will try to fix it.

I have sent out patch "libata: clear error mask of old error history".
Thanks for your test.

Lin Ming

> [   99.045842] ata6.00: configured for UDMA/133
> [   99.064156] ata6: EH complete
> [  141.857958] EXT4-fs (sdc1): mounted filesystem with ordered data mode. Opts: (null)
> 



^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-19  8:16                   ` Lin Ming
  2012-04-19 17:28                     ` Martin Mokrejs
  2012-04-19 18:22                     ` Martin Mokrejs
@ 2012-04-20  2:37                     ` Grant Grundler
  2012-04-26  9:29                       ` Gwendal Grignou
  2 siblings, 1 reply; 37+ messages in thread
From: Grant Grundler @ 2012-04-20  2:37 UTC (permalink / raw)
  To: Lin Ming
  Cc: Martin Mokrejs, Jeff Garzik, cwillu, Mark Lord, Tejun Heo,
	IDE/ATA development list, Gwendal Grignou

On Thu, Apr 19, 2012 at 1:16 AM, Lin Ming <ming.m.lin@intel.com> wrote:
...
> I did bisect and found that this is a really old regression introduced
> in 2.6.37-rc1 with below commit.
>
> commit d9027470b88631d0956ac37cdadfdeb9cdcf2c99
> Author: Gwendal Grignou <gwendal@google.com>
> Date:   Tue May 25 12:31:38 2010 -0700
>
>    [libata] Add ATA transport class
>
>    This is a scheleton for libata transport class.
>    All information is read only, exporting information from libata:
>    - ata_port class: one per ATA port
>    - ata_link class: one per ATA port or 15 for SATA Port Multiplier
>    - ata_device class: up to 2 for PATA link, usually one for SATA.
>
>    Signed-off-by: Gwendal Grignou <gwendal@google.com>
>    Reviewed-by: Grant Grundler <grundler@google.com>
>    Signed-off-by: Jeff Garzik <jgarzik@redhat.com>
>
>
> Here is the patch to fix it.
>
> Gwendal and Grant,
>
> Would you help to review it?
>
>
> From f696daec7ff63e9b3697e8f7ef8f985152667965 Mon Sep 17 00:00:00 2001
> From: Lin Ming <ming.m.lin@intel.com>
> Date: Thu, 19 Apr 2012 15:45:51 +0800
> Subject: [PATCH] libata: clear error mask of old error history
>
> The old error history was cleared in ata_ering_clear().
> It only sets ATA_EFLAG_OLD_ER eflags, but the err_mask was not cleared.
> So ata_ering_map() still iterates the old error history.
>
> This causes problem, for example, wrong probe trials count were returned in
> ata_eh_schedule_probe(), which in turn causes SATA link speed to be slowed down
> to 1.5Gbps.
>
> Reported-by: Martin Mokrejs <mmokrejs@fold.natur.cuni.cz>
> Signed-off-by: Lin Ming <ming.m.lin@intel.com>

Reviewed-by: Grant Grundler <grundler@google.com>

LGTM. Caveat is I have looked at libata code only once or twice since
reviewing this patch for Gwendal.

cheers,
grant

> ---
>  drivers/ata/libata-eh.c |    3 ++-
>  1 files changed, 2 insertions(+), 1 deletions(-)
>
> diff --git a/drivers/ata/libata-eh.c b/drivers/ata/libata-eh.c
> index c61316e..4c6f49b 100644
> --- a/drivers/ata/libata-eh.c
> +++ b/drivers/ata/libata-eh.c
> @@ -419,9 +419,10 @@ int ata_ering_map(struct ata_ering *ering,
>        return rc;
>  }
>
> -int ata_ering_clear_cb(struct ata_ering_entry *ent, void *void_arg)
> +static int ata_ering_clear_cb(struct ata_ering_entry *ent, void *void_arg)
>  {
>        ent->eflags |= ATA_EFLAG_OLD_ER;
> +       ent->err_mask = 0;
>        return 0;
>  }
>
> --
> 1.7.2.5
>
>
>
>>
>> [  146.876489] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4050000 action 0xe frozen
>> [  146.876499] ata6: irq_stat 0x00400040, connection status changed
>> [  146.876508] ata6: SError: { PHYRdyChg CommWake DevExch }
>> [  146.876527] ata6: hard resetting link
>> [  147.619956] ata6: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
>> [  147.869349] ata6.00: ATA-8: ST3000DM001-9YN166, CC4C, max UDMA/133
>> [  147.869360] ata6.00: 5860533168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
>> [  147.870126] ata6.00: configured for UDMA/133
>> [  147.870131] ata6: EH complete
>> [  147.870220] scsi 5:0:0:0: Direct-Access     ATA      ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 5
>> [  147.870391] sd 5:0:0:0: [sdc] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
>> [  147.870393] sd 5:0:0:0: [sdc] 4096-byte physical blocks
>> [  147.870396] sd 5:0:0:0: Attached scsi generic sg3 type 0
>> [  147.870434] sd 5:0:0:0: [sdc] Write Protect is off
>> [  147.870436] sd 5:0:0:0: [sdc] Mode Sense: 00 3a 00 00
>> [  147.870460] sd 5:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
>> [  147.904848]  sdc: sdc1
>> [  147.905196] sd 5:0:0:0: [sdc] Attached SCSI disk
>>
>>
>> Here is what happens on re-plug of the device. It is a 3.5" drive and the line
>> [  617.838013] ata6: hard resetting link
>> happens too early. I can hear the drive is still spinning up, it can't be ready yet.
>> I think the delay should be increased.
>>
>>
>> [  617.837966] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4050002 action 0xe frozen
>> [  617.837976] ata6: irq_stat 0x00400040, connection status changed
>> [  617.837984] ata6: SError: { RecovComm PHYRdyChg CommWake DevExch }
>> [  617.838004] ata6: limiting SATA link speed to 1.5 Gbps
>> [  617.838013] ata6: hard resetting link
>> [  623.610941] ata6: link is slow to respond, please be patient (ready=0)
>> [  627.864604] ata6: COMRESET failed (errno=-16)
>> [  627.864615] ata6: hard resetting link
>> [  629.931538] ata6: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
>> [  629.932355] ata6.00: ATA-8: ST3000DM001-9YN166, CC4C, max UDMA/133
>> [  629.932365] ata6.00: 5860533168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
>> [  629.933170] ata6.00: configured for UDMA/133
>> [  629.951629] ata6: EH complete
>> [  629.951700] scsi 5:0:0:0: Direct-Access     ATA      ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 5
>> [  629.951816] sd 5:0:0:0: [sdc] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
>> [  629.951819] sd 5:0:0:0: [sdc] 4096-byte physical blocks
>> [  629.951842] sd 5:0:0:0: Attached scsi generic sg3 type 0
>> [  629.951875] sd 5:0:0:0: [sdc] Write Protect is off
>> [  629.951877] sd 5:0:0:0: [sdc] Mode Sense: 00 3a 00 00
>> [  629.951901] sd 5:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
>> [  629.995970]  sdc: sdc1
>> [  629.996359] sd 5:0:0:0: [sdc] Attached SCSI disk
>>
>>
>> Martin
>
>

^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-20  2:37                     ` Grant Grundler
@ 2012-04-26  9:29                       ` Gwendal Grignou
  2012-04-26 13:06                         ` Lin Ming
  2012-05-03  1:26                         ` Lin Ming
  0 siblings, 2 replies; 37+ messages in thread
From: Gwendal Grignou @ 2012-04-26  9:29 UTC (permalink / raw)
  To: Lin Ming
  Cc: Martin Mokrejs, Jeff Garzik, cwillu, Mark Lord, Tejun Heo,
	IDE/ATA development list, Grant Grundler

Lin,

In the patch d9027470b88631d0956ac37cdadfdeb9cdcf2c99, I did limit the
amount of data cleaning in some of the ata objects.

If setting err_mask to 0 masks the regression I introduced in the
patch, I may have altered too much how ata_device object is
reinitialized when a device is found. I am digging deeper, I may have
change the code to try to preserve the ering as much as possible.

Concerning your patch, isn't adding a test (ent->eflags &
ATA_EFLAG_OLD_ER) in ata_count_probe_trials_cb() more in line with
speed_down_verdict_cb() code?

Gwendal.

On Fri, Apr 20, 2012 at 10:37 AM, Grant Grundler <grundler@google.com> wrote:
> On Thu, Apr 19, 2012 at 1:16 AM, Lin Ming <ming.m.lin@intel.com> wrote:
> ...
>> I did bisect and found that this is a really old regression introduced
>> in 2.6.37-rc1 with below commit.
>>
>> commit d9027470b88631d0956ac37cdadfdeb9cdcf2c99
>> Author: Gwendal Grignou <gwendal@google.com>
>> Date:   Tue May 25 12:31:38 2010 -0700
>>
>>    [libata] Add ATA transport class
>>
>>    This is a scheleton for libata transport class.
>>    All information is read only, exporting information from libata:
>>    - ata_port class: one per ATA port
>>    - ata_link class: one per ATA port or 15 for SATA Port Multiplier
>>    - ata_device class: up to 2 for PATA link, usually one for SATA.
>>
>>    Signed-off-by: Gwendal Grignou <gwendal@google.com>
>>    Reviewed-by: Grant Grundler <grundler@google.com>
>>    Signed-off-by: Jeff Garzik <jgarzik@redhat.com>
>>
>>
>> Here is the patch to fix it.
>>
>> Gwendal and Grant,
>>
>> Would you help to review it?
>>
>>
>> From f696daec7ff63e9b3697e8f7ef8f985152667965 Mon Sep 17 00:00:00 2001
>> From: Lin Ming <ming.m.lin@intel.com>
>> Date: Thu, 19 Apr 2012 15:45:51 +0800
>> Subject: [PATCH] libata: clear error mask of old error history
>>
>> The old error history was cleared in ata_ering_clear().
>> It only sets ATA_EFLAG_OLD_ER eflags, but the err_mask was not cleared.
>> So ata_ering_map() still iterates the old error history.
>>
>> This causes problem, for example, wrong probe trials count were returned in
>> ata_eh_schedule_probe(), which in turn causes SATA link speed to be slowed down
>> to 1.5Gbps.
>>
>> Reported-by: Martin Mokrejs <mmokrejs@fold.natur.cuni.cz>
>> Signed-off-by: Lin Ming <ming.m.lin@intel.com>
>
> Reviewed-by: Grant Grundler <grundler@google.com>
>
> LGTM. Caveat is I have looked at libata code only once or twice since
> reviewing this patch for Gwendal.
>
> cheers,
> grant
>
>> ---
>>  drivers/ata/libata-eh.c |    3 ++-
>>  1 files changed, 2 insertions(+), 1 deletions(-)
>>
>> diff --git a/drivers/ata/libata-eh.c b/drivers/ata/libata-eh.c
>> index c61316e..4c6f49b 100644
>> --- a/drivers/ata/libata-eh.c
>> +++ b/drivers/ata/libata-eh.c
>> @@ -419,9 +419,10 @@ int ata_ering_map(struct ata_ering *ering,
>>        return rc;
>>  }
>>
>> -int ata_ering_clear_cb(struct ata_ering_entry *ent, void *void_arg)
>> +static int ata_ering_clear_cb(struct ata_ering_entry *ent, void *void_arg)
>>  {
>>        ent->eflags |= ATA_EFLAG_OLD_ER;
>> +       ent->err_mask = 0;
>>        return 0;
>>  }
>>
>> --
>> 1.7.2.5
>>
>>
>>
>>>
>>> [  146.876489] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4050000 action 0xe frozen
>>> [  146.876499] ata6: irq_stat 0x00400040, connection status changed
>>> [  146.876508] ata6: SError: { PHYRdyChg CommWake DevExch }
>>> [  146.876527] ata6: hard resetting link
>>> [  147.619956] ata6: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
>>> [  147.869349] ata6.00: ATA-8: ST3000DM001-9YN166, CC4C, max UDMA/133
>>> [  147.869360] ata6.00: 5860533168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
>>> [  147.870126] ata6.00: configured for UDMA/133
>>> [  147.870131] ata6: EH complete
>>> [  147.870220] scsi 5:0:0:0: Direct-Access     ATA      ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 5
>>> [  147.870391] sd 5:0:0:0: [sdc] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
>>> [  147.870393] sd 5:0:0:0: [sdc] 4096-byte physical blocks
>>> [  147.870396] sd 5:0:0:0: Attached scsi generic sg3 type 0
>>> [  147.870434] sd 5:0:0:0: [sdc] Write Protect is off
>>> [  147.870436] sd 5:0:0:0: [sdc] Mode Sense: 00 3a 00 00
>>> [  147.870460] sd 5:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
>>> [  147.904848]  sdc: sdc1
>>> [  147.905196] sd 5:0:0:0: [sdc] Attached SCSI disk
>>>
>>>
>>> Here is what happens on re-plug of the device. It is a 3.5" drive and the line
>>> [  617.838013] ata6: hard resetting link
>>> happens too early. I can hear the drive is still spinning up, it can't be ready yet.
>>> I think the delay should be increased.
>>>
>>>
>>> [  617.837966] ata6: exception Emask 0x10 SAct 0x0 SErr 0x4050002 action 0xe frozen
>>> [  617.837976] ata6: irq_stat 0x00400040, connection status changed
>>> [  617.837984] ata6: SError: { RecovComm PHYRdyChg CommWake DevExch }
>>> [  617.838004] ata6: limiting SATA link speed to 1.5 Gbps
>>> [  617.838013] ata6: hard resetting link
>>> [  623.610941] ata6: link is slow to respond, please be patient (ready=0)
>>> [  627.864604] ata6: COMRESET failed (errno=-16)
>>> [  627.864615] ata6: hard resetting link
>>> [  629.931538] ata6: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
>>> [  629.932355] ata6.00: ATA-8: ST3000DM001-9YN166, CC4C, max UDMA/133
>>> [  629.932365] ata6.00: 5860533168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
>>> [  629.933170] ata6.00: configured for UDMA/133
>>> [  629.951629] ata6: EH complete
>>> [  629.951700] scsi 5:0:0:0: Direct-Access     ATA      ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 5
>>> [  629.951816] sd 5:0:0:0: [sdc] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
>>> [  629.951819] sd 5:0:0:0: [sdc] 4096-byte physical blocks
>>> [  629.951842] sd 5:0:0:0: Attached scsi generic sg3 type 0
>>> [  629.951875] sd 5:0:0:0: [sdc] Write Protect is off
>>> [  629.951877] sd 5:0:0:0: [sdc] Mode Sense: 00 3a 00 00
>>> [  629.951901] sd 5:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
>>> [  629.995970]  sdc: sdc1
>>> [  629.996359] sd 5:0:0:0: [sdc] Attached SCSI disk
>>>
>>>
>>> Martin
>>
>>

^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-26  9:29                       ` Gwendal Grignou
@ 2012-04-26 13:06                         ` Lin Ming
  2012-04-26 16:50                           ` Gwendal Grignou
  2012-05-03  1:26                         ` Lin Ming
  1 sibling, 1 reply; 37+ messages in thread
From: Lin Ming @ 2012-04-26 13:06 UTC (permalink / raw)
  To: Gwendal Grignou
  Cc: Martin Mokrejs, Jeff Garzik, cwillu, Mark Lord, Tejun Heo,
	IDE/ATA development list, Grant Grundler

On Thu, Apr 26, 2012 at 5:29 PM, Gwendal Grignou <gwendal@google.com> wrote:
> Lin,

Hi Gwendal,

>
> In the patch d9027470b88631d0956ac37cdadfdeb9cdcf2c99, I did limit the
> amount of data cleaning in some of the ata objects.
>
> If setting err_mask to 0 masks the regression I introduced in the
> patch, I may have altered too much how ata_device object is
> reinitialized when a device is found. I am digging deeper, I may have
> change the code to try to preserve the ering as much as possible.
>
> Concerning your patch, isn't adding a test (ent->eflags &
> ATA_EFLAG_OLD_ER) in ata_count_probe_trials_cb() more in line with
> speed_down_verdict_cb() code?

This could also fix the regression.

But the fundamental problem is should ata_ering_map still iterate the old
error history which were cleared already?

Lin Ming

>
> Gwendal.

^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-26 13:06                         ` Lin Ming
@ 2012-04-26 16:50                           ` Gwendal Grignou
  0 siblings, 0 replies; 37+ messages in thread
From: Gwendal Grignou @ 2012-04-26 16:50 UTC (permalink / raw)
  To: Lin Ming
  Cc: Martin Mokrejs, Jeff Garzik, cwillu, Mark Lord, Tejun Heo,
	IDE/ATA development list, Grant Grundler

On Thu, Apr 26, 2012 at 6:06 AM, Lin Ming <ming.m.lin@intel.com> wrote:
> On Thu, Apr 26, 2012 at 5:29 PM, Gwendal Grignou <gwendal@google.com> wrote:
>> Lin,
>
> Hi Gwendal,
>
>>
>> In the patch d9027470b88631d0956ac37cdadfdeb9cdcf2c99, I did limit the
>> amount of data cleaning in some of the ata objects.
>>
>> If setting err_mask to 0 masks the regression I introduced in the
>> patch, I may have altered too much how ata_device object is
>> reinitialized when a device is found. I am digging deeper, I may have
>> change the code to try to preserve the ering as much as possible.
>>
>> Concerning your patch, isn't adding a test (ent->eflags &
>> ATA_EFLAG_OLD_ER) in ata_count_probe_trials_cb() more in line with
>> speed_down_verdict_cb() code?
>
> This could also fix the regression.
>
> But the fundamental problem is should ata_ering_map still iterate the old
> error history which were cleared already?
ATA_EFLAG_OLD_ER marks the entry as irrelevant for the current error
handler. It can still be interesting to be able to see the history of
errors for a particular device without going through dmesg output.
Especially if you want a script to do it.

Gwendal.
>
> Lin Ming
>
>>
>> Gwendal.

^ permalink raw reply	[flat|nested] 37+ messages in thread

* Re: Hotplug borked after suspend/resume in Linux-3.3 ?
  2012-04-26  9:29                       ` Gwendal Grignou
  2012-04-26 13:06                         ` Lin Ming
@ 2012-05-03  1:26                         ` Lin Ming
  1 sibling, 0 replies; 37+ messages in thread
From: Lin Ming @ 2012-05-03  1:26 UTC (permalink / raw)
  To: Gwendal Grignou
  Cc: Martin Mokrejs, Jeff Garzik, cwillu, Mark Lord, Tejun Heo,
	IDE/ATA development list, Grant Grundler

On Thu, Apr 26, 2012 at 5:29 PM, Gwendal Grignou <gwendal@google.com> wrote:
> Lin,
>
> In the patch d9027470b88631d0956ac37cdadfdeb9cdcf2c99, I did limit the
> amount of data cleaning in some of the ata objects.
>
> If setting err_mask to 0 masks the regression I introduced in the
> patch, I may have altered too much how ata_device object is
> reinitialized when a device is found. I am digging deeper, I may have
> change the code to try to preserve the ering as much as possible.
>
> Concerning your patch, isn't adding a test (ent->eflags &
> ATA_EFLAG_OLD_ER) in ata_count_probe_trials_cb() more in line with
> speed_down_verdict_cb() code?

Hi,

I have updated the patch.

[PATCH] libata: skip old error history when counting probe trials
http://marc.info/?l=linux-ide&m=133600832126645&w=2

Regards,
Lin Ming

^ permalink raw reply	[flat|nested] 37+ messages in thread

* [PATCH 3.3.y] libata: forbid port runtime pm by default, fixing regression
  2012-04-18 17:29           ` Jeff Garzik
  2012-04-18 17:44             ` Martin Mokrejs
@ 2012-05-19 23:58             ` Jonathan Nieder
  2012-05-24 17:30               ` Greg KH
  1 sibling, 1 reply; 37+ messages in thread
From: Jonathan Nieder @ 2012-05-19 23:58 UTC (permalink / raw)
  To: stable
  Cc: Michael Schmitt, Jeff Garzik, Martin Mokrejs, cwillu, Mark Lord,
	Tejun Heo, IDE/ATA development list

From: Lin Ming <ming.m.lin@intel.com>
Date: Wed, 18 Apr 2012 09:29:47 +0800

commit 0c8d32c27f5cf6e14ca14b4758d1e994eebd50fd upstream.

Forbid port runtime pm by default because it has known hotplug issue.
User can allow it by, for example

echo auto > /sys/devices/pci0000:00/0000:00:1f.2/ata2/power/control

Signed-off-by: Lin Ming <ming.m.lin@intel.com>
Signed-off-by: Jeff Garzik <jgarzik@redhat.com>
Signed-off-by: Jonathan Nieder <jrnieder@gmail.com>
---
Hi Greg,

Please consider

  0c8d32c27f5c libata: forbid port runtime pm by default, fixing
               regression

for inclusion in the 3.3-stable tree.  (It should apply there cleanly.
The copy in this message is just for easy reference.)

Michael Schmitt noticed[1] using a 3.3.4-based kernel that powering
his esata enclosure on, off, and back on again would cause Linux to no
longer recognize the disk.  By contrast, a 3.2.y-based kernel worked
fine.  Examining logs reveals that on 3.3.y the second time the
enclosure turns on, no PHYRdgyChg CommWake exception shows up:

| dmesg logs directly pasted here. So first, booted with powered down 
| esata enclosure and now, poweron:
| 
| [36997.268364] ata5: exception Emask 0x10 SAct 0x0 SErr 0x50000 action 0xe frozen
| [36997.268370] ata5: SError: { PHYRdyChg CommWake }
| [36997.268383] ata5: hard resetting link
[...]
| Disk works.
[...]
| mounted.... and umount again, now powerdown.
|
| [37437.877977] ata5: exception Emask 0x10 SAct 0x0 SErr 0x10000 action 0xe frozen
| [37437.877982] ata5: SError: { PHYRdyChg }
| [37437.877995] ata5: hard resetting link
[...]
| Drive gone... now, power-up again.
|
| adrastea:~# dmesg
| adrastea:~#
|
| Nothing. I did clear the kernel-message log in between...

With this patch, Michael found hotplug to work again.

See also [2] and [3].

Jeff seems to have acked it for stable already[4].

Hope that helps,
Jonathan

[1] http://bugs.debian.org/671689
[2] http://thread.gmane.org/gmane.linux.ide/51860/focus=51882
[3] https://bugzilla.redhat.com/show_bug.cgi?id=807632
[4] http://thread.gmane.org/gmane.linux.ide/51885/focus=51887

 drivers/ata/libata-transport.c |    1 +
 1 file changed, 1 insertion(+)

diff --git a/drivers/ata/libata-transport.c b/drivers/ata/libata-transport.c
index 74aaee30e264..c34190485377 100644
--- a/drivers/ata/libata-transport.c
+++ b/drivers/ata/libata-transport.c
@@ -294,6 +294,7 @@ int ata_tport_add(struct device *parent,
 	device_enable_async_suspend(dev);
 	pm_runtime_set_active(dev);
 	pm_runtime_enable(dev);
+	pm_runtime_forbid(dev);
 
 	transport_add_device(dev);
 	transport_configure_device(dev);
-- 
1.7.10.2


^ permalink raw reply related	[flat|nested] 37+ messages in thread

* Re: [PATCH 3.3.y] libata: forbid port runtime pm by default, fixing regression
  2012-05-19 23:58             ` [PATCH 3.3.y] libata: forbid port runtime pm by default, fixing regression Jonathan Nieder
@ 2012-05-24 17:30               ` Greg KH
  0 siblings, 0 replies; 37+ messages in thread
From: Greg KH @ 2012-05-24 17:30 UTC (permalink / raw)
  To: Jonathan Nieder
  Cc: stable, Michael Schmitt, Jeff Garzik, Martin Mokrejs, cwillu,
	Mark Lord, Tejun Heo, IDE/ATA development list

On Sat, May 19, 2012 at 06:58:54PM -0500, Jonathan Nieder wrote:
> From: Lin Ming <ming.m.lin@intel.com>
> Date: Wed, 18 Apr 2012 09:29:47 +0800
> 
> commit 0c8d32c27f5cf6e14ca14b4758d1e994eebd50fd upstream.
> 
> Forbid port runtime pm by default because it has known hotplug issue.
> User can allow it by, for example
> 
> echo auto > /sys/devices/pci0000:00/0000:00:1f.2/ata2/power/control
> 
> Signed-off-by: Lin Ming <ming.m.lin@intel.com>
> Signed-off-by: Jeff Garzik <jgarzik@redhat.com>
> Signed-off-by: Jonathan Nieder <jrnieder@gmail.com>
> ---
> Hi Greg,
> 
> Please consider
> 
>   0c8d32c27f5c libata: forbid port runtime pm by default, fixing
>                regression
> 
> for inclusion in the 3.3-stable tree.  (It should apply there cleanly.
> The copy in this message is just for easy reference.)

Now applied, thanks for letting me know.

greg k-h

^ permalink raw reply	[flat|nested] 37+ messages in thread

end of thread, other threads:[~2012-05-24 21:25 UTC | newest]

Thread overview: 37+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2012-04-17 20:38 Hotplug borked after suspend/resume in Linux-3.3 ? Mark Lord
2012-04-17 20:48 ` Mark Lord
2012-04-17 20:51   ` Tejun Heo
2012-04-17 20:53   ` Mark Lord
2012-04-17 21:02     ` Mark Lord
2012-04-17 21:05       ` cwillu
2012-04-18 17:10         ` Martin Mokrejs
2012-04-18 17:29           ` Jeff Garzik
2012-04-18 17:44             ` Martin Mokrejs
2012-04-18 18:23               ` Martin Mokrejs
2012-04-18 18:32               ` Martin Mokrejs
2012-04-19  1:31                 ` Lin Ming
     [not found]                 ` <CAF1ivSYqzjv10F+sdYkR_jdTZvzKP1=_ZwgNDj2njnmb6uaenA@mail.gmail.com>
2012-04-19  8:16                   ` Lin Ming
2012-04-19 17:28                     ` Martin Mokrejs
2012-04-19 18:22                     ` Martin Mokrejs
2012-04-20  1:46                       ` Lin Ming
2012-04-20  2:37                     ` Grant Grundler
2012-04-26  9:29                       ` Gwendal Grignou
2012-04-26 13:06                         ` Lin Ming
2012-04-26 16:50                           ` Gwendal Grignou
2012-05-03  1:26                         ` Lin Ming
2012-05-19 23:58             ` [PATCH 3.3.y] libata: forbid port runtime pm by default, fixing regression Jonathan Nieder
2012-05-24 17:30               ` Greg KH
2012-04-17 21:04     ` Hotplug borked after suspend/resume in Linux-3.3 ? Jeff Garzik
2012-04-17 20:57   ` Jeff Garzik
2012-04-17 21:05     ` Mark Lord
2012-04-17 21:10       ` Jeff Garzik
2012-04-17 21:16         ` Mark Lord
     [not found]           ` <CAF1ivSbEWJ18vV1ZqTnzWuZ5AXKwj+0pPPzCWUmnT_JKwKKQ2w@mail.gmail.com>
2012-04-18  1:29             ` Lin Ming
2012-04-18  1:37               ` Mark Lord
2012-04-18  1:46                 ` Mark Lord
2012-04-18  6:18                   ` Jeff Garzik
2012-04-18  1:52         ` Lin Ming
2012-04-18  2:28           ` Jeff Garzik
2012-04-17 20:50 ` Jeff Garzik
2012-04-17 21:07   ` Mark Lord
2012-04-17 21:14   ` Mark Lord

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).