Regression introduced in v3.2.12 stable

Regression introduced in v3.2.12 stable

[Joseph Salisbury]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hello,

I figured I'd send a heads up regarding a possible regression in v3.2.12
stable.  The issue prevents systems from booting.

There have been a few bugs[0] reported against the Ubuntu kernel, which
was recently rebased to 3.2.12.  We're in the process of bisecting now
and will post an update..

Thanks,

Joe

https://bugs.launchpad.net/ubuntu/+source/linux/+bug/961482
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQIcBAEBAgAGBQJPa3o3AAoJEGzvPSfKWxQeiXEQAMFKzJj+urC+JyVXfTOOjV/z
iv7/nMAHFPvKgNpDFpk+SM3pFDgZJ/7JZn5Bjl6nidycJy79uCoYxBehBycohtkn
De3Qvefq4lUvIdVpxbM1GhjxRphru8tnGmUOsC1a9S30aYPhRKcHSIGpZZyaSE7k
XmdbI3XEtu1pNiML4Q7lJku5VbOrAt4mm0vBoNpczdTikaAsuLsNnLPju94el3iR
z0Ra7U5buxM06d4T81xoOqVRmcVU8kVsC9Rebp7W2Cfo8VBkkzdlyRsmCCVFL7j/
3Hi5Ir0DCSY7nvPgnlcmOPvF9J4TwgCDkpAheNFkQQph3jc9q7XrlsG3310LeAW7
7w4dtTt+m7FmkmveRmvkC54av2YdqgabcJDMDPlXQ6GC6tdYU7H3dvvKJsz1NbT0
H5JlURCE0zmnMEUnErVLhMCrNm3AFdQQGpJkut3roapSxJfARatowu5Vu+eFzmhV
DCwZpRUKjdvCd88dn+blSBRTb2BLDGYTSP5/Lp2gehdeStrLs3QVJDq8VDGHQUq5
b5zAM1BAmgtT8eCyJHLGVrjO7dmuMRVBqitn4IGbcAeUbd9bSNxuZ4fnkjrVlW4f
Qy1xzws5qGqSYQt39tIG0uvSYar2U4UBUmJERr1FBAEb5FvnGnA5enB75RFWqwR1
q8dxiWcHxI9jG4/wVFq7
=3Uid
-----END PGP SIGNATURE-----

Re: Regression introduced in v3.2.12 stable

[Joseph Salisbury]

On 03/22/2012 03:15 PM, Joseph Salisbury wrote:
> Hello,
> 
> I figured I'd send a heads up regarding a possible regression in v3.2.12
> stable.  The issue prevents systems from booting.
> 
> There have been a few bugs[0] reported against the Ubuntu kernel, which
> was recently rebased to 3.2.12.  We're in the process of bisecting now
> and will post an update..
> 
> Thanks,
> 
> Joe
> 
> https://bugs.launchpad.net/ubuntu/+source/linux/+bug/961482
> --
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at  http://www.tux.org/lkml/

It's also been noted that this bug happens in the latest version of v3.3.

Re: Regression introduced in v3.2.12 stable

[Greg KH]

On Thu, Mar 22, 2012 at 03:15:03PM -0400, Joseph Salisbury wrote:
> I figured I'd send a heads up regarding a possible regression in v3.2.12
> stable.  The issue prevents systems from booting.
> 
> There have been a few bugs[0] reported against the Ubuntu kernel, which
> was recently rebased to 3.2.12.  We're in the process of bisecting now
> and will post an update..

What specifically happens here when the system does not boot?  Any error
message?  Are you sure this isn't the known pci express issue showing up
here?

Can you run 'git bisect' to trace it down to a specific patch please?

thanks,

greg k-h

Re: Regression introduced in v3.2.12 stable

[Joseph Salisbury]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 03/22/2012 05:26 PM, Greg KH wrote:
> On Thu, Mar 22, 2012 at 03:15:03PM -0400, Joseph Salisbury wrote:
>> I figured I'd send a heads up regarding a possible regression in v3.2.12
>> stable.  The issue prevents systems from booting.
>>
>> There have been a few bugs[0] reported against the Ubuntu kernel, which
>> was recently rebased to 3.2.12.  We're in the process of bisecting now
>> and will post an update..
> 
> What specifically happens here when the system does not boot?  Any error
> message?  Are you sure this isn't the known pci express issue showing up
> here?
> 
> Can you run 'git bisect' to trace it down to a specific patch please?
> 
> thanks,
> 
> greg k-h

Hi Greg,

Thanks for the response.

We did some bisecting/testing and identified the bad commit in 3.2.12 as
the following:

f043ddb60c84ea64a23b755004572afe922e653c PCI: ignore pre-1.1 ASPM
quirking when ASPM is disabled
diff --git a/drivers/pci/pcie/aspm.c b/drivers/pci/pcie/aspm.c
index 1cfbf22..24f049e 100644
- --- a/drivers/pci/pcie/aspm.c
+++ b/drivers/pci/pcie/aspm.c
@@ -500,6 +500,9 @@ static int pcie_aspm_sanity_check(struct pci_dev *pdev)
        int pos;
        u32 reg32;

+       if (aspm_disabled)
+               return 0;
+
        /*
         * Some functions in a slot might not all be PCIe functions,
         * very strange. Disable ASPM for the whole slot


Building a test kernel with this commit reverted allows the machines to
boot.  I see there has already been some discussion on this commit[0]

Thanks,

Joe

[0] https://lkml.org/lkml/2012/3/19/408
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQIcBAEBAgAGBQJPa50OAAoJEGzvPSfKWxQe1owP/2esbjlmY9UsZwNTRUeH2Ujz
uNejdESt+Wj40pEvofs8xSWYLik/G7ogn9jpSBkjo0D9sgESKeQENtSRzACmy4dr
ZmLiIp46uvLhFLIokMYOle6/OZ73A9GFAkr++MqPzYV7XGWSCxxDS9ly73CBT1wy
vfZGWg9l/qDXdHmJDiJYiR+GQsno0pFJtroAdqNqDEXTRjJCWVcD03aotxXw8BWy
MxOVBQHsq61IUFPRyf7IrEOhj1myxzAdVqwuUubJ5Yvzo1/6NWY7y6CB3YJ/gtnZ
uaQ4fNdzAY2jIoKE2fBLz/fFPETW/vkb1tsh4of4Jalcsf2Whh6cPAgYeGPRNB+C
ToQ0VLiIkKKm1en+PmUQ+bOqkyh3dvIppUFiyIEX85YeuCxSOryJ9WXDcUuWNLbn
h2ru9HkSW0pctUuU+quR7tyo5mYlxgxR7Ox9oMO0i86BW6HMVeGDDc1BSZgzHYcj
WClxLysuVkXvMHG3p3wCrJpSSyLS23+S3278RnnqmxM4Xul0VCxLDLZfQG5hZB2L
sZYVwjlPphZJOoNdnRLqTdPeBjVKRM2r9nSe21naxhDXI0MbaDpzpJTDx9h1n7Pb
9D7pzeEiprUi/5/9qnwVtjuhTRdB7QwYUA6rKWBqyf0lOItDOU6n3iPqp2llx7EJ
GK6MOek8ODPzV2smclb7
=IDuC
-----END PGP SIGNATURE-----

Re: Regression introduced in v3.2.12 stable

[Greg KH]

On Thu, Mar 22, 2012 at 05:43:42PM -0400, Joseph Salisbury wrote:
> On 03/22/2012 05:26 PM, Greg KH wrote:
> > On Thu, Mar 22, 2012 at 03:15:03PM -0400, Joseph Salisbury wrote:
> >> I figured I'd send a heads up regarding a possible regression in v3.2.12
> >> stable.  The issue prevents systems from booting.
> >>
> >> There have been a few bugs[0] reported against the Ubuntu kernel, which
> >> was recently rebased to 3.2.12.  We're in the process of bisecting now
> >> and will post an update..
> > 
> > What specifically happens here when the system does not boot?  Any error
> > message?  Are you sure this isn't the known pci express issue showing up
> > here?
> > 
> > Can you run 'git bisect' to trace it down to a specific patch please?
> > 
> > thanks,
> > 
> > greg k-h
> 
> Hi Greg,
> 
> Thanks for the response.
> 
> We did some bisecting/testing and identified the bad commit in 3.2.12 as
> the following:
> 
> f043ddb60c84ea64a23b755004572afe922e653c PCI: ignore pre-1.1 ASPM
> quirking when ASPM is disabled

Yup, that's the known problem one.  But, note that it does solve other
people's problems at the moment, so you can't just ignore it :)

greg k-h

Re: Regression introduced in v3.2.12 stable

[Joseph Salisbury]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 03/22/2012 05:52 PM, Greg KH wrote:
> On Thu, Mar 22, 2012 at 05:43:42PM -0400, Joseph Salisbury wrote:
>> On 03/22/2012 05:26 PM, Greg KH wrote:
>>> On Thu, Mar 22, 2012 at 03:15:03PM -0400, Joseph Salisbury
>>> wrote:
>>>> I figured I'd send a heads up regarding a possible regression
>>>> in v3.2.12 stable.  The issue prevents systems from booting.
>>>> 
>>>> There have been a few bugs[0] reported against the Ubuntu
>>>> kernel, which was recently rebased to 3.2.12.  We're in the
>>>> process of bisecting now and will post an update..
>>> 
>>> What specifically happens here when the system does not boot?
>>> Any error message?  Are you sure this isn't the known pci
>>> express issue showing up here?
>>> 
>>> Can you run 'git bisect' to trace it down to a specific patch
>>> please?
>>> 
>>> thanks,
>>> 
>>> greg k-h
>> 
>> Hi Greg,
>> 
>> Thanks for the response.
>> 
>> We did some bisecting/testing and identified the bad commit in
>> 3.2.12 as the following:
>> 
>> f043ddb60c84ea64a23b755004572afe922e653c PCI: ignore pre-1.1
>> ASPM quirking when ASPM is disabled
> 
> Yup, that's the known problem one.  But, note that it does solve
> other people's problems at the moment, so you can't just ignore it
> :)
> 
> greg k-h

Thanks for the info, Greg.  I'll keep up to date on the other thread.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQIcBAEBAgAGBQJPa59kAAoJEGzvPSfKWxQeb5sP/RA075hhvENhxPXH6/abvdZx
/yZSybKjF+iIZIdxcauK9iVTUvhPnHwd1q5knC1tDb+kBbjqVcCbacWNVQr/kHdz
/tnhLyOFof5dVNAW+/6/C4mGtixti8+SmUW3nX0qvjaFKxYfDebFekMJ0sAfLMRd
DSEss9jA657Cct17KSDJMQfvZ6QRqMkGVtxV20fKeMeBYNRw4pyAAMUus75IGA8L
XzSA5z4Bf82MkhWc4VMY2X6awSwKyxWnyRCIllo3EdUQJQ80GYK0NVhzFyTy7Yqs
7WRkUqY99VSy0EgpRayDZ5/MRKVjbYJge8O0L3IMRVV/JbVChIQ1T1JRwnSJuGUe
dB2ZGR1uVFEJED9loB+PZNH477E11wt1UDkEsiDl9PnIghSrG2YC6YRm/K3HZrRS
7pSYqqX2xZbm+pH2rE4X0gdxnRk6RxjaQzy7bApOv9YZgVSpDKYbal6ajpLlYG4w
PAgW6NBDba6sIcBf+6mnQwzk/np7gl6MUBo+bJ2dY1nUzAFfYyp8a8359jDc1aDf
MAPpyiztiI4YnsG5WE7suPv1HAeQf8rXFaTJFIkEIRDJuT0uLnz/DKE0MJTjpiUC
SQKAMcN5H+dfgcA33QUP/SRcgTogHjG0K1SVUmo2e8pasAlBRJkSPbrZ5QVa7dkJ
z2JLI0pN27TLBTbNgWaj
=cX2M
-----END PGP SIGNATURE-----