[Linux-ia64] Re: Boot hangs "Probing PCI hardware"

[Linux-ia64] Re: Boot hangs "Probing PCI hardware"

["鶴川 達也"]

Dear Mr. Mares:

I'd like to revise the patch as follows.
I've also referenced the following spec.

PCI Local Bus Specification
Revision 2.2
December 18, 1998

P.204 of 6.2.5.1. Address Maps
It says as follows.
"Implementation Note: Sizing a 32 bit Base Address Register
Example
Decode (I/O or memory) of a register is disabled via the command register
before sizing a Base Address register.
  :
The original value in the Base Address register is restored before
re-enabling decode in the command register of the device."


*** pci.c.orig  Fri Apr  5 18:16:22 2002
--- pci.c       Fri Apr  5 18:50:26 2002
***************
*** 939,946 ****
--- 939,955 ----
  {
        unsigned int pos, reg, next;
        u32 l, sz;
+       u16 pcicmd_sv;
        struct resource *res;

+       /*
+        * Decode (I/O or memory) of a register is disabled via the command register
+        * before sizing a Base Address register.
+        */
+       pci_read_config_word(dev, PCI_COMMAND, &pcicmd_sv);
+       pci_write_config_word(dev, PCI_COMMAND,
+                       pcicmd_sv & ~(PCI_COMMAND_IO|PCI_COMMAND_MEMORY));
+
        for(pos=0; pos<howmany; pos = next) {
                next = pos+1;
                res = &dev->resource[pos];
***************
*** 1004,1009 ****
--- 1013,1022 ----
                }
                res->name = dev->name;
        }
+       /*
+        * re-enabling decode in the command register of the device.
+        */
+       pci_write_config_word(dev, PCI_COMMAND, pcicmd_sv);
  }

  void __devinit  pci_read_bridge_bases(struct pci_bus *child)

>I've found RHL7.2 boot sometimes hangs with "Probing PCI hardware" message
>on our Itanium based server.
>
>I also conclude it is a kernel problem in PCI device initialization.
>
>There is the following architectural difference between IA-32 and IA-64.
>IA-64 has SAPIC for interrupts and its messages are generated by Memory write 
>transaction to System reserved region on PCI Bus, instead of using APIC and 
>APIC Bus in IA-32.
>
>Therefore, from this point of view, BAR(Base Address Register) opertions in PCI
>device initialization must be changed between IA-32 and IA-64, but it has not 
>actually revised yet.
>
>I'll explain that in detail below and also provide the patch. If somebody 
>reflect it in Kernel source tree, I would be appreciated so much. I also hope 
>the next Kernel-2.4.19 includes following fixes.
>
>Our machine has two Itaniums (733MHz 2MB cache) and 512MB RAM. It also has
>three PCI Buses and the problem occurs in case of putting a video card (ATI Rage
>128 GL) on the first PCI Bus which also has SAPIC.
>
>I've also found it occurs on RHL7.1(Kernel-2.4.3-12), RHL7.2(Kernel-2.4.9-18)
>and the latest Kernel-2.4.18.
>
>Next, I'll describe the error sequence.
>
>There are some BAR operations in pci_read_bases() function of pci.c to get memory
>and IO space ranges assigned for each PCI device by writing 0xffffffff on BAR and
>reading it again. If an interrupt from SAPIC occurs during BAR operations, the 
>first PCI Bus hangs.
>
>In this case, the video device gets 64MB memory space from 0xFC000000 to 
>0xFFFFFFFF improperly, and it conflicts with System reserve region (0xFCxxxxxx -
>0xFExxxxxx) for SAPIC interrupt messages. After that the video device reacts to 
>an SAPIC interrupt improperly.
>
>According to PCI specifications, it is necessary to disable Memory IO target
>function during BAR operations by setting zero to bit0/1 of PCI_COMMAND, but
>current pci_read_bases() doesn't do that.
>
>I'd like to provide the following patch, and I've already found it works well 
>on both RHL7.2 and Kernel-2.4.18.
>
>
>*** pci.c.orig  Tue Apr  2 19:56:06 2002
>--- pci.c       Tue Apr  2 19:56:14 2002
>***************
>*** 939,946 ****
>--- 939,950 ----
>  {
>        unsigned int pos, reg, next;
>        u32 l, sz;
>+       u16 pcicmd_sv;
>        struct resource *res;
>
>+       pci_read_config_word(dev, PCI_COMMAND, &pcicmd_sv);
>+       pci_write_config_word(dev, PCI_COMMAND, pcicmd_sv & 0xfffc);
>+
>        for(pos=0; pos<howmany; pos = next) {
>                next = pos+1;
>                res = &dev->resource[pos];
>***************
>*** 1004,1009 ****
>--- 1008,1014 ----
>                }
>                res->name = dev->name;
>        }
>+       pci_write_config_word(dev, PCI_COMMAND, pcicmd_sv);
>  }
>
>  void __devinit  pci_read_bridge_bases(struct pci_bus *child)
>
>
>Finally, I think this problem may occur theoretically in case of having memory 
>consuming devices (more than 32MB) like a video card and SAPIC on the same PCI
>Bus. Do you know the same problem on a Lion box ?
>
>PS.
>I've already sent the same mail to ia64-list@redhat.com.
>
>Best regards,
>Tatsuya Tsurukawa
>Mitsubishi Electric
>
>----
>Tatsuya   turukawa@icc.melco.co.jp

Best regards,
Tatsuya Tsurukawa
Mitsubishi Electric

Re: [Linux-ia64] Re: Boot hangs "Probing PCI hardware"

[Grant Grundler]

=?iso-2022-jp?B?IhskQkRhQG4hIUMjTGkbKEIi?= wrote:
...
> In this case, the video device gets 64MB memory space from 0xFC000000 to
> 0xFFFFFFFF improperly, and it conflicts with System reserve region
> (0xFCxxxxxx - 0xFExxxxxx) for SAPIC interrupt messages. After that
> the video device reacts to an SAPIC interrupt improperly.

Martin, et al,
I also believe this is a problem.
I just haven't seen it because I'm always using serial console.

This problem might also exist on x86 Foster CPU as well.
The new x86 CPU also uses IO-xAPIC and Local xAPIC.
I don't have access to a physical memory map of such a box
to confirm it though.

I don't believe this is a problem on HP parisc (also uses
IO-SAPIC) because of how PCI address routing works.

grant