Re: [PATCH v4 0/5] PCI: EP: Add RC-to-EP doorbell with platform MSI controller

[Frank Li <Frank.li@nxp.com>]

On Wed, Nov 06, 2024 at 10:36:42AM +0100, Niklas Cassel wrote:
> On Wed, Nov 06, 2024 at 10:15:27AM +0100, Niklas Cassel wrote:
> >
> > I do get a domain, but I do not get any IRQ on the EP side when the RC side is
> > writing the doorbell (as part of pcitest -B),
> >
> > [    7.978984] pci_epc_alloc_doorbell: num_db: 1
> > [    7.979545] pci_epf_test_bind: doorbell_addr: 0x40
> > [    7.979978] pci_epf_test_bind: doorbell_data: 0x0
> > [    7.980397] pci_epf_test_bind: doorbell_bar: 0x1
> > [   21.114613] pci_epf_enable_doorbell db_bar: 1
> > [   21.115001] pci_epf_enable_doorbell: doorbell_addr: 0xfe650040
> > [   21.115512] pci_epf_enable_doorbell: phys_addr: 0xfe650000
> > [   21.115994] pci_epf_enable_doorbell: success
> >
> > # cat /proc/interrupts | grep epc
> > 117:          0          0          0          0          0          0          0          0  ITS-pMSI-a40000000.pcie-ep   0 Edge      pci-epc-doorbell0
> >
> > Even if I try to write the doorbell manually from EP side using devmem:
> >
> > # devmem 0xfe670040 32 1
>
> Sorry, this should of course have been:
> # devmem 0xfe650040 32 1

Thank you test it. You can't write it at EP side. ITS identify the bus
master. master ID (streamid) of CPU is the diffference with PCI master's
ID (streamid). You set msi-parent = <&its0 0x0000>, not sure if 0x0000 is
validate stream.

You have to run at RC side, "devmem (Bar1+0x40) 32 0".  So PCIe EP
controller can use EP streamid.

some system need special register to config stream id, you can refer host
side's settings.

Frank

>
> But the result is the name, no IRQ triggered on the EP side.
>
> (My command above was from testing "msi-parent = <&its0 0x0000>",
> rather than &its1, but that also didn't work when writing the
> corresponding "doorbell_addr" using e.g. devmem.)

<&its0 0x0000>,  second argument is your PCIe controller's stream ID. You
can ref RC side.

>
> Considering that the RC node is using &its1, that is probably
> also what should be used in the EP node when running the controller
> in EP mode instead of RC mode.

Generally,  RC node should use smmu-map, instead &its1. Or your PCI
controller direct use 16bit RID as streamid.

>
>
> Kind regards,
> Niklas