Linux PCI subsystem development
 help / color / mirror / Atom feed
* [PATCH] PCI/MSI: add iounmap in msix_capability_init()
@ 2026-01-25 14:44 Haoxiang Li
  2026-02-06 22:37 ` Bjorn Helgaas
                   ` (2 more replies)
  0 siblings, 3 replies; 6+ messages in thread
From: Haoxiang Li @ 2026-01-25 14:44 UTC (permalink / raw)
  To: bhelgaas, tglx, jgross, hans.zhang, himanshu.madhani, roger.pau,
	chrisl
  Cc: linux-pci, linux-kernel, Haoxiang Li

In msix_capability_init(), if msix_setup_interrupts()
fails, call iounmap() to release the memory allocated
by msix_map_region().

Signed-off-by: Haoxiang Li <lihaoxiang@isrc.iscas.ac.cn>
---
 drivers/pci/msi/msi.c | 4 +++-
 1 file changed, 3 insertions(+), 1 deletion(-)

diff --git a/drivers/pci/msi/msi.c b/drivers/pci/msi/msi.c
index 34d664139f48..e010ecd9f90d 100644
--- a/drivers/pci/msi/msi.c
+++ b/drivers/pci/msi/msi.c
@@ -737,7 +737,7 @@ static int msix_capability_init(struct pci_dev *dev, struct msix_entry *entries,
 
 	ret = msix_setup_interrupts(dev, entries, nvec, affd);
 	if (ret)
-		goto out_disable;
+		goto out_unmap;
 
 	/* Disable INTX */
 	pci_intx_for_msi(dev, 0);
@@ -758,6 +758,8 @@ static int msix_capability_init(struct pci_dev *dev, struct msix_entry *entries,
 	pcibios_free_irq(dev);
 	return 0;
 
+out_unmap:
+	iounmap(dev->msix_base);
 out_disable:
 	dev->msix_enabled = 0;
 	pci_msix_clear_and_set_ctrl(dev, PCI_MSIX_FLAGS_MASKALL | PCI_MSIX_FLAGS_ENABLE, 0);
-- 
2.25.1


^ permalink raw reply related	[flat|nested] 6+ messages in thread

* Re: [PATCH] PCI/MSI: add iounmap in msix_capability_init()
  2026-01-25 14:44 [PATCH] PCI/MSI: add iounmap in msix_capability_init() Haoxiang Li
@ 2026-02-06 22:37 ` Bjorn Helgaas
  2026-03-10 14:38 ` Guenter Roeck
  2026-03-16 17:22 ` Guenter Roeck
  2 siblings, 0 replies; 6+ messages in thread
From: Bjorn Helgaas @ 2026-02-06 22:37 UTC (permalink / raw)
  To: Haoxiang Li
  Cc: bhelgaas, tglx, jgross, hans.zhang, himanshu.madhani, roger.pau,
	chrisl, linux-pci, linux-kernel

On Sun, Jan 25, 2026 at 10:44:52PM +0800, Haoxiang Li wrote:
> In msix_capability_init(), if msix_setup_interrupts()
> fails, call iounmap() to release the memory allocated
> by msix_map_region().
> 
> Signed-off-by: Haoxiang Li <lihaoxiang@isrc.iscas.ac.cn>
> ---
>  drivers/pci/msi/msi.c | 4 +++-
>  1 file changed, 3 insertions(+), 1 deletion(-)
> 
> diff --git a/drivers/pci/msi/msi.c b/drivers/pci/msi/msi.c
> index 34d664139f48..e010ecd9f90d 100644
> --- a/drivers/pci/msi/msi.c
> +++ b/drivers/pci/msi/msi.c
> @@ -737,7 +737,7 @@ static int msix_capability_init(struct pci_dev *dev, struct msix_entry *entries,
>  
>  	ret = msix_setup_interrupts(dev, entries, nvec, affd);
>  	if (ret)
> -		goto out_disable;
> +		goto out_unmap;
>  
>  	/* Disable INTX */
>  	pci_intx_for_msi(dev, 0);
> @@ -758,6 +758,8 @@ static int msix_capability_init(struct pci_dev *dev, struct msix_entry *entries,
>  	pcibios_free_irq(dev);
>  	return 0;
>  
> +out_unmap:
> +	iounmap(dev->msix_base);

Maybe Thomas has already applied this, and if not, he should chime in.

Personally, I would prefer if msix_map_region() were renamed and made
to return the phys_addr instead of returning the ioremapped address.
That way both the ioremap() and the iounmap() on failure would be in
msix_capability_init() so it's easier to review.

>  out_disable:
>  	dev->msix_enabled = 0;
>  	pci_msix_clear_and_set_ctrl(dev, PCI_MSIX_FLAGS_MASKALL | PCI_MSIX_FLAGS_ENABLE, 0);
> -- 
> 2.25.1
> 

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: [PATCH] PCI/MSI: add iounmap in msix_capability_init()
  2026-01-25 14:44 [PATCH] PCI/MSI: add iounmap in msix_capability_init() Haoxiang Li
  2026-02-06 22:37 ` Bjorn Helgaas
@ 2026-03-10 14:38 ` Guenter Roeck
  2026-03-16 17:22 ` Guenter Roeck
  2 siblings, 0 replies; 6+ messages in thread
From: Guenter Roeck @ 2026-03-10 14:38 UTC (permalink / raw)
  To: Haoxiang Li
  Cc: bhelgaas, tglx, jgross, hans.zhang, himanshu.madhani, roger.pau,
	chrisl, linux-pci, linux-kernel

Hi,

On Sun, Jan 25, 2026 at 10:44:52PM +0800, Haoxiang Li wrote:
> In msix_capability_init(), if msix_setup_interrupts()
> fails, call iounmap() to release the memory allocated
> by msix_map_region().
> 

AI review has the following feedback:

  In __msix_setup_interrupts(), `dev` is declared with the
  `__free(free_msi_irqs)` cleanup attribute. If an error is returned,
  pci_free_msi_irqs() is automatically called.

  pci_free_msi_irqs() already unmaps dev->msix_base and sets it to NULL:

  void pci_free_msi_irqs(struct pci_dev *dev)
  {
	...
	if (dev->msix_base) {
		iounmap(dev->msix_base);
		dev->msix_base = NULL;
	}
  }

  So if msix_setup_interrupts() fails, dev->msix_base has already been
  unmapped and is NULL by the time we reach this new error path.
  Is this extra iounmap() necessary?

I checked the code, and agree.

Thanks,
Guenter

> Signed-off-by: Haoxiang Li <lihaoxiang@isrc.iscas.ac.cn>
> ---
>  drivers/pci/msi/msi.c | 4 +++-
>  1 file changed, 3 insertions(+), 1 deletion(-)
> 
> diff --git a/drivers/pci/msi/msi.c b/drivers/pci/msi/msi.c
> index 34d664139f48..e010ecd9f90d 100644
> --- a/drivers/pci/msi/msi.c
> +++ b/drivers/pci/msi/msi.c
> @@ -737,7 +737,7 @@ static int msix_capability_init(struct pci_dev *dev, struct msix_entry *entries,
>  
>  	ret = msix_setup_interrupts(dev, entries, nvec, affd);
>  	if (ret)
> -		goto out_disable;
> +		goto out_unmap;
>  
>  	/* Disable INTX */
>  	pci_intx_for_msi(dev, 0);
> @@ -758,6 +758,8 @@ static int msix_capability_init(struct pci_dev *dev, struct msix_entry *entries,
>  	pcibios_free_irq(dev);
>  	return 0;
>  
> +out_unmap:
> +	iounmap(dev->msix_base);
>  out_disable:
>  	dev->msix_enabled = 0;
>  	pci_msix_clear_and_set_ctrl(dev, PCI_MSIX_FLAGS_MASKALL | PCI_MSIX_FLAGS_ENABLE, 0);
> -- 
> 2.25.1
> 

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: [PATCH] PCI/MSI: add iounmap in msix_capability_init()
  2026-01-25 14:44 [PATCH] PCI/MSI: add iounmap in msix_capability_init() Haoxiang Li
  2026-02-06 22:37 ` Bjorn Helgaas
  2026-03-10 14:38 ` Guenter Roeck
@ 2026-03-16 17:22 ` Guenter Roeck
  2026-06-10  9:19   ` Yuanhe Shu
  2 siblings, 1 reply; 6+ messages in thread
From: Guenter Roeck @ 2026-03-16 17:22 UTC (permalink / raw)
  To: Haoxiang Li
  Cc: bhelgaas, tglx, jgross, hans.zhang, himanshu.madhani, roger.pau,
	chrisl, linux-pci, linux-kernel

Hi,

On Sun, Jan 25, 2026 at 10:44:52PM +0800, Haoxiang Li wrote:
> In msix_capability_init(), if msix_setup_interrupts()
> fails, call iounmap() to release the memory allocated
> by msix_map_region().
> 
Really ? AI review provided the following feedback. Looking into the code,
I think it has a point.

Thanks,
Guenter

> Signed-off-by: Haoxiang Li <lihaoxiang@isrc.iscas.ac.cn>
> ---
>  drivers/pci/msi/msi.c | 4 +++-
>  1 file changed, 3 insertions(+), 1 deletion(-)
> 
> diff --git a/drivers/pci/msi/msi.c b/drivers/pci/msi/msi.c
> index 34d664139f48..e010ecd9f90d 100644
> --- a/drivers/pci/msi/msi.c
> +++ b/drivers/pci/msi/msi.c
> @@ -737,7 +737,7 @@ static int msix_capability_init(struct pci_dev *dev, struct msix_entry *entries,
>  
>  	ret = msix_setup_interrupts(dev, entries, nvec, affd);
>  	if (ret)
> -		goto out_disable;
> +		goto out_unmap;

Does msix_setup_interrupts() already unmap this region? If it fails,
msix_setup_interrupts() calls pci_free_msi_irqs(), which appears to already
call iounmap(dev->msix_base) and sets dev->msix_base to NULL.

>  
>  	/* Disable INTX */
>  	pci_intx_for_msi(dev, 0);
> @@ -758,6 +758,8 @@ static int msix_capability_init(struct pci_dev *dev, struct msix_entry *entries,
>  	pcibios_free_irq(dev);
>  	return 0;
>  
> +out_unmap:
> +	iounmap(dev->msix_base);

If dev->msix_base was already set to NULL by pci_free_msi_irqs() during the
msix_setup_interrupts() error path, does this result in iounmap(NULL)?

>  out_disable:
>  	dev->msix_enabled = 0;
>  	pci_msix_clear_and_set_ctrl(dev, PCI_MSIX_FLAGS_MASKALL | PCI_MSIX_FLAGS_ENABLE, 0);
> -- 
> 2.25.1
> 

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: [PATCH] PCI/MSI: add iounmap in msix_capability_init()
  2026-03-16 17:22 ` Guenter Roeck
@ 2026-06-10  9:19   ` Yuanhe Shu
  2026-06-10 19:44     ` Bjorn Helgaas
  0 siblings, 1 reply; 6+ messages in thread
From: Yuanhe Shu @ 2026-06-10  9:19 UTC (permalink / raw)
  To: linux, lihaoxiang
  Cc: tglx, bhelgaas, jgross, hans.zhang, himanshu.madhani, roger.pau,
	chrisl, linux-pci, linux-kernel

On Mon, 16 Mar 2026 at 10:22:12 -0700, Guenter Roeck wrote:
> Does msix_setup_interrupts() already unmap this region? If it fails,
> msix_setup_interrupts() calls pci_free_msi_irqs(), which appears to already
> call iounmap(dev->msix_base) and sets dev->msix_base to NULL.
>
> If dev->msix_base was already set to NULL by pci_free_msi_irqs() during the
> msix_setup_interrupts() error path, does this result in iounmap(NULL)?

Confirmed. We hit this on Intel Emerald Rapids (192 CPUs) when running
tools/testing/selftests/kexec/test_kexec_jump.sh.

The commit message of 1a8d4c6ecb4c states:

  "msix_capability_init() fails to unmap the MSI-X region if
   msix_setup_interrupts() fails."

This is incorrect. There is no leak on this error path.

When msix_setup_interrupts() fails, the call chain is:

  msix_setup_interrupts()
    -> __msix_setup_interrupts()
         struct pci_dev *dev __free(free_msi_irqs) = __dev;
         ...
         return ret;  // __free cleanup fires on error

The __free(free_msi_irqs) cleanup calls pci_free_msi_irqs(), which
already handles the unmap:

  void pci_free_msi_irqs(struct pci_dev *dev)
  {
      pci_msi_teardown_msi_irqs(dev);
      if (dev->msix_base) {
          iounmap(dev->msix_base);   // already unmapped here
          dev->msix_base = NULL;     // and set to NULL
      }
  }

So dev->msix_base is unmapped and NULLed before msix_setup_interrupts()
even returns to msix_capability_init(). The original "goto out_disable"
was correct -- it skipped iounmap because the cleanup was already done.

Commit 1a8d4c6ecb4c changed it to "goto out_unmap", adding a second
iounmap() call on an already-NULL pointer, which triggers:

  WARNING: CPU#44 at iounmap+0x2a/0xe0
  Workqueue: nvme-reset-wq nvme_reset_work [nvme]
  RIP: 0010:iounmap+0x2a/0xe0
  ...
  RDI: 0000000000000000
  ...
  Call Trace:
   <TASK>
   msix_capability_init+0x317/0x3f0
   __pci_enable_msix_range+0x21d/0x2c0
   pci_alloc_irq_vectors_affinity+0xa9/0x130
   nvme_setup_io_queues+0x2a8/0x420 [nvme]
   ? __pfx_nvme_calc_irq_sets+0x10/0x10 [nvme]
   nvme_reset_work+0x151/0x340 [nvme]
   process_one_work+0x197/0x3a0
   worker_thread+0x1ab/0x320
   ? __pfx_worker_thread+0x10/0x10

RDI=0 confirms iounmap() is called with NULL.

This commit should probably be reverted. The out_unmap label and its
iounmap() are redundant with the __free(free_msi_irqs) scoped cleanup
in __msix_setup_interrupts(), which already takes care of unmapping
dev->msix_base on any error path.


^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: [PATCH] PCI/MSI: add iounmap in msix_capability_init()
  2026-06-10  9:19   ` Yuanhe Shu
@ 2026-06-10 19:44     ` Bjorn Helgaas
  0 siblings, 0 replies; 6+ messages in thread
From: Bjorn Helgaas @ 2026-06-10 19:44 UTC (permalink / raw)
  To: Yuanhe Shu
  Cc: linux, lihaoxiang, tglx, bhelgaas, jgross, hans.zhang,
	himanshu.madhani, roger.pau, chrisl, linux-pci, linux-kernel

On Wed, Jun 10, 2026 at 05:19:51PM +0800, Yuanhe Shu wrote:
> On Mon, 16 Mar 2026 at 10:22:12 -0700, Guenter Roeck wrote:
> > Does msix_setup_interrupts() already unmap this region? If it fails,
> > msix_setup_interrupts() calls pci_free_msi_irqs(), which appears to already
> > call iounmap(dev->msix_base) and sets dev->msix_base to NULL.
> >
> > If dev->msix_base was already set to NULL by pci_free_msi_irqs() during the
> > msix_setup_interrupts() error path, does this result in iounmap(NULL)?
> 
> Confirmed. We hit this on Intel Emerald Rapids (192 CPUs) when running
> tools/testing/selftests/kexec/test_kexec_jump.sh.
> 
> The commit message of 1a8d4c6ecb4c states:
> 
>   "msix_capability_init() fails to unmap the MSI-X region if
>    msix_setup_interrupts() fails."
> 
> This is incorrect. There is no leak on this error path.
> 
> When msix_setup_interrupts() fails, the call chain is:
> 
>   msix_setup_interrupts()
>     -> __msix_setup_interrupts()
>          struct pci_dev *dev __free(free_msi_irqs) = __dev;
>          ...
>          return ret;  // __free cleanup fires on error
> 
> The __free(free_msi_irqs) cleanup calls pci_free_msi_irqs(), which
> already handles the unmap:
> 
>   void pci_free_msi_irqs(struct pci_dev *dev)
>   {
>       pci_msi_teardown_msi_irqs(dev);
>       if (dev->msix_base) {
>           iounmap(dev->msix_base);   // already unmapped here
>           dev->msix_base = NULL;     // and set to NULL
>       }
>   }
> 
> So dev->msix_base is unmapped and NULLed before msix_setup_interrupts()
> even returns to msix_capability_init(). The original "goto out_disable"
> was correct -- it skipped iounmap because the cleanup was already done.
> 
> Commit 1a8d4c6ecb4c changed it to "goto out_unmap", adding a second
> iounmap() call on an already-NULL pointer, which triggers:
> 
>   WARNING: CPU#44 at iounmap+0x2a/0xe0
>   Workqueue: nvme-reset-wq nvme_reset_work [nvme]
>   RIP: 0010:iounmap+0x2a/0xe0
>   ...
>   RDI: 0000000000000000
>   ...
>   Call Trace:
>    <TASK>
>    msix_capability_init+0x317/0x3f0
>    __pci_enable_msix_range+0x21d/0x2c0
>    pci_alloc_irq_vectors_affinity+0xa9/0x130
>    nvme_setup_io_queues+0x2a8/0x420 [nvme]
>    ? __pfx_nvme_calc_irq_sets+0x10/0x10 [nvme]
>    nvme_reset_work+0x151/0x340 [nvme]
>    process_one_work+0x197/0x3a0
>    worker_thread+0x1ab/0x320
>    ? __pfx_worker_thread+0x10/0x10
> 
> RDI=0 confirms iounmap() is called with NULL.
> 
> This commit should probably be reverted. The out_unmap label and its
> iounmap() are redundant with the __free(free_msi_irqs) scoped cleanup
> in __msix_setup_interrupts(), which already takes care of unmapping
> dev->msix_base on any error path.

Thanks a lot for testing and verifying the issue!

I guess it's 1a8d4c6ecb4c ("PCI/MSI: Unmap MSI-X region on error")
that you think should be reverted?  Can you or Haoxiang send a patch
to do that so this is unambiguous?

It looks like Thomas applied 1a8d4c6ecb4c, so I'll leave it up to him
to handle any revert.

^ permalink raw reply	[flat|nested] 6+ messages in thread

end of thread, other threads:[~2026-06-10 19:44 UTC | newest]

Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2026-01-25 14:44 [PATCH] PCI/MSI: add iounmap in msix_capability_init() Haoxiang Li
2026-02-06 22:37 ` Bjorn Helgaas
2026-03-10 14:38 ` Guenter Roeck
2026-03-16 17:22 ` Guenter Roeck
2026-06-10  9:19   ` Yuanhe Shu
2026-06-10 19:44     ` Bjorn Helgaas

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox