From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-14.0 required=3.0 tests=BAYES_00,INCLUDES_CR_TRAILER, INCLUDES_PATCH,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id EAD67C433E0 for ; Fri, 26 Mar 2021 12:59:30 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 9C00E619E8 for ; Fri, 26 Mar 2021 12:59:30 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229995AbhCZM66 (ORCPT ); Fri, 26 Mar 2021 08:58:58 -0400 Received: from mail.kernel.org ([198.145.29.99]:59146 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230093AbhCZM6k (ORCPT ); Fri, 26 Mar 2021 08:58:40 -0400 Received: from disco-boy.misterjones.org (disco-boy.misterjones.org [51.254.78.96]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 489C7619BF; Fri, 26 Mar 2021 12:58:40 +0000 (UTC) Received: from 78.163-31-62.static.virginmediabusiness.co.uk ([62.31.163.78] helo=wait-a-minute.misterjones.org) by disco-boy.misterjones.org with esmtpsa (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94) (envelope-from ) id 1lPm2w-003yqm-1z; Fri, 26 Mar 2021 12:58:38 +0000 Date: Fri, 26 Mar 2021 12:58:37 +0000 Message-ID: <87r1k2f4w2.wl-maz@kernel.org> From: Marc Zyngier To: "Dey, Megha" Cc: tglx@linutronix.de, linux-kernel@vger.kernel.org, dave.jiang@intel.com, ashok.raj@intel.com, kevin.tian@intel.com, dwmw@amazon.co.uk, x86@kernel.org, tony.luck@intel.com, dan.j.williams@intel.com, jgg@mellanox.com, kvm@vger.kernel.org, iommu@lists.linux-foundation.org, alex.williamson@redhat.com, bhelgaas@google.com, linux-pci@vger.kernel.org, baolu.lu@linux.intel.com, ravi.v.shankar@intel.com Subject: Re: [Patch V2 13/13] genirq/msi: Provide helpers to return Linux IRQ/dev_msi hw IRQ number In-Reply-To: <5bed6fea-32e1-d909-0a5c-439d0f0a7dfe@intel.com> References: <1614370277-23235-1-git-send-email-megha.dey@intel.com> <1614370277-23235-14-git-send-email-megha.dey@intel.com> <87y2ebqfw5.wl-maz@kernel.org> <5bed6fea-32e1-d909-0a5c-439d0f0a7dfe@intel.com> User-Agent: Wanderlust/2.15.9 (Almost Unreal) SEMI-EPG/1.14.7 (Harue) FLIM-LB/1.14.9 (=?UTF-8?B?R29qxY0=?=) APEL-LB/10.8 EasyPG/1.0.0 Emacs/27.1 (x86_64-pc-linux-gnu) MULE/6.0 (HANACHIRUSATO) MIME-Version: 1.0 (generated by SEMI-EPG 1.14.7 - "Harue") Content-Type: text/plain; charset=US-ASCII X-SA-Exim-Connect-IP: 62.31.163.78 X-SA-Exim-Rcpt-To: megha.dey@intel.com, tglx@linutronix.de, linux-kernel@vger.kernel.org, dave.jiang@intel.com, ashok.raj@intel.com, kevin.tian@intel.com, dwmw@amazon.co.uk, x86@kernel.org, tony.luck@intel.com, dan.j.williams@intel.com, jgg@mellanox.com, kvm@vger.kernel.org, iommu@lists.linux-foundation.org, alex.williamson@redhat.com, bhelgaas@google.com, linux-pci@vger.kernel.org, baolu.lu@linux.intel.com, ravi.v.shankar@intel.com X-SA-Exim-Mail-From: maz@kernel.org X-SA-Exim-Scanned: No (on disco-boy.misterjones.org); SAEximRunCond expanded to false Precedence: bulk List-ID: X-Mailing-List: linux-pci@vger.kernel.org On Fri, 26 Mar 2021 01:02:43 +0000, "Dey, Megha" wrote: > > Hi Marc, > > On 3/25/2021 10:53 AM, Marc Zyngier wrote: > > On Fri, 26 Feb 2021 20:11:17 +0000, > > Megha Dey wrote: > >> From: Dave Jiang > >> > >> Add new helpers to get the Linux IRQ number and device specific index > >> for given device-relative vector so that the drivers don't need to > >> allocate their own arrays to keep track of the vectors and hwirq for > >> the multi vector device MSI case. > >> > >> Reviewed-by: Tony Luck > >> Signed-off-by: Dave Jiang > >> Signed-off-by: Megha Dey > >> --- > >> include/linux/msi.h | 2 ++ > >> kernel/irq/msi.c | 44 ++++++++++++++++++++++++++++++++++++++++++++ > >> 2 files changed, 46 insertions(+) > >> > >> diff --git a/include/linux/msi.h b/include/linux/msi.h > >> index 24abec0..d60a6ba 100644 > >> --- a/include/linux/msi.h > >> +++ b/include/linux/msi.h > >> @@ -451,6 +451,8 @@ struct irq_domain *platform_msi_create_irq_domain(struct fwnode_handle *fwnode, > >> int platform_msi_domain_alloc_irqs(struct device *dev, unsigned int nvec, > >> irq_write_msi_msg_t write_msi_msg); > >> void platform_msi_domain_free_irqs(struct device *dev); > >> +int msi_irq_vector(struct device *dev, unsigned int nr); > >> +int dev_msi_hwirq(struct device *dev, unsigned int nr); > >> /* When an MSI domain is used as an intermediate domain */ > >> int msi_domain_prepare_irqs(struct irq_domain *domain, struct device *dev, > >> diff --git a/kernel/irq/msi.c b/kernel/irq/msi.c > >> index 047b59d..f2a8f55 100644 > >> --- a/kernel/irq/msi.c > >> +++ b/kernel/irq/msi.c > >> @@ -581,4 +581,48 @@ struct msi_domain_info *msi_get_domain_info(struct irq_domain *domain) > >> return (struct msi_domain_info *)domain->host_data; > >> } > >> +/** > >> + * msi_irq_vector - Get the Linux IRQ number of a device vector > >> + * @dev: device to operate on > >> + * @nr: device-relative interrupt vector index (0-based). > >> + * > >> + * Returns the Linux IRQ number of a device vector. > >> + */ > >> +int msi_irq_vector(struct device *dev, unsigned int nr) > >> +{ > >> + struct msi_desc *entry; > >> + int i = 0; > >> + > >> + for_each_msi_entry(entry, dev) { > >> + if (i == nr) > >> + return entry->irq; > >> + i++; > > This obviously doesn't work with Multi-MSI, does it? > > This API is only for devices that support device MSI interrupts. They > follow MSI-x format and don't support multi MSI (part of MSI). > > Not sure if I am missing something here, can you please let me know? Nothing in the prototype of the function indicates this limitation, nor does the documentation. And I'm not sure why you should exclude part of the MSI functionality here. It can't be for performance reason, so you might as well make sure this works for all the MSI variants: int msi_irq_vector(struct device *dev, unsigned int nr) { struct msi_desc *entry; int irq, index = 0; for_each_msi_vector(entry, irq, dev) { if (index == nr} return irq; index++; } return WARN_ON_ONCE(-EINVAL); } > > > > >> + } > >> + WARN_ON_ONCE(1); > >> + return -EINVAL; > >> +} > >> +EXPORT_SYMBOL_GPL(msi_irq_vector); > >> + > >> +/** > >> + * dev_msi_hwirq - Get the device MSI hw IRQ number of a device vector > >> + * @dev: device to operate on > >> + * @nr: device-relative interrupt vector index (0-based). > >> + * > >> + * Return the dev_msi hw IRQ number of a device vector. > >> + */ > >> +int dev_msi_hwirq(struct device *dev, unsigned int nr) > >> +{ > >> + struct msi_desc *entry; > >> + int i = 0; > >> + > >> + for_each_msi_entry(entry, dev) { > >> + if (i == nr) > >> + return entry->device_msi.hwirq; > >> + i++; > >> + } > >> + WARN_ON_ONCE(1); > >> + return -EINVAL; > >> +} And this helper would be more generally useful if it returned the n-th msi_desc entry rather than some obscure field in a substructure. struct msi_desc *msi_get_nth_desc(struct device *dev, unsigned int nth) { struct msi_desc *entry = NULL; unsigned int i = 0; for_each_msi_entry(entry, dev) { if (i == nth) return entry; i++; } WARN_ON_ONCE(!entry); return entry; } You can always wrap it for your particular use case. > >> +EXPORT_SYMBOL_GPL(dev_msi_hwirq); > >> + > >> #endif /* CONFIG_GENERIC_MSI_IRQ_DOMAIN */ > > And what uses these helpers?] > These helpers are to be used by a driver series(Intel's IDXD driver) > which is currently stuck due to VFIO refactoring. Then I's suggest you keep the helpers together with the actual user, unless this can generally be useful to existing users (exported symbols without in-tree users is always a bit odd). Thanks, M. -- Without deviation from the norm, progress is not possible.