From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-11.3 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,INCLUDES_PATCH,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 597A4C433E9 for ; Sun, 21 Feb 2021 13:56:07 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 2AD8164EE0 for ; Sun, 21 Feb 2021 13:56:07 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229926AbhBUN4G (ORCPT ); Sun, 21 Feb 2021 08:56:06 -0500 Received: from mail.kernel.org ([198.145.29.99]:51544 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229685AbhBUN4E (ORCPT ); Sun, 21 Feb 2021 08:56:04 -0500 Received: by mail.kernel.org (Postfix) with ESMTPSA id 057FC64EEF; Sun, 21 Feb 2021 13:55:21 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1613915722; bh=tdDBv48xyhS5S+cFj5+hGf1E8xy0/i+1/C4L6PMs8Ng=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=qa77/M1AiF4re9VATdM+2IfWji1P/vOwMALMLT0N0qOM84pMydMXbLJOBMg2iuuET Ju7UXw2LQOnBpfmepYvfJw0O5FVxAmygKKtwz8nk/3ZLBp9Q068bJEva4GifspNILM gRJiFJOEV0CJ2oyWb08tRZYht1VDpPzoXGqDxpPOLQ0rm3aTU6YN9BjmD7D6FZHbqU q1agQ/EHmknTbx5AQDXP2kCZs2FisdEWeJszdW3nDTv41yqR+pzOiSYiG+VAZpvso3 eNecCyZI5C/+VQaQe+aHEj+Ay90UBIfEC+V/uLbRFXToVcE/+BFkhzouYyKoiUJ1JS qJKEnw81Hw40w== Date: Sun, 21 Feb 2021 15:55:18 +0200 From: Leon Romanovsky To: Greg Kroah-Hartman Cc: Bjorn Helgaas , Bjorn Helgaas , Saeed Mahameed , Jason Gunthorpe , Alexander Duyck , Jakub Kicinski , linux-pci@vger.kernel.org, linux-rdma@vger.kernel.org, netdev@vger.kernel.org, Don Dutile , Alex Williamson , "David S . Miller" , Krzysztof =?utf-8?Q?Wilczy=C5=84ski?= Subject: Re: [PATCH mlx5-next v6 1/4] PCI: Add sysfs callback to allow MSI-X table size change of SR-IOV VFs Message-ID: References: <20210220190600.GA1260870@bjorn-Precision-5520> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Precedence: bulk List-ID: X-Mailing-List: netdev@vger.kernel.org On Sun, Feb 21, 2021 at 02:00:41PM +0100, Greg Kroah-Hartman wrote: > On Sat, Feb 20, 2021 at 01:06:00PM -0600, Bjorn Helgaas wrote: > > On Fri, Feb 19, 2021 at 09:20:18AM +0100, Greg Kroah-Hartman wrote: > > > > > Ok, can you step back and try to explain what problem you are trying to > > > solve first, before getting bogged down in odd details? I find it > > > highly unlikely that this is something "unique", but I could be wrong as > > > I do not understand what you are wanting to do here at all. > > > > We want to add two new sysfs files: > > > > sriov_vf_total_msix, for PF devices > > sriov_vf_msix_count, for VF devices associated with the PF > > > > AFAICT it is *acceptable* if they are both present always. But it > > would be *ideal* if they were only present when a driver that > > implements the ->sriov_get_vf_total_msix() callback is bound to the > > PF. > > Ok, so in the pci bus probe function, if the driver that successfully > binds to the device is of this type, then create the sysfs files. > > The driver core will properly emit a KOBJ_BIND message when the driver > is bound to the device, so userspace knows it is now safe to rescan the > device to see any new attributes. > > Here's some horrible pseudo-patch for where this probably should be > done: > > > diff --git a/drivers/pci/pci-driver.c b/drivers/pci/pci-driver.c > index ec44a79e951a..5a854a5e3977 100644 > --- a/drivers/pci/pci-driver.c > +++ b/drivers/pci/pci-driver.c > @@ -307,8 +307,14 @@ static long local_pci_probe(void *_ddi) > pm_runtime_get_sync(dev); > pci_dev->driver = pci_drv; > rc = pci_drv->probe(pci_dev, ddi->id); > - if (!rc) > + if (!rc) { > + /* If PF or FV driver was bound, let's add some more sysfs files */ > + if (pci_drv->is_pf) > + device_add_groups(pci_dev->dev, pf_groups); > + if (pci_drv->is_fv) > + device_add_groups(pci_dev->dev, fv_groups); > return rc; > + } > if (rc < 0) { > pci_dev->driver = NULL; > pm_runtime_put_sync(dev); > > > > > Add some proper error handling if device_add_groups() fails, and then do > the same thing to remove the sysfs files when the device is unbound from > the driver, and you should be good to go. > > Or is this what you all are talking about already and I'm just totally > confused? There are two different things here. First we need to add sysfs files for VF as the event of PF driver bind, not for the VF binds. In your pseudo code, it will look: rc = pci_drv->probe(pci_dev, ddi->id); - if (!rc) + if (!rc) { + /* If PF or FV driver was bound, let's add some more sysfs files */ + if (pci_drv->is_pf) { + int i = 0; + device_add_groups(pci_dev->dev, pf_groups); + for (i; i < pci_dev->totalVF; i++) { + struct pci_device vf_dev = find_vf_device(pci_dev, i); + + device_add_groups(vf_dev->dev, fv_groups); + } + } return rc; Second, the code proposed by me does that but with driver callback that PF calls during init/uninit. Thanks > > thanks, > > greg k-h