From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-pl1-f169.google.com (mail-pl1-f169.google.com [209.85.214.169]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 50E773FB7FC for ; Mon, 17 Aug 2026 11:16:26 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.214.169 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786965387; cv=none; b=CgT1YCWcun+1JYpe3r1jFPr27eUcF+R16B6DxLVjgfpelYT55l1EurLSaIrBPpd9ahhp4i/Ju5Z/Ba28suwxVJLuhyIyRGjHw9vpZ4ol2dKZJ4ksG5yKKPJF7w+ksP6OVrrfsy89AFlpaMUEjgJLAcdDT02DsUuvz3Odx7Rc3Vw= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786965387; c=relaxed/simple; bh=VVXh1hJaIziTnYcw5VXBnBRcdWv8NrGa70oD5ZkUoBQ=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:In-Reply-To; b=r3Y17UXYvru6JBzp3gn0pKEGIu42fRgWwgnQ7PreXUbjMeXutMUwve9F4OvOCQY/WLJc3dg4hUXyfkyqQsAXvgf83ByvvGuu+IqmNPicws0KFPbbL9Hld1PjqlQ8ZKwDLlgdclOWqpf5IL4Y8fc3k5KZuCDCYqDBnHgD64kKR9Q= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=google.com; spf=pass smtp.mailfrom=google.com; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b=J5CVKQD+; arc=none smtp.client-ip=209.85.214.169 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=google.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=google.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b="J5CVKQD+" Received: by mail-pl1-f169.google.com with SMTP id d9443c01a7336-2ccdf36f63dso246625ad.0 for ; Mon, 17 Aug 2026 04:16:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20251104; t=1786965385; x=1787570185; darn=lists.linux.dev; h=in-reply-to:content-disposition:content-type:mime-version :references:message-id:subject:cc:to:from:date:from:to:cc:subject :date:message-id:reply-to:content-type; bh=R+l+UxdGP4xSYpq+snL3DrvZxjB7YwI2tVyA/dO6w4c=; b=J5CVKQD+GyQipXNzqS6n27hruYn+7kKacKA4YgibisK7gzDwkET2U7nVvBPtJ9dAVj 7ZQpCXDWIvSbVBvbwyc5TizmY6uKxosGCjn3/BUL12ShgrASbEHPxgh1/gilkpmdBqlL zSwtvmG4e5DuVq8LZhsmrJLSGxjdvEqj5vc+i+jbzOqNY95sEGF+Jve4rhollaU2VxVZ emlFjnaGQP6rvXYv3ZG/8MwZf57unSxKaKC79KF+Q9LEHnQvGHFEGWX0WbMpv7VlXuad z4jfhrE4nspJTETTyRwmwdPFMnuvM5r65xkMrlz1PCNjR5YnM3YyL8tgIbo8MtBrKbXx E8xg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1786965385; x=1787570185; h=in-reply-to:content-disposition:content-type:mime-version :references:message-id:subject:cc:to:from:date:x-gm-gg :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to :content-type; bh=R+l+UxdGP4xSYpq+snL3DrvZxjB7YwI2tVyA/dO6w4c=; b=jv1y9YMihwXRm+/LcAcSQEVDhdJmgV3gGqI8l6m96IpPQBAR0zOs+nNuE6+f9v/NLB KhRBQMuwu2KomRf6LCoIeYwmprzSkWdDKW+YBwfOUqZ8GMzFiPNYa6lqmfC/8+Ypr7cj MsNeWlzDbC2zne558Agf/YU4iYxqbcJUXbL7yTTK3ZfY1JHMZw4yUSLJU/6Jad0R2H1b YGhQQBE6xt+Rb5j5zfrKTs/fuMwxkppJH6ey2/oN5nRdPWWwauoSD7gk4yBXssP+xPnb K4DDpk5ZVVm9a8BKifShC07kvh6gLV6ISyX85beGr3ICvV2Pevzm4jq6JCCx4P6Xz3CN YS+g== X-Forwarded-Encrypted: i=1; AHgh+Rq1IRHdYMxWWA4Tvn3nxl8xnIm7p586tPN6/mu+JPb4rDyJ57kjQUAOc3PfbjRT4Pb/3mV+1A==@lists.linux.dev X-Gm-Message-State: AOJu0YxB9BsCxmoXsJw/LtgZjZ1am5iqH0rIkX1EwhCPDKf0Q+Rxljwm Ilz/zNnWRmbPtnMvzLyS8aKNts3VHxbCKBOP/1yB6C7HSfDgMxuudkr7efUElon9BA== X-Gm-Gg: AR+sD11FzIjMpJpP7e3GB5zqmXEpXsMtqciWCkw5Hxq9ugCqrsXJCdtZK+lETVp6bds fcTMINFqQVI7iAG/e9xbcpiNH5Y8jyvYTpu/TydZo7HysDo5Sq+lHqWB9bnMqMEQgLaezraNnF+ 3VahqQqCgtHdVmyIAMEu3rXJaW1K5G+YeaRYTPyAbKHDaT5VsZLLehxG5CbIEW3r3c1HYcJG0Za s79LAYvTGQkujVsaJxsYnbzcXv1ncXkm9txduCxNOBjqT0E6lvFacxlCJmsuECRylhk0bp/UsZK ALy9/jX5jBvMKDtpRIRb2kOR0uU41nLpd3d0siRhMO4ZbvxW+5NG6hKqg5HEVvRGkWlv989FUBB UVZ6NfyfQPyML1Nu+mzUqUbP/1oJ/F3yYV1WZbbydxS1Tdj14yKv4QM5asZKSkXngNnr5TYxjtM wXIlPJtBO7Q2X9neVvSDU6/rvdunL7rSGka7FcgarRgxwRPSKayZeoR+ELDa1j9zGXXH3VMZp2h 7jtbQXza6rgw+mzA8GBboo= X-Received: by 2002:a17:903:2b0c:b0:2bf:1000:d3ac with SMTP id d9443c01a7336-2d596cfb925mr4566865ad.11.1786965384912; Mon, 17 Aug 2026 04:16:24 -0700 (PDT) Received: from google.com (21.168.124.34.bc.googleusercontent.com. [34.124.168.21]) by smtp.gmail.com with ESMTPSA id d9443c01a7336-2d5bb499e8csm3975245ad.2.2026.08.17.04.16.21 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 17 Aug 2026 04:16:24 -0700 (PDT) Date: Mon, 17 Aug 2026 11:16:17 +0000 From: Pranjal Shrivastava To: Dmitry Malkin Cc: Jason Gunthorpe , Will Deacon , Robin Murphy , Joerg Roedel , Nicolin Chen , "iommu@lists.linux.dev" , "linux-arm-kernel@lists.infradead.org" , "linux-kernel@vger.kernel.org" , "regressions@lists.linux.dev" , "stable@vger.kernel.org" , NB-Core Team Subject: Re: [RFC PATCH] iommu/arm-smmu-v3: Allow nested attach for PCI bridges without vDEVICE Message-ID: References: <20260814174825.GC510472@nvidia.com> <20260814221103.GE510472@nvidia.com> Precedence: bulk X-Mailing-List: iommu@lists.linux.dev List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: On Mon, Aug 17, 2026 at 09:29:10AM +0000, Dmitry Malkin wrote: > > Don't use it that way? > > Why not? We use pci=config_acs to configure ACS at kernel startup and > enable direct PCIe peer-to-peer traffic between GPUs and NICs. All > affected devices are assigned to the same VM and IOMMU domain, which > also reduces the memory footprint by reducing the number of page tables > and lowers IOTLB pressure. > I'll defer the debate of enabling ACS or not OR supporting multi-device groups for vIOMMU for a moment. But, regarding PCI P2PDMA, you can still enable it with ACS enabled in the upstream kernel *IF* your hardware supports TLP forwarding between root ports. When ACS is enabled, all TLPs get forwarded to the host's Root Ports instead of getting routed directly through the switch. All that needs to be done is to add an entry of your hardware to the whitelist in p2pdma.c (pci_p2pdma_whitelist). Are you aware if your HW supports this? If yes, then a simple addition like [1] should work. Thanks, Praan [1] https://lore.kernel.org/all/20260409150123.3538444-2-jmoroni@google.com/