From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 3BB9CD65C52 for ; Thu, 14 Nov 2024 07:23:41 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:In-Reply-To:MIME-Version:References: Message-ID:Subject:Cc:To:From:Date:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=DTTmarUugooD2MZ5dN4aFZffGpBw5/GzItg6HfV89vU=; b=w1NRNRgV2hp20X +VShH8DJbyxz9BjJVbGfdslo9sd4VdMmlPC3wDNHNix+mQzzMDLVw6hthpRV+al5ZfCqU/H1Elyr8 XHHcqhZFrWd9fwH2egqtztJIlJ5XQ4lx0BDn4wLsRV2NSa2YTNsKHmN8ewf6rAd3HYJxryiEo/YrI EPJJc6C+IHnQcGJhHshk26Q3WDaBFq/WEpBcs3MK6dAY2ijuD9kMgHnkPp61ZjDK231DO95AxcoOx Xd9B2kai0BzIp1r+0wVVShY1yBrM+qm4Oqh/qpDIpRCOC3eOaoTgFMLh0x8WsQ5CerFtFXnoekZ01 IYcbWaLL+Tc/vrORhTiQ==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.98 #2 (Red Hat Linux)) id 1tBUCT-000000094lS-1Rqv; Thu, 14 Nov 2024 07:23:33 +0000 Received: from mail-pl1-x62d.google.com ([2607:f8b0:4864:20::62d]) by bombadil.infradead.org with esmtps (Exim 4.98 #2 (Red Hat Linux)) id 1tBUCP-000000094l2-3c1V for linux-riscv@lists.infradead.org; Thu, 14 Nov 2024 07:23:31 +0000 Received: by mail-pl1-x62d.google.com with SMTP id d9443c01a7336-20cbcd71012so2667865ad.3 for ; Wed, 13 Nov 2024 23:23:28 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=rivosinc-com.20230601.gappssmtp.com; s=20230601; t=1731569008; x=1732173808; darn=lists.infradead.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=jcVdx/PDcosiuJvg6s7470mt1Sbg0MJ8nbwkpgIFfDI=; b=WTyS4KybL8e8uQedCzL2tfccEIzpXVoJMbw5NO2huCOmbOH1M5YxU3V2NlKoTajzRb rKmb8JaehZULwVyZ0nRqtBWMDSLKgq5zXyjA6oxDKm41JFius0T9KBxSSa7tUThxayeW DtPt9LXhnlMEasB7jlCY7h8jMNFjpXpi0pblam9iuNtZhowKMC5T03lMogu+sDFMqxWL EUEJOM9AVvyuTmiFIRNUuEv6zL0DX6YDi4FGLbo0rWHgShPe8QJxnBkWic3Kni8EPyT3 Ejl7xp5XCGNsQzhS+AiiY2DUJ0ddDRuUG/nTmD7fudw1IifUETXZ0RmZBEeKlO9f0Llt 7kDA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1731569008; x=1732173808; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=jcVdx/PDcosiuJvg6s7470mt1Sbg0MJ8nbwkpgIFfDI=; b=WnLq+j/4PXb519UsyPjZFDrQhKQuleOndPEZZ0cj9kelcjeaaXGhpaqKkNqpjJNT6C l4aKKSHxPJqbhizZJqP45HjsMtIysfDscliMoxDHM1dFHEHGFPtC+fj1ZknyphaV7N7k gA5PTS8ZyC/XKmTxcLS+7T98v16MzqOGC349erlS6sTDbUziZnv4K3JGvfMtRV2etFzE 8+EJqt868r8pviiArG+iRi7sYnS5X9TXS1rDr/e9zHTyu2Vo7OCWgeeaZbHV7czf+X6X Dv03khMlui67lUTXMrDqxSaKMN3WK1NpvByS7TAYLH2nMuDbyFdNAqKjg0Feg5sWNxtm fTFQ== X-Forwarded-Encrypted: i=1; AJvYcCVrqv+QSWCKw5I0+igWrNm0NuxnvuTp6m4FxDej24Gatx87Jk3RLnDGxvS0hlNoYYQ89Nv+5BOUrbUy4Q==@lists.infradead.org X-Gm-Message-State: AOJu0Yw7Hn9siSYFuA+CasyY/o0i0HE9wFkSZuSZseQF0D9vPvmlDH3e aVRbYsRM84sinDBVPyYM6Qlw9nbNSq9bP9LIdf9MtexcNwWBb8qhuHRPMWqQtPI= X-Google-Smtp-Source: AGHT+IEqIiAMaMvRr6traVqlETDXrksYLlEnbTBwgNuybxklLmBA23F6Bg0v7Zkwsdh3ki0S14Ja2g== X-Received: by 2002:a17:902:d4d2:b0:20b:5aff:dd50 with SMTP id d9443c01a7336-211c4ffd29emr15882815ad.31.1731569008105; Wed, 13 Nov 2024 23:23:28 -0800 (PST) Received: from ghost ([2601:647:6700:64d0:4ece:7c14:cc18:73af]) by smtp.gmail.com with ESMTPSA id d9443c01a7336-211c7c290b1sm4623065ad.10.2024.11.13.23.23.25 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 13 Nov 2024 23:23:27 -0800 (PST) Date: Wed, 13 Nov 2024 23:23:24 -0800 From: Charlie Jenkins To: Yangyu Chen Cc: Conor Dooley , Rob Herring , Krzysztof Kozlowski , Paul Walmsley , Palmer Dabbelt , Albert Ou , Jisheng Zhang , Chen-Yu Tsai , Jernej Skrabec , Samuel Holland , Samuel Holland , Jonathan Corbet , Shuah Khan , Guo Ren , Evan Green , Jessica Clarke , Andrew Jones , Andy Chiu , linux-riscv@lists.infradead.org, devicetree@vger.kernel.org, linux-kernel@vger.kernel.org, linux-sunxi@lists.linux.dev, linux-doc@vger.kernel.org, linux-kselftest@vger.kernel.org Subject: Re: [PATCH v11 10/14] riscv: hwprobe: Add thead vendor extension probing Message-ID: References: <20241113-xtheadvector-v11-0-236c22791ef9@rivosinc.com> <20241113-xtheadvector-v11-10-236c22791ef9@rivosinc.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20241113_232330_198127_322FEECA X-CRM114-Status: GOOD ( 66.74 ) X-BeenThere: linux-riscv@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-riscv" Errors-To: linux-riscv-bounces+linux-riscv=archiver.kernel.org@lists.infradead.org On Thu, Nov 14, 2024 at 02:54:17PM +0800, Yangyu Chen wrote: > > > On 11/14/24 12:46, Charlie Jenkins wrote: > > On Thu, Nov 14, 2024 at 11:26:47AM +0800, Yangyu Chen wrote: > > > > > > > > > On 11/14/24 11:02, Charlie Jenkins wrote: > > > > On Thu, Nov 14, 2024 at 10:44:37AM +0800, Yangyu Chen wrote: > > > > > > > > > > > > > > > On 11/14/24 10:21, Charlie Jenkins wrote: > > > > > > Add a new hwprobe key "RISCV_HWPROBE_KEY_VENDOR_EXT_THEAD_0" which > > > > > > allows userspace to probe for the new RISCV_ISA_VENDOR_EXT_XTHEADVECTOR > > > > > > vendor extension. > > > > > > > > > > > > > > > > Hi Charlie, > > > > > > > > > > How about changing the name of the key from > > > > > "RISCV_ISA_VENDOR_EXT_XTHEADVECTOR" to "RISCV_HWPROBE_KEY_VENDOR_EXT_0" and > > > > > use marchid to identify what the vendor is, each vendor will have its own > > > > > bit definition in this value. So we can avoid adding so many hwprobe keys > > > > > for each vendor in the future. > > > > > > > > > > I proposed a commit here: https://github.com/cyyself/linux/commit/36390645d85d1ac75dd71172f167719df4297f59 > > > > > > > > I actually originally had this in one of my first versions of this > > > > series but was convinced by Conor to change it. The problem with it was > > > > that tying vendor extensions to mvendorid means that it is enforced by > > > > the kernel that vendors cannot share vendor extensions. It is possible > > > > for vendor A to purchase IP that contains a vendor extension from vendor > > > > B. This vendor extension should work on platforms created by vendor A > > > > and vendor B. However, vendor A and vendor B have different mvendorids, > > > > so the kernel can't support this if it is tied to mvendorid. It could > > > > be solved by duplicating every extension that vendors have, but then > > > > userspace software would have to keep in mind the mvendorid they are > > > > running on and check the different extensions for the different vendors > > > > even though the implementation of the extension is the same. > > > > > > > > The original conversation where Conor and I agreed that it was better to > > > > have vendor extensions not rely on mvendorid: > > > > > > > > https://lore.kernel.org/linux-riscv/20240416-husband-flavored-96c1dad58b6e@wendy/ > > > > > > > > > > Thanks for your explanation. I will strongly agree with Conor's opinion if > > > the feature bitmask does not exist in RISC-V C-ABI. > > > > > > However, as the feature mask defined in RISC-V C-ABI[1] uses the design > > > depending on marchid currently, should we reconsider this key for its use > > > case? The current target_clones and taget_version implemented in GCC[2] and > > > LLVM[3] also use the bitmask defined in C-ABI. I think if we use this key > > > depending on marchid, to make a key shared with all vendors will make this > > > cleaner. > > > > Changing this will break linux userspace API. It is a non-workable > > solution for the kernel to associate extensions with marchid/mvendorid > > for the reasons provided. I fail to see why this ABI would require the > > kernel to behave in this manner. The ABI provides the marchid to be used > > by function multi-versioning and applications are free to use the > > marchid to change which function they want to compile. However, if they > > want to know if an extension is supported, then they need to use > > hwprobe. If they want to check if xtheadvector is supported, then they> call hwprobe with the xtheadvector key. This is true no matter what the > > mvendorid of the system is. > > A userspace software can use either c-api defined feature masks or directly > use hwprobe syscall. If they use c-api defined feature masks as GCC or LLVM > did for compiler generated IFUNC resolver, the bitmask is guarded by > mvendorid. So my point at that time was that if the C-API defined way became > mainstream, why should we keep this key only for T-Head to increase the > maintenance overhead? Yes that makes sense. I was thinking that the Andes PMU extension had a hwprobe key, but I realized that it does not. This patch has been on the lists for so long I lost track! I was trying to design this to be forward-thinking, I believe that it makes more sense this way, but I am interested in the opinion of the c-api maintainers. > > This has been discussed here before in RISC-V C-API: https://github.com/riscv-non-isa/riscv-c-api-doc/pull/74#issuecomment-2128844747 > > But now (from the last email), you convinced me. So, I would like to make > the c-api change: https://github.com/riscv-non-isa/riscv-c-api-doc/issues/96 > Thank you for opening that! > > This does not add any complexity, "clean" > > code can equally be written following this scheme or following a scheme > > that relies on mvendorid. Ditching the reliance on mvendorid in the > > kernel allows the kernel to be as generic as possible, and allow > > whatever ABIs or hardware that exist to have a resiliant way of > > communicating with the kernel. > > > > OK. I'm just concerned about when these vendors will add the hwprobe key for > their own extension, which may introduce a potential merge conflict in the > kernel tree. It can also be a disaster if the hardware vendor ships their > kernel with these under-review patches for their products with hwprobe key > conflict with mainline kernel. > > But we can avoid this now by adding each key for each vendor to avoid > potential conflict in the future. This can be a separate patch for future > work, so there is nothing to change here. Yes that is unfortunately the downside of hwprobe that it is a centralized source of these keys, and that can be exacerbated by this scheme were vendor keys are not completely isolated from each other. That would be very unfortunate if a vendor ships a kernel and binaries that has different keys than the mainline kernel. Hopefully vendors don't do that, but it should be manageable for vendors to submit their own keys. Thank you for bringing this up, it is an important issue! A main goal of this series was to get vendor extensions in a state that would be able to grow into a future when there are lots of vendors. > > Thanks, > Yangyu Chen > > > - CHarlie > > > > > > > > [1] https://github.com/riscv-non-isa/riscv-c-api-doc/blob/main/src/c-api.adoc#function-multi-version > > > [2] https://github.com/gcc-mirror/gcc/blob/8564d0948c72df0a66d7eb47e15c6ab43e9b25ce/gcc/config/riscv/riscv.cc#L13016 > > > [3] https://github.com/llvm/llvm-project/blob/f407dff50cdcbcfee9dd92397d3792627c3ac708/clang/lib/CodeGen/CGBuiltin.cpp#L14627 > > > > > > > > > > > > > > This new key will allow userspace code to probe for which thead vendor > > > > > > extensions are supported. This API is modeled to be consistent with > > > > > > RISCV_HWPROBE_KEY_IMA_EXT_0. The bitmask returned will have each bit > > > > > > corresponding to a supported thead vendor extension of the cpumask set. > > > > > > Just like RISCV_HWPROBE_KEY_IMA_EXT_0, this allows a userspace program > > > > > > to determine all of the supported thead vendor extensions in one call. > > > > > > > > > > > > Signed-off-by: Charlie Jenkins > > > > > > Reviewed-by: Evan Green > > > > > > --- > > > > > > arch/riscv/include/asm/hwprobe.h | 3 +- > > > > > > .../include/asm/vendor_extensions/thead_hwprobe.h | 19 +++++++++++ > > > > > > .../include/asm/vendor_extensions/vendor_hwprobe.h | 37 ++++++++++++++++++++++ > > > > > > arch/riscv/include/uapi/asm/hwprobe.h | 3 +- > > > > > > arch/riscv/include/uapi/asm/vendor/thead.h | 3 ++ > > > > > > arch/riscv/kernel/sys_hwprobe.c | 5 +++ > > > > > > arch/riscv/kernel/vendor_extensions/Makefile | 1 + > > > > > > .../riscv/kernel/vendor_extensions/thead_hwprobe.c | 19 +++++++++++ > > > > > > 8 files changed, 88 insertions(+), 2 deletions(-) > > > > > > > > > > > > > > > > > > > _______________________________________________ linux-riscv mailing list linux-riscv@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-riscv