From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id CD31951C37 for ; Mon, 11 Dec 2023 19:23:34 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="AMme99iK" Received: by smtp.kernel.org (Postfix) with ESMTPSA id B5331C433C8; Mon, 11 Dec 2023 19:23:33 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1702322614; bh=NQb2rHrXZBC2qUTW9Bi96GGbDXlv9qtiv4KE2DukMZQ=; h=Date:From:To:Cc:Subject:In-Reply-To:References:From; b=AMme99iKkntnUrXuqksuKV8S9Z0XBRo4r/dUWRy7Ecb/57h3O5zfQDbYuhWxXTbDW rNOS/yeyWp4FG6kT4ZpqR3/gG+U7uuzKWQAqStlqNnYSnByosexY2n6mRAJmRhapS5 MFNJSQqQYA8zCGRVNzw+7c/2jamKT3Z+EP7fPWPKm0Pg7DnSyweEaxDJ/4qC1QdwEH kyE3xq3Rus0MbPaZ0bkqBhPkgfTUv+x6MDaQ7xhO8VBZOb/8tNSUJU6f8wX1eQ7y/x DJpJ5C+NGJQ3rRjcqXHLr/c96oukNWoVRtm93UjY2E7tRCoYTzjmTl4SLYpN/CctNX s8pnQR/Dt9cJg== Date: Mon, 11 Dec 2023 11:23:32 -0800 From: Jakub Kicinski To: Alexander Lobakin Cc: Yunsheng Lin , "David S. Miller" , Eric Dumazet , Paolo Abeni , Maciej Fijalkowski , Michal Kubiak , Larysa Zaremba , Alexander Duyck , "David Christensen" , Jesper Dangaard Brouer , Ilias Apalodimas , "Paul Menzel" , , , , Amritha Nambiar Subject: Re: [PATCH net-next v6 08/12] libie: add Rx buffer management (via Page Pool) Message-ID: <20231211112332.2abc94ae@kernel.org> In-Reply-To: <03d7e8b0-8766-4f59-afd4-15b592693a83@intel.com> References: <20231207172010.1441468-1-aleksander.lobakin@intel.com> <20231207172010.1441468-9-aleksander.lobakin@intel.com> <1103fe8f-04c8-8cc4-8f1b-ff45cea22b54@huawei.com> <03d7e8b0-8766-4f59-afd4-15b592693a83@intel.com> Precedence: bulk X-Mailing-List: netdev@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On Mon, 11 Dec 2023 11:16:20 +0100 Alexander Lobakin wrote: > Ideally, I'd like to pass a CPU ID this queue will be run on and use > cpu_to_node(), but currently there's no NUMA-aware allocations in the > Intel drivers and Rx queues don't get the corresponding CPU ID when > configuring. I may revisit this later, but for now NUMA_NO_NODE is the > most optimal solution here. Hm, I've been wondering about persistent IRQ mappings. Drivers resetting IRQ mapping on reconfiguration is a major PITA in production clusters. You change the RSS hash and some NICs suddenly forget affinitization =F0=9F=A4=AF=EF=B8=8F The connection with memory allocations changes the math on that a bit. The question is really whether we add CPU <> NAPI config as a netdev Netlink API or build around the generic IRQ affinity API. The latter=20 is definitely better from "don't duplicate uAPI" perspective. But we need to reset the queues and reallocate their state when=20 the mapping is changed. And shutting down queues on=20 echo $cpu > /../smp_affinity_list seems moderately insane. Perhaps some middle-ground exists. Anyway, if you do find cycles to tackle this - pls try to do it generically not just for Intel? :)