From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from out-185.mta0.migadu.com (out-185.mta0.migadu.com [91.218.175.185]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 5D02B478868 for ; Thu, 4 Jun 2026 12:55:15 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=91.218.175.185 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1780577716; cv=none; b=TgonRTVWLov9En2L1vIfajzdKs9ofxIVZwrotoz9gGqoVD/h8zuuadjZWE9n1Zyg8RSiohVYNtiJ7K8L6Iua/GEL4rCGs6w1V+YJXC8IJsHXqaWL7zoxUN47USxn+z79urkYgMEU8FHXs1VdLvC6/vv53ck3nJsgl+t+0ATbokw= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1780577716; c=relaxed/simple; bh=QxSGRY4L3Tgf3x+iOHyGVPvIzaF30Hlk6xO46vSv8Dw=; h=From:To:Cc:Subject:Date:Message-Id:In-Reply-To:References: MIME-Version:Content-Type; b=Kn7EjlzudaY9pzhw0AmxvBTaYlEyGE+5PcBT3I00vDJreJMHi4N8IAzZpOFyyoIkix6A9aUKGTXe58o3okM0rI2rLWwQ2ZMAEdKO1eXIlTK6HGgx9i0ER8xaQvfNCeHVm3tImB6jqrwRSocuCnoYrSfpuFs/oTwLHbs74+eeU/k= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.dev; spf=pass smtp.mailfrom=linux.dev; dkim=pass (1024-bit key) header.d=linux.dev header.i=@linux.dev header.b=EC5j3yEx; arc=none smtp.client-ip=91.218.175.185 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.dev Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=linux.dev Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=linux.dev header.i=@linux.dev header.b="EC5j3yEx" X-Report-Abuse: Please report any abuse attempt to abuse@migadu.com and include these headers. DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.dev; s=key1; t=1780577702; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=r3MGpzxEfhVL51O4IZ6GwBDnyJ7cfCwaCriJzF1YfgA=; b=EC5j3yExvJBfA12Qtv3Xe8KvPU/oWt4LMe09BEih7PuEK7sFCewUk6c0aOoTt2zMQagtxL HrxRt8uNXG69bG05So1eGhMN0vuJSFouqWWo8WHKN/pLzG+XUtm7MYmFAmdvPl03KZpQ7p n7YLamSWiSJ38bqRJHatqfW0QgGjvBI= From: Fushuai Wang To: shayd@nvidia.com Cc: andrew+netdev@lunn.ch, davem@davemloft.net, edumazet@google.com, fushuai.wang@linux.dev, kuba@kernel.org, leon@kernel.org, linux-kernel@vger.kernel.org, linux-rdma@vger.kernel.org, mbloch@nvidia.com, moshe@nvidia.com, netdev@vger.kernel.org, pabeni@redhat.com, parav@nvidia.com, saeedm@nvidia.com, tariqt@nvidia.com, wangfushuai@baidu.com Subject: Re: [PATCH 2/2] net/mlx5: Only consider online CPUs in affinity subset check Date: Thu, 4 Jun 2026 20:54:42 +0800 Message-Id: <20260604125442.20673-1-fushuai.wang@linux.dev> In-Reply-To: <7018a27a-29fb-4c8e-84cf-dc90d1b3bd9c@nvidia.com> References: <7018a27a-29fb-4c8e-84cf-dc90d1b3bd9c@nvidia.com> Precedence: bulk X-Mailing-List: linux-rdma@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=y Content-Transfer-Encoding: 8bit X-Migadu-Flow: FLOW_OUT > > From: Fushuai Wang > > > > When an SF is created after a CPU has been taken offline, the IRQ pool may > > contain IRQs with affinity masks that include the offline CPU. Since only > > online CPUs should be considered for IRQ placement, cpumask_subset() check > > would fail because the iter_mask contains offline CPUs that are not present > > in req_mask, causing SF creation to fail. > > Thank for the patch! > > can you please provide a full example? for simplicity, lets say the SF > pool is of size of 2 IRQs. > Sure, here are the AI summarized steps: 1. When mlx5 driver loads, it initializes the IRQ pools. For sf_ctrl_pool with ≤64 SFs: - xa_num_irqs = {N, N} (There is only one slot) 2. When the first SF is created: - The ctrl IRQ is allocated with mask=cpu_online_mask={0-191} 2. We take CPU 20 offline 3. Existing ctl irq still have mask={0-191} 4. Create a new SF: - req_mask={0-19,21-191} - iter_mask={0-191} - {0-191} is NOT a subset of {0-19,21-191} - least_loaded_irq=NULL 5. Try to allocate a new irq via irq_pool_request_irq() 6. xa_alloc() fails because the pool is full(There is only one slot) 7. sf creation fails with error > > > > Filter the affinity mask to only include online CPUs before checking if it's > > a subset of the requested mask, > > won't this cause the affinity mask to be empty, which is kind of missing > the point of this API... :( Yes, I didn't realize this. > can you check if irq_get_effective_affinity_mask() will solve the issue? > Yes, I tested that irq_get_effective_affinity_mask can solve the issue. I will send a v2 shortly. -- Regards, WANG