From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-wr1-f45.google.com (mail-wr1-f45.google.com [209.85.221.45]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id BD7823D7D91 for ; Thu, 30 Apr 2026 21:39:23 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.221.45 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1777585165; cv=none; b=BdGwzBnIGQWDl7XtCYUp/nVucw5wobw0j0Dk84Y4oSXf4TW2XBNVMypIsCLdQJoNXufnbnnVU+Cmcy8tSQKaa3pVyvMoc8ja0w7a03GS2dAHmKD+OiBPbE9HV97Mz6ME3wRKE+UDD1fySaYK8MtcvXjqog8jJEDgqh7WCb+oUZA= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1777585165; c=relaxed/simple; bh=3g6Ss7Sp5MAl+/UMsni/DReWQuvJVgF0XRECcqbGR8w=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=J0Pythd7yrdM7VPzCM6bONXsfjS1/GeWl3TxGVcFyGkNXs9s2S5f8iPDBRVGPWQ044GVYOst7Qvy/9wsFzZA1bNvhZrWyvor7OF7VTQ6+fma2m1aoK2p8CbVsyKK+mQWBBjgehTrUbivya4CPH0e7ZOKhoBO51+0l0UjBId3uAw= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com; spf=pass smtp.mailfrom=gmail.com; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b=JmX6yje0; arc=none smtp.client-ip=209.85.221.45 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=gmail.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="JmX6yje0" Received: by mail-wr1-f45.google.com with SMTP id ffacd0b85a97d-444826c16ffso1233778f8f.1 for ; Thu, 30 Apr 2026 14:39:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20251104; t=1777585162; x=1778189962; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=h8AWPkz8KJFiH3aKbTZEJCpprJU6lSxCjxlPiaauIRo=; b=JmX6yje0DiGDFBS0H4knFbChy8loeBAxx1jWwDERoMSmzLLeHQf7rNP7N5tJYfQzm1 GoPpsDKousDU8ff0JkCsYF9xvKn9suzj0iodWkfQodTD7VxW76xsPlsDRQPcZ/A+6rPv JxZo7rbnW77DFRsBXCOGPA7W1+97fxhgZqYhZrOyLxmmcWYpSP4zMfHcW8j3NUJhjEGy K6dep59/mEu8lD9tl9Iw1XSrAeIzWh31fQ4X1J4Qxc0B3YlVzPgvrvSxwq8YHRTaHvhL megHElkNNCVaaXss/k97Y1E2lqkvaGm04Y0gmMpLGmltR7LQiSa0h/m85qr8/yseyhYj 2tMw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1777585162; x=1778189962; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-gg:x-gm-message-state:from :to:cc:subject:date:message-id:reply-to; bh=h8AWPkz8KJFiH3aKbTZEJCpprJU6lSxCjxlPiaauIRo=; b=Cm/LkENAZFuRL17kzc8gyz7u0mjb7cU8I3sNmNUyKLCkwadiZMGi8FXzQU3mTe6hkE +dreYBbxm9AI2hVUYN8GIOzZNtK5+j8M5Vjia7vSm/WUmXnTUd3aAmU2Dyr9y36zSrkY OV/qU58OQIb7XBdvvz4C0GumIGZyBtZ21Zy55Rie7Mm4NHMQsmyAN00JEuyGe8X5linU H78R1R/x40o+bUTM5BqCw0kP0rR7qQlDY0NLmrQlv8uSthyIOa9Q11wSJeoBMRdx2cs5 zPFsYfGgdzAE3cIntIzbceu2UJDvxV4N4RuM47gpepwpcIwycNpDn0kSwIblncVUBaw1 VeTA== X-Gm-Message-State: AOJu0YyEPHpLkEADNL9kM55eyqLVBqNyD8TKugQ5TJ+zNHX7WHNXqMRX yQ6xe2qnmyNafI3gFWsfU3Nst95LfpsogeRKIvd5weST5bAI2ZjDng2L X-Gm-Gg: AeBDiet9QtprfCSbkEa+xWXB1LPU/T6HrtAf0TV3wl+Pasv8/lHACA5KIri8b2H1gYk djwpjiKjXnIi9Qb4dAWbyn8/uMJpTAWkw1M7PypNGp/4qzHWZiZUA+l1kdG4J1VKeQg+xBpju80 4MDghjj83fjQ4h7ZfP/i/mdbQ9KaJES2xvtKA8zcv9j+R2JjrcwBmp7hfLhr3z0UrIjTf8bIBQf oWMi+10RxcRdoXstuTtgAbgqylSgNjkg2Yvj473h2yRkewfuX3UkZcoZgfwwpCciItkEGQWXnEm aKh8kaPOr70nyPxZf2NTdvgbBVkciXPHiUQZfbaRtk633vd0hXfhe2oRlrdRBsAhBLbck7m1e7s rd/M2GAyQHr4ufO48azrPL2TNgmzsEdISZsHJ9zuev4jgt39KB0zYZ89V8EXsGSxmHe/bHk/bYF MqnltKrbbvE3MmxpSrksLUdgAzOGb3wqemQn2eXmUc X-Received: by 2002:a05:6000:1ac8:b0:441:2335:ac3f with SMTP id ffacd0b85a97d-4493f9fe8ffmr8056448f8f.31.1777585162265; Thu, 30 Apr 2026 14:39:22 -0700 (PDT) Received: from yuri-framework13 ([78.211.51.156]) by smtp.gmail.com with ESMTPSA id ffacd0b85a97d-44a9879ef89sm418510f8f.30.2026.04.30.14.39.20 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 30 Apr 2026 14:39:21 -0700 (PDT) From: Yuri Andriaccio To: Ingo Molnar , Peter Zijlstra , Juri Lelli , Vincent Guittot , Dietmar Eggemann , Steven Rostedt , Ben Segall , Mel Gorman , Valentin Schneider Cc: linux-kernel@vger.kernel.org, Luca Abeni , Yuri Andriaccio Subject: [RFC PATCH v5 26/29] sched/core: Execute enqueued balance callbacks after migrate_disable_switch Date: Thu, 30 Apr 2026 23:38:30 +0200 Message-ID: <20260430213835.62217-27-yurand2000@gmail.com> X-Mailer: git-send-email 2.53.0 In-Reply-To: <20260430213835.62217-1-yurand2000@gmail.com> References: <20260430213835.62217-1-yurand2000@gmail.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Execute balance callbacks after migrate_disable_switch. Balancing may be requested on the __schedule path, in migrate_disable_switch, when the running task is throttled and then pushed away from its runqueue. Signed-off-by: Yuri Andriaccio --- kernel/sched/core.c | 12 ++++++++++-- 1 file changed, 10 insertions(+), 2 deletions(-) diff --git a/kernel/sched/core.c b/kernel/sched/core.c index 24ffe933527c..03bd86cc8d4f 100644 --- a/kernel/sched/core.c +++ b/kernel/sched/core.c @@ -2352,6 +2352,9 @@ do_set_cpus_allowed(struct task_struct *p, struct affinity_context *ctx); static void migrate_disable_switch(struct rq *rq, struct task_struct *p) { + struct rq_flags rf; + struct balance_callback *head; + struct affinity_context ac = { .new_mask = cpumask_of(rq->cpu), .flags = SCA_MIGRATE_DISABLE, @@ -2363,8 +2366,13 @@ static void migrate_disable_switch(struct rq *rq, struct task_struct *p) if (p->cpus_ptr != &p->cpus_mask) return; - scoped_guard (task_rq_lock, p) - do_set_cpus_allowed(p, &ac); + rq = task_rq_lock(p, &rf); + + do_set_cpus_allowed(p, &ac); + + head = splice_balance_callbacks(rq); + task_rq_unlock(rq, p, &rf); + balance_callbacks(rq, head); } void ___migrate_enable(void) -- 2.53.0