From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 8421E287261 for ; Fri, 8 Aug 2025 16:27:32 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=170.10.133.124 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1754670454; cv=none; b=mjU6I9ttBZ/VNsoF7VhVsqnx/XDtcP0exYMxLT2xxHjXbdHPixXRja7pXsSpvQz7SZU3V9ZpBdX5XkKfKuSBz3rlTCWoJYrSzDwmt3j26AzRML6cYU+lT0wr3XwCtmnOYKnJku4BpGa5iqIPJNAt1q+/gCqfY6RSvpFMqXXaDG8= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1754670454; c=relaxed/simple; bh=35xdwsaBTJ1Y4skh6luh1NYwYaL7lznfoO0s3HYedOc=; h=From:Message-ID:Date:MIME-Version:Subject:To:Cc:References: In-Reply-To:Content-Type; b=Yw+htq1N6RhcaW8c7d5fEp0PxtPQ9jwOeV4pp08XWRchgEdFMb++1wTYPQfTQSdinQVRpuOCjBoABicJPsVAC0KCK4y6ojcfYtNMN5ZHKD4uB94m6iij6zDW9XPsJ7QWTwBda8t+pBr4QsGaUBTjvWaGynP1dnxa+QyCDb5iPWI= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=redhat.com; spf=pass smtp.mailfrom=redhat.com; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b=SaSXXSwZ; arc=none smtp.client-ip=170.10.133.124 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=redhat.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=redhat.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b="SaSXXSwZ" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1754670451; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=C2n2d3+1CIGjf3VybsTqnnNSZHlfvXlp65LE1VoA9y8=; b=SaSXXSwZyLtw7C22Uqk63mPoahvYCDr9NqQS2KHO5sthemoqIp0UJL9XQw+F2/XKLBKqvx ZUS32854N/PnCBMSJU3ig38CfCJi06KZkfCTPD60K6Qm9mQOipEV0BmZB8FC8A4FxZDTjc j5JGWfmzi67Ws4/GsA6e01dLpfY/4Yg= Received: from mail-yw1-f198.google.com (mail-yw1-f198.google.com [209.85.128.198]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-104-nWxiPN0nPQ-opz49sMo72Q-1; Fri, 08 Aug 2025 12:27:29 -0400 X-MC-Unique: nWxiPN0nPQ-opz49sMo72Q-1 X-Mimecast-MFC-AGG-ID: nWxiPN0nPQ-opz49sMo72Q_1754670449 Received: by mail-yw1-f198.google.com with SMTP id 00721157ae682-71b6636036fso31069847b3.3 for ; Fri, 08 Aug 2025 09:27:29 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1754670449; x=1755275249; h=content-transfer-encoding:in-reply-to:content-language:references :cc:to:subject:user-agent:mime-version:date:message-id:from :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=C2n2d3+1CIGjf3VybsTqnnNSZHlfvXlp65LE1VoA9y8=; b=W0SsP7v3/T6QPnITM8+aQ3W5IXaRYdsCAyOvosO1kdsN4Ko3d6W7xhL6ZslCGpzfbA 3NIwJdVPWc5U924Kf2edErD8nTe/UEt7S6GO+ngmGo2s5WKbDGF6Yknj2pCBaPcZJX83 LJhFBVgWswziImv4Hoc4CZbb41CkhZ8GSqv4yuwCTSouPmH8nNfJgOK2xU/YhHjnoeRq KZJGDq2xmFElf8x0CTXgY8R+2JLA6v+QxNtnxoHDjDTBN9iCXE+l5nC/bsg5k4PgRKI0 fCsMxkDal2ky3nI3HfbUSykuoKEiuqx0yNIPKafuAYG8GIPvUKMwq35AMNSV+KIiRFUX tH3Q== X-Forwarded-Encrypted: i=1; AJvYcCUCPJ090xQow/8pStS4eVxq4F5yBtAC9KyGQKSSiX11otdHoRT9vnJ53c6+YyXNhKPv6Pp/UafFtvA=@vger.kernel.org X-Gm-Message-State: AOJu0YwJXT66F0E5TIMutRTl67oWI3xOFAjbizG/TvyBQ93N9PQ3Rs8v h+XZMwj5NgV/HK7TaNyEnZuE5pVXT/vjNLzKz+zTSTtGyA/vTYjYc5GIWcN/LPS2JDZ+b1ZXg9s mi7i56R+XpeNV4bPauXK8BH2bRHaTy6bGS1K+zfEhUbwGbGa/yr2c6X1OaCaqZQ== X-Gm-Gg: ASbGncuiif3WjokUjhMotEgoBhr8rL2m8zMpbjdVyv+7UJ3z9gqC2FhRp4mTdV2IC+A CaMVrq6KQovOApDeysToqC/1SfhBgQmbLEmkdVHAkPQC1Dhy1/glnh7GqSqBbGBgM5etQBWOhKo 04yp/dWj5nN+mDTjw6+zJMdrYYIAx7IdrDNj3hedfhqB9A9s5Ht3Zzq4q0yF5VStUO5u5c+k6yT XSrZI1dbP4EBrmGspR1Mq0XvgCOVdK2+VQDXWc86Z5u19qXNipP8jGWO+c0HvT99By/IVtTaiCT wVld5T95IwJg91jRfkIsCwsXg6P18tFzqADbq3is9PPuYRxxWn07/HcnU3RBB7L8kA7uVxAakAm 8mhDFFaiuVQ== X-Received: by 2002:a05:690c:368d:b0:71b:fa69:1a82 with SMTP id 00721157ae682-71bfa692661mr24301377b3.33.1754670448733; Fri, 08 Aug 2025 09:27:28 -0700 (PDT) X-Google-Smtp-Source: AGHT+IFlW/SK2xqpPPbu5o35295axqLAQOkQhIqoyd+MS4mQP3LIL8+WZc9zZEAAqzqpjzlffRpZ3w== X-Received: by 2002:a05:690c:368d:b0:71b:fa69:1a82 with SMTP id 00721157ae682-71bfa692661mr24300697b3.33.1754670448271; Fri, 08 Aug 2025 09:27:28 -0700 (PDT) Received: from ?IPV6:2601:188:c180:4250:ecbe:130d:668d:951d? ([2601:188:c180:4250:ecbe:130d:668d:951d]) by smtp.gmail.com with ESMTPSA id 00721157ae682-71c058d6bf3sm398587b3.22.2025.08.08.09.27.25 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 08 Aug 2025 09:27:27 -0700 (PDT) From: Waiman Long X-Google-Original-From: Waiman Long Message-ID: <43af3cb0-3a8d-4ed4-9007-992475ba2844@redhat.com> Date: Fri, 8 Aug 2025 12:27:25 -0400 Precedence: bulk X-Mailing-List: linux-doc@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [RFC PATCH 00/18] cgroup/cpuset: Enable runtime modification of To: Frederic Weisbecker Cc: Tejun Heo , Johannes Weiner , =?UTF-8?Q?Michal_Koutn=C3=BD?= , Jonathan Corbet , "Paul E. McKenney" , Neeraj Upadhyay , Joel Fernandes , Josh Triplett , Boqun Feng , Uladzislau Rezki , Steven Rostedt , Mathieu Desnoyers , Lai Jiangshan , Zqiang , Anna-Maria Behnsen , Ingo Molnar , Thomas Gleixner , Peter Zijlstra , Juri Lelli , Vincent Guittot , Dietmar Eggemann , Ben Segall , Mel Gorman , Valentin Schneider , Shuah Khan , cgroups@vger.kernel.org, linux-doc@vger.kernel.org, linux-kernel@vger.kernel.org, rcu@vger.kernel.org, linux-kselftest@vger.kernel.org, Phil Auld , Costa Shulyupin , Gabriele Monaco , Cestmir Kalina References: <20250808151053.19777-1-longman@redhat.com> Content-Language: en-US In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 8/8/25 11:50 AM, Frederic Weisbecker wrote: > Le Fri, Aug 08, 2025 at 11:10:44AM -0400, Waiman Long a écrit : >> The "nohz_full" and "rcu_nocbs" boot command parameters can be used to >> remove a lot of kernel overhead on a specific set of isolated CPUs which >> can be used to run some latency/bandwidth sensitive workloads with as >> little kernel disturbance/noise as possible. The problem with this mode >> of operation is the fact that it is a static configuration which cannot >> be changed after boot to adjust for changes in application loading. >> >> There is always a desire to enable runtime modification of the number >> of isolated CPUs that can be dedicated to this type of demanding >> workloads. This patchset is an attempt to do just that with an amount of >> CPU isolation close to what can be done with the nohz_full and rcu_nocbs >> boot kernel parameters. >> >> This patch series provides the ability to change the set of housekeeping >> CPUs at run time via the cpuset isolated partition functionality. >> Currently, the cpuset isolated partition is able to disable scheduler >> load balancing and the CPU affinity of the unbound workqueue to avoid the >> isolated CPUs. This patch series will extend that with other kernel noises >> associated with the nohz_full boot command line parameter which has the >> following sub-categories: >> - tick >> - timer >> - RCU >> - MISC >> - WQ >> - kthread > Thanks for working on that, I'm about to leave for 2 weeks vacation so I > won't have the time to check this until I'm back. > > However this series is highly conflicting with mine (cpuset/isolation: Honour > kthreads preferred affinity). Your patchset even redoes things I'm doing > (housekeeping cpumask update, RCU synchronization, HK_TYPE_DOMAIN to include > cpusets, etc...) > > I have a v2 that is almost ready to post. > > Wouldn't it be better to wait for it and its infrastructure changes before > proceeding with nohz_full? Sure. I am just posting this RFC patch series to show my current idea that I have. I will wait for your v2 and integrate on top. Looking forward to your upcoming v2 patch. Cheers, Longman