From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-15.1 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7CBF4C48BDF for ; Tue, 15 Jun 2021 08:04:43 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id F1E36611CE for ; Tue, 15 Jun 2021 08:04:42 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org F1E36611CE Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=redhat.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 735586B0036; Tue, 15 Jun 2021 04:04:42 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 6E5476B006E; Tue, 15 Jun 2021 04:04:42 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 4E99E6B0070; Tue, 15 Jun 2021 04:04:42 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 18F1D6B0036 for ; Tue, 15 Jun 2021 04:04:42 -0400 (EDT) Received: from smtpin19.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay05.hostedemail.com (Postfix) with ESMTP id A12FB181AEF10 for ; Tue, 15 Jun 2021 08:04:41 +0000 (UTC) X-FDA: 78255221562.19.BAE1466 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by imf25.hostedemail.com (Postfix) with ESMTP id 5FFAA6000145 for ; Tue, 15 Jun 2021 08:04:32 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1623744280; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=BQ3dVIBtoSwO39R+hFiZcOjeq+PcftU2mloldEk3r0o=; b=ghI2CV28/fcclDDenDFwxB7ErYLs7q9lcILrePQeq30nMRa5kO9BOT3anJxGx9hrY279Ng pIemlc2lXwAozLIF05tXC9jdJpH87AHLSKjRmq3WApiK4sNv/ojDGCsCsak/qjCZFyJFb3 DvfKso4oKJ4B5JnZr925hUCNJW/TifA= Received: from mail-wr1-f69.google.com (mail-wr1-f69.google.com [209.85.221.69]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-474-0pAbu7oiMS6e07Z7naBlcQ-1; Tue, 15 Jun 2021 04:04:39 -0400 X-MC-Unique: 0pAbu7oiMS6e07Z7naBlcQ-1 Received: by mail-wr1-f69.google.com with SMTP id g14-20020a5d698e0000b0290117735bd4d3so8163398wru.13 for ; Tue, 15 Jun 2021 01:04:39 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:organization :message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=BQ3dVIBtoSwO39R+hFiZcOjeq+PcftU2mloldEk3r0o=; b=dy+H131IflQYzUXyBDMCziOvUxoQR5+ITu/ZG9STq+DUk337TIWRbbXcRj81sk9AiD 5qtdyrBHBGtAY5+730PELrUG7jx3hNOswutcw5zq579qpDgsA4nrqVJGVUC4L6nKTX+5 ASwEIiJNr2NwLqYVclt4NxqUWA3RmJxjbf2gRSJLmiC84L7TxuRQ5XBpfzqixqkE6OiB 9U/980x3uhxdgaxFIiz9osVXQ7Wbu7BlS0gh9aQjWX4YvbqNNhohVwbDf7+Aosdu+0OF b4DX/4YIqCwAlCtGSx4RWDYlwpwZBpJwc4pHHjBM7k3xP37joTsdAIjPI5uaB9IRqBJD fTVQ== X-Gm-Message-State: AOAM530XYq2ZQS3aanEKdqjSzVGAaRAKRJheL2zpcCBdlUOurRL8+Rsr +uLh6e/DiUiVmLjQ0RDwlvmboTZfNCwRbN4doLpAG3x2w0X2Bx9KePZ0LieBMzxGCyOwoIB6Z9l MoAzy3ufoPygH2x+5n6R94yaR36d5crv4UE2F8LpjebGpzouXuN2MnqJgl+M= X-Received: by 2002:a1c:7c13:: with SMTP id x19mr3705095wmc.96.1623744278028; Tue, 15 Jun 2021 01:04:38 -0700 (PDT) X-Google-Smtp-Source: ABdhPJy8zKcj+0CHWNbpopi15qK/VY149FzjCqfOGVYh24AlZU3SNfDxUiS6IcZoR2LoqC+8dPMiWA== X-Received: by 2002:a1c:7c13:: with SMTP id x19mr3705056wmc.96.1623744277769; Tue, 15 Jun 2021 01:04:37 -0700 (PDT) Received: from [192.168.3.132] (p5b0c6136.dip0.t-ipconnect.de. [91.12.97.54]) by smtp.gmail.com with ESMTPSA id s1sm1510041wmj.8.2021.06.15.01.04.36 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 15 Jun 2021 01:04:37 -0700 (PDT) Subject: =?UTF-8?B?UmU6IOetlOWkjTogW1BBVENIIHY0XSBtbS9jb21wYWN0aW9uOiBsZXQg?= =?UTF-8?Q?proactive_compaction_order_configurable?= To: "Chu,Kaiping" , "mcgrof@kernel.org" , "keescook@chromium.org" , "yzaikin@google.com" , "akpm@linux-foundation.org" , "vbabka@suse.cz" , "nigupta@nvidia.com" , "bhe@redhat.com" , "khalid.aziz@oracle.com" , "iamjoonsoo.kim@lge.com" , "mateusznosek0@gmail.com" , "sh_def@163.com" Cc: "linux-kernel@vger.kernel.org" , "linux-fsdevel@vger.kernel.org" , "linux-mm@kvack.org" References: <1619576901-9531-1-git-send-email-chukaiping@baidu.com> From: David Hildenbrand Organization: Red Hat Message-ID: <3d4f59ce-8f83-4892-c210-649780b247f3@redhat.com> Date: Tue, 15 Jun 2021 10:04:36 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.10.1 MIME-Version: 1.0 In-Reply-To: X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Authentication-Results: imf25.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=ghI2CV28; dmarc=pass (policy=none) header.from=redhat.com; spf=none (imf25.hostedemail.com: domain of david@redhat.com has no SPF policy when checking 170.10.133.124) smtp.mailfrom=david@redhat.com X-Rspamd-Server: rspam02 X-Stat-Signature: bhg6zproh6osktot9udf4rdnrs9axtw5 X-Rspamd-Queue-Id: 5FFAA6000145 X-HE-Tag: 1623744272-77462 Content-Transfer-Encoding: quoted-printable X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On 15.06.21 03:11, Chu,Kaiping wrote: >=20 >=20 >> -----=E9=82=AE=E4=BB=B6=E5=8E=9F=E4=BB=B6----- >> =E5=8F=91=E4=BB=B6=E4=BA=BA: David Hildenbrand >> =E5=8F=91=E9=80=81=E6=97=B6=E9=97=B4: 2021=E5=B9=B46=E6=9C=889=E6=97=A5= 18:45 >> =E6=94=B6=E4=BB=B6=E4=BA=BA: Chu,Kaiping ; mcgro= f@kernel.org; >> keescook@chromium.org; yzaikin@google.com; akpm@linux-foundation.org; >> vbabka@suse.cz; nigupta@nvidia.com; bhe@redhat.com; >> khalid.aziz@oracle.com; iamjoonsoo.kim@lge.com; >> mateusznosek0@gmail.com; sh_def@163.com >> =E6=8A=84=E9=80=81: linux-kernel@vger.kernel.org; linux-fsdevel@vger.k= ernel.org; >> linux-mm@kvack.org >> =E4=B8=BB=E9=A2=98: Re: [PATCH v4] mm/compaction: let proactive compac= tion order >> configurable >> >> On 28.04.21 04:28, chukaiping wrote: >>> Currently the proactive compaction order is fixed to >>> COMPACTION_HPAGE_ORDER(9), it's OK in most machines with lots of >>> normal 4KB memory, but it's too high for the machines with small >>> normal memory, for example the machines with most memory configured a= s >>> 1GB hugetlbfs huge pages. In these machines the max order of free >>> pages is often below 9, and it's always below 9 even with hard >>> compaction. This will lead to proactive compaction be triggered very >>> frequently. In these machines we only care about order of 3 or 4. >>> This patch export the oder to proc and let it configurable by user, >>> and the default value is still COMPACTION_HPAGE_ORDER. >>> >>> Signed-off-by: chukaiping >>> Reported-by: kernel test robot >>> --- >>> >>> Changes in v4: >>> - change the sysctl file name to proactive_compation_order >>> >>> Changes in v3: >>> - change the min value of compaction_order to 1 because the >> fragmentation >>> index of order 0 is always 0 >>> - move the definition of max_buddy_zone into #ifdef >>> CONFIG_COMPACTION >>> >>> Changes in v2: >>> - fix the compile error in ia64 and powerpc, move the initializ= ation >>> of sysctl_compaction_order to kcompactd_init because >>> COMPACTION_HPAGE_ORDER is a variable in these architectures >>> - change the hard coded max order number from 10 to MAX_ORDER - >> 1 >>> >>> include/linux/compaction.h | 1 + >>> kernel/sysctl.c | 10 ++++++++++ >>> mm/compaction.c | 12 ++++++++---- >>> 3 files changed, 19 insertions(+), 4 deletions(-) >>> >>> diff --git a/include/linux/compaction.h b/include/linux/compaction.h >>> index ed4070e..a0226b1 100644 >>> --- a/include/linux/compaction.h >>> +++ b/include/linux/compaction.h >>> @@ -83,6 +83,7 @@ static inline unsigned long compact_gap(unsigned in= t >> order) >>> #ifdef CONFIG_COMPACTION >>> extern int sysctl_compact_memory; >>> extern unsigned int sysctl_compaction_proactiveness; >>> +extern unsigned int sysctl_proactive_compaction_order; >>> extern int sysctl_compaction_handler(struct ctl_table *table, int = write, >>> void *buffer, size_t *length, loff_t *ppos); >>> extern int sysctl_extfrag_threshold; diff --git a/kernel/sysctl.c >>> b/kernel/sysctl.c index 62fbd09..ed9012e 100644 >>> --- a/kernel/sysctl.c >>> +++ b/kernel/sysctl.c >>> @@ -196,6 +196,7 @@ enum sysctl_writes_mode { >>> #endif /* CONFIG_SCHED_DEBUG */ >>> >>> #ifdef CONFIG_COMPACTION >>> +static int max_buddy_zone =3D MAX_ORDER - 1; >>> static int min_extfrag_threshold; >>> static int max_extfrag_threshold =3D 1000; >>> #endif >>> @@ -2871,6 +2872,15 @@ int proc_do_static_key(struct ctl_table *table= , >> int write, >>> .extra2 =3D &one_hundred, >>> }, >>> { >>> + .procname =3D "proactive_compation_order", >>> + .data =3D &sysctl_proactive_compaction_order, >>> + .maxlen =3D sizeof(sysctl_proactive_compaction_order), >>> + .mode =3D 0644, >>> + .proc_handler =3D proc_dointvec_minmax, >>> + .extra1 =3D SYSCTL_ONE, >>> + .extra2 =3D &max_buddy_zone, >>> + }, >>> + { >>> .procname =3D "extfrag_threshold", >>> .data =3D &sysctl_extfrag_threshold, >>> .maxlen =3D sizeof(int), >>> diff --git a/mm/compaction.c b/mm/compaction.c index e04f447..171436e >>> 100644 >>> --- a/mm/compaction.c >>> +++ b/mm/compaction.c >>> @@ -1925,17 +1925,18 @@ static bool kswapd_is_running(pg_data_t >>> *pgdat) >>> >>> /* >>> * A zone's fragmentation score is the external fragmentation wrt = to >>> the >>> - * COMPACTION_HPAGE_ORDER. It returns a value in the range [0, 100]. >>> + * sysctl_proactive_compaction_order. It returns a value in the rang= e >>> + * [0, 100]. >>> */ >>> static unsigned int fragmentation_score_zone(struct zone *zone) >>> { >>> - return extfrag_for_order(zone, COMPACTION_HPAGE_ORDER); >>> + return extfrag_for_order(zone, sysctl_proactive_compaction_order); >>> } >>> >>> /* >>> * A weighted zone's fragmentation score is the external >>> fragmentation >>> - * wrt to the COMPACTION_HPAGE_ORDER scaled by the zone's size. It >>> - * returns a value in the range [0, 100]. >>> + * wrt to the sysctl_proactive_compaction_order scaled by the zone's= size. >>> + * It returns a value in the range [0, 100]. >>> * >>> * The scaling factor ensures that proactive compaction focuses on= larger >>> * zones like ZONE_NORMAL, rather than smaller, specialized zones >>> like @@ -2666,6 +2667,7 @@ static void compact_nodes(void) >>> * background. It takes values in the range [0, 100]. >>> */ >>> unsigned int __read_mostly sysctl_compaction_proactiveness =3D 20; >>> +unsigned int __read_mostly sysctl_proactive_compaction_order; >>> >>> /* >>> * This is the entry point for compacting all nodes via @@ -2958,6 >>> +2960,8 @@ static int __init kcompactd_init(void) >>> int nid; >>> int ret; >>> >>> + sysctl_proactive_compaction_order =3D COMPACTION_HPAGE_ORDER; >>> + >>> ret =3D cpuhp_setup_state_nocalls(CPUHP_AP_ONLINE_DYN, >>> "mm/compaction:online", >>> kcompactd_cpu_online, NULL); >>> >> >> Hm, do we actually want to put an upper limit to the order a user can = supply? > No=EF=BC=8Cwe should allow user to configure the order from 1 to MAX_OR= DER - 1. Ah, I missed that we enforce an upper limit of "MAX_ORDER - 1" -- thanks. --=20 Thanks, David / dhildenb