From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-18.2 required=3.0 tests=BAYES_00,DKIMWL_WL_MED, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,MENTIONS_GIT_HOSTING,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED, USER_IN_DEF_DKIM_WL autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 1ED97C433F5 for ; Sun, 5 Sep 2021 22:16:02 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 8E5CF60F4A for ; Sun, 5 Sep 2021 22:16:01 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org 8E5CF60F4A Authentication-Results: mail.kernel.org; dmarc=fail (p=reject dis=none) header.from=google.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=kvack.org Received: by kanga.kvack.org (Postfix) id DFB076B0071; Sun, 5 Sep 2021 18:16:00 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id DAB2C900002; Sun, 5 Sep 2021 18:16:00 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id C4B646B0073; Sun, 5 Sep 2021 18:16:00 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0126.hostedemail.com [216.40.44.126]) by kanga.kvack.org (Postfix) with ESMTP id B46046B0071 for ; Sun, 5 Sep 2021 18:16:00 -0400 (EDT) Received: from smtpin28.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay03.hostedemail.com (Postfix) with ESMTP id 69F728249980 for ; Sun, 5 Sep 2021 22:16:00 +0000 (UTC) X-FDA: 78554928480.28.E797BBA Received: from mail-lf1-f50.google.com (mail-lf1-f50.google.com [209.85.167.50]) by imf18.hostedemail.com (Postfix) with ESMTP id 290034002088 for ; Sun, 5 Sep 2021 22:16:00 +0000 (UTC) Received: by mail-lf1-f50.google.com with SMTP id z2so9657117lft.1 for ; Sun, 05 Sep 2021 15:15:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=EdF8eTd8kKpWzCqKy4Qdxl10507JxyAEtuvJS7LJ1MI=; b=EXW6QJMTkxih4uLdIulfVtj8kkdNJUj9ZVgJhBNCciX3HOhQcli4gqqydxY9c3m2Y+ L2+23FTK49S7qcWelz/2lKHVC1gu/6C4QRnWXT/tJFu0DWn+ITZCtBbb2uVvQeePYPsW ukg6FTqYeImuHuxa8h1a7WX3JzysBBGpGAl0wD3CpuzPghXaT0urE9auGcJTMldW2Cfp tHLbXJUO06uMfccbxfdwM/B636Fm+3LmTzF+FS35wE0+wurL9FfgF9pQzrrlexAHR8Ab scXUnbcoI4LDivihcvms7WnTP22Yj0En4zYY2icbg1ykEHPuylj92F3vofdyMsmkgCoo ZbTA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=EdF8eTd8kKpWzCqKy4Qdxl10507JxyAEtuvJS7LJ1MI=; b=prLBdJ6XgKXJxWtHyYanaoaZ6tskd5RLqHdJ+fNrzprX3BFQU1P2sEcv/LKeLGJe6B nAPQmpQ4eYpmF/6Io96tL3o0rt4Mk+OfRNkO8QLg2R7oNF8U0lV13QgRg1Z7KRUXNK/W CP75VH11TtW+dXdjUbbcLn71gbkQHoYGFF3JJ6hZx9SKjeM2X4VypxeZuV+UB+Ulh0j1 EiF/aHnpH1av3T+OY+pdj1cmDuM3imLj095Jrpwc8HtvdmKTNpsnWsM8z6uwO3UhcJ0w V9qo0MvINCFBziGIRYvKzgG2/Zyn7VBQmuVuamSb3WgNK0jVGkEFLf/6W8LOzsR37WOw QSdg== X-Gm-Message-State: AOAM533iBVJO2b06UW3ZmOpl0gNAUETYEZMGSDE/jlPlwFyQ/lFlslm1 YC+ppq1VpLxEd3ueNNqETBUumH4upxyJpK1ouPo9cw== X-Google-Smtp-Source: ABdhPJxmlX3dXPmgnB6Hh77xDi+jpkh8lQ/2eVRzletNPai5vYDEuEL3vbjDqx3eEjDosmulhpU4ptRFDUrSV3w6bTg= X-Received: by 2002:a05:6512:2202:: with SMTP id h2mr7253775lfu.494.1630880158252; Sun, 05 Sep 2021 15:15:58 -0700 (PDT) MIME-Version: 1.0 References: <20210902215504.dSSfDKJZu%akpm@linux-foundation.org> <20210905124439.GA15026@xsang-OptiPlex-9020> In-Reply-To: <20210905124439.GA15026@xsang-OptiPlex-9020> From: Shakeel Butt Date: Sun, 5 Sep 2021 15:15:46 -0700 Message-ID: Subject: Re: [memcg] 45208c9105: aim7.jobs-per-min -14.0% regression To: kernel test robot Cc: Andrew Morton , 0day robot , Marek Szyprowski , Hillf Danton , Huang Ying , Johannes Weiner , Michal Hocko , =?UTF-8?Q?Michal_Koutn=C3=BD?= , Muchun Song , Roman Gushchin , Tejun Heo , LKML , lkp@lists.01.org, Feng Tang , Xing Zhengjun , Linux MM , mm-commits@vger.kernel.org, Linus Torvalds Content-Type: text/plain; charset="UTF-8" Authentication-Results: imf18.hostedemail.com; dkim=pass header.d=google.com header.s=20210112 header.b=EXW6QJMT; spf=pass (imf18.hostedemail.com: domain of shakeelb@google.com designates 209.85.167.50 as permitted sender) smtp.mailfrom=shakeelb@google.com; dmarc=pass (policy=reject) header.from=google.com X-Rspamd-Server: rspam05 X-Rspamd-Queue-Id: 290034002088 X-Stat-Signature: 5mtfnbmzg1eedsm7qr6ikm6d9xade3s7 X-HE-Tag: 1630880160-967620 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Sun, Sep 5, 2021 at 5:27 AM kernel test robot wrote: > > > > Greeting, > > FYI, we noticed a -14.0% regression of aim7.jobs-per-min due to commit: > > > commit: 45208c9105bd96015b98cdf31fbd6a3bcff234b6 ("[patch 097/212] memcg: infrastructure to flush memcg stats") > url: https://github.com/0day-ci/linux/commits/Andrew-Morton/ia64-fix-typo-in-a-comment/20210903-065028 > > > in testcase: aim7 > on test machine: 128 threads 2 sockets Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz with 256G memory > with following parameters: > > disk: 1BRD_48G > fs: xfs > test: disk_rr > load: 3000 > cpufreq_governor: performance > ucode: 0xd000280 > > test-description: AIM7 is a traditional UNIX system level benchmark suite which is used to test and measure the performance of multiuser system. > test-url: https://sourceforge.net/projects/aimbench/files/aim-suite7/ > > In addition to that, the commit also has significant impact on the following tests: > > +------------------+-------------------------------------------------------------------------------------+ > | testcase: change | reaim: reaim.jobs_per_min -10.0% regression | > | test machine | 192 threads 4 sockets Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory | > | test parameters | cpufreq_governor=performance | > | | nr_task=100% | > | | runtime=300s | > | | test=compute | > | | ucode=0x5003006 | > +------------------+-------------------------------------------------------------------------------------+ > | testcase: change | will-it-scale: will-it-scale.per_process_ops -29.8% regression | > | test machine | 104 threads 2 sockets Skylake with 192G memory | > | test parameters | cpufreq_governor=performance | > | | mode=process | > | | nr_task=100% | > | | test=fallocate2 | > | | ucode=0x2006a0a | > +------------------+-------------------------------------------------------------------------------------+ > | testcase: change | fio-basic: fio.read_iops -20.5% regression | > | test machine | 96 threads 2 sockets Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 256G memory | > | test parameters | bs=4k | > | | cpufreq_governor=performance | > | | disk=2pmem | > | | fs=xfs | > | | ioengine=mmap | > | | nr_task=50% | > | | runtime=200s | > | | rw=read | > | | test_size=200G | > | | time_based=tb | > | | ucode=0x5003006 | > +------------------+-------------------------------------------------------------------------------------+ > | testcase: change | will-it-scale: will-it-scale.per_process_ops -9.2% regression | > | test machine | 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory | > | test parameters | cpufreq_governor=performance | > | | mode=process | > | | nr_task=50% | > | | test=page_fault3 | > | | ucode=0x42e | > +------------------+-------------------------------------------------------------------------------------+ > | testcase: change | will-it-scale: will-it-scale.per_thread_ops -2.3% regression | > | test machine | 144 threads 4 sockets Intel(R) Xeon(R) Gold 5318H CPU @ 2.50GHz with 128G memory | > | test parameters | cpufreq_governor=performance | > | | mode=thread | > | | nr_task=100% | > | | test=tlb_flush1 | > | | ucode=0x700001e | > +------------------+-------------------------------------------------------------------------------------+ > | testcase: change | will-it-scale: will-it-scale.per_thread_ops -8.9% regression | > | test machine | 144 threads 4 sockets Intel(R) Xeon(R) Gold 5318H CPU @ 2.50GHz with 128G memory | > | test parameters | cpufreq_governor=performance | > | | mode=thread | > | | nr_task=16 | > | | test=tlb_flush1 | > | | ucode=0x700001e | > +------------------+-------------------------------------------------------------------------------------+ > | testcase: change | will-it-scale: will-it-scale.per_process_ops -6.4% regression | > | test machine | 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory | > | test parameters | cpufreq_governor=performance | > | | mode=process | > | | nr_task=50% | > | | test=page_fault2 | > | | ucode=0x42e | > +------------------+-------------------------------------------------------------------------------------+ > | testcase: change | netperf: netperf.Throughput_Mbps 89.8% improvement | > | test machine | 192 threads 4 sockets Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory | > | test parameters | cluster=cs-localhost | > | | cpufreq_governor=performance | > | | ip=ipv4 | > | | nr_threads=200% | > | | runtime=900s | > | | test=TCP_MAERTS | > | | ucode=0x5003006 | > +------------------+-------------------------------------------------------------------------------------+ > > > If you fix the issue, kindly add following tag > Reported-by: kernel test robot > > > Details are as below: > --------------------------------------------------------------------------------------------------> > > > To reproduce: > > git clone https://github.com/intel/lkp-tests.git > cd lkp-tests > bin/lkp install job.yaml # job file is attached in this email > bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run > bin/lkp run generated-yaml-file > > ========================================================================================= > compiler/cpufreq_governor/disk/fs/kconfig/load/rootfs/tbox_group/test/testcase/ucode: > gcc-9/performance/1BRD_48G/xfs/x86_64-rhel-8.3/3000/debian-10.4-x86_64-20200603.cgz/lkp-icl-2sp2/disk_rr/aim7/0xd000280 > > commit: > 3c28c7680e ("memcg: switch lruvec stats to rstat") > 45208c9105 ("memcg: infrastructure to flush memcg stats") I am looking into this. I was hoping we have resolution for [1] as these patches touch similar data structures. [1] https://lore.kernel.org/all/20210811031734.GA5193@xsang-OptiPlex-9020/T/#u