From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id A67BBC433EF for ; Tue, 30 Nov 2021 17:28:19 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id B30FC6B0072; Tue, 30 Nov 2021 12:28:08 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id ADFF46B0073; Tue, 30 Nov 2021 12:28:08 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 9CEF86B0075; Tue, 30 Nov 2021 12:28:08 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0031.hostedemail.com [216.40.44.31]) by kanga.kvack.org (Postfix) with ESMTP id 8D01B6B0072 for ; Tue, 30 Nov 2021 12:28:08 -0500 (EST) Received: from smtpin20.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay03.hostedemail.com (Postfix) with ESMTP id 592718248076 for ; Tue, 30 Nov 2021 17:27:58 +0000 (UTC) X-FDA: 78866279436.20.11BBCA2 Received: from outbound-smtp38.blacknight.com (outbound-smtp38.blacknight.com [46.22.139.221]) by imf28.hostedemail.com (Postfix) with ESMTP id 962D890000A3 for ; Tue, 30 Nov 2021 17:27:57 +0000 (UTC) Received: from mail.blacknight.com (pemlinmail02.blacknight.ie [81.17.254.11]) by outbound-smtp38.blacknight.com (Postfix) with ESMTPS id 24EC61FCB for ; Tue, 30 Nov 2021 17:27:56 +0000 (GMT) Received: (qmail 22121 invoked from network); 30 Nov 2021 17:27:55 -0000 Received: from unknown (HELO techsingularity.net) (mgorman@techsingularity.net@[84.203.17.29]) by 81.17.254.9 with ESMTPSA (AES256-SHA encrypted, authenticated); 30 Nov 2021 17:27:55 -0000 Date: Tue, 30 Nov 2021 17:27:54 +0000 From: Mel Gorman To: Alexey Avramov Cc: Andrew Morton , Michal Hocko , Vlastimil Babka , Rik van Riel , Mike Galbraith , Darrick Wong , regressions@lists.linux.dev, Linux-fsdevel , Linux-MM , LKML Subject: Re: [PATCH 1/1] mm: vmscan: Reduce throttling due to a failure to make progress Message-ID: <20211130172754.GS3366@techsingularity.net> References: <20211125151853.8540-1-mgorman@techsingularity.net> <20211127011246.7a8ac7b8@mail.inbox.lv> <20211129150117.GO3366@techsingularity.net> <20211201010348.31e99637@mail.inbox.lv> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-15 Content-Disposition: inline In-Reply-To: <20211201010348.31e99637@mail.inbox.lv> User-Agent: Mutt/1.10.1 (2018-07-13) X-Rspamd-Server: rspam11 X-Rspamd-Queue-Id: 962D890000A3 X-Stat-Signature: dofjee9wmuayxyztssruhrquq45adaoz Authentication-Results: imf28.hostedemail.com; dkim=none; dmarc=none; spf=pass (imf28.hostedemail.com: domain of mgorman@techsingularity.net designates 46.22.139.221 as permitted sender) smtp.mailfrom=mgorman@techsingularity.net X-HE-Tag: 1638293277-138426 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Wed, Dec 01, 2021 at 01:03:48AM +0900, Alexey Avramov wrote: > I tested this [1] patch on top of 5.16-rc2. It's the same test with 10 tails. > > - with noswap > > Summary: > > 2021-11-30 23:32:36,890: Stall times for the last 548.6s: > 2021-11-30 23:32:36,890: ----------- > 2021-11-30 23:32:36,891: some cpu 3.7s, avg 0.7% > 2021-11-30 23:32:36,891: ----------- > 2021-11-30 23:32:36,891: some io 187.6s, avg 34.2% > 2021-11-30 23:32:36,891: full io 178.3s, avg 32.5% > 2021-11-30 23:32:36,891: ----------- > 2021-11-30 23:32:36,892: some memory 392.2s, avg 71.5% > 2021-11-30 23:32:36,892: full memory 390.7s, avg 71.2% > > full psi: > https://raw.githubusercontent.com/hakavlad/cache-tests/main/516-reclaim-throttle/516-rc2/patch5/noswap/psi > > mem: > https://raw.githubusercontent.com/hakavlad/cache-tests/main/516-reclaim-throttle/516-rc2/patch5/noswap/mem > Ok, taking just noswap in isolation, this is what I saw when running firefox + youtube vido and running tail /dev/zero 10 times in a row 2021-11-30 17:10:11,817: ================================= 2021-11-30 17:10:11,817: Peak values: avg10 avg60 avg300 2021-11-30 17:10:11,817: ----------- ------ ------ ------ 2021-11-30 17:10:11,817: some cpu 1.00 0.96 0.56 2021-11-30 17:10:11,817: ----------- ------ ------ ------ 2021-11-30 17:10:11,817: some io 0.24 0.06 0.04 2021-11-30 17:10:11,817: full io 0.24 0.06 0.01 2021-11-30 17:10:11,817: ----------- ------ ------ ------ 2021-11-30 17:10:11,817: some memory 2.48 0.51 0.38 2021-11-30 17:10:11,817: full memory 2.48 0.51 0.37 2021-11-30 17:10:11,817: ================================= 2021-11-30 17:10:11,817: Stall times for the last 53.7s: 2021-11-30 17:10:11,817: ----------- 2021-11-30 17:10:11,817: some cpu 0.4s, avg 0.8% 2021-11-30 17:10:11,817: ----------- 2021-11-30 17:10:11,817: some io 0.1s, avg 0.2% 2021-11-30 17:10:11,817: full io 0.1s, avg 0.2% 2021-11-30 17:10:11,817: ----------- 2021-11-30 17:10:11,817: some memory 0.3s, avg 0.6% 2021-11-30 17:10:11,817: full memory 0.3s, avg 0.6% Obviously a fairly different experience and most likely due to the underlying storage. Can you run the same test but after doing this $ echo 1 > /sys/kernel/debug/tracing/events/vmscan/mm_vmscan_throttled/enable $ cat /sys/kernel/debug/tracing/trace_pipe > trace.out and send me the trace.out file please? -- Mel Gorman SUSE Labs