From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 8905ACDB474 for ; Fri, 20 Oct 2023 04:15:55 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id E16EA8D01BE; Fri, 20 Oct 2023 00:15:54 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id DC6DB8D01BD; Fri, 20 Oct 2023 00:15:54 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id CB5918D01BE; Fri, 20 Oct 2023 00:15:54 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id BCABC8D01BD for ; Fri, 20 Oct 2023 00:15:54 -0400 (EDT) Received: from smtpin24.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay07.hostedemail.com (Postfix) with ESMTP id 7C08D1604CD for ; Fri, 20 Oct 2023 04:15:54 +0000 (UTC) X-FDA: 81364526628.24.3958145 Received: from casper.infradead.org (casper.infradead.org [90.155.50.34]) by imf10.hostedemail.com (Postfix) with ESMTP id 63520C0008 for ; Fri, 20 Oct 2023 04:15:52 +0000 (UTC) Authentication-Results: imf10.hostedemail.com; dkim=pass header.d=infradead.org header.s=casper.20170209 header.b=HzvYEQZm; spf=none (imf10.hostedemail.com: domain of willy@infradead.org has no SPF policy when checking 90.155.50.34) smtp.mailfrom=willy@infradead.org; dmarc=none ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1697775352; a=rsa-sha256; cv=none; b=SLJPn5RKu7I1ODiBCAWpFVQSKqesWNCm+fBTOvxSTk94m1oJ/i2pqlBe8tNjVn6Ck9+FZy tISjY0ciL3pS6REqH6cGYfHTM1pcC2ZTH0inqL/XyfzZ2yMzQn0rG8/0PSfBPD/uGSZ8Nt fKYO2sG04yTHzYX0Fe7JDJmVyIEYnAc= ARC-Authentication-Results: i=1; imf10.hostedemail.com; dkim=pass header.d=infradead.org header.s=casper.20170209 header.b=HzvYEQZm; spf=none (imf10.hostedemail.com: domain of willy@infradead.org has no SPF policy when checking 90.155.50.34) smtp.mailfrom=willy@infradead.org; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1697775352; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=gemlUgVisWtTZh5bt5ZgoKVAVQjqpxFYZRLfuM3OkQ4=; b=cLqeqbQ0uKNSFrJUiYL6JrIvw3d+/julXxyPMpWL5d/c4Zz86J3MWzQZL3kS+F9Ud8m4Wt L9Tr1Fjl8UADjUowllMVbMyeNo6/wRJ3zJOUYefZNknHQirFn0zEAmFb2s7zSJsSb6siAU 0QfcDL3vZiRm1rCq3XHylTEjVsYKITs= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=casper.20170209; h=In-Reply-To:Content-Transfer-Encoding: Content-Type:MIME-Version:References:Message-ID:Subject:Cc:To:From:Date: Sender:Reply-To:Content-ID:Content-Description; bh=gemlUgVisWtTZh5bt5ZgoKVAVQjqpxFYZRLfuM3OkQ4=; b=HzvYEQZm/NkcpUNat/8nKTKpfF Xt28jHszC5uDQpn4Uc62WV5dSC6NCW+GnjQWa2/2RSxaaU9Bw+QeW6lmZ4eaQqQQZClX0ZaBB/8UU b7+8MNyFu/nZ9YZvgB+lE4GpV5g21t8RPpPSudrS/bxM4EXdzfbEAmG7PjzquRzfAmvHbXbxswbJn LN382U6ZhJumGsmOfObSAl4a7PuRgPQGwTu2PYLNembJcTG0YL23sNxem+9S+0Drxx1t+4bvvqjFx tFJGSPJHbrImfxCrRWa0Eb4X70XEmQY2TlCYHXBAk6ygZa7cF8JGSjOdBiMYR8QOnJb8Lwku3nwIb RcCuJbpw==; Received: from willy by casper.infradead.org with local (Exim 4.94.2 #2 (Red Hat Linux)) id 1qtgvF-00B1Jv-VU; Fri, 20 Oct 2023 04:15:42 +0000 Date: Fri, 20 Oct 2023 05:15:41 +0100 From: Matthew Wilcox To: zhiguojiang Cc: David Hildenbrand , Andrew Morton , linux-mm@kvack.org, linux-kernel@vger.kernel.org, opensource.kernel@vivo.com Subject: Re: [PATCH v2 1/2] mm:vmscan: the dirty folio in folio_list skip unmap Message-ID: References: <20231019131446.317-1-justinjiang@vivo.com> <20231019131446.317-2-justinjiang@vivo.com> <2d847d76-2e33-4296-992f-1a6d00c66ff5@redhat.com> <02e73251-33ff-4632-9d2c-bc268f397202@vivo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <02e73251-33ff-4632-9d2c-bc268f397202@vivo.com> X-Rspamd-Server: rspam08 X-Rspamd-Queue-Id: 63520C0008 X-Stat-Signature: gjckdzzb9nhwjfzbm5yixjuyradbcnnp X-Rspam-User: X-HE-Tag: 1697775352-699759 X-HE-Meta: U2FsdGVkX19atd6+2lujwq7iSprFG8ZUOcXue13YQSXTQ277o2UpUy7DSReO+W+uQQTBs8YuQ7qwOrBWlQy8k1gQChSzTZTij+Dh7jbt8yrxla6wz4j2E8EXKd4OU9BIBVvY1O7BNZ8JmD8FUqjsbB2OFLKJ03kVxvDPSlqDevbB7ILid6Q4i+/j2pvYZcQOfxYkN6+O9zh9V2dQxNSqXY3SYbey2ttFEJLoP6fwc6sMme946ELDBJBHiLCfsVQVQNvm1mUueHjHIycympB3+pl/RH7g4nOq1WNhR0BJMxNdaxyyhp2NMMmkkONGkWtlmnzhu2gLMIZmPwFTxedGbVJtlvZDdSr/tzRClxGYuSdeNmF/EzxN/6vzWP9Ah7ZWaH/r+slkZwKOClD0fy49A2syNBhBQn+C2oFbMl24sGS4MvQAAlo799xlbvHeAokRlj85BtXICAamQerI9gRjPUKObzI3MCuDR3oR1p7TeVWVBbunEbxTZJ0c0qeiYwSvRnQ4y4A0oiuiCJz2TkwdO1roYWtuGNsd9d/+3tDFMkcPwMsbEHPI2TBnAVfm5VFxc5UftETKIIguW4E1rgdewNICoEFvk8t8WGvGb6yIc0n889XvI1GSBamJLq9w5HQ4nfYup/5wpH8StHBA4+DfjVafkdaW4I7GeKT9mVUCaMvocU5RXWDA2GRfUDAIp5LrKsGNjcUTL4csncHlC8/E9LM34Ab306rmXyuqJ0bJEzDKIzHn5KXDkUrJlnOt77BjUK+VC4GTVwuJrkif+GJ4YXS7fQ708Y21ttwhMzfMIzSpSca4H5VGIg8D/4zqeA2LlRWxrR7hKYM5Ap1zbnKnvlcKMiu1zAmy/axzL5o9C+TuR8HyIi7SiZ9SPJYgo7msqOkPxkHm9W8/ohS8Xg600CQL76pnPVBjfHOBqm+XrFvgHYkKB3LMS4vxDnvt0rdcFsG/G0o7r2FtBmJvYNG 25Np1wKE Htt/5zClxKU1cuFv9PiU8e1qSNCWlTrDb0XxjjvC/wyLo5Jw1hN7AV9a5VvCBfaGT4J48i7JDcLv7hIn6VdgOEtjPCCLechjN5q3voJTep119BS+kSX+11vGIRQsGr2VioXTkl5YaWEzRa6LT5iNyTaMe0TjXokY9D+O8ZkL3mTmqQ1laneeID6dyyA== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Fri, Oct 20, 2023 at 11:59:33AM +0800, zhiguojiang wrote: > > > @@ -1261,43 +1305,6 @@ static unsigned int shrink_folio_list(struct > > > list_head *folio_list, > > >                       enum ttu_flags flags = TTU_BATCH_FLUSH; > > >                       bool was_swapbacked = > > > folio_test_swapbacked(folio); > > > > > > -                     if (folio_test_dirty(folio)) { > > > -                             /* > > > -                              * Only kswapd can writeback > > > filesystem folios > > > -                              * to avoid risk of stack overflow. > > > But avoid > > > -                              * injecting inefficient single-folio > > > I/O into > > > -                              * flusher writeback as much as > > > possible: only > > > -                              * write folios when we've encountered > > > many > > > -                              * dirty folios, and when we've > > > already scanned > > > -                              * the rest of the LRU for clean > > > folios and see > > > -                              * the same dirty folios again (with > > > the reclaim > > > -                              * flag set). > > > -                              */ > > > -                             if (folio_is_file_lru(folio) && > > > -                                     (!current_is_kswapd() || > > > - !folio_test_reclaim(folio) || > > > -                                      !test_bit(PGDAT_DIRTY, > > > &pgdat->flags))) { > > > -                                     /* > > > -                                      * Immediately reclaim when > > > written back. > > > -                                      * Similar in principle to > > > folio_deactivate() > > > -                                      * except we already have the > > > folio isolated > > > -                                      * and know it's dirty > > > -                                      */ > > > -                                     node_stat_mod_folio(folio, > > > NR_VMSCAN_IMMEDIATE, > > > -                                                     nr_pages); > > > -                                     folio_set_reclaim(folio); > > > - > > > -                                     goto activate_locked; > > > -                             } > > > - > > > -                             if (references == FOLIOREF_RECLAIM_CLEAN) > > > -                                     goto keep_locked; > > > -                             if (!may_enter_fs(folio, sc->gfp_mask)) > > > -                                     goto keep_locked; > > > -                             if (!sc->may_writepage) > > > -                                     goto keep_locked; > > > -                     } > > > - > > >                       if (folio_test_pmd_mappable(folio)) > > >                               flags |= TTU_SPLIT_HUGE_PMD; > > > > > > > I'm confused. Did you apply this on top of v1 by accident? > Hi, > According to my modified mm_vmscan_lru_shrink_inactive test tracelog, in the You're missing David's point. You've generated this patch against ... something ... that isn't upstream. Probably against v1 of your patch. Please check your git tree. > 32 scanned inactive file pages, 20 were dirty, and the 20 dirty pages were > not reclamed, but they took 20us to perform try_to_unmap. > > I think unreclaimed dirty folio in inactive file lru can skip to perform > try_to_unmap. Please help to continue review. Thanks. > > kswapd0-99      (     99) [005] .....   687.793724: > mm_vmscan_lru_shrink_inactive: [Justin] nid 0 scan=32 isolate=32 reclamed=12 > nr_dirty=20 nr_unqueued_dirty=20 nr_writeback=0 nr_congested=0 > nr_immediate=0 nr_activate[0]=0 nr_activate[1]=20 nr_ref_keep=0 > nr_unmap_fail=0 priority=2 file=RECLAIM_WB_FILE|RECLAIM_WB_ASYNC total=39 > exe=0 reference_cost=5 reference_exe=0 unmap_cost=21 unmap_exe=0 > dirty_unmap_cost=20 dirty_unmap_exe=0 pageout_cost=0 pageout_exe=0 Are you seeing measurable changes for any workloads? It certainly seems like you should, but it would help if you chose a test from mmtests and showed how performance changed on your system.