From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-13.6 required=3.0 tests=BAYES_00, DKIM_ADSP_CUSTOM_MED,DKIM_INVALID,DKIM_SIGNED,FREEMAIL_FORGED_FROMDOMAIN, FREEMAIL_FROM,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER, INCLUDES_PATCH,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 1BC0BC433F5 for ; Sun, 12 Sep 2021 01:51:26 +0000 (UTC) Received: from lists.sourceforge.net (lists.sourceforge.net [216.105.38.7]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id B050761213 for ; Sun, 12 Sep 2021 01:51:25 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org B050761213 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=gmail.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=lists.sourceforge.net Received: from [127.0.0.1] (helo=sfs-ml-2.v29.lw.sourceforge.com) by sfs-ml-2.v29.lw.sourceforge.com with esmtp (Exim 4.92.3) (envelope-from ) id 1mPEeR-0008Dw-Qd; Sun, 12 Sep 2021 01:51:23 +0000 Received: from [172.30.20.202] (helo=mx.sourceforge.net) by sfs-ml-2.v29.lw.sourceforge.com with esmtps (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.92.3) (envelope-from ) id 1mPEeQ-0008Dq-NV for linux-f2fs-devel@lists.sourceforge.net; Sun, 12 Sep 2021 01:51:22 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=sourceforge.net; s=x; h=Content-Transfer-Encoding:MIME-Version:Message-Id: Date:Subject:Cc:To:From:Sender:Reply-To:Content-Type:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:In-Reply-To:References:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=auEZYHBqASA+fB02AIOJA7gR0SmC/QFwN1UQq3UIMQg=; b=Op+UILNr1ipRqf5rA8GMAxKVZc cNiaosIBJ8osuLv+iavqgAtiKH2k+I74lTxIFjQDX1ifgtYijrTwNw3oGaP4Bb0K7fbvUnwZ854bz 8Smq3x2Vdj/5gDhsOCZ+CqRXctT55T7wy5M8ffn78RzvuCyGFbr9b5HEnBMH1QEzQcx0=; DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=sf.net; s=x ; h=Content-Transfer-Encoding:MIME-Version:Message-Id:Date:Subject:Cc:To:From :Sender:Reply-To:Content-Type:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:In-Reply-To: References:List-Id:List-Help:List-Unsubscribe:List-Subscribe:List-Post: List-Owner:List-Archive; bh=auEZYHBqASA+fB02AIOJA7gR0SmC/QFwN1UQq3UIMQg=; b=A yBJIkgkCKfXsZ3UxVMkNy9XHqTDAcHqdA33Pikd95ocAaE1NlIY4W/L3hK51qtp99ZN2l9QAk763c xkyQ5CsOfkQcDNIQJzePtmAgeOodPLJSo6A1lATmxSTJskV09jYsqOVDksosfaTcElnxS1znIIY+x lFFEKMQnvmWLYsuU=; Received: from mail-pj1-f53.google.com ([209.85.216.53]) by sfi-mx-2.v28.lw.sourceforge.com with esmtps (TLSv1.2:ECDHE-RSA-AES128-GCM-SHA256:128) (Exim 4.92.3) id 1mPEeL-0006kg-DQ for linux-f2fs-devel@lists.sourceforge.net; Sun, 12 Sep 2021 01:51:22 +0000 Received: by mail-pj1-f53.google.com with SMTP id oc9so3880034pjb.4 for ; Sat, 11 Sep 2021 18:51:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=auEZYHBqASA+fB02AIOJA7gR0SmC/QFwN1UQq3UIMQg=; b=mxRd4tX/8jfm+/pIF01Optbc9rXsNbBj/w+YJZ3oZAMGhWGrmhIPIpXUuAlrZqTZbt O4G4GwzCx6FqAdabaSjpXtKHvhHiUZxDp6VT/uEnNuZmSOzdbfDc+QCsq2ZaTPv62OJo N/s/fVzApifRynwTYTajLOkYZj/77thaEKYSAAinXCmKYV0Q5wumxBvyV6XBZQnY4cbz QVatE8K9k1g+JY0O6ZRxLLYw/SLqLCGYG0GRFF1kQYee5dCxaQvP/y1tBqx3VloLs6ep co645lJFYe5fxxByNw1qrvjBUjGK+NrE1Es6X4NEHVm4o5hTGO3CS3nMv2hBOM6NHs7v dlKQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=auEZYHBqASA+fB02AIOJA7gR0SmC/QFwN1UQq3UIMQg=; b=ANB+yVUNXENHzPkPJMdTlhQEQEJ1dArSswtep+a++Lj0IZRq6v2J8PAM3E2vqoNryp remPxTVjiqetW1xur2/EVX2VwtrTV8RICFFfFTKlRQaUaAA//ExdjfnYHM8s657QwDf6 CCeLLidclcu7ud2vZzyFOhLCQuy5UryB5eemrQQJ16m0G1uyXzp+QYQHqtT/Ua6xS6Fu cVjK6ZeVNUoF7tYI+NCKCQ0dyaZD79E6aq1i1YgfPHy9gNzr1EYUKIntGk/jdp4rr8H/ Qi5r4uoGEHPN+73xw60VECx2bH+l9JNNzUp9zcxmQUMzIcr4dg3ay/al3eLk1Era8MvH P4YQ== X-Gm-Message-State: AOAM531TPRZ//0YaSQYtVkDpI9OieLUkN4CQYRtsGtMWN9jGNRHn+Hcj laPxaVApDIHslqWjrcqhA+s= X-Google-Smtp-Source: ABdhPJznyCQq33WyT01BwhV0NsRCtSxVEQzlqCkkwwtoLV0vcNgcbMWNPi7kkCfuKVjCxl/OwmfpfQ== X-Received: by 2002:a17:902:ab16:b0:13a:356c:6a03 with SMTP id ik22-20020a170902ab1600b0013a356c6a03mr4420989plb.38.1631411470958; Sat, 11 Sep 2021 18:51:10 -0700 (PDT) Received: from localhost.localdomain (061239141224.ctinets.com. [61.239.141.224]) by smtp.googlemail.com with ESMTPSA id l13sm2638912pji.3.2021.09.11.18.51.08 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 11 Sep 2021 18:51:10 -0700 (PDT) From: Fengnan Chang To: jaegeuk@kernel.org, chao@kernel.org Date: Sun, 12 Sep 2021 09:50:57 +0800 Message-Id: <20210912015058.14063-1-fengnanchang@gmail.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 X-Headers-End: 1mPEeL-0006kg-DQ Subject: [f2fs-dev] [PATCH 1/2] f2fs: separate buffer and direct io in block allocation statistics X-BeenThere: linux-f2fs-devel@lists.sourceforge.net X-Mailman-Version: 2.1.21 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Fengnan Chang , linux-f2fs-devel@lists.sourceforge.net Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: linux-f2fs-devel-bounces@lists.sourceforge.net From: Fengnan Chang separate buffer and direct io in block allocation statistics. New output will like this: buffer direct segments IPU: 0 0 N/A SSR: 0 0 0 LFS: 0 0 0 Signed-off-by: Fengnan Chang --- fs/f2fs/data.c | 10 ++++++---- fs/f2fs/debug.c | 24 +++++++++++++++--------- fs/f2fs/f2fs.h | 28 +++++++++++++++++++--------- fs/f2fs/gc.c | 2 +- fs/f2fs/segment.c | 8 ++++---- 5 files changed, 45 insertions(+), 27 deletions(-) diff --git a/fs/f2fs/data.c b/fs/f2fs/data.c index f4fd6c246c9a..c1490b9a1345 100644 --- a/fs/f2fs/data.c +++ b/fs/f2fs/data.c @@ -1342,7 +1342,7 @@ struct page *f2fs_get_new_data_page(struct inode *inode, return page; } -static int __allocate_data_block(struct dnode_of_data *dn, int seg_type) +static int __allocate_data_block(struct dnode_of_data *dn, int seg_type, bool direct_io) { struct f2fs_sb_info *sbi = F2FS_I_SB(dn->inode); struct f2fs_summary sum; @@ -1369,7 +1369,7 @@ static int __allocate_data_block(struct dnode_of_data *dn, int seg_type) set_summary(&sum, dn->nid, dn->ofs_in_node, ni.version); old_blkaddr = dn->data_blkaddr; f2fs_allocate_data_block(sbi, NULL, old_blkaddr, &dn->data_blkaddr, - &sum, seg_type, NULL); + &sum, seg_type, NULL, direct_io); if (GET_SEGNO(sbi, old_blkaddr) != NULL_SEGNO) { invalidate_mapping_pages(META_MAPPING(sbi), old_blkaddr, old_blkaddr); @@ -1548,7 +1548,7 @@ int f2fs_map_blocks(struct inode *inode, struct f2fs_map_blocks *map, /* use out-place-update for driect IO under LFS mode */ if (f2fs_lfs_mode(sbi) && flag == F2FS_GET_BLOCK_DIO && map->m_may_create) { - err = __allocate_data_block(&dn, map->m_seg_type); + err = __allocate_data_block(&dn, map->m_seg_type, true); if (err) goto sync_out; blkaddr = dn.data_blkaddr; @@ -1569,7 +1569,9 @@ int f2fs_map_blocks(struct inode *inode, struct f2fs_map_blocks *map, WARN_ON(flag != F2FS_GET_BLOCK_PRE_DIO && flag != F2FS_GET_BLOCK_DIO); err = __allocate_data_block(&dn, - map->m_seg_type); + map->m_seg_type, + flag == F2FS_GET_BLOCK_PRE_DIO || + flag == F2FS_GET_BLOCK_DIO); if (!err) set_inode_flag(inode, FI_APPEND_WRITE); } diff --git a/fs/f2fs/debug.c b/fs/f2fs/debug.c index 8c50518475a9..e1aa843b067c 100644 --- a/fs/f2fs/debug.c +++ b/fs/f2fs/debug.c @@ -64,7 +64,7 @@ static void update_general_status(struct f2fs_sb_info *sbi) { struct f2fs_stat_info *si = F2FS_STAT(sbi); struct f2fs_super_block *raw_super = F2FS_RAW_SUPER(sbi); - int i; + int i, j; /* these will be changed if online resize is done */ si->main_area_segs = le32_to_cpu(raw_super->segment_count_main); @@ -210,10 +210,12 @@ static void update_general_status(struct f2fs_sb_info *sbi) for (i = 0; i < 2; i++) { si->segment_count[i] = sbi->segment_count[i]; - si->block_count[i] = sbi->block_count[i]; + for (j = 0; j < 2; j++) + si->block_count[i][j] = sbi->block_count[i][j]; } - si->inplace_count = atomic_read(&sbi->inplace_count); + for (i = 0; i < 2; i++) + si->inplace_count[i] = atomic_read(&sbi->inplace_count[i]); } /* @@ -551,11 +553,14 @@ static int stat_show(struct seq_file *s, void *v) for (j = 0; j < si->util_free; j++) seq_putc(s, '-'); seq_puts(s, "]\n\n"); - seq_printf(s, "IPU: %u blocks\n", si->inplace_count); - seq_printf(s, "SSR: %u blocks in %u segments\n", - si->block_count[SSR], si->segment_count[SSR]); - seq_printf(s, "LFS: %u blocks in %u segments\n", - si->block_count[LFS], si->segment_count[LFS]); + + seq_printf(s, " %10s %10s %10s\n", "buffer", "direct", "segments"); + seq_printf(s, "IPU: %10d %10d N/A\n", si->inplace_count[1], + si->inplace_count[0]); + seq_printf(s, "SSR: %10d %10d %10d\n", si->block_count[1][SSR], + si->block_count[0][SSR], si->segment_count[SSR]); + seq_printf(s, "LFS: %10d %10d %10d\n", si->block_count[1][LFS], + si->block_count[0][LFS], si->segment_count[LFS]); /* segment usage info */ f2fs_update_sit_info(si->sbi); @@ -611,7 +616,8 @@ int f2fs_build_stats(struct f2fs_sb_info *sbi) atomic_set(&sbi->inline_dir, 0); atomic_set(&sbi->compr_inode, 0); atomic64_set(&sbi->compr_blocks, 0); - atomic_set(&sbi->inplace_count, 0); + for (i = 0; i < 2; i++) + atomic_set(&sbi->inplace_count[i], 0); for (i = META_CP; i < META_MAX; i++) atomic_set(&sbi->meta_count[i], 0); diff --git a/fs/f2fs/f2fs.h b/fs/f2fs/f2fs.h index b339ae89c1ad..3d4ee444db27 100644 --- a/fs/f2fs/f2fs.h +++ b/fs/f2fs/f2fs.h @@ -1692,8 +1692,8 @@ struct f2fs_sb_info { struct f2fs_stat_info *stat_info; /* FS status information */ atomic_t meta_count[META_MAX]; /* # of meta blocks */ unsigned int segment_count[2]; /* # of allocated segments */ - unsigned int block_count[2]; /* # of allocated blocks */ - atomic_t inplace_count; /* # of inplace update */ + unsigned int block_count[2][2]; /* # of allocated blocks */ + atomic_t inplace_count[2]; /* # of inplace update */ atomic64_t total_hit_ext; /* # of lookup extent cache */ atomic64_t read_hit_rbtree; /* # of hit rbtree extent node */ atomic64_t read_hit_largest; /* # of hit largest extent node */ @@ -3491,7 +3491,7 @@ void f2fs_replace_block(struct f2fs_sb_info *sbi, struct dnode_of_data *dn, void f2fs_allocate_data_block(struct f2fs_sb_info *sbi, struct page *page, block_t old_blkaddr, block_t *new_blkaddr, struct f2fs_summary *sum, int type, - struct f2fs_io_info *fio); + struct f2fs_io_info *fio, bool direct_io); void f2fs_wait_on_page_writeback(struct page *page, enum page_type type, bool ordered, bool locked); void f2fs_wait_on_block_writeback(struct inode *inode, block_t blkaddr); @@ -3699,8 +3699,8 @@ struct f2fs_stat_info { unsigned int meta_count[META_MAX]; unsigned int segment_count[2]; - unsigned int block_count[2]; - unsigned int inplace_count; + unsigned int block_count[2][2]; + unsigned int inplace_count[2]; unsigned long long base_mem, cache_mem, page_mem; }; @@ -3778,10 +3778,20 @@ static inline struct f2fs_stat_info *F2FS_STAT(struct f2fs_sb_info *sbi) } while (0) #define stat_inc_seg_type(sbi, curseg) \ ((sbi)->segment_count[(curseg)->alloc_type]++) -#define stat_inc_block_count(sbi, curseg) \ - ((sbi)->block_count[(curseg)->alloc_type]++) -#define stat_inc_inplace_blocks(sbi) \ - (atomic_inc(&(sbi)->inplace_count)) +#define stat_inc_block_count(sbi, curseg, direct_io) \ + do { \ + if (direct_io) \ + ((sbi)->block_count[0][(curseg)->alloc_type]++); \ + else \ + ((sbi)->block_count[1][(curseg)->alloc_type]++); \ + } while (0) +#define stat_inc_inplace_blocks(sbi, direct_io) \ + do { \ + if (direct_io) \ + (atomic_inc(&(sbi)->inplace_count[0])); \ + else \ + (atomic_inc(&(sbi)->inplace_count[1])); \ + } while (0) #define stat_update_max_atomic_write(inode) \ do { \ int cur = F2FS_I_SB(inode)->atomic_files; \ diff --git a/fs/f2fs/gc.c b/fs/f2fs/gc.c index 77391e3b7d68..7c47082f73cc 100644 --- a/fs/f2fs/gc.c +++ b/fs/f2fs/gc.c @@ -1247,7 +1247,7 @@ static int move_data_block(struct inode *inode, block_t bidx, /* allocate block address */ f2fs_allocate_data_block(fio.sbi, NULL, fio.old_blkaddr, &newaddr, - &sum, type, NULL); + &sum, type, NULL, false); fio.encrypted_page = f2fs_pagecache_get_page(META_MAPPING(fio.sbi), newaddr, FGP_LOCK | FGP_CREAT, GFP_NOFS); diff --git a/fs/f2fs/segment.c b/fs/f2fs/segment.c index a135d2247415..ded744e880d0 100644 --- a/fs/f2fs/segment.c +++ b/fs/f2fs/segment.c @@ -3391,7 +3391,7 @@ static int __get_segment_type(struct f2fs_io_info *fio) void f2fs_allocate_data_block(struct f2fs_sb_info *sbi, struct page *page, block_t old_blkaddr, block_t *new_blkaddr, struct f2fs_summary *sum, int type, - struct f2fs_io_info *fio) + struct f2fs_io_info *fio, bool direct_io) { struct sit_info *sit_i = SIT_I(sbi); struct curseg_info *curseg = CURSEG_I(sbi, type); @@ -3425,7 +3425,7 @@ void f2fs_allocate_data_block(struct f2fs_sb_info *sbi, struct page *page, __refresh_next_blkoff(sbi, curseg); - stat_inc_block_count(sbi, curseg); + stat_inc_block_count(sbi, curseg, direct_io); if (from_gc) { old_mtime = get_segment_mtime(sbi, old_blkaddr); @@ -3515,7 +3515,7 @@ static void do_write_page(struct f2fs_summary *sum, struct f2fs_io_info *fio) down_read(&fio->sbi->io_order_lock); reallocate: f2fs_allocate_data_block(fio->sbi, fio->page, fio->old_blkaddr, - &fio->new_blkaddr, sum, type, fio); + &fio->new_blkaddr, sum, type, fio, false); if (GET_SEGNO(fio->sbi, fio->old_blkaddr) != NULL_SEGNO) { invalidate_mapping_pages(META_MAPPING(fio->sbi), fio->old_blkaddr, fio->old_blkaddr); @@ -3611,7 +3611,7 @@ int f2fs_inplace_write_data(struct f2fs_io_info *fio) goto drop_bio; } - stat_inc_inplace_blocks(fio->sbi); + stat_inc_inplace_blocks(fio->sbi, false); if (fio->bio && !(SM_I(sbi)->ipu_policy & (1 << F2FS_IPU_NOCACHE))) err = f2fs_merge_page_bio(fio); -- 2.32.0 _______________________________________________ Linux-f2fs-devel mailing list Linux-f2fs-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel