From: Liu Bo <bo.li.liu@oracle.com>
To: Chandan Rajendra <chandan@linux.vnet.ibm.com>
Cc: clm@fb.com, jbacik@fb.com, dsterba@suse.cz,
linux-btrfs@vger.kernel.org, chandan@mykolab.com
Subject: Re: [RFC PATCH V11 08/21] Btrfs: subpagesize-blocksize: Compute and look up csums based on sectorsized blocks.
Date: Wed, 1 Jul 2015 22:37:00 +0800 [thread overview]
Message-ID: <20150701143659.GB7847@localhost.localdomain> (raw)
In-Reply-To: <1433172176-8742-9-git-send-email-chandan@linux.vnet.ibm.com>
On Mon, Jun 01, 2015 at 08:52:43PM +0530, Chandan Rajendra wrote:
> Checksums are applicable to sectorsize units. The current code uses
> bio->bv_len units to compute and look up checksums. This works on machines
> where sectorsize == PAGE_SIZE. This patch makes the checksum computation and
> look up code to work with sectorsize units.
Reviewed-by: Liu Bo <bo.li.liu@oracle.com>
Thanks,
-liubo
>
> Signed-off-by: Chandan Rajendra <chandan@linux.vnet.ibm.com>
> ---
> fs/btrfs/file-item.c | 87 ++++++++++++++++++++++++++++++++--------------------
> 1 file changed, 54 insertions(+), 33 deletions(-)
>
> diff --git a/fs/btrfs/file-item.c b/fs/btrfs/file-item.c
> index 58ece65..65ab9c3 100644
> --- a/fs/btrfs/file-item.c
> +++ b/fs/btrfs/file-item.c
> @@ -172,6 +172,7 @@ static int __btrfs_lookup_bio_sums(struct btrfs_root *root,
> u64 item_start_offset = 0;
> u64 item_last_offset = 0;
> u64 disk_bytenr;
> + u64 page_bytes_left;
> u32 diff;
> int nblocks;
> int bio_index = 0;
> @@ -220,6 +221,8 @@ static int __btrfs_lookup_bio_sums(struct btrfs_root *root,
> disk_bytenr = (u64)bio->bi_iter.bi_sector << 9;
> if (dio)
> offset = logical_offset;
> +
> + page_bytes_left = bvec->bv_len;
> while (bio_index < bio->bi_vcnt) {
> if (!dio)
> offset = page_offset(bvec->bv_page) + bvec->bv_offset;
> @@ -243,7 +246,7 @@ static int __btrfs_lookup_bio_sums(struct btrfs_root *root,
> if (BTRFS_I(inode)->root->root_key.objectid ==
> BTRFS_DATA_RELOC_TREE_OBJECTID) {
> set_extent_bits(io_tree, offset,
> - offset + bvec->bv_len - 1,
> + offset + root->sectorsize - 1,
> EXTENT_NODATASUM, GFP_NOFS);
> } else {
> btrfs_info(BTRFS_I(inode)->root->fs_info,
> @@ -281,11 +284,17 @@ static int __btrfs_lookup_bio_sums(struct btrfs_root *root,
> found:
> csum += count * csum_size;
> nblocks -= count;
> - bio_index += count;
> +
> while (count--) {
> - disk_bytenr += bvec->bv_len;
> - offset += bvec->bv_len;
> - bvec++;
> + disk_bytenr += root->sectorsize;
> + offset += root->sectorsize;
> + page_bytes_left -= root->sectorsize;
> + if (!page_bytes_left) {
> + bio_index++;
> + bvec++;
> + page_bytes_left = bvec->bv_len;
> + }
> +
> }
> }
> btrfs_free_path(path);
> @@ -432,6 +441,8 @@ int btrfs_csum_one_bio(struct btrfs_root *root, struct inode *inode,
> struct bio_vec *bvec = bio->bi_io_vec;
> int bio_index = 0;
> int index;
> + int nr_sectors;
> + int i;
> unsigned long total_bytes = 0;
> unsigned long this_sum_bytes = 0;
> u64 offset;
> @@ -459,41 +470,51 @@ int btrfs_csum_one_bio(struct btrfs_root *root, struct inode *inode,
> if (!contig)
> offset = page_offset(bvec->bv_page) + bvec->bv_offset;
>
> - if (offset >= ordered->file_offset + ordered->len ||
> - offset < ordered->file_offset) {
> - unsigned long bytes_left;
> - sums->len = this_sum_bytes;
> - this_sum_bytes = 0;
> - btrfs_add_ordered_sum(inode, ordered, sums);
> - btrfs_put_ordered_extent(ordered);
> + data = kmap_atomic(bvec->bv_page);
>
> - bytes_left = bio->bi_iter.bi_size - total_bytes;
>
> - sums = kzalloc(btrfs_ordered_sum_size(root, bytes_left),
> - GFP_NOFS);
> - BUG_ON(!sums); /* -ENOMEM */
> - sums->len = bytes_left;
> - ordered = btrfs_lookup_ordered_extent(inode, offset);
> - BUG_ON(!ordered); /* Logic error */
> - sums->bytenr = ((u64)bio->bi_iter.bi_sector << 9) +
> - total_bytes;
> - index = 0;
> + nr_sectors = (bvec->bv_len + root->sectorsize - 1)
> + >> root->fs_info->sb->s_blocksize_bits;
> +
> +
> + for (i = 0; i < nr_sectors; i++) {
> + if (offset >= ordered->file_offset + ordered->len ||
> + offset < ordered->file_offset) {
> + unsigned long bytes_left;
> + sums->len = this_sum_bytes;
> + this_sum_bytes = 0;
> + btrfs_add_ordered_sum(inode, ordered, sums);
> + btrfs_put_ordered_extent(ordered);
> +
> + bytes_left = bio->bi_iter.bi_size - total_bytes;
> +
> + sums = kzalloc(btrfs_ordered_sum_size(root, bytes_left),
> + GFP_NOFS);
> + BUG_ON(!sums); /* -ENOMEM */
> + sums->len = bytes_left;
> + ordered = btrfs_lookup_ordered_extent(inode, offset);
> + BUG_ON(!ordered); /* Logic error */
> + sums->bytenr = ((u64)bio->bi_iter.bi_sector << 9) +
> + total_bytes;
> + index = 0;
> + }
> +
> + sums->sums[index] = ~(u32)0;
> + sums->sums[index]
> + = btrfs_csum_data(data + bvec->bv_offset + (i * root->sectorsize),
> + sums->sums[index],
> + root->sectorsize);
> + btrfs_csum_final(sums->sums[index],
> + (char *)(sums->sums + index));
> + index++;
> + offset += root->sectorsize;
> + this_sum_bytes += root->sectorsize;
> + total_bytes += root->sectorsize;
> }
>
> - data = kmap_atomic(bvec->bv_page);
> - sums->sums[index] = ~(u32)0;
> - sums->sums[index] = btrfs_csum_data(data + bvec->bv_offset,
> - sums->sums[index],
> - bvec->bv_len);
> kunmap_atomic(data);
> - btrfs_csum_final(sums->sums[index],
> - (char *)(sums->sums + index));
>
> bio_index++;
> - index++;
> - total_bytes += bvec->bv_len;
> - this_sum_bytes += bvec->bv_len;
> - offset += bvec->bv_len;
> bvec++;
> }
> this_sum_bytes = 0;
> --
> 2.1.0
>
next prev parent reply other threads:[~2015-07-01 14:37 UTC|newest]
Thread overview: 47+ messages / expand[flat|nested] mbox.gz Atom feed top
2015-06-01 15:22 [RFC PATCH V11 00/21] Btrfs: Subpagesize-blocksize: Allow I/O on blocks whose size is less than page size Chandan Rajendra
2015-06-01 15:22 ` [RFC PATCH V11 01/21] Btrfs: subpagesize-blocksize: Fix whole page read Chandan Rajendra
2015-06-19 4:45 ` Liu Bo
2015-06-19 9:45 ` Chandan Rajendra
2015-06-23 8:37 ` Liu Bo
2016-02-10 10:44 ` David Sterba
2016-02-10 10:39 ` David Sterba
2016-02-11 5:42 ` Chandan Rajendra
2015-06-01 15:22 ` [RFC PATCH V11 02/21] Btrfs: subpagesize-blocksize: Fix whole page write Chandan Rajendra
2015-06-26 9:50 ` Liu Bo
2015-06-29 8:54 ` Chandan Rajendra
2015-07-01 14:27 ` Liu Bo
2015-06-01 15:22 ` [RFC PATCH V11 03/21] Btrfs: subpagesize-blocksize: __btrfs_buffered_write: Reserve/release extents aligned to block size Chandan Rajendra
2015-06-01 15:22 ` [RFC PATCH V11 04/21] Btrfs: subpagesize-blocksize: Define extent_buffer_head Chandan Rajendra
2015-07-01 14:33 ` Liu Bo
2015-06-01 15:22 ` [RFC PATCH V11 05/21] Btrfs: subpagesize-blocksize: Read tree blocks whose size is < PAGE_SIZE Chandan Rajendra
2015-07-01 14:40 ` Liu Bo
2015-07-03 10:02 ` Chandan Rajendra
2015-06-01 15:22 ` [RFC PATCH V11 06/21] Btrfs: subpagesize-blocksize: Write only dirty extent buffers belonging to a page Chandan Rajendra
2015-06-01 15:22 ` [RFC PATCH V11 07/21] Btrfs: subpagesize-blocksize: Allow mounting filesystems where sectorsize != PAGE_SIZE Chandan Rajendra
2015-06-01 15:22 ` [RFC PATCH V11 08/21] Btrfs: subpagesize-blocksize: Compute and look up csums based on sectorsized blocks Chandan Rajendra
2015-07-01 14:37 ` Liu Bo [this message]
2015-06-01 15:22 ` [RFC PATCH V11 09/21] Btrfs: subpagesize-blocksize: Direct I/O read: Work " Chandan Rajendra
2015-07-01 14:45 ` Liu Bo
2015-07-03 10:05 ` Chandan Rajendra
2015-06-01 15:22 ` [RFC PATCH V11 10/21] Btrfs: subpagesize-blocksize: fallocate: Work with sectorsized units Chandan Rajendra
2015-06-01 15:22 ` [RFC PATCH V11 11/21] Btrfs: subpagesize-blocksize: btrfs_page_mkwrite: Reserve space in " Chandan Rajendra
2015-07-06 3:18 ` Liu Bo
2015-06-01 15:22 ` [RFC PATCH V11 12/21] Btrfs: subpagesize-blocksize: Search for all ordered extents that could span across a page Chandan Rajendra
2015-07-01 14:47 ` Liu Bo
2015-07-03 10:08 ` Chandan Rajendra
2015-07-06 3:17 ` Liu Bo
2015-07-06 10:49 ` Chandan Rajendra
2015-06-01 15:22 ` [RFC PATCH V11 13/21] Btrfs: subpagesize-blocksize: Deal with partial ordered extent allocations Chandan Rajendra
2015-07-06 10:06 ` Liu Bo
2015-07-07 13:38 ` Chandan Rajendra
2015-06-01 15:22 ` [RFC PATCH V11 14/21] Btrfs: subpagesize-blocksize: Explicitly Track I/O status of blocks of an ordered extent Chandan Rajendra
2015-07-20 8:34 ` Liu Bo
2015-07-20 12:54 ` Chandan Rajendra
2015-06-01 15:22 ` [RFC PATCH V11 15/21] Btrfs: subpagesize-blocksize: Revert commit fc4adbff823f76577ece26dcb88bf6f8392dbd43 Chandan Rajendra
2015-06-01 15:22 ` [RFC PATCH V11 16/21] Btrfs: subpagesize-blocksize: Prevent writes to an extent buffer when PG_writeback flag is set Chandan Rajendra
2015-06-01 15:22 ` [RFC PATCH V11 17/21] Btrfs: subpagesize-blocksize: Use (eb->start, seq) as search key for tree modification log Chandan Rajendra
2015-07-20 14:46 ` Liu Bo
2015-06-01 15:22 ` [RFC PATCH V11 18/21] Btrfs: subpagesize-blocksize: btrfs_submit_direct_hook: Handle map_length < bio vector length Chandan Rajendra
2015-06-01 15:22 ` [RFC PATCH V11 19/21] Revert "btrfs: fix lockups from btrfs_clear_path_blocking" Chandan Rajendra
2015-06-01 15:22 ` [RFC PATCH V11 20/21] Btrfs: subpagesize-blockssize: Limit inline extents to root->sectorsize Chandan Rajendra
2015-06-01 15:22 ` [RFC PATCH V11 21/21] Btrfs: subpagesize-blocksize: Fix block size returned to user space Chandan Rajendra
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20150701143659.GB7847@localhost.localdomain \
--to=bo.li.liu@oracle.com \
--cc=chandan@linux.vnet.ibm.com \
--cc=chandan@mykolab.com \
--cc=clm@fb.com \
--cc=dsterba@suse.cz \
--cc=jbacik@fb.com \
--cc=linux-btrfs@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).