All of lore.kernel.org
 help / color / mirror / Atom feed
From: Mike Snitzer <snitzer@redhat.com>
To: Ming Lin <mlin@kernel.org>
Cc: lkml <linux-kernel@vger.kernel.org>,
	Christoph Hellwig <hch@lst.de>, Jens Axboe <axboe@kernel.dk>,
	Kent Overstreet <kent.overstreet@gmail.com>,
	Dongsu Park <dpark@posteo.net>,
	Christoph Hellwig <hch@infradead.org>,
	Al Viro <viro@zeniv.linux.org.uk>,
	Ming Lei <ming.lei@canonical.com>, Neil Brown <neilb@suse.de>,
	Alasdair Kergon <agk@redhat.com>,
	dm-devel@redhat.com, Lars Ellenberg <drbd-dev@lists.linbit.com>,
	drbd-user@lists.linbit.com, Jiri Kosina <jkosina@suse.cz>,
	Geoff Levand <geoff@infradead.org>, Jim Paris <jim@jtan.com>,
	Joshua Morris <josh.h.morris@us.ibm.com>,
	Philip Kelleher <pjk1939@linux.vnet.ibm.com>,
	Minchan Kim <minchan@kernel.org>, Nitin Gupta <ngupta@vflare.org>,
	Oleg Drokin <oleg.drokin@intel.com>,
	Andreas Dilger <andreas.dilger@intel.com>,
	Ming Lin <ming.l@ssi.samsung.com>
Subject: Re: [PATCH v5 01/11] block: make generic_make_request handle arbitrarily sized bios
Date: Sat, 1 Aug 2015 12:33:57 -0400	[thread overview]
Message-ID: <20150801163356.GA21478@redhat.com> (raw)
In-Reply-To: <1438412290.26596.14.camel@hasee>

On Sat, Aug 01 2015 at  2:58am -0400,
Ming Lin <mlin@kernel.org> wrote:

> On Fri, 2015-07-31 at 17:38 -0400, Mike Snitzer wrote:
> > 
> > OK, once setup, to run the 2 tests in question directly you'd do
> > something like:
> > 
> > dmtest run --suite thin-provisioning -n discard_a_fragmented_device
> > 
> > dmtest run --suite thin-provisioning -n discard_fully_provisioned_device_benchmark
> > 
> > Again, these tests pass without this patchset.
> 
> It's caused by patch 4.
> When discard size >=4G, the bio->bi_iter.bi_size overflows.

Thanks for tracking this down!

> Below is the new patch.
> 
> Christoph,
> Could you also help to review it?
> 
> Now we still do "misaligned" check in blkdev_issue_discard().
> So the same code in blk_bio_discard_split() was removed.

But I don't agree with this approach.  One of the most meaningful
benefits of late bio splitting is the upper layers shouldn't _need_ to
depend on the intermediate devices' queue_limits being stacked properly.
Your solution to mix discard granularity/alignment checks at the upper
layer(s) but then split based on max_discard_sectors at the lower layer
defeats that benefit for discards.

This will translate to all intermediate layers that might split
discards needing to worry about granularity/alignment
too (e.g. how dm-thinp will have to care because it must generate
discard mappings with associated bios based on how blocks were mapped to
thinp).

Also, it is unfortunate that IO that doesn't have a payload is being
artificially split simply because bio->bi_iter.bi_size is 32bits.

Mike

WARNING: multiple messages have this Message-ID (diff)
From: Mike Snitzer <snitzer@redhat.com>
To: Ming Lin <mlin@kernel.org>
Cc: Neil Brown <neilb@suse.de>, Ming Lei <ming.lei@canonical.com>,
	dm-devel@redhat.com, Christoph Hellwig <hch@lst.de>,
	Alasdair Kergon <agk@redhat.com>,
	Lars Ellenberg <drbd-dev@lists.linbit.com>,
	Philip Kelleher <pjk1939@linux.vnet.ibm.com>,
	Joshua Morris <josh.h.morris@us.ibm.com>,
	Christoph Hellwig <hch@infradead.org>,
	Kent Overstreet <kent.overstreet@gmail.com>,
	Nitin Gupta <ngupta@vflare.org>,
	Ming Lin <ming.l@ssi.samsung.com>,
	Oleg Drokin <oleg.drokin@intel.com>,
	Al Viro <viro@zeniv.linux.org.uk>, Jens Axboe <axboe@kernel.dk>,
	Andreas Dilger <andreas.dilger@intel.com>,
	Geoff Levand <geoff@infradead.org>, Jiri Kosina <jkosina@suse.cz>,
	lkml <linux-kernel@vger.kernel.org>, Jim Paris <jim@jtan.com>,
	Minchan Kim <minchan@kernel.org>, Dongsu Park <dpark@posteo.net>,
	drbd-user@lists.linbit.com
Subject: Re: [Drbd-dev] [PATCH v5 01/11] block: make generic_make_request handle arbitrarily sized bios
Date: Sat, 1 Aug 2015 12:33:57 -0400	[thread overview]
Message-ID: <20150801163356.GA21478@redhat.com> (raw)
In-Reply-To: <1438412290.26596.14.camel@hasee>

On Sat, Aug 01 2015 at  2:58am -0400,
Ming Lin <mlin@kernel.org> wrote:

> On Fri, 2015-07-31 at 17:38 -0400, Mike Snitzer wrote:
> > 
> > OK, once setup, to run the 2 tests in question directly you'd do
> > something like:
> > 
> > dmtest run --suite thin-provisioning -n discard_a_fragmented_device
> > 
> > dmtest run --suite thin-provisioning -n discard_fully_provisioned_device_benchmark
> > 
> > Again, these tests pass without this patchset.
> 
> It's caused by patch 4.
> When discard size >=4G, the bio->bi_iter.bi_size overflows.

Thanks for tracking this down!

> Below is the new patch.
> 
> Christoph,
> Could you also help to review it?
> 
> Now we still do "misaligned" check in blkdev_issue_discard().
> So the same code in blk_bio_discard_split() was removed.

But I don't agree with this approach.  One of the most meaningful
benefits of late bio splitting is the upper layers shouldn't _need_ to
depend on the intermediate devices' queue_limits being stacked properly.
Your solution to mix discard granularity/alignment checks at the upper
layer(s) but then split based on max_discard_sectors at the lower layer
defeats that benefit for discards.

This will translate to all intermediate layers that might split
discards needing to worry about granularity/alignment
too (e.g. how dm-thinp will have to care because it must generate
discard mappings with associated bios based on how blocks were mapped to
thinp).

Also, it is unfortunate that IO that doesn't have a payload is being
artificially split simply because bio->bi_iter.bi_size is 32bits.

Mike

  reply	other threads:[~2015-08-01 16:33 UTC|newest]

Thread overview: 149+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2015-07-06  7:44 [PATCH v5 01/11] block: make generic_make_request handle arbitrarily sized bios Ming Lin
2015-07-06  7:44 ` [Drbd-dev] " Ming Lin
2015-07-06  7:44 ` [PATCH v5 02/11] block: simplify bio_add_page() Ming Lin
2015-07-06  7:44 ` [PATCH v5 03/11] bcache: remove driver private bio splitting code Ming Lin
2015-07-06  7:44 ` [PATCH v5 04/11] btrfs: remove bio splitting and merge_bvec_fn() calls Ming Lin
2015-07-06  7:44 ` [PATCH v5 05/11] block: remove split code in blkdev_issue_discard Ming Lin
2015-07-06  7:44 ` [PATCH v5 06/11] md/raid5: split bio for chunk_aligned_read Ming Lin
2015-07-06  7:44 ` [PATCH v5 07/11] md/raid5: get rid of bio_fits_rdev() Ming Lin
2015-07-06  7:44 ` [PATCH v5 08/11] block: kill merge_bvec_fn() completely Ming Lin
2015-07-06  7:44   ` [Drbd-dev] " Ming Lin
2015-07-06  7:44 ` [PATCH v5 09/11] fs: use helper bio_add_page() instead of open coding on bi_io_vec Ming Lin
2015-07-06  7:44 ` [PATCH v5 10/11] block: remove bio_get_nr_vecs() Ming Lin
2015-07-06 10:58   ` Steven Whitehouse
2015-07-06 17:21     ` Ming Lin
2015-07-07  9:04       ` Steven Whitehouse
2015-07-06  7:44 ` [PATCH v5 11/11] Documentation: update notes in biovecs about arbitrarily sized bios Ming Lin
2015-07-31 19:23 ` [PATCH v5 01/11] block: make generic_make_request handle " Mike Snitzer
2015-07-31 19:23   ` [Drbd-dev] " Mike Snitzer
     [not found]   ` <20150731192337.GA8907-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>
2015-07-31 21:19     ` Ming Lin
2015-07-31 21:19       ` Ming Lin
2015-07-31 21:19       ` [Drbd-dev] " Ming Lin
     [not found]       ` <CAF1ivSZbMDgyo_-wFGusSNSZ1fonSMWmNU9aVavGFaQsmEyYmQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2015-07-31 21:38         ` Mike Snitzer
2015-07-31 21:38           ` Mike Snitzer
2015-07-31 21:38           ` [Drbd-dev] " Mike Snitzer
2015-07-31 22:02           ` Ming Lin
2015-07-31 22:18             ` Ming Lin
     [not found]           ` <20150731213831.GA16464-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>
2015-08-01  6:58             ` Ming Lin
2015-08-01  6:58               ` Ming Lin
2015-08-01  6:58               ` [Drbd-dev] " Ming Lin
2015-08-01 16:33               ` Mike Snitzer [this message]
2015-08-01 16:33                 ` Mike Snitzer
     [not found]                 ` <20150801163356.GA21478-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>
2015-08-03  5:58                   ` Ming Lin
2015-08-03  5:58                     ` Ming Lin
2015-08-03  5:58                     ` [Drbd-dev] " Ming Lin
2015-08-04 11:36                     ` Christoph Hellwig
2015-08-04 11:36                       ` [Drbd-dev] " Christoph Hellwig
     [not found]                       ` <20150804113626.GA12682-jcswGhMUV9g@public.gmane.org>
2015-08-05  6:03                         ` Ming Lin
2015-08-05  6:03                           ` Ming Lin
2015-08-05  6:03                           ` [Drbd-dev] " Ming Lin
2015-08-07  7:30                           ` Christoph Hellwig
2015-08-07  7:30                             ` Christoph Hellwig
2015-08-07  7:30                             ` [Drbd-dev] " Christoph Hellwig
     [not found]                             ` <20150807073001.GA17485-jcswGhMUV9g@public.gmane.org>
2015-08-07 23:40                               ` Ming Lin
2015-08-07 23:40                                 ` Ming Lin
2015-08-07 23:40                                 ` [Drbd-dev] " Ming Lin
2015-08-08  0:30                                 ` Kent Overstreet
2015-09-11 13:20                                   ` [Drbd-dev] " Kent Overstreet
2015-08-08  5:17                                   ` Ming Lin
2015-08-08  5:17                                     ` Ming Lin
2015-08-08  5:17                                     ` [Drbd-dev] " Ming Lin
2015-08-08  5:22                                     ` Kent Overstreet
2015-09-11 13:20                                       ` [Drbd-dev] " Kent Overstreet
2015-08-08 12:35                                       ` Christoph Hellwig
2015-08-08 12:35                                         ` Christoph Hellwig
2015-08-08 12:35                                         ` [Drbd-dev] " Christoph Hellwig
2015-08-08  8:52                                 ` [dm-devel] " Hannes Reinecke
2015-09-11 13:21                                   ` [Drbd-dev] " Hannes Reinecke
2015-08-08  9:02                                   ` Kent Overstreet
2015-09-11 13:21                                     ` [Drbd-dev] " Kent Overstreet
2015-08-13  6:04                                     ` Hannes Reinecke
2015-09-11 13:22                                       ` [Drbd-dev] " Hannes Reinecke
2015-08-07  0:00                       ` Kent Overstreet
     [not found]                         ` <20150807000004.GB30757-jC9Py7bek1znysI04z7BkA@public.gmane.org>
2015-08-07  7:30                           ` Christoph Hellwig
2015-08-07  7:30                             ` Christoph Hellwig
2015-08-07  7:30                             ` [Drbd-dev] " Christoph Hellwig
2015-08-08 16:19                   ` [dm-devel] " Martin K. Petersen
2015-08-08 16:19                     ` Martin K. Petersen
2015-08-08 16:19                     ` [Drbd-dev] " Martin K. Petersen
     [not found]                     ` <yq18u9liwhj.fsf-+q57XtR/GgMb6DWv4sQWN6xOck334EZe@public.gmane.org>
2015-08-09  5:59                       ` Ming Lin
2015-08-09  5:59                         ` Ming Lin
2015-08-09  5:59                         ` [Drbd-dev] " Ming Lin
2015-08-09  6:41                         ` Christoph Hellwig
2015-08-09  6:41                           ` Christoph Hellwig
2015-08-09  6:41                           ` [Drbd-dev] " Christoph Hellwig
     [not found]                           ` <20150809064128.GB2436-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-08-09  6:55                             ` Ming Lin
2015-08-09  6:55                               ` Ming Lin
2015-08-09  6:55                               ` [Drbd-dev] " Ming Lin
2015-08-09  7:01                               ` Christoph Hellwig
2015-08-09  7:01                                 ` Christoph Hellwig
2015-08-09  7:01                                 ` [Drbd-dev] " Christoph Hellwig
     [not found]                                 ` <20150809070128.GA25739-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-08-09  7:18                                   ` Ming Lin
2015-08-09  7:18                                     ` Ming Lin
2015-08-09  7:18                                     ` [Drbd-dev] " Ming Lin
2015-08-10 15:02                                     ` Mike Snitzer
2015-08-10 15:02                                       ` Mike Snitzer
2015-08-10 15:02                                       ` [Drbd-dev] " Mike Snitzer
     [not found]                                       ` <20150810150216.GA22719-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>
2015-08-10 16:14                                         ` Ming Lin
2015-08-10 16:14                                           ` Ming Lin
2015-08-10 16:14                                           ` [Drbd-dev] " Ming Lin
2015-08-10 16:18                                           ` Ming Lin
2015-08-10 16:18                                             ` Ming Lin
2015-08-10 16:18                                             ` [Drbd-dev] " Ming Lin
2015-08-10 16:40                                           ` Martin K. Petersen
2015-08-10 16:40                                             ` Martin K. Petersen
2015-08-10 16:40                                             ` [Drbd-dev] " Martin K. Petersen
2015-08-10 18:13                                           ` Mike Snitzer
2015-08-10 18:13                                             ` [Drbd-dev] " Mike Snitzer
     [not found]                                             ` <20150810181325.GA24125-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>
2015-08-10 22:30                                               ` Ming Lin
2015-08-10 22:30                                                 ` Ming Lin
2015-08-10 22:30                                                 ` [Drbd-dev] " Ming Lin
2015-08-10 16:22                                         ` Martin K. Petersen
2015-08-10 16:22                                           ` Martin K. Petersen
2015-08-10 16:22                                           ` [Drbd-dev] " Martin K. Petersen
2015-08-10 18:18                                           ` Ming Lin
2015-08-10 18:18                                             ` [Drbd-dev] " Ming Lin
2015-08-11  2:00                                             ` Martin K. Petersen
2015-08-11  2:00                                               ` Martin K. Petersen
2015-08-11  2:00                                               ` [Drbd-dev] " Martin K. Petersen
     [not found]                                               ` <yq1bneeh9df.fsf-+q57XtR/GgMb6DWv4sQWN6xOck334EZe@public.gmane.org>
2015-08-11  2:41                                                 ` Mike Snitzer
2015-08-11  2:41                                                   ` Mike Snitzer
2015-08-11  2:41                                                   ` [Drbd-dev] " Mike Snitzer
2015-08-11  3:38                                                   ` Kent Overstreet
2015-09-11 13:22                                                     ` [Drbd-dev] " Kent Overstreet
2015-08-11 14:08                                                     ` Mike Snitzer
2015-08-11 14:08                                                       ` Mike Snitzer
2015-08-11 14:08                                                       ` [Drbd-dev] " Mike Snitzer
2015-08-11 17:49                                                     ` Martin K. Petersen
2015-08-11 17:49                                                       ` Martin K. Petersen
2015-08-11 17:49                                                       ` [Drbd-dev] " Martin K. Petersen
     [not found]                                                       ` <yq11tf9hg01.fsf-+q57XtR/GgMb6DWv4sQWN6xOck334EZe@public.gmane.org>
2015-08-11 18:05                                                         ` Martin K. Petersen
2015-08-11 18:05                                                           ` Martin K. Petersen
2015-08-11 18:05                                                           ` [Drbd-dev] " Martin K. Petersen
     [not found]                                                           ` <yq1si7pg0px.fsf-+q57XtR/GgMb6DWv4sQWN6xOck334EZe@public.gmane.org>
2015-08-11 20:56                                                             ` Ming Lin
2015-08-11 20:56                                                               ` Ming Lin
2015-08-11 20:56                                                               ` [Drbd-dev] " Ming Lin
2015-08-12  0:24                                                               ` Martin K. Petersen
2015-08-12  0:24                                                                 ` Martin K. Petersen
2015-08-12  0:24                                                                 ` [Drbd-dev] " Martin K. Petersen
     [not found]                                                                 ` <yq137zpfj5j.fsf-+q57XtR/GgMb6DWv4sQWN6xOck334EZe@public.gmane.org>
2015-08-12  4:41                                                                   ` Ming Lin
2015-08-12  4:41                                                                     ` Ming Lin
2015-08-12  4:41                                                                     ` [Drbd-dev] " Ming Lin
     [not found]                                                   ` <20150811024154.GA26351-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>
2015-08-11 17:36                                                     ` Martin K. Petersen
2015-08-11 17:36                                                       ` Martin K. Petersen
2015-08-11 17:36                                                       ` [Drbd-dev] " Martin K. Petersen
     [not found]                                                       ` <yq17fp1hgm0.fsf-+q57XtR/GgMb6DWv4sQWN6xOck334EZe@public.gmane.org>
2015-08-11 17:47                                                         ` Mike Snitzer
2015-08-11 17:47                                                           ` Mike Snitzer
2015-08-11 17:47                                                           ` [Drbd-dev] " Mike Snitzer
     [not found]                                                           ` <20150811174717.GA30439-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>
2015-08-11 18:01                                                             ` [dm-devel] " Martin K. Petersen
2015-08-11 18:01                                                               ` Martin K. Petersen
2015-08-11 18:01                                                               ` [Drbd-dev] " Martin K. Petersen
2015-08-18  5:09                                       ` Ming Lin
2015-08-18  7:04                                         ` Ming Lin
2015-08-18 14:45                                           ` Mike Snitzer
2015-08-18 17:32                                             ` Ming Lin
2015-08-18 19:59                                               ` Mike Snitzer
2015-08-18 21:16                                                 ` Ming Lin
2015-08-18 21:22                                                   ` Mike Snitzer
2015-08-18 22:17                                                     ` Ming Lin
  -- strict thread matches above, loose matches on Subject: below --
2015-07-06  7:11 [PATCH v5 00/11] simplify block layer based on immutable biovecs mlin
2015-07-06  7:11 ` [PATCH v5 01/11] block: make generic_make_request handle arbitrarily sized bios mlin

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20150801163356.GA21478@redhat.com \
    --to=snitzer@redhat.com \
    --cc=agk@redhat.com \
    --cc=andreas.dilger@intel.com \
    --cc=axboe@kernel.dk \
    --cc=dm-devel@redhat.com \
    --cc=dpark@posteo.net \
    --cc=drbd-dev@lists.linbit.com \
    --cc=drbd-user@lists.linbit.com \
    --cc=geoff@infradead.org \
    --cc=hch@infradead.org \
    --cc=hch@lst.de \
    --cc=jim@jtan.com \
    --cc=jkosina@suse.cz \
    --cc=josh.h.morris@us.ibm.com \
    --cc=kent.overstreet@gmail.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=minchan@kernel.org \
    --cc=ming.l@ssi.samsung.com \
    --cc=ming.lei@canonical.com \
    --cc=mlin@kernel.org \
    --cc=neilb@suse.de \
    --cc=ngupta@vflare.org \
    --cc=oleg.drokin@intel.com \
    --cc=pjk1939@linux.vnet.ibm.com \
    --cc=viro@zeniv.linux.org.uk \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.