From: Mike Snitzer <snitzer@kernel.org>
To: cluster-devel.redhat.com
Subject: [Cluster-devel] [PATCH v5 16/20] dm-crypt: check if adding pages to clone bio fails
Date: Tue, 30 May 2023 11:49:53 -0400 [thread overview]
Message-ID: <ZHYbIYxGbcXbpvIK@redhat.com> (raw)
In-Reply-To: <alpine.LRH.2.21.2305301045220.3943@file01.intranet.prod.int.rdu2.redhat.com>
On Tue, May 30 2023 at 11:13P -0400,
Mikulas Patocka <mpatocka@redhat.com> wrote:
>
>
> On Tue, 2 May 2023, Johannes Thumshirn wrote:
>
> > Check if adding pages to clone bio fails and if it does retry with
> > reclaim. This mirrors the behaviour of page allocation in
> > crypt_alloc_buffer().
> >
> > This way we can mark bio_add_pages as __must_check.
> >
> > Reviewed-by: Damien Le Moal <damien.lemoal@opensource.wdc.com>
> > Signed-off-by: Johannes Thumshirn <johannes.thumshirn@wdc.com>
> > ---
> > drivers/md/dm-crypt.c | 9 ++++++++-
> > 1 file changed, 8 insertions(+), 1 deletion(-)
> >
> > diff --git a/drivers/md/dm-crypt.c b/drivers/md/dm-crypt.c
> > index 8b47b913ee83..b234dc089cee 100644
> > --- a/drivers/md/dm-crypt.c
> > +++ b/drivers/md/dm-crypt.c
> > @@ -1693,7 +1693,14 @@ static struct bio *crypt_alloc_buffer(struct dm_crypt_io *io, unsigned int size)
> >
> > len = (remaining_size > PAGE_SIZE) ? PAGE_SIZE : remaining_size;
> >
> > - bio_add_page(clone, page, len, 0);
> > + if (!bio_add_page(clone, page, len, 0)) {
> > + mempool_free(page, &cc->page_pool);
> > + crypt_free_buffer_pages(cc, clone);
> > + bio_put(clone);
> > + gfp_mask |= __GFP_DIRECT_RECLAIM;
> > + goto retry;
> > +
> > + }
> >
> > remaining_size -= len;
> > }
>
> Hi
>
> I nack this. This just adds code that can't ever be executed.
>
> dm-crypt already allocates enough entries in the vector (see "unsigned int
> nr_iovecs = (size + PAGE_SIZE - 1) >> PAGE_SHIFT;"), so bio_add_page can't
> fail.
>
> If you want to add __must_check to bio_add_page, you should change the
> dm-crypt code to:
> if (!bio_add_page(clone, page, len, 0)) {
> WARN(1, "this can't happen");
> return NULL;
> }
> and not write recovery code for a can't-happen case.
Thanks for the review Mikulas. But the proper way forward, in the
context of this patchset, is to simply change bio_add_page() to
__bio_add_page()
Subject becomes: "dm crypt: use __bio_add_page to add single page to clone bio"
And header can explain that "crypt_alloc_buffer() already allocates
enough entries in the clone bio's vector, so bio_add_page can't fail".
Mike
WARNING: multiple messages have this Message-ID (diff)
From: Mike Snitzer <snitzer@kernel.org>
To: Mikulas Patocka <mpatocka@redhat.com>
Cc: "axboe @ kernel . dk" <axboe@kernel.dk>,
shaggy@kernel.org, damien.lemoal@wdc.com, kch@nvidia.com,
agruenba@redhat.com, song@kernel.org,
Johannes Thumshirn <johannes.thumshirn@wdc.com>,
Damien Le Moal <damien.lemoal@opensource.wdc.com>,
linux-raid@vger.kernel.org, jfs-discussion@lists.sourceforge.net,
willy@infradead.org, ming.lei@redhat.com,
cluster-devel@redhat.com, linux-mm@kvack.org,
dm-devel@redhat.com, linux-block@vger.kernel.org,
rpeterso@redhat.com, linux-fsdevel@vger.kernel.org, hch@lst.de
Subject: Re: [dm-devel] [PATCH v5 16/20] dm-crypt: check if adding pages to clone bio fails
Date: Tue, 30 May 2023 11:49:53 -0400 [thread overview]
Message-ID: <ZHYbIYxGbcXbpvIK@redhat.com> (raw)
In-Reply-To: <alpine.LRH.2.21.2305301045220.3943@file01.intranet.prod.int.rdu2.redhat.com>
On Tue, May 30 2023 at 11:13P -0400,
Mikulas Patocka <mpatocka@redhat.com> wrote:
>
>
> On Tue, 2 May 2023, Johannes Thumshirn wrote:
>
> > Check if adding pages to clone bio fails and if it does retry with
> > reclaim. This mirrors the behaviour of page allocation in
> > crypt_alloc_buffer().
> >
> > This way we can mark bio_add_pages as __must_check.
> >
> > Reviewed-by: Damien Le Moal <damien.lemoal@opensource.wdc.com>
> > Signed-off-by: Johannes Thumshirn <johannes.thumshirn@wdc.com>
> > ---
> > drivers/md/dm-crypt.c | 9 ++++++++-
> > 1 file changed, 8 insertions(+), 1 deletion(-)
> >
> > diff --git a/drivers/md/dm-crypt.c b/drivers/md/dm-crypt.c
> > index 8b47b913ee83..b234dc089cee 100644
> > --- a/drivers/md/dm-crypt.c
> > +++ b/drivers/md/dm-crypt.c
> > @@ -1693,7 +1693,14 @@ static struct bio *crypt_alloc_buffer(struct dm_crypt_io *io, unsigned int size)
> >
> > len = (remaining_size > PAGE_SIZE) ? PAGE_SIZE : remaining_size;
> >
> > - bio_add_page(clone, page, len, 0);
> > + if (!bio_add_page(clone, page, len, 0)) {
> > + mempool_free(page, &cc->page_pool);
> > + crypt_free_buffer_pages(cc, clone);
> > + bio_put(clone);
> > + gfp_mask |= __GFP_DIRECT_RECLAIM;
> > + goto retry;
> > +
> > + }
> >
> > remaining_size -= len;
> > }
>
> Hi
>
> I nack this. This just adds code that can't ever be executed.
>
> dm-crypt already allocates enough entries in the vector (see "unsigned int
> nr_iovecs = (size + PAGE_SIZE - 1) >> PAGE_SHIFT;"), so bio_add_page can't
> fail.
>
> If you want to add __must_check to bio_add_page, you should change the
> dm-crypt code to:
> if (!bio_add_page(clone, page, len, 0)) {
> WARN(1, "this can't happen");
> return NULL;
> }
> and not write recovery code for a can't-happen case.
Thanks for the review Mikulas. But the proper way forward, in the
context of this patchset, is to simply change bio_add_page() to
__bio_add_page()
Subject becomes: "dm crypt: use __bio_add_page to add single page to clone bio"
And header can explain that "crypt_alloc_buffer() already allocates
enough entries in the clone bio's vector, so bio_add_page can't fail".
Mike
--
dm-devel mailing list
dm-devel@redhat.com
https://listman.redhat.com/mailman/listinfo/dm-devel
WARNING: multiple messages have this Message-ID (diff)
From: Mike Snitzer <snitzer@kernel.org>
To: Mikulas Patocka <mpatocka@redhat.com>
Cc: Johannes Thumshirn <johannes.thumshirn@wdc.com>,
"axboe @ kernel . dk" <axboe@kernel.dk>,
shaggy@kernel.org, damien.lemoal@wdc.com,
cluster-devel@redhat.com, kch@nvidia.com, agruenba@redhat.com,
linux-mm@kvack.org,
Damien Le Moal <damien.lemoal@opensource.wdc.com>,
jfs-discussion@lists.sourceforge.net, willy@infradead.org,
ming.lei@redhat.com, linux-block@vger.kernel.org,
song@kernel.org, dm-devel@redhat.com, rpeterso@redhat.com,
linux-fsdevel@vger.kernel.org, linux-raid@vger.kernel.org,
hch@lst.de
Subject: Re: [PATCH v5 16/20] dm-crypt: check if adding pages to clone bio fails
Date: Tue, 30 May 2023 11:49:53 -0400 [thread overview]
Message-ID: <ZHYbIYxGbcXbpvIK@redhat.com> (raw)
In-Reply-To: <alpine.LRH.2.21.2305301045220.3943@file01.intranet.prod.int.rdu2.redhat.com>
On Tue, May 30 2023 at 11:13P -0400,
Mikulas Patocka <mpatocka@redhat.com> wrote:
>
>
> On Tue, 2 May 2023, Johannes Thumshirn wrote:
>
> > Check if adding pages to clone bio fails and if it does retry with
> > reclaim. This mirrors the behaviour of page allocation in
> > crypt_alloc_buffer().
> >
> > This way we can mark bio_add_pages as __must_check.
> >
> > Reviewed-by: Damien Le Moal <damien.lemoal@opensource.wdc.com>
> > Signed-off-by: Johannes Thumshirn <johannes.thumshirn@wdc.com>
> > ---
> > drivers/md/dm-crypt.c | 9 ++++++++-
> > 1 file changed, 8 insertions(+), 1 deletion(-)
> >
> > diff --git a/drivers/md/dm-crypt.c b/drivers/md/dm-crypt.c
> > index 8b47b913ee83..b234dc089cee 100644
> > --- a/drivers/md/dm-crypt.c
> > +++ b/drivers/md/dm-crypt.c
> > @@ -1693,7 +1693,14 @@ static struct bio *crypt_alloc_buffer(struct dm_crypt_io *io, unsigned int size)
> >
> > len = (remaining_size > PAGE_SIZE) ? PAGE_SIZE : remaining_size;
> >
> > - bio_add_page(clone, page, len, 0);
> > + if (!bio_add_page(clone, page, len, 0)) {
> > + mempool_free(page, &cc->page_pool);
> > + crypt_free_buffer_pages(cc, clone);
> > + bio_put(clone);
> > + gfp_mask |= __GFP_DIRECT_RECLAIM;
> > + goto retry;
> > +
> > + }
> >
> > remaining_size -= len;
> > }
>
> Hi
>
> I nack this. This just adds code that can't ever be executed.
>
> dm-crypt already allocates enough entries in the vector (see "unsigned int
> nr_iovecs = (size + PAGE_SIZE - 1) >> PAGE_SHIFT;"), so bio_add_page can't
> fail.
>
> If you want to add __must_check to bio_add_page, you should change the
> dm-crypt code to:
> if (!bio_add_page(clone, page, len, 0)) {
> WARN(1, "this can't happen");
> return NULL;
> }
> and not write recovery code for a can't-happen case.
Thanks for the review Mikulas. But the proper way forward, in the
context of this patchset, is to simply change bio_add_page() to
__bio_add_page()
Subject becomes: "dm crypt: use __bio_add_page to add single page to clone bio"
And header can explain that "crypt_alloc_buffer() already allocates
enough entries in the clone bio's vector, so bio_add_page can't fail".
Mike
next prev parent reply other threads:[~2023-05-30 15:49 UTC|newest]
Thread overview: 103+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-05-02 10:19 [Cluster-devel] [PATCH v5 00/20] bio: check return values of bio_add_page Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-02 10:19 ` [Cluster-devel] [PATCH v5 01/20] swap: use __bio_add_page to add page to bio Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-02 10:19 ` [Cluster-devel] [PATCH v5 02/20] drbd: " Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-02 10:19 ` [Cluster-devel] [PATCH v5 03/20] dm: dm-zoned: use __bio_add_page for adding single metadata page Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-02 10:19 ` [Cluster-devel] [PATCH v5 04/20] fs: buffer: use __bio_add_page to add single page to bio Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-30 5:41 ` gouhao
2023-05-30 6:02 ` [Cluster-devel] [PATCH " gouhao
2023-05-30 6:02 ` gouhao
2023-05-30 6:02 ` [dm-devel] [PATCH " gouhao
2023-05-02 10:19 ` [Cluster-devel] [PATCH v5 05/20] md: use __bio_add_page to add single page Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-02 10:19 ` [Cluster-devel] [PATCH v5 06/20] md: raid5-log: " Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-02 10:19 ` [Cluster-devel] [PATCH v5 07/20] md: raid5: use __bio_add_page to add single page to new bio Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-02 10:19 ` [Cluster-devel] [PATCH v5 08/20] jfs: logmgr: use __bio_add_page to add single page to bio Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-02 10:19 ` [Cluster-devel] [PATCH v5 09/20] gfs2: use __bio_add_page for adding " Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-02 11:51 ` [Cluster-devel] " Bob Peterson
2023-05-02 11:51 ` Bob Peterson
2023-05-02 11:51 ` [dm-devel] " Bob Peterson
2023-05-02 11:53 ` [Cluster-devel] " Johannes Thumshirn
2023-05-02 11:53 ` Johannes Thumshirn
2023-05-02 11:53 ` [dm-devel] " Johannes Thumshirn
2023-05-02 10:19 ` [Cluster-devel] [PATCH v5 10/20] zonefs: " Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-02 10:19 ` [Cluster-devel] [PATCH v5 11/20] zram: " Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-02 10:19 ` [Cluster-devel] [PATCH v5 12/20] floppy: " Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-02 10:19 ` [Cluster-devel] [PATCH v5 13/20] md: check for failure when adding pages in alloc_behind_master_bio Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-02 10:19 ` [Cluster-devel] [PATCH v5 14/20] md: raid1: use __bio_add_page for adding single page to bio Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-02 10:19 ` [Cluster-devel] [PATCH v5 15/20] md: raid1: check if adding pages to resync bio fails Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-02 10:19 ` [Cluster-devel] [PATCH v5 16/20] dm-crypt: check if adding pages to clone " Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-30 15:13 ` [Cluster-devel] " Mikulas Patocka
2023-05-30 15:13 ` Mikulas Patocka
2023-05-30 15:13 ` Mikulas Patocka
2023-05-30 15:49 ` Mike Snitzer [this message]
2023-05-30 15:49 ` Mike Snitzer
2023-05-30 15:49 ` [dm-devel] " Mike Snitzer
2023-05-30 19:43 ` [Cluster-devel] " Mikulas Patocka
2023-05-30 19:43 ` Mikulas Patocka
2023-05-30 19:43 ` [dm-devel] " Mikulas Patocka
2023-06-01 18:46 ` [Cluster-devel] " Mike Snitzer
2023-06-01 18:46 ` Mike Snitzer
2023-06-01 18:46 ` [dm-devel] " Mike Snitzer
2023-05-02 10:19 ` [Cluster-devel] [PATCH v5 17/20] block: mark bio_add_page as __must_check Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-02 10:19 ` [Cluster-devel] [PATCH v5 18/20] block: add __bio_add_folio Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-02 10:19 ` [Cluster-devel] [PATCH v5 19/20] fs: iomap: use __bio_add_folio where possible Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-02 10:19 ` [Cluster-devel] [PATCH v5 20/20] block: mark bio_add_folio as __must_check Johannes Thumshirn
2023-05-02 10:19 ` Johannes Thumshirn
2023-05-02 10:19 ` [dm-devel] " Johannes Thumshirn
2023-05-05 8:09 ` [Cluster-devel] [PATCH v5 00/20] bio: check return values of bio_add_page Johannes Thumshirn
2023-05-05 8:09 ` Johannes Thumshirn
2023-05-05 8:09 ` [dm-devel] " Johannes Thumshirn
2023-05-05 14:11 ` [Cluster-devel] " Jens Axboe
2023-05-05 14:11 ` Jens Axboe
2023-05-05 14:11 ` [dm-devel] " Jens Axboe
2023-05-24 10:04 ` [Cluster-devel] " Johannes Thumshirn
2023-05-24 10:04 ` Johannes Thumshirn
2023-05-24 10:04 ` [dm-devel] " Johannes Thumshirn
2023-05-24 15:02 ` [Cluster-devel] " Jens Axboe
2023-05-24 15:02 ` Jens Axboe
2023-05-24 15:02 ` [dm-devel] " Jens Axboe
2023-05-26 6:37 ` [Cluster-devel] " Johannes Thumshirn
2023-05-26 6:37 ` Johannes Thumshirn
2023-05-26 6:37 ` [dm-devel] " Johannes Thumshirn
2023-05-30 15:14 ` [Cluster-devel] " Jens Axboe
2023-05-30 15:14 ` Jens Axboe
2023-05-30 15:14 ` [dm-devel] " Jens Axboe
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=ZHYbIYxGbcXbpvIK@redhat.com \
--to=snitzer@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.