From: Mikulas Patocka <mpatocka@redhat.com>
To: Jens Axboe <axboe@kernel.dk>
Cc: Alasdair Kergon <agk@redhat.com>,
Mike Snitzer <snitzer@kernel.org>,
linux-block@vger.kernel.org, dm-devel@lists.linux.dev
Subject: [PATC] block: update queue limits atomically
Date: Tue, 18 Mar 2025 15:26:10 +0100 (CET) [thread overview]
Message-ID: <ee66a4f2-ecc4-68d2-4594-a0bcba7ffe9c@redhat.com> (raw)
The block limits may be read while they are being modified. The statement
"q->limits = *lim" is not really atomic. The compiler may turn it into
memcpy (clang does).
On x86-64, the kernel uses the "rep movsb" instruction for memcpy - it is
optimized on modern CPUs, but it is not atomic, it may be interrupted at
any byte boundary - and if it is interrupted, the readers may read
garbage.
On sparc64, there's an instruction that zeroes a cache line without
reading it from memory. The kernel memcpy implementation uses it (see
b3a04ed507bf) to avoid loading the destination buffer from memory. The
problem is that if we copy a block of data to q->limits and someone reads
it at the same time, the reader may read zeros.
This commit changes it to use WRITE_ONCE, so that individual words are
updated atomically.
Signed-off-by: Mikulas Patocka <mpatocka@redhat.com>
Cc: stable@vger.kernel.org
---
block/blk-settings.c | 10 +++++++++-
1 file changed, 9 insertions(+), 1 deletion(-)
Index: linux-2.6/block/blk-settings.c
===================================================================
--- linux-2.6.orig/block/blk-settings.c
+++ linux-2.6/block/blk-settings.c
@@ -433,6 +433,7 @@ int queue_limits_commit_update(struct re
struct queue_limits *lim)
{
int error;
+ size_t i;
error = blk_validate_limits(lim);
if (error)
@@ -446,7 +447,14 @@ int queue_limits_commit_update(struct re
}
#endif
- q->limits = *lim;
+ /*
+ * Note that direct assignment like "q->limits = *lim" is not atomic
+ * (the compiler can generate things like "rep movsb" for it),
+ * so we use WRITE_ONCE.
+ */
+ for (i = 0; i < sizeof(struct queue_limits) / sizeof(long); i++)
+ WRITE_ONCE(*((long *)&q->limits + i), *((long *)lim + i));
+
if (q->disk)
blk_apply_bdi_limits(q->disk->bdi, lim);
out_unlock:
next reply other threads:[~2025-03-18 14:26 UTC|newest]
Thread overview: 12+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-03-18 14:26 Mikulas Patocka [this message]
2025-03-18 14:56 ` [PATC] block: update queue limits atomically Ming Lei
2025-03-18 15:31 ` Mikulas Patocka
2025-03-19 1:22 ` Ming Lei
2025-03-19 1:58 ` Jens Axboe
2025-03-19 21:18 ` Mikulas Patocka
2025-03-20 2:22 ` Ming Lei
2025-03-20 12:58 ` Jens Axboe
2025-03-20 5:26 ` Christoph Hellwig
2025-03-18 15:58 ` Bart Van Assche
2025-03-18 16:13 ` Mikulas Patocka
2025-03-20 5:25 ` Christoph Hellwig
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=ee66a4f2-ecc4-68d2-4594-a0bcba7ffe9c@redhat.com \
--to=mpatocka@redhat.com \
--cc=agk@redhat.com \
--cc=axboe@kernel.dk \
--cc=dm-devel@lists.linux.dev \
--cc=linux-block@vger.kernel.org \
--cc=snitzer@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox