From: Tejun Heo <tj@kernel.org>
To: David Sterba <dsterba@suse.cz>
Cc: jiangshanlai@gmail.com, linux-kernel@vger.kernel.org,
kernel-team@meta.com, Wang Yugui <wangyugui@e16-tech.com>,
Chris Mason <clm@fb.com>, Josef Bacik <josef@toxicpanda.com>,
David Sterba <dsterba@suse.com>,
linux-btrfs@vger.kernel.org
Subject: Re: [PATCH 08/13] btrfs: Use alloc_ordered_workqueue() to create ordered workqueues
Date: Tue, 9 May 2023 13:47:20 -1000 [thread overview]
Message-ID: <ZFrbiAyCiZ2aIZ4_@slm.duckdns.org> (raw)
In-Reply-To: <20230509233620.GN32559@twin.jikos.cz>
Hello, David.
On Wed, May 10, 2023 at 01:36:20AM +0200, David Sterba wrote:
...
> Yeah I think so but I'm not entierly sure. The ordering for all queues
> that don't start with max_active > 1 should not be required, here the
> parallelization and out of order processing is expected and serialized
> or decided once the work is done.
>
> > > In btrfs_resize_thread_pool the workqueue_set_max_active is called
> > > directly or indirectly so this can set the max_active to a user-defined
> > > mount option. Could this be a problem or trigger a warning? This would
> > > lead to max_active==1 + WQ_UNBOUND.
> >
> > That's not a problem. The only thing we need to make sure is that the
> > workqueues which actually *must* be ordered use alloc_ordered_workqueue() as
> > they won't be implicitly treated as ordered in the future.
> >
> > * The current patch converts two - fs_info->discard_ctl.discard_workers and
> > scrub_workers when @is_dev_replace is set. Do they actually need to be
> > ordered?
> >
> > * As you pointed out, fs_info->fixup_workers and
> > fs_info->qgroup_rescan_workers are also currently implicitly ordered. Do
> > they actually need to be ordered?
>
> I think all of them somehow implictly depend on the ordering. The
> replace process sequentially goes over a block group and copies blocks.
>
> The fixup process is quite obscure and we should preserve the semantics
> as much as possible. It has something to do with pages that get out of
> sync with extent state without btrfs knowing and that there are more such
> requests hapenning at the same time is low but once it happens it can
> lead to corruptions.
>
> Quota rescan is in its nature also a sequential process but I think it
> does not need to be ordered, it's started from higher level context like
> enabling quotas or rescan but there are also calls at remount time so
> this makes it less clear.
>
> In summary, if the ordered queue could be used then I'd recommend to do
> it as the safe option.
I see. It seems rather error-prone to make workqueues implicitly ordered
from btrfs_alloc_workqueue(). I'll see if I can make it explicit and keep
all workqueues which are currently guaranteed to be ordered ordered.
Thanks.
--
tejun
next prev parent reply other threads:[~2023-05-09 23:47 UTC|newest]
Thread overview: 43+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-05-09 1:50 [PATCHSET v2 wq/for-6.5-cleanup-ordered] workqueue: Ordered workqueue creation cleanup Tejun Heo
2023-05-09 1:50 ` [PATCH 01/13] scsi: ncr53c8xx: Use default @max_active for hostdata->work_q Tejun Heo
2023-05-21 2:48 ` [PATCH RESEND " Tejun Heo
2023-05-21 6:42 ` Finn Thain
2023-05-22 22:06 ` Martin K. Petersen
2023-05-23 0:58 ` Tejun Heo
2023-05-09 1:50 ` [PATCH 02/13] wifi: mwifiex: Use default @max_active for workqueues Tejun Heo
2023-05-10 8:45 ` Kalle Valo
2023-05-10 18:09 ` Brian Norris
2023-05-10 18:16 ` Tejun Heo
2023-05-10 18:57 ` Brian Norris
2023-05-10 19:19 ` Tejun Heo
2023-05-10 19:50 ` Brian Norris
2023-05-19 0:36 ` Tejun Heo
2023-05-09 1:50 ` [PATCH 03/13] dm integrity: Use alloc_ordered_workqueue() to create ordered workqueues Tejun Heo
2023-05-25 22:10 ` Tejun Heo
2023-05-09 1:50 ` [PATCH 04/13] media: amphion: " Tejun Heo
2023-05-23 12:19 ` Hans Verkuil
2023-05-23 21:25 ` Tejun Heo
2023-05-09 1:50 ` [PATCH 05/13] wifi: ath10/11/12k: " Tejun Heo
2023-05-10 8:41 ` Kalle Valo
2023-05-19 0:41 ` Tejun Heo
2023-05-09 1:50 ` [PATCH 06/13] net: wwan: t7xx: " Tejun Heo
2023-05-25 22:11 ` Tejun Heo
2023-05-09 1:50 ` [PATCH 07/13] soc: qcom: qmi: " Tejun Heo
2023-05-09 1:50 ` [PATCH 08/13] btrfs: " Tejun Heo
2023-05-09 14:53 ` David Sterba
2023-05-09 15:57 ` Tejun Heo
2023-05-09 23:36 ` David Sterba
2023-05-09 23:47 ` Tejun Heo [this message]
2023-05-25 23:33 ` Tejun Heo
2023-05-26 12:52 ` David Sterba
2023-05-09 1:50 ` [PATCH 09/13] net: qrtr: " Tejun Heo
2023-05-25 22:14 ` Tejun Heo
2023-05-09 1:50 ` [PATCH 10/13] rxrpc: " Tejun Heo
2023-05-25 22:14 ` Tejun Heo
2023-05-09 1:50 ` [PATCH 11/13] crypto: octeontx2: " Tejun Heo
2023-05-09 2:18 ` Herbert Xu
2023-05-19 0:42 ` Tejun Heo
2023-05-09 1:50 ` [PATCH 12/13] media: coda: " Tejun Heo
2023-05-09 10:46 ` Philipp Zabel
2023-05-19 0:50 ` Tejun Heo
2023-05-09 1:50 ` [PATCH 13/13] workqueue: Don't implicitly make UNBOUND workqueues w/ @max_active==1 ordered Tejun Heo
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=ZFrbiAyCiZ2aIZ4_@slm.duckdns.org \
--to=tj@kernel.org \
--cc=clm@fb.com \
--cc=dsterba@suse.com \
--cc=dsterba@suse.cz \
--cc=jiangshanlai@gmail.com \
--cc=josef@toxicpanda.com \
--cc=kernel-team@meta.com \
--cc=linux-btrfs@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=wangyugui@e16-tech.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox