From: "Yu Kuai" <yukuai@fnnas.com>
To: "Michal Koutný" <mkoutny@suse.com>
Cc: <tj@kernel.org>, <josef@toxicpanda.com>, <axboe@kernel.dk>,
<cgroups@vger.kernel.org>, <linux-block@vger.kernel.org>,
<linux-kernel@vger.kernel.org>, <zhengqixing@huawei.com>,
<hch@infradead.org>, <ming.lei@redhat.com>,
<nilay@linux.ibm.com>, <yukuai@fnnas.com>
Subject: Re: [PATCH v2 6/7] blk-cgroup: allocate pds before freezing queue in blkcg_activate_policy()
Date: Wed, 4 Feb 2026 14:44:26 +0800 [thread overview]
Message-ID: <fe9f7cc4-a9dc-4809-9d98-d5158c17c983@fnnas.com> (raw)
In-Reply-To: <gq45vl55n2gucipjc5jk5e5kp7ups3nw672ua6nvksooycezv5@lfr62hy5br4f>
Hi,
在 2026/2/3 17:06, Michal Koutný 写道:
> On Tue, Feb 03, 2026 at 04:06:01PM +0800, Yu Kuai <yukuai@fnnas.com> wrote:
>> Some policies like iocost and iolatency perform percpu allocation in
>> pd_alloc_fn(). Percpu allocation with queue frozen can cause deadlock
>> because percpu memory reclaim may issue IO.
>>
>> Now that q->blkg_list is protected by blkcg_mutex,
> With this ^^^
>
> ...
>> restructure
>> blkcg_activate_policy() to allocate all pds before freezing the queue:
>> 1. Allocate all pds with GFP_KERNEL before freezing the queue
>> 2. Freeze the queue
>> 3. Initialize and online all pds
>>
>> Note: Future work is to remove all queue freezing before
>> blkcg_activate_policy() to fix the deadlocks thoroughly.
>>
>> Signed-off-by: Yu Kuai <yukuai@fnnas.com>
>> ---
>> block/blk-cgroup.c | 90 +++++++++++++++++-----------------------------
>> 1 file changed, 32 insertions(+), 58 deletions(-)
>>
>> diff --git a/block/blk-cgroup.c b/block/blk-cgroup.c
>> index 0206050f81ea..7fcb216917d0 100644
>> --- a/block/blk-cgroup.c
>> +++ b/block/blk-cgroup.c
>> @@ -1606,8 +1606,7 @@ static void blkcg_policy_teardown_pds(struct request_queue *q,
>> int blkcg_activate_policy(struct gendisk *disk, const struct blkcg_policy *pol)
>> {
>> struct request_queue *q = disk->queue;
>> - struct blkg_policy_data *pd_prealloc = NULL;
>> - struct blkcg_gq *blkg, *pinned_blkg = NULL;
>> + struct blkcg_gq *blkg;
>> unsigned int memflags;
>> int ret;
>>
>> @@ -1622,90 +1621,65 @@ int blkcg_activate_policy(struct gendisk *disk, const struct blkcg_policy *pol)
> ...
>
>> + /* Now freeze queue and initialize/online all pds */
>> + if (queue_is_mq(q))
>> + memflags = blk_mq_freeze_queue(q);
>> +
>> + spin_lock_irq(&q->queue_lock);
>> + list_for_each_entry_reverse(blkg, &q->blkg_list, q_node) {
>> + struct blkg_policy_data *pd = blkg->pd[pol->plid];
>> +
>> + /* Skip dying blkg */
>> + if (hlist_unhashed(&blkg->blkcg_node))
>> + continue;
>> +
>> + spin_lock(&blkg->blkcg->lock);
>> if (pol->pd_init_fn)
>> pol->pd_init_fn(pd);
>> -
>> if (pol->pd_online_fn)
>> pol->pd_online_fn(pd);
>> pd->online = true;
>> -
>> spin_unlock(&blkg->blkcg->lock);
>> }
>>
>> __set_bit(pol->plid, q->blkcg_pols);
>> - ret = 0;
>> -
>> spin_unlock_irq(&q->queue_lock);
>> -out:
>> - mutex_unlock(&q->blkcg_mutex);
>> +
>> if (queue_is_mq(q))
>> blk_mq_unfreeze_queue(q, memflags);
>> - if (pinned_blkg)
>> - blkg_put(pinned_blkg);
>> - if (pd_prealloc)
>> - pol->pd_free_fn(pd_prealloc);
>> - return ret;
>> + mutex_unlock(&q->blkcg_mutex);
>> + return 0;
> Why is q->queue_lock still needed here?
I do want to remove queue_lock for accessing blkgs. However, this set just protect q->blkg_list
with blkg_mutex, and I'll remove the queue_lock after everything is converted to blkg_mutex.
>
> Thanks,
> Michal
--
Thansk,
Kuai
next prev parent reply other threads:[~2026-02-04 6:44 UTC|newest]
Thread overview: 13+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-02-03 8:05 [PATCH v2 0/7] blk-cgroup: fix races and deadlocks Yu Kuai
2026-02-03 8:05 ` [PATCH v2 1/7] blk-cgroup: protect q->blkg_list iteration in blkg_destroy_all() with blkcg_mutex Yu Kuai
2026-02-03 8:05 ` [PATCH v2 2/7] bfq: protect q->blkg_list iteration in bfq_end_wr_async() " Yu Kuai
2026-02-03 12:54 ` kernel test robot
2026-02-03 13:07 ` Yu Kuai
2026-02-03 13:36 ` kernel test robot
2026-02-03 8:05 ` [PATCH v2 3/7] blk-cgroup: fix race between policy activation and blkg destruction Yu Kuai
2026-02-03 8:05 ` [PATCH v2 4/7] blk-cgroup: skip dying blkg in blkcg_activate_policy() Yu Kuai
2026-02-03 8:06 ` [PATCH v2 5/7] blk-cgroup: factor policy pd teardown loop into helper Yu Kuai
2026-02-03 8:06 ` [PATCH v2 6/7] blk-cgroup: allocate pds before freezing queue in blkcg_activate_policy() Yu Kuai
2026-02-03 9:06 ` Michal Koutný
2026-02-04 6:44 ` Yu Kuai [this message]
2026-02-03 8:06 ` [PATCH v2 7/7] blk-rq-qos: move rq_qos_mutex acquisition inside rq_qos_add/del Yu Kuai
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=fe9f7cc4-a9dc-4809-9d98-d5158c17c983@fnnas.com \
--to=yukuai@fnnas.com \
--cc=axboe@kernel.dk \
--cc=cgroups@vger.kernel.org \
--cc=hch@infradead.org \
--cc=josef@toxicpanda.com \
--cc=linux-block@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=ming.lei@redhat.com \
--cc=mkoutny@suse.com \
--cc=nilay@linux.ibm.com \
--cc=tj@kernel.org \
--cc=zhengqixing@huawei.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox