From: "yu kuai" <yukuai@fygo.io>
To: "Yang Erkun" <yangerkun@huawei.com>, <josef@toxicpanda.com>,
<axboe@kernel.dk>, <hch@lst.de>, "yu kuai" <yukuai@fygo.io>
Cc: <yi.zhang@huawei.com>, <chengzhihao1@huawei.com>,
<echo.chenlin@huawei.com>, <leo.lilong@huaweicloud.com>,
<wangkefeng.wang@huawei.com>, <huawei.libin@huawei.com>,
<leijitang@huawei.com>, <linux-block@vger.kernel.org>,
<nbd@other.debian.org>
Subject: Re: [PATCH v7 8/8] nbd: add pre_defined_connections module parameter for pre-created devices
Date: Wed, 5 Aug 2026 16:45:50 +0800 [thread overview]
Message-ID: <6b39fb25-6030-4e4e-9200-c7df47f3ca89@fygo.io> (raw)
In-Reply-To: <20260805065843.3332859-9-yangerkun@huawei.com>
Hi,
在 2026/8/5 14:58, Yang Erkun 写道:
> blk_mq_update_nr_hw_queues() in nbd_start_device() may cause a queue
> freeze. The previous commit addressed this for newly created nbd
> devices by setting the expected nr_hw_queues in nbd_dev_add(). However,
> when reusing an old inactive nbd device, the queue freeze can still
> occur if the old nbd->tag_set->nr_hw_queues does not match the new
> socket connection count. Inactive nbd devices can originate from two
> sources: loading the nbd module with nbds_max, which sets the default
> nr_hw_queues to 1, and the netlink method, which sets nr_hw_queues
> according to the expected number of socket connections. For the first
> case, add a module parameter so the default nr_hw_queues can be
> changed. Users who know their expected number of connections can then
> prevent queue freezes on pre-created devices via nbds_max.
>
> Before this patchset:
> real 0m2.195s
> user 0m0.005s
> sys 0m0.022s
>
> After this patchset:
> real 0m0.090s
> user 0m0.004s
> sys 0m0.018s
>
> Signed-off-by: Yang Erkun <yangerkun@huawei.com>
> ---
> drivers/block/nbd.c | 11 ++++++++++-
> 1 file changed, 10 insertions(+), 1 deletion(-)
>
> diff --git a/drivers/block/nbd.c b/drivers/block/nbd.c
> index b316129b9a17..f8f51df31ada 100644
> --- a/drivers/block/nbd.c
> +++ b/drivers/block/nbd.c
> @@ -166,6 +166,7 @@ static struct dentry *nbd_dbg_dir;
>
> static unsigned int nbds_max = 16;
> static int max_part = 16;
> +static int pre_defined_connections = 1;
> static int part_shift;
>
> static int nbd_dev_dbg_init(struct nbd_device *nbd);
> @@ -2733,8 +2734,13 @@ static int __init nbd_init(void)
> }
> nbd_dbg_init();
>
> + if (pre_defined_connections < 1)
> + pre_defined_connections = 1;
nbd_init() will fail for invalid module parameter like max_part, nbds_max. So I
think it's better to fail for new parameter as well.
> + /* Set to the intended connection count so nbd_start_device() can skip
> + * the queue-freezing blk_mq_update_nr_hw_queues() call.
> + */
Please follow the common comment style in this file.
/*
* xxx
*/
> for (i = 0; i < nbds_max; i++)
> - nbd_dev_add(i, 1, 1);
> + nbd_dev_add(i, 1, pre_defined_connections);
> return 0;
> }
>
> @@ -2795,3 +2801,6 @@ module_param(nbds_max, int, 0444);
> MODULE_PARM_DESC(nbds_max, "number of network block devices to initialize (default: 16)");
> module_param(max_part, int, 0444);
> MODULE_PARM_DESC(max_part, "number of partitions per device (default: 16)");
> +module_param(pre_defined_connections, int, 0444);
> +MODULE_PARM_DESC(pre_defined_connections,
> +"number of connections for devices pre-created at module load (default: 1)");
--
Thanks,
Kuai
prev parent reply other threads:[~2026-08-05 8:47 UTC|newest]
Thread overview: 14+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-08-05 6:58 [PATCH v7 0/8] nbd: eliminate queue freeze/unfreeze overhead in connection setup Yang Erkun
2026-08-05 6:58 ` [PATCH v7 1/8] nbd: simplify find_fallback() by removing redundant logic Yang Erkun
2026-08-05 6:58 ` [PATCH v7 2/8] nbd: disallow NBD_SET_SOCK on an active device Yang Erkun
2026-08-05 6:58 ` [PATCH v7 3/8] nbd: clear queue limits on disconnect Yang Erkun
2026-08-05 8:35 ` yu kuai
2026-08-05 6:58 ` [PATCH v7 4/8] nbd: remove queue freeze in nbd_add_socket Yang Erkun
2026-08-05 8:36 ` yu kuai
2026-08-05 6:58 ` [PATCH v7 5/8] nbd: skip queue freeze when setting size at device startup Yang Erkun
2026-08-05 8:37 ` yu kuai
2026-08-05 6:58 ` [PATCH v7 6/8] nbd: factor out a nbd_genl_foreach_sock Yang Erkun
2026-08-05 8:40 ` yu kuai
2026-08-05 6:58 ` [PATCH v7 7/8] nbd: remove queue freeze for newly created nbd from netlink path Yang Erkun
2026-08-05 6:58 ` [PATCH v7 8/8] nbd: add pre_defined_connections module parameter for pre-created devices Yang Erkun
2026-08-05 8:45 ` yu kuai [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=6b39fb25-6030-4e4e-9200-c7df47f3ca89@fygo.io \
--to=yukuai@fygo.io \
--cc=axboe@kernel.dk \
--cc=chengzhihao1@huawei.com \
--cc=echo.chenlin@huawei.com \
--cc=hch@lst.de \
--cc=huawei.libin@huawei.com \
--cc=josef@toxicpanda.com \
--cc=leijitang@huawei.com \
--cc=leo.lilong@huaweicloud.com \
--cc=linux-block@vger.kernel.org \
--cc=nbd@other.debian.org \
--cc=wangkefeng.wang@huawei.com \
--cc=yangerkun@huawei.com \
--cc=yi.zhang@huawei.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox