Linux block layer
 help / color / mirror / Atom feed
From: "yu kuai" <yukuai@fygo.io>
To: "Yang Erkun" <yangerkun@huawei.com>, <josef@toxicpanda.com>,
	 <axboe@kernel.dk>, <hch@lst.de>, "yu kuai" <yukuai@fygo.io>
Cc: <yi.zhang@huawei.com>, <chengzhihao1@huawei.com>,
	 <echo.chenlin@huawei.com>, <leo.lilong@huaweicloud.com>,
	 <wangkefeng.wang@huawei.com>, <huawei.libin@huawei.com>,
	 <leijitang@huawei.com>, <linux-block@vger.kernel.org>,
	 <nbd@other.debian.org>
Subject: Re: [PATCH v7 8/8] nbd: add pre_defined_connections module parameter for pre-created devices
Date: Wed, 5 Aug 2026 16:45:50 +0800	[thread overview]
Message-ID: <6b39fb25-6030-4e4e-9200-c7df47f3ca89@fygo.io> (raw)
In-Reply-To: <20260805065843.3332859-9-yangerkun@huawei.com>

Hi,

在 2026/8/5 14:58, Yang Erkun 写道:
> blk_mq_update_nr_hw_queues() in nbd_start_device() may cause a queue
> freeze.  The previous commit addressed this for newly created nbd
> devices by setting the expected nr_hw_queues in nbd_dev_add().  However,
> when reusing an old inactive nbd device, the queue freeze can still
> occur if the old nbd->tag_set->nr_hw_queues does not match the new
> socket connection count.  Inactive nbd devices can originate from two
> sources: loading the nbd module with nbds_max, which sets the default
> nr_hw_queues to 1, and the netlink method, which sets nr_hw_queues
> according to the expected number of socket connections.  For the first
> case, add a module parameter so the default nr_hw_queues can be
> changed.  Users who know their expected number of connections can then
> prevent queue freezes on pre-created devices via nbds_max.
>
> Before this patchset:
> real    0m2.195s
> user    0m0.005s
> sys     0m0.022s
>
> After this patchset:
> real    0m0.090s
> user    0m0.004s
> sys     0m0.018s
>
> Signed-off-by: Yang Erkun <yangerkun@huawei.com>
> ---
>   drivers/block/nbd.c | 11 ++++++++++-
>   1 file changed, 10 insertions(+), 1 deletion(-)
>
> diff --git a/drivers/block/nbd.c b/drivers/block/nbd.c
> index b316129b9a17..f8f51df31ada 100644
> --- a/drivers/block/nbd.c
> +++ b/drivers/block/nbd.c
> @@ -166,6 +166,7 @@ static struct dentry *nbd_dbg_dir;
>   
>   static unsigned int nbds_max = 16;
>   static int max_part = 16;
> +static int pre_defined_connections = 1;
>   static int part_shift;
>   
>   static int nbd_dev_dbg_init(struct nbd_device *nbd);
> @@ -2733,8 +2734,13 @@ static int __init nbd_init(void)
>   	}
>   	nbd_dbg_init();
>   
> +	if (pre_defined_connections < 1)
> +		pre_defined_connections = 1;

nbd_init() will fail for invalid module parameter like max_part, nbds_max. So I
think it's better to fail for new parameter as well.

> +	/* Set to the intended connection count so nbd_start_device() can skip
> +	 * the queue-freezing blk_mq_update_nr_hw_queues() call.
> +	 */

Please follow the common comment style in this file.

/*
  * xxx
  */

>   	for (i = 0; i < nbds_max; i++)
> -		nbd_dev_add(i, 1, 1);
> +		nbd_dev_add(i, 1, pre_defined_connections);
>   	return 0;
>   }
>   
> @@ -2795,3 +2801,6 @@ module_param(nbds_max, int, 0444);
>   MODULE_PARM_DESC(nbds_max, "number of network block devices to initialize (default: 16)");
>   module_param(max_part, int, 0444);
>   MODULE_PARM_DESC(max_part, "number of partitions per device (default: 16)");
> +module_param(pre_defined_connections, int, 0444);
> +MODULE_PARM_DESC(pre_defined_connections,
> +"number of connections for devices pre-created at module load (default: 1)");

-- 
Thanks,
Kuai

      reply	other threads:[~2026-08-05  8:47 UTC|newest]

Thread overview: 14+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-08-05  6:58 [PATCH v7 0/8] nbd: eliminate queue freeze/unfreeze overhead in connection setup Yang Erkun
2026-08-05  6:58 ` [PATCH v7 1/8] nbd: simplify find_fallback() by removing redundant logic Yang Erkun
2026-08-05  6:58 ` [PATCH v7 2/8] nbd: disallow NBD_SET_SOCK on an active device Yang Erkun
2026-08-05  6:58 ` [PATCH v7 3/8] nbd: clear queue limits on disconnect Yang Erkun
2026-08-05  8:35   ` yu kuai
2026-08-05  6:58 ` [PATCH v7 4/8] nbd: remove queue freeze in nbd_add_socket Yang Erkun
2026-08-05  8:36   ` yu kuai
2026-08-05  6:58 ` [PATCH v7 5/8] nbd: skip queue freeze when setting size at device startup Yang Erkun
2026-08-05  8:37   ` yu kuai
2026-08-05  6:58 ` [PATCH v7 6/8] nbd: factor out a nbd_genl_foreach_sock Yang Erkun
2026-08-05  8:40   ` yu kuai
2026-08-05  6:58 ` [PATCH v7 7/8] nbd: remove queue freeze for newly created nbd from netlink path Yang Erkun
2026-08-05  6:58 ` [PATCH v7 8/8] nbd: add pre_defined_connections module parameter for pre-created devices Yang Erkun
2026-08-05  8:45   ` yu kuai [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=6b39fb25-6030-4e4e-9200-c7df47f3ca89@fygo.io \
    --to=yukuai@fygo.io \
    --cc=axboe@kernel.dk \
    --cc=chengzhihao1@huawei.com \
    --cc=echo.chenlin@huawei.com \
    --cc=hch@lst.de \
    --cc=huawei.libin@huawei.com \
    --cc=josef@toxicpanda.com \
    --cc=leijitang@huawei.com \
    --cc=leo.lilong@huaweicloud.com \
    --cc=linux-block@vger.kernel.org \
    --cc=nbd@other.debian.org \
    --cc=wangkefeng.wang@huawei.com \
    --cc=yangerkun@huawei.com \
    --cc=yi.zhang@huawei.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox