From: Vladimir Sementsov-Ogievskiy <vsementsov@virtuozzo.com>
To: qemu-block@nongnu.org
Cc: qemu-devel@nongnu.org, armbru@redhat.com, hreitz@redhat.com,
kwolf@redhat.com, vsementsov@virtuozzo.com, eblake@redhat.com,
den@openvz.org
Subject: [PATCH v3 3/9] nbd: allow reconnect on open, with corresponding new options
Date: Mon, 6 Sep 2021 22:06:48 +0300 [thread overview]
Message-ID: <20210906190654.183421-4-vsementsov@virtuozzo.com> (raw)
In-Reply-To: <20210906190654.183421-1-vsementsov@virtuozzo.com>
It is useful when start of vm and start of nbd server are not
simple to sync.
Signed-off-by: Vladimir Sementsov-Ogievskiy <vsementsov@virtuozzo.com>
---
qapi/block-core.json | 9 ++++++++-
block/nbd.c | 45 +++++++++++++++++++++++++++++++++++++++++++-
2 files changed, 52 insertions(+), 2 deletions(-)
diff --git a/qapi/block-core.json b/qapi/block-core.json
index 6e4042530a..30d491bcd4 100644
--- a/qapi/block-core.json
+++ b/qapi/block-core.json
@@ -3994,6 +3994,12 @@
# future requests before a successful reconnect will
# immediately fail. Default 0 (Since 4.2)
#
+# @open-timeout: In seconds. If zero, the nbd driver tries the connection
+# only once, and fails to open if the connection fails.
+# If non-zero, the nbd driver will repeat connection attempts
+# until successful or until @open-timeout seconds have elapsed.
+# Default 0 (Since 6.2)
+#
# Since: 2.9
##
{ 'struct': 'BlockdevOptionsNbd',
@@ -4001,7 +4007,8 @@
'*export': 'str',
'*tls-creds': 'str',
'*x-dirty-bitmap': 'str',
- '*reconnect-delay': 'uint32' } }
+ '*reconnect-delay': 'uint32',
+ '*open-timeout': 'uint32' } }
##
# @BlockdevOptionsRaw:
diff --git a/block/nbd.c b/block/nbd.c
index 306b2de9f2..38a503102c 100644
--- a/block/nbd.c
+++ b/block/nbd.c
@@ -80,6 +80,7 @@ typedef struct BDRVNBDState {
NBDClientState state;
QEMUTimer *reconnect_delay_timer;
+ QEMUTimer *open_timer;
NBDClientRequest requests[MAX_NBD_REQUESTS];
NBDReply reply;
@@ -87,6 +88,7 @@ typedef struct BDRVNBDState {
/* Connection parameters */
uint32_t reconnect_delay;
+ uint32_t open_timeout;
SocketAddress *saddr;
char *export, *tlscredsid;
QCryptoTLSCreds *tlscreds;
@@ -218,6 +220,32 @@ static void nbd_teardown_connection(BlockDriverState *bs)
s->state = NBD_CLIENT_QUIT;
}
+static void open_timer_del(BDRVNBDState *s)
+{
+ if (s->open_timer) {
+ timer_free(s->open_timer);
+ s->open_timer = NULL;
+ }
+}
+
+static void open_timer_cb(void *opaque)
+{
+ BDRVNBDState *s = opaque;
+
+ nbd_co_establish_connection_cancel(s->conn);
+ open_timer_del(s);
+}
+
+static void open_timer_init(BDRVNBDState *s, uint64_t expire_time_ns)
+{
+ assert(!s->open_timer);
+ s->open_timer = aio_timer_new(bdrv_get_aio_context(s->bs),
+ QEMU_CLOCK_REALTIME,
+ SCALE_NS,
+ open_timer_cb, s);
+ timer_mod(s->open_timer, expire_time_ns);
+}
+
static bool nbd_client_connecting(BDRVNBDState *s)
{
NBDClientState state = qatomic_load_acquire(&s->state);
@@ -1737,6 +1765,15 @@ static QemuOptsList nbd_runtime_opts = {
"future requests before a successful reconnect will "
"immediately fail. Default 0",
},
+ {
+ .name = "open-timeout",
+ .type = QEMU_OPT_NUMBER,
+ .help = "In seconds. If zero, the nbd driver tries the connection "
+ "only once, and fails to open if the connection fails. "
+ "If non-zero, the nbd driver will repeat connection "
+ "attempts until successful or until @open-timeout seconds "
+ "have elapsed. Default 0",
+ },
{ /* end of list */ }
},
};
@@ -1792,6 +1829,7 @@ static int nbd_process_options(BlockDriverState *bs, QDict *options,
}
s->reconnect_delay = qemu_opt_get_number(opts, "reconnect-delay", 0);
+ s->open_timeout = qemu_opt_get_number(opts, "open-timeout", 0);
ret = 0;
@@ -1823,7 +1861,12 @@ static int nbd_open(BlockDriverState *bs, QDict *options, int flags,
s->conn = nbd_client_connection_new(s->saddr, true, s->export,
s->x_dirty_bitmap, s->tlscreds);
- /* TODO: Configurable retry-until-timeout behaviour. */
+ if (s->open_timeout) {
+ nbd_client_connection_enable_retry(s->conn);
+ open_timer_init(s, qemu_clock_get_ns(QEMU_CLOCK_REALTIME) +
+ s->open_timeout * NANOSECONDS_PER_SECOND);
+ }
+
s->state = NBD_CLIENT_CONNECTING_WAIT;
ret = nbd_do_establish_connection(bs, errp);
if (ret < 0) {
--
2.29.2
next prev parent reply other threads:[~2021-09-06 19:09 UTC|newest]
Thread overview: 21+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-09-06 19:06 [PATCH v3 0/9] nbd reconnect on open Vladimir Sementsov-Ogievskiy
2021-09-06 19:06 ` [PATCH v3 1/9] nbd/client-connection: nbd_co_establish_connection(): fix non set errp Vladimir Sementsov-Ogievskiy
2021-09-07 17:44 ` Eric Blake
2021-09-24 19:19 ` Eric Blake
2021-09-06 19:06 ` [PATCH v3 2/9] qapi: make blockdev-add a coroutine command Vladimir Sementsov-Ogievskiy
2021-09-06 19:28 ` Markus Armbruster
2021-09-06 21:40 ` Vladimir Sementsov-Ogievskiy
2021-09-07 6:14 ` Markus Armbruster
2021-09-27 11:25 ` Vladimir Sementsov-Ogievskiy
2021-09-06 19:06 ` Vladimir Sementsov-Ogievskiy [this message]
2021-09-07 20:36 ` [PATCH v3 3/9] nbd: allow reconnect on open, with corresponding new options Eric Blake
2021-09-06 19:06 ` [PATCH v3 4/9] nbd/client-connection: nbd_co_establish_connection(): return real error Vladimir Sementsov-Ogievskiy
2021-09-07 20:42 ` Eric Blake
2021-09-06 19:06 ` [PATCH v3 5/9] nbd/client-connection: improve error message of cancelled attempt Vladimir Sementsov-Ogievskiy
2021-09-07 20:45 ` Eric Blake
2021-09-06 19:06 ` [PATCH v3 6/9] iotests.py: add qemu_tool_popen() Vladimir Sementsov-Ogievskiy
2021-09-06 19:06 ` [PATCH v3 7/9] iotests.py: add and use qemu_io_wrap_args() Vladimir Sementsov-Ogievskiy
2021-09-06 19:06 ` [PATCH v3 8/9] iotests.py: add qemu_io_popen() Vladimir Sementsov-Ogievskiy
2021-09-06 19:06 ` [PATCH v3 9/9] iotests: add nbd-reconnect-on-open test Vladimir Sementsov-Ogievskiy
2021-09-07 20:51 ` Eric Blake
2021-09-08 7:55 ` Vladimir Sementsov-Ogievskiy
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20210906190654.183421-4-vsementsov@virtuozzo.com \
--to=vsementsov@virtuozzo.com \
--cc=armbru@redhat.com \
--cc=den@openvz.org \
--cc=eblake@redhat.com \
--cc=hreitz@redhat.com \
--cc=kwolf@redhat.com \
--cc=qemu-block@nongnu.org \
--cc=qemu-devel@nongnu.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).