From: Baokun Li <libaokun@linux.alibaba.com>
To: Bernd Schubert <bernd@bsbernd.com>,
Joanne Koong <joannelkoong@gmail.com>,
Miklos Szeredi <miklos@szeredi.hu>
Cc: jlayton@kernel.org, axboe@kernel.dk, amir73il@gmail.com,
fuse-devel@lists.linux.dev
Subject: Re: [PATCH v7 1/6] fuse: decouple fuse_ring creation from ent registration
Date: Thu, 20 Aug 2026 16:02:21 +0800 [thread overview]
Message-ID: <69545a14-e3ca-487c-a98d-b9f16b745c39@linux.alibaba.com> (raw)
In-Reply-To: <f0cc2fd8-bf0a-4722-b81c-d54fbafd00a7@bsbernd.com>
Hi all,
On 2026/8/20 04:05, Bernd Schubert wrote:
>
> On 8/19/26 19:56, Joanne Koong wrote:
>> On Wed, Aug 19, 2026 at 4:35 AM Miklos Szeredi <miklos@szeredi.hu> wrote:
>>> On Fri, 14 Aug 2026 at 21:00, Joanne Koong <joannelkoong@gmail.com> wrote:
>>>> Currently, the connection's fuse_ring is created lazily on the first
>>>> FUSE_IO_URING_CMD_REGISTER command. A server registers entries from one
>>>> thread per queue (one per CPU) and those threads issue their first
>>>> REGISTER command concurrently. They then race to create the single
>>>> per-connection fuse_ring, which required open-coded handling in
>>>> fuse_uring_create() to detect and protect against concurrent creations.
>>>>
>>>> Decouple fuse_ring creation from ent registration and move it to
>>>> FUSE_INIT reply processing after a server has negotiated and set
>>>> FUSE_OVER_IO_URING. The ring is published before the connection is
>>>> marked initialized. fuse_uring_register() no longer creates the ring and
>>>> it instead uses the ring set up at init time.
>>> I tested this with loraw (a "raw" loopback tester that doesn't use
>>> libfuse) and it fails with
>>>
>>> root@kvm:~# ./loraw -u /mnt/fuse
>>> loraw: loraw.c:1010: lo_start_uring: Assertion `!cqe->res' failed.
>>>
>>> cqe->res is -22 (EINVAL).
>>>
>>> Attaching the reproducer. To compile:
>>>
>>> cp $(KERNEL_TREE)/include/uapi/linux/fuse.h fuse_kernel.h
>>> gcc loraw.c -oloraw -luring
>>>
>> Thanks for attaching the repro.
>>
>> This is happening because this patch uses the FUSE_OVER_IO_URING init
>> reply as a signal that the ring should be created, but I missed that
>> the FUSE_OVER_IO_URING reply is *optional*.
>>
>> Prior to this patch, there's two scenarios:
>> a) server sets FUSE_OVER_IO_URING reply at init time - requests will
>> automatically block until fuse-io-uring is completely set up
>> b) server does not set FUSE_OVER_IO_URING but later sends uring
>> register request - requests will continue along /dev/fuse path until
>> fuse-io-uring is completely set up
>>
>> Libfuse sets FUSE_OVER_IO_URING in the reply, but the loraw.c server does not.
>>
>> I think the best way to fix this is to have the ring creation happen
>> when the kernel receives the first io-uring command instead of at
>> FUSE_INIT or at FUSE_IO_URING_CMD_REGISTER ent creation time, given
>> that FUSE_IO_URING_ADD_QUEUE needs the ring to exist:
> I don't think we should allow io-uring without FUSE_OVER_IO_URING and
> I really thought that was disabled.
I share Bernd's concern here. Allowing io-uring without
FUSE_OVER_IO_URING means enabling a capability beyond what was
negotiated. We should honor the negotiated feature set, and print
the negotiated flags to dmesg at INIT time so issues like this are
easy to spot.
>
> <... checking the code ...>
>
> I'm on a ublk branch without your commits a applied, i.e. plain upstream 7.2 fuse
>
> fuse_uring_cmd()
> /* Once a connection has io-uring enabled on it, it can't be disabled */
> if (!enable_uring && !fch->io_uring) {
> pr_info_ratelimited("fuse-io-uring is disabled\n");
> return -EOPNOTSUPP;
> }
BTW, the current code clears fch->io_uring on REGISTER failure:
if (err) {
fch->io_uring = 0;
wake_up_all(&fch->blocked_waitq);
return err;
}
But by then other entries may have already registered successfully,
fiq->ops is switched to fuse_io_uring_ops, and requests are flowing
through the uring path. Clearing fch->io_uring here may reject all
subsequent io_uring commands with -EOPNOTSUPP while the data path
is still running on uring ops.
fch->io_uring is a protocol fact — the daemon negotiated
FUSE_OVER_IO_URING at INIT time. A single REGISTER failure should
not regress it, at least not once the ring is ready. The daemon
can retry; the negotiated capability should be permanent.
Thanks,
Baokun
next prev parent reply other threads:[~2026-08-20 8:02 UTC|newest]
Thread overview: 27+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-08-14 18:59 [PATCH v7 0/6] fuse: add io-uring buffer pools and zero-copy Joanne Koong
2026-08-14 18:59 ` [PATCH v7 1/6] fuse: decouple fuse_ring creation from ent registration Joanne Koong
2026-08-19 11:34 ` Miklos Szeredi
2026-08-19 11:38 ` Bernd Schubert
2026-08-19 17:56 ` Joanne Koong
2026-08-19 20:05 ` Bernd Schubert
2026-08-19 20:29 ` Joanne Koong
2026-08-19 20:52 ` Bernd Schubert
2026-08-19 21:35 ` Bernd Schubert
2026-08-20 8:02 ` Baokun Li [this message]
2026-08-20 16:16 ` Joanne Koong
2026-08-20 17:20 ` Bernd Schubert
2026-08-20 17:46 ` Joanne Koong
2026-08-20 18:27 ` Bernd Schubert
2026-08-21 3:38 ` Baokun Li
2026-08-21 3:24 ` Baokun Li
2026-08-21 3:04 ` Baokun Li
2026-08-14 18:59 ` [PATCH v7 2/6] fuse: add FUSE_IO_URING_CMD_ADD_QUEUE Joanne Koong
2026-08-14 18:59 ` [PATCH v7 3/6] fuse: add io-uring buffer pools Joanne Koong
2026-08-14 18:59 ` [PATCH v7 4/6] fuse: support registered buffer pools in io-uring Joanne Koong
2026-08-17 10:15 ` Bernd Schubert
2026-08-14 18:59 ` [PATCH v7 5/6] fuse: add zero-copy over io-uring Joanne Koong
2026-08-17 13:05 ` Bernd Schubert
2026-08-14 18:59 ` [PATCH v7 6/6] docs: fuse: document io-uring buffer pool and zero-copy uapi Joanne Koong
2026-08-14 19:23 ` [PATCH v7 0/6] fuse: add io-uring buffer pools and zero-copy Joanne Koong
2026-08-17 15:29 ` Miklos Szeredi
2026-08-17 18:23 ` Jens Axboe
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=69545a14-e3ca-487c-a98d-b9f16b745c39@linux.alibaba.com \
--to=libaokun@linux.alibaba.com \
--cc=amir73il@gmail.com \
--cc=axboe@kernel.dk \
--cc=bernd@bsbernd.com \
--cc=fuse-devel@lists.linux.dev \
--cc=jlayton@kernel.org \
--cc=joannelkoong@gmail.com \
--cc=miklos@szeredi.hu \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.