Linux io-uring development
 help / color / mirror / Atom feed
From: Bernd Schubert <bschubert@ddn.com>
To: David Wei <dw@davidwei.uk>, Miklos Szeredi <miklos@szeredi.hu>
Cc: Jens Axboe <axboe@kernel.dk>,
	Pavel Begunkov <asml.silence@gmail.com>,
	"linux-fsdevel@vger.kernel.org" <linux-fsdevel@vger.kernel.org>,
	"io-uring@vger.kernel.org" <io-uring@vger.kernel.org>,
	Joanne Koong <joannelkoong@gmail.com>,
	Amir Goldstein <amir73il@gmail.com>,
	Ming Lei <tom.leiming@gmail.com>,
	Josef Bacik <josef@toxicpanda.com>
Subject: Re: [PATCH RFC v4 00/15] fuse: fuse-over-io-uring
Date: Mon, 4 Nov 2024 23:02:48 +0000	[thread overview]
Message-ID: <0fc59c7e-33f6-4933-b4ab-4ed92ce681b8@ddn.com> (raw)
In-Reply-To: <7c1cb193-cd0a-4b7f-b4ca-4cc4407e4875@ddn.com>

On 11/4/24 09:24, Bernd Schubert wrote:
> Hi David,
> 
> On 10/23/24 00:10, David Wei wrote:
>> [You don't often get email from dw@davidwei.uk. Learn why this is important at https://aka.ms/LearnAboutSenderIdentification ]
>>
>> On 2024-10-15 17:05, Bernd Schubert wrote:
>>> RFCv1 and RFCv2 have been tested with multiple xfstest runs in a VM
>>> (32 cores) with a kernel that has several debug options
>>> enabled (like KASAN and MSAN). RFCv3 is not that well tested yet.
>>> O_DIRECT is currently not working well with /dev/fuse and
>>> also these patches, a patch has been submitted to fix that (although
>>> the approach is refused)
>>> https://www.spinics.net/lists/linux-fsdevel/msg280028.html
>>
>> Hi Bernd, I applied this patch and the associated libfuse patch at:
>>
>> https://github.com/bsbernd/libfuse/tree/aligned-writes
>>
>> I have a simple Python FUSE client that is still returning EINVAL for
>> write():
>>
>> with open(sys.argv[1], 'r+b') as f:
>>     mmapped_file = mmap.mmap(f.fileno(), 0)
>>     shm = shared_memory.SharedMemory(create=True, size=mmapped_file.size())
>>     shm.buf[:mmapped_file.size()] = mmapped_file[:]
>>     fd = os.open("/home/vmuser/scratch/dest/out", O_RDWR|O_CREAT|O_DIRECT)
>>     with open(fd, 'w+b') as f2:
>>         f2.write(bytes(shm.buf))
>>     mmapped_file.close()
>>     shm.unlink()
>>     shm.close()
>>
>> I'll keep looking at this but letting you know in case it's something
>> obvious again.
> 
> the 'aligned-writes' libfuse branch would need another kernel patch. Please
> hold on a little bit, I hope to send out a new version later today or
> tomorrow that separates headers from payload - alignment is guaranteed. 
> 

If you are very brave, you could try out this (sorry, still on 6.10)


https://github.com/bsbernd/linux/tree/fuse-uring-for-6.10-rfc5
https://github.com/bsbernd/libfuse/tree/uring


Right now #fuse-uring-for-6.10-rfc5 is rather similar to
fuse-uring-for-6.10-rfc4, with two additional patches to
separate headers from payload. The head commit, which
updates fuse-io-uring is going to be rebased into the
other commits tomorrow.

Also, I just noticed a tear down issue, when the daemon
is killed while IO is going on - busy inodes on sb shutdown.
Some fuse requests are probably not correctly released, I
guess that is also already present on rfcv4. Will look into
it in the morning.


Thanks,
Bernd

  reply	other threads:[~2024-11-04 23:02 UTC|newest]

Thread overview: 47+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <CGME20250618105918epcas5p472b61890ece3e8044e7172785f469cc0@epcas5p4.samsung.com>
2024-10-16  0:05 ` [PATCH RFC v4 00/15] fuse: fuse-over-io-uring Bernd Schubert
2024-10-16  0:05   ` [PATCH RFC v4 01/15] fuse: rename to fuse_dev_end_requests and make non-static Bernd Schubert
2024-10-16  0:05   ` [PATCH RFC v4 02/15] fuse: Move fuse_get_dev to header file Bernd Schubert
2024-10-16  0:05   ` [PATCH RFC v4 03/15] fuse: Move request bits Bernd Schubert
2024-10-16  0:05   ` [PATCH RFC v4 04/15] fuse: Add fuse-io-uring design documentation Bernd Schubert
2024-10-16  0:05   ` [PATCH RFC v4 05/15] fuse: {uring} Handle SQEs - register commands Bernd Schubert
2024-10-16  0:05   ` [PATCH RFC v4 06/15] fuse: Make fuse_copy non static Bernd Schubert
2024-10-16  0:05   ` [PATCH RFC v4 07/15] fuse: Add buffer offset for uring into fuse_copy_state Bernd Schubert
2024-10-16  0:05   ` [PATCH RFC v4 08/15] fuse: {uring} Add uring sqe commit and fetch support Bernd Schubert
2024-10-16  0:05   ` [PATCH RFC v4 09/15] fuse: {uring} Handle teardown of ring entries Bernd Schubert
2024-10-16  0:05   ` [PATCH RFC v4 10/15] fuse: {uring} Add a ring queue and send method Bernd Schubert
2024-10-16  0:05   ` [PATCH RFC v4 11/15] fuse: {uring} Allow to queue to the ring Bernd Schubert
2024-10-16  0:05   ` [PATCH RFC v4 12/15] io_uring/cmd: let cmds to know about dying task Bernd Schubert
2024-11-04  0:28     ` Pavel Begunkov
2024-11-04 22:15       ` Bernd Schubert
2024-11-05  1:08         ` Pavel Begunkov
2024-11-05 23:02           ` Bernd Schubert
2024-11-06  0:14             ` Pavel Begunkov
2024-11-06 19:28               ` Bernd Schubert
2024-11-06  4:44             ` Ming Lei
2024-11-06 19:34               ` Bernd Schubert
2024-11-07 16:11                 ` Pavel Begunkov
2024-10-16  0:05   ` [PATCH RFC v4 13/15] fuse: {uring} Handle IO_URING_F_TASK_DEAD Bernd Schubert
2024-10-16  0:05   ` [PATCH RFC v4 14/15] fuse: {io-uring} Prevent mount point hang on fuse-server termination Bernd Schubert
2024-10-16  0:05   ` [PATCH RFC v4 15/15] fuse: enable fuse-over-io-uring Bernd Schubert
2024-10-16  0:08   ` [PATCH RFC v4 00/15] fuse: fuse-over-io-uring Bernd Schubert
2024-10-21  4:06   ` David Wei
2024-10-21 11:47     ` Bernd Schubert
2024-10-21 20:57       ` David Wei
2024-10-22 10:24         ` Bernd Schubert
2024-10-22 12:46           ` Bernd Schubert
2024-10-22 17:10             ` David Wei
2024-10-22 17:12           ` David Wei
2024-10-22 22:10   ` David Wei
2024-11-04  8:24     ` Bernd Schubert
2024-11-04 23:02       ` Bernd Schubert [this message]
2025-06-18 10:54   ` [PATCH v9 00/17] " xiaobing.li
2025-06-18 13:13     ` Bernd Schubert
2025-06-18 15:30       ` Keith Busch
2025-06-18 15:40         ` Pavel Begunkov
2025-06-20  1:39         ` xiaobing.li
2025-06-23 21:36           ` Bernd Schubert
2025-06-23 21:55             ` David Wei
2025-06-23 22:21               ` Bernd Schubert
2025-08-14  1:55               ` Xue He
2025-06-24  1:09             ` Ming Lei
2025-06-23  8:33         ` xiaobing.li

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=0fc59c7e-33f6-4933-b4ab-4ed92ce681b8@ddn.com \
    --to=bschubert@ddn.com \
    --cc=amir73il@gmail.com \
    --cc=asml.silence@gmail.com \
    --cc=axboe@kernel.dk \
    --cc=dw@davidwei.uk \
    --cc=io-uring@vger.kernel.org \
    --cc=joannelkoong@gmail.com \
    --cc=josef@toxicpanda.com \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=miklos@szeredi.hu \
    --cc=tom.leiming@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox