From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id A927FC04A6A for ; Tue, 25 Jul 2023 10:11:26 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231254AbjGYKLY (ORCPT ); Tue, 25 Jul 2023 06:11:24 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:38442 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231623AbjGYKLW (ORCPT ); Tue, 25 Jul 2023 06:11:22 -0400 Received: from out-60.mta1.migadu.com (out-60.mta1.migadu.com [95.215.58.60]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 1EC7F10FA for ; Tue, 25 Jul 2023 03:11:14 -0700 (PDT) Message-ID: <9b0a164d-3d0e-cc57-81b7-ae32bef4e9d7@linux.dev> DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.dev; s=key1; t=1690279872; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=cp2G6Suk2Avgq5OP5WwoCgbwBHs06hhcMJV7ZyIbEuo=; b=VB2J3ghJq5xLs1cyTqWpdXTFvI5iEbfSWggwbTi9iY0JjW0Hdt/TGxEyqNs2FmVp++YRjZ kPtzdP0DqA4HqecPpeUutJq0VaB4JIxVB2Mc5/PSnYO5eX1/cEIzSdvNHGCnAVwFeVGfjO /8/Z7JCq/4RwPLemJtd10OK/rn2KOfE= Date: Tue, 25 Jul 2023 18:11:05 +0800 MIME-Version: 1.0 Subject: Re: [External] [fuse-devel] [PATCH 3/3] fuse: write back dirty pages before direct write in direct_io_relax mode To: Bernd Schubert , Jiachen Zhang , fuse-devel@lists.sourceforge.net Cc: linux-fsdevel@vger.kernel.org, Wanpeng Li , cgxu519@mykernel.net, miklos@szeredi.hu References: <20230630094602.230573-1-hao.xu@linux.dev> <20230630094602.230573-4-hao.xu@linux.dev> <2622afd7-228f-02f3-3b72-a1c826844126@linux.dev> <396A0BF4-DA68-46F8-9881-3801737225C6@fastmail.fm> Content-Language: en-US X-Report-Abuse: Please report any abuse attempt to abuse@migadu.com and include these headers. From: Hao Xu In-Reply-To: <396A0BF4-DA68-46F8-9881-3801737225C6@fastmail.fm> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Migadu-Flow: FLOW_OUT Precedence: bulk List-ID: X-Mailing-List: linux-fsdevel@vger.kernel.org On 7/21/23 19:56, Bernd Schubert wrote: > On July 21, 2023 1:27:26 PM GMT+02:00, Hao Xu wrote: >> On 7/21/23 14:35, Jiachen Zhang wrote: >>> >>> On 2023/6/30 17:46, Hao Xu wrote: >>>> From: Hao Xu >>>> >>>> In direct_io_relax mode, there can be shared mmaped files and thus dirty >>>> pages in its page cache. Therefore those dirty pages should be written >>>> back to backend before direct write to avoid data loss. >>>> >>>> Signed-off-by: Hao Xu >>>> --- >>>>   fs/fuse/file.c | 7 +++++++ >>>>   1 file changed, 7 insertions(+) >>>> >>>> diff --git a/fs/fuse/file.c b/fs/fuse/file.c >>>> index 176f719f8fc8..7c9167c62bf6 100644 >>>> --- a/fs/fuse/file.c >>>> +++ b/fs/fuse/file.c >>>> @@ -1485,6 +1485,13 @@ ssize_t fuse_direct_io(struct fuse_io_priv *io, struct iov_iter *iter, >>>>       if (!ia) >>>>           return -ENOMEM; >>>> +    if (fopen_direct_write && fc->direct_io_relax) { >>>> +        res = filemap_write_and_wait_range(mapping, pos, pos + count - 1); >>>> +        if (res) { >>>> +            fuse_io_free(ia); >>>> +            return res; >>>> +        } >>>> +    } >>>>       if (!cuse && fuse_range_is_writeback(inode, idx_from, idx_to)) { >>>>           if (!write) >>>>               inode_lock(inode); >>> >>> Tested-by: Jiachen Zhang >>> >>> >>> Looks good to me. >>> >>> By the way, the behaviour would be a first FUSE_WRITE flushing the page cache, followed by a second FUSE_WRITE doing the direct IO. In the future, further optimization could be first write into the page cache and then flush the dirty page to the FUSE daemon. >>> >> >> I think this makes sense, cannot think of any issue in it for now, so >> I'll do that change and send next version, super thanks, Jiachen! >> >> Thanks, >> Hao >> >>> >>> Thanks, >>> Jiachen >> > > On my phone, sorry if mail formatting is not optimal. > Do I understand it right? You want DIO code path copy into pages and then flush/invalidate these pages? That would be punish DIO for for the unlikely case there are also dirty pages (discouraged IO pattern). Hi Bernd, I think I don't get what you said, why it is punishment and why it's discouraged IO pattern? On my first eyes seeing Jiachen's idea, I was thinking "that sounds disobeying direct write semantics" because usually direct write is "flush dirty page -> invalidate page -> write data through to backend" not "write data to page -> flush dirty page/(writeback data)" The latter in worst case write data both to page cache and backend while the former just write to backend and load it to the page cache when buffered reading. But seems there is no such "standard way" which says we should implement direct IO in that way. Regards, Hao