Linux network filesystem support library
 help / color / mirror / Atom feed
From: David Howells <dhowells@redhat.com>
To: Christian Brauner <christian@brauner.io>,
	Matthew Wilcox <willy@infradead.org>,
	Christoph Hellwig <hch@infradead.org>
Cc: David Howells <dhowells@redhat.com>,
	Paulo Alcantara <pc@manguebit.org>, Jens Axboe <axboe@kernel.dk>,
	Leon Romanovsky <leon@kernel.org>,
	Steve French <sfrench@samba.org>,
	ChenXiaoSong <chenxiaosong@chenxiaosong.com>,
	Marc Dionne <marc.dionne@auristor.com>,
	Eric Van Hensbergen <ericvh@kernel.org>,
	Dominique Martinet <asmadeus@codewreck.org>,
	Ilya Dryomov <idryomov@gmail.com>,
	Trond Myklebust <trondmy@kernel.org>,
	netfs@lists.linux.dev, linux-afs@lists.infradead.org,
	linux-cifs@vger.kernel.org, linux-nfs@vger.kernel.org,
	ceph-devel@vger.kernel.org, v9fs@lists.linux.dev,
	linux-erofs@lists.ozlabs.org, linux-fsdevel@vger.kernel.org,
	linux-kernel@vger.kernel.org
Subject: [PATCH v3 21/22] netfs: Limit the minimum trigger for progress reporting
Date: Mon,  8 Jun 2026 15:54:29 +0100	[thread overview]
Message-ID: <20260608145432.681865-22-dhowells@redhat.com> (raw)
In-Reply-To: <20260608145432.681865-1-dhowells@redhat.com>

For really big read RPC ops that span multiple folios, netfslib allows the
filesystem to give progress notifications to wake up the collector thread
to do a collection of folios that have now been fetched, even if the RPC is
still ongoing, thereby allowing the application to make progress.

The trigger for this is that at least one folio has been downloaded since
the clean point.  If, however, the folios are small, this means the
collector thread is constantly being woken up - which has a negative
performance impact on the system.

Set a minimum trigger of 256KiB or the size of the folio at the front of
the queue, whichever is larger.

Also, fix the base to be the stream collection point, not the point at
which the collector has cleaned up to (which is currently 0 until something
has been collected).

Signed-off-by: David Howells <dhowells@redhat.com>
cc: Paulo Alcantara <pc@manguebit.org>
cc: netfs@lists.linux.dev
cc: linux-fsdevel@vger.kernel.org
---
 fs/netfs/read_collect.c | 6 +++---
 1 file changed, 3 insertions(+), 3 deletions(-)

diff --git a/fs/netfs/read_collect.c b/fs/netfs/read_collect.c
index fc62eaef6107..fccc6c2d891e 100644
--- a/fs/netfs/read_collect.c
+++ b/fs/netfs/read_collect.c
@@ -491,15 +491,15 @@ void netfs_read_collection_worker(struct work_struct *work)
 void netfs_read_subreq_progress(struct netfs_io_subrequest *subreq)
 {
 	struct netfs_io_request *rreq = subreq->rreq;
-	struct netfs_io_stream *stream = &rreq->io_streams[0];
-	size_t fsize = PAGE_SIZE << rreq->front_folio_order;
+	struct netfs_io_stream *stream = &rreq->io_streams[subreq->stream_nr];
+	size_t fsize = umax(PAGE_SIZE << rreq->front_folio_order, 256 * 1024);
 
 	trace_netfs_sreq(subreq, netfs_sreq_trace_progress);
 
 	/* If we are at the head of the queue, wake up the collector,
 	 * getting a ref to it if we were the ones to do so.
 	 */
-	if (subreq->start + subreq->transferred > rreq->cleaned_to + fsize &&
+	if (subreq->start + subreq->transferred >= stream->collected_to + fsize &&
 	    (rreq->origin == NETFS_READAHEAD ||
 	     rreq->origin == NETFS_READPAGE ||
 	     rreq->origin == NETFS_READ_FOR_WRITE) &&


  parent reply	other threads:[~2026-06-08 14:57 UTC|newest]

Thread overview: 23+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-06-08 14:54 [PATCH v3 00/22] netfs: Keep track of folios in a segmented bio_vec[] chain David Howells
2026-06-08 14:54 ` [PATCH v3 01/22] netfs: Fix decision whether to disallow write-streaming due to fscache use David Howells
2026-06-08 14:54 ` [PATCH v3 02/22] cachefiles: Don't rely on backing fs storage map for most use cases David Howells
2026-06-08 14:54 ` [PATCH v3 03/22] netfs: Add the cache object ID to netfs_read/write tracepoints David Howells
2026-06-08 14:54 ` [PATCH v3 04/22] mm: Make readahead store folio count in readahead_control David Howells
2026-06-08 14:54 ` [PATCH v3 05/22] netfs: Bulk load the readahead-provided folios up front David Howells
2026-06-08 14:54 ` [PATCH v3 06/22] Add a function to kmap one page of a multipage bio_vec David Howells
2026-06-08 14:54 ` [PATCH v3 07/22] iov_iter: Make iov_iter_get_pages*() wrap iov_iter_extract_pages() David Howells
2026-06-08 14:54 ` [PATCH v3 08/22] iov_iter: Add a segmented queue of bio_vec[] David Howells
2026-06-08 14:54 ` [PATCH v3 09/22] netfs: Add some tools for managing bvecq chains David Howells
2026-06-08 14:54 ` [PATCH v3 10/22] netfs: Add a function to extract from an iter into a bvecq David Howells
2026-06-08 14:54 ` [PATCH v3 11/22] afs: Use a bvecq to hold dir content rather than folioq David Howells
2026-06-08 14:54 ` [PATCH v3 12/22] cifs: Use a bvecq for buffering instead of a folioq David Howells
2026-06-08 14:54 ` [PATCH v3 13/22] smbdirect: Support ITER_BVECQ in smbdirect_map_sges_from_iter() David Howells
2026-06-08 14:54 ` [PATCH v3 14/22] netfs: Switch to using bvecq rather than folio_queue and rolling_buffer David Howells
2026-06-08 14:54 ` [PATCH v3 15/22] smbdirect: Remove support for ITER_FOLIOQ from smbdirect_map_sges_from_iter() David Howells
2026-06-08 14:54 ` [PATCH v3 16/22] netfs: Remove netfs_alloc/free_folioq_buffer() David Howells
2026-06-08 14:54 ` [PATCH v3 17/22] netfs: Remove netfs_extract_user_iter() David Howells
2026-06-08 14:54 ` [PATCH v3 18/22] iov_iter: Remove ITER_FOLIOQ David Howells
2026-06-08 14:54 ` [PATCH v3 19/22] netfs: Remove folio_queue and rolling_buffer David Howells
2026-06-08 14:54 ` [PATCH v3 20/22] netfs: Check for too much data being read David Howells
2026-06-08 14:54 ` David Howells [this message]
2026-06-08 14:54 ` [PATCH v3 22/22] netfs: Combine prepare and issue ops and grab the buffers on request David Howells

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20260608145432.681865-22-dhowells@redhat.com \
    --to=dhowells@redhat.com \
    --cc=asmadeus@codewreck.org \
    --cc=axboe@kernel.dk \
    --cc=ceph-devel@vger.kernel.org \
    --cc=chenxiaosong@chenxiaosong.com \
    --cc=christian@brauner.io \
    --cc=ericvh@kernel.org \
    --cc=hch@infradead.org \
    --cc=idryomov@gmail.com \
    --cc=leon@kernel.org \
    --cc=linux-afs@lists.infradead.org \
    --cc=linux-cifs@vger.kernel.org \
    --cc=linux-erofs@lists.ozlabs.org \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-nfs@vger.kernel.org \
    --cc=marc.dionne@auristor.com \
    --cc=netfs@lists.linux.dev \
    --cc=pc@manguebit.org \
    --cc=sfrench@samba.org \
    --cc=trondmy@kernel.org \
    --cc=v9fs@lists.linux.dev \
    --cc=willy@infradead.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox