From: bfields@fieldses.org (J. Bruce Fields)
To: dai.ngo@oracle.com
Cc: Chuck Lever III <chuck.lever@oracle.com>,
Jeff Layton <jlayton@kernel.org>,
Linux NFS Mailing List <linux-nfs@vger.kernel.org>,
steved@redhat.com
Subject: Re: [PATCH v4 2/2] NFSD: add shrinker to reap courtesy clients on low memory condition
Date: Tue, 6 Sep 2022 09:00:11 -0400 [thread overview]
Message-ID: <20220906130011.GB25323@fieldses.org> (raw)
In-Reply-To: <1f395e2b-695f-836f-2038-6a672c651d53@oracle.com>
On Sat, Sep 03, 2022 at 10:59:17AM -0700, dai.ngo@oracle.com wrote:
> On 9/3/22 10:29 AM, Chuck Lever III wrote:
> >What I was suggesting was a longer term strategy for improving the
> >laundromat. In order to scale well in the number of clients, it
> >needs to schedule client expiry and deletion without serializing.
> >
> >(ie, the laundromat itself can identify a set of clients to clean,
> >but then it should pass that list to other workers so it can run
> >again as soon as it needs to -- and that also means it can use more
> >than just one CPU at a time to do its work).
>
> I see. Currently on my lowly 1-CPU VM it takes about ~35 secs to
> destroy 128 clients, each with only few states (generated by pynfs's
> CID5 test). We can improve on this.
Careful--it's not the CPU that's the issue, it's waiting for disk.
If you're on a hard drive, for example, it's going to take at least one
seek (probably at least 10ms) to expire a single client, so you're never
going to destroy more than 100 per second. That's what you need to
parallelize. See item 3 from
https://lore.kernel.org/linux-nfs/20220523154026.GD24163@fieldses.org/
Also, looks like current nfs-utils is still doing 3 commits per expiry.
Steve, for some reason I think "nfsdcld: use WAL journal for faster
commits" never got applied:
https://lore.kernel.org/linux-nfs/20220104222445.GF12040@fieldses.org/
--b.
next prev parent reply other threads:[~2022-09-06 13:00 UTC|newest]
Thread overview: 17+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-08-30 21:48 [PATCH v4 0/2] NFSD: memory shrinker for NFSv4 clients Dai Ngo
2022-08-30 21:48 ` [PATCH v4 1/2] NFSD: keep track of the number of courtesy clients in the system Dai Ngo
2022-08-31 14:30 ` Chuck Lever III
2022-08-30 21:48 ` [PATCH v4 2/2] NFSD: add shrinker to reap courtesy clients on low memory condition Dai Ngo
2022-08-31 14:30 ` Chuck Lever III
2022-09-02 1:56 ` dai.ngo
2022-09-02 4:32 ` Chuck Lever III
2022-09-02 16:44 ` dai.ngo
2022-09-02 17:58 ` Chuck Lever III
2022-09-02 19:34 ` dai.ngo
2022-09-03 1:26 ` Chuck Lever III
2022-09-03 17:03 ` dai.ngo
2022-09-03 17:29 ` Chuck Lever III
2022-09-03 17:59 ` dai.ngo
2022-09-06 13:00 ` J. Bruce Fields [this message]
2022-09-06 19:04 ` dai.ngo
2022-08-31 10:00 ` [PATCH v4 0/2] NFSD: memory shrinker for NFSv4 clients Jeff Layton
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20220906130011.GB25323@fieldses.org \
--to=bfields@fieldses.org \
--cc=chuck.lever@oracle.com \
--cc=dai.ngo@oracle.com \
--cc=jlayton@kernel.org \
--cc=linux-nfs@vger.kernel.org \
--cc=steved@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox