From: Olga Kornievskaia <aglo@umich.edu>
To: "J. Bruce Fields" <bfields@redhat.com>
Cc: Olga Kornievskaia <kolga@netapp.com>,
Christoph Hellwig <hch@infradead.org>,
linux-nfs <linux-nfs@vger.kernel.org>,
Jorge Mora <Jorge.Mora@netapp.com>
Subject: Re: [PATCH v8 0/9] NFSD support for async COPY
Date: Tue, 17 Apr 2018 10:13:56 -0400 [thread overview]
Message-ID: <CAN-5tyE7srmScvToz-GvWrksQb1JcwYnby+RobD6E8zPLi7AyA@mail.gmail.com> (raw)
In-Reply-To: <CAN-5tyFf2dkQYhbeULgKMuN8i=hJ4JUnETwN6x0J786H_fWVLg@mail.gmail.com>
On Tue, Apr 17, 2018 at 10:08 AM, Olga Kornievskaia <aglo@umich.edu> wrote:
> On Tue, Apr 17, 2018 at 9:57 AM, J. Bruce Fields <bfields@redhat.com> wrote:
>> On Tue, Apr 17, 2018 at 09:43:45AM -0400, Olga Kornievskaia wrote:
>>> > On Apr 17, 2018, at 9:41 AM, J. Bruce Fields <bfields@redhat.com> wrote:
>>> > Christoph said: "I'd like to see numbers for actual, real use cases."
>>> > Yes, I'd love to see that too.
>>> >
>>> > Is it possible to get testing on real hardware that we'd expect people
>>> > to use, with sufficient details about the setup that someone else could
>>> > reproduce the results?
>>>
>>> The numbers we presented was on real hardware. If you have any more questions regarding the setup please ask.
>>
>> Argh, sorry, you had to remind me once already:
>>
>> https://www.ietf.org/mail-archive/web/nfsv4/current/msg15379.html
>
> Yes that was for the "inter" copy.
>
> Besides those numbers, Jorge also did the numbers for the asynchronous
> vs synchronous intra copy. Are you interested in them as well?
> Hopefully Jorge still has them.
I found this in my emails. There is degradation for file size <- 8MB
and increase in performance for >16MB
Here are the numbers (each test is run 10 times and the average is displayed):
/home/mora/logs/nfstest_ssc_20171015174051.log: synchronous SSC
/home/mora/logs/nfstest_ssc_20171015171323.log: asynchronous SSC
Performance degradation for file size <= 8MB:
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
1KB file: 0.162018680573 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
1KB file: 0.636984395981 seconds
74.56%
performance degradation by async
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
2KB file: 0.177096033096 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
2KB file: 0.583548688889 seconds
69.65%
performance degradation by async
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
4KB file: 0.207866406441 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
4KB file: 0.782712388039 seconds
73.44%
performance degradation by async
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
8KB file: 0.201173448563 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
8KB file: 0.692702102661 seconds
70.96%
performance degradation by async
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
16KB file: 0.216166472435 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
16KB file: 0.56289691925 seconds
61.60%
performance degradation by async
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
32KB file: 0.185425901413 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
32KB file: 0.65691485405 seconds
71.77%
performance degradation by async
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
64KB file: 0.238445782661 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
64KB file: 0.525265741348 seconds
54.60%
performance degradation by async
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
128KB file: 0.166219258308 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
128KB file: 0.69602959156 seconds
76.12%
performance degradation by async
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
256KB file: 0.192826724052 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
256KB file: 0.556627941132 seconds
65.36%
performance degradation by async
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
512KB file: 0.230020523071 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
512KB file: 0.496951031685 seconds
53.71%
performance degradation by async
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
1MB file: 0.225317955017 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
1MB file: 0.50447602272 seconds
55.34%
performance degradation by async
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
2MB file: 0.233719205856 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
2MB file: 0.570275163651 seconds
59.02%
performance degradation by async
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
4MB file: 0.285868096352 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
4MB file: 0.656079149246 seconds
56.43%
performance degradation by async
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
8MB file: 0.509396600723 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
8MB file: 0.696055078506 seconds
26.82%
performance degradation by async
Performance improvement for file size >= 16MB:
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
16MB file: 0.960887002945 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
16MB file: 0.817601919174 seconds
14.91%
performance improvement by async
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
32MB file: 1.58274662495 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
32MB file: 1.24578406811 seconds
21.29%
performance improvement by async
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
64MB file: 2.54690010548 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
64MB file: 1.58639280796 seconds
37.71%
performance improvement by async
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
128MB file: 4.2253510952 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
128MB file: 2.58433949947 seconds
38.84%
performance improvement by async
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
256MB file: 7.71305201054 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
256MB file: 4.43859291077 seconds
42.45%
performance improvement by async
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
512MB file: 14.6445164919 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
512MB file: 8.18448216915 seconds
44.11%
performance improvement by async
/home/mora/logs/nfstest_ssc_20171015174051.log: PASS: SSC copy of
1GB file: 28.7619983673 seconds
/home/mora/logs/nfstest_ssc_20171015171323.log: PASS: SSC copy of
1GB file: 16.1399238825 seconds
43.88%
performance improvement by async
next prev parent reply other threads:[~2018-04-17 14:13 UTC|newest]
Thread overview: 42+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-04-13 17:01 [PATCH v8 0/9] NFSD support for async COPY Olga Kornievskaia
2018-04-13 17:01 ` [PATCH v8 1/9] NFSD CB_OFFLOAD xdr Olga Kornievskaia
2018-04-13 17:01 ` [PATCH v8 2/9] NFSD OFFLOAD_STATUS xdr Olga Kornievskaia
2018-04-13 17:01 ` [PATCH v8 3/9] NFSD OFFLOAD_CANCEL xdr Olga Kornievskaia
2018-04-13 17:01 ` [PATCH v8 4/9] NFSD xdr callback stateid in async COPY reply Olga Kornievskaia
2018-04-13 17:01 ` [PATCH v8 5/9] NFSD introduce async copy feature Olga Kornievskaia
2018-04-13 17:01 ` [PATCH v8 6/9] NFSD create new stateid for async copy Olga Kornievskaia
2018-04-13 17:01 ` [PATCH v8 7/9] NFSD handle OFFLOAD_CANCEL op Olga Kornievskaia
2018-04-17 18:06 ` Anna Schumaker
2018-04-17 18:08 ` Olga Kornievskaia
2018-04-17 18:10 ` Olga Kornievskaia
2018-04-13 17:01 ` [PATCH v8 8/9] NFSD support OFFLOAD_STATUS Olga Kornievskaia
2018-04-13 17:01 ` [PATCH v8 9/9] NFSD stop ongoing async copies on client shutdown Olga Kornievskaia
2018-04-14 7:22 ` [PATCH v8 0/9] NFSD support for async COPY Christoph Hellwig
2018-04-14 12:32 ` Olga Kornievskaia
2018-04-18 7:05 ` Christoph Hellwig
2018-04-16 21:45 ` J. Bruce Fields
2018-04-17 6:52 ` Christoph Hellwig
2018-04-17 13:22 ` Olga Kornievskaia
2018-04-17 13:41 ` J. Bruce Fields
2018-04-17 13:45 ` Olga Kornievskaia
[not found] ` <FE7DF381-A335-4827-94AB-1DEBF5FCEB05@netapp.com>
2018-04-17 13:57 ` J. Bruce Fields
2018-04-17 14:04 ` J. Bruce Fields
2018-04-17 14:08 ` Olga Kornievskaia
2018-04-17 14:13 ` Olga Kornievskaia [this message]
2018-04-17 14:50 ` Anna Schumaker
2018-04-17 14:41 ` Steve Dickson
[not found] ` <1E0C45FE-2214-41FB-8634-1005CC13AD9E@netapp.com>
2018-04-18 7:08 ` Christoph Hellwig
2018-04-24 20:29 ` Olga Kornievskaia
2018-04-27 16:03 ` J. Bruce Fields
2018-04-27 23:11 ` Olga Kornievskaia
2018-05-22 21:05 ` Olga Kornievskaia
2018-05-22 22:01 ` J. Bruce Fields
2018-04-17 13:42 ` J. Bruce Fields
2018-04-17 15:00 ` J. Bruce Fields
2018-04-17 15:17 ` Olga Kornievskaia
2018-04-17 15:41 ` J. Bruce Fields
2018-04-17 15:58 ` J. Bruce Fields
2018-04-17 17:41 ` J. Bruce Fields
2018-04-17 16:15 ` Olga Kornievskaia
2018-04-17 17:39 ` J. Bruce Fields
2018-04-18 7:07 ` Christoph Hellwig
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=CAN-5tyE7srmScvToz-GvWrksQb1JcwYnby+RobD6E8zPLi7AyA@mail.gmail.com \
--to=aglo@umich.edu \
--cc=Jorge.Mora@netapp.com \
--cc=bfields@redhat.com \
--cc=hch@infradead.org \
--cc=kolga@netapp.com \
--cc=linux-nfs@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).