All of lore.kernel.org
 help / color / mirror / Atom feed
From: Petr Vorel <pvorel@suse.cz>
To: ltp@lists.linux.it
Subject: [LTP] [PATCH 3/3] lib/tst_net.sh: calc median instead of mean in tst_netload()
Date: Fri, 5 Feb 2021 11:17:27 +0100	[thread overview]
Message-ID: <YB0bN4BMGZyVvNeA@pevik> (raw)
In-Reply-To: <20210202133454.59224-4-alexey.kodanev@oracle.com>

Hi Alexey,

> Sometimes the tests can get the following results on a test network:

> gre01   1 TINFO: run server 'netstress -D ltp_v0...
> gre01   1 TINFO: run client 'netstress -l -D ltp_v0... 5 times
> gre01   1 TPASS: netstress passed, mean time 4633 ms, data: 128 22627 134 142 137
> ...
> vxlan03 1 TINFO: run server 'netstress -D ltp_v0...
> vxlan03 1 TINFO: run client 'netstress -l -D ltp_v0... 5 times
> vxlan03 1 TPASS: netstress passed, mean time 4584 ms, data: 142 140 146 145 22350

> One unsuccessful run can have a huge impact on the final result,
> when using the mean time with such data.

> A more suitable solution for short runs would be to obtain a median
> time that can remove all outliers. This will lead to more consistent
> performance test results. For example, instead of the above runs, we
> would get this:

> gre01   1 TPASS: netstress passed, median time 137 ms, data: 128 22627 134 142 137
> vxlan03 1 TPASS: netstress passed, median time 145 ms, data: 142 140 146 145 22350
Reviewed-by: Petr Vorel <pvorel@suse.cz>

Kind regards,
Petr

  reply	other threads:[~2021-02-05 10:17 UTC|newest]

Thread overview: 9+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-02-02 13:34 [LTP] [PATCH 0/3] lib/tst_net.sh: calc median instead of mean in tst_netload() Alexey Kodanev
2021-02-02 13:34 ` [LTP] [PATCH 1/3] lib/tst_net.sh: print all netstress results " Alexey Kodanev
2021-02-05  6:59   ` Petr Vorel
2021-02-02 13:34 ` [LTP] [PATCH 2/3] lib: add tst_get_median helper binary for use in script tests Alexey Kodanev
2021-02-05 10:15   ` Petr Vorel
2021-02-02 13:34 ` [LTP] [PATCH 3/3] lib/tst_net.sh: calc median instead of mean in tst_netload() Alexey Kodanev
2021-02-05 10:17   ` Petr Vorel [this message]
2021-02-05 10:21 ` [LTP] [PATCH 0/3] " Petr Vorel
2021-02-08 15:24   ` Alexey Kodanev

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=YB0bN4BMGZyVvNeA@pevik \
    --to=pvorel@suse.cz \
    --cc=ltp@lists.linux.it \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body. 
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.