public inbox for ltp@lists.linux.it
 help / color / mirror / Atom feed
From: Richard Palethorpe <rpalethorpe@suse.de>
To: Cyril Hrubis <chrubis@suse.cz>
Cc: ltp@lists.linux.it, automated-testing@lists.yoctoproject.org
Subject: Re: [LTP] [Automated-testing] [PATCH v3 01/29] Introduce a concept of max runtime
Date: Tue, 24 May 2022 10:25:22 +0100	[thread overview]
Message-ID: <87zgj7qo2c.fsf@suse.de> (raw)
In-Reply-To: <20220512123816.24399-2-chrubis@suse.cz>

Hello,

"Cyril Hrubis" <chrubis@suse.cz> writes:

> This commit introduces a concept of max test runtime. In other words
> test runtime is capped at a certain value in order to make testruns more
> deterministic. Test is free to to finish before the runtime is used up,
> for example when maximal number of iterations was reached, but test must
> stop once the runtime has been used up.
>
> Testcases that run for more than a second or two must check for
> remaining runtime by regular calls to tst_remaining_runtime() and should
> exit when zero is returned.
>
> The test max runtime must be set either by the .max_iteration_runtime in
> the tst_test structure or in the test setup by a call to
> tst_set_runtime().
>
> The test timeout is then computed as a sum of DEFAULT_TIMEOUT (currently
> set to 30 seconds) and the test runtime. The DEFAULT_TIMEOUT is nothing
> more than a safety margin for teardown of the test.
>
> This commit also maps the -I parameter to the test max runtime if
> available and introduces LTP_RUNTIME_MUL enviroment variable so that we
> have an easy controll over the runtime cap.
>
> Lastly but not least the function related to the timeout are turned into
> no-op by this commit and removed after all test are converted to the
> runtime API.
>
> Signed-off-by: Cyril Hrubis <chrubis@suse.cz>

Reviewed-by: Richard Palethorpe <rpalethorpe@suse.com>

-- 
Thank you,
Richard.

-- 
Mailing list info: https://lists.linux.it/listinfo/ltp

  parent reply	other threads:[~2022-05-24  9:26 UTC|newest]

Thread overview: 61+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2022-05-12 12:37 [LTP] [PATCH v3 00/29] Introduce runtime and conver tests Cyril Hrubis
2022-05-12 12:37 ` [LTP] [PATCH v3 01/29] Introduce a concept of max runtime Cyril Hrubis
2022-05-14  4:21   ` Li Wang
2022-05-24  9:25   ` Richard Palethorpe [this message]
2022-05-12 12:37 ` [LTP] [PATCH v3 02/29] mtest06/mmap1: Convert to runtime Cyril Hrubis
2022-05-12 12:37 ` [LTP] [PATCH v3 03/29] mtest06/mmap3: " Cyril Hrubis
2022-05-12 12:37 ` [LTP] [PATCH v3 04/29] mtest01/mtest01: " Cyril Hrubis
2022-05-12 12:37 ` [LTP] [PATCH v3 05/29] cve/cve-2015-3290: " Cyril Hrubis
2022-05-12 12:37 ` [LTP] [PATCH v3 06/29] crypto/af_alg02: " Cyril Hrubis
2022-05-12 12:37 ` [LTP] [PATCH v3 07/29] crypto/pcrypt_aead01: " Cyril Hrubis
2022-05-12 12:37 ` [LTP] [PATCH v3 08/29] syscalls/clock_gettime01: Remove useless timeout Cyril Hrubis
2022-05-12 12:37 ` [LTP] [PATCH v3 09/29] syscalls/fanotify22: " Cyril Hrubis
2022-05-12 12:37 ` [LTP] [PATCH v3 10/29] syscalls/gettimeofday02: Convert to runtime Cyril Hrubis
2022-05-12 12:37 ` [LTP] [PATCH v3 11/29] syscalls/inotify06: " Cyril Hrubis
2022-05-12 12:37 ` [LTP] [PATCH v3 12/29] syscalls/inotify01: Remove now useless timeout Cyril Hrubis
2022-05-12 12:38 ` [LTP] [PATCH v3 13/29] syscalls/perf_event_open03: Convert to runtime Cyril Hrubis
2022-05-12 12:38 ` [LTP] [PATCH v3 14/29] syscalls/readv01: Remove now useless timeout Cyril Hrubis
2022-05-12 12:38 ` [LTP] [PATCH v3 15/29] syscalls/tgkill03: Remove now unused timeout Cyril Hrubis
2022-05-12 12:38 ` [LTP] [PATCH v3 16/29] syscalls/setsockopt09: Remove now useless timeout Cyril Hrubis
2022-05-12 12:38 ` [LTP] [PATCH v3 17/29] syscalls/userfaultfd01: " Cyril Hrubis
2022-05-12 12:38 ` [LTP] [PATCH v3 18/29] syscalls/move_pages12: Convert to runtime Cyril Hrubis
2022-05-12 12:38 ` [LTP] [PATCH v3 19/29] syscalls/rt_sigqueueinfo01: Remove now useless timeout Cyril Hrubis
2022-05-12 12:38 ` [LTP] [PATCH v3 20/29] mem/mallocstress: Convert to runtime Cyril Hrubis
2022-05-12 12:38 ` [LTP] [PATCH v3 21/29] mem/{oom, min_free_kbytes}: " Cyril Hrubis
2022-05-12 12:38 ` [LTP] [PATCH v3 22/29] fuzzy_sync: " Cyril Hrubis
2022-05-13  9:13   ` Li Wang
2022-05-13 12:20     ` Cyril Hrubis
2022-05-13 13:08       ` Li Wang
2022-05-13 14:22         ` Cyril Hrubis
2022-05-14  2:59           ` Li Wang
2022-05-16  7:52           ` Richard Palethorpe
2022-05-17 10:56             ` Cyril Hrubis
2022-05-17 11:07               ` [LTP] [Automated-testing] " Petr Vorel
2022-05-17 12:28               ` [LTP] " Li Wang
2022-05-18  7:47                 ` Li Wang
2022-05-19  9:05                   ` Cyril Hrubis
2022-05-19 10:02                     ` Li Wang
2022-05-19 10:27                       ` Cyril Hrubis
2022-05-19 10:29                         ` Li Wang
2022-05-19 12:01                           ` Cyril Hrubis
2022-05-24  9:24                             ` Richard Palethorpe
2022-05-12 12:38 ` [LTP] [PATCH v3 23/29] ltp-aiodio/dio_sparse, aiodio_sparse: " Cyril Hrubis
2022-05-12 12:38 ` [LTP] [PATCH v3 24/29] ltp-aiodio/read_checkzero: Remove Cyril Hrubis
2022-05-12 12:38 ` [LTP] [PATCH v3 25/29] ltp-aiodio/dio_{truncate, append}: Convert to runtime Cyril Hrubis
2022-05-12 12:38 ` [LTP] [PATCH v3 26/29] ltp-aiodio/dio_read: " Cyril Hrubis
2022-05-24  8:36   ` Petr Vorel
2022-05-12 12:38 ` [LTP] [PATCH v3 27/29] timer_test: " Cyril Hrubis
2022-05-12 12:38 ` [LTP] [PATCH v3 28/29] ltp-aiodio/aiodio_append: " Cyril Hrubis
2022-05-12 12:38 ` [LTP] [PATCH v3 29/29] tst_test: Remove timeout stubs Cyril Hrubis
2022-05-20  8:36 ` [LTP] [PATCH 0/2] two follow up fix for Introduce-of-max-runtime Li Wang
2022-05-20  8:36   ` [LTP] [PATCH 1/2] testcases: make use of runtime Li Wang
2022-05-20 11:03     ` Cyril Hrubis
2022-05-20 11:15       ` Li Wang
2022-05-20  8:36   ` [LTP] [PATCH 2/2] mmap3: reset runtime to 10s Li Wang
2022-05-20 11:05     ` Cyril Hrubis
2022-05-20 11:24       ` Li Wang
2022-05-20 12:18   ` [LTP] [PATCH 0/2] two follow up fix for Introduce-of-max-runtime Cyril Hrubis
2022-05-20 12:51     ` Li Wang
2022-05-20 12:55       ` Petr Vorel
2022-05-24  8:39 ` [LTP] [PATCH v3 00/29] Introduce runtime and conver tests Petr Vorel
2022-05-24  8:41 ` Petr Vorel

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=87zgj7qo2c.fsf@suse.de \
    --to=rpalethorpe@suse.de \
    --cc=automated-testing@lists.yoctoproject.org \
    --cc=chrubis@suse.cz \
    --cc=ltp@lists.linux.it \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox