public inbox for openembedded-core@lists.openembedded.org
 help / color / mirror / Atom feed
From: Richard Purdie <richard.purdie@linuxfoundation.org>
To: daniel.turull@ericsson.com, openembedded-core@lists.openembedded.org
Cc: bruce.ashfield@gmail.com, alex.kanavin@gmail.com,
	pratik.farkase@est.tech
Subject: Re: [PATCH v2 6/6] oeqa: ltp - add LTP_WORKERS to allow parallelization
Date: Fri, 27 Mar 2026 15:37:23 +0000	[thread overview]
Message-ID: <ed22500800950b87d26983346d7b3106c41257db.camel@linuxfoundation.org> (raw)
In-Reply-To: <20260327122758.1851989-6-daniel.turull@ericsson.com>

On Fri, 2026-03-27 at 13:27 +0100, daniel.turull@ericsson.com wrote:
> From: Daniel Turull <daniel.turull@ericsson.com>
> 
> Add new configurable variable to execute multiple workers in parallel.
> kirk adds the option that was not available in runltp.
> 
> Tested in qemux86-64 with configuration:
> 
> IMAGE_CLASSES += "testimage"
> CORE_IMAGE_EXTRA_INSTALL += "ltp openssh"
> TEST_SUITES = "ping ssh ltp"
> QB_MEM = "32768"
> QB_CPU_KVM = "-cpu host -smp 16"
> QB_SMP = "-smp 16"
> LTP_WORKERS = "16"
> IMAGE_ROOTFS_EXTRA_SPACE = "2097152"
> 
> bitbake core-image-minimal
> bitbake core-image-minimal -c testimage
> 
> Signed-off-by: Daniel Turull <daniel.turull@ericsson.com>
> ---
>  meta/lib/oeqa/runtime/cases/ltp.py | 4 +++-
>  1 file changed, 3 insertions(+), 1 deletion(-)

Thanks for looking at this, it is interesting it now has the
parallelism support. I'll probably hold off this initially just so that
we can transition successfully but it then makes sense to tweak things.

I checked yocto-autobuilder-helper's config.json for the config we use
on the autobuilder and it is:

"IMAGE_INSTALL:append = ' ltp'",
"TEST_SUITES = 'ping ssh ltp ltp_compliance'",
"IMAGE_OVERHEAD_FACTOR = '1.0'",
"IMAGE_ROOTFS_EXTRA_SPACE = '1324288'",
"QB_MEM:forcevariable = '-m 1024'"

so we're running with a lot less memory than you configured but you
also have a lot more threads!

> diff --git a/meta/lib/oeqa/runtime/cases/ltp.py b/meta/lib/oeqa/runtime/cases/ltp.py
> index b855e76907..ae6a275110 100644
> --- a/meta/lib/oeqa/runtime/cases/ltp.py
> +++ b/meta/lib/oeqa/runtime/cases/ltp.py
> @@ -68,7 +68,9 @@ class LtpTest(LtpTestBase):
>              # LTP appends to log files, so ensure we start with a clean log
>              self.target.deleteFiles("/opt/ltp/results/", "%s.json" % ltp_group)
>  
> -            cmd = 'kirk --run-suite %s --json-report /opt/ltp/results/%s.json -n -d /opt/ltp --exec-timeout 20m' % (ltp_group, ltp_group)
> +            # LTP_WORKERS: number of parallel test workers (default: 1)
> +            workers = self.td.get('LTP_WORKERS', '1')
> +            cmd = 'kirk --run-suite %s --json-report /opt/ltp/results/%s.json -n -d /opt/ltp --exec-timeout 20m --workers %s' % (ltp_group, ltp_group, workers)

We probably need to namespace the variable a little more, such as 
OEQA_LTP_WORKERS so that people have a hint on where it is used.

Cheers,

Richard



  reply	other threads:[~2026-03-27 15:37 UTC|newest]

Thread overview: 8+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-03-27 12:27 [PATCH v2 1/6] python3-kirk: Add version 4.0.0 daniel.turull
2026-03-27 12:27 ` [PATCH v2 2/6] ltp: disable min_free_kbytes daniel.turull
2026-03-27 12:27 ` [PATCH v2 3/6] ltp: disable pty testcase daniel.turull
2026-03-27 12:27 ` [PATCH v2 4/6] ltp: disable cve failing testcases daniel.turull
2026-03-27 12:27 ` [PATCH v2 5/6] oeqa: replace runltp with kirk daniel.turull
2026-03-27 12:27 ` [PATCH v2 6/6] oeqa: ltp - add LTP_WORKERS to allow parallelization daniel.turull
2026-03-27 15:37   ` Richard Purdie [this message]
2026-03-27 15:41     ` Daniel Turull

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=ed22500800950b87d26983346d7b3106c41257db.camel@linuxfoundation.org \
    --to=richard.purdie@linuxfoundation.org \
    --cc=alex.kanavin@gmail.com \
    --cc=bruce.ashfield@gmail.com \
    --cc=daniel.turull@ericsson.com \
    --cc=openembedded-core@lists.openembedded.org \
    --cc=pratik.farkase@est.tech \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox