From: Luis Chamberlain <mcgrof@kernel.org>
To: Chuck Lever <cel@kernel.org>, Daniel Gomez <da.gomez@kruces.com>,
kdevops@lists.linux.dev
Cc: Luis Chamberlain <mcgrof@kernel.org>
Subject: [PATCH 0/2] mmtests-compare and minor fix
Date: Mon, 11 Aug 2025 17:42:49 -0700 [thread overview]
Message-ID: <20250812004252.2256571-1-mcgrof@kernel.org> (raw)
While running mmtests I realized the html graphs were not being
generaed. So kick that off and also try to enhance graphing. We can
fine tune this later with time. The goal is to easily be able to do AB
testing with mmtests against different kernels.
Also a small fix for gen_hosts is provided due to a patch from Daniel
which forgot to update the kdevops_hosts in that file.
Luis Chamberlain (2):
gen_hosts: fix inventory path for dedicated mmtests workflow
mmtests: add AB testing and comparison support
.gitignore | 2 +
defconfigs/mmtests-ab-testing | 22 +
defconfigs/mmtests-ab-testing-thpcompact | 31 +
playbooks/mmtests-compare.yml | 5 +
playbooks/mmtests.yml | 2 +-
playbooks/roles/gen_hosts/tasks/main.yml | 2 +-
.../roles/gen_hosts/templates/mmtests.j2 | 10 +
playbooks/roles/mmtests/tasks/main.yaml | 58 +-
.../roles/mmtests_compare/defaults/main.yml | 6 +
.../mmtests_compare/files/apply_patch.sh | 32 +
.../files/embed_graphs_in_html.sh | 100 +++
.../mmtests_compare/files/generate_graphs.sh | 148 +++++
.../files/generate_html_with_graphs.sh | 89 +++
.../mmtests_compare/files/run_comparison.sh | 58 ++
.../roles/mmtests_compare/tasks/main.yml | 472 ++++++++++++++
.../templates/comparison_report.html.j2 | 414 ++++++++++++
scripts/generate_mmtests_graphs.py | 598 ++++++++++++++++++
workflows/mmtests/Makefile | 19 +-
...fined-array-reference-when-no-operat.patch | 46 ++
...act-fix-library-order-in-gcc-command.patch | 33 +
20 files changed, 2139 insertions(+), 8 deletions(-)
create mode 100644 defconfigs/mmtests-ab-testing
create mode 100644 defconfigs/mmtests-ab-testing-thpcompact
create mode 100644 playbooks/mmtests-compare.yml
create mode 100644 playbooks/roles/mmtests_compare/defaults/main.yml
create mode 100755 playbooks/roles/mmtests_compare/files/apply_patch.sh
create mode 100755 playbooks/roles/mmtests_compare/files/embed_graphs_in_html.sh
create mode 100755 playbooks/roles/mmtests_compare/files/generate_graphs.sh
create mode 100755 playbooks/roles/mmtests_compare/files/generate_html_with_graphs.sh
create mode 100755 playbooks/roles/mmtests_compare/files/run_comparison.sh
create mode 100644 playbooks/roles/mmtests_compare/tasks/main.yml
create mode 100644 playbooks/roles/mmtests_compare/templates/comparison_report.html.j2
create mode 100644 scripts/generate_mmtests_graphs.py
create mode 100644 workflows/mmtests/fixes/0001-compare-Fix-undefined-array-reference-when-no-operat.patch
create mode 100644 workflows/mmtests/fixes/0002-thpcompact-fix-library-order-in-gcc-command.patch
--
2.47.2
next reply other threads:[~2025-08-12 0:42 UTC|newest]
Thread overview: 5+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-08-12 0:42 Luis Chamberlain [this message]
2025-08-12 0:42 ` [PATCH 1/2] gen_hosts: fix inventory path for dedicated mmtests workflow Luis Chamberlain
2025-08-13 12:40 ` Daniel Gomez
2025-08-14 0:48 ` Luis Chamberlain
2025-08-12 0:42 ` [PATCH 2/2] mmtests: add AB testing and comparison support Luis Chamberlain
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20250812004252.2256571-1-mcgrof@kernel.org \
--to=mcgrof@kernel.org \
--cc=cel@kernel.org \
--cc=da.gomez@kruces.com \
--cc=kdevops@lists.linux.dev \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox