Openembedded Core Discussions
 help / color / mirror / Atom feed
From: "Eilís 'pidge' Ní Fhlannagáin" <pidge@baylibre.com>
To: openembedded-core@lists.openembedded.org
Cc: "Eilís 'pidge' Ní Fhlannagáin" <pidge@baylibre.com>
Subject: [PATCHv2 0/4] Proof of concept for screenshot testcases
Date: Wed, 13 Dec 2023 20:30:11 +0000	[thread overview]
Message-ID: <cover.1702499299.git.pidge@baylibre.com> (raw)

This takes the work rburton did on image screenshot testing and
expands it.

Right now this only works for qemux86-64. Some standardization
of screensize/resolution needs to happen with runqemu params for other
machines. There is an issue in qemux86-64 (and possibly others) where
the screenswitch icon is only half present. This causes the test to
fail.

This test takes a screendump of a qemu image (for now, just
core-image-sato for qemux86-64), and compares it to an image we
have on record. Some normalisation of the different qemu configs
need to happen to be able to support all machines. Example, the
qemuarm64 screen size is much larger than the qemux86-64.

The image we have on record contains a blanked out clock. We do
the same blanking out process for the screenshot, so the images should
have zero differences. If they do, we fail.

In order to enable this test, you will need meta-openembedded/meta-oe in
your bblayers.conf and the following in local.conf:

IMAGE_CLASSES += "testimage"
TEST_SUITES = "login"
IMAGE_INSTALL:append = " python3-qemu-qmp "
TESTIMAGEDEPENDS:append:qemuall = " imagemagick-native:do_populate_sysroot "

Eilís 'pidge' Ní Fhlannagáin (1):
  login.py: Proof of concept for screenshot testcases

Ross Burton (3):
  qemurunner: remove unused import
  python3-qemu-qmp: Add recipe
  runqemu: add qmp socket support

 .../core-image-sato-qemux86-64.png            | Bin 0 -> 46986 bytes
 meta/lib/oeqa/runtime/cases/login.py          |  34 ++++++++++++++++++
 meta/lib/oeqa/utils/qemurunner.py             |   1 -
 .../python/python3-qemu-qmp_0.0.2.bb          |  14 ++++++++
 scripts/runqemu                               |  11 ++++++
 5 files changed, 59 insertions(+), 1 deletion(-)
 create mode 100644 meta/files/image-tests/core-image-sato-qemux86-64.png
 create mode 100644 meta/lib/oeqa/runtime/cases/login.py
 create mode 100644 meta/recipes-devtools/python/python3-qemu-qmp_0.0.2.bb

-- 
2.34.1



             reply	other threads:[~2023-12-13 20:30 UTC|newest]

Thread overview: 11+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2023-12-13 20:30 Eilís 'pidge' Ní Fhlannagáin [this message]
2023-12-13 20:30 ` [PATCHv2 1/4] qemurunner: remove unused import Eilís 'pidge' Ní Fhlannagáin
2023-12-13 20:30 ` [PATCHv2 2/4] python3-qemu-qmp: Add recipe Eilís 'pidge' Ní Fhlannagáin
2023-12-13 21:00   ` [OE-core] " Richard Purdie
2023-12-13 20:30 ` [PATCHv2 3/4] runqemu: add qmp socket support Eilís 'pidge' Ní Fhlannagáin
2023-12-13 20:30 ` [PATCHv2 4/4] login.py: Proof of concept for screenshot testcases Eilís 'pidge' Ní Fhlannagáin
2023-12-13 20:55   ` [OE-core] " Richard Purdie
2023-12-14 10:37     ` Ross Burton
2023-12-14 16:32     ` Eilís 'pidge' Ní Fhlannagáin
2023-12-14 17:29       ` Richard Purdie
2023-12-14 18:58         ` Eilís 'pidge' Ní Fhlannagáin

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=cover.1702499299.git.pidge@baylibre.com \
    --to=pidge@baylibre.com \
    --cc=openembedded-core@lists.openembedded.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox