All of lore.kernel.org
 help / color / mirror / Atom feed
From: Joshua Lock <joshua.g.lock@linux.intel.com>
To: openembedded-core@lists.openembedded.org
Subject: Re: [PATCH 2/9] selftest: skip two bbtest tests depending on distro
Date: Mon, 17 Oct 2016 08:08:52 +0100	[thread overview]
Message-ID: <1476688132.2604.8.camel@linux.intel.com> (raw)
In-Reply-To: <88ed2fc1a30df53f6c94192966c00c5c41de3869.1476462963.git.leonardo.sandoval.gonzalez@linux.intel.com>

On Fri, 2016-10-14 at 11:40 -0500,
leonardo.sandoval.gonzalez@linux.intel.com wrote:
> From: Leonardo Sandoval <leonardo.sandoval.gonzalez@linux.intel.com>
> 
> There are two bbtests that just makes sense on certain distros:
> test_bitbake_g cannot be done on poky-tiny and test_non_gplv3
> just makes sense on poky and poky-tiny. Skip these when
> necessary under the latter conditions.
> 
> [YOCTO #8525]
> 
> Signed-off-by: Leonardo Sandoval <leonardo.sandoval.gonzalez@linux.in
> tel.com>
> ---
>  meta/lib/oeqa/selftest/bbtests.py | 7 +++++++
>  1 file changed, 7 insertions(+)
> 
> diff --git a/meta/lib/oeqa/selftest/bbtests.py
> b/meta/lib/oeqa/selftest/bbtests.py
> index baae1e0..9b11cd9 100644
> --- a/meta/lib/oeqa/selftest/bbtests.py
> +++ b/meta/lib/oeqa/selftest/bbtests.py
> @@ -114,6 +114,9 @@ class BitbakeTests(oeSelfTest):
>  
>      @testcase(167)
>      def test_bitbake_g(self):
> +        if self.distro == 'poky-tiny':
> +            self.skipTest('core-image-full-cmdline is not buildable
> with poky-tiny')
> +

This test is still valid for poky-tiny, it's just that the image the
test builds isn't buildable with poky-tiny, right?

I think it would be better to change the test to a different, smaller,
image that can also be built for poky-tiny (core-image-minimal?). 
We'd also need to change the target the test checks for the presence of
in pn-buildlist.

Regards,

Joshua

>          result = bitbake('-g core-image-full-cmdline')
>          for f in ['pn-buildlist', 'pn-depends.dot', 'package-
> depends.dot', 'task-depends.dot']:
>              self.addCleanup(os.remove, f)
> @@ -229,6 +232,10 @@ INHERIT_remove = \"report-error\"
>  
>      @testcase(1119)
>      def test_non_gplv3(self):
> +        supported_distros = ['poky', 'poky-tiny']
> +        if not self.distro in supported_distros:
> +            self.skipTest('Test considers only %s distros' %
> ','.join(supported_distros))
> +
>          data = 'INCOMPATIBLE_LICENSE = "GPLv3"'
>          conf = os.path.join(self.builddir, 'conf/local.conf')
>          ftools.append_file(conf ,data)
> -- 
> 2.1.4
> 


  reply	other threads:[~2016-10-17  7:09 UTC|newest]

Thread overview: 42+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2016-10-14 16:40 [PATCH 0/9] Support supported distros on selftest leonardo.sandoval.gonzalez
2016-10-14 16:40 ` [PATCH 1/9] selftest: set correct linux-yocto recipe when distro is poky-tiny leonardo.sandoval.gonzalez
2016-10-17 11:30   ` Burton, Ross
2016-10-17 14:34     ` Leonardo Sandoval
2016-10-14 16:40 ` [PATCH 2/9] selftest: skip two bbtest tests depending on distro leonardo.sandoval.gonzalez
2016-10-17  7:08   ` Joshua Lock [this message]
2016-10-17 16:04     ` Leonardo Sandoval
2016-10-18 16:38       ` Joshua Lock
2016-10-14 16:40 ` [PATCH 3/9] selftest: skip test_read_only_image on poky-tiny distro leonardo.sandoval.gonzalez
2016-10-17 11:48   ` Burton, Ross
2016-10-17 15:00     ` Leonardo Sandoval
2016-10-14 16:40 ` [PATCH 4/9] selftest: skip some devtool tests when distro is poky-tiny due to missing libx11 leonardo.sandoval.gonzalez
2016-10-17 11:42   ` Burton, Ross
2016-10-17 15:19     ` Leonardo Sandoval
2016-10-18 16:39       ` Joshua Lock
2016-10-14 16:40 ` [PATCH 5/9] selftest: skip those imagefeatures tests not relevant for certain distros leonardo.sandoval.gonzalez
2016-10-17 11:44   ` Burton, Ross
2016-10-14 16:40 ` [PATCH 6/9] selftest: skip test_recipetool_create_git on poky-tiny distro leonardo.sandoval.gonzalez
2016-10-17 11:43   ` Burton, Ross
2016-10-14 16:40 ` [PATCH 7/9] selftest: skip runtime-test's test_testimage_install " leonardo.sandoval.gonzalez
2016-10-17  7:09   ` Joshua Lock
2016-10-17 16:02     ` Leonardo Sandoval
2016-10-18 16:40       ` Joshua Lock
2016-10-14 16:40 ` [PATCH 8/9] selftest: skip sstatetests methods considering distro and its features leonardo.sandoval.gonzalez
2016-10-14 16:40 ` [PATCH 9/9] selftest: skip wic test methods for poky-tiny distro leonardo.sandoval.gonzalez
2016-11-24 20:55 ` [PATCH v2 00/13] Skip selftests depending on distro and its features leonardo.sandoval.gonzalez
2016-11-24 20:58   ` [PATCH v2 01/13] selftest: base: new object member to store the DISTRO value leonardo.sandoval.gonzalez
2016-11-24 20:58   ` [PATCH v2 02/13] selftest: bbtests: use minimal image so all distros can execute it leonardo.sandoval.gonzalez
2016-11-24 20:58   ` [PATCH v2 03/13] selftest: bbtests: run non-gplv3 test only on relevant distros leonardo.sandoval.gonzalez
2016-11-24 20:58   ` [PATCH v2 04/13] selftest: buildoptions: skip read-only-image test depending on distro leonardo.sandoval.gonzalez
2016-11-24 20:58   ` [PATCH v2 05/13] selftest: buildoptions: skip test in case features are missing leonardo.sandoval.gonzalez
2016-11-24 20:58   ` [PATCH v2 06/13] selftest: devtool: use mraa instead of libmatchbox to lessen distro requirements leonardo.sandoval.gonzalez
2016-11-24 20:58   ` [PATCH v2 07/13] selftest: imagefeatures: skip tests in case distro feature is missing leonardo.sandoval.gonzalez
2016-12-13 15:05     ` Burton, Ross
2016-11-24 20:58   ` [PATCH v2 08/13] selftest: imagefeatures: skip bmap test in case of poky-tiny leonardo.sandoval.gonzalez
2016-11-24 20:58   ` [PATCH v2 09/13] selftest: recipetool: use mraa instead of libmatchbox to lessen distro requirements leonardo.sandoval.gonzalez
2016-11-24 20:58   ` [PATCH v2 10/13] selftest: runtime-test: skip image-install test for poky-tiny leonardo.sandoval.gonzalez
2016-11-24 20:58   ` [PATCH v2 11/13] selftest: sstatetests: skip methods in case of poky-tiny or opengl is missing leonardo.sandoval.gonzalez
2016-12-13 15:25     ` Burton, Ross
2016-12-15 20:21       ` Leonardo Sandoval
2016-11-24 20:58   ` [PATCH v2 12/13] selftest: wic: skip tests for poky-tiny distro policy leonardo.sandoval.gonzalez
2016-11-24 20:58   ` [PATCH v2 13/13] selftest: bblayers: remove linux kernel checks for show-recipes check leonardo.sandoval.gonzalez

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1476688132.2604.8.camel@linux.intel.com \
    --to=joshua.g.lock@linux.intel.com \
    --cc=openembedded-core@lists.openembedded.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.