Re: [PATCH v2 0/4] selftest/wic: extending test coverage for WIC script options

["Jair Gonzalez" <jair.de.jesus.gonzalez.plascencia@linux.intel.com>]

> -----Original Message-----
> From: Ed Bartosh [mailto:ed.bartosh@linux.intel.com]
> Sent: Tuesday, December 20, 2016 7:07 AM
> To: Jair Gonzalez <jair.de.jesus.gonzalez.plascencia@linux.intel.com>
> Cc: openembedded-core@lists.openembedded.org
> Subject: Re: [OE-core] [PATCH v2 0/4] selftest/wic: extending test
coverage
> for WIC script options
> 
> On Mon, Dec 19, 2016 at 03:07:30PM -0600, Jair Gonzalez wrote:
> > Changed in V2:
> >
> > The original patch was splitted and updated according to the
discussion on:
> > http://lists.openembedded.org/pipermail/openembedded-core/2016-
> Decembe
> > r/130131.html
> > NOTE: The WKS_FILE entry deletion was ommitted from this patch set as
> > it was introduced on the first patch by mistake.
> >
> > The following changes since commit
> 573c646d4cc62dcd0c230381df4940bdf314d495:
> >
> >   bitbake: BBHandler: use with instead of open/close (2016-12-16
> > 10:23:24 +0000)
> >
> > are available in the git repository at:
> >
> >   git://git.yoctoproject.org/poky-contrib jairglez/wictest
> >
> > http://git.yoctoproject.org/cgit.cgi/poky-contrib/log/?h=jairglez/wict
> > est
> >
> > Jair Gonzalez (4):
> >   selftest/wic: adding Testopia ID numbers to test cases missing it
> >   selftest/wic: code cleanup
> >   selftest/wic: reorganizing test methods by functionality
> >   selftest/wic: extending test coverage for WIC script options
> >
> >  meta/lib/oeqa/selftest/wic.py | 370
> > +++++++++++++++++++++++++++---------------
> >  1 file changed, 238 insertions(+), 132 deletions(-)
> >
> 
> Thank you for the updated patchset!
> It looks good to me.
> 
> BTW, did you measure its impact on the test run time?
> 
> --
> Regards,
> Ed

Hi Ed,

Thanks. Regarding the impact, I tested it on my local machine after cleaning
the cache, sstate-cache, downloads and tmp directories, and the difference
between them was about 130 seconds after I applied my commits:
Before:
Ran 28 tests in 4446.939s
After:
Ran 39 tests in 4578.604s
Difference:
131.665s

I also tried with a source repository with existing cache and the difference
was about 70 seconds:
Before:
Ran 28 tests in 272.170s
After:
Ran 39 tests in 339.637s
Difference:
67.467s

Regards,
Jair