xen-devel.lists.xenproject.org archive mirror
 help / color / mirror / Atom feed
* [OSSTEST PATCH RFC v2 00/14] Integrate XTF into OSSTest
@ 2016-08-08  9:22 Wei Liu
  2016-08-08  9:22 ` [OSSTEST PATCH RFC v2 01/14] ts-xen-build: always compile in FEP support Wei Liu
                   ` (13 more replies)
  0 siblings, 14 replies; 31+ messages in thread
From: Wei Liu @ 2016-08-08  9:22 UTC (permalink / raw)
  To: Xen-devel; +Cc: ian.jackson, Wei Liu, andrew.cooper3

Hi all

This patch series integrates XTF into OSSTest. It still depends on
quite a few things (listed below) but I think it has gotten to point
that it can be posted for review.

It depends on having a canonical location for xtf.git. Currently this
series contains a patch to point to my own xtf.git tree.

It depends on Ian's work:

1. Add a "skip" state to OSSTest.
2. Add diverse flag.

To make the XTf jobs reliable, we also need to:

1. Fix synchronisation issues in xenconsole related code in Xen.
2. Fix synchronisation issue in xtf-runner.

The effect of  synchronisations can be seen in [0]. Test 1 and 5
failed. I've posted patches for them ([2], [3]).

I created a dummy test case that always fails. We expect ts-xtf-run to
continue running after that. The result is at [1].

The test flight in [4] contained a hack that removed "skip" from accepcted
states, so test-pv64-xsa-167 became "never pass" (should be "skip" in normal
case). In job 4 test-pv32-pae-pv-iopl~vmassist failed due to xenconsole race.
The code correctly caused rest of the job to be skipped. The same race also
caused xtf-fep to fail in job 2, but that test won't cause the job to be
aborted anymore.
 

Wei.


[0] http://osstest.xs.citrite.net/~osstest/testlogs/logs/66910/
[1] http://osstest.xs.citrite.net/~osstest/testlogs/logs/66916/
[2] <1470418894-11358-1-git-send-email-wei.liu2@citrix.com>
[3] <1470060258-20084-1-git-send-email-wei.liu2@citrix.com>
[4] http://osstest.xs.citrite.net/~osstest/testlogs/logs/66926/

[0] and [1] are from v1 of this series, [4] is from v2 (this version).

* Currently all logs are only accessible from within Citrix. Sorry. :-/

Wei Liu (14):
  ts-xen-build: always compile in FEP support
  DO NOT APPLY ts-leak-check: sleep 5 seconds before collecting stuff
  ap-common: add xtf tree
  DO NOT APPLY point xtf to my personal tree
  BuildSupport: move buildcmd_stamped_logged here
  Introduce ts-xtf-build
  sg-run-job: create xtf build recipe
  Introduce ts-xtf-install
  mfi-common: create xtf build job for 4.8 onwards
  Introduce ts-xtf-fep
  Introduce ts-xtf-run
  sg-run-job: test-xtf recipe
  make-flight: create 5 xtf jobs
  Create XTF branch

 Osstest/BuildSupport.pm |  15 ++++++
 ap-common               |   4 ++
 ap-fetch-version        |   4 ++
 ap-print-url            |   3 ++
 ap-push                 |   5 ++
 cr-daily-branch         |   8 ++++
 cr-for-branches         |   2 +-
 cri-common              |   1 +
 make-flight             |  40 ++++++++++++++++
 mfi-common              |  29 ++++++++++++
 sg-run-job              |  15 ++++++
 ts-leak-check           |   3 ++
 ts-xen-build            |  25 ++++------
 ts-xtf-build            |  54 +++++++++++++++++++++
 ts-xtf-fep              |  37 +++++++++++++++
 ts-xtf-install          |  37 +++++++++++++++
 ts-xtf-run              | 122 ++++++++++++++++++++++++++++++++++++++++++++++++
 17 files changed, 386 insertions(+), 18 deletions(-)
 create mode 100755 ts-xtf-build
 create mode 100755 ts-xtf-fep
 create mode 100755 ts-xtf-install
 create mode 100755 ts-xtf-run

-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 31+ messages in thread

end of thread, other threads:[~2016-08-09  8:11 UTC | newest]

Thread overview: 31+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2016-08-08  9:22 [OSSTEST PATCH RFC v2 00/14] Integrate XTF into OSSTest Wei Liu
2016-08-08  9:22 ` [OSSTEST PATCH RFC v2 01/14] ts-xen-build: always compile in FEP support Wei Liu
2016-08-08 14:46   ` Ian Jackson
2016-08-08  9:22 ` [OSSTEST PATCH RFC v2 02/14] DO NOT APPLY ts-leak-check: sleep 5 seconds before collecting stuff Wei Liu
2016-08-08  9:22 ` [OSSTEST PATCH RFC v2 03/14] ap-common: add xtf tree Wei Liu
2016-08-08 14:46   ` Ian Jackson
2016-08-08  9:22 ` [OSSTEST PATCH RFC v2 04/14] DO NOT APPLY point xtf to my personal tree Wei Liu
2016-08-08  9:22 ` [OSSTEST PATCH RFC v2 05/14] BuildSupport: move buildcmd_stamped_logged here Wei Liu
2016-08-08 14:47   ` Ian Jackson
2016-08-08  9:22 ` [OSSTEST PATCH RFC v2 06/14] Introduce ts-xtf-build Wei Liu
2016-08-08 14:48   ` Ian Jackson
2016-08-08  9:22 ` [OSSTEST PATCH RFC v2 07/14] sg-run-job: create xtf build recipe Wei Liu
2016-08-08  9:22 ` [OSSTEST PATCH RFC v2 08/14] Introduce ts-xtf-install Wei Liu
2016-08-08 14:49   ` Ian Jackson
2016-08-08  9:22 ` [OSSTEST PATCH RFC v2 09/14] mfi-common: create xtf build job for 4.8 onwards Wei Liu
2016-08-08 14:51   ` Ian Jackson
2016-08-08 16:21     ` Wei Liu
2016-08-08 16:26       ` Andrew Cooper
2016-08-08 16:58         ` Wei Liu
2016-08-08  9:22 ` [OSSTEST PATCH RFC v2 10/14] Introduce ts-xtf-fep Wei Liu
2016-08-08 14:52   ` Ian Jackson
2016-08-08  9:22 ` [OSSTEST PATCH RFC v2 11/14] Introduce ts-xtf-run Wei Liu
2016-08-08 14:55   ` Ian Jackson
2016-08-09  8:11     ` Wei Liu
2016-08-08 16:29   ` Andrew Cooper
2016-08-08 16:56     ` Ian Jackson
2016-08-08  9:22 ` [OSSTEST PATCH RFC v2 12/14] sg-run-job: test-xtf recipe Wei Liu
2016-08-08 14:56   ` Ian Jackson
2016-08-08  9:22 ` [OSSTEST PATCH RFC v2 13/14] make-flight: create 5 xtf jobs Wei Liu
2016-08-08 14:56   ` Ian Jackson
2016-08-08  9:22 ` [OSSTEST PATCH RFC v2 14/14] Create XTF branch Wei Liu

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).