xen-devel.lists.xenproject.org archive mirror
 help / color / mirror / Atom feed
From: Anthony PERARD <anthony.perard@citrix.com>
To: Ian Jackson <ian.jackson@eu.citrix.com>
Cc: xen-devel@lists.xenproject.org
Subject: Re: [OSSTEST PATCH v11 16/20] ts-openstack-tempest: Update list of skipped tests
Date: Wed, 5 Jul 2017 15:33:51 +0100	[thread overview]
Message-ID: <20170705143351.GA1609@perard.uk.xensource.com> (raw)
In-Reply-To: <20170630175843.GJ1598@perard.uk.xensource.com>

On Fri, Jun 30, 2017 at 06:58:43PM +0100, Anthony PERARD wrote:
> On Fri, Jun 30, 2017 at 05:32:56PM +0100, Ian Jackson wrote:
> > Anthony PERARD writes ("Re: [OSSTEST PATCH v11 16/20] ts-openstack-tempest: Update list of skipped tests"):
> > > But it can be told to print subunit v2, which can be pipped to a different
> > > program to transform into want we want, including simple cvs, subunit v1, and
> > > other.
> > > 
> > > I thing we could try to parse subunit v1, grab the start and finish time
> > > of a test, the result, and the output of the tests. And have all that as
> > > subunit. During my manual tests, `tempest run --subunit ... | subunit-2to1`
> > > only print the stuff about a tests once it is finish, so I guess we'll
> > > have to rewrite substep_start() (or another function) to take time as
> > > parameter.
> > 
> > That sounds quite good really.
> > 
> > I guess you don't want to write a parser for subunit v2 but if there
> > is one in Perl already in some package in Debian we could use it.  Or
> > subunit-2to1 is fine.
> 
> There is one, libsubunit-perl, but its only for subunit v1 :-(. So I
> guess I'll use both, the package and subunit-2to1.

:( the package does not work with the output of `Tempest | subunit-2to1`
there are a few things that are not parsed properly.

That the parser:
https://github.com/testing-cabal/subunit/blob/master/perl/lib/Subunit.pm

I'm kind of tempted to write one that's will be easier to integrate with
Osstest, especially because subunit v1 is simple enough.

-- 
Anthony PERARD

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

  reply	other threads:[~2017-07-05 14:33 UTC|newest]

Thread overview: 58+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2017-06-16 17:56 [OSSTEST PATCH v11 00/20] Have OpenStack tested on top of xen's master and libvirt's master Anthony PERARD
2017-06-16 17:56 ` [OSSTEST PATCH v11 01/20] ts-openstack-deploy: Deploy OpenStack on a host with devstack Anthony PERARD
2017-06-16 17:56 ` [OSSTEST PATCH v11 02/20] ts-openstack-tempest: Run Tempest to check OpenStack Anthony PERARD
2017-06-16 17:56 ` [OSSTEST PATCH v11 03/20] Create a flight to test OpenStack with xen-unstable and libvirt Anthony PERARD
2017-06-16 17:56 ` [OSSTEST PATCH v11 04/20] ts-openstack-deploy: Set http proxy Anthony PERARD
2017-06-16 17:56 ` [OSSTEST PATCH v11 05/20] TestSupport: provide target_https_mitm_proxy_cert_path Anthony PERARD
2017-06-16 17:56 ` [OSSTEST PATCH v11 06/20] ts-openstack-deploy: set CURL_CA_BUNDLE Anthony PERARD
2017-06-16 17:56 ` [OSSTEST PATCH v11 07/20] ts-openstack-deploy: Keep CURL_CA_BUNDLE when sudo is called Anthony PERARD
2017-06-23 13:37   ` Ian Jackson
2017-06-16 17:56 ` [OSSTEST PATCH v11 08/20] ts-openstack-deploy: Try to disable use of SYSTEMD Anthony PERARD
2017-06-23 13:38   ` Ian Jackson
2017-06-16 17:56 ` [OSSTEST PATCH v11 09/20] ts-kernel-build: Enable network related modules for Neutron Anthony PERARD
2017-06-23 13:39   ` Ian Jackson
2017-06-16 17:56 ` [OSSTEST PATCH v11 10/20] ts-openstack-deploy: Switch to Neutron for network Anthony PERARD
2017-06-23 13:41   ` Ian Jackson
2017-06-23 14:10     ` Anthony PERARD
2017-06-23 14:18       ` Ian Jackson
2017-06-16 17:56 ` [OSSTEST PATCH v11 11/20] ts-openstack-deploy: Increase fd and memory limits for rabbitmq Anthony PERARD
2017-06-23 13:41   ` Ian Jackson
2017-06-23 14:35     ` Anthony PERARD
2017-06-23 15:34       ` Ian Jackson
2017-06-23 16:50         ` Anthony PERARD
2017-06-23 17:16           ` Ian Jackson
2017-06-16 17:56 ` [OSSTEST PATCH v11 12/20] make-flight: Increase dom0_mem for openstack flight Anthony PERARD
2017-06-23 13:42   ` Ian Jackson
2017-06-23 14:40     ` Anthony PERARD
2017-06-23 15:35       ` Ian Jackson
2017-06-16 17:56 ` [OSSTEST PATCH v11 13/20] ts-openstack-deploy: Apply a Tempest patch Anthony PERARD
2017-06-23 13:43   ` Ian Jackson
2017-06-16 17:56 ` [OSSTEST PATCH v11 14/20] ts-openstack-deploy: Ignore libvirt-python version and use latest Anthony PERARD
2017-06-23 13:44   ` Ian Jackson
2017-06-16 17:56 ` [OSSTEST PATCH v11 15/20] ts-openstack-tempest: Fix tempest invocation Anthony PERARD
2017-06-23 13:45   ` Ian Jackson
2017-06-23 14:49     ` Anthony PERARD
2017-06-16 17:57 ` [OSSTEST PATCH v11 16/20] ts-openstack-tempest: Update list of skipped tests Anthony PERARD
2017-06-23 13:47   ` Ian Jackson
2017-06-23 15:16     ` Anthony PERARD
2017-06-23 15:38       ` Ian Jackson
2017-06-30 16:11         ` Anthony PERARD
2017-06-30 16:32           ` Ian Jackson
2017-06-30 17:58             ` Anthony PERARD
2017-07-05 14:33               ` Anthony PERARD [this message]
2017-06-16 17:57 ` [OSSTEST PATCH v11 17/20] ts-openstack-deploy: Move logs to /var/log/openstack Anthony PERARD
2017-06-23 13:48   ` Ian Jackson
2017-06-16 17:57 ` [OSSTEST PATCH v11 18/20] ts-logs-capture: Capture OpenStack logs Anthony PERARD
2017-06-23 13:49   ` Ian Jackson
2017-06-23 15:31     ` Anthony PERARD
2017-06-23 15:42       ` Ian Jackson
2017-06-16 17:57 ` [OSSTEST PATCH v11 19/20] ts-openstack-deploy: Increase devstack timeout Anthony PERARD
2017-06-23 13:49   ` Ian Jackson
2017-06-16 17:57 ` [OSSTEST PATCH v11 20/20] Introduce flight for stable branches of OpenStack Anthony PERARD
2017-06-23 13:58   ` Ian Jackson
2017-06-23 16:26     ` Anthony PERARD
2017-06-23 16:47       ` Ian Jackson
2017-06-23 17:00   ` Ian Jackson
2017-06-30 16:51     ` Anthony PERARD
2017-07-03 11:00       ` Ian Jackson
2017-06-19 11:02 ` [OSSTEST PATCH v11 00/20] Have OpenStack tested on top of xen's master and libvirt's master Anthony PERARD

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20170705143351.GA1609@perard.uk.xensource.com \
    --to=anthony.perard@citrix.com \
    --cc=ian.jackson@eu.citrix.com \
    --cc=xen-devel@lists.xenproject.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).