All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Michael S. Tsirkin" <mst@redhat.com>
To: Thomas Huth <thuth@redhat.com>
Cc: Eduardo Habkost <ehabkost@redhat.com>,
	linux-nvdimm <linux-nvdimm@lists.01.org>,
	Qemu Developers <qemu-devel@nongnu.org>,
	Stefan Hajnoczi <stefanha@redhat.com>,
	Igor Mammedov <imammedo@redhat.com>
Subject: Re: [Qemu-devel] [qemu PATCH 2/5] acpi: "make check" should fail on asl mismatch
Date: Fri, 8 Jun 2018 19:03:10 +0300	[thread overview]
Message-ID: <20180608190040-mutt-send-email-mst@kernel.org> (raw)
In-Reply-To: <5352d2fb-9244-78b0-4f4b-2818359a4425@redhat.com>

On Fri, Jun 08, 2018 at 07:17:51AM +0200, Thomas Huth wrote:
> On 08.06.2018 01:09, Michael S. Tsirkin wrote:
> > On Thu, Jun 07, 2018 at 04:31:08PM -0600, Ross Zwisler wrote:
> >> Currently if "make check" detects a mismatch in the ASL generated during
> >> testing, we print an error such as:
> >>
> >>   acpi-test: Warning! SSDT mismatch. Actual [asl:/tmp/asl-QZDWJZ.dsl,
> >>   aml:/tmp/aml-T8JYJZ], Expected [asl:/tmp/asl-DTWVJZ.dsl,
> >>   aml:tests/acpi-test-data/q35/SSDT.dimmpxm].
> >>
> >> but the testing still exits with good shell status.  This is wrong, and
> >> makes bisecting such a failure difficult.
> >>
> >> Signed-off-by: Ross Zwisler <ross.zwisler@linux.intel.com>
> > 
> > Failing would also mean that any change must update the expected files
> > at the same time.  And that in turn is problematic because expected
> > files are binary and can't be merged.
> > 
> > In other words the way we devel ACPI right now means that bisect will
> > periodically produce a diff, it's not an error.
> 
> But apparently the current way also allows that real bug go unnoticed
> for a while, until somebody accidentially spots the warning in the
> output of "make check". Wouldn't it be better to fail at CI time
> already? If a merge of the file is required, you can still resolve that
> manually (i.e. by rebasing one of the pull requests).
> 
>  Thomas

Pull requests are somewhat different, they are usually tested for lack
of warnings. This change didn't arrive as a result of a pull request
maybe that's why it slipped through the cracks. Peter?

Maybe we need a "pedantic" flag to fail on any warnings, or just catch
output to stderr.

-- 
MST
_______________________________________________
Linux-nvdimm mailing list
Linux-nvdimm@lists.01.org
https://lists.01.org/mailman/listinfo/linux-nvdimm

WARNING: multiple messages have this Message-ID (diff)
From: "Michael S. Tsirkin" <mst@redhat.com>
To: Thomas Huth <thuth@redhat.com>
Cc: Ross Zwisler <ross.zwisler@linux.intel.com>,
	Eduardo Habkost <ehabkost@redhat.com>,
	linux-nvdimm <linux-nvdimm@lists.01.org>,
	Qemu Developers <qemu-devel@nongnu.org>,
	Stefan Hajnoczi <stefanha@redhat.com>,
	Igor Mammedov <imammedo@redhat.com>,
	Dan Williams <dan.j.williams@intel.com>
Subject: Re: [Qemu-devel] [qemu PATCH 2/5] acpi: "make check" should fail on asl mismatch
Date: Fri, 8 Jun 2018 19:03:10 +0300	[thread overview]
Message-ID: <20180608190040-mutt-send-email-mst@kernel.org> (raw)
In-Reply-To: <5352d2fb-9244-78b0-4f4b-2818359a4425@redhat.com>

On Fri, Jun 08, 2018 at 07:17:51AM +0200, Thomas Huth wrote:
> On 08.06.2018 01:09, Michael S. Tsirkin wrote:
> > On Thu, Jun 07, 2018 at 04:31:08PM -0600, Ross Zwisler wrote:
> >> Currently if "make check" detects a mismatch in the ASL generated during
> >> testing, we print an error such as:
> >>
> >>   acpi-test: Warning! SSDT mismatch. Actual [asl:/tmp/asl-QZDWJZ.dsl,
> >>   aml:/tmp/aml-T8JYJZ], Expected [asl:/tmp/asl-DTWVJZ.dsl,
> >>   aml:tests/acpi-test-data/q35/SSDT.dimmpxm].
> >>
> >> but the testing still exits with good shell status.  This is wrong, and
> >> makes bisecting such a failure difficult.
> >>
> >> Signed-off-by: Ross Zwisler <ross.zwisler@linux.intel.com>
> > 
> > Failing would also mean that any change must update the expected files
> > at the same time.  And that in turn is problematic because expected
> > files are binary and can't be merged.
> > 
> > In other words the way we devel ACPI right now means that bisect will
> > periodically produce a diff, it's not an error.
> 
> But apparently the current way also allows that real bug go unnoticed
> for a while, until somebody accidentially spots the warning in the
> output of "make check". Wouldn't it be better to fail at CI time
> already? If a merge of the file is required, you can still resolve that
> manually (i.e. by rebasing one of the pull requests).
> 
>  Thomas

Pull requests are somewhat different, they are usually tested for lack
of warnings. This change didn't arrive as a result of a pull request
maybe that's why it slipped through the cracks. Peter?

Maybe we need a "pedantic" flag to fail on any warnings, or just catch
output to stderr.

-- 
MST

  parent reply	other threads:[~2018-06-08 16:03 UTC|newest]

Thread overview: 56+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2018-06-07 22:31 [qemu PATCH 1/5] gitignore: ignore generated qapi job files Ross Zwisler
2018-06-07 22:31 ` [Qemu-devel] " Ross Zwisler
2018-06-07 22:31 ` [qemu PATCH 2/5] acpi: "make check" should fail on asl mismatch Ross Zwisler
2018-06-07 22:31   ` [Qemu-devel] " Ross Zwisler
2018-06-07 23:09   ` Michael S. Tsirkin
2018-06-07 23:09     ` [Qemu-devel] " Michael S. Tsirkin
2018-06-08  5:17     ` Thomas Huth
2018-06-08  5:17       ` Thomas Huth
2018-06-08 15:34       ` Ross Zwisler
2018-06-08 15:34         ` Ross Zwisler
2018-06-08 15:59         ` Michael S. Tsirkin
2018-06-08 15:59           ` Michael S. Tsirkin
2018-06-08 16:14           ` Peter Maydell
2018-06-08 16:14             ` Peter Maydell
2018-06-08 16:21             ` Michael S. Tsirkin
2018-06-08 16:21               ` Michael S. Tsirkin
2018-06-08 16:03       ` Michael S. Tsirkin [this message]
2018-06-08 16:03         ` Michael S. Tsirkin
2018-06-08 16:16         ` Peter Maydell
2018-06-08 16:16           ` Peter Maydell
2018-06-08 16:24           ` Michael S. Tsirkin
2018-06-08 16:24             ` Michael S. Tsirkin
2018-06-08 17:23             ` Thomas Huth
2018-06-08 17:23               ` Thomas Huth
2018-06-08 18:41               ` Michael S. Tsirkin
2018-06-08 18:41                 ` Michael S. Tsirkin
2018-06-08 19:56                 ` Thomas Huth
2018-06-08 19:56                   ` Thomas Huth
2018-06-07 22:31 ` [qemu PATCH 3/5] hw/i386: Update SSDT table used by "make check" Ross Zwisler
2018-06-07 22:31   ` [Qemu-devel] " Ross Zwisler
2018-06-07 23:14   ` Michael S. Tsirkin
2018-06-07 23:14     ` [Qemu-devel] " Michael S. Tsirkin
2018-06-08 14:24     ` Eric Blake
2018-06-08 14:24       ` Eric Blake
2018-06-08 16:00       ` Michael S. Tsirkin
2018-06-08 16:00         ` Michael S. Tsirkin
2018-06-08  5:39   ` Thomas Huth
2018-06-08  5:39     ` Thomas Huth
2018-06-07 22:31 ` [qemu PATCH 4/5] machine: fix some misspelled words Ross Zwisler
2018-06-07 22:31   ` [Qemu-devel] " Ross Zwisler
2018-06-08  5:38   ` Thomas Huth
2018-06-08  5:38     ` Thomas Huth
2018-06-08 17:41     ` Ross Zwisler
2018-06-08 17:41       ` Ross Zwisler
2018-06-08 18:01       ` Eric Blake
2018-06-08 18:01         ` Eric Blake
2018-06-07 22:31 ` [qemu PATCH 5/5] nvdimm: make persistence option symbolic Ross Zwisler
2018-06-07 22:31   ` [Qemu-devel] " Ross Zwisler
2018-06-08 19:34   ` Michael S. Tsirkin
2018-06-08 19:34     ` [Qemu-devel] " Michael S. Tsirkin
2018-06-08 14:59 ` [qemu PATCH 1/5] gitignore: ignore generated qapi job files Eric Blake
2018-06-08 14:59   ` [Qemu-devel] " Eric Blake
2018-06-08 15:00   ` Eric Blake
2018-06-08 15:00     ` [Qemu-devel] " Eric Blake
2018-06-08 15:36   ` Ross Zwisler
2018-06-08 15:36     ` [Qemu-devel] " Ross Zwisler

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20180608190040-mutt-send-email-mst@kernel.org \
    --to=mst@redhat.com \
    --cc=ehabkost@redhat.com \
    --cc=imammedo@redhat.com \
    --cc=linux-nvdimm@lists.01.org \
    --cc=qemu-devel@nongnu.org \
    --cc=stefanha@redhat.com \
    --cc=thuth@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.