dri-devel Archive on lore.kernel.org
 help / color / mirror / Atom feed
From: Kieran Bingham <kieran.bingham@ideasonboard.com>
To: Brendan Higgins <brendanhiggins@google.com>
Cc: Luis Chamberlain <mcgrof@kernel.org>,
	Greg KH <gregkh@linuxfoundation.org>,
	Kees Cook <keescook@google.com>,
	shuah@kernel.org, Joel Stanley <joel@jms.id.au>,
	mpe@ellerman.id.au, joe@perches.com, brakmo@fb.com,
	Steven Rostedt <rostedt@goodmis.org>,
	Tim.Bird@sony.com, khilman@baylibre.com,
	Julia Lawall <julia.lawall@lip6.fr>,
	linux-kselftest@vger.kernel.org, kunit-dev@googlegroups.com,
	Linux Kernel Mailing List <linux-kernel@vger.kernel.org>,
	jdike@addtoit.com, richard@nod.at, linux-um@lists.infradead.org,
	Daniel Vetter <daniel@ffwll.ch>,
	dri-devel@lists.freedesktop.org, Rob Herring <robh@kernel.org>,
	dan.j.williams@intel.com, linux-nvdimm@lists.01.org,
	Frank Rowand <frowand.list@gmail.com>,
	Knut Omang <knut.omang@oracle.com>,
	Felix Guo <felixguoxiuping@gmail.com>
Subject: Re: [RFC v3 14/19] Documentation: kunit: add documentation for KUnit
Date: Mon, 11 Feb 2019 12:16:08 +0000	[thread overview]
Message-ID: <57c3dc86-236f-e981-249a-8bbfe5c19f0e@ideasonboard.com> (raw)
In-Reply-To: <CAFd5g44fKzriEs_pGyANxe7GuC9Ji2SD7EEz76__h8q9jjg8yA@mail.gmail.com>

Hi Brendan,

On 09/02/2019 00:56, Brendan Higgins wrote:
> On Thu, Dec 6, 2018 at 4:16 AM Kieran Bingham
> <kieran.bingham@ideasonboard.com> wrote:
>>
>> Hi Brendan,
>>
>> On 03/12/2018 23:53, Brendan Higgins wrote:
>>> On Thu, Nov 29, 2018 at 7:45 PM Luis Chamberlain <mcgrof@kernel.org> wrote:
>>>>
>>>> On Thu, Nov 29, 2018 at 01:56:37PM +0000, Kieran Bingham wrote:
>>>>> Hi Brendan,
>>>>>
>>>>> Please excuse the top posting, but I'm replying here as I'm following
>>>>> the section "Creating a kunitconfig" in Documentation/kunit/start.rst.
>>>>>
>>>>> Could the three line kunitconfig file live under say
>>>>>        arch/um/configs/kunit_defconfig?
>>
>>
>> Further consideration to this topic - I mentioned putting it in
>>   arch/um/configs
>>
>> - but I think this is wrong.
>>
>> We now have a location for config-fragments, which is essentially what
>> this is, under kernel/configs
>>
>> So perhaps an addition as :
>>
>>  kernel/configs/kunit.config
>>
>> Would be more appropriate - and less (UM) architecture specific.
> 
> Sorry for the long radio silence.
> 
> I just got around to doing this and I found that there are some
> configs that are desirable to have when running KUnit under x86 in a
> VM, but not UML. 

Should this behaviour you mention be handled by the KCONFIG depends flags?

depends on (KUMIT & UML)
or
depends on (KUNIT & !UML)

or such?

An example of which configs you are referring to would help to
understand the issue perhaps.


> So should we have one that goes in with
> config-fragments and others that go into architectures? Another idea,
> it would be nice to have a KUnit config that runs all known tests

This might also be a config option added to the tests directly like
COMPILE_TEST perhaps?

(Not sure what that would be called though ... KUNIT_RUNTIME_TEST?)

I think that might be more maintainable as otherwise each new test would
have to modify the {min,def}{config,fragment} ...


> (this probably won't work in practice once we start testing mutually
> exclusive things or things with lots of ifdeffery, but it probably
> something we should try to maintain as best as we can?); this probably
> shouldn't go in with the fragments, right?

Sounds like we agree there :)

> 
> I will be sending another revision out soon, but I figured I might be
> able to catch you before I did so.

Thanks for thinking of me.
I hope I managed to reply in time to help and not hinder your progress.

-- 
Regards
--
Kieran

  reply	other threads:[~2019-02-11 12:16 UTC|newest]

Thread overview: 118+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2018-11-28 19:36 [RFC v3 00/19] kunit: introduce KUnit, the Linux kernel unit testing framework Brendan Higgins
2018-11-28 19:36 ` [RFC v3 01/19] kunit: test: add KUnit test runner core Brendan Higgins
2018-11-30  3:14   ` Luis Chamberlain
2018-12-01  1:51     ` Brendan Higgins
2018-12-01  2:57       ` Luis Chamberlain
     [not found]     ` <20181130031438.GQ4922-dAjH6bxAqesAS62YNPtMr3dQhYtBYE6JAL8bYrjMMd8@public.gmane.org>
2018-12-05 13:15       ` Anton Ivanov
2018-12-05 14:45         ` Arnd Bergmann
     [not found]           ` <CAK8P3a2HrOTYv7qCJH1XGVxZ2HDqwkHqRWaAJ93nWc5p8LnCig-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2018-12-05 14:49             ` Anton Ivanov
2018-11-30  3:28   ` Luis Chamberlain
     [not found]     ` <20181130032802.GG18410-dAjH6bxAqesAS62YNPtMr3dQhYtBYE6JAL8bYrjMMd8@public.gmane.org>
2018-12-01  2:08       ` Brendan Higgins
     [not found]         ` <CAFd5g45F0RViYDQyXRwyxVPAU=CO_Goqy3yHz=BbcMeAT7o6-g-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2018-12-01  3:10           ` Luis Chamberlain
     [not found]             ` <20181201031049.GL28501-dAjH6bxAqesAS62YNPtMr3dQhYtBYE6JAL8bYrjMMd8@public.gmane.org>
2018-12-03 22:47               ` Brendan Higgins
2018-12-01  3:02   ` Luis Chamberlain
2018-11-28 19:36 ` [RFC v3 10/19] kunit: test: add test managed resource tests Brendan Higgins
     [not found] ` <20181128193636.254378-1-brendanhiggins-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org>
2018-11-28 19:36   ` [RFC v3 02/19] kunit: test: add test resource management API Brendan Higgins
2018-11-28 19:36   ` [RFC v3 03/19] kunit: test: add string_stream a std::stream like string builder Brendan Higgins
2018-11-30  3:29     ` Luis Chamberlain
2018-12-01  2:14       ` Brendan Higgins
2018-12-01  3:12         ` Luis Chamberlain
2018-12-03 10:55       ` Petr Mladek
2018-12-04  0:35         ` Brendan Higgins
2018-11-28 19:36   ` [RFC v3 04/19] kunit: test: add test_stream a std::stream like logger Brendan Higgins
2018-11-28 19:36   ` [RFC v3 05/19] kunit: test: add the concept of expectations Brendan Higgins
2018-11-28 19:36   ` [RFC v3 06/19] arch: um: enable running kunit from User Mode Linux Brendan Higgins
2018-11-28 21:26     ` Rob Herring
     [not found]       ` <CAL_JsqJLNSg-38hej8LV+Oh-YXBM2hRGomie3b_psa9LvzoRYg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2018-11-30  3:37         ` Luis Chamberlain
     [not found]           ` <20181130033704.GL18410-dAjH6bxAqesAS62YNPtMr3dQhYtBYE6JAL8bYrjMMd8@public.gmane.org>
2018-11-30 14:05             ` Rob Herring
2018-11-30 18:22               ` Luis Chamberlain
     [not found]                 ` <20181130182203.GS18410-dAjH6bxAqesAS62YNPtMr3dQhYtBYE6JAL8bYrjMMd8@public.gmane.org>
2018-12-03 23:22                   ` Brendan Higgins
     [not found]     ` <20181128193636.254378-7-brendanhiggins-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org>
2018-11-30  3:30       ` Luis Chamberlain
2018-11-28 19:36   ` [RFC v3 07/19] kunit: test: add initial tests Brendan Higgins
     [not found]     ` <20181128193636.254378-8-brendanhiggins-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org>
2018-11-30  3:40       ` Luis Chamberlain
2018-12-03 23:26         ` Brendan Higgins
     [not found]           ` <CAFd5g47CJnfE3Gqc03onidd5FiZSW43-6_dA5czb30-Rb3dyfg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2018-12-03 23:43             ` Luis Chamberlain
2018-11-28 19:36   ` [RFC v3 08/19] arch: um: add shim to trap to allow installing a fault catcher for tests Brendan Higgins
2018-11-30  3:34     ` Luis Chamberlain
     [not found]       ` <20181130033429.GK18410-dAjH6bxAqesAS62YNPtMr3dQhYtBYE6JAL8bYrjMMd8@public.gmane.org>
2018-12-03 23:34         ` Brendan Higgins
     [not found]           ` <CAFd5g45+MAVaSW8HN9x57Y8Um=TV1Oa=-K8yExPBS-4KjLyciQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2018-12-03 23:46             ` Luis Chamberlain
     [not found]               ` <20181203234628.GR28501-dAjH6bxAqesAS62YNPtMr3dQhYtBYE6JAL8bYrjMMd8@public.gmane.org>
2018-12-04  0:44                 ` Brendan Higgins
2018-11-30  3:41     ` Luis Chamberlain
2018-12-03 23:37       ` Brendan Higgins
2018-11-28 19:36   ` [RFC v3 09/19] kunit: test: add the concept of assertions Brendan Higgins
2018-11-28 19:36   ` [RFC v3 11/19] kunit: add Python libraries for handing KUnit config and kernel Brendan Higgins
2018-11-29 13:54     ` Kieran Bingham
     [not found]       ` <841cf4ae-501b-05ae-5863-a51010709b67-ryLnwIuWjnjg/C1BVhZhaw@public.gmane.org>
2018-12-03 23:48         ` Brendan Higgins
2018-12-04 20:47           ` Luis Chamberlain
2018-12-06 12:32             ` Kieran Bingham
2018-12-06 15:37               ` Matthew Wilcox
2018-12-07 11:30                 ` Kieran Bingham
     [not found]                 ` <20181206153718.GD24603-PfSpb0PWhxZc2C7mugBRk2EX/6BAtgUQ@public.gmane.org>
2018-12-11 14:09                   ` Petr Mladek
     [not found]                     ` <20181211140926.7wzd5jh6klcfsfgz-KsEp0d+Q8qECVLCxKZUutA@public.gmane.org>
2018-12-11 14:41                       ` Steven Rostedt
     [not found]                         ` <20181211094140.2a928fe7-f9ZlEuEWxVcJvu8Pb33WZ0EMvNT87kid@public.gmane.org>
2018-12-11 17:01                           ` Anton Ivanov
2019-02-09  0:40                             ` Brendan Higgins
     [not found]               ` <f8722f4a-44c8-24c2-c433-5178f9f40b82-ryLnwIuWjnjg/C1BVhZhaw@public.gmane.org>
2018-12-07  1:05                 ` Luis Chamberlain
2018-12-07 18:35               ` Kent Overstreet
     [not found]     ` <20181128193636.254378-12-brendanhiggins-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org>
2018-11-30  3:44       ` Luis Chamberlain
2018-12-03 23:50         ` Brendan Higgins
2018-12-04 20:48           ` Luis Chamberlain
2018-11-28 19:36   ` [RFC v3 12/19] kunit: add KUnit wrapper script and simple output parser Brendan Higgins
2018-11-28 19:36   ` [RFC v3 13/19] kunit: improve output from python wrapper Brendan Higgins
2018-11-28 19:36   ` [RFC v3 14/19] Documentation: kunit: add documentation for KUnit Brendan Higgins
     [not found]     ` <20181128193636.254378-15-brendanhiggins-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org>
2018-11-29 13:56       ` Kieran Bingham
2018-11-30  3:45         ` Luis Chamberlain
     [not found]           ` <20181130034525.GP18410-dAjH6bxAqesAS62YNPtMr3dQhYtBYE6JAL8bYrjMMd8@public.gmane.org>
2018-12-03 23:53             ` Brendan Higgins
2018-12-06 12:16               ` Kieran Bingham
     [not found]                 ` <0927c42a-8e65-f410-e6ed-27576572577f-ryLnwIuWjnjg/C1BVhZhaw@public.gmane.org>
2019-02-09  0:56                   ` Brendan Higgins
2019-02-11 12:16                     ` Kieran Bingham [this message]
     [not found]                       ` <57c3dc86-236f-e981-249a-8bbfe5c19f0e-ryLnwIuWjnjg/C1BVhZhaw@public.gmane.org>
2019-02-12 22:10                         ` Brendan Higgins
2019-02-13 21:55                           ` Kieran Bingham
     [not found]                             ` <eade3052-0aa4-90b4-d55b-8c44556f98bc-ryLnwIuWjnjg/C1BVhZhaw@public.gmane.org>
2019-02-14  0:17                               ` Brendan Higgins
2019-02-14 17:26                                 ` Luis Chamberlain via dri-devel
2019-02-14 22:07                                   ` Brendan Higgins
2018-11-28 19:36   ` [RFC v3 15/19] MAINTAINERS: add entry for KUnit the unit testing framework Brendan Higgins
2018-11-28 19:36   ` [RFC v3 17/19] of: unittest: migrate tests to run on KUnit Brendan Higgins
     [not found]     ` <20181128193636.254378-18-brendanhiggins-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org>
2018-11-28 20:56       ` Rob Herring
2018-11-30  0:39         ` Randy Dunlap
     [not found]           ` <18814973-8f0a-4647-a097-fcc3dc0b3cd3-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2018-12-04  0:13             ` Brendan Higgins
     [not found]               ` <CAFd5g475RK9v9X4qxmXwuHiPMOs05WrZAw6EJWNdVoAHQWguFQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2018-12-04 13:40                 ` Rob Herring
     [not found]                   ` <CAL_JsqL_PivQbrJFEusdKAy-2EQtKL3OHbmyYSK9bzuTOQegqA-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2018-12-05 23:42                     ` Brendan Higgins
2018-12-07  0:41                       ` Rob Herring
2018-12-04  0:08         ` Brendan Higgins
2019-02-13  1:44         ` Brendan Higgins
2019-02-14 20:10           ` Rob Herring
     [not found]             ` <CAL_JsqL=NthWW6q==TXjado83AAWuC1jYZ9CR+T9wPtgQLC4hw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2019-02-14 21:52               ` Brendan Higgins
     [not found]           ` <CAFd5g46NehKo=TT4reQ8r74bDTG9BkR=ELg+Q3n5YooUxFwBmA-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2019-02-18 22:56             ` Frank Rowand
     [not found]               ` <1d72f04e-08ba-e3dd-c8c0-512946126113-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2019-02-28  0:29                 ` Brendan Higgins
2018-12-04 10:56       ` Frank Rowand
2018-11-28 19:36   ` [RFC v3 18/19] of: unittest: split out a couple of test cases from unittest Brendan Higgins
     [not found]     ` <20181128193636.254378-19-brendanhiggins-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org>
2018-12-04 10:58       ` Frank Rowand
2018-12-05 23:54         ` Brendan Higgins
2019-02-14 23:57           ` Frank Rowand
2019-02-15  0:56             ` Brendan Higgins
2019-02-15  2:05               ` Frank Rowand
2019-02-15 10:56                 ` Brendan Higgins
     [not found]                   ` <CAFd5g44NTZoSAJPMvXP2xvJgn7m5QoV-KJu2AMrr67+eL+CKrQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2019-02-18 22:25                     ` Frank Rowand
2019-02-20 20:44                       ` Frank Rowand
     [not found]                         ` <72cd1c5b-6f68-73ad-c8fd-f3a3268a0529-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2019-02-20 20:47                           ` Frank Rowand
2019-02-28  3:52                           ` Brendan Higgins
2019-03-22  0:22                             ` Frank Rowand
     [not found]                               ` <bb5bcd3d-a09a-cfbe-c7fa-16e5eb75b0e4-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2019-03-22  1:30                                 ` Brendan Higgins
2019-03-22  1:47                                   ` Frank Rowand
2019-03-25 22:15                                     ` Brendan Higgins
     [not found]                                   ` <CAFd5g448xQLOJwVYU5Zmu4+OPWuboiWZPhBvK6au8Pgm5B9haQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2019-09-20 16:57                                     ` Rob Herring
     [not found]                                       ` <CAL_JsqLxPZ2TyKv3M=a9r4_Vh+aOQRXgETwbBvf7xsBVisZN9w-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2019-09-21 23:57                                         ` Frank Rowand
2019-03-22  1:34                                 ` Frank Rowand
2019-03-25 22:18                                   ` Brendan Higgins
2018-11-28 19:36   ` [RFC v3 19/19] of: unittest: split up some super large test cases Brendan Higgins
2018-11-28 19:36 ` [RFC v3 16/19] arch: um: make UML unflatten device tree when testing Brendan Higgins
     [not found]   ` <20181128193636.254378-17-brendanhiggins-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org>
2018-11-28 21:16     ` Rob Herring
     [not found]       ` <CAL_JsqK5cG=QzMBFSZ31_-3ujnxqxv=jj3XYajbRLT7yWYZbfw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2018-12-04  0:00         ` Brendan Higgins
2018-11-30  3:46   ` Luis Chamberlain
2018-12-04  0:02     ` Brendan Higgins
2018-12-04 10:52 ` [RFC v3 00/19] kunit: introduce KUnit, the Linux kernel unit testing framework Frank Rowand
2018-12-04 11:40 ` Frank Rowand
     [not found]   ` <f34ee937-83d6-3ff6-12b3-c6cd9acbfc38-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2018-12-04 13:49     ` Rob Herring
2018-12-05 23:10       ` Brendan Higgins
2019-03-22  0:27         ` Frank Rowand
2019-03-25 22:04           ` Brendan Higgins

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=57c3dc86-236f-e981-249a-8bbfe5c19f0e@ideasonboard.com \
    --to=kieran.bingham@ideasonboard.com \
    --cc=Tim.Bird@sony.com \
    --cc=brakmo@fb.com \
    --cc=brendanhiggins@google.com \
    --cc=dan.j.williams@intel.com \
    --cc=daniel@ffwll.ch \
    --cc=dri-devel@lists.freedesktop.org \
    --cc=felixguoxiuping@gmail.com \
    --cc=frowand.list@gmail.com \
    --cc=gregkh@linuxfoundation.org \
    --cc=jdike@addtoit.com \
    --cc=joe@perches.com \
    --cc=joel@jms.id.au \
    --cc=julia.lawall@lip6.fr \
    --cc=keescook@google.com \
    --cc=khilman@baylibre.com \
    --cc=knut.omang@oracle.com \
    --cc=kunit-dev@googlegroups.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-kselftest@vger.kernel.org \
    --cc=linux-nvdimm@lists.01.org \
    --cc=linux-um@lists.infradead.org \
    --cc=mcgrof@kernel.org \
    --cc=mpe@ellerman.id.au \
    --cc=richard@nod.at \
    --cc=robh@kernel.org \
    --cc=rostedt@goodmis.org \
    --cc=shuah@kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox