Linux Kernel Selftest development
 help / color / mirror / Atom feed
From: frowand.list at gmail.com (Frank Rowand)
Subject: [RFC v4 00/17] kunit: introduce KUnit, the Linux kernel unit testing framework
Date: Thu, 21 Mar 2019 18:12:48 -0700	[thread overview]
Message-ID: <aea24c8e-5ce8-5f33-c81b-d2eeef588ec8@gmail.com> (raw)
In-Reply-To: <CAFd5g45u6oX=nK9anAEdfsV+8SET8Zo_Dpy0WfzCna19r_jSyw@mail.gmail.com>

On 3/21/19 4:33 PM, Brendan Higgins wrote:
> On Thu, Mar 21, 2019 at 3:27 PM Logan Gunthorpe <logang at deltatee.com> wrote:
>>
>>
>>
>> On 2019-03-21 4:07 p.m., Brendan Higgins wrote:
>>> A couple of points, as for needing CONFIG_PCI; my plan to deal with
>>> that type of thing has been that we would add support for a KUnit/UML
>>> version that is just for KUnit. It would mock out the necessary bits
>>> to provide a fake hardware implementation for anything that might
>>> depend on it. I wrote a prototype for mocking/faking MMIO that I
>>> presented to the list here[1]; it is not part of the current patchset
>>> because we decided it would be best to focus on getting an MVP in, but
>>> I plan on bringing it back up at some point. Anyway, what do you
>>> generally think of this approach?
>>
>> Yes, I was wondering if that might be possible. I think that's a great
>> approach but it will unfortunately take a lot of work before larger
>> swaths of the kernel are testable in Kunit with UML. Having more common
>> mocked infrastructure will be great by-product of it though.
> 
> Yeah, it's unfortunate that the best way to do something often takes
> so much longer.
> 
>>
>>> Awesome, I looked at the code you posted and it doesn't look like you
>>> have had too many troubles. One thing that stood out to me, why did
>>> you need to put it in the kunit/ dir?
>>
>> Yeah, writing the code was super easy. Only after, did I realized I
>> couldn't get it to easily build.
> 
> Yeah, we really need to fix that; unfortunately, broadly addressing
> that problem is really hard and will most likely take a long time.
> 
>>
>> Putting it in the kunit directory was necessary because nothing in the
>> NTB tree builds unless CONFIG_NTB is set (see drivers/Makefile) and
>> CONFIG_NTB depends on CONFIG_PCI. I didn't experiment to see how hard it
>> would be to set CONFIG_NTB without CONFIG_PCI; I assumed it would be tricky.
>>
>>> I am looking forward to see what you think!
>>
>> Generally, I'm impressed and want to see this work in upstream as soon
>> as possible so I can start to make use of it!
> 
> Great to hear! I was trying to get the next revision out this week,
> but addressing some of the comments is taking a little longer than
> expected. I should have something together fairly soon though
> (hopefully next week). Good news is that next revision will be
> non-RFC; most of the feedback has settled down and I think we are
> ready to start figuring out how to merge it. Fingers crossed :-)
> 
> Cheers

I'll be out of the office next week and will not be able to review.
Please hold off on any devicetree related files until after I review.

Thanks,

Frank

WARNING: multiple messages have this Message-ID (diff)
From: frowand.list@gmail.com (Frank Rowand)
Subject: [RFC v4 00/17] kunit: introduce KUnit, the Linux kernel unit testing framework
Date: Thu, 21 Mar 2019 18:12:48 -0700	[thread overview]
Message-ID: <aea24c8e-5ce8-5f33-c81b-d2eeef588ec8@gmail.com> (raw)
Message-ID: <20190322011248.dQsOlifkSTdfe2Zd8S1lvhpnFmz_aCYjW-86L0-HTqQ@z> (raw)
In-Reply-To: <CAFd5g45u6oX=nK9anAEdfsV+8SET8Zo_Dpy0WfzCna19r_jSyw@mail.gmail.com>

On 3/21/19 4:33 PM, Brendan Higgins wrote:
> On Thu, Mar 21, 2019@3:27 PM Logan Gunthorpe <logang@deltatee.com> wrote:
>>
>>
>>
>> On 2019-03-21 4:07 p.m., Brendan Higgins wrote:
>>> A couple of points, as for needing CONFIG_PCI; my plan to deal with
>>> that type of thing has been that we would add support for a KUnit/UML
>>> version that is just for KUnit. It would mock out the necessary bits
>>> to provide a fake hardware implementation for anything that might
>>> depend on it. I wrote a prototype for mocking/faking MMIO that I
>>> presented to the list here[1]; it is not part of the current patchset
>>> because we decided it would be best to focus on getting an MVP in, but
>>> I plan on bringing it back up at some point. Anyway, what do you
>>> generally think of this approach?
>>
>> Yes, I was wondering if that might be possible. I think that's a great
>> approach but it will unfortunately take a lot of work before larger
>> swaths of the kernel are testable in Kunit with UML. Having more common
>> mocked infrastructure will be great by-product of it though.
> 
> Yeah, it's unfortunate that the best way to do something often takes
> so much longer.
> 
>>
>>> Awesome, I looked at the code you posted and it doesn't look like you
>>> have had too many troubles. One thing that stood out to me, why did
>>> you need to put it in the kunit/ dir?
>>
>> Yeah, writing the code was super easy. Only after, did I realized I
>> couldn't get it to easily build.
> 
> Yeah, we really need to fix that; unfortunately, broadly addressing
> that problem is really hard and will most likely take a long time.
> 
>>
>> Putting it in the kunit directory was necessary because nothing in the
>> NTB tree builds unless CONFIG_NTB is set (see drivers/Makefile) and
>> CONFIG_NTB depends on CONFIG_PCI. I didn't experiment to see how hard it
>> would be to set CONFIG_NTB without CONFIG_PCI; I assumed it would be tricky.
>>
>>> I am looking forward to see what you think!
>>
>> Generally, I'm impressed and want to see this work in upstream as soon
>> as possible so I can start to make use of it!
> 
> Great to hear! I was trying to get the next revision out this week,
> but addressing some of the comments is taking a little longer than
> expected. I should have something together fairly soon though
> (hopefully next week). Good news is that next revision will be
> non-RFC; most of the feedback has settled down and I think we are
> ready to start figuring out how to merge it. Fingers crossed :-)
> 
> Cheers

I'll be out of the office next week and will not be able to review.
Please hold off on any devicetree related files until after I review.

Thanks,

Frank

  parent reply	other threads:[~2019-03-22  1:12 UTC|newest]

Thread overview: 126+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2019-02-14 21:37 [RFC v4 00/17] kunit: introduce KUnit, the Linux kernel unit testing framework brendanhiggins
2019-02-14 21:37 ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 01/17] kunit: test: add KUnit test runner core brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 02/17] kunit: test: add test resource management API brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-15 21:01   ` sboyd
2019-02-15 21:01     ` Stephen Boyd
2019-02-19 23:24     ` brendanhiggins
2019-02-19 23:24       ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 03/17] kunit: test: add string_stream a std::stream like string builder brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 04/17] kunit: test: add test_stream a std::stream like logger brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 05/17] kunit: test: add the concept of expectations brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 06/17] kbuild: enable building KUnit brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 07/17] kunit: test: add initial tests brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 08/17] kunit: test: add support for test abort brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-18 19:52   ` frowand.list
2019-02-18 19:52     ` Frank Rowand
2019-02-20  3:39     ` brendanhiggins
2019-02-20  3:39       ` Brendan Higgins
2019-02-20  6:44       ` frowand.list
2019-02-20  6:44         ` Frank Rowand
2019-02-28  7:42         ` brendanhiggins
2019-02-28  7:42           ` Brendan Higgins
2019-03-22  1:09           ` frowand.list
2019-03-22  1:09             ` Frank Rowand
2019-03-22  1:41             ` brendanhiggins
2019-03-22  1:41               ` Brendan Higgins
2019-03-22  7:10               ` knut.omang
2019-03-22  7:10                 ` Knut Omang
2019-03-25 22:32                 ` brendanhiggins
2019-03-25 22:32                   ` Brendan Higgins
2019-03-26  7:44                   ` knut.omang
2019-03-26  7:44                     ` Knut Omang
2019-02-26 20:35   ` sboyd
2019-02-26 20:35     ` Stephen Boyd
2019-02-28  9:03     ` brendanhiggins
2019-02-28  9:03       ` Brendan Higgins
2019-02-28 13:54       ` dan.carpenter
2019-02-28 13:54         ` Dan Carpenter
2019-03-04 22:28         ` brendanhiggins
2019-03-04 22:28           ` Brendan Higgins
     [not found]       ` <155137694423.260864.2846034318906225490@swboyd.mtv.corp.google.com>
2019-03-04 22:39         ` brendanhiggins
2019-03-04 22:39           ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 09/17] kunit: test: add the concept of assertions brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 10/17] kunit: test: add test managed resource tests brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-15 20:54   ` sboyd
2019-02-15 20:54     ` Stephen Boyd
2019-02-19 23:20     ` brendanhiggins
2019-02-19 23:20       ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 11/17] kunit: tool: add Python wrappers for running KUnit tests brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 12/17] kunit: defconfig: add defconfigs for building " brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 13/17] Documentation: kunit: add documentation for KUnit brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 14/17] MAINTAINERS: add entry for KUnit the unit testing framework brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 15/17] of: unittest: migrate tests to run on KUnit brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-16  0:24   ` frowand.list
2019-02-16  0:24     ` Frank Rowand
2019-02-20  2:24     ` brendanhiggins
2019-02-20  2:24       ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 16/17] of: unittest: split out a couple of test cases from unittest brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-03-22  1:14   ` frowand.list
2019-03-22  1:14     ` Frank Rowand
2019-03-22  1:45     ` brendanhiggins
2019-03-22  1:45       ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 17/17] of: unittest: split up some super large test cases brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-03-22  1:16   ` frowand.list
2019-03-22  1:16     ` Frank Rowand
2019-03-22  1:45     ` brendanhiggins
2019-03-22  1:45       ` Brendan Higgins
2019-02-18 20:02 ` [RFC v4 00/17] kunit: introduce KUnit, the Linux kernel unit testing framework frowand.list
2019-02-18 20:02   ` Frank Rowand
2019-02-20  6:34   ` brendanhiggins
2019-02-20  6:34     ` Brendan Higgins
2019-02-20  6:46     ` frowand.list
2019-02-20  6:46       ` Frank Rowand
2019-02-22 20:52       ` bauerman
2019-02-22 20:52         ` Thiago Jung Bauermann
2019-02-28  4:18         ` brendanhiggins
2019-02-28  4:18           ` Brendan Higgins
2019-02-28  4:15       ` brendanhiggins
2019-02-28  4:15         ` Brendan Higgins
2019-03-04 23:01 ` brendanhiggins
2019-03-04 23:01   ` Brendan Higgins
2019-03-22  1:23   ` frowand.list
2019-03-22  1:23     ` Frank Rowand
2019-03-25 22:11     ` brendanhiggins
2019-03-25 22:11       ` Brendan Higgins
2019-03-21  1:07 ` logang
2019-03-21  1:07   ` Logan Gunthorpe
2019-03-21  5:23   ` knut.omang
2019-03-21  5:23     ` Knut Omang
2019-03-21 15:56     ` logang
2019-03-21 15:56       ` Logan Gunthorpe
2019-03-21 16:55       ` brendanhiggins
2019-03-21 16:55         ` Brendan Higgins
2019-03-21 19:13         ` knut.omang
2019-03-21 19:13           ` Knut Omang
2019-03-21 19:29           ` logang
2019-03-21 19:29             ` Logan Gunthorpe
2019-03-21 20:14             ` knut.omang
2019-03-21 20:14               ` Knut Omang
2019-03-21 22:07   ` brendanhiggins
2019-03-21 22:07     ` Brendan Higgins
2019-03-21 22:26     ` logang
2019-03-21 22:26       ` Logan Gunthorpe
2019-03-21 23:33       ` brendanhiggins
2019-03-21 23:33         ` Brendan Higgins
2019-03-22  1:12         ` frowand.list [this message]
2019-03-22  1:12           ` Frank Rowand
2019-03-25 22:12           ` brendanhiggins
2019-03-25 22:12             ` Brendan Higgins

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=aea24c8e-5ce8-5f33-c81b-d2eeef588ec8@gmail.com \
    --to=linux-kselftest@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox