Linux Kernel Selftest development
 help / color / mirror / Atom feed
From: frowand.list at gmail.com (Frank Rowand)
Subject: [RFC v4 00/17] kunit: introduce KUnit, the Linux kernel unit testing framework
Date: Thu, 21 Mar 2019 18:23:53 -0700	[thread overview]
Message-ID: <0e6eb370-3e62-e1a5-1b91-bccc5868e8e4@gmail.com> (raw)
In-Reply-To: <CAFd5g45F3YUsAjse+Vt5hj5CLjaXrRWgr5zCZZ6CJKc0hboP6Q@mail.gmail.com>

On 3/4/19 3:01 PM, Brendan Higgins wrote:
> On Thu, Feb 14, 2019 at 1:38 PM Brendan Higgins
> <brendanhiggins at google.com> wrote:
>>
>> This patch set proposes KUnit, a lightweight unit testing and mocking
>> framework for the Linux kernel.
>>
> 
> <snip>
> 
>> ## More information on KUnit
>>
>> There is a bunch of documentation near the end of this patch set that
>> describes how to use KUnit and best practices for writing unit tests.
>> For convenience I am hosting the compiled docs here:
>> https://google.github.io/kunit-docs/third_party/kernel/docs/
>> Additionally for convenience, I have applied these patches to a branch:
>> https://kunit.googlesource.com/linux/+/kunit/rfc/5.0-rc5/v4
>> The repo may be cloned with:
>> git clone https://kunit.googlesource.com/linux
>> This patchset is on the kunit/rfc/5.0-rc5/v4 branch.
>>
>> ## Changes Since Last Version
>>
>>  - Got KUnit working on (hypothetically) all architectures (tested on
>>    x86), as per Rob's (and other's) request
>>  - Punting all KUnit features/patches depending on UML for now.
>>  - Broke out UML specific support into arch/um/* as per "[RFC v3 01/19]
>>    kunit: test: add KUnit test runner core", as requested by Luis.
>>  - Added support to kunit_tool to allow it to build kernels in external
>>    directories, as suggested by Kieran.
>>  - Added a UML defconfig, and a config fragment for KUnit as suggested
>>    by Kieran and Luis.
>>  - Cleaned up, and reformatted a bunch of stuff.
>>
>> --
>> 2.21.0.rc0.258.g878e2cd30e-goog
>>
> 
> Someone suggested I should send the next revision out as "PATCH"
> instead of "RFC" since there seems to be general consensus about
> everything at a high level, with a couple exceptions.
> 
> At this time I am planning on sending the next revision out as "[PATCH
> v1 00/NN] kunit: introduce KUnit, the Linux kernel unit testing
> framework". Initially I wasn't sure if the next revision should be
> "[PATCH v1 ...]" or "[PATCH v5 ...]". Please let me know if you have a
> strong objection to the former.
> 
> In the next revision, I will be dropping the last two of three patches
> for the DT unit tests as there doesn't seem to be enough features
> currently available to justify the heavy refactoring I did; however, I

Thank you.


> will still include the patch that just converts everything over to
> KUnit without restructuring the test cases:
> https://lkml.org/lkml/2019/2/14/1133

The link doesn't work for me (don't worry about that), so I'm assuming
this is:

   [RFC v4 15/17] of: unittest: migrate tests to run on KUnit

The conversation on that patch ended after:

   >> After adding patch 15, there are a lot of "unittest internal error" messages.
   > 
   > Yeah, I meant to ask you about that. I thought it was due to a change
   > you made, but after further examination, just now, I found it was my
   > fault. Sorry for not mentioning that anywhere. I will fix it in v5.

It is not worth my time to look at patch 15 when it is that broken.  So I
have not done any review of it.

So no, I think you are still in the RFC stage unless you drop patch 15.

> 
> I should have the next revision out in a week or so.
> 

WARNING: multiple messages have this Message-ID (diff)
From: frowand.list@gmail.com (Frank Rowand)
Subject: [RFC v4 00/17] kunit: introduce KUnit, the Linux kernel unit testing framework
Date: Thu, 21 Mar 2019 18:23:53 -0700	[thread overview]
Message-ID: <0e6eb370-3e62-e1a5-1b91-bccc5868e8e4@gmail.com> (raw)
Message-ID: <20190322012353.46NJ6MFqHrjbMKb0AA3wIwWpsmYdV7j2Hs3PoxpOMvk@z> (raw)
In-Reply-To: <CAFd5g45F3YUsAjse+Vt5hj5CLjaXrRWgr5zCZZ6CJKc0hboP6Q@mail.gmail.com>

On 3/4/19 3:01 PM, Brendan Higgins wrote:
> On Thu, Feb 14, 2019 at 1:38 PM Brendan Higgins
> <brendanhiggins@google.com> wrote:
>>
>> This patch set proposes KUnit, a lightweight unit testing and mocking
>> framework for the Linux kernel.
>>
> 
> <snip>
> 
>> ## More information on KUnit
>>
>> There is a bunch of documentation near the end of this patch set that
>> describes how to use KUnit and best practices for writing unit tests.
>> For convenience I am hosting the compiled docs here:
>> https://google.github.io/kunit-docs/third_party/kernel/docs/
>> Additionally for convenience, I have applied these patches to a branch:
>> https://kunit.googlesource.com/linux/+/kunit/rfc/5.0-rc5/v4
>> The repo may be cloned with:
>> git clone https://kunit.googlesource.com/linux
>> This patchset is on the kunit/rfc/5.0-rc5/v4 branch.
>>
>> ## Changes Since Last Version
>>
>>  - Got KUnit working on (hypothetically) all architectures (tested on
>>    x86), as per Rob's (and other's) request
>>  - Punting all KUnit features/patches depending on UML for now.
>>  - Broke out UML specific support into arch/um/* as per "[RFC v3 01/19]
>>    kunit: test: add KUnit test runner core", as requested by Luis.
>>  - Added support to kunit_tool to allow it to build kernels in external
>>    directories, as suggested by Kieran.
>>  - Added a UML defconfig, and a config fragment for KUnit as suggested
>>    by Kieran and Luis.
>>  - Cleaned up, and reformatted a bunch of stuff.
>>
>> --
>> 2.21.0.rc0.258.g878e2cd30e-goog
>>
> 
> Someone suggested I should send the next revision out as "PATCH"
> instead of "RFC" since there seems to be general consensus about
> everything at a high level, with a couple exceptions.
> 
> At this time I am planning on sending the next revision out as "[PATCH
> v1 00/NN] kunit: introduce KUnit, the Linux kernel unit testing
> framework". Initially I wasn't sure if the next revision should be
> "[PATCH v1 ...]" or "[PATCH v5 ...]". Please let me know if you have a
> strong objection to the former.
> 
> In the next revision, I will be dropping the last two of three patches
> for the DT unit tests as there doesn't seem to be enough features
> currently available to justify the heavy refactoring I did; however, I

Thank you.


> will still include the patch that just converts everything over to
> KUnit without restructuring the test cases:
> https://lkml.org/lkml/2019/2/14/1133

The link doesn't work for me (don't worry about that), so I'm assuming
this is:

   [RFC v4 15/17] of: unittest: migrate tests to run on KUnit

The conversation on that patch ended after:

   >> After adding patch 15, there are a lot of "unittest internal error" messages.
   > 
   > Yeah, I meant to ask you about that. I thought it was due to a change
   > you made, but after further examination, just now, I found it was my
   > fault. Sorry for not mentioning that anywhere. I will fix it in v5.

It is not worth my time to look at patch 15 when it is that broken.  So I
have not done any review of it.

So no, I think you are still in the RFC stage unless you drop patch 15.

> 
> I should have the next revision out in a week or so.
> 

  parent reply	other threads:[~2019-03-22  1:23 UTC|newest]

Thread overview: 126+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2019-02-14 21:37 [RFC v4 00/17] kunit: introduce KUnit, the Linux kernel unit testing framework brendanhiggins
2019-02-14 21:37 ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 01/17] kunit: test: add KUnit test runner core brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 02/17] kunit: test: add test resource management API brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-15 21:01   ` sboyd
2019-02-15 21:01     ` Stephen Boyd
2019-02-19 23:24     ` brendanhiggins
2019-02-19 23:24       ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 03/17] kunit: test: add string_stream a std::stream like string builder brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 04/17] kunit: test: add test_stream a std::stream like logger brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 05/17] kunit: test: add the concept of expectations brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 06/17] kbuild: enable building KUnit brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 07/17] kunit: test: add initial tests brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 08/17] kunit: test: add support for test abort brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-18 19:52   ` frowand.list
2019-02-18 19:52     ` Frank Rowand
2019-02-20  3:39     ` brendanhiggins
2019-02-20  3:39       ` Brendan Higgins
2019-02-20  6:44       ` frowand.list
2019-02-20  6:44         ` Frank Rowand
2019-02-28  7:42         ` brendanhiggins
2019-02-28  7:42           ` Brendan Higgins
2019-03-22  1:09           ` frowand.list
2019-03-22  1:09             ` Frank Rowand
2019-03-22  1:41             ` brendanhiggins
2019-03-22  1:41               ` Brendan Higgins
2019-03-22  7:10               ` knut.omang
2019-03-22  7:10                 ` Knut Omang
2019-03-25 22:32                 ` brendanhiggins
2019-03-25 22:32                   ` Brendan Higgins
2019-03-26  7:44                   ` knut.omang
2019-03-26  7:44                     ` Knut Omang
2019-02-26 20:35   ` sboyd
2019-02-26 20:35     ` Stephen Boyd
2019-02-28  9:03     ` brendanhiggins
2019-02-28  9:03       ` Brendan Higgins
2019-02-28 13:54       ` dan.carpenter
2019-02-28 13:54         ` Dan Carpenter
2019-03-04 22:28         ` brendanhiggins
2019-03-04 22:28           ` Brendan Higgins
     [not found]       ` <155137694423.260864.2846034318906225490@swboyd.mtv.corp.google.com>
2019-03-04 22:39         ` brendanhiggins
2019-03-04 22:39           ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 09/17] kunit: test: add the concept of assertions brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 10/17] kunit: test: add test managed resource tests brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-15 20:54   ` sboyd
2019-02-15 20:54     ` Stephen Boyd
2019-02-19 23:20     ` brendanhiggins
2019-02-19 23:20       ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 11/17] kunit: tool: add Python wrappers for running KUnit tests brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 12/17] kunit: defconfig: add defconfigs for building " brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 13/17] Documentation: kunit: add documentation for KUnit brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 14/17] MAINTAINERS: add entry for KUnit the unit testing framework brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 15/17] of: unittest: migrate tests to run on KUnit brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-02-16  0:24   ` frowand.list
2019-02-16  0:24     ` Frank Rowand
2019-02-20  2:24     ` brendanhiggins
2019-02-20  2:24       ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 16/17] of: unittest: split out a couple of test cases from unittest brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-03-22  1:14   ` frowand.list
2019-03-22  1:14     ` Frank Rowand
2019-03-22  1:45     ` brendanhiggins
2019-03-22  1:45       ` Brendan Higgins
2019-02-14 21:37 ` [RFC v4 17/17] of: unittest: split up some super large test cases brendanhiggins
2019-02-14 21:37   ` Brendan Higgins
2019-03-22  1:16   ` frowand.list
2019-03-22  1:16     ` Frank Rowand
2019-03-22  1:45     ` brendanhiggins
2019-03-22  1:45       ` Brendan Higgins
2019-02-18 20:02 ` [RFC v4 00/17] kunit: introduce KUnit, the Linux kernel unit testing framework frowand.list
2019-02-18 20:02   ` Frank Rowand
2019-02-20  6:34   ` brendanhiggins
2019-02-20  6:34     ` Brendan Higgins
2019-02-20  6:46     ` frowand.list
2019-02-20  6:46       ` Frank Rowand
2019-02-22 20:52       ` bauerman
2019-02-22 20:52         ` Thiago Jung Bauermann
2019-02-28  4:18         ` brendanhiggins
2019-02-28  4:18           ` Brendan Higgins
2019-02-28  4:15       ` brendanhiggins
2019-02-28  4:15         ` Brendan Higgins
2019-03-04 23:01 ` brendanhiggins
2019-03-04 23:01   ` Brendan Higgins
2019-03-22  1:23   ` frowand.list [this message]
2019-03-22  1:23     ` Frank Rowand
2019-03-25 22:11     ` brendanhiggins
2019-03-25 22:11       ` Brendan Higgins
2019-03-21  1:07 ` logang
2019-03-21  1:07   ` Logan Gunthorpe
2019-03-21  5:23   ` knut.omang
2019-03-21  5:23     ` Knut Omang
2019-03-21 15:56     ` logang
2019-03-21 15:56       ` Logan Gunthorpe
2019-03-21 16:55       ` brendanhiggins
2019-03-21 16:55         ` Brendan Higgins
2019-03-21 19:13         ` knut.omang
2019-03-21 19:13           ` Knut Omang
2019-03-21 19:29           ` logang
2019-03-21 19:29             ` Logan Gunthorpe
2019-03-21 20:14             ` knut.omang
2019-03-21 20:14               ` Knut Omang
2019-03-21 22:07   ` brendanhiggins
2019-03-21 22:07     ` Brendan Higgins
2019-03-21 22:26     ` logang
2019-03-21 22:26       ` Logan Gunthorpe
2019-03-21 23:33       ` brendanhiggins
2019-03-21 23:33         ` Brendan Higgins
2019-03-22  1:12         ` frowand.list
2019-03-22  1:12           ` Frank Rowand
2019-03-25 22:12           ` brendanhiggins
2019-03-25 22:12             ` Brendan Higgins

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=0e6eb370-3e62-e1a5-1b91-bccc5868e8e4@gmail.com \
    --to=linux-kselftest@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox