Re: KCIDB: Support one more test status

Nikolai Kondrashov
2023-04-20T16:50:52Z

On 4/19/23 20:49, Mark Brown wrote:
> On Wed, Apr 19, 2023 at 08:08:03PM +0300, Nikolai Kondrashov wrote:
>
>> I would like to make KCIDB I/O schema accept one more test status string:
>> "MISS" (preliminary name), meaning the test was supposed to run, but didn't
>> because of a harness/framework/infrastructure/CI system failure.
>
>> This would be distinct from the "SKIP" status, meaning the test was supposed
>> to run, but didn't (or didn't complete), because it was not applicable.
>
>> Here's the PR in question: https://github.com/kernelci/kcidb-io/pull/74
>
>> I'll merge it in two weeks, on Wed, May 3, if there are no unresolved
>> objections by that time.
>
>> Read on for details, and respond either to this message, or in the PR.
>
> This makes sense to me, it corresponds to how my own testing inteprets
> results - I have a list of tests I expect to pass, and if any of them
> return any result other than pass then that's an issue. I also picked
> the name "missing" for that in my code.

Yeah, it's kinda like that. Only KCIDB defines explicit statuses for a bunch
of specific failures, and I propose to make "MISS" represent
harness/framework/CI system mess-ups/"misses" only.

Nick