From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Message-ID: <5b2783a2-76bf-ce6f-89b1-d0fe05b80b82@gmail.com> Date: Thu, 12 May 2022 12:26:33 -0500 MIME-Version: 1.0 Subject: Re: [RFC] KTAP spec v2: prefix to KTAP data References: <5ca35c47-6145-4ec1-6c05-3c46f436cb4d@gmail.com> From: Frank Rowand In-Reply-To: Content-Language: en-US Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit List-ID: To: Daniel Latypov Cc: David Gow , Shuah Khan , Kees Cook , Tim.Bird@sony.com, Brendan Higgins , Jonathan Corbet , rmr167@gmail.com, guillaume.tucker@collabora.com, kernelci@groups.io, kunit-dev@googlegroups.com, linux-kselftest@vger.kernel.org, linux-doc@vger.kernel.org, linux-kernel@vger.kernel.org On 5/12/22 10:25, Daniel Latypov wrote: > On Wed, May 11, 2022 at 11:01 PM Frank Rowand wrote: >> ================================================================================ >> #### discussion notes: >> >> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - >> PRO: minimally invasive to specification. >> >> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - >> CON: >> >> KTAP does not include any mechanism to describe the value of >> to test harnesses and test output processing programs. The test output >> processing programs must infer the value of by detecting >> the in the "Version lines". >> >> The detection of a "Version lines" might be a match of the regex: >> >> "^.*KTAP version 2$" >> >> This risks falsely detecting a "Version lines", but the risk is small??? > > Agree this is a risk and also think it's probably small, but it's hard to say. > I think the $ anchoring the regex is probably safe enough. > > As noted earlier, this tracks with what kunit.py already does. > That was necessitated by dynamic prefixes such as timestamps, etc.f That is a good observation. I nearly always have the prefix timestamp on my console output, and thus remove the timestamp with a regex when processing the data. -Frank > So I think this is probably a fine risk to take. > > I imagine we could add constraints of prefix string, e.g. must have [] > around it, etc. if we want to try and minimize this risk. > But I don't know if it's necessarily worth it, given what we know right now. > > Along those lines, I think I like this approach (Alternative 1) more > than Alternative 2/2b. > I'm not sure we need a structured way to specify metadata in KTAP yet? > The prefix seems like a reasonable candidate, but do others have ideas > of other bits of metadata we'd want to be able to declare? > > Daniel