[LTP] LTP release

Bird, Tim
2020-09-21T18:04:30Z

Just to finish answering questions...

> -----Original Message-----
> From: Cyril Hrubis <chrubis@suse.cz>
>
> > Do you have a preferred name for the runtest file? My proposal, just off the top
> > of my head, is: "ltp-selftest-quick", but I'm open to other suggestions.
>
> Maybe we should call it smoketest, but I'm okay selftest as well.

I'm fine with "smoketest".

...
> >
> > This takes about 5 seconds on one of my test machines.
>
> So I will add a network test to the set and push that before a patch
> that removes quickhit.
>
> It would be nice to have the outliners, but that is a bit more
> complicated change, so I would like to add these after a release, is
> that okay?

Yes. I think that's actually better. I think a simple change now
is good. I'd like to think some more about whether it would be good to
add things that misbehave to smoketest, or if they should be put into
a separate selftest group. My inclination is that a smoketest should really
just be a super-quick check that should work unless something fundamental
is broken, while selftest should try as many things as possible, including weird
stuff and corner cases, to actually test specific features of runtest handling.

I'm satisfied with the current smoketest content.

>
> > P.S. Maybe, if you're moving away from runltp and ltp-pan, it's a little late to be
> > adding some selftests to make sure they work correctly. But Fuego is using them.
> > I don't know what other frameworks use when they invoke LTP to perform
> > tests.
>
> I do expect that we will have ltp-pan included for compatibility reasons
> at least for a year or two once the replacement would be in place
> anyways, so having a smoketest wouldn't harm at all.
Sounds good.