Re: [LTP] [RFC][PATCH 0/2] Merge runtest files

[Cyril Hrubis <chrubis@suse.cz>]

Hi!
> this is a _huge_ topic that might affect LTP automation configurations.
> 
> It's a job that IMHO should be done, but it makes more sense to wait for 
> testing suites definition in metadata, as well as a total refactoring of 
> old LTP tests.

For a bigger changes yes. I would say that eliminating runtest files
with a single test could be done sooner.

> The reason of my statements is not only that runtest files should be 
> removed one day, but also that known issues inside products which are 
> tested, often require years of analysis of the runtest files and their 
> executions. By shuffling tests around will create issues where there's 
> no need due to a small logical improvement.

I do not think that it's as severe as you describe it. We change runtest
files a lot in each release and additions to runtest/syscall are the most
frequent.

> I think we should start to push more on testing suites definition inside 
> metadata and to refactor tests as fast as possible. So we will be free 
> from runtest files, leading to a more coherent structure of the tests 
> organization.

We are getting there slowly, but I'm afraid that it will take years to
get there.

-- 
Cyril Hrubis
chrubis@suse.cz

-- 
Mailing list info: https://lists.linux.it/listinfo/ltp