Re: [LTP] open posix testsuite and names of testcases

chrubis
2012-12-06T16:35:46Z

Hi!
> > Well I don't think that the option one is that hard, at least I'm not
> > aware of much cases of hardcoded names in the Open Posix Testsuite.
> > On
> > the other hand having better test driver that executes the tests and
> > presents the result in more convinient way would be more appealing.
> > Or
> > we can do both of them.
>
> I think we should do the renaming anyway.
> Would the following format work for everyone? "testdirname-[number]-[number].c"
> For example: pthread_create-1-5.c
> It's unique, and it's easy to tell what old name was.

I'm ok with that.

> > I was thinking of creating a relatively simply test driver that runs
> > the
> > tests, takes care of timeouts (and anything else) and logs
> > information
> > in some reasonable format (I used JSON in similar case). And then
> > about
> > some tools that could compare the results, print list of failed
> > testcases and so on. Does that sound reasonable?
>
> How would this be related to ltp-pan? Would this be only for open posix testsuite
> or also for LTP?

Well, that is a good question. The differencies between Open Posix
Testsuite and the rest of the LTP aren't too big so it may be possible
to create a test driver for both and share most of the code. On the
other hand. To just run the tests you just need to export right
VARIABLES and modify PATH accordingly. To collect the result you need to
translate the test return values.

On the other hand I'm not even sure about all the features that ltp-pan
has and what subset of them is used by different people. But I will
surely like to have more up to date test driver that produces more
usefull data.

There are couple possibilities what we can do.

We may start creating something that could run the Open Posix Testsuite
and then gradually extend it to work with the rest of the LTP adding all
the features we would need while deprecating the ltp-pan and removing it
once we have full replacement.

Or we may look if there is something to fit our meets out there
allready and modify it to meet our needs.

Or anything that any of you may come up with.

--
Cyril Hrubis
chrubis@suse.cz

------------------------------------------------------------------------------
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
Remotely access PCs and mobile devices and provide instant support
Improve your efficiency, and focus on delivering more value-add services
Discover what IT Professionals Know. Rescue delivers