[LTP] Some of the testcases which are resulting in FAIL even though they might not be

[LTP] Some of the testcases which are resulting in FAIL even though they might not be

[Munipradeep Beerakam]

Hi,

Here is the list of testcases in May 2009 LTP, which *may* result in
FAIL even though it is a configuration error, not the error due to the
functionality we are testing. Those tests should give "CONF" message,
not "FAIL". I ran LTP on 2.6.18 kernel, x86 architecture.

   1. InitNuma
Error output:
Initnuma 0 WARN : non-NUMA aware kernel is running or your machine does
not support numa policy or
your machine is not a NUMA machine
Initnuma 1 FAIL : INIT NUMA FAILED !!

   2. ht_enable
Error output:
ht_enable 0 INFO : Begin: HyperThreading Enabled
ht_enable 0 INFO : The kernel boot paramter 'noht' is not set.
ht_enable 1 FAIL : HT feature is not included in this Linux Kernel.
ht_enable 0 INFO : End: HyperThreading Enabled

   3. get_mempolicy01
Part of code, which is not correct
tst_resm(TFAIL, "set_mempolicy() failed - errno = %d : %s",TEST_ERRNO,
strerror(TEST_ERRNO));
...
...
tst_resm(TFAIL, "malloc failed - errno = %d : %s",TEST_ERRNO,
strerror(TEST_ERRNO));

   4. mq_open01
Part of code, which is not correct
if (TEST_RETURN < 0) {
                        tst_resm(TFAIL, "mq_getsetattr failed - errno =
%d : %s",TEST_ERRNO, strerror(TEST_ERRNO));

Regards
Muni


------------------------------------------------------------------------------
Crystal Reports - New Free Runtime and 30 Day Trial
Check out the new simplified licensing option that enables unlimited
royalty-free distribution of the report engine for externally facing 
server and web deployment.
http://p.sf.net/sfu/businessobjects
_______________________________________________
Ltp-list mailing list
Ltp-list@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ltp-list

Re: [LTP] Some of the testcases which are resulting in FAIL even though they might not be

[Jiri Palecek]

On Wednesday 10 June 2009 14:06:25 Munipradeep Beerakam wrote:
> Hi,

Hi,

> Here is the list of testcases in May 2009 LTP, which *may* result in
> FAIL even though it is a configuration error, not the error due to the
> functionality we are testing. Those tests should give "CONF" message,
> not "FAIL". I ran LTP on 2.6.18 kernel, x86 architecture.
> 
> 
>    3. get_mempolicy01
> Part of code, which is not correct
> tst_resm(TFAIL, "set_mempolicy() failed - errno = %d : %s",TEST_ERRNO,
> strerror(TEST_ERRNO));
> ...
> ...
> tst_resm(TFAIL, "malloc failed - errno = %d : %s",TEST_ERRNO,
> strerror(TEST_ERRNO));
> 
>    4. mq_open01
> Part of code, which is not correct
> if (TEST_RETURN < 0) {
>                         tst_resm(TFAIL, "mq_getsetattr failed - errno =
> %d : %s",TEST_ERRNO, strerror(TEST_ERRNO));

Not that I'd say this code is stellar, it may even be incorrect, but changing these to TCONF wouldn't be correct either. These error messages should be TCONF only if errno is ENOSYS, otherwise, they should be reported as TBROK, because it would be an error that prevents the test to run. The best option, however, would probably be to add a tst_kvercmp check for kernel versions that contain the respective functions.

Regards
    Jiri Palecek

------------------------------------------------------------------------------
Crystal Reports - New Free Runtime and 30 Day Trial
Check out the new simplified licensing option that enables unlimited
royalty-free distribution of the report engine for externally facing 
server and web deployment.
http://p.sf.net/sfu/businessobjects
_______________________________________________
Ltp-list mailing list
Ltp-list@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ltp-list

Re: [LTP] Some of the testcases which are resulting in FAIL even though they might not be

[Subrata Modak]

On Wed, 2009-06-10 at 17:36 +0530, Munipradeep Beerakam wrote: 
> Hi,
> 
> Here is the list of testcases in May 2009 LTP, which *may* result in
> FAIL even though it is a configuration error, not the error due to the
> functionality we are testing. Those tests should give "CONF" message,
> not "FAIL". I ran LTP on 2.6.18 kernel, x86 architecture.
> 
>    1. InitNuma
> Error output:
> Initnuma 0 WARN : non-NUMA aware kernel is running or your machine does
> not support numa policy or
> your machine is not a NUMA machine
> Initnuma 1 FAIL : INIT NUMA FAILED !!

Contact Pradeep for this.

> 
>    2. ht_enable
> Error output:
> ht_enable 0 INFO : Begin: HyperThreading Enabled
> ht_enable 0 INFO : The kernel boot paramter 'noht' is not set.
> ht_enable 1 FAIL : HT feature is not included in this Linux Kernel.
> ht_enable 0 INFO : End: HyperThreading Enabled
> 

Cai/Rohit has been discussing this for long.

> 3. get_mempolicy01
> Part of code, which is not correct
> tst_resm(TFAIL, "set_mempolicy() failed - errno = %d : %s",TEST_ERRNO,
> strerror(TEST_ERRNO));
> ...
> ...
> tst_resm(TFAIL, "malloc failed - errno = %d : %s",TEST_ERRNO,
> strerror(TEST_ERRNO));
> 
>    4. mq_open01
> Part of code, which is not correct
> if (TEST_RETURN < 0) {
>                         tst_resm(TFAIL, "mq_getsetattr failed - errno =
> %d : %s",TEST_ERRNO, strerror(TEST_ERRNO));
> 

And they are as per my earlier mail.

Regards--
Subrata

> Regards
> Muni
> 


------------------------------------------------------------------------------
Crystal Reports - New Free Runtime and 30 Day Trial
Check out the new simplified licensing option that enables unlimited
royalty-free distribution of the report engine for externally facing 
server and web deployment.
http://p.sf.net/sfu/businessobjects
_______________________________________________
Ltp-list mailing list
Ltp-list@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ltp-list

Re: [LTP] Some of the testcases which are resulting in FAIL even though they might not be

[Subrata Modak]

On Fri, 2009-06-12 at 14:08 +0200, Jiri Palecek wrote: 
> On Wednesday 10 June 2009 14:06:25 Munipradeep Beerakam wrote:
> > Hi,
> 
> Hi,
> 
> > Here is the list of testcases in May 2009 LTP, which *may* result in
> > FAIL even though it is a configuration error, not the error due to the
> > functionality we are testing. Those tests should give "CONF" message,
> > not "FAIL". I ran LTP on 2.6.18 kernel, x86 architecture.
> > 
> > 
> >    3. get_mempolicy01
> > Part of code, which is not correct
> > tst_resm(TFAIL, "set_mempolicy() failed - errno = %d : %s",TEST_ERRNO,
> > strerror(TEST_ERRNO));
> > ...
> > ...
> > tst_resm(TFAIL, "malloc failed - errno = %d : %s",TEST_ERRNO,
> > strerror(TEST_ERRNO));
> > 
> >    4. mq_open01
> > Part of code, which is not correct
> > if (TEST_RETURN < 0) {
> >                         tst_resm(TFAIL, "mq_getsetattr failed - errno =
> > %d : %s",TEST_ERRNO, strerror(TEST_ERRNO));
> 
> Not that I'd say this code is stellar, it may even be incorrect, but changing these to TCONF wouldn't be correct either. These error messages should be TCONF only if errno is ENOSYS, otherwise, they should be reported as TBROK, because it would be an error that prevents the test to run. The best option, however, would probably be to add a tst_kvercmp check for kernel versions that contain the respective functions.
> 

Muni,

Can you work out a patch on this lines. I would help you to do so if
required.

Regards--
Subrata

> Regards
>     Jiri Palecek
> 
> ------------------------------------------------------------------------------
> Crystal Reports - New Free Runtime and 30 Day Trial
> Check out the new simplified licensing option that enables unlimited
> royalty-free distribution of the report engine for externally facing 
> server and web deployment.
> http://p.sf.net/sfu/businessobjects
> _______________________________________________
> Ltp-list mailing list
> Ltp-list@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/ltp-list


------------------------------------------------------------------------------
Crystal Reports - New Free Runtime and 30 Day Trial
Check out the new simplified licensing option that enables unlimited
royalty-free distribution of the report engine for externally facing 
server and web deployment.
http://p.sf.net/sfu/businessobjects
_______________________________________________
Ltp-list mailing list
Ltp-list@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ltp-list

Re: [LTP] Some of the testcases which are resulting in FAIL even though they might not be

[Pradeep K Surisetty]

Subrata Modak <subrata@linux.vnet.ibm.com> wrote on 06/18/2009 11:01:32 PM:

> Subrata Modak <subrata@linux.vnet.ibm.com>
> 06/18/2009 11:01 PM
>
> Please respond to
> subrata@linux.vnet.ibm.com
>
> To
>
> Munipradeep Beerakam <mpradeep@linux.vnet.ibm.com>, Pradeep K
> Surisetty/India/IBM@IBMIN, Cai Qian <caiqian@cclom.cn>, rohit verma
> <rohit.170309@gmail.com>
>
> cc
>
> ltp-list@lists.sourceforge.net, Iranna D Ankad/India/IBM@IBMIN
>
> Subject
>
> Re: Some of the testcases which are resulting in FAIL even though
> they might not be
>
> On Wed, 2009-06-10 at 17:36 +0530, Munipradeep Beerakam wrote:
> > Hi,
> >
> > Here is the list of testcases in May 2009 LTP, which *may* result in
> > FAIL even though it is a configuration error, not the error due to the
> > functionality we are testing. Those tests should give "CONF" message,
> > not "FAIL". I ran LTP on 2.6.18 kernel, x86 architecture.
> >
> >    1. InitNuma
> > Error output:
> > Initnuma 0 WARN : non-NUMA aware kernel is running or your machine does
> > not support numa policy or
> > your machine is not a NUMA machine
> > Initnuma 1 FAIL : INIT NUMA FAILED !!
>
> Contact Pradeep for this.

Hi Subrata,

I have noticed few issues with NUMA test cases.
Currently I am investigating and get back to you in short.

Best Regards
Pradeep


>
> >
> >    2. ht_enable
> > Error output:
> > ht_enable 0 INFO : Begin: HyperThreading Enabled
> > ht_enable 0 INFO : The kernel boot paramter 'noht' is not set.
> > ht_enable 1 FAIL : HT feature is not included in this Linux Kernel.
> > ht_enable 0 INFO : End: HyperThreading Enabled
> >
>
> Cai/Rohit has been discussing this for long.
>
> > 3. get_mempolicy01
> > Part of code, which is not correct
> > tst_resm(TFAIL, "set_mempolicy() failed - errno = %d : %s",TEST_ERRNO,
> > strerror(TEST_ERRNO));
> > ...
> > ...
> > tst_resm(TFAIL, "malloc failed - errno = %d : %s",TEST_ERRNO,
> > strerror(TEST_ERRNO));
> >
> >    4. mq_open01
> > Part of code, which is not correct
> > if (TEST_RETURN < 0) {
> >                         tst_resm(TFAIL, "mq_getsetattr failed - errno =
> > %d : %s",TEST_ERRNO, strerror(TEST_ERRNO));
> >
>
> And they are as per my earlier mail.
>
> Regards--
> Subrata
>
> > Regards
> > Muni
> >
>


------------------------------------------------------------------------------
_______________________________________________
Ltp-list mailing list
Ltp-list@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ltp-list