[LTP] Missing test tools in recent ltp builds

[LTP] Missing test tools in recent ltp builds

[Shwetabh]

Hi,

In recent ltp releases, I see quite a few test cases breaking since 
their required tools
are not being copied over to /opt/ltp/testcases/. I believe this 
behaviour started since
ltp started compiling and copying the files to /opt/ltp. Here is an example:

----<<snip>>-----------
remove test cases which require the block device.
You can specify it with option -b
COMMAND:    /opt/ltp/bin/ltp-pan  -e -S   -a 27204     -n 27204  -p  -f 
/tmp/ltp-gcfmm27210/alltests -l 
/opt/ltp/results/LTP_RUN_ON-2010_Mar_02-22h_24m_38s.log  -C 
/opt/ltp/output/LTP_RUN_ON-2010_Mar_02-22h_24m_38s.failed
LOG File: /opt/ltp/results/LTP_RUN_ON-2010_Mar_02-22h_24m_38s.log
FAILED COMMAND File: 
/opt/ltp/output/LTP_RUN_ON-2010_Mar_02-22h_24m_38s.failed
Running tests.......
<<<test_start>>>
tag=CPUHOTPLUG stime=1267586681
cmdline="(cd $LTPROOT/testcases/kernel/hotplug/cpu_hotplug/; ./runtests.sh)"
contacts=""
analysis=exit
<<<test_output>>>
incrementing stop
sh: line 0: cd: /opt/ltp/testcases/kernel/hotplug/cpu_hotplug/: No such 
file or directory
sh: ./runtests.sh: No such file or directory
<<<execution_status>>>
initiation_status="ok"
duration=0 termination_type=exited termination_id=127 corefile=no
cutime=0 cstime=0
<<<test_end>>>
INFO: ltp-pan reported some tests FAIL
LTP Version: LTP-20100228

        ###############################################################"

             Done executing testcases."
             LTP Version:  LTP-20100228
        ###############################################################"

[root@localhost runtest]# cd /opt/ltp/testcases/
[root@localhost testcases]# ls
bin  data
[root@localhost testcases]# pwd
/opt/ltp/testcases
[root@localhost testcases]# ls -l
total 76
drwxr-xr-x 7 root root 69632 Mar  2 22:24 bin
drwxr-xr-x 2 root root  4096 Mar  2 22:19 data

--------------------

Please advice if I am doing something wrong here. Do I manually have to 
copy the tools from tarballs' testcases/kernel directory?
If so, shouldn't this be done by make install?

-- 
Regards,
Shwetabh


------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Ltp-list mailing list
Ltp-list@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ltp-list

Re: [LTP] Missing test tools in recent ltp builds

[Garrett Cooper]

Hi,

On Wed, Mar 3, 2010 at 2:35 AM, Shwetabh <shwetabh.goel@calsoftinc.com> wrote:
>
> In recent ltp releases, I see quite a few test cases breaking since
> their required tools
> are not being copied over to /opt/ltp/testcases/. I believe this
> behaviour started since
> ltp started compiling and copying the files to /opt/ltp. Here is an example:

Please provide more concrete examples and patches wherever possible.
We'll get it fixed as soon as feasibly possible, but it helps if
others contribute back as well. Also, not providing examples is
counterproductive and I won't waste my time worrying about issues that
supposedly exist if I don't have a means to reproduce the problem, or
at least a fundamental understanding of what the problem is.

> ----<<snip>>-----------
> remove test cases which require the block device.
> You can specify it with option -b
> COMMAND:    /opt/ltp/bin/ltp-pan  -e -S   -a 27204     -n 27204  -p  -f
> /tmp/ltp-gcfmm27210/alltests -l
> /opt/ltp/results/LTP_RUN_ON-2010_Mar_02-22h_24m_38s.log  -C
> /opt/ltp/output/LTP_RUN_ON-2010_Mar_02-22h_24m_38s.failed
> LOG File: /opt/ltp/results/LTP_RUN_ON-2010_Mar_02-22h_24m_38s.log
> FAILED COMMAND File:
> /opt/ltp/output/LTP_RUN_ON-2010_Mar_02-22h_24m_38s.failed
> Running tests.......
> <<<test_start>>>
> tag=CPUHOTPLUG stime=1267586681
> cmdline="(cd $LTPROOT/testcases/kernel/hotplug/cpu_hotplug/; ./runtests.sh)"
> contacts=""
> analysis=exit
> <<<test_output>>>
> incrementing stop
> sh: line 0: cd: /opt/ltp/testcases/kernel/hotplug/cpu_hotplug/: No such
> file or directory
> sh: ./runtests.sh: No such file or directory

And the reason why this is failing is that
/opt/ltp/testcases/kernel/hotplug/cpu_hotplug doesn't exist; the test
still works -- it's just the runtest file itself that's broken. The
tests haven't been touched for months, if not almost 2 years...

> <<<execution_status>>>
> initiation_status="ok"
> duration=0 termination_type=exited termination_id=127 corefile=no
> cutime=0 cstime=0
> <<<test_end>>>
> INFO: ltp-pan reported some tests FAIL
> LTP Version: LTP-20100228
>
>        ###############################################################"
>
>             Done executing testcases."
>             LTP Version:  LTP-20100228
>        ###############################################################"
>
> [root@localhost runtest]# cd /opt/ltp/testcases/
> [root@localhost testcases]# ls
> bin  data
> [root@localhost testcases]# pwd
> /opt/ltp/testcases
> [root@localhost testcases]# ls -l
> total 76
> drwxr-xr-x 7 root root 69632 Mar  2 22:24 bin
> drwxr-xr-x 2 root root  4096 Mar  2 22:19 data
>
> --------------------
>
> Please advice if I am doing something wrong here. Do I manually have to
> copy the tools from tarballs' testcases/kernel directory?
> If so, shouldn't this be done by make install?

Just leave it as-is and execute like before, or feel free to submit
patches to fix this (it's a non-blocking issue so it's not a high
priority on my list to `fix').

Thanks,
-Garrett

------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Ltp-list mailing list
Ltp-list@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ltp-list

Re: [LTP] Missing test tools in recent ltp builds

[Rishikesh K Rajak]

On Wed, Mar 03, 2010 at 04:05:43PM +0530, Shwetabh wrote:
> Hi,
> 
Hi Shwetabh,

Few queries:
    - Tell us the complete steps of execution/compiling
    - OS version ?
    - automake & autoconf version ?
    - Arch ?

Thanks
-Rishi

> In recent ltp releases, I see quite a few test cases breaking since 
> their required tools
> are not being copied over to /opt/ltp/testcases/. I believe this 
> behaviour started since
> ltp started compiling and copying the files to /opt/ltp. Here is an example:
> 
> ----<<snip>>-----------
> remove test cases which require the block device.
> You can specify it with option -b
> COMMAND:    /opt/ltp/bin/ltp-pan  -e -S   -a 27204     -n 27204  -p  -f 
> /tmp/ltp-gcfmm27210/alltests -l 
> /opt/ltp/results/LTP_RUN_ON-2010_Mar_02-22h_24m_38s.log  -C 
> /opt/ltp/output/LTP_RUN_ON-2010_Mar_02-22h_24m_38s.failed
> LOG File: /opt/ltp/results/LTP_RUN_ON-2010_Mar_02-22h_24m_38s.log
> FAILED COMMAND File: 
> /opt/ltp/output/LTP_RUN_ON-2010_Mar_02-22h_24m_38s.failed
> Running tests.......
> <<<test_start>>>
> tag=CPUHOTPLUG stime=1267586681
> cmdline="(cd $LTPROOT/testcases/kernel/hotplug/cpu_hotplug/; ./runtests.sh)"
> contacts=""
> analysis=exit
> <<<test_output>>>
> incrementing stop
> sh: line 0: cd: /opt/ltp/testcases/kernel/hotplug/cpu_hotplug/: No such 
> file or directory
> sh: ./runtests.sh: No such file or directory
> <<<execution_status>>>
> initiation_status="ok"
> duration=0 termination_type=exited termination_id=127 corefile=no
> cutime=0 cstime=0
> <<<test_end>>>
> INFO: ltp-pan reported some tests FAIL
> LTP Version: LTP-20100228
> 
>         ###############################################################"
> 
>              Done executing testcases."
>              LTP Version:  LTP-20100228
>         ###############################################################"
> 
> [root@localhost runtest]# cd /opt/ltp/testcases/
> [root@localhost testcases]# ls
> bin  data
> [root@localhost testcases]# pwd
> /opt/ltp/testcases
> [root@localhost testcases]# ls -l
> total 76
> drwxr-xr-x 7 root root 69632 Mar  2 22:24 bin
> drwxr-xr-x 2 root root  4096 Mar  2 22:19 data
> 
> --------------------
> 
> Please advice if I am doing something wrong here. Do I manually have to 
> copy the tools from tarballs' testcases/kernel directory?
> If so, shouldn't this be done by make install?
> 
> -- 
> Regards,
> Shwetabh
> 
> 
> ------------------------------------------------------------------------------
> Download Intel&#174; Parallel Studio Eval
> Try the new software tools for yourself. Speed compiling, find bugs
> proactively, and fine-tune applications for parallel performance.
> See why Intel Parallel Studio got high marks during beta.
> http://p.sf.net/sfu/intel-sw-dev
> _______________________________________________
> Ltp-list mailing list
> Ltp-list@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/ltp-list

-- 
Thanks & Regards
Rishi
LTP Maintainer
IBM, LTC, Bangalore
Please join IRC #ltp @ irc.freenode.net

------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Ltp-list mailing list
Ltp-list@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ltp-list

Re: [LTP] Missing test tools in recent ltp builds

[Shwetabh]

Hi Rishi,

Here is the information you needed:

- Installation Steps:
1. Downloaded LTP's Feb 2010 Stable build from ltp.sourceforge.net
2. Extracted/compiled using following commands:
tar -xzf ltp-full-20100228.tgz
cd ltp-full-20100228
./configure
make
make install
3. Went to /opt/ltp directory and tried to execute cpuhotplug test:
[root@localhost ~]# cd /opt/ltp/
[root@localhost ltp]# ./runltp -f cpuhotplug

- OS Version: RHEL 5.4

- Automake version:
[root@localhost ~]# automake --version
automake (GNU automake) 1.9.6
Written by Tom Tromey <tromey@redhat.com>.

Autoconf version:
[root@localhost ~]# autoconf --version
autoconf (GNU Autoconf) 2.59
Written by David J. MacKenzie and Akim Demaille.

- Arch: x86_64

I was able to run the same test w/o any issues with 
ltp-full-20090731.tgz, which I "think" was the
last drop which would compile and install in the same location. Even in 
the current case, I was able
to run the test only after I copied all folders from 
/root/ltp-full-20100228/testcases to /opt/ltp/testcases.

Regards,
Shwetabh
On 3/3/2010 6:13 PM, Rishikesh K Rajak wrote:
> On Wed, Mar 03, 2010 at 04:05:43PM +0530, Shwetabh wrote:
>    
>> Hi,
>>
>>      
> Hi Shwetabh,
>
> Few queries:
>      - Tell us the complete steps of execution/compiling
>      - OS version ?
>      - automake&  autoconf version ?
>      - Arch ?
>
> Thanks
> -Rishi
>
>    
>> In recent ltp releases, I see quite a few test cases breaking since
>> their required tools
>> are not being copied over to /opt/ltp/testcases/. I believe this
>> behaviour started since
>> ltp started compiling and copying the files to /opt/ltp. Here is an example:
>>
>> ----<<snip>>-----------
>> remove test cases which require the block device.
>> You can specify it with option -b
>> COMMAND:    /opt/ltp/bin/ltp-pan  -e -S   -a 27204     -n 27204  -p  -f
>> /tmp/ltp-gcfmm27210/alltests -l
>> /opt/ltp/results/LTP_RUN_ON-2010_Mar_02-22h_24m_38s.log  -C
>> /opt/ltp/output/LTP_RUN_ON-2010_Mar_02-22h_24m_38s.failed
>> LOG File: /opt/ltp/results/LTP_RUN_ON-2010_Mar_02-22h_24m_38s.log
>> FAILED COMMAND File:
>> /opt/ltp/output/LTP_RUN_ON-2010_Mar_02-22h_24m_38s.failed
>> Running tests.......
>> <<<test_start>>>
>> tag=CPUHOTPLUG stime=1267586681
>> cmdline="(cd $LTPROOT/testcases/kernel/hotplug/cpu_hotplug/; ./runtests.sh)"
>> contacts=""
>> analysis=exit
>> <<<test_output>>>
>> incrementing stop
>> sh: line 0: cd: /opt/ltp/testcases/kernel/hotplug/cpu_hotplug/: No such
>> file or directory
>> sh: ./runtests.sh: No such file or directory
>> <<<execution_status>>>
>> initiation_status="ok"
>> duration=0 termination_type=exited termination_id=127 corefile=no
>> cutime=0 cstime=0
>> <<<test_end>>>
>> INFO: ltp-pan reported some tests FAIL
>> LTP Version: LTP-20100228
>>
>>          ###############################################################"
>>
>>               Done executing testcases."
>>               LTP Version:  LTP-20100228
>>          ###############################################################"
>>
>> [root@localhost runtest]# cd /opt/ltp/testcases/
>> [root@localhost testcases]# ls
>> bin  data
>> [root@localhost testcases]# pwd
>> /opt/ltp/testcases
>> [root@localhost testcases]# ls -l
>> total 76
>> drwxr-xr-x 7 root root 69632 Mar  2 22:24 bin
>> drwxr-xr-x 2 root root  4096 Mar  2 22:19 data
>>
>> --------------------
>>
>> Please advice if I am doing something wrong here. Do I manually have to
>> copy the tools from tarballs' testcases/kernel directory?
>> If so, shouldn't this be done by make install?
>>
>> -- 
>> Regards,
>> Shwetabh
>>
>>
>> ------------------------------------------------------------------------------
>> Download Intel&#174; Parallel Studio Eval
>> Try the new software tools for yourself. Speed compiling, find bugs
>> proactively, and fine-tune applications for parallel performance.
>> See why Intel Parallel Studio got high marks during beta.
>> http://p.sf.net/sfu/intel-sw-dev
>> _______________________________________________
>> Ltp-list mailing list
>> Ltp-list@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/ltp-list
>>      
>    

------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Ltp-list mailing list
Ltp-list@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ltp-list

Re: [LTP] Missing test tools in recent ltp builds

[Maxin John]

[-- Attachment #1: Type: text/plain, Size: 7136 bytes --]

Hi Shwetabh,

> 3. Went to /opt/ltp directory and tried to execute cpuhotplug test:
> [root@localhost ~]# cd /opt/ltp/
> [root@localhost ltp]# ./runltp -f cpuhotplug
>

Please find attached the quick 'n' dirty patch
(cpu_hotplugin_makefile.patch) to execute cpuhotplugin test.
I have observed that the 'hotplug' directory is not included in
"testcases/kernel/Makefile". I have also
created a Makefile in 'hotplug/cpu_hotplug' directory.

After applying this patch, I have followed the usual ./configure;
make; sudo make install steps and executed
the cpuhotplug test and observed the below given output . It seems
like the test execution is "not so good" in
my machine. Your mileage may vary.

Garret,Rishi, please review the patch and let me know your comments.

Signed-off-by: Maxin B. John <maxin.john@gmail.com>

------------------------------------------------------------------------------------------------------------------------------------------
maxin@maxin-laptop:/opt/ltp$ sudo ./runltp -f cpuhotplug
INFO: creating /opt/ltp/output directory
INFO: creating /opt/ltp/results directory
Checking for required user/group ids

If some fields are empty or look unusual you may have an old version.
Compare to the current minimal requirements in Documentation/Changes.

DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=9.10
DISTRIB_CODENAME=karmic
DISTRIB_DESCRIPTION="Ubuntu 9.10"
Linux maxin-laptop 2.6.31-19-generic #56-Ubuntu SMP Thu Jan 28
01:26:53 UTC 2010 i686 GNU/Linux

'nobody' user id and group found.
'bin' user id and group found.
'daemon' user id and group found.
Users group found.
Sys group found.
Required users/groups exist.
Gnu C                  gcc (Ubuntu 4.4.1-4ubuntu9) 4.4.1
Gnu make               3.81
util-linux             ng 2.16)
mount                  ng 2.16 (with libblkid and selinux support)
modutils               3.10
e2fsprogs              1.41.9
PPP                    2.4.5
Linux C Library        2.10.1
Dynamic linker (ldd)   2.10.1
Procps                 3.2.8
Net-tools              1.60
iproute2              iproute2-ss090324
Kbd                    1.15
Sh-utils               7.4
Modules Loaded         usb_storage binfmt_misc ppdev
snd_hda_codec_conexant snd_hda_intel snd_hda_codec snd_hwdep
snd_pcm_oss snd_mixer_oss snd_pcm snd_seq_dummy joydev snd_seq_oss
snd_seq_midi arc4 snd_rawmidi snd_seq_midi_event snd_seq ecb snd_timer
snd_seq_device iptable_filter snd soundcore snd_page_alloc b43
ip_tables psmouse mac80211 x_tables serio_raw cfg80211 led_class lp
parport fbcon tileblit font bitblit softcursor i915 drm i2c_algo_bit
ssb 8139too 8139cp mii intel_agp agpgart video output

free reports:
             total       used       free     shared    buffers     cached
Mem:        241116     235908       5208          0      10116      87660
-/+ buffers/cache:     138132     102984
Swap:      1028152     154292     873860

/proc/cpuinfo
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 14
model name	: Intel(R) Celeron(R) M CPU        420  @ 1.60GHz
stepping	: 8
cpu MHz		: 1596.045
cache size	: 1024 KB
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov
clflush dts acpi mmx fxsr sse sse2 ss tm pbe nx constant_tsc up
arch_perfmon bts pni monitor tm2 xtpr pdcm
bogomips	: 3192.09
clflush size	: 64
power management:

remove test cases which require the block device.
You can specify it with option -b
COMMAND:    /opt/ltp/bin/ltp-pan  -e -S   -a 7506     -n 7506  -p  -f
/tmp/ltp-07KEC2Bcm4/alltests -l
/opt/ltp/results/LTP_RUN_ON-2010_Mar_03-22h_14m_34s.log  -C
/opt/ltp/output/LTP_RUN_ON-2010_Mar_03-22h_14m_34s.failed
-e LOG File: /opt/ltp/results/LTP_RUN_ON-2010_Mar_03-22h_14m_34s.log
-e FAILED COMMAND File:
/opt/ltp/output/LTP_RUN_ON-2010_Mar_03-22h_14m_34s.failed
Running tests.......
<<<test_start>>>
tag=CPUHOTPLUG stime=1267634676
cmdline="(cd $LTPROOT/testcases/kernel/hotplug/cpu_hotplug/; ./runtests.sh)"
contacts=""
analysis=exit
<<<test_output>>>
cd: 1: can't cd to /opt/ltp/testcases/kernel/hotplug/cpu_hotplug/
incrementing stop
CPU:        1
LOOPS:      1
LHCS_PATH:  /opt/ltp/testcases/bin
Name:   hotplug01
Date:   Wed Mar  3 22:14:36 IST 2010
Desc:   What happens to disk controller interrupts when offlining CPUs?

CPU is 1
Error: cpu1 not found
hotplug01      FAIL: cpu1 not found!
Wed Mar  3 22:14:37 IST 2010
Name:   hotplug02
Date:   Wed Mar  3 22:14:37 IST 2010
Desc:   What happens to a process when its CPU is offlined?

CPU is 1
Error: cpu1 not found
hotplug02      FAIL: cpu1 not found!
Wed Mar  3 22:14:37 IST 2010
exit: 35: Illegal number: -1
Name:   hotplug03
Date:   Wed Mar  3 22:14:37 IST 2010
Desc:   Do tasks get scheduled to a newly on-lined CPU?

CPU is 1
Error: CPU1 not found
hotplug03      FAIL: CPU1 not found!
Wed Mar  3 22:14:37 IST 2010
exit: 31: Illegal number: -1
Name:   hotplug04
Date:   Wed Mar  3 22:14:37 IST 2010
Desc:   Does it prevent us from offlining the last CPU?

functional/hotplug04.sh: 65: on[1]=cpuidle: not found
functional/hotplug04.sh: 65: Bad substitution
Name:   Hotplug Test - Test Case 6
Date:   Wed Mar  3 22:14:37 IST 2010
Desc:   Verify user tools can handle adding and removing CPUs.

Name:   hotplug06.top
Date:   Wed Mar  3 22:14:37 IST 2010
Desc:   Does top work properly when CPU hotplug events occur?

CPU is 1
Error: CPU1 not found
hotplug06.top      FAIL: CPU1 not found!
Wed Mar  3 22:14:37 IST 2010
exit: 31: Illegal number: -1


Name:   hotplug06.sar
Date:   Wed Mar  3 22:14:37 IST 2010
Desc:   Does sar behave properly during CPU hotplug events?

CPU is 1
Error: CPU1 not found
hotplug06.sar      FAIL: CPU1 not found!
Wed Mar  3 22:14:37 IST 2010
exit: 31: Illegal number: -1

Name:   HotPlug Test - Test Case 7
Date:   Wed Mar  3 22:14:37 IST 2010
Desc:   What happens when hotplugging during a heavy workload?
Issue:  Hotplug bugs have been found during kernel compiles

get_affinity_mask 7652
cat: /sys/devices/system/cpu/cpu1/online: No such file or directory
[: 57: =: unexpected operator
Error:  CPU1 cannot be onlined
Wed Mar  3 22:14:37 IST 2010
functional/hotplug07.sh: 64: disown: not found
<<<execution_status>>>
initiation_status="ok"
duration=1 termination_type=exited termination_id=1 corefile=no
cutime=3 cstime=3
<<<test_end>>>
INFO: ltp-pan reported some tests FAIL
LTP Version: LTP-20100228

       ###############################################################"

            Done executing testcases."
            LTP Version:  LTP-20100228
       ###############################################################"

maxin@maxin-laptop:/opt/ltp$ cd results/
maxin@maxin-laptop:/opt/ltp/results$ cat LTP_RUN_ON-2010_Mar_03-22h_14m_34s.log
Test Start Time: Wed Mar  3 22:14:36 2010
-----------------------------------------
Testcase                       Result     Exit Value
--------                       ------     ----------
CPUHOTPLUG                     FAIL       1

-----------------------------------------------
Total Tests: 1
Total Failures: 1
Kernel Version: 2.6.31-19-generic
Machine Architecture: i686
Hostname: maxin-laptop

[-- Attachment #2: cpu_hotplug_makefile.patch --]
[-- Type: text/x-patch, Size: 2573 bytes --]

diff -uNr ltp-full-20100228-orig/testcases/kernel/hotplug/cpu_hotplug/Makefile ltp-full-20100228/testcases/kernel/hotplug/cpu_hotplug/Makefile
--- ltp-full-20100228-orig/testcases/kernel/hotplug/cpu_hotplug/Makefile	1970-01-01 05:30:00.000000000 +0530
+++ ltp-full-20100228/testcases/kernel/hotplug/cpu_hotplug/Makefile	2010-03-03 21:46:33.000000000 +0530
@@ -0,0 +1,27 @@
+#
+#    kernel/hotplug/cpu_hotplug test suite Makefile.
+#
+#    This program is free software; you can redistribute it and/or modify
+#    it under the terms of the GNU General Public License as published by
+#    the Free Software Foundation; either version 2 of the License, or
+#    (at your option) any later version.
+#
+#    This program is distributed in the hope that it will be useful,
+#    but WITHOUT ANY WARRANTY; without even the implied warranty of
+#    MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+#    GNU General Public License for more details.
+#
+#    You should have received a copy of the GNU General Public License along
+#    with this program; if not, write to the Free Software Foundation, Inc.,
+#    51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA.
+#
+# Maxin B. John, March 2010
+
+top_srcdir                      ?= ../../../..
+
+include $(top_srcdir)/include/mk/env_pre.mk
+
+INSTALL_TARGETS                 := runtests.sh functional/* include/* tools/*
+
+include $(top_srcdir)/include/mk/generic_leaf_target.mk
+
diff -uNr ltp-full-20100228-orig/testcases/kernel/hotplug/memory_hotplug/Makefile ltp-full-20100228/testcases/kernel/hotplug/memory_hotplug/Makefile
--- ltp-full-20100228-orig/testcases/kernel/hotplug/memory_hotplug/Makefile	2010-03-01 20:28:28.000000000 +0530
+++ ltp-full-20100228/testcases/kernel/hotplug/memory_hotplug/Makefile	2010-03-03 21:46:12.000000000 +0530
@@ -29,6 +29,8 @@
 LDLIBS		+= $(NUMA_LIBS)
 LDLIBS		:= $(filter-out -lltp,$(LDLIBS))
 
+INSTALL_TARGETS := memtoy
+
 MAKE_TARGETS	:= memtoy
 
 memtoy: $(patsubst $(abs_srcdir)/%.c,%.o,$(wildcard $(abs_srcdir)/*.c))
diff -uNr ltp-full-20100228-orig/testcases/kernel/Makefile ltp-full-20100228/testcases/kernel/Makefile
--- ltp-full-20100228-orig/testcases/kernel/Makefile	2010-03-01 20:28:28.000000000 +0530
+++ ltp-full-20100228/testcases/kernel/Makefile	2010-03-03 21:45:52.000000000 +0530
@@ -27,7 +27,7 @@
 ifneq ($(UCLINUX),1)
 SUBDIRS		:= containers connectors controllers fs io ipc mem numa \
 		   performance_counters power_management pty sched security \
-		   syscalls timers
+		   syscalls timers hotplug
 else
 SUBDIRS		:= syscalls
 endif

[-- Attachment #3: Type: text/plain, Size: 345 bytes --]

------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev

[-- Attachment #4: Type: text/plain, Size: 155 bytes --]

_______________________________________________
Ltp-list mailing list
Ltp-list@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ltp-list

Re: [LTP] Missing test tools in recent ltp builds

[Garrett Cooper]

On Mar 3, 2010, at 9:00 AM, Maxin John <maxin.john@gmail.com> wrote:

> Hi Shwetabh,
>
>> 3. Went to /opt/ltp directory and tried to execute cpuhotplug test:
>> [root@localhost ~]# cd /opt/ltp/
>> [root@localhost ltp]# ./runltp -f cpuhotplug
>>
>
> Please find attached the quick 'n' dirty patch
> (cpu_hotplugin_makefile.patch) to execute cpuhotplugin test.
> I have observed that the 'hotplug' directory is not included in
> "testcases/kernel/Makefile". I have also
> created a Makefile in 'hotplug/cpu_hotplug' directory.
>
> After applying this patch, I have followed the usual ./configure;
> make; sudo make install steps and executed
> the cpuhotplug test and observed the below given output . It seems
> like the test execution is "not so good" in
> my machine. Your mileage may vary.
>
> Garret,Rishi, please review the patch and let me know your comments.
>
> Signed-off-by: Maxin B. John <maxin.john@gmail.com>
>
> ---
> ---
> ---
> ---
> ---
> ---
> ---
> ---
> ---
> ---
> ---
> ---
> ---
> ---
> ---
> ---
> ---
> ---
> ---
> ---
> ---
> ---
> ---
> ---------------------------------------------------------------------
> maxin@maxin-laptop:/opt/ltp$ sudo ./runltp -f cpuhotplug
> INFO: creating /opt/ltp/output directory
> INFO: creating /opt/ltp/results directory
> Checking for required user/group ids
>
> If some fields are empty or look unusual you may have an old version.
> Compare to the current minimal requirements in Documentation/Changes.
>
> DISTRIB_ID=Ubuntu
> DISTRIB_RELEASE=9.10
> DISTRIB_CODENAME=karmic
> DISTRIB_DESCRIPTION="Ubuntu 9.10"
> Linux maxin-laptop 2.6.31-19-generic #56-Ubuntu SMP Thu Jan 28
> 01:26:53 UTC 2010 i686 GNU/Linux
>
> 'nobody' user id and group found.
> 'bin' user id and group found.
> 'daemon' user id and group found.
> Users group found.
> Sys group found.
> Required users/groups exist.
> Gnu C                  gcc (Ubuntu 4.4.1-4ubuntu9) 4.4.1
> Gnu make               3.81
> util-linux             ng 2.16)
> mount                  ng 2.16 (with libblkid and selinux support)
> modutils               3.10
> e2fsprogs              1.41.9
> PPP                    2.4.5
> Linux C Library        2.10.1
> Dynamic linker (ldd)   2.10.1
> Procps                 3.2.8
> Net-tools              1.60
> iproute2              iproute2-ss090324
> Kbd                    1.15
> Sh-utils               7.4
> Modules Loaded         usb_storage binfmt_misc ppdev
> snd_hda_codec_conexant snd_hda_intel snd_hda_codec snd_hwdep
> snd_pcm_oss snd_mixer_oss snd_pcm snd_seq_dummy joydev snd_seq_oss
> snd_seq_midi arc4 snd_rawmidi snd_seq_midi_event snd_seq ecb snd_timer
> snd_seq_device iptable_filter snd soundcore snd_page_alloc b43
> ip_tables psmouse mac80211 x_tables serio_raw cfg80211 led_class lp
> parport fbcon tileblit font bitblit softcursor i915 drm i2c_algo_bit
> ssb 8139too 8139cp mii intel_agp agpgart video output
>
> free reports:
>             total       used       free     shared    buffers      
> cached
> Mem:        241116     235908       5208          0      10116       
> 87660
> -/+ buffers/cache:     138132     102984
> Swap:      1028152     154292     873860
>
> /proc/cpuinfo
> processor    : 0
> vendor_id    : GenuineIntel
> cpu family    : 6
> model        : 14
> model name    : Intel(R) Celeron(R) M CPU        420  @ 1.60GHz
> stepping    : 8
> cpu MHz        : 1596.045
> cache size    : 1024 KB
> fdiv_bug    : no
> hlt_bug        : no
> f00f_bug    : no
> coma_bug    : no
> fpu        : yes
> fpu_exception    : yes
> cpuid level    : 10
> wp        : yes
> flags        : fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca  
> cmov
> clflush dts acpi mmx fxsr sse sse2 ss tm pbe nx constant_tsc up
> arch_perfmon bts pni monitor tm2 xtpr pdcm
> bogomips    : 3192.09
> clflush size    : 64
> power management:
>
> remove test cases which require the block device.
> You can specify it with option -b
> COMMAND:    /opt/ltp/bin/ltp-pan  -e -S   -a 7506     -n 7506  -p  -f
> /tmp/ltp-07KEC2Bcm4/alltests -l
> /opt/ltp/results/LTP_RUN_ON-2010_Mar_03-22h_14m_34s.log  -C
> /opt/ltp/output/LTP_RUN_ON-2010_Mar_03-22h_14m_34s.failed
> -e LOG File: /opt/ltp/results/LTP_RUN_ON-2010_Mar_03-22h_14m_34s.log
> -e FAILED COMMAND File:
> /opt/ltp/output/LTP_RUN_ON-2010_Mar_03-22h_14m_34s.failed
> Running tests.......
> <<<test_start>>>
> tag=CPUHOTPLUG stime=1267634676
> cmdline="(cd $LTPROOT/testcases/kernel/hotplug/cpu_hotplug/; ./ 
> runtests.sh)"
> contacts=""
> analysis=exit
> <<<test_output>>>
> cd: 1: can't cd to /opt/ltp/testcases/kernel/hotplug/cpu_hotplug/
> incrementing stop
> CPU:        1
> LOOPS:      1
> LHCS_PATH:  /opt/ltp/testcases/bin
> Name:   hotplug01
> Date:   Wed Mar  3 22:14:36 IST 2010
> Desc:   What happens to disk controller interrupts when offlining  
> CPUs?
>
> CPU is 1
> Error: cpu1 not found
> hotplug01      FAIL: cpu1 not found!
> Wed Mar  3 22:14:37 IST 2010
> Name:   hotplug02
> Date:   Wed Mar  3 22:14:37 IST 2010
> Desc:   What happens to a process when its CPU is offlined?
>
> CPU is 1
> Error: cpu1 not found
> hotplug02      FAIL: cpu1 not found!
> Wed Mar  3 22:14:37 IST 2010
> exit: 35: Illegal number: -1
> Name:   hotplug03
> Date:   Wed Mar  3 22:14:37 IST 2010
> Desc:   Do tasks get scheduled to a newly on-lined CPU?
>
> CPU is 1
> Error: CPU1 not found
> hotplug03      FAIL: CPU1 not found!
> Wed Mar  3 22:14:37 IST 2010
> exit: 31: Illegal number: -1
> Name:   hotplug04
> Date:   Wed Mar  3 22:14:37 IST 2010
> Desc:   Does it prevent us from offlining the last CPU?
>
> functional/hotplug04.sh: 65: on[1]=cpuidle: not found
> functional/hotplug04.sh: 65: Bad substitution

Double ouch. Most likely involves a bashism...

> Name:   Hotplug Test - Test Case 6
> Date:   Wed Mar  3 22:14:37 IST 2010
> Desc:   Verify user tools can handle adding and removing CPUs.
>
> Name:   hotplug06.top
> Date:   Wed Mar  3 22:14:37 IST 2010
> Desc:   Does top work properly when CPU hotplug events occur?
>
> CPU is 1
> Error: CPU1 not found
> hotplug06.top      FAIL: CPU1 not found!
> Wed Mar  3 22:14:37 IST 2010
> exit: 31: Illegal number: -1

Incorrect (*ash hates explicitly signed numbers; signedness not  
mentioned in POSIX spec).

> Name:   hotplug06.sar
> Date:   Wed Mar  3 22:14:37 IST 2010
> Desc:   Does sar behave properly during CPU hotplug events?
>
> CPU is 1
> Error: CPU1 not found
> hotplug06.sar      FAIL: CPU1 not found!
> Wed Mar  3 22:14:37 IST 2010
> exit: 31: Illegal number: -1
>
> Name:   HotPlug Test - Test Case 7
> Date:   Wed Mar  3 22:14:37 IST 2010
> Desc:   What happens when hotplugging during a heavy workload?
> Issue:  Hotplug bugs have been found during kernel compiles
>
> get_affinity_mask 7652
> cat: /sys/devices/system/cpu/cpu1/online: No such file or directory
> [: 57: =: unexpected operator

Noise.

> Error:  CPU1 cannot be onlined
> Wed Mar  3 22:14:37 IST 2010
> functional/hotplug07.sh: 64: disown: not found

Missing command or bad path set.

> <<<execution_status>>>
> initiation_status="ok"
> duration=1 termination_type=exited termination_id=1 corefile=no
> cutime=3 cstime=3
> <<<test_end>>>
> INFO: ltp-pan reported some tests FAIL
> LTP Version: LTP-20100228
>
>       ###############################################################"
>
>            Done executing testcases."
>            LTP Version:  LTP-20100228
>       ###############################################################"
>
> maxin@maxin-laptop:/opt/ltp$ cd results/
> maxin@maxin-laptop:/opt/ltp/results$ cat  
> LTP_RUN_ON-2010_Mar_03-22h_14m_34s.log
> Test Start Time: Wed Mar  3 22:14:36 2010
> -----------------------------------------
> Testcase                       Result     Exit Value
> --------                       ------     ----------
> CPUHOTPLUG                     FAIL       1
>
> -----------------------------------------------
> Total Tests: 1
> Total Failures: 1
> Kernel Version: 2.6.31-19-generic
> Machine Architecture: i686
> Hostname: maxin-laptop
> <cpu_hotplug_makefile.patch>

It looks better but it's going to need a minor amount of fudging in  
the scripts to source the appropriate scripts to execute cpuhotplug's  
tests... I'll pick this up tomorrow if it's not done by then...
Thanks,
-Garrett

------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Ltp-list mailing list
Ltp-list@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ltp-list

Re: [LTP] Missing test tools in recent ltp builds

[Rishikesh K Rajak]

On Wed, Mar 03, 2010 at 03:16:47PM -0800, Garrett Cooper wrote:
> On Mar 3, 2010, at 9:00 AM, Maxin John <maxin.john@gmail.com> wrote:
> 
> > Hi Shwetabh,
> >
> >> 3. Went to /opt/ltp directory and tried to execute cpuhotplug test:
> >> [root@localhost ~]# cd /opt/ltp/
> >> [root@localhost ltp]# ./runltp -f cpuhotplug
> >>
> >
> > Please find attached the quick 'n' dirty patch
> > (cpu_hotplugin_makefile.patch) to execute cpuhotplugin test.
> > I have observed that the 'hotplug' directory is not included in
> > "testcases/kernel/Makefile". I have also
> > created a Makefile in 'hotplug/cpu_hotplug' directory.
> >
> > After applying this patch, I have followed the usual ./configure;
> > make; sudo make install steps and executed
> > the cpuhotplug test and observed the below given output . It seems
> > like the test execution is "not so good" in
> > my machine. Your mileage may vary.
> >
> > Garret,Rishi, please review the patch and let me know your comments.
> >
> > Signed-off-by: Maxin B. John <maxin.john@gmail.com>
> 
> It looks better but it's going to need a minor amount of fudging in  
> the scripts to source the appropriate scripts to execute cpuhotplug's  
> tests... I'll pick this up tomorrow if it's not done by then...

Yes it looks better, i have tested it and true there are still some
problem with testcase, can you look very closely and try to find the
root cause for that ? Since this patch is important to run cpuhotplug
testcases, i have included this to master branch.

Acked & Tested-By: Rishikesh K Rajak <risrajak@linux.vnet.ibm.com>

-Rishi

> Thanks,
> -Garrett
-- 
Thanks & Regards
Rishi
LTP Maintainer
IBM, LTC, Bangalore
Please join IRC #ltp @ irc.freenode.net

------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Ltp-list mailing list
Ltp-list@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ltp-list

Re: [LTP] Missing test tools in recent ltp builds

[Garrett Cooper]

On Wed, Mar 3, 2010 at 10:45 PM, Rishikesh K Rajak
<risrajak@linux.vnet.ibm.com> wrote:
> On Wed, Mar 03, 2010 at 03:16:47PM -0800, Garrett Cooper wrote:
>> On Mar 3, 2010, at 9:00 AM, Maxin John <maxin.john@gmail.com> wrote:
>>
>> > Hi Shwetabh,
>> >
>> >> 3. Went to /opt/ltp directory and tried to execute cpuhotplug test:
>> >> [root@localhost ~]# cd /opt/ltp/
>> >> [root@localhost ltp]# ./runltp -f cpuhotplug
>> >>
>> >
>> > Please find attached the quick 'n' dirty patch
>> > (cpu_hotplugin_makefile.patch) to execute cpuhotplugin test.
>> > I have observed that the 'hotplug' directory is not included in
>> > "testcases/kernel/Makefile". I have also
>> > created a Makefile in 'hotplug/cpu_hotplug' directory.
>> >
>> > After applying this patch, I have followed the usual ./configure;
>> > make; sudo make install steps and executed
>> > the cpuhotplug test and observed the below given output . It seems
>> > like the test execution is "not so good" in
>> > my machine. Your mileage may vary.
>> >
>> > Garret,Rishi, please review the patch and let me know your comments.
>> >
>> > Signed-off-by: Maxin B. John <maxin.john@gmail.com>
>>
>> It looks better but it's going to need a minor amount of fudging in
>> the scripts to source the appropriate scripts to execute cpuhotplug's
>> tests... I'll pick this up tomorrow if it's not done by then...
>
> Yes it looks better, i have tested it and true there are still some
> problem with testcase, can you look very closely and try to find the
> root cause for that ? Since this patch is important to run cpuhotplug
> testcases, i have included this to master branch.

    I'm not arguing that it's a good step towards getting the task
solved; I'm arguing that the change wasn't complete. I'm cleaning it
up right now...
Thanks,
-Garrett

------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Ltp-list mailing list
Ltp-list@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ltp-list

Re: [LTP] Missing test tools in recent ltp builds

[Shwetabh]

Hi Garett,

There is one possible problem with the current solution provided by 
Maxin. The patch takes care
only of cpuhotplug tests. However, judging by the number of files that 
are missing in /opt/ltp/testcases,
it is quite possible that many other tests might have been broken. So, 
perhaps a generic solution to this
problem would be to modify the Makefile to ensure that it copies all 
directories from ltp-full-20100228/testcases/
to /opt/ltp/testcases/.

Here is a listing of files in both directories after an installation has 
been performed:

----Installation Directory------
[root@localhost ~]# ls -l /root/ltp-full-20100228/testcases/
total 56
drwxrwxr-x  3 500 500 4096 Mar  1 09:58 ballista
drwxrwxr-x 15 500 500 4096 Mar  1 09:58 commands
drwxrwxr-x  6 500 500 4096 Mar  1 09:58 DOTS
drwxrwxr-x  5 500 500 4096 Mar  1 09:58 kdump
drwxrwxr-x 21 500 500 4096 Mar  1 09:58 kernel
drwxrwxr-x  2 500 500 4096 Mar  1 09:58 lib
-rw-rw-r--  1 500 500 1381 Mar  1 09:58 Makefile
drwxrwxr-x  9 500 500 4096 Mar  1 09:58 mce-test
drwxrwxr-x  6 500 500 4096 Mar  1 09:58 misc
drwxrwxr-x 18 500 500 4096 Mar  3 19:00 network
drwxrwxr-x 15 500 500 4096 Mar  1 09:58 open_hpi_testsuite
drwxrwxr-x  7 500 500 4096 Mar  1 09:58 open_posix_testsuite
drwxrwxr-x  5 500 500 4096 Mar  1 09:58 pounder21
drwxrwxr-x 13 500 500 4096 Mar  3 18:51 realtime
---------------------------------

------Target Directory-----------
[root@localhost ~]# ls -l /opt/ltp/testcases/
total 76
drwxr-xr-x 7 root root 69632 Mar  3 19:01 bin
drwxr-xr-x 2 root root  4096 Mar  3 19:01 data
---------------------------------

Regards,
Shwetabh


On 3/4/2010 12:20 PM, Garrett Cooper wrote:
> On Wed, Mar 3, 2010 at 10:45 PM, Rishikesh K Rajak
> <risrajak@linux.vnet.ibm.com>  wrote:
>    
>> On Wed, Mar 03, 2010 at 03:16:47PM -0800, Garrett Cooper wrote:
>>      
>>> On Mar 3, 2010, at 9:00 AM, Maxin John<maxin.john@gmail.com>  wrote:
>>>
>>>        
>>>> Hi Shwetabh,
>>>>
>>>>          
>>>>> 3. Went to /opt/ltp directory and tried to execute cpuhotplug test:
>>>>> [root@localhost ~]# cd /opt/ltp/
>>>>> [root@localhost ltp]# ./runltp -f cpuhotplug
>>>>>
>>>>>            
>>>> Please find attached the quick 'n' dirty patch
>>>> (cpu_hotplugin_makefile.patch) to execute cpuhotplugin test.
>>>> I have observed that the 'hotplug' directory is not included in
>>>> "testcases/kernel/Makefile". I have also
>>>> created a Makefile in 'hotplug/cpu_hotplug' directory.
>>>>
>>>> After applying this patch, I have followed the usual ./configure;
>>>> make; sudo make install steps and executed
>>>> the cpuhotplug test and observed the below given output . It seems
>>>> like the test execution is "not so good" in
>>>> my machine. Your mileage may vary.
>>>>
>>>> Garret,Rishi, please review the patch and let me know your comments.
>>>>
>>>> Signed-off-by: Maxin B. John<maxin.john@gmail.com>
>>>>          
>>> It looks better but it's going to need a minor amount of fudging in
>>> the scripts to source the appropriate scripts to execute cpuhotplug's
>>> tests... I'll pick this up tomorrow if it's not done by then...
>>>        
>> Yes it looks better, i have tested it and true there are still some
>> problem with testcase, can you look very closely and try to find the
>> root cause for that ? Since this patch is important to run cpuhotplug
>> testcases, i have included this to master branch.
>>      
>      I'm not arguing that it's a good step towards getting the task
> solved; I'm arguing that the change wasn't complete. I'm cleaning it
> up right now...
> Thanks,
> -Garrett
>
>    

------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Ltp-list mailing list
Ltp-list@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ltp-list

Re: [LTP] Missing test tools in recent ltp builds

[Maxin John]

Hi Shwetabh,

> There is one possible problem with the current solution provided by Maxin.
> The patch takes care
> only of cpuhotplug tests. However, judging by the number of files that are
> missing in /opt/ltp/testcases,
> it is quite possible that many other tests might have been broken. So,
> perhaps a generic solution to this
> problem would be to modify the Makefile to ensure that it copies all
> directories from ltp-full-20100228/testcases/
> to /opt/ltp/testcases/.

Yes, I do agree with you. This patch is intented only for the cpuhotplug tests.

Another solution (old school method) will be to have a look into the
LTP's "TODO" file :)
In that file, we can locate a number of "items missing from LTP
install based on the output log provided by runltp[lite.sh]".  Please
have a look into the "testscripts/ltp-missing-install-files.py" script
for the logic behind it.

Best Regards,
Maxin B. John

------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Ltp-list mailing list
Ltp-list@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ltp-list