Re: [LTP] [ANNOUNCE] The Linux Test Project has been released for JANUARY 2024

Petr Vorel
2024-02-03T23:57:33Z

Hi all,

> Good news everyone,

> the Linux Test Project test suite stable release for *January 2024* has been
> released.

> Since the last release 315 patches by 34 authors were merged.

> Patch review is what most of the projects struggle with and LTP is no
> different. If you can spare some effort helping with the patch review is more
> than welcomed.

> NOTABLE CHANGES
> ===============

FYI, there is missing removal of runtest/connectors [1], which can break some
tooling.

Kind regards,
Petr

[1] https://github.com/linux-test-project/ltp/commit/9b642d89c0bcf5885b051c2d5768fa94b61d86cb

> * New tests
> - splice07, accept03, readahead01:

> Tests that feeds the syscall all kinds of invalid file descriptors and
> checks that the syscall fails properly.

> - proc_sched_rt01 a regression test for:

> c1fc6484e1fb ("sched/rt: sysctl_sched_rr_timeslice show default timeslice after reset")
> 079be8fc6309 ("sched/rt: Disallow writing invalid values to sched_rt_period_us")

> - ksm07 a test for KSM smart-scan.

> - pathconf02 negative testcases for pathconf()

> - pipe15 A regresson test for:

> 46c4c9d1beb7 ("pipe: increase minimum default pipe size to 2 pages")

> - nft02 A regression test for:

> 515ad530795c ("netfilter: nf_tables: do not ignore genmask when looking up chain by id") aka CVE-2023-31248

> - sched_setscheduler04 a test for SCHED_RESET_ON_FORK

> - setsockopt10 2c02d41d71f9 ("net/ulp: prevent ULP without clone op from entering the LISTEN status") aka CVE-2023-0461

> - gettid02 A basic gettid02 test.

> - splice06 A test that splicing from a /proc files works.

> * Increased coverage

> - ioctl02 cover more modern termios ioctls() as well.

> - fanotify13 More test coverage for overlayfs.

> - input* test now check UI_GET_NAME ioctl() too.

> * Removed tests

> - fork12 Which was a naive fork bomb test, we do have other tests
> (setrlimit01.c, ...) that better cover this scenario.

> - mongo test framework

> Which was test reiser, ext2 and jfs unmaintained for a decade.

> - simple_tracer.c Tracing test from 2009 that does not compile anymore.

> - runtest/fsx-linux This is consolidation of runtest files, since these test
> duplicated in ltp-aiodio.part3.

> - testscripts/autofs{1,4}.sh, testscripts/sysfs.sh,
> testscripts/ltp-scsi_debug.sh, testscripts/ltpdmmapper.sh

> These were unmaintained and unused scripts.

> - scsi/* A testsuite with a custom kernel module for kernel 2.5 that didn't
> compile cleanly for decades.

> - load_stress_all_kernel_modules.sh Broken for quite some time.

> * The LTP library now has a functions to iterate over different
> file descriptors. That allows us to easily implement more comprehensive tests
> that feed various syscalls all possible file descriptors and check that the
> syscall fails properly with invalid combinations. Most notable use of this
> library is the newly introduced splice07.c test.

> * The minimal size of the device for a few filesystem tests was increased to
> 1GB because modern filesystems, most notably Btrfs does not work properly on
> smaller devices.

> * LTP now tests bcachefs if kernel support and bcache.mkfs is present

> * 30 testcases were converted to the new test library

> + The usual amount of fixes and cleanups

> NOTABLE CHANGES IN NETWORK TESTS
> ================================
> brought to you by Petr Vorel

> The performance tests in net.features can be now skipped by setting
> LTP_NET_FEATURES_IGNORE_PERFORMANCE_FAILURE=1 which is useful when testing is
> executed on VMs on a overloaded host or if we are running tests with a
> background load.

> KIRK (previously RUNLTP-NG)
> ===========================

> Kirk was updated to v1.2

> This version brings the following updates:

> - show both stdout and stderr when executing tests on host
> - support for external commands on different SUTs
> - warning message when SUT doesn't support parallel execution
> - more stable epoll() communication with LTX
> - minor fixes
> - updated documentation

> DOWNLOAD AND LINKS
> ==================

> The latest version of the test-suite contains 3000+ tests for the Linux
> and can be downloaded at:

> https://github.com/linux-test-project/ltp/releases/tag/20240129

> The project pages as well as GIT repository are hosted on GitHub:

> https://github.com/linux-test-project/ltp
> http://linux-test-project.github.io/

> If you ever wondered how to write a LTP testcase, don't miss our developer
> documentation at:

> https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines

> https://github.com/linux-test-project/ltp/wiki/C-Test-API

> https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API

> https://github.com/linux-test-project/ltp/wiki/Shell-Test-API

> https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial

> https://github.com/linux-test-project/ltp/wiki/Build-System

> Patches, new tests, bugs, comments or questions should go to to our mailing
> list at ltp@lists.linux.it.

> CREDITS
> =======

> Many thanks to the people contributing to this release:

> git shortlog -s -e -n 20230929..

> 147 Petr Vorel <pvorel@suse.cz>
> 25 Yang Xu <xuyang2018.jy@fujitsu.com>
> 21 Andrea Cervesato <andrea.cervesato@suse.com>
> 18 Martin Doucha <mdoucha@suse.cz>
> 12 Cyril Hrubis <chrubis@suse.cz>
> 11 Marius Kittler <mkittler@suse.de>
> 8 Wei Gao <wegao@suse.com>
> 7 Amir Goldstein <amir73il@gmail.com>
> 7 Richard Palethorpe <rpalethorpe@suse.com>
> 6 Avinesh Kumar <akumar@suse.de>
> 6 Edward Liaw <edliaw@google.com>
> 6 Jan Kara <jack@suse.cz>
> 5 Jan Stancek <jstancek@redhat.com>
> 4 Hongchen Zhang <zhanghongchen@loongson.cn>
> 4 Kevin Brodsky <kevin.brodsky@arm.com>
> 4 Xiao Yang <yangx.jy@fujitsu.com>
> 3 Shiyang Ruan <ruansy.fnst@fujitsu.com>
> 2 Li Wang <liwang@redhat.com>
> 2 Li Zhijian <lizhijian@fujitsu.com>
> 2 Pengfei Xu <pengfei.xu@intel.com>
> 2 Stefan Roesch <shr@devkernel.io>
> 1 Alexander Kanavin <alex@linutronix.de>
> 1 Brennan Ashton <bashton@brennanashton.com>
> 1 Korobeynikov Gleb <mathkgd@mail.ru>
> 1 Marcos Paulo de Souza <mpdesouza@suse.com>
> 1 Mengchi Cheng <mengcc@amazon.com>
> 1 Murphy Zhou <jencce.kernel@gmail.com>
> 1 Shizhao Chen <shichen@redhat.com>
> 1 Shoukui Zhang <zhangshoukui@xiaomi.com>
> 1 Subramanya Swamy <subramanya.swamy.linux@gmail.com>
> 1 haopengxiang <haopengxiang@xiaomi.com>
> 1 nietingting <nietingting@xiaomi.com>
> 1 wangxuewen <wangxuewen@kylinos.cn>
> 1 ybonatakis <ybonatakis@suse.com>

> And also thanks to patch reviewers:

> git log 20230929.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

> 111 Petr Vorel <pvorel@suse.cz>
> 70 Cyril Hrubis <chrubis@suse.cz>
> 47 Li Wang <liwang@redhat.com>
> 35 Richard Palethorpe <rpalethorpe@suse.com>
> 14 Martin Doucha <mdoucha@suse.cz>
> 8 Amir Goldstein <amir73il@gmail.com>
> 7 Xiao Yang <yangx.jy@fujitsu.com>
> 7 Marius Kittler <mkittler@suse.de>
> 6 Jan Kara <jack@suse.cz>
> 4 Avinesh Kumar <akumar@suse.de>
> 3 Andrea Cervesato <andrea.cervesato@suse.com>
> 3 Jan Stancek <jstancek@redhat.com>
> 2 Yang Xu <xuyang2018.jy@fujitsu.com>
> 1 Petr Vorel <petr.vorel@gmail.com>
> 1 Christian Brauner <brauner@kernel.org>