[ANNOUNCE] The Linux Test Project has been released for JANUARY 2021

Cyril Hrubis
2021-01-21T12:29:07Z

Good news everyone,

the Linux Test Project test suite stable release for *January 2021* has been
released.

Since the last release 303 patches by 35 authors were merged.

NOTABLE CHANGES
===============

* New tests
- finit_module()
- init_module()
- delete_module()
- semctl09 for SEM_STAT_ANY flag
- msgctl06 for MSG_STAT_ANY flag
- shmctl04 for SHM_STAT_ANY flag
- sendmmsg() failure tests
- recvmmsg() failure tests
- open_by_handle_at()
- name_to_handle_at()
- ptrace11 to check if we can trace PID 1
- select04 failure tests
- select04 to check if rfds/wfds flags are clered on empty/full fd

* New regression tests
- inotify10 added test for fecc4559780d (fsnotify: fix events reported to watching parent and child)
- fanotify09 for 7372e79c9eb9 (fanotify: fix logic of reporting name info with watched parent)
- ptrace10 bd14406b78e6 (perf/hw_breakpoint: Modify breakpoint even if the new attr has disabled set)

* Increased coverage
- fanotify09 added case with FAN_CLOSE_NOWRITE on a sibling non-dir child

* Removed tests
- sync01, sync02 these tests were useless so there was no point in keeping them

* The metadata extraction patchset was merged. LTP now produces metadata.json
with a metadata for new library testcases and also html test catalogue build
from the extracted metadata.

https://github.com/linux-test-project/ltp/blob/master/docparse/README.md

* Kernel .config parser was rewritten to support proper boolean expressions

* LTP now requires pkg-config > 0.23 (working version 0.24 was released in 2010)

* Error handling in test library (mostly SAFE_MACROS()) was unified

* High level test library overview was written:
https://github.com/linux-test-project/ltp/blob/master/lib/README.md

* IMA/EVM
- fixed ima_tpm.sh for TPM 2.0 and for TPM 1.2 on kernel >= v5.8 (commit 6f1a1d103b48)
- rewrote ima_boot_aggregate.c to new API

* 16 testcases were converted to the new test library

+ The usual amount of fixes and cleanups.

NOTABLE CHANGES IN NETWORK TESTS
================================
brought to you by Petr Vorel

* New tests
- wireguard tests

* Fixes
- fix various false-positive failures in tests using tst_netload
(tests in net.features and net_stress.ipsec_* runtest files)
- if-mtu-change.sh on s390x: fix max packet size for IPv4

* Compatibility fixes:
- ping and traceroute from BusyBox
- MUSL (netstress)
- traceroute6 from iputils

+ various other fixes and cleanup

* Rewrite into new API
- host01
- netstat01.sh

DOWNLOAD AND LINKS
==================

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20210121

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial
https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines
https://github.com/linux-test-project/ltp/wiki/BuildSystem

Patches, new tests, bugs, comments or questions should go to to our mailing
list at ltp@lists.linux.it.

CREDITS
=======

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20200930..

88 Petr Vorel <pvorel@suse.cz>
52 Cyril Hrubis <chrubis@suse.cz>
25 Martin Doucha <mdoucha@suse.cz>
19 Yang Xu <xuyang2018.jy@cn.fujitsu.com>
18 Viresh Kumar <viresh.kumar@linaro.org>
10 Xiao Yang <yangx.jy@cn.fujitsu.com>
8 Alexey Kodanev <alexey.kodanev@oracle.com>
8 Amir Goldstein <amir73il@gmail.com>
8 Feiyu Zhu <zhufy.jy@cn.fujitsu.com>
8 Kory Maincent <kory.maincent@bootlin.com>
7 Radoslav Kolev <radoslav.kolev@suse.com>
5 Richard Palethorpe <rpalethorpe@suse.com>
4 Cixi Geng <cixi.geng1@unisoc.com>
4 Krzysztof Dynowski <k.dynowski@samsung.com>
4 Li Wang <liwang@redhat.com>
4 Po-Hsu Lin <po-hsu.lin@canonical.com>
4 Joerg Vehlow <joerg.vehlow@aox-tech.de>
3 Alexander Egorenkov <egorenar@linux.ibm.com>
2 Khem Raj <raj.khem@gmail.com>
2 Li Zhijian <lizhijian@cn.fujitsu.com>
2 Pengfei Xu <pengfei.xu@intel.com>
2 Tree Davies <tdavies@darkphysics.net>
2 Yang Xu <xuyang_jy_0410@163.com>
2 Bogdan Lezhepekov <bogdan.lezhepekov@suse.com>
2 Johannes Nixdorf <j.nixdorf@avm.de>
1 Alexander Egorenkov <Alexander.Egorenkov@ibm.com>
1 Deepak Rawat <derawa@microsoft.com>
1 Filip Bozuta <Filip.Bozuta@syrmia.com>
1 Jan Stancek <jstancek@redhat.com>
1 Peter Bee <bijunda1@xiaomi.com>
1 Petr Cervinka via ltp <ltp@lists.linux.it>
1 Punit Agrawal <punit1.agrawal@toshiba.co.jp>
1 Radoslav Kolev via ltp <ltp@lists.linux.it>
1 Xinpeng Liu <liuxp11@chinatelecom.cn>
1 bhargavdas <bhargav_das@mentor.com>

And also thanks to patch reviewers:

git log 20200930.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

114 Cyril Hrubis <chrubis@suse.cz>
58 Petr Vorel <pvorel@suse.cz>
51 Li Wang <liwang@redhat.com>
13 Yang Xu <xuyang2018.jy@cn.fujitsu.com>
11 Amir Goldstein <amir73il@gmail.com>
10 Alexey Kodanev <alexey.kodanev@oracle.com>
9 Jan Stancek <jstancek@redhat.com>
5 Xiao Yang <yangx.jy@cn.fujitsu.com>
5 Jan Kara <jack@suse.cz>
3 Xiao Yang <yangx.jy@cn.fujitsu.com>
5 Richard Palethorpe <rpalethorpe@suse.com>
3 Martin Doucha <mdoucha@suse.cz>
2 Mimi Zohar <zohar@linux.ibm.com>
1 Kory Maincent <kory.maincent@bootlin.com>
1 Joerg Vehlow <joerg.vehlow@aox-tech.de>

--
Cyril Hrubis
chrubis@suse.cz