From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.0 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,MENTIONS_GIT_HOSTING,SPF_HELO_NONE,SPF_PASS,URIBL_RHS_DOB, USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 43417C2D0DB for ; Mon, 20 Jan 2020 16:39:40 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 1A86D2073D for ; Mon, 20 Jan 2020 16:39:40 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729253AbgATQjj (ORCPT ); Mon, 20 Jan 2020 11:39:39 -0500 Received: from mx2.suse.de ([195.135.220.15]:50566 "EHLO mx2.suse.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1729190AbgATQji (ORCPT ); Mon, 20 Jan 2020 11:39:38 -0500 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.220.254]) by mx2.suse.de (Postfix) with ESMTP id 63533ABB3; Mon, 20 Jan 2020 16:39:36 +0000 (UTC) Date: Mon, 20 Jan 2020 17:39:33 +0100 From: Cyril Hrubis To: ltp@lists.linux.it, linux-kernel@vger.kernel.org, libc-alpha@sourceware.org Cc: lwn@lwn.net, akpm@linux-foundation.org, torvalds@linux-foundation.org Subject: [ANNOUNCE] The Linux Test Project has been released for JANUARY 2020 Message-ID: <20200120163933.GA7391@rei> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.10.1 (2018-07-13) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Good news everyone, the Linux Test Project test suite stable release for *January 2020* has been released. Since the last release 195 patches by 31 authors were merged. NOTABLE CHANGES =============== * New tests - vmsplice03 (splicing pipe to user memory) - prctl08, prctl09 (PR_{SET,GET}_TIMERSLACK) * New regression tests - bpf_prog03 * Increased coverage - quotactl tests were rewritten and coverage was increased * Additional 19 tests were converted to the new test library * Removed tests - TI-RPC authdes related tests (authdes is disabled by default since libtirpc 1.2.5) - openposix/pi_test* - ext4 features tests (the interesting bits are being moved to xfstests https://patchwork.kernel.org/patch/11290345/) * Our Travis now includes native ppc64le and s390x builds * Improved musl support, build with musl in Travis CI using Alpine Linux (broken tests are documented in Travis build script travis/alpine.sh) * Regression tests now print possibly missing kernel commits: -------------------------------------------------------------------------- snd_timer01.c:134: FAIL: kernel seems vulnerable HINT: You _MAY_ be missing kernel fixes, see: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=d11662f4f798 https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=ba3021b2c79b HINT: You _MAY_ be vulnerable to CVE(s), see: https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2017-1000380 Summary: passed 0 failed 1 skipped 0 warnings 0 -------------------------------------------------------------------------- + The usual amount of fixes and cleanups. METADATA EXTRACTION & TEST CATALOGUE ==================================== There is an ongoing experiment that attempts to extract metadata[1] from the testcases, we also have a proof of concept web page that renders the json metadata into a browseable test documentation[2]. There is not much there yet, but we are hoping, among other things, to build a nice, searchable and browseable test catalogue based on these efforts. [1] https://github.com/metan-ucw/ltp/tree/master/docparse [2] http://metan.ucw.cz/outgoing/metadata.html http://metan.ucw.cz/outgoing/metadata.html?test=abort01 http://metan.ucw.cz/outgoing/metadata.html?test=pcrypt_aead01 NOTABLE CHANGES IN NETWORK TESTS ================================ brought to you by Petr Vorel * iptables: add new test for iptables-translate and nft, add IPv6 support * route: rewrite route change destination, gateway and interface tests into new API DOWNLOAD AND LINKS ================== The latest version of the test-suite contains 3000+ tests for the Linux and can be downloaded at: https://github.com/linux-test-project/ltp/releases/tag/20190930 The project pages as well as GIT repository are hosted on GitHub: https://github.com/linux-test-project/ltp http://linux-test-project.github.io/ If you ever wondered how to write a LTP testcase, don't miss our developer documentation at: https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines https://github.com/linux-test-project/ltp/wiki/BuildSystem Patches, new tests, bugs, comments or questions should go to to our mailing list at ltp@lists.linux.it. CREDITS ======= Many thanks to the people contributing to this release: git shortlog -s -e -n 20190930.. 45 Petr Vorel 22 Jan Stancek 22 Yang Xu 13 Cyril Hrubis 13 Petr Vorel 11 Li Wang 10 Joerg Vehlow 10 Martin Doucha 7 Alexey Kodanev 6 Clemens Famulla-Conrad 5 Xiao Yang 3 Feiyu Zhu 2 Jorik Cronenberg 2 Pengfei Xu 2 Ping Fang 2 Richard Palethorpe 1 Cai Zhenglong 1 Dylan Chung 1 Eric Lin 1 Fabrice Fontaine 1 He Zhe 1 Ivan Hu 1 Ma Feng 1 Mathias Fiedler 1 Rachel Sibley 1 Song Jian 1 Sultan Alsawaf 1 Xiang Li 1 Yi Zhao 1 Yongxin Liu 1 Zou Wei And also thanks to patch reviewers: git log 20190930.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r 76 Cyril Hrubis 46 Petr Vorel 28 Li Wang 19 Jan Stancek 9 Alexey Kodanev 5 Clemens Famulla-Conrad 4 Richard Palethorpe 3 Yang Xu 1 Thadeu Lima de Souza Cascardo 1 Sumit Garg 1 Steve Dickson 1 Petr Vorel 1 Joerg Vehlow 1 Amir Goldstein -- Cyril Hrubis chrubis@suse.cz