From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from picard.linux.it (picard.linux.it [213.254.12.146]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 4C587C3ABAC for ; Tue, 6 May 2025 08:05:41 +0000 (UTC) Received: from picard.linux.it (localhost [IPv6:::1]) by picard.linux.it (Postfix) with ESMTP id D2C2F3C56CD for ; Tue, 6 May 2025 10:05:39 +0200 (CEST) Received: from in-4.smtp.seeweb.it (in-4.smtp.seeweb.it [217.194.8.4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (secp384r1)) (No client certificate requested) by picard.linux.it (Postfix) with ESMTPS id F1D273C56CD for ; Tue, 6 May 2025 10:05:23 +0200 (CEST) Received: from smtp-out2.suse.de (smtp-out2.suse.de [195.135.223.131]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by in-4.smtp.seeweb.it (Postfix) with ESMTPS id 755F51000472 for ; Tue, 6 May 2025 10:05:23 +0200 (CEST) Received: from imap1.dmz-prg2.suse.org (imap1.dmz-prg2.suse.org [IPv6:2a07:de40:b281:104:10:150:64:97]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by smtp-out2.suse.de (Postfix) with ESMTPS id A85681F443; Tue, 6 May 2025 08:05:22 +0000 (UTC) Authentication-Results: smtp-out2.suse.de; none Received: from imap1.dmz-prg2.suse.org (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by imap1.dmz-prg2.suse.org (Postfix) with ESMTPS id 1D17713A30; Tue, 6 May 2025 08:05:21 +0000 (UTC) Received: from dovecot-director2.suse.de ([2a07:de40:b281:106:10:150:64:167]) by imap1.dmz-prg2.suse.org with ESMTPSA id XrISOsHCGWi/UwAAD6G6ig (envelope-from ); Tue, 06 May 2025 08:05:21 +0000 Date: Tue, 6 May 2025 10:05:20 +0200 From: Petr Vorel To: Cyril Hrubis Message-ID: <20250506080520.GA64990@pevik> References: <20250429052247.GA144682@pevik> <4428939d-dc71-488b-9728-030accaca3e8@suse.cz> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 50.00]; REPLY(-4.00)[] X-Rspamd-Queue-Id: A85681F443 X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Rspamd-Action: no action X-Rspamd-Server: rspamd1.dmz-prg2.suse.org X-Virus-Scanned: clamav-milter 1.0.7 at in-4.smtp.seeweb.it X-Virus-Status: Clean Subject: Re: [LTP] LTP in valgrind :) X-BeenThere: ltp@lists.linux.it X-Mailman-Version: 2.1.29 Precedence: list List-Id: Linux Test Project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: Petr Vorel Cc: Mark Wielaard , ltp@lists.linux.it, Martin Cermak Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: ltp-bounces+ltp=archiver.kernel.org@lists.linux.it Sender: "ltp" Hi all, [ Cc Martin and Mark from Valgrind project ] > Hi! > > > It also opens some interesting questions, i.e. how do we make comparing > > > results from two different tests easier. Currently they grep the test > > > results for a summary, but maybe we can do better. > > One option is to extract all TPASS/TFAIL/TWARN/TBROK/TCONF messages, > > discard any message contents past the file:line header and then compare > > whether the sanitized output is identical. That'll take care of random > > values in the output while ensuring that the test went through the same > > code paths as before. We could provide a sanitizer script for that. > Maybe we can even add an option to the test library to supress the > messages in output, that would be fairly simple. @Martin @Mark: feel free to comment what we can do for you :). Whole thread: https://lore.kernel.org/ltp/20250505195003.GB137650@pevik/T/#t Kind regards, Petr -- Mailing list info: https://lists.linux.it/listinfo/ltp