From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.3 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED, USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 82C6CC433E2 for ; Thu, 17 Sep 2020 19:16:48 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 36EE020874 for ; Thu, 17 Sep 2020 19:16:48 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1600370208; bh=wwHhr9kNyK/fz58Shvmyf4hmRwf5NeceRlbJ/UjWonI=; h=Subject:To:Cc:References:From:Date:In-Reply-To:List-ID:From; b=eeGGqiCOiy8TYUBpBAD8UAh5WJsOW1OXbXbmLIPWsisB5c2C7mZ6vLyC+eKS3yKtI Mp67aY1wT3cihzDdu3soYlZUg+lEL6gebFFhNhb4FPK4VdK33EhREMEJm6K1uYZSWt kGLPxALwvr5RPgB+IBduoYZYmFuWsyHPf9ynijA8= Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726489AbgIQTQr (ORCPT ); Thu, 17 Sep 2020 15:16:47 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:47848 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1728400AbgIQQS2 (ORCPT ); Thu, 17 Sep 2020 12:18:28 -0400 Received: from mail-oi1-x232.google.com (mail-oi1-x232.google.com [IPv6:2607:f8b0:4864:20::232]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 642DBC061221 for ; Thu, 17 Sep 2020 09:10:56 -0700 (PDT) Received: by mail-oi1-x232.google.com with SMTP id x69so3071363oia.8 for ; Thu, 17 Sep 2020 09:10:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linuxfoundation.org; s=google; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=sIkLaR4efdKIlF3DeDLkZaf3VX9CKFcY1gO9EuwPjhw=; b=XU8RJN/MqigKWw0CVB3m421NSqReUXfksDaZGEyos2nBpoXl1ju1yQqAubTgkTJcbn Le3xlkK/DbAdJStJ9Kh9Bjhx49Wq/gJyUoaIS9wL37TLIYu4rZcIHLj1dV8yjD9eSchs PeAb/xmeHxw4VmpM/0bVHuVg3XX2EEkwKPFaY= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=sIkLaR4efdKIlF3DeDLkZaf3VX9CKFcY1gO9EuwPjhw=; b=om2dtKdWu7smRhyzPZN/3xQReCQJ92rC3GTSdSwm1PV/1nZxAMj57O2Vg9G7PEEeNN qDK36c/iqbytEFLbdhVzejd60QDPmttRZFsIIrkkNJTaUToeXKi7BPaFlCk0UCyQ8HuV eS8mQZ4CY73a23bVoEkP54QZyqJ80M2PNBr3mDGR1J3b2NC7qOxTxZklxhHkYrRcfnRE 8zzonC7q8rNlm2k+gHWT9fqNz8zVB1IY2h0m5kr4uZ5ay/8wcdcr6yNgC0ZcM9MUqns4 mfXCvDqdto21AlDe0PGZnoH7ilVTOlKhT4QWJ38vLw+AdfoJ3ALwEIcEXa+FQgHgjUna a42g== X-Gm-Message-State: AOAM533OKE16c4peGLkQGBguQKofcOPum8FFS+clxczkoG7hbFUf7Jmf Kfc/F25tGgmTexTyj3luA9ukKhy8pMuyNg== X-Google-Smtp-Source: ABdhPJxKcRfkmpsNQA0mhR4Fli9We9m5QG7yYc9oVq3FyDc4BnJseyAtqM5dWR75FNB7KWGez3Xl9A== X-Received: by 2002:aca:de08:: with SMTP id v8mr6613587oig.82.1600359050849; Thu, 17 Sep 2020 09:10:50 -0700 (PDT) Received: from [192.168.1.112] (c-24-9-64-241.hsd1.co.comcast.net. [24.9.64.241]) by smtp.gmail.com with ESMTPSA id d17sm126456oth.73.2020.09.17.09.10.49 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 17 Sep 2020 09:10:50 -0700 (PDT) Subject: Re: [REGRESSION] kselftest: next-20200915 To: Justin Cook Cc: LKFT , lkft-triage@lists.linaro.org, linux-kselftest@vger.kernel.org, linux-next@vger.kernel.org, sfr@canb.auug.org.au, shuah@kernel.org, Shuah Khan References: <0100017492de8180-c524cff4-bd4e-4777-9f33-7e1da2c986d2-000000@email.amazonses.com> From: Shuah Khan Message-ID: <0263c321-5d2d-8822-6ed9-3ea24efce4dd@linuxfoundation.org> Date: Thu, 17 Sep 2020 10:10:49 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.10.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit Precedence: bulk List-ID: X-Mailing-List: linux-kselftest@vger.kernel.org Hi Justin, On 9/17/20 9:52 AM, Justin Cook wrote: > Shuah, > > The report sent was meant to be a general summary, rather than a deep > dive, of the results. Most of that information can be gathered by > viewing the test details. > >> * Test details: >> https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20200915 > > If you open that link in a web browser, there are a number of ways to > dig down into the results. If you have questions about the best ways > to do this, please let me know. > Yes. I did look at the results. It isn't easy to figure out. It would help is cc'ing the test authors in addition to the list. There are two failed tests if recall correctly, mm and kvm. cc'ing and subsystem mailing lists and authors for the last commit for the test in question will get you results quickly. > Maybe that isn't the best way? I'm very open to feedback. I just tried > to best copy the previous report that was being sent out to start. > We had the same problem with the previous report. It just tells you which tests regressed. It is a good start. Unfortunately without tagging test authors/maintainers it won't get addressed. thanks, -- Shuah