From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id D1C8AC433F5 for ; Tue, 10 May 2022 17:06:46 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S243998AbiEJRKm (ORCPT ); Tue, 10 May 2022 13:10:42 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:50342 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S238571AbiEJRKl (ORCPT ); Tue, 10 May 2022 13:10:41 -0400 Received: from ams.source.kernel.org (ams.source.kernel.org [145.40.68.75]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id A6FD253E38 for ; Tue, 10 May 2022 10:06:43 -0700 (PDT) Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ams.source.kernel.org (Postfix) with ESMTPS id 5CF81B81D2E for ; Tue, 10 May 2022 17:06:42 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id C5473C385A6; Tue, 10 May 2022 17:06:40 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1652202401; bh=q7J2WH5N5gDwoaobqal2v9K8HktLcbKwiFlz3iwpMzs=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=uJcj/V3xREczRWzdVb+5/WQHqIlpZzwyzx2IHFnYiPL3RutyXtON2J95PqifSejaL /RTkpfhzhOzTFj/NyCHPMK4p2a747h0eGHMljZ73Vgd9UTkB0QdajoDi1XX9COIMIq xciIaoNyQ2iAHaATBix3sY8dsHYi0hqzDDAV+xYOm2Mhzvn1LItFRtuDgRe61lcyhj v+sqCDoZAZd9LSYiGIQgDw9Q74z5+KgsWEPSQ6w6ShrTrldZmxRMVbkvp3AV8ZxNuQ I6Pv5xONVwOKKB3S5YVFbgDFEEDRfPwFqDzdb3DS9JOkg0TgGwzrJaVzSSMe9b7gNm RXkCvIYO1Kdbg== Received: by quaco.ghostprotocols.net (Postfix, from userid 1000) id AFDC0400B1; Tue, 10 May 2022 14:06:38 -0300 (-03) Date: Tue, 10 May 2022 14:06:38 -0300 From: Arnaldo Carvalho de Melo To: Athira Rajeev Cc: Jiri Olsa , disgoel@linux.vnet.ibm.com, Michael Ellerman , linux-perf-users@vger.kernel.org, linuxppc-dev@lists.ozlabs.org, maddy@linux.vnet.ibm.com, rnsastry@linux.ibm.com, kjain@linux.ibm.com, irogers@google.com Subject: Re: [PATCH] tools/perf/tests: Skip perf BPF test if clang is not present Message-ID: References: <20220505100039.58287-1-atrajeev@linux.vnet.ibm.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Url: http://acmel.wordpress.com Precedence: bulk List-ID: X-Mailing-List: linux-perf-users@vger.kernel.org Em Fri, May 06, 2022 at 03:07:51PM +0530, Athira Rajeev escreveu: > > > > On 05-May-2022, at 10:51 PM, Arnaldo Carvalho de Melo wrote: > > > > Em Thu, May 05, 2022 at 03:30:39PM +0530, Athira Rajeev escreveu: > >> Perf BPF filter test fails in environment where "clang" > >> is not installed. > >> > >> Test failure logs: > >> > >> <<>> > >> 42: BPF filter : > >> 42.1: Basic BPF filtering : Skip > >> 42.2: BPF pinning : FAILED! > >> 42.3: BPF prologue generation : FAILED! > >> <<>> > >> > >> Enabling verbose option provided debug logs which says > >> clang/llvm needs to be installed. Snippet of verbose logs: > >> > >> <<>> > >> 42.2: BPF pinning : > >> --- start --- > >> test child forked, pid 61423 > >> ERROR: unable to find clang. > >> Hint: Try to install latest clang/llvm to support BPF. > >> Check your $PATH > >> > >> <> > >> > >> Failed to compile test case: 'Basic BPF llvm compile' > >> Unable to get BPF object, fix kbuild first > >> test child finished with -1 > >> ---- end ---- > >> BPF filter subtest 2: FAILED! > >> <<>> > >> > >> Here subtests, "BPF pinning" and "BPF prologue generation" > >> failed and logs shows clang/llvm is needed. After installing > >> clang, testcase passes. > >> > >> Reason on why subtest failure happens though logs has proper > >> debug information: > >> Main function __test__bpf calls test_llvm__fetch_bpf_obj by > >> passing 4th argument as true ( 4th arguments maps to parameter > >> "force" in test_llvm__fetch_bpf_obj ). But this will cause > >> test_llvm__fetch_bpf_obj to skip the check for clang/llvm. > >> > >> Snippet of code part which checks for clang based on > >> parameter "force" in test_llvm__fetch_bpf_obj: > >> > >> <<>> > >> if (!force && (!llvm_param.user_set_param && > >> <<>> > >> > >> Since force is set to "false", test won't get skipped and > >> fails to compile test case. The BPF code compilation needs > >> clang, So pass the fourth argument as "false" and also skip > >> the test if reason for return is "TEST_SKIP" > >> > >> After the patch: > >> > >> <<>> > >> 42: BPF filter : > >> 42.1: Basic BPF filtering : Skip > >> 42.2: BPF pinning : Skip > >> 42.3: BPF prologue generation : Skip > >> <<>> > > > > Wouldn't it be better to add the reason for the skip, like other tests > > do? > > > > E.g.: > > > > 23: Watchpoint : > > 23.1: Read Only Watchpoint : Skip (missing hardware support) > > 23.2: Write Only Watchpoint : Ok > > 23.3: Read / Write Watchpoint : Ok > > 23.4: Modify Watchpoint > > > > Something like: > > > > After the patch: > > > > <<>> > > 42: BPF filter : > > 42.1: Basic BPF filtering : Skip (clang not installed) > > 42.2: BPF pinning : Skip (clang not installed) > > 42.3: BPF prologue generation : Skip (clang not installed) > > > Hi Arnaldo, > > I tried to use TEST_CASE_REASON("BPF pinning", bpf_pinning, "clang not installed") > > The clang check is done in test_llvm__fetch_bpf_obj under some condition checks: > > <<>> > /* > * Skip this test if user's .perfconfig doesn't set [llvm] section > * and clang is not found in $PATH > */ > if (!force && (!llvm_param.user_set_param && > llvm__search_clang())) { > pr_debug("No clang, skip this test\n"); > return TEST_SKIP; > } > <<>> > > But the reason for BPF skip could happen at other places also ie non-root user, bpf support checks from check_env. > So can't exactly print the skip reason to be clang since It could get skipped from other environment checks too. Any suggestions Arnaldo ? We have cases where the framework isn't flexible enough to say exactly what was the reason for the failure and we use language such as "maybe clang isn't installed or some other reason?" - Arnaldo > Thanks > Athira > > > <<>> > > > >> Signed-off-by: Athira Rajeev > >> --- > >> tools/perf/tests/bpf.c | 4 ++-- > >> 1 file changed, 2 insertions(+), 2 deletions(-) > >> > >> diff --git a/tools/perf/tests/bpf.c b/tools/perf/tests/bpf.c > >> index 57b9591f7cbb..ae62f01239e3 100644 > >> --- a/tools/perf/tests/bpf.c > >> +++ b/tools/perf/tests/bpf.c > >> @@ -222,11 +222,11 @@ static int __test__bpf(int idx) > >> > >> ret = test_llvm__fetch_bpf_obj(&obj_buf, &obj_buf_sz, > >> bpf_testcase_table[idx].prog_id, > >> - true, NULL); > >> + false, NULL); > >> if (ret != TEST_OK || !obj_buf || !obj_buf_sz) { > >> pr_debug("Unable to get BPF object, %s\n", > >> bpf_testcase_table[idx].msg_compile_fail); > >> - if (idx == 0) > >> + if ((idx == 0) || (ret == TEST_SKIP)) > >> return TEST_SKIP; > >> else > >> return TEST_FAIL; > >> -- > >> 2.35.1 > > > > -- > > > > - Arnaldo -- - Arnaldo