AMD-GFX Archive on lore.kernel.org
 help / color / mirror / Atom feed
From: Jim Cromie <jim.cromie@gmail.com>
To: daniel.vetter@ffwll.ch, tvrtko.ursulin@linux.intel.com,
	jani.nikula@intel.com, ville.syrjala@linux.intel.com,
	jbaron@akamai.com, gregkh@linuxfoundation.org,
	ukaszb@chromium.org
Cc: linux-kernel@vger.kernel.org, dri-devel@lists.freedesktop.org,
	amd-gfx@lists.freedesktop.org,
	intel-gvt-dev@lists.freedesktop.org,
	intel-gfx@lists.freedesktop.org, linux@rasmusvillemoes.dk,
	joe@perches.com, mcgrof@kernel.org,
	Jim Cromie <jim.cromie@gmail.com>
Subject: [PATCH v9 27/52] selftests-dyndbg: check KCONFIG_CONFIG to avoid silly fails
Date: Tue,  2 Jul 2024 15:57:17 -0600	[thread overview]
Message-ID: <20240702215804.2201271-28-jim.cromie@gmail.com> (raw)
In-Reply-To: <20240702215804.2201271-1-jim.cromie@gmail.com>

Several tests are dependent upon config choices. Lets avoid failing
where that is noise.

The KCONFIG_CONFIG var exists to convey the config-file around.  If
the var names a file, read it and extract the relevant CONFIG items,
and use them to skip the dependent tests, thus avoiding the fails that
would follow, and the disruption to whatever CI is running these
selftests.

If the envar doesn't name a config-file, ".config" is assumed.

CONFIG_DYNAMIC_DEBUG=y:

basic-tests() and comma-terminator-tests() test for the presence of
the builtin pr_debugs in module/main.c, which I deemed stable and
therefore safe to count.  That said, the test fails if only
CONFIG_DYNAMIC_DEBUG_CORE=y is set.  It could be rewritten to test
against test-dynamic-debug.ko, but that just trades one config
dependence for another.

CONFIG_TEST_DYNAMIC_DEBUG=m

As written, test_percent_splitting() modprobes test_dynamic_debug,
enables several classes, and count them.  It could be re-written to
work for the builtin module also, but builtin test modules are not a
common or desirable build/config.

CONFIG_TEST_DYNAMIC_DEBUG=m && CONFIG_TEST_DYNAMIC_DEBUG_SUBMOD=m

test_mod_submod() recaps the bug found in DRM-CI where drivers werent
enabled by drm.debug=<bits>.  It modprobes both test_dynamic_debug &
test_dynamic_debug_submod, so it depends on a loadable modules config.

It could be rewritten to work in a builtin parent config; DRM=y is
common enough to be pertinent, but testing that config also wouldn't
really test anything more fully than all-loadable modules, since they
default together.

Signed-off-by: Jim Cromie <jim.cromie@gmail.com>

fixup-kconfig
---
 .../dynamic_debug/dyndbg_selftest.sh          | 45 ++++++++++++++++++-
 1 file changed, 44 insertions(+), 1 deletion(-)

diff --git a/tools/testing/selftests/dynamic_debug/dyndbg_selftest.sh b/tools/testing/selftests/dynamic_debug/dyndbg_selftest.sh
index fccd2012b548..d09ef26b2308 100755
--- a/tools/testing/selftests/dynamic_debug/dyndbg_selftest.sh
+++ b/tools/testing/selftests/dynamic_debug/dyndbg_selftest.sh
@@ -11,6 +11,30 @@ CYAN="\033[0;36m"
 NC="\033[0;0m"
 error_msg=""
 
+[ -e /proc/dynamic_debug/control ] || {
+    echo -e "${RED}: this test requires CONFIG_DYNAMIC_DEBUG=y ${NC}"
+    exit 0 # nothing to test here, no good reason to fail.
+}
+
+# need info to avoid failures due to untestable configs
+
+[ -f "$KCONFIG_CONFIG" ] || KCONFIG_CONFIG=".config"
+if [ -f "$KCONFIG_CONFIG" ]; then
+    echo "# consulting KCONFIG_CONFIG: $KCONFIG_CONFIG"
+    grep -q "CONFIG_DYNAMIC_DEBUG=y" $KCONFIG_CONFIG ; LACK_DD_BUILTIN=$?
+    grep -q "CONFIG_TEST_DYNAMIC_DEBUG=m" $KCONFIG_CONFIG ; LACK_TMOD=$?
+    grep -q "CONFIG_TEST_DYNAMIC_DEBUG_SUBMOD=m" $KCONFIG_CONFIG ; LACK_TMOD_SUBMOD=$?
+    if [ $V -eq 1 ]; then
+	echo LACK_DD_BUILTIN: $LACK_DD_BUILTIN
+	echo LACK_TMOD: $LACK_TMOD
+	echo LACK_TMOD_SUBMOD: $LACK_TMOD_SUBMOD
+    fi
+else
+    LACK_DD_BUILTIN=0
+    LACK_TMOD=0
+    LACK_TMOD_SUBMOD=0
+fi
+
 function vx () {
     echo $1 > /sys/module/dynamic_debug/parameters/verbose
 }
@@ -192,6 +216,10 @@ function check_err_msg() {
 
 function basic_tests {
     echo -e "${GREEN}# BASIC_TESTS ${NC}"
+    if [ $LACK_DD_BUILTIN -eq 1 ]; then
+	echo "SKIP"
+	return
+    fi
     ddcmd =_ # zero everything (except class'd sites)
     check_match_ct =p 0
     # there are several main's :-/
@@ -214,6 +242,10 @@ EOF
 
 function comma_terminator_tests {
     echo -e "${GREEN}# COMMA_TERMINATOR_TESTS ${NC}"
+    if [ $LACK_DD_BUILTIN -eq 1 ]; then
+	echo "SKIP"
+	return
+    fi
     # try combos of spaces & commas
     check_match_ct '\[params\]' 4 -r
     ddcmd module,params,=_		# commas as spaces
@@ -226,9 +258,12 @@ function comma_terminator_tests {
     ddcmd =_
 }
 
-    
 function test_percent_splitting {
     echo -e "${GREEN}# TEST_PERCENT_SPLITTING - multi-command splitting on % ${NC}"
+    if [ $LACK_TMOD -eq 1 ]; then
+	echo "SKIP"
+	return
+    fi
     ifrmmod test_dynamic_debug_submod
     ifrmmod test_dynamic_debug
     ddcmd =_
@@ -248,6 +283,14 @@ function test_percent_splitting {
 
 function test_mod_submod {
     echo -e "${GREEN}# TEST_MOD_SUBMOD ${NC}"
+    if [ $LACK_TMOD -eq 1 ]; then
+	echo "SKIP"
+	return
+    fi
+    if [ $LACK_TMOD_SUBMOD -eq 1 ]; then
+	echo "SKIP"
+	return
+    fi
     ifrmmod test_dynamic_debug_submod
     ifrmmod test_dynamic_debug
     ddcmd =_
-- 
2.45.2


  parent reply	other threads:[~2024-07-03 13:04 UTC|newest]

Thread overview: 90+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2024-07-02 21:56 [PATCH v9 00/53] fix CONFIG_DRM_USE_DYNAMIC_DEBUG=y Jim Cromie
2024-07-02 21:56 ` [PATCH v9 01/52] docs/dyndbg: update examples \012 to \n Jim Cromie
2024-07-02 21:56 ` [PATCH v9 02/52] test-dyndbg: fixup CLASSMAP usage error Jim Cromie
2024-07-02 21:56 ` [PATCH v9 03/52] dyndbg: reword "class unknown, " to "class:_UNKNOWN_" Jim Cromie
2024-07-02 21:56 ` [PATCH v9 04/52] dyndbg: make ddebug_class_param union members same size Jim Cromie
2024-07-02 21:56 ` [PATCH v9 05/52] dyndbg: replace classmap list with a vector Jim Cromie
2024-07-02 21:56 ` [PATCH v9 06/52] dyndbg: ddebug_apply_class_bitmap - add module arg, select on it Jim Cromie
2024-07-02 21:56 ` [PATCH v9 07/52] dyndbg: split param_set_dyndbg_classes to _module & wrapper fns Jim Cromie
2024-07-02 21:56 ` [PATCH v9 08/52] dyndbg: drop NUM_TYPE_ARRAY Jim Cromie
2024-07-02 21:56 ` [PATCH v9 09/52] dyndbg: reduce verbose/debug clutter Jim Cromie
2024-07-02 21:57 ` [PATCH v9 10/52] dyndbg: silence debugs with no-change updates Jim Cromie
2024-07-02 21:57 ` [PATCH v9 11/52] dyndbg: tighten ddebug_class_name() 1st arg type Jim Cromie
2024-07-02 21:57 ` [PATCH v9 12/52] dyndbg: tighten fn-sig of ddebug_apply_class_bitmap Jim Cromie
2024-07-02 21:57 ` [PATCH v9 13/52] dyndbg: reduce verbose=3 messages in ddebug_add_module Jim Cromie
2024-07-02 21:57 ` [PATCH v9 14/52] dyndbg-API: remove DD_CLASS_TYPE_(DISJOINT|LEVEL)_NAMES and code Jim Cromie
2024-07-02 21:57 ` [PATCH v9 15/52] dyndbg-API: fix DECLARE_DYNDBG_CLASSMAP Jim Cromie
2024-07-02 21:57 ` [PATCH v9 16/52] selftests-dyndbg: add tools/testing/selftests/dynamic_debug/* Jim Cromie
2024-07-02 21:57 ` [PATCH v9 17/52] dyndbg-API: promote DYNDBG_CLASSMAP_PARAM to API Jim Cromie
2024-07-02 21:57 ` [PATCH v9 18/52] dyndbg-doc: add classmap info to howto Jim Cromie
2024-07-02 21:57 ` [PATCH v9 19/52] dyndbg: treat comma as a token separator Jim Cromie
2024-07-02 21:57 ` [PATCH v9 20/52] selftests-dyndbg: add comma_terminator_tests Jim Cromie
2024-07-02 21:57 ` [PATCH v9 21/52] dyndbg: split multi-query strings with % Jim Cromie
2024-07-02 21:57 ` [PATCH v9 22/52] selftests-dyndbg: test_percent_splitting Jim Cromie
2024-07-02 21:57 ` [PATCH v9 23/52] docs/dyndbg: explain new delimiters: comma, percent Jim Cromie
2024-07-02 21:57 ` [PATCH v9 24/52] selftests-dyndbg: add test_mod_submod Jim Cromie
2024-07-02 21:57 ` [PATCH v9 25/52] dyndbg-doc: explain flags parse 1st Jim Cromie
2024-07-02 21:57 ` [PATCH v9 26/52] dyndbg: change __dynamic_func_call_cls* macros into expressions Jim Cromie
2024-07-02 21:57 ` Jim Cromie [this message]
2024-07-10 20:22   ` [PATCH v9 27/52] selftests-dyndbg: check KCONFIG_CONFIG to avoid silly fails Helen Koike
2024-07-14 16:13     ` jim.cromie
2024-07-02 21:57 ` [PATCH v9 28/52] dyndbg-selftest: reduce default verbosity Jim Cromie
2024-07-02 21:57 ` [PATCH v9 29/52] drm: use correct ccflags-y spelling Jim Cromie
2024-07-02 21:57 ` [PATCH v9 30/52] drm-dyndbg: adapt drm core to use dyndbg classmaps-v2 Jim Cromie
2024-07-02 23:33   ` Ville Syrjälä
2024-07-03  2:34     ` jim.cromie
2024-07-03 11:52       ` Ville Syrjälä
2024-07-03 16:11         ` jim.cromie
2024-07-10  0:25           ` jim.cromie
2024-07-02 21:57 ` [PATCH v9 31/52] drm-dyndbg: adapt DRM to invoke DYNDBG_CLASSMAP_PARAM Jim Cromie
2024-07-02 21:57 ` [PATCH v9 32/53] DRM-CLASSMAP-USE in drm-drv.c Jim Cromie
2024-07-02 22:21   ` jim.cromie
2024-07-02 21:57 ` [PATCH v9 32/52] drm-dyndbg: DRM_CLASSMAP_USE in amdgpu driver Jim Cromie
2024-07-02 21:57 ` [PATCH v9 33/53] " Jim Cromie
2024-07-02 21:57 ` [PATCH v9 33/52] drm-dyndbg: DRM_CLASSMAP_USE in i915 driver Jim Cromie
2024-07-02 21:57 ` [PATCH v9 34/52] drm-dyndbg: DRM_CLASSMAP_USE in drm_crtc_helper Jim Cromie
2024-07-02 21:57 ` [PATCH v9 34/53] drm-dyndbg: DRM_CLASSMAP_USE in i915 driver Jim Cromie
2024-07-02 21:57 ` [PATCH v9 35/53] drm-dyndbg: DRM_CLASSMAP_USE in drm_crtc_helper Jim Cromie
2024-07-02 21:57 ` [PATCH v9 35/52] drm-dyndbg: DRM_CLASSMAP_USE in drm_dp_helper Jim Cromie
2024-07-02 21:57 ` [PATCH v9 36/53] " Jim Cromie
2024-07-02 21:57 ` [PATCH v9 36/52] drm-dyndbg: DRM_CLASSMAP_USE in nouveau Jim Cromie
2024-07-02 21:57 ` [PATCH v9 37/53] " Jim Cromie
2024-07-02 21:57 ` [PATCH v9 37/52] drm-print: workaround unused variable compiler meh Jim Cromie
2024-07-02 21:57 ` [PATCH v9 38/52] drm-dyndbg: add DRM_CLASSMAP_USE to Xe driver Jim Cromie
2024-07-02 21:57 ` [PATCH v9 38/53] drm-print: workaround unused variable compiler meh Jim Cromie
2024-07-02 21:57 ` [PATCH v9 39/52] drm-dyndbg: add DRM_CLASSMAP_USE to virtio_gpu Jim Cromie
2024-07-02 21:57 ` [PATCH v9 39/53] drm-dyndbg: add DRM_CLASSMAP_USE to Xe driver Jim Cromie
2024-07-02 21:57 ` [PATCH v9 40/52] drm-dyndbg: add DRM_CLASSMAP_USE to simpledrm Jim Cromie
2024-07-02 21:57 ` [PATCH v9 40/53] drm-dyndbg: add DRM_CLASSMAP_USE to virtio_gpu Jim Cromie
2024-07-02 21:57 ` [PATCH v9 41/52] drm-dyndbg: add DRM_CLASSMAP_USE to bochs Jim Cromie
2024-07-02 21:57 ` [PATCH v9 41/53] drm-dyndbg: add DRM_CLASSMAP_USE to simpledrm Jim Cromie
2024-07-02 21:57 ` [PATCH v9 42/53] drm-dyndbg: add DRM_CLASSMAP_USE to bochs Jim Cromie
2024-07-02 21:57 ` [PATCH v9 42/52] drm-dyndbg: add DRM_CLASSMAP_USE to etnaviv Jim Cromie
2024-07-02 21:57 ` [PATCH v9 43/53] " Jim Cromie
2024-07-02 21:57 ` [PATCH v9 43/52] drm-dyndbg: add DRM_CLASSMAP_USE to gma500 driver Jim Cromie
2024-07-02 21:57 ` [PATCH v9 44/53] " Jim Cromie
2024-07-02 21:57 ` [PATCH v9 44/52] drm-dyndbg: add DRM_CLASSMAP_USE to radeon Jim Cromie
2024-07-02 21:57 ` [PATCH v9 45/53] " Jim Cromie
2024-07-02 21:57 ` [PATCH v9 45/52] drm-dyndbg: add DRM_CLASSMAP_USE to vmwgfx driver Jim Cromie
2024-07-02 21:57 ` [PATCH v9 46/52] drm-dyndbg: add DRM_CLASSMAP_USE to vkms driver Jim Cromie
2024-07-02 21:57 ` [PATCH v9 46/53] drm-dyndbg: add DRM_CLASSMAP_USE to vmwgfx driver Jim Cromie
2024-07-02 21:57 ` [PATCH v9 47/52] drm-dyndbg: add DRM_CLASSMAP_USE to udl driver Jim Cromie
2024-07-02 21:57 ` [PATCH v9 47/53] drm-dyndbg: add DRM_CLASSMAP_USE to vkms driver Jim Cromie
2024-07-02 21:57 ` [PATCH v9 48/52] drm-dyndbg: add DRM_CLASSMAP_USE to mgag200 driver Jim Cromie
2024-07-02 21:57 ` [PATCH v9 48/53] drm-dyndbg: add DRM_CLASSMAP_USE to udl driver Jim Cromie
2024-07-02 21:57 ` [PATCH v9 49/53] drm-dyndbg: add DRM_CLASSMAP_USE to mgag200 driver Jim Cromie
2024-07-02 21:57 ` [PATCH v9 49/52] drm-dyndbg: add DRM_CLASSMAP_USE to the gud driver Jim Cromie
2024-07-02 21:57 ` [PATCH v9 50/53] " Jim Cromie
2024-07-02 21:57 ` [PATCH v9 50/52] drm-dyndbg: add DRM_CLASSMAP_USE to the qxl driver Jim Cromie
2024-07-02 21:58 ` [PATCH v9 51/52] drm-dyndbg: add DRM_CLASSMAP_USE to the drm_gem_shmem_helper driver Jim Cromie
2024-07-02 21:58 ` [PATCH v9 51/53] drm-dyndbg: add DRM_CLASSMAP_USE to the qxl driver Jim Cromie
2024-07-02 21:58 ` [PATCH v9 52/53] drm-dyndbg: add DRM_CLASSMAP_USE to the drm_gem_shmem_helper driver Jim Cromie
2024-07-02 21:58 ` [PATCH v9 52/52] drm: restore CONFIG_DRM_USE_DYNAMIC_DEBUG un-BROKEN Jim Cromie
2024-07-02 21:58 ` [PATCH v9 53/53] " Jim Cromie
2024-07-02 22:01 ` [PATCH v9 00/53] fix CONFIG_DRM_USE_DYNAMIC_DEBUG=y Luis Chamberlain
2024-07-02 22:14   ` jim.cromie
2024-07-12 15:44     ` Łukasz Bartosik
2024-07-13 21:44       ` jim.cromie
2024-07-15 10:04         ` Łukasz Bartosik
2024-07-15 18:00           ` jim.cromie
2024-07-17 10:38             ` Łukasz Bartosik

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20240702215804.2201271-28-jim.cromie@gmail.com \
    --to=jim.cromie@gmail.com \
    --cc=amd-gfx@lists.freedesktop.org \
    --cc=daniel.vetter@ffwll.ch \
    --cc=dri-devel@lists.freedesktop.org \
    --cc=gregkh@linuxfoundation.org \
    --cc=intel-gfx@lists.freedesktop.org \
    --cc=intel-gvt-dev@lists.freedesktop.org \
    --cc=jani.nikula@intel.com \
    --cc=jbaron@akamai.com \
    --cc=joe@perches.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux@rasmusvillemoes.dk \
    --cc=mcgrof@kernel.org \
    --cc=tvrtko.ursulin@linux.intel.com \
    --cc=ukaszb@chromium.org \
    --cc=ville.syrjala@linux.intel.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox