* [PATCH net-next] selftests: netfilter: nft_concat_range.sh: reduce debug kernel run time
@ 2024-04-30 14:58 Florian Westphal
2024-05-01 15:59 ` Simon Horman
2024-05-01 22:00 ` patchwork-bot+netdevbpf
0 siblings, 2 replies; 5+ messages in thread
From: Florian Westphal @ 2024-04-30 14:58 UTC (permalink / raw)
To: netdev
Cc: Paolo Abeni, David S. Miller, Eric Dumazet, Jakub Kicinski,
netfilter-devel, pablo
Even a 1h timeout isn't enough for nft_concat_range.sh to complete on
debug kernels.
Reduce test complexity and only match on single entry if
KSFT_MACHINE_SLOW is set.
To spot 'slow' tests, print the subtest duration (in seconds) in
addition to the status.
Add new nft_concat_range_perf.sh script, not executed via kselftest,
to run the performance (pps match rate) tests.
Those need about 25m to complete which seems too much to run this
via 'make run_tests'.
Signed-off-by: Florian Westphal <fw@strlen.de>
---
.../testing/selftests/net/netfilter/Makefile | 2 ++
tools/testing/selftests/net/netfilter/config | 1 +
.../net/netfilter/nft_concat_range.sh | 28 +++++++++++++++----
.../net/netfilter/nft_concat_range_perf.sh | 9 ++++++
4 files changed, 34 insertions(+), 6 deletions(-)
create mode 100755 tools/testing/selftests/net/netfilter/nft_concat_range_perf.sh
diff --git a/tools/testing/selftests/net/netfilter/Makefile b/tools/testing/selftests/net/netfilter/Makefile
index 72c6001964a6..e9a6c702b8c9 100644
--- a/tools/testing/selftests/net/netfilter/Makefile
+++ b/tools/testing/selftests/net/netfilter/Makefile
@@ -28,6 +28,8 @@ TEST_PROGS += nft_zones_many.sh
TEST_PROGS += rpath.sh
TEST_PROGS += xt_string.sh
+TEST_PROGS_EXTENDED = nft_concat_range_perf.sh
+
TEST_GEN_PROGS = conntrack_dump_flush
TEST_GEN_FILES = audit_logread
diff --git a/tools/testing/selftests/net/netfilter/config b/tools/testing/selftests/net/netfilter/config
index 60b86c7f3ea1..5b5b764f6cd0 100644
--- a/tools/testing/selftests/net/netfilter/config
+++ b/tools/testing/selftests/net/netfilter/config
@@ -85,3 +85,4 @@ CONFIG_VETH=m
CONFIG_VLAN_8021Q=m
CONFIG_XFRM_USER=m
CONFIG_XFRM_STATISTICS=y
+CONFIG_NET_PKTGEN=m
diff --git a/tools/testing/selftests/net/netfilter/nft_concat_range.sh b/tools/testing/selftests/net/netfilter/nft_concat_range.sh
index 2b6661519055..6d66240e149c 100755
--- a/tools/testing/selftests/net/netfilter/nft_concat_range.sh
+++ b/tools/testing/selftests/net/netfilter/nft_concat_range.sh
@@ -19,7 +19,7 @@ source lib.sh
# - timeout: check that packets match entries until they expire
# - performance: estimate matching rate, compare with rbtree and hash baselines
TESTS="reported_issues correctness concurrency timeout"
-[ "${quicktest}" != "1" ] && TESTS="${TESTS} performance"
+[ -n "$NFT_CONCAT_RANGE_TESTS" ] && TESTS="${NFT_CONCAT_RANGE_TESTS}"
# Set types, defined by TYPE_ variables below
TYPES="net_port port_net net6_port port_proto net6_port_mac net6_port_mac_proto
@@ -31,7 +31,7 @@ BUGS="flush_remove_add reload"
# List of possible paths to pktgen script from kernel tree for performance tests
PKTGEN_SCRIPT_PATHS="
- ../../../../samples/pktgen/pktgen_bench_xmit_mode_netif_receive.sh
+ ../../../../../samples/pktgen/pktgen_bench_xmit_mode_netif_receive.sh
pktgen/pktgen_bench_xmit_mode_netif_receive.sh"
# Definition of set types:
@@ -951,6 +951,10 @@ cleanup() {
killall iperf 2>/dev/null
killall netperf 2>/dev/null
killall netserver 2>/dev/null
+}
+
+cleanup_exit() {
+ cleanup
rm -f "$tmp"
}
@@ -1371,6 +1375,9 @@ test_timeout() {
setup veth send_"${proto}" set || return ${ksft_skip}
timeout=3
+
+ [ "$KSFT_MACHINE_SLOW" = "yes" ] && timeout=8
+
range_size=1
for i in $(seq "$start" $((start + count))); do
end=$((start + range_size))
@@ -1386,7 +1393,7 @@ test_timeout() {
range_size=$((range_size + 1))
start=$((end + range_size))
done
- sleep 3
+ sleep $timeout
for i in $(seq "$start" $((start + count))); do
end=$((start + range_size))
srcstart=$((start + src_delta))
@@ -1480,10 +1487,13 @@ test_performance() {
}
test_bug_flush_remove_add() {
+ rounds=100
+ [ "$KSFT_MACHINE_SLOW" = "yes" ] && rounds=10
+
set_cmd='{ set s { type ipv4_addr . inet_service; flags interval; }; }'
elem1='{ 10.0.0.1 . 22-25, 10.0.0.1 . 10-20 }'
elem2='{ 10.0.0.1 . 10-20, 10.0.0.1 . 22-25 }'
- for i in $(seq 1 100); do
+ for i in $(seq 1 $rounds); do
nft add table t "$set_cmd" || return ${ksft_skip}
nft add element t s "$elem1" 2>/dev/null || return 1
nft flush set t s 2>/dev/null || return 1
@@ -1552,7 +1562,7 @@ test_reported_issues() {
# Run everything in a separate network namespace
[ "${1}" != "run" ] && { unshare -n "${0}" run; exit $?; }
tmp="$(mktemp)"
-trap cleanup EXIT
+trap cleanup_exit EXIT
# Entry point for test runs
passed=0
@@ -1584,10 +1594,16 @@ for name in ${TESTS}; do
continue
fi
- printf " %-60s " "${display}"
+ [ "$KSFT_MACHINE_SLOW" = "yes" ] && count=1
+
+ printf " %-32s " "${display}"
+ tthen=$(date +%s)
eval test_"${name}"
ret=$?
+ tnow=$(date +%s)
+ printf "%5ds%-30s" $((tnow-tthen))
+
if [ $ret -eq 0 ]; then
printf "[ OK ]\n"
info_flush
diff --git a/tools/testing/selftests/net/netfilter/nft_concat_range_perf.sh b/tools/testing/selftests/net/netfilter/nft_concat_range_perf.sh
new file mode 100755
index 000000000000..5d276995a5c5
--- /dev/null
+++ b/tools/testing/selftests/net/netfilter/nft_concat_range_perf.sh
@@ -0,0 +1,9 @@
+#!/bin/bash
+# SPDX-License-Identifier: GPL-2.0
+#
+
+source lib.sh
+
+[ "$KSFT_MACHINE_SLOW" = yes ] && exit ${ksft_skip}
+
+NFT_CONCAT_RANGE_TESTS="performance" exec ./nft_concat_range.sh
--
2.43.2
^ permalink raw reply related [flat|nested] 5+ messages in thread* Re: [PATCH net-next] selftests: netfilter: nft_concat_range.sh: reduce debug kernel run time
2024-04-30 14:58 [PATCH net-next] selftests: netfilter: nft_concat_range.sh: reduce debug kernel run time Florian Westphal
@ 2024-05-01 15:59 ` Simon Horman
2024-05-01 19:41 ` Florian Westphal
2024-05-01 22:00 ` patchwork-bot+netdevbpf
1 sibling, 1 reply; 5+ messages in thread
From: Simon Horman @ 2024-05-01 15:59 UTC (permalink / raw)
To: Florian Westphal
Cc: netdev, Paolo Abeni, David S. Miller, Eric Dumazet,
Jakub Kicinski, netfilter-devel, pablo
On Tue, Apr 30, 2024 at 04:58:07PM +0200, Florian Westphal wrote:
...
> diff --git a/tools/testing/selftests/net/netfilter/nft_concat_range.sh b/tools/testing/selftests/net/netfilter/nft_concat_range.sh
...
> @@ -1584,10 +1594,16 @@ for name in ${TESTS}; do
> continue
> fi
>
> - printf " %-60s " "${display}"
> + [ "$KSFT_MACHINE_SLOW" = "yes" ] && count=1
> +
> + printf " %-32s " "${display}"
> + tthen=$(date +%s)
> eval test_"${name}"
> ret=$?
>
> + tnow=$(date +%s)
> + printf "%5ds%-30s" $((tnow-tthen))
> +
Hi Florian,
A minor nit: the format string above expects two variables, but only one
is passed.
Flagged by Shellcheck.
> if [ $ret -eq 0 ]; then
> printf "[ OK ]\n"
> info_flush
...
^ permalink raw reply [flat|nested] 5+ messages in thread* Re: [PATCH net-next] selftests: netfilter: nft_concat_range.sh: reduce debug kernel run time
2024-05-01 15:59 ` Simon Horman
@ 2024-05-01 19:41 ` Florian Westphal
2024-05-01 20:09 ` Simon Horman
0 siblings, 1 reply; 5+ messages in thread
From: Florian Westphal @ 2024-05-01 19:41 UTC (permalink / raw)
To: Simon Horman
Cc: Florian Westphal, netdev, Paolo Abeni, David S. Miller,
Eric Dumazet, Jakub Kicinski, netfilter-devel, pablo
Simon Horman <horms@kernel.org> wrote:
> On Tue, Apr 30, 2024 at 04:58:07PM +0200, Florian Westphal wrote:
>
> ...
>
> > diff --git a/tools/testing/selftests/net/netfilter/nft_concat_range.sh b/tools/testing/selftests/net/netfilter/nft_concat_range.sh
>
> ...
>
> > @@ -1584,10 +1594,16 @@ for name in ${TESTS}; do
> > continue
> > fi
> >
> > - printf " %-60s " "${display}"
> > + [ "$KSFT_MACHINE_SLOW" = "yes" ] && count=1
> > +
> > + printf " %-32s " "${display}"
> > + tthen=$(date +%s)
> > eval test_"${name}"
> > ret=$?
> >
> > + tnow=$(date +%s)
> > + printf "%5ds%-30s" $((tnow-tthen))
> > +
>
> Hi Florian,
>
> A minor nit: the format string above expects two variables, but only one
> is passed.
Its intentional, I thought this was better than "%5ds "
or similar.
^ permalink raw reply [flat|nested] 5+ messages in thread* Re: [PATCH net-next] selftests: netfilter: nft_concat_range.sh: reduce debug kernel run time
2024-05-01 19:41 ` Florian Westphal
@ 2024-05-01 20:09 ` Simon Horman
0 siblings, 0 replies; 5+ messages in thread
From: Simon Horman @ 2024-05-01 20:09 UTC (permalink / raw)
To: Florian Westphal
Cc: netdev, Paolo Abeni, David S. Miller, Eric Dumazet,
Jakub Kicinski, netfilter-devel, pablo
On Wed, May 01, 2024 at 09:41:53PM +0200, Florian Westphal wrote:
> Simon Horman <horms@kernel.org> wrote:
> > On Tue, Apr 30, 2024 at 04:58:07PM +0200, Florian Westphal wrote:
> >
> > ...
> >
> > > diff --git a/tools/testing/selftests/net/netfilter/nft_concat_range.sh b/tools/testing/selftests/net/netfilter/nft_concat_range.sh
> >
> > ...
> >
> > > @@ -1584,10 +1594,16 @@ for name in ${TESTS}; do
> > > continue
> > > fi
> > >
> > > - printf " %-60s " "${display}"
> > > + [ "$KSFT_MACHINE_SLOW" = "yes" ] && count=1
> > > +
> > > + printf " %-32s " "${display}"
> > > + tthen=$(date +%s)
> > > eval test_"${name}"
> > > ret=$?
> > >
> > > + tnow=$(date +%s)
> > > + printf "%5ds%-30s" $((tnow-tthen))
> > > +
> >
> > Hi Florian,
> >
> > A minor nit: the format string above expects two variables, but only one
> > is passed.
>
> Its intentional, I thought this was better than "%5ds "
> or similar.
Understood, thanks.
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [PATCH net-next] selftests: netfilter: nft_concat_range.sh: reduce debug kernel run time
2024-04-30 14:58 [PATCH net-next] selftests: netfilter: nft_concat_range.sh: reduce debug kernel run time Florian Westphal
2024-05-01 15:59 ` Simon Horman
@ 2024-05-01 22:00 ` patchwork-bot+netdevbpf
1 sibling, 0 replies; 5+ messages in thread
From: patchwork-bot+netdevbpf @ 2024-05-01 22:00 UTC (permalink / raw)
To: Florian Westphal
Cc: netdev, pabeni, davem, edumazet, kuba, netfilter-devel, pablo
Hello:
This patch was applied to netdev/net-next.git (main)
by Jakub Kicinski <kuba@kernel.org>:
On Tue, 30 Apr 2024 16:58:07 +0200 you wrote:
> Even a 1h timeout isn't enough for nft_concat_range.sh to complete on
> debug kernels.
>
> Reduce test complexity and only match on single entry if
> KSFT_MACHINE_SLOW is set.
>
> To spot 'slow' tests, print the subtest duration (in seconds) in
> addition to the status.
>
> [...]
Here is the summary with links:
- [net-next] selftests: netfilter: nft_concat_range.sh: reduce debug kernel run time
https://git.kernel.org/netdev/net-next/c/496bc5861c73
You are awesome, thank you!
--
Deet-doot-dot, I am a bot.
https://korg.docs.kernel.org/patchwork/pwbot.html
^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2024-05-01 22:00 UTC | newest]
Thread overview: 5+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2024-04-30 14:58 [PATCH net-next] selftests: netfilter: nft_concat_range.sh: reduce debug kernel run time Florian Westphal
2024-05-01 15:59 ` Simon Horman
2024-05-01 19:41 ` Florian Westphal
2024-05-01 20:09 ` Simon Horman
2024-05-01 22:00 ` patchwork-bot+netdevbpf
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).