From: Ana Rey <anarey@gmail.com>
To: netfilter-devel@vger.kernel.org
Cc: Ana Rey <anarey@gmail.com>
Subject: [v3 nft 0/7] tests: Automated regression testing
Date: Thu, 18 Sep 2014 12:39:14 +0200 [thread overview]
Message-ID: <1411036761-26825-1-git-send-email-anarey@gmail.com> (raw)
This is a new version of the automated regression testing of nftables.
There is no infrastructure to allow us to check all options/features in
nft. So, if anyone sends a patch, we cannot check if it breaks something.
I send in this patchset the nftables automated regression tests. It
contains a python script (nft-add.py) and a set of test files.
This allow us to check the input of rules of nft-tool from the
command-line and the output from nft-tool of this rule. Then, it
compares if the rule input matches the rule output automatically.
We also have plans to add automated regression testing in the packet
path in the future, which should come in a follow up step.
Comments welcome, thanks
[Changes in v3]
* I fix signal handlers when press ctrl + c repeatedly.
* I add the output_clean function. This function improves the parser of
rules is shown by nft.
Ana Rey (7):
tests: Add automated regression testing
tests: Add ip folder with test files
tests: Add ip6 folder with test files.
tests: Add inet folder with test files.
tests: Add arp folder with test files.
tests: Add bridge folder with test files.
tests: Add any folder with test files.
tests/regression/any/ct.t | 105 +++++
tests/regression/any/frag.t | 64 +++
tests/regression/any/limit.t | 12 +
tests/regression/any/log.t | 27 ++
tests/regression/any/meta.t | 160 +++++++
tests/regression/any/queue.t | 15 +
tests/regression/arp/arp.t | 53 +++
tests/regression/arp/chains.t | 5 +
tests/regression/bridge/chains.t | 7 +
tests/regression/inet/ah.t | 58 +++
tests/regression/inet/comp.t | 31 ++
tests/regression/inet/dccp.t | 32 ++
tests/regression/inet/esp.t | 23 +
tests/regression/inet/sctp.t | 42 ++
tests/regression/inet/tcp.t | 103 +++++
tests/regression/inet/udp.t | 49 +++
tests/regression/inet/udplite.t | 42 ++
tests/regression/ip/chains.t | 22 +
tests/regression/ip/icmp.t | 93 +++++
tests/regression/ip/ip.t | 107 +++++
tests/regression/ip/nat.t | 18 +
tests/regression/ip/reject.t | 5 +
tests/regression/ip/sets.t | 31 ++
tests/regression/ip6/chains.t | 18 +
tests/regression/ip6/dst.t | 25 ++
tests/regression/ip6/hbh.t | 25 ++
tests/regression/ip6/icmpv6.t | 96 +++++
tests/regression/ip6/ip6.t | 142 +++++++
tests/regression/ip6/mh.t | 49 +++
tests/regression/ip6/nat.t | 6 +
tests/regression/ip6/reject.t | 5 +
tests/regression/ip6/rt.t | 45 ++
tests/regression/ip6/sets.t | 22 +
tests/regression/ip6/vmap.t | 54 +++
tests/regression/nft-test.py | 859 ++++++++++++++++++++++++++++++++++++++
35 files changed, 2450 insertions(+)
create mode 100644 tests/regression/any/ct.t
create mode 100644 tests/regression/any/frag.t
create mode 100644 tests/regression/any/limit.t
create mode 100644 tests/regression/any/log.t
create mode 100644 tests/regression/any/meta.t
create mode 100644 tests/regression/any/queue.t
create mode 100644 tests/regression/arp/arp.t
create mode 100644 tests/regression/arp/chains.t
create mode 100644 tests/regression/bridge/chains.t
create mode 100644 tests/regression/inet/ah.t
create mode 100644 tests/regression/inet/comp.t
create mode 100644 tests/regression/inet/dccp.t
create mode 100644 tests/regression/inet/esp.t
create mode 100644 tests/regression/inet/sctp.t
create mode 100644 tests/regression/inet/tcp.t
create mode 100644 tests/regression/inet/udp.t
create mode 100644 tests/regression/inet/udplite.t
create mode 100644 tests/regression/ip/chains.t
create mode 100644 tests/regression/ip/icmp.t
create mode 100644 tests/regression/ip/ip.t
create mode 100644 tests/regression/ip/nat.t
create mode 100644 tests/regression/ip/reject.t
create mode 100644 tests/regression/ip/sets.t
create mode 100644 tests/regression/ip6/chains.t
create mode 100644 tests/regression/ip6/dst.t
create mode 100644 tests/regression/ip6/hbh.t
create mode 100644 tests/regression/ip6/icmpv6.t
create mode 100644 tests/regression/ip6/ip6.t
create mode 100644 tests/regression/ip6/mh.t
create mode 100644 tests/regression/ip6/nat.t
create mode 100644 tests/regression/ip6/reject.t
create mode 100644 tests/regression/ip6/rt.t
create mode 100644 tests/regression/ip6/sets.t
create mode 100644 tests/regression/ip6/vmap.t
create mode 100755 tests/regression/nft-test.py
--
1.7.10.4
next reply other threads:[~2014-09-18 10:37 UTC|newest]
Thread overview: 9+ messages / expand[flat|nested] mbox.gz Atom feed top
2014-09-18 10:39 Ana Rey [this message]
2014-09-18 10:39 ` [v3 nft 1/7] tests: Add automated regression testing Ana Rey
2014-09-18 10:39 ` [v3 nft 2/7] tests: Add ip folder with test files Ana Rey
2014-09-18 10:39 ` [v3 nft 3/7] tests: Add ip6 " Ana Rey
2014-09-18 10:39 ` [v3 nft 4/7] tests: Add inet " Ana Rey
2014-09-18 10:39 ` [v3 nft 5/7] tests: Add arp " Ana Rey
2014-09-18 10:39 ` [v3 nft 6/7] tests: Add bridge " Ana Rey
2014-09-18 10:39 ` [v3 nft 7/7] tests: Add any " Ana Rey
2014-09-18 11:02 ` [v3 nft 0/7] tests: Automated regression testing Pablo Neira Ayuso
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1411036761-26825-1-git-send-email-anarey@gmail.com \
--to=anarey@gmail.com \
--cc=netfilter-devel@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).