From mboxrd@z Thu Jan 1 00:00:00 1970 From: Linda Knippers Subject: certification test suite Date: Mon, 13 Aug 2007 14:21:13 -0400 Message-ID: <46C0A119.1060103@hp.com> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Return-path: Received: from mx1.redhat.com (mx1.redhat.com [172.16.48.31]) by int-mx1.corp.redhat.com (8.13.1/8.13.1) with ESMTP id l7DIOMH4005750 for ; Mon, 13 Aug 2007 14:24:22 -0400 Received: from tayrelbas01.tay.hp.com (tayrelbas01.tay.hp.com [161.114.80.244]) by mx1.redhat.com (8.13.1/8.13.1) with ESMTP id l7DIOCUg008529 for ; Mon, 13 Aug 2007 14:24:13 -0400 List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: linux-audit-bounces@redhat.com Errors-To: linux-audit-bounces@redhat.com To: linux-audit@redhat.com, selinux@tycho.nsa.gov List-Id: linux-audit@redhat.com HP has posted the test suite we used for the audit and MLS portions of our recent RHEL5 CAPP/LSPP/RBACPP certification. http://sourceforge.net/projects/audit-test/ We used this suite in combination with the LTP and a handful of manual tests to provide the necessary test coverage for our evaluation. Although this suite is called 'audit-test' and includes coverage of all the security relevant system calls, it also includes tests for other components such as NetLabel/CIPSO, IPsec, and CUPS. The suite is available as a tarball, a source rpm, and as a noarch rpm which will install files into /usr/local/eal4_testing/audit-test. There are 3 README files which describe how to run the tests, how to develop tests, and how to configure the test server for network tests. These tests are known to pass on RHEL5 plus the updated packages listed in our security target in both CAPP mode (optional targeted policy) and LSPP mode (mls policy) on i386, x86_64 and ia64 architectures. The tests are known to run on the RHEL5.1 beta with about 17 failures due to changes in some of the pam audit records. Items on our TODO list include updating the suite to support multiple versions of some of the interesting packages (such as audit and pam), providing more intuitive subsets of the test cases for specific components, and separating the test harness into its own package. We would appreciate feedback as well as patches through the sourceforge project trackers if you use and update the suite. We are especially interested in hearing from people running the tests on other distros, with or without SELinux. Thanks, -- ljk