Kernel KVM virtualization development
 help / color / mirror / Atom feed
From: Guoqing Jiang <guoqing.jiang@linux.dev>
To: kvm@vger.kernel.org
Subject: kvm-unit-tests: inconsistent test result between run_tests.sh and standalone test
Date: Tue, 15 Nov 2022 16:11:48 +0800	[thread overview]
Message-ID: <9bf9defb-1482-8f8a-7e8e-d07ab2f51852@linux.dev> (raw)

Hi,

I find the two test results (pmu and intel_cet) are quite different, but 
other
test results are consistent.

gjiang@x1:~/source/kvm-unit-tests> ./run_tests.sh
...
*PASS pmu (142 tests)*
...
*FAIL intel_cet*
...

1. pmu standalone test
gjiang@x1:~/source/kvm-unit-tests/tests> ./pmu
BUILD_HEAD=73d9d850
timeout -k 1s --foreground 90s /usr/bin/qemu-system-x86_64 --no-reboot 
-nodefaults -device pc-testdev -device 
isa-debug-exit,iobase=0xf4,iosize=0x4 -vnc none -serial stdio -device 
pci-testdev -machine accel=kvm -kernel /tmp/tmp.Bai8UEIh2F -smp 1 -cpu 
max # -initrd /tmp/tmp.DFE9VFPOdp
enabling apic
smp: waiting for 0 APs
paging enabled
cr0 = 80010011
cr3 = 1007000
cr4 = 20
PMU version:         2
GP counters:         4
GP counter width:    48
Mask length:         7
Fixed counters:      3
Fixed counter width: 48
PASS: core cycles-0
...
FAIL: llc misses-0
FAIL: llc misses-1
FAIL: llc misses-2
FAIL: llc misses-3
...
SUMMARY: 142 tests, 4 unexpected failures
*FAIL pmu (142 tests, 4 unexpected failures)

*And

gjiang@x1:~/source/kvm-unit-tests> ./x86-run ./x86/pmu.flat
/usr/bin/qemu-system-x86_64 --no-reboot -nodefaults -device pc-testdev 
-device isa-debug-exit,iobase=0xf4,iosize=0x4 -vnc none -serial stdio 
-device pci-testdev -machine accel=kvm -kernel ./x86/pmu.flat # -initrd 
/tmp/tmp.jiEHps3KLW
enabling apic
smp: waiting for 0 APs
paging enabled
cr0 = 80010011
cr3 = 1007000
cr4 = 20
*SKIP: No pmu is detected!**
**SUMMARY: 1 tests, 1 skipped*

**
2. intel_cet
gjiang@x1:~/source/kvm-unit-tests/tests> ./intel_cet
BUILD_HEAD=73d9d850
*skip intel_cet (test kernel not present)*

Then I am not sure which test result should be correct, standalone test
or run all tests. Or am I missed something fundamentally?

Thanks for your reply in advance.

Guoqing

             reply	other threads:[~2022-11-15  8:12 UTC|newest]

Thread overview: 5+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2022-11-15  8:11 Guoqing Jiang [this message]
2022-11-15  8:42 ` kvm-unit-tests: inconsistent test result between run_tests.sh and standalone test Andrew Jones
2022-11-15  8:53   ` Guoqing Jiang
2022-11-15 10:29     ` Andrew Jones
2022-11-16  1:36       ` Guoqing Jiang

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=9bf9defb-1482-8f8a-7e8e-d07ab2f51852@linux.dev \
    --to=guoqing.jiang@linux.dev \
    --cc=kvm@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox