Re: [kvm-unit-tests ] results on stable-rc-5.0

[Sean Christopherson <sean.j.christopherson@intel.com>]

On Thu, May 02, 2019 at 12:54:14PM +0530, Naresh Kamboju wrote:
> Linaro test farm is validating each stable rc releases and reporting
> results to upstream. kvm-unit-tests also included in Linux Kernel
> Functional test plan and we see below results so please comment on
> reason for test failures and skip and suggest Kconfig or any userland
> tools for improve test coverage.

The test environment needs to load a KVM module, e.g. kvm_intel or kvm_amd.
The unit tests don't require KVM to be loaded and will happily test Qemu
emulation when possible (not sure if this is a bug or feature).

Lack of KVM is why you see

  SKIP ... (qemu-system-x86_64: CPU model 'host' requires KVM)

and is likely why other tests are failing, e.g. apic timeouts.


> 
> kvm unit tests results summary.
> PASS 23
> SKIP 18
> FAIL 14
> 
> Test results output log,
> --------------------------------
> FAIL apic-split (timeout; duration=90s)
> PASS ioapic-split (19 tests)
> FAIL apic (timeout; duration=30)
> PASS ioapic (19 tests)
> PASS smptest (1 tests)
> PASS smptest3 (1 tests)
> PASS vmexit_cpuid
> FAIL vmexit_vmcall
> PASS vmexit_mov_from_cr8
> PASS vmexit_mov_to_cr8
> PASS vmexit_inl_pmtimer
> PASS vmexit_ipi
> PASS vmexit_ipi_halt
> PASS vmexit_ple_round_robin
> PASS vmexit_tscdeadline
> PASS vmexit_tscdeadline_immed
> SKIP access (qemu-system-x86_64: CPU model 'host' requires KVM)
> SKIP smap (qemu-system-x86_64: CPU model 'host' requires KVM)
> SKIP pku (qemu-system-x86_64: CPU model 'host' requires KVM)
> FAIL emulator (timeout; duration=90s)
> PASS eventinj (13 tests)
> FAIL hypercall (timeout; duration=90s)
> FAIL idt_test (timeout; duration=90s)
> SKIP memory (qemu-system-x86_64: CPU model 'host' requires KVM)
> PASS msr (12 tests)
> cat: /proc/sys/kernel/nmi_watchdog: No such file or directory
> SKIP pmu (/proc/sys/kernel/nmi_watchdog not equal to 0)
> FAIL vmware_backdoors
> PASS port80
> FAIL realmode
> FAIL s3
> PASS sieve
> PASS syscall (2 tests)
> PASS tsc (3 tests)
> SKIP tsc_adjust (qemu-system-x86_64: CPU model 'host' requires KVM)
> SKIP xsave (qemu-system-x86_64: CPU model 'host' requires KVM)
> PASS rmap_chain
> FAIL svm (timeout; duration=90s)
> SKIP taskswitch (i386 only)
> SKIP taskswitch2 (i386 only)
> FAIL kvmclock_test
> FAIL pcid (3 tests, 1 unexpected failures)
> PASS umip (11 tests)
> SKIP vmx (qemu-system-x86_64: CPU model 'host' requires KVM)
> SKIP ept (qemu-system-x86_64: CPU model 'host' requires KVM)
> SKIP vmx_eoi_bitmap_ioapic_scan (qemu-system-x86_64: CPU model 'host'
> requires KVM)
> SKIP vmx_hlt_with_rvi_test (qemu-system-x86_64: CPU model 'host' requires KVM)
> SKIP vmx_apicv_test (qemu-system-x86_64: CPU model 'host' requires KVM)
> SKIP vmx_apic_passthrough_thread (qemu-system-x86_64: CPU model 'host'
> requires KVM)
> SKIP vmx_vmcs_shadow_test (qemu-system-x86_64: CPU model 'host' requires KVM)
> FAIL debug
> SKIP hyperv_synic
> SKIP hyperv_connections (1 tests, 1 skipped)
> PASS hyperv_stimer (1 tests)
> FAIL hyperv_clock (timeout; duration=90s)
> PASS intel_iommu (11 tests)
> 
> Kernel version,
> 5.0.11-rc1
> 
> x86_64 kernel config,
> http://snapshots.linaro.org/openembedded/lkft/lkft/sumo/intel-corei7-64/lkft/linux-stable-rc-5.0/39/config
> 
> Test full results log,
> https://lkft.validation.linaro.org/scheduler/job/696689#L1415
> 
> Reference link for all test plans running on x86_64, i386, arm and arm64.
> https://qa-reports.linaro.org/lkft/linux-stable-rc-5.0-oe/
> 
> Best regards
> Naresh Kamboju