Re: openbsd system_powerdown: "KVM internal error. Suberror: 1"

[Avi Kivity <avi@redhat.com>]

On 03/17/2011 10:18 PM, Michael Tokarev wrote:
> 17.03.2011 20:52, Marcelo Tosatti wrote:
> []
> >  iret emulation is only partially implemented. Why is iret faulting
> >  in the first place i don't know. Can you enable tracing with
> >
> >  echo kvm>  /$debugfs/tracing/set_event
> >
> >  And save the tail of the log, including events at $RIP?
>
> Something like the one below (with the error at the end)?
>
> What do you mean "events at $RIP" ?  I see 2 patterns here
> with references to $RIP.  Many like this:
>
>        kvm-0.12.5-1301  [001] 47965.427622: kvm_page_fault: address fee00080 error_code 6
>        kvm-0.12.5-1301  [001] 47965.427622: kvm_emulate_insn: 0:d0202002: 89 1d 80 00 99 d0 (prot32)
>        kvm-0.12.5-1301  [001] 47965.427623: kvm_mmio: mmio write len 4 gpa 0xfee00080 val 0x30
>        kvm-0.12.5-1301  [001] 47965.427623: kvm_apic: apic_write APIC_TASKPRI = 0x30
>        kvm-0.12.5-1301  [001] 47965.427624: kvm_entry: vcpu 0
>        kvm-0.12.5-1301  [001] 47965.427625: kvm_exit: reason vintr rip 0xd0202041
>        kvm-0.12.5-1301  [001] 47965.427625: kvm_inj_virq: irq 81
>        kvm-0.12.5-1301  [001] 47965.427625: kvm_inj_virq: irq 81
>        kvm-0.12.5-1301  [001] 47965.427626: kvm_entry: vcpu 0
>        kvm-0.12.5-1301  [001] 47965.427627: kvm_exit: reason npf rip 0xd02024f1
>        kvm-0.12.5-1301  [001] 47965.427627: kvm_page_fault: address fee00080 error_code 4
>
> which are repeated without changes over and over again.
> And at the end, several like this:
>
>        kvm-0.12.5-1301  [001] 47965.428634: kvm_entry: vcpu 0
>        kvm-0.12.5-1301  [001] 47965.428635: kvm_exit: reason npf rip 0xd020203a
>        kvm-0.12.5-1301  [001] 47965.428635: kvm_page_fault: address bfffc error_code 4
>        kvm-0.12.5-1301  [001] 47965.428635: kvm_emulate_insn: 0:d020203a: 5a (prot32)
>        kvm-0.12.5-1301  [001] 47965.428636: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbfffc val 0x0
>        kvm-0.12.5-1301  [001] 47965.428637: kvm_mmio: mmio read len 4 gpa 0xbfffc val 0xb100
>        kvm-0.12.5-1301  [001] 47965.428637: kvm_entry: vcpu 0
>        kvm-0.12.5-1301  [001] 47965.428638: kvm_exit: reason vintr rip 0xd0202041
>        kvm-0.12.5-1301  [001] 47965.428638: kvm_inj_virq: irq 81
>        kvm-0.12.5-1301  [001] 47965.428638: kvm_inj_virq: irq 81
>        kvm-0.12.5-1301  [001] 47965.428639: kvm_entry: vcpu 0
>        kvm-0.12.5-1301  [001] 47965.428640: kvm_exit: reason npf rip 0xd02024cc
>        kvm-0.12.5-1301  [001] 47965.428640: kvm_page_fault: address bfffc error_code 6
>        kvm-0.12.5-1301  [001] 47965.428640: kvm_emulate_insn: 0:d02024cc: 6a 03 (prot32)
>        kvm-0.12.5-1301  [001] 47965.428641: kvm_mmio: mmio write len 4 gpa 0xbfffc val 0x3
>
> (with different kvm_emulate_insn each time), which finally ends with
>        kvm-0.12.5-1301  [001] 47965.428804: kvm_emulate_insn: 0:d0202041: cf (prot32)
>        kvm-0.12.5-1301  [001] 47965.428805: kvm_emulate_insn: 0:d0202041: cf (prot32) failed
>
> Note it's the same openbsd which triggers insane amount of
> host_state_reloads, so the trace is quite, well, large :)
>
> Thanks!
>
> /mjt
>
> $ kvm-0.12.5 -drive file=obsd.raw,snapshot=on -net none -monitor stdio
> QEMU 0.12.5 monitor - type 'help' for more information
> (qemu) system_powerdown
> (qemu) KVM internal error. Suberror: 1
> rax 0000000000000030 rbx 0000000000000000 rcx 0000000000000000 rdx 000000000000b100
> rsi 00000000d0201fc6 rdi 00000000d0ac1ad4 rsp 00000000d438d004 rbp 00000000d4492e1c
> r8  0000000000000000 r9  0000000000000000 r10 0000000000000000 r11 0000000000000000
> r12 0000000000000000 r13 0000000000000000 r14 0000000000000000 r15 0000000000000000
> rip 00000000d0202041 rflags 00000292
> cs 0050 (00000000/ffffffff p 1 dpl 0 db 1 s 1 type b l 0 g 1 avl 0)
> ds 0010 (00000000/ffffffff p 1 dpl 0 db 1 s 1 type 3 l 0 g 1 avl 0)
> es 0010 (00000000/ffffffff p 1 dpl 0 db 1 s 1 type 3 l 0 g 1 avl 0)
> ss 0010 (00000000/ffffffff p 1 dpl 0 db 1 s 1 type 3 l 0 g 1 avl 0)
> fs 0058 (d0ac1aa0/000003db p 1 dpl 0 db 0 s 1 type 3 l 0 g 0 avl 0)
> gs 0010 (00000000/ffffffff p 1 dpl 0 db 1 s 1 type 3 l 0 g 1 avl 0)
> tr 0078 (d4491000/00000333 p 1 dpl 0 db 0 s 0 type b l 0 g 0 avl 0)
> ldt 0018 (d0a31580/00000087 p 1 dpl 0 db 0 s 0 type 2 l 0 g 0 avl 0)
> gdt d42b1000/ffff
> idt d0a31620/7ff
> cr0 8001003b cr2 8adaa850 cr3 7370000 cr4 780 cr8 3 efer 0
> emulation failure, check dmesg for details
>
> (qemu) x/20i 0x00000000d0202036
> 0x00000000d0202036:  pop    %edi
> 0x00000000d0202037:  pop    %esi
> 0x00000000d0202038:  pop    %ebp
> 0x00000000d0202039:  pop    %ebx
> 0x00000000d020203a:  pop    %edx
> 0x00000000d020203b:  pop    %ecx
> 0x00000000d020203c:  pop    %eax
> 0x00000000d020203d:  sti
> 0x00000000d020203e:  add    $0x8,%esp
> 0x00000000d0202041:  iret
> 0x00000000d0202042:  mov    %esi,%esi
> 0x00000000d0202044:  mov    $0x70,%eax
> 0x00000000d0202049:  mov    %eax,0xd0990080
> 0x00000000d020204e:  sti
> 0x00000000d020204f:  push   $0x2
> 0x00000000d0202051:  call   0xd0570470
> 0x00000000d0202056:  add    $0x4,%esp
> 0x00000000d0202059:  jmp    *%esi
> 0x00000000d020205b:  nop
> 0x00000000d020205c:  mov    $0x40,%eax
> (qemu) q
>
> # tail -500 /sys/kernel/debug/tracing/trace | sed 's|^.*\] ||'
>
> 47965.428524: kvm_page_fault: address bffd4 error_code 6
> 47965.428524: kvm_emulate_insn: 0:d0202534: 50 (prot32)
> 47965.428525: kvm_mmio: mmio write len 4 gpa 0xbffd4 val 0xd0ec7b00
> 47965.428525: kvm_entry: vcpu 0
> 47965.428526: kvm_exit: reason npf rip 0xd0202535
> 47965.428526: kvm_page_fault: address bffd0 error_code 6
> 47965.428527: kvm_emulate_insn: 0:d0202535: ff 53 00 (prot32)
> 47965.428527: kvm_mmio: mmio write len 4 gpa 0xbffd0 val 0xd0202538
> 47965.428528: kvm_entry: vcpu 0
> 47965.428529: kvm_exit: reason npf rip 0xd06e53d0
> 47965.428529: kvm_page_fault: address bffcc error_code 6
> 47965.428529: kvm_emulate_insn: 0:d06e53d0: 55 (prot32)
> 47965.428529: kvm_mmio: mmio write len 4 gpa 0xbffcc val 0xd438cfd4
> 47965.428530: kvm_entry: vcpu 0
> 47965.428531: kvm_exit: reason npf rip 0xd06e53d6
> 47965.428531: kvm_page_fault: address bffc4 error_code 6
> 47965.428531: kvm_emulate_insn: 0:d06e53d6: 89 75 f8 (prot32)
> 47965.428532: kvm_mmio: mmio write len 4 gpa 0xbffc4 val 0xd0201fc6
> 47965.428532: kvm_entry: vcpu 0
> 47965.428533: kvm_exit: reason npf rip 0xd06e53d9
> 47965.428533: kvm_page_fault: address bffd4 error_code 4
> 47965.428534: kvm_emulate_insn: 0:d06e53d9: 8b 75 08 (prot32)
> 47965.428534: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffd4 val 0x0
> 47965.428536: kvm_mmio: mmio read len 4 gpa 0xbffd4 val 0xd0ec7b00
> 47965.428536: kvm_entry: vcpu 0
> 47965.428537: kvm_exit: reason npf rip 0xd06e53dc
> 47965.428537: kvm_page_fault: address bffc0 error_code 6
> 47965.428538: kvm_emulate_insn: 0:d06e53dc: 89 5d f4 (prot32)
> 47965.428538: kvm_mmio: mmio write len 4 gpa 0xbffc0 val 0xd0eea840
> 47965.428539: kvm_entry: vcpu 0
> 47965.428540: kvm_exit: reason npf rip 0xd06e53df
> 47965.428540: kvm_page_fault: address bffc8 error_code 6
> 47965.428541: kvm_emulate_insn: 0:d06e53df: 89 7d fc (prot32)
> 47965.428541: kvm_mmio: mmio write len 4 gpa 0xbffc8 val 0xd0ac1ad4
> 47965.428541: kvm_entry: vcpu 0
> 47965.428542: kvm_exit: reason npf rip 0xd06e53e2
> 47965.428542: kvm_page_fault: address bffac error_code 6
> 47965.428543: kvm_emulate_insn: 0:d06e53e2: c7 44 24 08 00 00 00 00 (prot32)
> 47965.428543: kvm_mmio: mmio write len 4 gpa 0xbffac val 0x0
> 47965.428543: kvm_entry: vcpu 0
> 47965.428544: kvm_exit: reason npf rip 0xd06e53ed
> 47965.428545: kvm_page_fault: address bffa8 error_code 6
> 47965.428545: kvm_emulate_insn: 0:d06e53ed: 89 44 24 04 (prot32)
> 47965.428545: kvm_mmio: mmio write len 4 gpa 0xbffa8 val 0xb100
> 47965.428546: kvm_entry: vcpu 0
> 47965.428547: kvm_exit: reason npf rip 0xd06e53f4
> 47965.428547: kvm_page_fault: address bffa4 error_code 6
> 47965.428547: kvm_emulate_insn: 0:d06e53f4: 89 04 24 (prot32)
> 47965.428548: kvm_mmio: mmio write len 4 gpa 0xbffa4 val 0x0
> 47965.428548: kvm_entry: vcpu 0
> 47965.428549: kvm_exit: reason npf rip 0xd06e53f7
> 47965.428549: kvm_page_fault: address bffa0 error_code 6
> 47965.428550: kvm_emulate_insn: 0:d06e53f7: e8 94 98 e7 ff (prot32)
> 47965.428550: kvm_mmio: mmio write len 4 gpa 0xbffa0 val 0xd06e53fc
> 47965.428550: kvm_entry: vcpu 0
> 47965.428551: kvm_exit: reason npf rip 0xd055ec90
> 47965.428551: kvm_page_fault: address bff9c error_code 6
> 47965.428552: kvm_emulate_insn: 0:d055ec90: 55 (prot32)
> 47965.428552: kvm_mmio: mmio write len 4 gpa 0xbff9c val 0xd438cfcc
> 47965.428553: kvm_entry: vcpu 0
> 47965.428554: kvm_exit: reason npf rip 0xd055ec93
> 47965.428554: kvm_page_fault: address bffa4 error_code 4
> 47965.428554: kvm_emulate_insn: 0:d055ec93: 8b 45 08 (prot32)
> 47965.428555: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffa4 val 0x0
> 47965.428557: kvm_mmio: mmio read len 4 gpa 0xbffa4 val 0x0
> 47965.428557: kvm_entry: vcpu 0
> 47965.428558: kvm_exit: reason npf rip 0xd055eca8
> 47965.428558: kvm_page_fault: address bffac error_code 4
> 47965.428559: kvm_emulate_insn: 0:d055eca8: 8b 55 10 (prot32)
> 47965.428559: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffac val 0x0
> 47965.428560: kvm_mmio: mmio read len 4 gpa 0xbffac val 0x0
> 47965.428561: kvm_entry: vcpu 0
> 47965.428562: kvm_exit: reason npf rip 0xd055ecab
> 47965.428562: kvm_page_fault: address bffa8 error_code 4
> 47965.428562: kvm_emulate_insn: 0:d055ecab: 03 55 0c (prot32)
> 47965.428563: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffa8 val 0x0
> 47965.428564: kvm_mmio: mmio read len 4 gpa 0xbffa8 val 0xb100
> 47965.428564: kvm_entry: vcpu 0
> 47965.428565: kvm_exit: reason io rip 0xd055ecae
> 47965.428565: kvm_emulate_insn: 0:d055ecae: ec (prot32)
> 47965.428565: kvm_pio: pio_read at 0xb100 size 1 count 1
> 47965.428567: kvm_entry: vcpu 0
> 47965.428568: kvm_exit: reason npf rip 0xd055ecaf
> 47965.428568: kvm_page_fault: address bff9c error_code 4
> 47965.428569: kvm_emulate_insn: 0:d055ecaf: 5d (prot32)
> 47965.428569: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbff9c val 0x0
> 47965.428570: kvm_mmio: mmio read len 4 gpa 0xbff9c val 0xd438cfcc
> 47965.428570: kvm_entry: vcpu 0
> 47965.428571: kvm_exit: reason npf rip 0xd055ecb3
> 47965.428572: kvm_page_fault: address bffa0 error_code 4
> 47965.428572: kvm_emulate_insn: 0:d055ecb3: c3 (prot32)
> 47965.428573: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffa0 val 0x0
> 47965.428574: kvm_mmio: mmio read len 4 gpa 0xbffa0 val 0xd06e53fc
> 47965.428574: kvm_entry: vcpu 0
> 47965.428575: kvm_exit: reason npf rip 0xd06e540b
> 47965.428575: kvm_page_fault: address bffc0 error_code 4
> 47965.428576: kvm_emulate_insn: 0:d06e540b: 8b 5d f4 (prot32)
> 47965.428576: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffc0 val 0x0
> 47965.428577: kvm_mmio: mmio read len 4 gpa 0xbffc0 val 0xd0eea840
> 47965.428578: kvm_entry: vcpu 0
> 47965.428579: kvm_exit: reason npf rip 0xd06e540e
> 47965.428579: kvm_page_fault: address bffc4 error_code 4
> 47965.428579: kvm_emulate_insn: 0:d06e540e: 8b 75 f8 (prot32)
> 47965.428580: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffc4 val 0x0
> 47965.428581: kvm_mmio: mmio read len 4 gpa 0xbffc4 val 0xd0201fc6
> 47965.428581: kvm_entry: vcpu 0
> 47965.428582: kvm_exit: reason npf rip 0xd06e5411
> 47965.428582: kvm_page_fault: address bffc8 error_code 4
> 47965.428583: kvm_emulate_insn: 0:d06e5411: 8b 7d fc (prot32)
> 47965.428584: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffc8 val 0x0
> 47965.428585: kvm_mmio: mmio read len 4 gpa 0xbffc8 val 0xd0ac1ad4
> 47965.428585: kvm_entry: vcpu 0
> 47965.428586: kvm_exit: reason npf rip 0xd06e5416
> 47965.428586: kvm_page_fault: address bffcc error_code 4
> 47965.428587: kvm_emulate_insn: 0:d06e5416: 5d (prot32)
> 47965.428587: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffcc val 0x0
> 47965.428588: kvm_mmio: mmio read len 4 gpa 0xbffcc val 0xd438cfd4
> 47965.428589: kvm_entry: vcpu 0
> 47965.428590: kvm_exit: reason npf rip 0xd06e5417
> 47965.428590: kvm_page_fault: address bffd0 error_code 4
> 47965.428590: kvm_emulate_insn: 0:d06e5417: c3 (prot32)
> 47965.428591: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffd0 val 0x0
> 47965.428592: kvm_mmio: mmio read len 4 gpa 0xbffd0 val 0xd0202538
> 47965.428592: kvm_entry: vcpu 0
> 47965.428593: kvm_exit: reason npf rip 0xd0202554
> 47965.428593: kvm_page_fault: address fee000b0 error_code 6
> 47965.428594: kvm_emulate_insn: 0:d0202554: c7 05 b0 00 99 d0 00 00 00 00 (prot32)
> 47965.428594: kvm_mmio: mmio write len 4 gpa 0xfee000b0 val 0x0
> 47965.428594: kvm_apic: apic_write APIC_EOI = 0x0
> 47965.428595: kvm_ack_irq: irqchip IOAPIC pin 9
> 47965.428595: kvm_apic_accept_irq: apicid 0 vec 81 (Fixed|level)
> 47965.428595: kvm_entry: vcpu 0
> 47965.428596: kvm_exit: reason npf rip 0xd0201fc0
> 47965.428596: kvm_page_fault: address bffd8 error_code 4
> 47965.428597: kvm_emulate_insn: 0:d0201fc0: 5b (prot32)
> 47965.428598: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffd8 val 0x0
> 47965.428599: kvm_mmio: mmio read len 4 gpa 0xbffd8 val 0x30
> 47965.428599: kvm_entry: vcpu 0
> 47965.428600: kvm_exit: reason npf rip 0xd0202002
> 47965.428600: kvm_page_fault: address fee00080 error_code 6
> 47965.428601: kvm_emulate_insn: 0:d0202002: 89 1d 80 00 99 d0 (prot32)
> 47965.428601: kvm_mmio: mmio write len 4 gpa 0xfee00080 val 0x30
> 47965.428601: kvm_apic: apic_write APIC_TASKPRI = 0x30
> 47965.428603: kvm_entry: vcpu 0
> 47965.428604: kvm_exit: reason npf rip 0xd0202030
> 47965.428604: kvm_page_fault: address bffdc error_code 4
> 47965.428605: kvm_emulate_insn: 0:d0202030: 0f a1 (prot32)
> 47965.428605: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffdc val 0x0
> 47965.428606: kvm_mmio: mmio read len 4 gpa 0xbffdc val 0x58
> 47965.428607: kvm_entry: vcpu 0
> 47965.428608: kvm_exit: reason npf rip 0xd0202032
> 47965.428608: kvm_page_fault: address bffe0 error_code 4
> 47965.428609: kvm_emulate_insn: 0:d0202032: 0f a9 (prot32)
> 47965.428609: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffe0 val 0x0
> 47965.428610: kvm_mmio: mmio read len 4 gpa 0xbffe0 val 0x10
> 47965.428611: kvm_entry: vcpu 0
> 47965.428612: kvm_exit: reason npf rip 0xd0202034
> 47965.428612: kvm_page_fault: address bffe4 error_code 4
> 47965.428613: kvm_emulate_insn: 0:d0202034: 07 (prot32)
> 47965.428613: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffe4 val 0x0
> 47965.428614: kvm_mmio: mmio read len 4 gpa 0xbffe4 val 0x10
> 47965.428615: kvm_entry: vcpu 0
> 47965.428616: kvm_exit: reason npf rip 0xd0202035
> 47965.428616: kvm_page_fault: address bffe8 error_code 4
> 47965.428617: kvm_emulate_insn: 0:d0202035: 1f (prot32)
> 47965.428617: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffe8 val 0x0
> 47965.428618: kvm_mmio: mmio read len 4 gpa 0xbffe8 val 0x10
> 47965.428619: kvm_entry: vcpu 0
> 47965.428620: kvm_exit: reason npf rip 0xd0202036
> 47965.428620: kvm_page_fault: address bffec error_code 4
> 47965.428621: kvm_emulate_insn: 0:d0202036: 5f (prot32)
> 47965.428621: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffec val 0x0
> 47965.428622: kvm_mmio: mmio read len 4 gpa 0xbffec val 0xd0ac1ad4
> 47965.428623: kvm_entry: vcpu 0
> 47965.428624: kvm_exit: reason npf rip 0xd0202037
> 47965.428624: kvm_page_fault: address bfff0 error_code 4
> 47965.428624: kvm_emulate_insn: 0:d0202037: 5e (prot32)
> 47965.428625: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbfff0 val 0x0
> 47965.428626: kvm_mmio: mmio read len 4 gpa 0xbfff0 val 0xd0201fc6
> 47965.428626: kvm_entry: vcpu 0
> 47965.428627: kvm_exit: reason npf rip 0xd0202038
> 47965.428627: kvm_page_fault: address bfff4 error_code 4
> 47965.428628: kvm_emulate_insn: 0:d0202038: 5d (prot32)
> 47965.428628: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbfff4 val 0x0
> 47965.428630: kvm_mmio: mmio read len 4 gpa 0xbfff4 val 0xd4492e1c
> 47965.428630: kvm_entry: vcpu 0
> 47965.428631: kvm_exit: reason npf rip 0xd0202039
> 47965.428631: kvm_page_fault: address bfff8 error_code 4
> 47965.428632: kvm_emulate_insn: 0:d0202039: 5b (prot32)
> 47965.428632: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbfff8 val 0x0
> 47965.428633: kvm_mmio: mmio read len 4 gpa 0xbfff8 val 0x0
> 47965.428634: kvm_entry: vcpu 0
> 47965.428635: kvm_exit: reason npf rip 0xd020203a
> 47965.428635: kvm_page_fault: address bfffc error_code 4
> 47965.428635: kvm_emulate_insn: 0:d020203a: 5a (prot32)
> 47965.428636: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbfffc val 0x0
> 47965.428637: kvm_mmio: mmio read len 4 gpa 0xbfffc val 0xb100
> 47965.428637: kvm_entry: vcpu 0
> 47965.428638: kvm_exit: reason vintr rip 0xd0202041
> 47965.428638: kvm_inj_virq: irq 81
> 47965.428638: kvm_inj_virq: irq 81
> 47965.428639: kvm_entry: vcpu 0
> 47965.428640: kvm_exit: reason npf rip 0xd02024cc
> 47965.428640: kvm_page_fault: address bfffc error_code 6
> 47965.428640: kvm_emulate_insn: 0:d02024cc: 6a 03 (prot32)
> 47965.428641: kvm_mmio: mmio write len 4 gpa 0xbfffc val 0x3
> 47965.428641: kvm_entry: vcpu 0
> 47965.428642: kvm_exit: reason npf rip 0xd02024ce
> 47965.428642: kvm_page_fault: address bfff8 error_code 6
> 47965.428643: kvm_emulate_insn: 0:d02024ce: 50 (prot32)
> 47965.428643: kvm_mmio: mmio write len 4 gpa 0xbfff8 val 0x30
> 47965.428643: kvm_entry: vcpu 0
> 47965.428645: kvm_exit: reason npf rip 0xd02024cf
> 47965.428645: kvm_page_fault: address bfff4 error_code 6
> 47965.428645: kvm_emulate_insn: 0:d02024cf: 51 (prot32)
> 47965.428646: kvm_mmio: mmio write len 4 gpa 0xbfff4 val 0x0
> 47965.428646: kvm_entry: vcpu 0
> 47965.428647: kvm_exit: reason npf rip 0xd02024d0
> 47965.428647: kvm_page_fault: address bfff0 error_code 6
> 47965.428648: kvm_emulate_insn: 0:d02024d0: 52 (prot32)
> 47965.428648: kvm_mmio: mmio write len 4 gpa 0xbfff0 val 0xb100
> 47965.428648: kvm_entry: vcpu 0
> 47965.428649: kvm_exit: reason npf rip 0xd02024d1
> 47965.428649: kvm_page_fault: address bffec error_code 6
> 47965.428650: kvm_emulate_insn: 0:d02024d1: 53 (prot32)
> 47965.428650: kvm_mmio: mmio write len 4 gpa 0xbffec val 0x0
> 47965.428651: kvm_entry: vcpu 0
> 47965.428652: kvm_exit: reason npf rip 0xd02024d2
> 47965.428652: kvm_page_fault: address bffe8 error_code 6
> 47965.428652: kvm_emulate_insn: 0:d02024d2: 55 (prot32)
> 47965.428653: kvm_mmio: mmio write len 4 gpa 0xbffe8 val 0xd4492e1c
> 47965.428653: kvm_entry: vcpu 0
> 47965.428654: kvm_exit: reason npf rip 0xd02024d3
> 47965.428654: kvm_page_fault: address bffe4 error_code 6
> 47965.428655: kvm_emulate_insn: 0:d02024d3: 56 (prot32)
> 47965.428655: kvm_mmio: mmio write len 4 gpa 0xbffe4 val 0xd0201fc6
> 47965.428655: kvm_entry: vcpu 0
> 47965.428656: kvm_exit: reason npf rip 0xd02024d4
> 47965.428656: kvm_page_fault: address bffe0 error_code 6
> 47965.428657: kvm_emulate_insn: 0:d02024d4: 57 (prot32)
> 47965.428657: kvm_mmio: mmio write len 4 gpa 0xbffe0 val 0xd0ac1ad4
> 47965.428657: kvm_entry: vcpu 0
> 47965.428658: kvm_exit: reason npf rip 0xd02024d5
> 47965.428658: kvm_page_fault: address bffdc error_code 6
> 47965.428659: kvm_emulate_insn: 0:d02024d5: 1e (prot32)
> 47965.428659: kvm_mmio: mmio write len 4 gpa 0xbffdc val 0x10
> 47965.428660: kvm_entry: vcpu 0
> 47965.428661: kvm_exit: reason npf rip 0xd02024d6
> 47965.428661: kvm_page_fault: address bffd8 error_code 6
> 47965.428662: kvm_emulate_insn: 0:d02024d6: 06 (prot32)
> 47965.428662: kvm_mmio: mmio write len 4 gpa 0xbffd8 val 0x10
> 47965.428662: kvm_entry: vcpu 0
> 47965.428663: kvm_exit: reason npf rip 0xd02024d7
> 47965.428663: kvm_page_fault: address bffd4 error_code 6
> 47965.428664: kvm_emulate_insn: 0:d02024d7: 0f a8 (prot32)
> 47965.428664: kvm_mmio: mmio write len 4 gpa 0xbffd4 val 0x10
> 47965.428665: kvm_entry: vcpu 0
> 47965.428666: kvm_exit: reason npf rip 0xd02024e4
> 47965.428666: kvm_page_fault: address bffd0 error_code 6
> 47965.428666: kvm_emulate_insn: 0:d02024e4: 0f a0 (prot32)
> 47965.428666: kvm_mmio: mmio write len 4 gpa 0xbffd0 val 0x58
> 47965.428667: kvm_entry: vcpu 0
> 47965.428668: kvm_exit: reason npf rip 0xd02024f1
> 47965.428668: kvm_page_fault: address fee00080 error_code 4
> 47965.428668: kvm_emulate_insn: 0:d02024f1: ff 35 80 00 99 d0 (prot32)
> 47965.428669: kvm_apic: apic_read APIC_TASKPRI = 0x30
> 47965.428669: kvm_mmio: mmio read len 4 gpa 0xfee00080 val 0x30
> 47965.428669: kvm_mmio: mmio write len 4 gpa 0xbffcc val 0x30
> 47965.428672: kvm_entry: vcpu 0
> 47965.428673: kvm_exit: reason npf rip 0xd02024f7
> 47965.428673: kvm_page_fault: address fee000a0 error_code 4
> 47965.428674: kvm_emulate_insn: 0:d02024f7: a1 a0 00 99 d0 (prot32)
> 47965.428674: kvm_apic: apic_read APIC_PROCPRI = 0x50
> 47965.428674: kvm_mmio: mmio read len 4 gpa 0xfee000a0 val 0x50
> 47965.428675: kvm_entry: vcpu 0
> 47965.428676: kvm_exit: reason npf rip 0xd0202506
> 47965.428676: kvm_page_fault: address fee00080 error_code 6
> 47965.428677: kvm_emulate_insn: 0:d0202506: 89 1d 80 00 99 d0 (prot32)
> 47965.428677: kvm_mmio: mmio write len 4 gpa 0xfee00080 val 0x50
> 47965.428677: kvm_apic: apic_write APIC_TASKPRI = 0x50
> 47965.428678: kvm_entry: vcpu 0
> 47965.428679: kvm_exit: reason npf rip 0xd0202534
> 47965.428680: kvm_page_fault: address bffc8 error_code 6
> 47965.428680: kvm_emulate_insn: 0:d0202534: 50 (prot32)
> 47965.428680: kvm_mmio: mmio write len 4 gpa 0xbffc8 val 0xd0ec7b00
> 47965.428681: kvm_entry: vcpu 0
> 47965.428682: kvm_exit: reason npf rip 0xd0202535
> 47965.428682: kvm_page_fault: address bffc4 error_code 6
> 47965.428683: kvm_emulate_insn: 0:d0202535: ff 53 00 (prot32)
> 47965.428683: kvm_mmio: mmio write len 4 gpa 0xbffc4 val 0xd0202538
> 47965.428683: kvm_entry: vcpu 0
> 47965.428684: kvm_exit: reason npf rip 0xd06e53d0
> 47965.428685: kvm_page_fault: address bffc0 error_code 6
> 47965.428685: kvm_emulate_insn: 0:d06e53d0: 55 (prot32)
> 47965.428685: kvm_mmio: mmio write len 4 gpa 0xbffc0 val 0xd438cfc8
> 47965.428686: kvm_entry: vcpu 0
> 47965.428687: kvm_exit: reason npf rip 0xd06e53d6
> 47965.428687: kvm_page_fault: address bffb8 error_code 6
> 47965.428687: kvm_emulate_insn: 0:d06e53d6: 89 75 f8 (prot32)
> 47965.428688: kvm_mmio: mmio write len 4 gpa 0xbffb8 val 0xd0201fc6
> 47965.428688: kvm_entry: vcpu 0
> 47965.428689: kvm_exit: reason npf rip 0xd06e53d9
> 47965.428689: kvm_page_fault: address bffc8 error_code 4
> 47965.428690: kvm_emulate_insn: 0:d06e53d9: 8b 75 08 (prot32)
> 47965.428690: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffc8 val 0x0
> 47965.428692: kvm_mmio: mmio read len 4 gpa 0xbffc8 val 0xd0ec7b00
> 47965.428692: kvm_entry: vcpu 0
> 47965.428693: kvm_exit: reason npf rip 0xd06e53dc
> 47965.428693: kvm_page_fault: address bffb4 error_code 6
> 47965.428694: kvm_emulate_insn: 0:d06e53dc: 89 5d f4 (prot32)
> 47965.428694: kvm_mmio: mmio write len 4 gpa 0xbffb4 val 0xd0eea840
> 47965.428695: kvm_entry: vcpu 0
> 47965.428696: kvm_exit: reason npf rip 0xd06e53df
> 47965.428696: kvm_page_fault: address bffbc error_code 6
> 47965.428696: kvm_emulate_insn: 0:d06e53df: 89 7d fc (prot32)
> 47965.428697: kvm_mmio: mmio write len 4 gpa 0xbffbc val 0xd0ac1ad4
> 47965.428697: kvm_entry: vcpu 0
> 47965.428698: kvm_exit: reason npf rip 0xd06e53e2
> 47965.428698: kvm_page_fault: address bffa0 error_code 6
> 47965.428699: kvm_emulate_insn: 0:d06e53e2: c7 44 24 08 00 00 00 00 (prot32)
> 47965.428699: kvm_mmio: mmio write len 4 gpa 0xbffa0 val 0x0
> 47965.428699: kvm_entry: vcpu 0
> 47965.428700: kvm_exit: reason npf rip 0xd06e53ed
> 47965.428700: kvm_page_fault: address bff9c error_code 6
> 47965.428701: kvm_emulate_insn: 0:d06e53ed: 89 44 24 04 (prot32)
> 47965.428701: kvm_mmio: mmio write len 4 gpa 0xbff9c val 0xb100
> 47965.428701: kvm_entry: vcpu 0
> 47965.428703: kvm_exit: reason npf rip 0xd06e53f4
> 47965.428703: kvm_page_fault: address bff98 error_code 6
> 47965.428703: kvm_emulate_insn: 0:d06e53f4: 89 04 24 (prot32)
> 47965.428704: kvm_mmio: mmio write len 4 gpa 0xbff98 val 0x0
> 47965.428704: kvm_entry: vcpu 0
> 47965.428705: kvm_exit: reason npf rip 0xd06e53f7
> 47965.428705: kvm_page_fault: address bff94 error_code 6
> 47965.428706: kvm_emulate_insn: 0:d06e53f7: e8 94 98 e7 ff (prot32)
> 47965.428706: kvm_mmio: mmio write len 4 gpa 0xbff94 val 0xd06e53fc
> 47965.428706: kvm_entry: vcpu 0
> 47965.428707: kvm_exit: reason npf rip 0xd055ec90
> 47965.428707: kvm_page_fault: address bff90 error_code 6
> 47965.428708: kvm_emulate_insn: 0:d055ec90: 55 (prot32)
> 47965.428708: kvm_mmio: mmio write len 4 gpa 0xbff90 val 0xd438cfc0
> 47965.428709: kvm_entry: vcpu 0
> 47965.428710: kvm_exit: reason npf rip 0xd055ec93
> 47965.428710: kvm_page_fault: address bff98 error_code 4
> 47965.428710: kvm_emulate_insn: 0:d055ec93: 8b 45 08 (prot32)
> 47965.428711: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbff98 val 0x0
> 47965.428712: kvm_mmio: mmio read len 4 gpa 0xbff98 val 0x0
> 47965.428713: kvm_entry: vcpu 0
> 47965.428714: kvm_exit: reason npf rip 0xd055eca8
> 47965.428714: kvm_page_fault: address bffa0 error_code 4
> 47965.428715: kvm_emulate_insn: 0:d055eca8: 8b 55 10 (prot32)
> 47965.428715: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffa0 val 0x0
> 47965.428716: kvm_mmio: mmio read len 4 gpa 0xbffa0 val 0x0
> 47965.428717: kvm_entry: vcpu 0
> 47965.428718: kvm_exit: reason npf rip 0xd055ecab
> 47965.428718: kvm_page_fault: address bff9c error_code 4
> 47965.428718: kvm_emulate_insn: 0:d055ecab: 03 55 0c (prot32)
> 47965.428719: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbff9c val 0x0
> 47965.428720: kvm_mmio: mmio read len 4 gpa 0xbff9c val 0xb100
> 47965.428721: kvm_entry: vcpu 0
> 47965.428721: kvm_exit: reason io rip 0xd055ecae
> 47965.428722: kvm_emulate_insn: 0:d055ecae: ec (prot32)
> 47965.428722: kvm_pio: pio_read at 0xb100 size 1 count 1
> 47965.428723: kvm_entry: vcpu 0
> 47965.428724: kvm_exit: reason npf rip 0xd055ecaf
> 47965.428725: kvm_page_fault: address bff90 error_code 4
> 47965.428725: kvm_emulate_insn: 0:d055ecaf: 5d (prot32)
> 47965.428726: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbff90 val 0x0
> 47965.428727: kvm_mmio: mmio read len 4 gpa 0xbff90 val 0xd438cfc0
> 47965.428727: kvm_entry: vcpu 0
> 47965.428728: kvm_exit: reason npf rip 0xd055ecb3
> 47965.428728: kvm_page_fault: address bff94 error_code 4
> 47965.428729: kvm_emulate_insn: 0:d055ecb3: c3 (prot32)
> 47965.428729: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbff94 val 0x0
> 47965.428730: kvm_mmio: mmio read len 4 gpa 0xbff94 val 0xd06e53fc
> 47965.428731: kvm_entry: vcpu 0
> 47965.428732: kvm_exit: reason npf rip 0xd06e540b
> 47965.428732: kvm_page_fault: address bffb4 error_code 4
> 47965.428732: kvm_emulate_insn: 0:d06e540b: 8b 5d f4 (prot32)
> 47965.428733: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffb4 val 0x0
> 47965.428734: kvm_mmio: mmio read len 4 gpa 0xbffb4 val 0xd0eea840
> 47965.428734: kvm_entry: vcpu 0
> 47965.428735: kvm_exit: reason npf rip 0xd06e540e
> 47965.428735: kvm_page_fault: address bffb8 error_code 4
> 47965.428736: kvm_emulate_insn: 0:d06e540e: 8b 75 f8 (prot32)
> 47965.428736: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffb8 val 0x0
> 47965.428737: kvm_mmio: mmio read len 4 gpa 0xbffb8 val 0xd0201fc6
> 47965.428738: kvm_entry: vcpu 0
> 47965.428739: kvm_exit: reason npf rip 0xd06e5411
> 47965.428739: kvm_page_fault: address bffbc error_code 4
> 47965.428740: kvm_emulate_insn: 0:d06e5411: 8b 7d fc (prot32)
> 47965.428740: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffbc val 0x0
> 47965.428741: kvm_mmio: mmio read len 4 gpa 0xbffbc val 0xd0ac1ad4
> 47965.428741: kvm_entry: vcpu 0
> 47965.428742: kvm_exit: reason npf rip 0xd06e5416
> 47965.428743: kvm_page_fault: address bffc0 error_code 4
> 47965.428743: kvm_emulate_insn: 0:d06e5416: 5d (prot32)
> 47965.428743: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffc0 val 0x0
> 47965.428745: kvm_mmio: mmio read len 4 gpa 0xbffc0 val 0xd438cfc8
> 47965.428745: kvm_entry: vcpu 0
> 47965.428746: kvm_exit: reason npf rip 0xd06e5417
> 47965.428746: kvm_page_fault: address bffc4 error_code 4
> 47965.428747: kvm_emulate_insn: 0:d06e5417: c3 (prot32)
> 47965.428747: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffc4 val 0x0
> 47965.428748: kvm_mmio: mmio read len 4 gpa 0xbffc4 val 0xd0202538
> 47965.428748: kvm_entry: vcpu 0
> 47965.428749: kvm_exit: reason npf rip 0xd0202554
> 47965.428750: kvm_page_fault: address fee000b0 error_code 6
> 47965.428750: kvm_emulate_insn: 0:d0202554: c7 05 b0 00 99 d0 00 00 00 00 (prot32)
> 47965.428751: kvm_mmio: mmio write len 4 gpa 0xfee000b0 val 0x0
> 47965.428751: kvm_apic: apic_write APIC_EOI = 0x0
> 47965.428751: kvm_ack_irq: irqchip IOAPIC pin 9
> 47965.428751: kvm_apic_accept_irq: apicid 0 vec 81 (Fixed|level)
> 47965.428752: kvm_entry: vcpu 0
> 47965.428753: kvm_exit: reason npf rip 0xd0201fc0
> 47965.428753: kvm_page_fault: address bffcc error_code 4
> 47965.428753: kvm_emulate_insn: 0:d0201fc0: 5b (prot32)
> 47965.428754: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffcc val 0x0
> 47965.428755: kvm_mmio: mmio read len 4 gpa 0xbffcc val 0x30
> 47965.428755: kvm_entry: vcpu 0
> 47965.428756: kvm_exit: reason npf rip 0xd0202002
> 47965.428756: kvm_page_fault: address fee00080 error_code 6
> 47965.428757: kvm_emulate_insn: 0:d0202002: 89 1d 80 00 99 d0 (prot32)
> 47965.428757: kvm_mmio: mmio write len 4 gpa 0xfee00080 val 0x30
> 47965.428757: kvm_apic: apic_write APIC_TASKPRI = 0x30
> 47965.428759: kvm_entry: vcpu 0
> 47965.428760: kvm_exit: reason npf rip 0xd0202030
> 47965.428760: kvm_page_fault: address bffd0 error_code 4
> 47965.428760: kvm_emulate_insn: 0:d0202030: 0f a1 (prot32)
> 47965.428761: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffd0 val 0x0
> 47965.428762: kvm_mmio: mmio read len 4 gpa 0xbffd0 val 0x58
> 47965.428763: kvm_entry: vcpu 0
> 47965.428764: kvm_exit: reason npf rip 0xd0202032
> 47965.428764: kvm_page_fault: address bffd4 error_code 4
> 47965.428765: kvm_emulate_insn: 0:d0202032: 0f a9 (prot32)
> 47965.428765: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffd4 val 0x0
> 47965.428766: kvm_mmio: mmio read len 4 gpa 0xbffd4 val 0x10
> 47965.428767: kvm_entry: vcpu 0
> 47965.428768: kvm_exit: reason npf rip 0xd0202034
> 47965.428768: kvm_page_fault: address bffd8 error_code 4
> 47965.428769: kvm_emulate_insn: 0:d0202034: 07 (prot32)
> 47965.428769: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffd8 val 0x0
> 47965.428770: kvm_mmio: mmio read len 4 gpa 0xbffd8 val 0x10
> 47965.428771: kvm_entry: vcpu 0
> 47965.428772: kvm_exit: reason npf rip 0xd0202035
> 47965.428772: kvm_page_fault: address bffdc error_code 4
> 47965.428773: kvm_emulate_insn: 0:d0202035: 1f (prot32)
> 47965.428773: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffdc val 0x0
> 47965.428774: kvm_mmio: mmio read len 4 gpa 0xbffdc val 0x10
> 47965.428775: kvm_entry: vcpu 0
> 47965.428776: kvm_exit: reason npf rip 0xd0202036
> 47965.428776: kvm_page_fault: address bffe0 error_code 4
> 47965.428777: kvm_emulate_insn: 0:d0202036: 5f (prot32)
> 47965.428777: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffe0 val 0x0
> 47965.428778: kvm_mmio: mmio read len 4 gpa 0xbffe0 val 0xd0ac1ad4
> 47965.428779: kvm_entry: vcpu 0
> 47965.428780: kvm_exit: reason npf rip 0xd0202037
> 47965.428780: kvm_page_fault: address bffe4 error_code 4
> 47965.428780: kvm_emulate_insn: 0:d0202037: 5e (prot32)
> 47965.428781: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffe4 val 0x0
> 47965.428782: kvm_mmio: mmio read len 4 gpa 0xbffe4 val 0xd0201fc6
> 47965.428782: kvm_entry: vcpu 0
> 47965.428783: kvm_exit: reason npf rip 0xd0202038
> 47965.428783: kvm_page_fault: address bffe8 error_code 4
> 47965.428784: kvm_emulate_insn: 0:d0202038: 5d (prot32)
> 47965.428784: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffe8 val 0x0
> 47965.428786: kvm_mmio: mmio read len 4 gpa 0xbffe8 val 0xd4492e1c
> 47965.428786: kvm_entry: vcpu 0
> 47965.428787: kvm_exit: reason npf rip 0xd0202039
> 47965.428788: kvm_page_fault: address bffec error_code 4
> 47965.428788: kvm_emulate_insn: 0:d0202039: 5b (prot32)
> 47965.428789: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbffec val 0x0
> 47965.428790: kvm_mmio: mmio read len 4 gpa 0xbffec val 0x0
> 47965.428790: kvm_entry: vcpu 0
> 47965.428791: kvm_exit: reason npf rip 0xd020203a
> 47965.428791: kvm_page_fault: address bfff0 error_code 4
> 47965.428792: kvm_emulate_insn: 0:d020203a: 5a (prot32)
> 47965.428792: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbfff0 val 0x0
> 47965.428793: kvm_mmio: mmio read len 4 gpa 0xbfff0 val 0xb100
> 47965.428794: kvm_entry: vcpu 0
> 47965.428795: kvm_exit: reason npf rip 0xd020203b
> 47965.428795: kvm_page_fault: address bfff4 error_code 4
> 47965.428795: kvm_emulate_insn: 0:d020203b: 59 (prot32)
> 47965.428796: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbfff4 val 0x0
> 47965.428797: kvm_mmio: mmio read len 4 gpa 0xbfff4 val 0x0
> 47965.428797: kvm_entry: vcpu 0
> 47965.428798: kvm_exit: reason npf rip 0xd020203c
> 47965.428798: kvm_page_fault: address bfff8 error_code 4
> 47965.428799: kvm_emulate_insn: 0:d020203c: 58 (prot32)

That's a POP instruction.  So openbsd mapped the stack into the 
framebuffer, and kvm has to emulate everything.

Please post a complete binary trace from bootup until the 
host_state_reload issue appears.

> 47965.428799: kvm_mmio: mmio unsatisfied-read len 4 gpa 0xbfff8 val 0x0
> 47965.428801: kvm_mmio: mmio read len 4 gpa 0xbfff8 val 0x30
> 47965.428801: kvm_entry: vcpu 0
> 47965.428802: kvm_exit: reason vintr rip 0xd0202041
> 47965.428802: kvm_inj_virq: irq 81
> 47965.428802: kvm_inj_virq: irq 81
> 47965.428803: kvm_entry: vcpu 0
> 47965.428803: kvm_exit: reason npf rip 0xd0202041
> 47965.428804: kvm_page_fault: address bfffc error_code 6
> 47965.428804: kvm_emulate_insn: 0:d0202041: cf (prot32)
> 47965.428805: kvm_emulate_insn: 0:d0202041: cf (prot32) failed

We don't emulate IRET-with-mmio-stack.


-- 
error compiling committee.c: too many arguments to function