From: "Radim Krčmář" <rkrcmar@redhat.com>
To: Wanpeng Li <kernellwp@gmail.com>
Cc: qemu-devel@nongnu.org, kvm@vger.kernel.org,
Wanpeng Li <wanpeng.li@hotmail.com>,
Paolo Bonzini <pbonzini@redhat.com>,
"Michael S. Tsirkin" <mst@redhat.com>,
Eduardo Habkost <ehabkost@redhat.com>
Subject: Re: [PATCH] pc: apic: fix touch LAPIC when irqchip is split
Date: Wed, 14 Sep 2016 16:02:43 +0200 [thread overview]
Message-ID: <20160914140243.GA17296@potion> (raw)
In-Reply-To: <1473822299-6302-1-git-send-email-wanpeng.li@hotmail.com>
2016-09-14 11:04+0800, Wanpeng Li:
> From: Wanpeng Li <wanpeng.li@hotmail.com>
>
> Add -kernel_irqchip=split
> ./x86-run x86/eventinj.flat
>
> qemu-system-x86_64 -enable-kvm -machine kernel_irqchip=split -cpu host
> -device pc-testdev -device isa-debug-exit,iobase=0xf4,iosize=0x4 -vnc
> none -serial stdio -device pci-testdev -kernel x86/eventinj.flat
> enabling apic
> paging enabled
> cr0 = 80010011
> cr3 = 7fff000
> cr4 = 20
> Sending vec 33 and 62 and mask one with TPR
> irq1 running
> irq1 running
> After 33/62 TPR test
> FAIL: TPR
> irq0 running
> irq0 running
>
> Both irq1 and irq0 are executing twice.
>
> kvm_entry: vcpu 0
> kvm_exit: reason MSR_WRITE rip 0x401f33 info 0 0
> kvm_apic: apic_write APIC_EOI = 0x0
> kvm_eoi: apicid 0 vector 62
> kvm_msr: msr_write 80b = 0x0
> kvm_entry: vcpu 0
> kvm_exit: reason PENDING_INTERRUPT rip 0x401f35 info 0 0
> kvm_userspace_exit: reason KVM_EXIT_IRQ_WINDOW_OPEN (7)
> kvm_inj_virq: irq 62
> kvm_entry: vcpu 0
> kvm_exit: reason IO_INSTRUCTION rip 0x4016ec info 3fd0008 0
>
> From the trace we can see there is an interrupt window exit
> after the first interrupt EOI(irq 62), and the same irq(62)
> is injected duplicately after the interrupt window.
>
> QEMU does KVM_INTERRUPT(62) ioctl after KVM exits with
> KVM_EXIT_IRQ_WINDOW_OPEN, which QEMU requested while the
> guest was printing. The printing calls
>
> serial_update_irq() -> qemu_irq_lower() -> qemu_set_irq() ->
> gsi_handler() -> qemu_set_irq() -> pic_irq_request() ->
> apic_deliver_pic_intr() -> kvm_handle_interrupt()
>
> kvm_handle_interrupt() does
>
> interrupt_request |= CPU_INTERRUPT_HARD
>
> which later calls cpu_get_pic_interrupt() in kvm_arch_pre_run(),
> but that function uses stale information from APIC and injects
> 62 again. If we synchronized the APIC, then the test would #GP,
> because there would be no injectable interrupt in LAPIC or PIC,
> so pic_read_irq() would return 15, thinking it was spurious.
>
> This patch fix it by don't touch LAPIC if LAPIC is in kernel.
>
> Suggested-by: Paolo Bonzini <pbonzini@redhat.com>
> Suggested-by: Radim Krčmář <rkrcmar@redhat.com>
> Cc: Paolo Bonzini <pbonzini@redhat.com>
> Cc: Radim Krčmář <rkrcmar@redhat.com>
> Cc: Michael S. Tsirkin <mst@redhat.com>
> Cc: Eduardo Habkost <ehabkost@redhat.com>
> Signed-off-by: Wanpeng Li <wanpeng.li@hotmail.com>
> ---
Reviewed-by: Radim Krčmář <rkrcmar@redhat.com>
(The code is horribly tangled, so I might have missed something.)
WARNING: multiple messages have this Message-ID (diff)
From: "Radim Krčmář" <rkrcmar@redhat.com>
To: Wanpeng Li <kernellwp@gmail.com>
Cc: qemu-devel@nongnu.org, kvm@vger.kernel.org,
Wanpeng Li <wanpeng.li@hotmail.com>,
Paolo Bonzini <pbonzini@redhat.com>,
"Michael S. Tsirkin" <mst@redhat.com>,
Eduardo Habkost <ehabkost@redhat.com>
Subject: Re: [Qemu-devel] [PATCH] pc: apic: fix touch LAPIC when irqchip is split
Date: Wed, 14 Sep 2016 16:02:43 +0200 [thread overview]
Message-ID: <20160914140243.GA17296@potion> (raw)
In-Reply-To: <1473822299-6302-1-git-send-email-wanpeng.li@hotmail.com>
2016-09-14 11:04+0800, Wanpeng Li:
> From: Wanpeng Li <wanpeng.li@hotmail.com>
>
> Add -kernel_irqchip=split
> ./x86-run x86/eventinj.flat
>
> qemu-system-x86_64 -enable-kvm -machine kernel_irqchip=split -cpu host
> -device pc-testdev -device isa-debug-exit,iobase=0xf4,iosize=0x4 -vnc
> none -serial stdio -device pci-testdev -kernel x86/eventinj.flat
> enabling apic
> paging enabled
> cr0 = 80010011
> cr3 = 7fff000
> cr4 = 20
> Sending vec 33 and 62 and mask one with TPR
> irq1 running
> irq1 running
> After 33/62 TPR test
> FAIL: TPR
> irq0 running
> irq0 running
>
> Both irq1 and irq0 are executing twice.
>
> kvm_entry: vcpu 0
> kvm_exit: reason MSR_WRITE rip 0x401f33 info 0 0
> kvm_apic: apic_write APIC_EOI = 0x0
> kvm_eoi: apicid 0 vector 62
> kvm_msr: msr_write 80b = 0x0
> kvm_entry: vcpu 0
> kvm_exit: reason PENDING_INTERRUPT rip 0x401f35 info 0 0
> kvm_userspace_exit: reason KVM_EXIT_IRQ_WINDOW_OPEN (7)
> kvm_inj_virq: irq 62
> kvm_entry: vcpu 0
> kvm_exit: reason IO_INSTRUCTION rip 0x4016ec info 3fd0008 0
>
> From the trace we can see there is an interrupt window exit
> after the first interrupt EOI(irq 62), and the same irq(62)
> is injected duplicately after the interrupt window.
>
> QEMU does KVM_INTERRUPT(62) ioctl after KVM exits with
> KVM_EXIT_IRQ_WINDOW_OPEN, which QEMU requested while the
> guest was printing. The printing calls
>
> serial_update_irq() -> qemu_irq_lower() -> qemu_set_irq() ->
> gsi_handler() -> qemu_set_irq() -> pic_irq_request() ->
> apic_deliver_pic_intr() -> kvm_handle_interrupt()
>
> kvm_handle_interrupt() does
>
> interrupt_request |= CPU_INTERRUPT_HARD
>
> which later calls cpu_get_pic_interrupt() in kvm_arch_pre_run(),
> but that function uses stale information from APIC and injects
> 62 again. If we synchronized the APIC, then the test would #GP,
> because there would be no injectable interrupt in LAPIC or PIC,
> so pic_read_irq() would return 15, thinking it was spurious.
>
> This patch fix it by don't touch LAPIC if LAPIC is in kernel.
>
> Suggested-by: Paolo Bonzini <pbonzini@redhat.com>
> Suggested-by: Radim Krčmář <rkrcmar@redhat.com>
> Cc: Paolo Bonzini <pbonzini@redhat.com>
> Cc: Radim Krčmář <rkrcmar@redhat.com>
> Cc: Michael S. Tsirkin <mst@redhat.com>
> Cc: Eduardo Habkost <ehabkost@redhat.com>
> Signed-off-by: Wanpeng Li <wanpeng.li@hotmail.com>
> ---
Reviewed-by: Radim Krčmář <rkrcmar@redhat.com>
(The code is horribly tangled, so I might have missed something.)
next prev parent reply other threads:[~2016-09-14 14:02 UTC|newest]
Thread overview: 9+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-09-14 3:04 [PATCH] pc: apic: fix touch LAPIC when irqchip is split Wanpeng Li
2016-09-14 3:04 ` [Qemu-devel] " Wanpeng Li
2016-09-14 3:21 ` no-reply
2016-09-14 3:40 ` Fam Zheng
2016-09-14 3:47 ` Wanpeng Li
2016-09-14 14:02 ` Radim Krčmář [this message]
2016-09-14 14:02 ` Radim Krčmář
2016-09-14 14:03 ` Radim Krčmář
2016-09-14 14:03 ` [Qemu-devel] " Radim Krčmář
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20160914140243.GA17296@potion \
--to=rkrcmar@redhat.com \
--cc=ehabkost@redhat.com \
--cc=kernellwp@gmail.com \
--cc=kvm@vger.kernel.org \
--cc=mst@redhat.com \
--cc=pbonzini@redhat.com \
--cc=qemu-devel@nongnu.org \
--cc=wanpeng.li@hotmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.