* [PATCH 1/2] KVM: x86: ioapic: Set remote_irr only after successful delivery
@ 2026-08-06 13:39 Hao Zhang
2026-08-06 13:46 ` [PATCH 2/2] KVM: selftests: Verify IOAPIC doesn't set remote_irr on failed delivery Hao Zhang
2026-08-07 7:41 ` [PATCH 1/2] KVM: x86: ioapic: Set remote_irr only after successful delivery Huang, Kai
0 siblings, 2 replies; 5+ messages in thread
From: Hao Zhang @ 2026-08-06 13:39 UTC (permalink / raw)
To: Sean Christopherson; +Cc: Paolo Bonzini, kvm
From: Hao Zhang <zhanghao1@kylinos.cn>
The I/O APIC sets remote_irr for level-triggered interrupts to track that
the interrupt has been accepted by a local APIC and that the I/O APIC must
wait for the corresponding EOI before delivering the interrupt again.
But ioapic_service() currently sets remote_irr for any non-zero return
from kvm_irq_delivery_to_apic(). The delivery helper can return -1 when
no destination is found. Treating -1 as success causes KVM to set
remote_irr even though no interrupt was delivered and no EOI will ever
be generated, leaving the pin blocked.
Set remote_irr only when the delivery result is positive, i.e. when at
least one local APIC accepted the interrupt.
Fixes: 4925663a079c ("KVM: Report IRQ injection status to userspace.")
Signed-off-by: Hao Zhang <zhanghao1@kylinos.cn>
---
arch/x86/kvm/ioapic.c | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/arch/x86/kvm/ioapic.c b/arch/x86/kvm/ioapic.c
index 757667fb2bfa..24a7cc3b8b7e 100644
--- a/arch/x86/kvm/ioapic.c
+++ b/arch/x86/kvm/ioapic.c
@@ -491,7 +491,7 @@ static int ioapic_service(struct kvm_ioapic *ioapic, int irq, bool line_status)
} else
ret = kvm_irq_delivery_to_apic(ioapic->kvm, NULL, &irqe);
- if (ret && irqe.trig_mode == IOAPIC_LEVEL_TRIG)
+ if (ret > 0 && irqe.trig_mode == IOAPIC_LEVEL_TRIG)
entry->fields.remote_irr = 1;
return ret;
base-commit: c21bb4193868a8de71fc4693fa741e195fdf5d86
--
2.15.0
^ permalink raw reply related [flat|nested] 5+ messages in thread* [PATCH 2/2] KVM: selftests: Verify IOAPIC doesn't set remote_irr on failed delivery 2026-08-06 13:39 [PATCH 1/2] KVM: x86: ioapic: Set remote_irr only after successful delivery Hao Zhang @ 2026-08-06 13:46 ` Hao Zhang 2026-08-07 7:41 ` [PATCH 1/2] KVM: x86: ioapic: Set remote_irr only after successful delivery Huang, Kai 1 sibling, 0 replies; 5+ messages in thread From: Hao Zhang @ 2026-08-06 13:46 UTC (permalink / raw) To: Sean Christopherson; +Cc: Paolo Bonzini, kvm From: Hao Zhang <zhanghao1@kylinos.cn> Add a regression test for level-triggered I/O APIC interrupt delivery when no local APIC can accept the interrupt. remote_irr tracks that a level-triggered interrupt has been accepted by a local APIC and that the I/O APIC must wait for the corresponding EOI before delivering the interrupt again. If no local APIC accepts the interrupt, remote_irr must remain clear, as no EOI will ever be generated. Configure an I/O APIC redirection entry and inject an I/O APIC-only GSI before creating any vCPUs. Verify that KVM_IRQ_LINE_STATUS reports failed delivery and that KVM_GET_IRQCHIP reports remote_irr clear. This covers the case where failed delivery returns a negative value and must not be treated as a successful delivery for remote_irr tracking. Signed-off-by: Hao Zhang <zhanghao1@kylinos.cn> --- tools/testing/selftests/kvm/Makefile.kvm | 1 + .../testing/selftests/kvm/x86/ioapic_state_test.c | 70 ++++++++++++++++++++++ 2 files changed, 71 insertions(+) create mode 100644 tools/testing/selftests/kvm/x86/ioapic_state_test.c diff --git a/tools/testing/selftests/kvm/Makefile.kvm b/tools/testing/selftests/kvm/Makefile.kvm index 6fc34e9bf8e1..89e3f82e75b0 100644 --- a/tools/testing/selftests/kvm/Makefile.kvm +++ b/tools/testing/selftests/kvm/Makefile.kvm @@ -86,6 +86,7 @@ TEST_GEN_PROGS_x86 += x86/hyperv_features TEST_GEN_PROGS_x86 += x86/hyperv_ipi TEST_GEN_PROGS_x86 += x86/hyperv_svm_test TEST_GEN_PROGS_x86 += x86/hyperv_tlb_flush +TEST_GEN_PROGS_x86 += x86/ioapic_state_test TEST_GEN_PROGS_x86 += x86/kvm_clock_test TEST_GEN_PROGS_x86 += x86/kvm_pv_test TEST_GEN_PROGS_x86 += x86/kvm_buslock_test diff --git a/tools/testing/selftests/kvm/x86/ioapic_state_test.c b/tools/testing/selftests/kvm/x86/ioapic_state_test.c new file mode 100644 index 000000000000..3e1badcc391c --- /dev/null +++ b/tools/testing/selftests/kvm/x86/ioapic_state_test.c @@ -0,0 +1,70 @@ +// SPDX-License-Identifier: GPL-2.0-only +/* + * Regression tests for in-kernel I/O APIC state. + */ + +#include "kvm_util.h" +#include "test_util.h" + +#define TEST_IOAPIC_PIN 16 +#define TEST_VECTOR 0x50 +#define NO_SUCH_APIC_ID 0xfe + +static void get_ioapic(struct kvm_vm *vm, struct kvm_irqchip *irqchip) +{ + int r; + + irqchip->chip_id = KVM_IRQCHIP_IOAPIC; + r = __vm_ioctl(vm, KVM_GET_IRQCHIP, irqchip); + if (r && errno == ENXIO) + __TEST_REQUIRE(0, "In-kernel I/O APIC not available"); + + TEST_ASSERT(!r, KVM_IOCTL_ERROR(KVM_GET_IRQCHIP, r)); +} + +static void set_ioapic(struct kvm_vm *vm, struct kvm_irqchip *irqchip) +{ + irqchip->chip_id = KVM_IRQCHIP_IOAPIC; + vm_ioctl(vm, KVM_SET_IRQCHIP, irqchip); +} + +static void test_no_remote_irr_for_undelivered_interrupt(void) +{ + struct kvm_irq_level irq = { + .irq = TEST_IOAPIC_PIN, + .level = 1, + }; + struct kvm_irqchip irqchip; + struct kvm_vm *vm; + + vm = vm_create_barebones(); + vm_create_irqchip(vm); + + get_ioapic(vm, &irqchip); + + irqchip.chip.ioapic.redirtbl[TEST_IOAPIC_PIN].fields.vector = TEST_VECTOR; + irqchip.chip.ioapic.redirtbl[TEST_IOAPIC_PIN].fields.dest_id = NO_SUCH_APIC_ID; + irqchip.chip.ioapic.redirtbl[TEST_IOAPIC_PIN].fields.dest_mode = 0; + irqchip.chip.ioapic.redirtbl[TEST_IOAPIC_PIN].fields.trig_mode = 1; + irqchip.chip.ioapic.redirtbl[TEST_IOAPIC_PIN].fields.mask = 0; + irqchip.chip.ioapic.redirtbl[TEST_IOAPIC_PIN].fields.remote_irr = 0; + + set_ioapic(vm, &irqchip); + + vm_ioctl(vm, KVM_IRQ_LINE_STATUS, &irq); + TEST_ASSERT(irq.status == -1, + "Expected failed interrupt delivery, got %d", irq.status); + + get_ioapic(vm, &irqchip); + TEST_ASSERT(!irqchip.chip.ioapic.redirtbl[TEST_IOAPIC_PIN].fields.remote_irr, + "KVM set remote_irr for a level-triggered interrupt that wasn't delivered"); + + kvm_vm_free(vm); +} + +int main(void) +{ + test_no_remote_irr_for_undelivered_interrupt(); + + return 0; +} -- 2.15.0 ^ permalink raw reply related [flat|nested] 5+ messages in thread
* Re: [PATCH 1/2] KVM: x86: ioapic: Set remote_irr only after successful delivery 2026-08-06 13:39 [PATCH 1/2] KVM: x86: ioapic: Set remote_irr only after successful delivery Hao Zhang 2026-08-06 13:46 ` [PATCH 2/2] KVM: selftests: Verify IOAPIC doesn't set remote_irr on failed delivery Hao Zhang @ 2026-08-07 7:41 ` Huang, Kai 2026-08-10 1:39 ` hao_zhang_kdev 1 sibling, 1 reply; 5+ messages in thread From: Huang, Kai @ 2026-08-07 7:41 UTC (permalink / raw) To: seanjc@google.com, hao_zhang_kdev@163.com Cc: kvm@vger.kernel.org, pbonzini@redhat.com On Thu, 2026-08-06 at 21:39 +0800, Hao Zhang wrote: > From: Hao Zhang <zhanghao1@kylinos.cn> > > The I/O APIC sets remote_irr for level-triggered interrupts to track that > the interrupt has been accepted by a local APIC and that the I/O APIC must > wait for the corresponding EOI before delivering the interrupt again. > > But ioapic_service() currently sets remote_irr for any non-zero return > from kvm_irq_delivery_to_apic(). The delivery helper can return -1 when > no destination is found. Treating -1 as success causes KVM to set > remote_irr even though no interrupt was delivered and no EOI will ever > be generated, leaving the pin blocked. > > Set remote_irr only when the delivery result is positive, i.e. when at > least one local APIC accepted the interrupt. > > Fixes: 4925663a079c ("KVM: Report IRQ injection status to userspace.") > Signed-off-by: Hao Zhang <zhanghao1@kylinos.cn> > --- > arch/x86/kvm/ioapic.c | 2 +- > 1 file changed, 1 insertion(+), 1 deletion(-) > > diff --git a/arch/x86/kvm/ioapic.c b/arch/x86/kvm/ioapic.c > index 757667fb2bfa..24a7cc3b8b7e 100644 > --- a/arch/x86/kvm/ioapic.c > +++ b/arch/x86/kvm/ioapic.c > @@ -491,7 +491,7 @@ static int ioapic_service(struct kvm_ioapic *ioapic, int irq, bool line_status) > } else > ret = kvm_irq_delivery_to_apic(ioapic->kvm, NULL, &irqe); > > - if (ret && irqe.trig_mode == IOAPIC_LEVEL_TRIG) > + if (ret > 0 && irqe.trig_mode == IOAPIC_LEVEL_TRIG) > entry->fields.remote_irr = 1; > > return ret; > > base-commit: c21bb4193868a8de71fc4693fa741e195fdf5d86 This seems reasonable to me. Just wondering did you meet any real bug? Btw, currently the IRQ is set to irr_delivered for level-triggered IRQ regardless of the return value of kvm_irq_delivery_to_apic(): if (irqe.trig_mode == IOAPIC_EDGE_TRIG) ioapic->irr_delivered |= 1 << irq; if (irq == RTC_GSI && line_status) { ... } else ret = kvm_irq_delivery_to_apic(ioapic->kvm, NULL, &irqe); ... Similarly, should this only be done when kvm_irq_delivery_to_apic() returns positive? E.g., kvm_get_ioapic() clears the bits in irr_delivered, so if one IRQ is set in it but actually not accepted by LAPIC then kvm_get_ioapic() will not return such IRQ in irr, therefore it can potentially be lost? ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [PATCH 1/2] KVM: x86: ioapic: Set remote_irr only after successful delivery 2026-08-07 7:41 ` [PATCH 1/2] KVM: x86: ioapic: Set remote_irr only after successful delivery Huang, Kai @ 2026-08-10 1:39 ` hao_zhang_kdev 2026-08-10 8:44 ` Huang, Kai 0 siblings, 1 reply; 5+ messages in thread From: hao_zhang_kdev @ 2026-08-10 1:39 UTC (permalink / raw) To: Huang, Kai Cc: seanjc@google.com, hao_zhang_kdev@163.com, kvm@vger.kernel.org, pbonzini@redhat.com On Fri, Aug 07, 2026, Huang, Kai wrote: > On Thu, 2026-08-06 at 21:39 +0800, Hao Zhang wrote: > > From: Hao Zhang <zhanghao1@kylinos.cn> > > > > The I/O APIC sets remote_irr for level-triggered interrupts to track that > > the interrupt has been accepted by a local APIC and that the I/O APIC must > > wait for the corresponding EOI before delivering the interrupt again. > > > > But ioapic_service() currently sets remote_irr for any non-zero return > > from kvm_irq_delivery_to_apic(). The delivery helper can return -1 when > > no destination is found. Treating -1 as success causes KVM to set > > remote_irr even though no interrupt was delivered and no EOI will ever > > be generated, leaving the pin blocked. > > > > Set remote_irr only when the delivery result is positive, i.e. when at > > least one local APIC accepted the interrupt. > > > > Fixes: 4925663a079c ("KVM: Report IRQ injection status to userspace.") > > Signed-off-by: Hao Zhang <zhanghao1@kylinos.cn> > > --- > > arch/x86/kvm/ioapic.c | 2 +- > > 1 file changed, 1 insertion(+), 1 deletion(-) > > > > diff --git a/arch/x86/kvm/ioapic.c b/arch/x86/kvm/ioapic.c > > index 757667fb2bfa..24a7cc3b8b7e 100644 > > --- a/arch/x86/kvm/ioapic.c > > +++ b/arch/x86/kvm/ioapic.c > > @@ -491,7 +491,7 @@ static int ioapic_service(struct kvm_ioapic *ioapic, int irq, bool line_status) > > } else > > ret = kvm_irq_delivery_to_apic(ioapic->kvm, NULL, &irqe); > > > > - if (ret && irqe.trig_mode == IOAPIC_LEVEL_TRIG) > > + if (ret > 0 && irqe.trig_mode == IOAPIC_LEVEL_TRIG) > > entry->fields.remote_irr = 1; > > > > return ret; > > > > base-commit: c21bb4193868a8de71fc4693fa741e195fdf5d86 > > This seems reasonable to me. Just wondering did you meet any real bug? > I didn't hit this from a production workload; I found it while testing the failed-delivery path. But the state corruption is guest/userspace visible, especially across KVM_GET_IRQCHIP/KVM_SET_IRQCHIP. > Btw, currently the IRQ is set to irr_delivered for level-triggered IRQ > regardless of the return value of kvm_irq_delivery_to_apic(): > > if (irqe.trig_mode == IOAPIC_EDGE_TRIG) > ioapic->irr_delivered |= 1 << irq; > > if (irq == RTC_GSI && line_status) { > ... > } else > ret = kvm_irq_delivery_to_apic(ioapic->kvm, NULL, &irqe); > > ... > > Similarly, should this only be done when kvm_irq_delivery_to_apic() returns > positive? > > E.g., kvm_get_ioapic() clears the bits in irr_delivered, so if one IRQ is set in > it but actually not accepted by LAPIC then kvm_get_ioapic() will not return such > IRQ in irr, therefore it can potentially be lost? > > Thanks, yes, I think you're right. irr_delivered has the same problem for edge-triggered interrupts: it is used to hide delivered edge IRQs from KVM_GET_IRQCHIP, but currently it is set before knowing whether delivery actually succeeded. If delivery fails, KVM_GET_IRQCHIP can incorrectly drop the pending IRR bit. I'll send a v2 that gates both remote_irr and irr_delivered on ret > 0, and extend the selftest to cover the edge-triggered irr_delivered case too. Thanks, Hao ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [PATCH 1/2] KVM: x86: ioapic: Set remote_irr only after successful delivery 2026-08-10 1:39 ` hao_zhang_kdev @ 2026-08-10 8:44 ` Huang, Kai 0 siblings, 0 replies; 5+ messages in thread From: Huang, Kai @ 2026-08-10 8:44 UTC (permalink / raw) To: hao_zhang_kdev@163.com Cc: kvm@vger.kernel.org, pbonzini@redhat.com, seanjc@google.com > > > Btw, currently the IRQ is set to irr_delivered for level-triggered IRQ > > regardless of the return value of kvm_irq_delivery_to_apic(): > > > > if (irqe.trig_mode == IOAPIC_EDGE_TRIG) > > ioapic->irr_delivered |= 1 << irq; [...] > Thanks, yes, I think you're right. irr_delivered has the same problem for > edge-triggered interrupts: it is used to hide delivered edge IRQs from > KVM_GET_IRQCHIP, but currently it is set before knowing whether delivery > actually succeeded. If delivery fails, KVM_GET_IRQCHIP can incorrectly > drop the pending IRR bit. Sorry as I replied in v2, I misread the code that I thought irr_delivered is for level-triggered IRQ too. For edge triggered I think the hardware behaviour is once it is triggered the IRQ is considered delivered, since it's just an "edge". > > I'll send a v2 that gates both remote_irr and irr_delivered on ret > 0, and > extend the selftest to cover the edge-triggered irr_delivered case too. I wish I saw this reply earlier. Again sorry for the noise. ^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2026-08-10 8:44 UTC | newest] Thread overview: 5+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2026-08-06 13:39 [PATCH 1/2] KVM: x86: ioapic: Set remote_irr only after successful delivery Hao Zhang 2026-08-06 13:46 ` [PATCH 2/2] KVM: selftests: Verify IOAPIC doesn't set remote_irr on failed delivery Hao Zhang 2026-08-07 7:41 ` [PATCH 1/2] KVM: x86: ioapic: Set remote_irr only after successful delivery Huang, Kai 2026-08-10 1:39 ` hao_zhang_kdev 2026-08-10 8:44 ` Huang, Kai
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox