From: Marc Zyngier <maz@kernel.org>
To: Reiji Watanabe <reijiw@google.com>
Cc: will@kernel.org, mingo@redhat.com, tglx@linutronix.de,
kvmarm@lists.cs.columbia.edu,
linux-arm-kernel@lists.infradead.org
Subject: Re: [PATCH v2 0/4] KVM: arm64: Improve PMU support on heterogeneous systems
Date: Wed, 08 Dec 2021 08:05:14 +0000 [thread overview]
Message-ID: <addac215bddf0b86bf6850093d500785@kernel.org> (raw)
In-Reply-To: <CAAeT=FygprcS3YxbVaW+4yUjHBm8=MxZ+j4_iVjq7ie-ppRKRg@mail.gmail.com>
Reji,
On 2021-12-08 02:36, Reiji Watanabe wrote:
> Hi Alex,
>
> On Mon, Dec 6, 2021 at 9:02 AM Alexandru Elisei
> <alexandru.elisei@arm.com> wrote:
>>
>> (CC'ing Peter Maydell in case this might be of interest to qemu)
>>
>> The series can be found on a branch at [1], and the kvmtool support at
>> [2].
>> The kvmtool patches are also on the mailing list [3] and haven't
>> changed
>> since v1.
>>
>> Detailed explanation of the issue and symptoms that the patches
>> attempt to
>> correct can be found in the cover letter for v1 [4].
>>
>> A brief summary of the problem is that on heterogeneous systems KVM
>> will
>> always use the same PMU for creating the VCPU events for *all* VCPUs
>> regardless of the physical CPU on which the VCPU is running, leading
>> to
>> events suddenly stopping and resuming in the guest as the VCPU thread
>> gets
>> migrated across different CPUs.
>>
>> This series proposes to fix this behaviour by allowing the user to
>> specify
>> which physical PMU is used when creating the VCPU events needed for
>> guest
>> PMU emulation. When the PMU is set, KVM will refuse to the VCPU on a
>> physical which is not part of the supported CPUs for the specified
>> PMU.
>
> Just to confirm, this series provides an API for userspace to request
> KVM to detect a wrong affinity setting due to a userspace bug so that
> userspace can get an error at KVM_RUN instead of leading to events
> suddenly stopping, correct ?
More than that, it allows userspace to select which PMU will be used
for their guest. The affinity setting is a byproduct of the PMU's own
affinity.
>
>> The default behaviour stays the same - without userspace setting the
>> PMU,
>> events will stop counting if the VCPU is scheduled on the wrong CPU.
>
> Can't we fix the default behavior (in addition to the current fix) ?
> (Do we need to maintain the default behavior ??)
Of course we do. This is a behaviour that has been exposed to userspace
for years, and *we don't break userspace*.
> IMHO I feel it is better to prevent userspace from configuring PMU
> for guests on such heterogeneous systems rather than leading to
> events suddenly stopping even as the default behavior.
People running KVM on asymmetric systems *strongly* disagree with you.
M.
--
Jazz is not dead. It just smells funny...
_______________________________________________
kvmarm mailing list
kvmarm@lists.cs.columbia.edu
https://lists.cs.columbia.edu/mailman/listinfo/kvmarm
WARNING: multiple messages have this Message-ID (diff)
From: Marc Zyngier <maz@kernel.org>
To: Reiji Watanabe <reijiw@google.com>
Cc: Alexandru Elisei <alexandru.elisei@arm.com>,
james.morse@arm.com, suzuki.poulose@arm.com, will@kernel.org,
mark.rutland@arm.com, linux-arm-kernel@lists.infradead.org,
kvmarm@lists.cs.columbia.edu, tglx@linutronix.de,
mingo@redhat.com
Subject: Re: [PATCH v2 0/4] KVM: arm64: Improve PMU support on heterogeneous systems
Date: Wed, 08 Dec 2021 08:05:14 +0000 [thread overview]
Message-ID: <addac215bddf0b86bf6850093d500785@kernel.org> (raw)
In-Reply-To: <CAAeT=FygprcS3YxbVaW+4yUjHBm8=MxZ+j4_iVjq7ie-ppRKRg@mail.gmail.com>
Reji,
On 2021-12-08 02:36, Reiji Watanabe wrote:
> Hi Alex,
>
> On Mon, Dec 6, 2021 at 9:02 AM Alexandru Elisei
> <alexandru.elisei@arm.com> wrote:
>>
>> (CC'ing Peter Maydell in case this might be of interest to qemu)
>>
>> The series can be found on a branch at [1], and the kvmtool support at
>> [2].
>> The kvmtool patches are also on the mailing list [3] and haven't
>> changed
>> since v1.
>>
>> Detailed explanation of the issue and symptoms that the patches
>> attempt to
>> correct can be found in the cover letter for v1 [4].
>>
>> A brief summary of the problem is that on heterogeneous systems KVM
>> will
>> always use the same PMU for creating the VCPU events for *all* VCPUs
>> regardless of the physical CPU on which the VCPU is running, leading
>> to
>> events suddenly stopping and resuming in the guest as the VCPU thread
>> gets
>> migrated across different CPUs.
>>
>> This series proposes to fix this behaviour by allowing the user to
>> specify
>> which physical PMU is used when creating the VCPU events needed for
>> guest
>> PMU emulation. When the PMU is set, KVM will refuse to the VCPU on a
>> physical which is not part of the supported CPUs for the specified
>> PMU.
>
> Just to confirm, this series provides an API for userspace to request
> KVM to detect a wrong affinity setting due to a userspace bug so that
> userspace can get an error at KVM_RUN instead of leading to events
> suddenly stopping, correct ?
More than that, it allows userspace to select which PMU will be used
for their guest. The affinity setting is a byproduct of the PMU's own
affinity.
>
>> The default behaviour stays the same - without userspace setting the
>> PMU,
>> events will stop counting if the VCPU is scheduled on the wrong CPU.
>
> Can't we fix the default behavior (in addition to the current fix) ?
> (Do we need to maintain the default behavior ??)
Of course we do. This is a behaviour that has been exposed to userspace
for years, and *we don't break userspace*.
> IMHO I feel it is better to prevent userspace from configuring PMU
> for guests on such heterogeneous systems rather than leading to
> events suddenly stopping even as the default behavior.
People running KVM on asymmetric systems *strongly* disagree with you.
M.
--
Jazz is not dead. It just smells funny...
_______________________________________________
linux-arm-kernel mailing list
linux-arm-kernel@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
next prev parent reply other threads:[~2021-12-08 8:05 UTC|newest]
Thread overview: 52+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-12-06 17:02 [PATCH v2 0/4] KVM: arm64: Improve PMU support on heterogeneous systems Alexandru Elisei
2021-12-06 17:02 ` Alexandru Elisei
2021-12-06 17:02 ` [PATCH v2 1/4] perf: Fix wrong name in comment for struct perf_cpu_context Alexandru Elisei
2021-12-06 17:02 ` Alexandru Elisei
2021-12-06 17:02 ` [PATCH v2 2/4] KVM: arm64: Keep a list of probed PMUs Alexandru Elisei
2021-12-06 17:02 ` Alexandru Elisei
2021-12-06 17:02 ` [PATCH v2 3/4] KVM: arm64: Add KVM_ARM_VCPU_PMU_V3_SET_PMU attribute Alexandru Elisei
2021-12-06 17:02 ` Alexandru Elisei
2021-12-08 3:13 ` Reiji Watanabe
2021-12-08 3:13 ` Reiji Watanabe
2021-12-08 12:23 ` Alexandru Elisei
2021-12-08 12:23 ` Alexandru Elisei
2021-12-08 12:43 ` Alexandru Elisei
2021-12-08 12:43 ` Alexandru Elisei
2021-12-08 14:25 ` Marc Zyngier
2021-12-08 14:25 ` Marc Zyngier
2021-12-08 15:20 ` Alexandru Elisei
2021-12-08 15:20 ` Alexandru Elisei
2021-12-08 15:44 ` Marc Zyngier
2021-12-08 15:44 ` Marc Zyngier
2021-12-08 16:11 ` Alexandru Elisei
2021-12-08 16:11 ` Alexandru Elisei
2021-12-08 16:21 ` Marc Zyngier
2021-12-08 16:21 ` Marc Zyngier
2021-12-06 17:02 ` [PATCH v2 4/4] KVM: arm64: Refuse to run VCPU if the PMU doesn't match the physical CPU Alexandru Elisei
2021-12-06 17:02 ` Alexandru Elisei
2021-12-07 14:17 ` Alexandru Elisei
2021-12-07 14:17 ` Alexandru Elisei
2021-12-08 7:54 ` Reiji Watanabe
2021-12-08 7:54 ` Reiji Watanabe
2021-12-08 10:38 ` Alexandru Elisei
2021-12-08 10:38 ` Alexandru Elisei
2021-12-13 7:40 ` Reiji Watanabe
2021-12-13 7:40 ` Reiji Watanabe
2021-12-08 9:56 ` Marc Zyngier
2021-12-08 9:56 ` Marc Zyngier
2021-12-08 11:18 ` Alexandru Elisei
2021-12-08 11:18 ` Alexandru Elisei
2021-12-08 2:36 ` [PATCH v2 0/4] KVM: arm64: Improve PMU support on heterogeneous systems Reiji Watanabe
2021-12-08 2:36 ` Reiji Watanabe
2021-12-08 8:05 ` Marc Zyngier [this message]
2021-12-08 8:05 ` Marc Zyngier
2021-12-13 6:36 ` Reiji Watanabe
2021-12-13 6:36 ` Reiji Watanabe
2021-12-13 11:14 ` Alexandru Elisei
2021-12-13 11:14 ` Alexandru Elisei
2021-12-14 6:24 ` Reiji Watanabe
2021-12-14 6:24 ` Reiji Watanabe
2021-12-14 11:56 ` Marc Zyngier
2021-12-14 11:56 ` Marc Zyngier
2021-12-15 6:47 ` Reiji Watanabe
2021-12-15 6:47 ` Reiji Watanabe
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=addac215bddf0b86bf6850093d500785@kernel.org \
--to=maz@kernel.org \
--cc=kvmarm@lists.cs.columbia.edu \
--cc=linux-arm-kernel@lists.infradead.org \
--cc=mingo@redhat.com \
--cc=reijiw@google.com \
--cc=tglx@linutronix.de \
--cc=will@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.