From: Richard Henderson <richard.henderson@linaro.org>
To: qemu-devel@nongnu.org
Cc: peter.maydell@linaro.org, qemu-ppc@nongnu.org,
"Daniel Henrique Barboza" <danielhb413@gmail.com>,
"Cédric Le Goater" <clg@kaod.org>,
"David Gibson" <david@gibson.dropbear.id.au>,
"Greg Kurz" <groug@kaod.org>,
qemu-s390x@nongnu.org, "David Hildenbrand" <david@redhat.com>,
"Ilya Leoshkevich" <iii@linux.ibm.com>
Subject: [PATCH v2 00/27] accel/tcg: Improvements to atomic128.h
Date: Tue, 23 May 2023 06:47:06 -0700 [thread overview]
Message-ID: <20230523134733.678646-1-richard.henderson@linaro.org> (raw)
Peter raised a good point about it not being ideal to mix inline assembly
into the middle of accel/tcg/ldst_atomicity.c. We now have a host-specific
structure in which to put those.
Additionally, Peter noticed that clang will incorrectly use a read-write
sequence for __atomic_load_16 on AArch64, which might fault for our usage
in user-only emulation.
Fixing both of these simultaneously splits atomic16_read into
atomic16_read_{ro,rw}, because there is in fact room for both
in the emulation -- we currently use cmpxchg directly where we
can allow a read with write side-effect.
Additionally, prepare for runtime detection. Both x86_64 and aarch64
have architecture extensions that *do* allow 128-bit load and store
without using cmpxchg.
To make runtime detection work, we need to remove preprocessor use
of HAVE_ATOMIC128*. It turns out this was only used for the legacy
helper_atomic_{ld,st}o_{be,le}_mmu functions. These uses within
ppc64 and s390x can now be updated to tcg_gen_qemu_{ld,st}_i128 and
cpu_{ld,st}16_mmu. After doing that, we can remove the problematic
#if's entirely.
Changes for v2:
* Updates from review.
Patches requiring review:
05-util-bufferiszero-Use-i386-host-cpuinfo.h.patch
10-include-host-Split-out-atomic128-cas.h.patch
11-include-host-Split-out-atomic128-ldst.h.patch
13-include-qemu-Move-CONFIG_ATOMIC128_OPT-handling-t.patch
14-target-ppc-Use-tcg_gen_qemu_-ld-st-_i128-for-LQAR.patch
15-target-s390x-Use-tcg_gen_qemu_-ld-st-_i128-for-LP.patch
17-target-s390x-Use-cpu_-ld-st-_mmu-in-do_csst.patch
19-accel-tcg-Remove-cpu_atomic_-ld-st-o_-_mmu.patch
20-accel-tcg-Remove-prot-argument-to-atomic_mmu_look.patch
21-accel-tcg-Eliminate-if-on-HAVE_ATOMIC128-and-HAVE.patch
22-qemu-atomic128-Split-atomic16_read.patch
23-accel-tcg-Correctly-use-atomic128.h-in-ldst_atomi.patch
25-qemu-atomic128-Improve-cmpxchg-fallback-for-atomi.patch
26-qemu-atomic128-Add-runtime-test-for-FEAT_LSE2.patch
27-qemu-atomic128-Add-x86_64-atomic128-ldst.h.patch
r~
Cc: qemu-ppc@nongnu.org
Cc: Daniel Henrique Barboza <danielhb413@gmail.com>
Cc: "Cédric Le Goater" <clg@kaod.org>
Cc: David Gibson <david@gibson.dropbear.id.au>
Cc: Greg Kurz <groug@kaod.org>
Cc: qemu-s390x@nongnu.org
Cc: David Hildenbrand <david@redhat.com>
Cc: Ilya Leoshkevich <iii@linux.ibm.com>
Richard Henderson (27):
util: Introduce host-specific cpuinfo.h
util: Add cpuinfo-i386.c
util: Add i386 CPUINFO_ATOMIC_VMOVDQU
tcg/i386: Use host/cpuinfo.h
util/bufferiszero: Use i386 host/cpuinfo.h
migration/xbzrle: Shuffle function order
migration/xbzrle: Use i386 host/cpuinfo.h
migration: Build migration_files once
util: Add cpuinfo-aarch64.c
include/host: Split out atomic128-cas.h
include/host: Split out atomic128-ldst.h
meson: Fix detect atomic128 support with optimization
include/qemu: Move CONFIG_ATOMIC128_OPT handling to atomic128.h
target/ppc: Use tcg_gen_qemu_{ld,st}_i128 for LQARX, LQ, STQ
target/s390x: Use tcg_gen_qemu_{ld,st}_i128 for LPQ, STPQ
accel/tcg: Unify cpu_{ld,st}*_{be,le}_mmu
target/s390x: Use cpu_{ld,st}*_mmu in do_csst
target/s390x: Always use cpu_atomic_cmpxchgl_be_mmu in do_csst
accel/tcg: Remove cpu_atomic_{ld,st}o_*_mmu
accel/tcg: Remove prot argument to atomic_mmu_lookup
accel/tcg: Eliminate #if on HAVE_ATOMIC128 and HAVE_CMPXCHG128
qemu/atomic128: Split atomic16_read
accel/tcg: Correctly use atomic128.h in ldst_atomicity.c.inc
tcg: Split out tcg/debug-assert.h
qemu/atomic128: Improve cmpxchg fallback for atomic16_set
qemu/atomic128: Add runtime test for FEAT_LSE2
qemu/atomic128: Add x86_64 atomic128-ldst.h
accel/tcg/atomic_template.h | 93 +---
host/include/aarch64/host/atomic128-cas.h | 45 ++
host/include/aarch64/host/atomic128-ldst.h | 79 ++++
host/include/aarch64/host/cpuinfo.h | 22 +
host/include/generic/host/atomic128-cas.h | 47 +++
host/include/generic/host/atomic128-ldst.h | 81 ++++
host/include/generic/host/cpuinfo.h | 4 +
host/include/i386/host/cpuinfo.h | 39 ++
host/include/x86_64/host/atomic128-ldst.h | 54 +++
host/include/x86_64/host/cpuinfo.h | 1 +
include/exec/cpu_ldst.h | 67 +--
include/qemu/atomic128.h | 146 +------
include/tcg/debug-assert.h | 17 +
include/tcg/tcg.h | 9 +-
migration/xbzrle.h | 5 +-
target/ppc/cpu.h | 1 -
target/ppc/helper.h | 9 -
target/s390x/cpu.h | 3 -
target/s390x/helper.h | 4 -
tcg/aarch64/tcg-target.h | 6 +-
tcg/i386/tcg-target.h | 28 +-
accel/tcg/cputlb.c | 211 +++------
accel/tcg/user-exec.c | 332 ++++-----------
migration/ram.c | 34 +-
migration/xbzrle.c | 268 ++++++------
target/arm/tcg/m_helper.c | 4 +-
target/ppc/mem_helper.c | 48 ---
target/ppc/translate.c | 34 +-
target/s390x/tcg/mem_helper.c | 137 ++----
target/s390x/tcg/translate.c | 30 +-
target/sparc/ldst_helper.c | 18 +-
tests/bench/xbzrle-bench.c | 469 ---------------------
tests/unit/test-xbzrle.c | 49 +--
util/bufferiszero.c | 126 ++----
util/cpuinfo-aarch64.c | 67 +++
util/cpuinfo-i386.c | 99 +++++
MAINTAINERS | 1 +
accel/tcg/atomic_common.c.inc | 14 -
accel/tcg/ldst_atomicity.c.inc | 135 +-----
accel/tcg/ldst_common.c.inc | 24 +-
meson.build | 12 +-
migration/meson.build | 1 -
target/ppc/translate/fixedpoint-impl.c.inc | 51 +--
target/s390x/tcg/insn-data.h.inc | 2 +-
tcg/aarch64/tcg-target.c.inc | 40 --
tcg/i386/tcg-target.c.inc | 123 +-----
tests/bench/meson.build | 6 -
util/meson.build | 6 +
48 files changed, 1085 insertions(+), 2016 deletions(-)
create mode 100644 host/include/aarch64/host/atomic128-cas.h
create mode 100644 host/include/aarch64/host/atomic128-ldst.h
create mode 100644 host/include/aarch64/host/cpuinfo.h
create mode 100644 host/include/generic/host/atomic128-cas.h
create mode 100644 host/include/generic/host/atomic128-ldst.h
create mode 100644 host/include/generic/host/cpuinfo.h
create mode 100644 host/include/i386/host/cpuinfo.h
create mode 100644 host/include/x86_64/host/atomic128-ldst.h
create mode 100644 host/include/x86_64/host/cpuinfo.h
create mode 100644 include/tcg/debug-assert.h
delete mode 100644 tests/bench/xbzrle-bench.c
create mode 100644 util/cpuinfo-aarch64.c
create mode 100644 util/cpuinfo-i386.c
--
2.34.1
next reply other threads:[~2023-05-23 13:49 UTC|newest]
Thread overview: 57+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-05-23 13:47 Richard Henderson [this message]
2023-05-23 13:47 ` [PATCH v2 01/27] util: Introduce host-specific cpuinfo.h Richard Henderson
2023-05-23 16:10 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 02/27] util: Add cpuinfo-i386.c Richard Henderson
2023-05-23 16:10 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 03/27] util: Add i386 CPUINFO_ATOMIC_VMOVDQU Richard Henderson
2023-05-23 16:13 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 04/27] tcg/i386: Use host/cpuinfo.h Richard Henderson
2023-05-23 16:14 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 05/27] util/bufferiszero: Use i386 host/cpuinfo.h Richard Henderson
2023-05-23 16:18 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 06/27] migration/xbzrle: Shuffle function order Richard Henderson
2023-05-23 16:19 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 07/27] migration/xbzrle: Use i386 host/cpuinfo.h Richard Henderson
2023-05-23 16:21 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 08/27] migration: Build migration_files once Richard Henderson
2023-05-23 16:26 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 09/27] util: Add cpuinfo-aarch64.c Richard Henderson
2023-05-23 16:28 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 10/27] include/host: Split out atomic128-cas.h Richard Henderson
2023-05-23 16:31 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 11/27] include/host: Split out atomic128-ldst.h Richard Henderson
2023-05-23 16:32 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 12/27] meson: Fix detect atomic128 support with optimization Richard Henderson
2023-05-23 16:32 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 13/27] include/qemu: Move CONFIG_ATOMIC128_OPT handling to atomic128.h Richard Henderson
2023-05-23 16:35 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 14/27] target/ppc: Use tcg_gen_qemu_{ld, st}_i128 for LQARX, LQ, STQ Richard Henderson
2023-05-23 16:37 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 15/27] target/s390x: Use tcg_gen_qemu_{ld, st}_i128 for LPQ, STPQ Richard Henderson
2023-05-23 13:50 ` David Hildenbrand
2023-05-23 16:59 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 16/27] accel/tcg: Unify cpu_{ld,st}*_{be,le}_mmu Richard Henderson
2023-05-23 16:40 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 17/27] target/s390x: Use cpu_{ld,st}*_mmu in do_csst Richard Henderson
2023-05-23 13:51 ` David Hildenbrand
2023-05-23 16:44 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 18/27] target/s390x: Always use cpu_atomic_cmpxchgl_be_mmu " Richard Henderson
2023-05-23 16:40 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 19/27] accel/tcg: Remove cpu_atomic_{ld,st}o_*_mmu Richard Henderson
2023-05-23 16:44 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 20/27] accel/tcg: Remove prot argument to atomic_mmu_lookup Richard Henderson
2023-05-23 16:46 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 21/27] accel/tcg: Eliminate #if on HAVE_ATOMIC128 and HAVE_CMPXCHG128 Richard Henderson
2023-05-23 16:47 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 22/27] qemu/atomic128: Split atomic16_read Richard Henderson
2023-05-23 16:49 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 23/27] accel/tcg: Correctly use atomic128.h in ldst_atomicity.c.inc Richard Henderson
2023-05-23 16:50 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 24/27] tcg: Split out tcg/debug-assert.h Richard Henderson
2023-05-23 16:52 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 25/27] qemu/atomic128: Improve cmpxchg fallback for atomic16_set Richard Henderson
2023-05-23 16:54 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 26/27] qemu/atomic128: Add runtime test for FEAT_LSE2 Richard Henderson
2023-05-23 16:57 ` Alex Bennée
2023-05-23 13:47 ` [PATCH v2 27/27] qemu/atomic128: Add x86_64 atomic128-ldst.h Richard Henderson
2023-05-23 16:59 ` Alex Bennée
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20230523134733.678646-1-richard.henderson@linaro.org \
--to=richard.henderson@linaro.org \
--cc=clg@kaod.org \
--cc=danielhb413@gmail.com \
--cc=david@gibson.dropbear.id.au \
--cc=david@redhat.com \
--cc=groug@kaod.org \
--cc=iii@linux.ibm.com \
--cc=peter.maydell@linaro.org \
--cc=qemu-devel@nongnu.org \
--cc=qemu-ppc@nongnu.org \
--cc=qemu-s390x@nongnu.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).