From: "Alex Bennée" <alex.bennee@linaro.org>
To: Richard Henderson <richard.henderson@linaro.org>
Cc: qemu-devel@nongnu.org
Subject: Re: [PATCH v2 17/22] tcg/ppc: Reorg goto_tb implementation
Date: Tue, 17 Jan 2023 18:30:13 +0000 [thread overview]
Message-ID: <87pmbd109o.fsf@linaro.org> (raw)
In-Reply-To: <20230109014248.2894281-18-richard.henderson@linaro.org>
Richard Henderson <richard.henderson@linaro.org> writes:
> The old ppc64 implementation replaces 2 or 4 insns, which leaves a race
> condition in which a thread could be stopped at a PC in the middle of
> the sequence, and when restarted does not see the complete address
> computation and branches to nowhere.
>
> The new implemetation replaces only one insn, swapping between
>
> b <dest>
> and
> mtctr r31
>
> falling through to a general-case indirect branch.
>
> Signed-off-by: Richard Henderson <richard.henderson@linaro.org>
> ---
<snip>
>
> static void tcg_out_goto_tb(TCGContext *s, int which)
> {
> - /* Direct jump. */
> - if (TCG_TARGET_REG_BITS == 64) {
> - /* Ensure the next insns are 8 or 16-byte aligned. */
> - while ((uintptr_t)s->code_ptr & (have_isa_2_07 ? 15 : 7)) {
> - tcg_out32(s, NOP);
> - }
> + uintptr_t ptr = get_jmp_target_addr(s, which);
> +
> + if (USE_REG_TB) {
> + ptrdiff_t offset = tcg_tbrel_diff(s, (void *)ptr);
> + tcg_out_mem_long(s, LD, LDX, TCG_REG_TB, TCG_REG_TB, offset);
> +
> + /* Direct branch will be patched by tb_target_set_jmp_target. */
> set_jmp_insn_offset(s, which);
> - tcg_out32(s, ADDIS | TAI(TCG_REG_TB, TCG_REG_TB, 0));
> - tcg_out32(s, ADDI | TAI(TCG_REG_TB, TCG_REG_TB, 0));
> tcg_out32(s, MTSPR | RS(TCG_REG_TB) | CTR);
> +
> + /* When branch is out of range, fall through to indirect. */
> + tcg_out32(s, BCCTR | BO_ALWAYS);
> +
> + /* For the unlinked case, need to reset TCG_REG_TB. */
> + set_jmp_reset_offset(s, which);
> + tcg_out_mem_long(s, ADDI, ADD, TCG_REG_TB, TCG_REG_TB,
> + -tcg_current_code_size(s));
> + } else {
> + /* Direct branch will be patched by tb_target_set_jmp_target. */
> + set_jmp_insn_offset(s, which);
> + tcg_out32(s, NOP);
> +
> + /* When branch is out of range, fall through to indirect. */
> + tcg_out_movi(s, TCG_TYPE_PTR, TCG_REG_TMP1, ptr - (int16_t)ptr);
> + tcg_out_ld(s, TCG_TYPE_PTR, TCG_REG_TMP1, TCG_REG_TMP1, (int16_t)ptr);
> + tcg_out32(s, MTSPR | RS(TCG_REG_TMP1) | CTR);
> tcg_out32(s, BCCTR | BO_ALWAYS);
> set_jmp_reset_offset(s, which);
> - if (USE_REG_TB) {
> - /* For the unlinked case, need to reset TCG_REG_TB. */
> - tcg_out_mem_long(s, ADDI, ADD, TCG_REG_TB, TCG_REG_TB,
> - -tcg_current_code_size(s));
> - }
> - } else {
> - set_jmp_insn_offset(s, which);
> - tcg_out32(s, B);
> - set_jmp_reset_offset(s, which);
> }
> }
>
> +void tb_target_set_jmp_target(const TranslationBlock *tb, int n,
> + uintptr_t jmp_rx, uintptr_t jmp_rw)
> +{
> + uintptr_t addr = tb->jmp_target_addr[n];
> + intptr_t diff = addr - jmp_rx;
> + tcg_insn_unit insn;
> +
> + if (in_range_b(diff)) {
> + insn = B | (diff & 0x3fffffc);
Again deposit would be nice here.
> + } else if (USE_REG_TB) {
> + insn = MTSPR | RS(TCG_REG_TB) | CTR;
> + } else {
> + insn = NOP;
> + }
> +
> + qatomic_set((uint32_t *)jmp_rw, insn);
> + flush_idcache_range(jmp_rx, jmp_rw, 4);
> +}
> +
> static void tcg_out_op(TCGContext *s, TCGOpcode opc,
> const TCGArg args[TCG_MAX_OP_ARGS],
> const int const_args[TCG_MAX_OP_ARGS])
Otherwise:
Reviewed-by: Alex Bennée <alex.bennee@linaro.org>
--
Alex Bennée
Virtualisation Tech Lead @ Linaro
next prev parent reply other threads:[~2023-01-17 18:31 UTC|newest]
Thread overview: 47+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-01-09 1:42 [PATCH v2 00/22] tcg: exit_tb tidy, goto_tb reorg Richard Henderson
2023-01-09 1:42 ` [PATCH v2 01/22] tcg: Split out tcg_out_exit_tb Richard Henderson
2023-01-17 17:31 ` Alex Bennée
2023-01-09 1:42 ` [PATCH v2 02/22] tcg/i386: Remove unused goto_tb code for indirect jump Richard Henderson
2023-01-17 17:46 ` Alex Bennée
2023-01-09 1:42 ` [PATCH v2 03/22] tcg/ppc: " Richard Henderson
2023-01-17 17:46 ` Alex Bennée
2023-01-09 1:42 ` [PATCH v2 04/22] tcg/sparc64: " Richard Henderson
2023-01-17 17:47 ` Alex Bennée
2023-01-09 1:42 ` [PATCH v2 05/22] tcg: Replace asserts on tcg_jmp_insn_offset Richard Henderson
2023-01-17 17:48 ` Alex Bennée
2023-01-09 1:42 ` [PATCH v2 06/22] tcg: Introduce set_jmp_insn_offset Richard Henderson
2023-01-17 17:49 ` Alex Bennée
2023-01-09 1:42 ` [PATCH v2 07/22] tcg: Introduce get_jmp_target_addr Richard Henderson
2023-01-17 17:51 ` Alex Bennée
2023-01-09 1:42 ` [PATCH v2 08/22] tcg: Split out tcg_out_goto_tb Richard Henderson
2023-01-17 17:56 ` Alex Bennée
2023-01-09 1:42 ` [PATCH v2 09/22] tcg: Rename TB_JMP_RESET_OFFSET_INVALID to TB_JMP_OFFSET_INVALID Richard Henderson
2023-01-17 17:57 ` Alex Bennée
2023-01-09 1:42 ` [PATCH v2 10/22] tcg: Add gen_tb to TCGContext Richard Henderson
2023-01-17 17:58 ` Alex Bennée
2023-01-09 1:42 ` [PATCH v2 11/22] tcg: Add TranslationBlock.jmp_insn_offset Richard Henderson
2023-01-17 18:01 ` Alex Bennée
2023-01-09 1:42 ` [PATCH v2 12/22] tcg: Change tb_target_set_jmp_target arguments Richard Henderson
2023-01-17 18:05 ` Alex Bennée
2023-01-09 1:42 ` [PATCH v2 13/22] tcg: Move tb_target_set_jmp_target declaration to tcg.h Richard Henderson
2023-01-17 18:10 ` Alex Bennée
2023-01-09 1:42 ` [PATCH v2 14/22] tcg: Always define tb_target_set_jmp_target Richard Henderson
2023-01-17 18:14 ` Alex Bennée
2023-01-17 19:51 ` Richard Henderson
2023-01-09 1:42 ` [PATCH v2 15/22] tcg: Remove TCG_TARGET_HAS_direct_jump Richard Henderson
2023-01-17 18:25 ` Alex Bennée
2023-01-09 1:42 ` [PATCH v2 16/22] tcg/aarch64: Reorg goto_tb implementation Richard Henderson
2023-01-17 18:26 ` Alex Bennée
2023-01-09 1:42 ` [PATCH v2 17/22] tcg/ppc: " Richard Henderson
2023-01-17 18:30 ` Alex Bennée [this message]
2023-01-09 1:42 ` [PATCH v2 18/22] tcg/sparc64: Remove USE_REG_TB Richard Henderson
2023-01-17 18:31 ` Alex Bennée
2023-01-09 1:42 ` [PATCH v2 19/22] tcg/sparc64: Reorg goto_tb implementation Richard Henderson
2023-01-17 18:33 ` Alex Bennée
2023-01-09 1:42 ` [PATCH v2 20/22] tcg/arm: Implement direct branch for goto_tb Richard Henderson
2023-01-17 18:33 ` Alex Bennée
2023-01-09 1:42 ` [PATCH v2 21/22] tcg/riscv: Introduce OPC_NOP Richard Henderson
2023-01-17 18:35 ` Alex Bennée
2023-01-09 1:42 ` [PATCH v2 22/22] tcg/riscv: Implement direct branch for goto_tb Richard Henderson
2023-01-17 18:37 ` Alex Bennée
2023-01-15 2:33 ` [PATCH v2 00/22] tcg: exit_tb tidy, goto_tb reorg Richard Henderson
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=87pmbd109o.fsf@linaro.org \
--to=alex.bennee@linaro.org \
--cc=qemu-devel@nongnu.org \
--cc=richard.henderson@linaro.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).