[PATCH 0/3] Allow to enable PREEMPT_RT.

[PATCH 0/3] Allow to enable PREEMPT_RT.

[Sebastian Andrzej Siewior]

The printk bits required for PREEMPT_RT are sitting in linux-next. This
was the last known roadblock for PREEMPT_RT. The RT queue has
additionally the "atomic console" for the 8250 UART which is not yet in
linux-next. This means "legacy console" behaviour as in no printing from
atomic context in emergency cases. The 8250 UART driver is the only one
providing "atomic console" support as of today.

With the printk bits merged, PREEMPT_RT could be enabled on X86, ARM64
and Risc-V. These three architectures merged required changes over the
years leaving me in a position where I have no essential changes in the
queue that would affect them.
ARM and POWERPC have a few essential patches left and I lost track of
MIPS.

Sebastian

[PATCH 1/3] x86: Allow to enable PREEMPT_RT.

[Sebastian Andrzej Siewior]

It is really time.

x86 has all the required architecture related changes, that have been
identified over time, in order to enable PREEMPT_RT. With the recent
printk changes, the last known road block has been addressed.

Allow to enable PREEMPT_RT on x86.

Signed-off-by: Sebastian Andrzej Siewior <bigeasy@linutronix.de>
---
 arch/x86/Kconfig | 1 +
 1 file changed, 1 insertion(+)

diff --git a/arch/x86/Kconfig b/arch/x86/Kconfig
index 28401c16b0c3f..a8cf61c52b063 100644
--- a/arch/x86/Kconfig
+++ b/arch/x86/Kconfig
@@ -125,6 +125,7 @@ config X86
 	select ARCH_USES_CFI_TRAPS		if X86_64 && CFI_CLANG
 	select ARCH_SUPPORTS_LTO_CLANG
 	select ARCH_SUPPORTS_LTO_CLANG_THIN
+	select ARCH_SUPPORTS_RT
 	select ARCH_USE_BUILTIN_BSWAP
 	select ARCH_USE_CMPXCHG_LOCKREF		if X86_CMPXCHG64
 	select ARCH_USE_MEMTEST
-- 
2.45.2

[PATCH 2/3] arm64: Allow to enable PREEMPT_RT.

[Sebastian Andrzej Siewior]

It is really time.

arm64 has all the required architecture related changes, that have been
identified over time, in order to enable PREEMPT_RT. With the recent
printk changes, the last known road block has been addressed.

Allow to enable PREEMPT_RT on arm64.

Signed-off-by: Sebastian Andrzej Siewior <bigeasy@linutronix.de>
---
 arch/arm64/Kconfig | 1 +
 1 file changed, 1 insertion(+)

diff --git a/arch/arm64/Kconfig b/arch/arm64/Kconfig
index 0e5bd38633936..2cce9cb44c31e 100644
--- a/arch/arm64/Kconfig
+++ b/arch/arm64/Kconfig
@@ -101,6 +101,7 @@ config ARM64
 	select ARCH_SUPPORTS_NUMA_BALANCING
 	select ARCH_SUPPORTS_PAGE_TABLE_CHECK
 	select ARCH_SUPPORTS_PER_VMA_LOCK
+	select ARCH_SUPPORTS_RT
 	select ARCH_SUPPORTS_HUGE_PFNMAP if TRANSPARENT_HUGEPAGE
 	select ARCH_WANT_BATCHED_UNMAP_TLB_FLUSH
 	select ARCH_WANT_COMPAT_IPC_PARSE_VERSION if COMPAT
-- 
2.45.2

[PATCH 3/3] riscv: Allow to enable PREEMPT_RT.

[Sebastian Andrzej Siewior]

It is really time.

riscv has all the required architecture related changes, that have been
identified over time, in order to enable PREEMPT_RT. With the recent
printk changes, the last known road block has been addressed.

Allow to enable PREEMPT_RT on riscv.

Signed-off-by: Sebastian Andrzej Siewior <bigeasy@linutronix.de>
---
 arch/riscv/Kconfig | 1 +
 1 file changed, 1 insertion(+)

diff --git a/arch/riscv/Kconfig b/arch/riscv/Kconfig
index 801ee681059ca..a9be4dca380dc 100644
--- a/arch/riscv/Kconfig
+++ b/arch/riscv/Kconfig
@@ -65,6 +65,7 @@ config RISCV
 	select ARCH_SUPPORTS_LTO_CLANG_THIN if LLD_VERSION >= 140000
 	select ARCH_SUPPORTS_PAGE_TABLE_CHECK if MMU
 	select ARCH_SUPPORTS_PER_VMA_LOCK if MMU
+	select ARCH_SUPPORTS_RT
 	select ARCH_SUPPORTS_SHADOW_CALL_STACK if HAVE_SHADOW_CALL_STACK
 	select ARCH_USE_CMPXCHG_LOCKREF if 64BIT
 	select ARCH_USE_MEMTEST
-- 
2.45.2

Re: [PATCH 2/3] arm64: Allow to enable PREEMPT_RT.

[Will Deacon]

On Fri, Sep 06, 2024 at 12:59:05PM +0200, Sebastian Andrzej Siewior wrote:
> It is really time.
> 
> arm64 has all the required architecture related changes, that have been
> identified over time, in order to enable PREEMPT_RT. With the recent
> printk changes, the last known road block has been addressed.
> 
> Allow to enable PREEMPT_RT on arm64.
> 
> Signed-off-by: Sebastian Andrzej Siewior <bigeasy@linutronix.de>
> ---
>  arch/arm64/Kconfig | 1 +
>  1 file changed, 1 insertion(+)
> 
> diff --git a/arch/arm64/Kconfig b/arch/arm64/Kconfig
> index 0e5bd38633936..2cce9cb44c31e 100644
> --- a/arch/arm64/Kconfig
> +++ b/arch/arm64/Kconfig
> @@ -101,6 +101,7 @@ config ARM64
>  	select ARCH_SUPPORTS_NUMA_BALANCING
>  	select ARCH_SUPPORTS_PAGE_TABLE_CHECK
>  	select ARCH_SUPPORTS_PER_VMA_LOCK
> +	select ARCH_SUPPORTS_RT
>  	select ARCH_SUPPORTS_HUGE_PFNMAP if TRANSPARENT_HUGEPAGE
>  	select ARCH_WANT_BATCHED_UNMAP_TLB_FLUSH
>  	select ARCH_WANT_COMPAT_IPC_PARSE_VERSION if COMPAT
> -- 
> 2.45.2

Acked-by: Will Deacon <will@kernel.org>

"Let it rip!"

Will

Re: [PATCH 2/3] arm64: Allow to enable PREEMPT_RT.

[Steven Rostedt]

On Fri, 6 Sep 2024 12:30:51 +0100
Will Deacon <will@kernel.org> wrote:

> Acked-by: Will Deacon <will@kernel.org>
> 
> "Let it rip!"

Woot! Woot!

-- Steve

Re: [PATCH 3/3] riscv: Allow to enable PREEMPT_RT.

[Nam Cao]

On Fri, Sep 06, 2024 at 12:59:06PM +0200, Sebastian Andrzej Siewior wrote:
> It is really time.
> 
> riscv has all the required architecture related changes, that have been
> identified over time, in order to enable PREEMPT_RT. With the recent
> printk changes, the last known road block has been addressed.
> 
> Allow to enable PREEMPT_RT on riscv.
> 
> Signed-off-by: Sebastian Andrzej Siewior <bigeasy@linutronix.de>

With the printk patches applied:

Tested-by: Nam Cao <namcao@linutronix.de> # Visionfive 2

Best regards,
Nam

Re: [PATCH 3/3] riscv: Allow to enable PREEMPT_RT.

[Palmer Dabbelt]

On Fri, 06 Sep 2024 08:13:24 PDT (-0700), namcao@linutronix.de wrote:
> On Fri, Sep 06, 2024 at 12:59:06PM +0200, Sebastian Andrzej Siewior wrote:
>> It is really time.
>>
>> riscv has all the required architecture related changes, that have been
>> identified over time, in order to enable PREEMPT_RT. With the recent
>> printk changes, the last known road block has been addressed.
>>
>> Allow to enable PREEMPT_RT on riscv.
>>
>> Signed-off-by: Sebastian Andrzej Siewior <bigeasy@linutronix.de>
>
> With the printk patches applied:
>
> Tested-by: Nam Cao <namcao@linutronix.de> # Visionfive 2


Thanks.  LMK if you guys want me to take this through the RISC-V tree, 
but no big deal if you want it somewhere else -- and if there's some 
dependencies already going in through some sort of RT tree maybe that's 
just easier.  So

Acked-by: Palmer Dabbelt <palmer@rivosinc.com>

I don't have a test setup yet, but I figure it's a new feature so I'll 
just flip it on as a config post-rc1.  Presumably this just works in the 
QEMU virt board, or is there some wizardry I'll need to copy?

> Best regards,
> Nam

[tip: sched/rt] riscv: Allow to enable PREEMPT_RT.

[tip-bot2 for Sebastian Andrzej Siewior]

The following commit has been merged into the sched/rt branch of tip:

Commit-ID:     41639286fd0b2538de8cfe3e99db18ed0df520cd
Gitweb:        https://git.kernel.org/tip/41639286fd0b2538de8cfe3e99db18ed0df520cd
Author:        Sebastian Andrzej Siewior <bigeasy@linutronix.de>
AuthorDate:    Fri, 06 Sep 2024 12:59:06 +02:00
Committer:     Thomas Gleixner <tglx@linutronix.de>
CommitterDate: Mon, 09 Sep 2024 19:24:11 +02:00

riscv: Allow to enable PREEMPT_RT.

It is really time.

riscv has all the required architecture related changes, that have been
identified over time, in order to enable PREEMPT_RT. With the recent
printk changes, the last known road block has been addressed.

Allow to enable PREEMPT_RT on riscv.

Signed-off-by: Sebastian Andrzej Siewior <bigeasy@linutronix.de>
Signed-off-by: Thomas Gleixner <tglx@linutronix.de>
Tested-by: Nam Cao <namcao@linutronix.de> # Visionfive 2
Link: https://lore.kernel.org/all/20240906111841.562402-4-bigeasy@linutronix.de

---
 arch/riscv/Kconfig | 1 +
 1 file changed, 1 insertion(+)

diff --git a/arch/riscv/Kconfig b/arch/riscv/Kconfig
index 0f3cd7c..b03f6d2 100644
--- a/arch/riscv/Kconfig
+++ b/arch/riscv/Kconfig
@@ -64,6 +64,7 @@ config RISCV
 	select ARCH_SUPPORTS_LTO_CLANG_THIN if LLD_VERSION >= 140000
 	select ARCH_SUPPORTS_PAGE_TABLE_CHECK if MMU
 	select ARCH_SUPPORTS_PER_VMA_LOCK if MMU
+	select ARCH_SUPPORTS_RT
 	select ARCH_SUPPORTS_SHADOW_CALL_STACK if HAVE_SHADOW_CALL_STACK
 	select ARCH_USE_CMPXCHG_LOCKREF if 64BIT
 	select ARCH_USE_MEMTEST

[tip: sched/rt] arm64: Allow to enable PREEMPT_RT.

[tip-bot2 for Sebastian Andrzej Siewior]

The following commit has been merged into the sched/rt branch of tip:

Commit-ID:     699fd9104967cc3b0826bb0b64a9f1a496121786
Gitweb:        https://git.kernel.org/tip/699fd9104967cc3b0826bb0b64a9f1a496121786
Author:        Sebastian Andrzej Siewior <bigeasy@linutronix.de>
AuthorDate:    Fri, 06 Sep 2024 12:59:05 +02:00
Committer:     Thomas Gleixner <tglx@linutronix.de>
CommitterDate: Mon, 09 Sep 2024 19:24:11 +02:00

arm64: Allow to enable PREEMPT_RT.

It is really time.

arm64 has all the required architecture related changes, that have been
identified over time, in order to enable PREEMPT_RT. With the recent
printk changes, the last known road block has been addressed.

Allow to enable PREEMPT_RT on arm64.

Signed-off-by: Sebastian Andrzej Siewior <bigeasy@linutronix.de>
Signed-off-by: Thomas Gleixner <tglx@linutronix.de>
Acked-by: Will Deacon <will@kernel.org>
Link: https://lore.kernel.org/all/20240906111841.562402-3-bigeasy@linutronix.de

---
 arch/arm64/Kconfig | 1 +
 1 file changed, 1 insertion(+)

diff --git a/arch/arm64/Kconfig b/arch/arm64/Kconfig
index a2f8ff3..e68ea64 100644
--- a/arch/arm64/Kconfig
+++ b/arch/arm64/Kconfig
@@ -99,6 +99,7 @@ config ARM64
 	select ARCH_SUPPORTS_NUMA_BALANCING
 	select ARCH_SUPPORTS_PAGE_TABLE_CHECK
 	select ARCH_SUPPORTS_PER_VMA_LOCK
+	select ARCH_SUPPORTS_RT
 	select ARCH_WANT_BATCHED_UNMAP_TLB_FLUSH
 	select ARCH_WANT_COMPAT_IPC_PARSE_VERSION if COMPAT
 	select ARCH_WANT_DEFAULT_BPF_JIT

[tip: sched/rt] x86: Allow to enable PREEMPT_RT.

[tip-bot2 for Sebastian Andrzej Siewior]

The following commit has been merged into the sched/rt branch of tip:

Commit-ID:     70c5e36c0f431cab9059477c6b7d3ba02b289cd9
Gitweb:        https://git.kernel.org/tip/70c5e36c0f431cab9059477c6b7d3ba02b289cd9
Author:        Sebastian Andrzej Siewior <bigeasy@linutronix.de>
AuthorDate:    Fri, 06 Sep 2024 12:59:04 +02:00
Committer:     Thomas Gleixner <tglx@linutronix.de>
CommitterDate: Mon, 09 Sep 2024 19:24:11 +02:00

x86: Allow to enable PREEMPT_RT.

It is really time.

x86 has all the required architecture related changes, that have been
identified over time, in order to enable PREEMPT_RT. With the recent
printk changes, the last known road block has been addressed.

Allow to enable PREEMPT_RT on x86.

Signed-off-by: Sebastian Andrzej Siewior <bigeasy@linutronix.de>
Signed-off-by: Thomas Gleixner <tglx@linutronix.de>
Link: https://lore.kernel.org/all/20240906111841.562402-2-bigeasy@linutronix.de

---
 arch/x86/Kconfig | 1 +
 1 file changed, 1 insertion(+)

diff --git a/arch/x86/Kconfig b/arch/x86/Kconfig
index 007bab9..8768d38 100644
--- a/arch/x86/Kconfig
+++ b/arch/x86/Kconfig
@@ -122,6 +122,7 @@ config X86
 	select ARCH_USES_CFI_TRAPS		if X86_64 && CFI_CLANG
 	select ARCH_SUPPORTS_LTO_CLANG
 	select ARCH_SUPPORTS_LTO_CLANG_THIN
+	select ARCH_SUPPORTS_RT
 	select ARCH_USE_BUILTIN_BSWAP
 	select ARCH_USE_CMPXCHG_LOCKREF		if X86_CMPXCHG64
 	select ARCH_USE_MEMTEST

Re: [PATCH 0/3] Allow to enable PREEMPT_RT.

[Mingcong Bai]

Hi Sebastian,

在 2024/9/6 18:59, Sebastian Andrzej Siewior 写道:
> The printk bits required for PREEMPT_RT are sitting in linux-next. This
> was the last known roadblock for PREEMPT_RT. The RT queue has
> additionally the "atomic console" for the 8250 UART which is not yet in
> linux-next. This means "legacy console" behaviour as in no printing from
> atomic context in emergency cases. The 8250 UART driver is the only one
> providing "atomic console" support as of today.
>
> With the printk bits merged, PREEMPT_RT could be enabled on X86, ARM64
> and Risc-V. These three architectures merged required changes over the
> years leaving me in a position where I have no essential changes in the
> queue that would affect them.
> ARM and POWERPC have a few essential patches left and I lost track of
> MIPS.
Congratulations, it's been a long time coming!

I'm wondering, for the architectures not included in the enablement this 
time, do we have a readiness checklist/guide for maintainers to refer to?

Thanks in advance.
>
> Sebastian
>
>
Best Regards,
Mingcong Bai

Re: [PATCH 0/3] Allow to enable PREEMPT_RT.

[Sebastian Andrzej Siewior]

On 2024-09-10 10:39:45 [+0800], Mingcong Bai wrote:
> Hi Sebastian,
Hi Mingcong,

> Congratulations, it's been a long time coming!
thank you.

> I'm wondering, for the architectures not included in the enablement this
> time, do we have a readiness checklist/guide for maintainers to refer to?

I don't think there is. The plain PREEMPT should work. Then need to
follow the checklist for forced-threaded interrupts. Generic code such
as GENERIC_ENTRY makes things easier but at least
HAVE_POSIX_CPU_TIMERS_TASK_WORK is needed with kvm enabled if my memory
serves me right. Everything else is part of generic code.

> Thanks in advance.
> Best Regards,
> Mingcong Bai

Sebastian

[tip: sched/rt] riscv: Allow to enable PREEMPT_RT.

[tip-bot2 for Sebastian Andrzej Siewior]

The following commit has been merged into the sched/rt branch of tip:

Commit-ID:     2638e4e6b18233d7ec54edb953f253ae9515bac2
Gitweb:        https://git.kernel.org/tip/2638e4e6b18233d7ec54edb953f253ae9515bac2
Author:        Sebastian Andrzej Siewior <bigeasy@linutronix.de>
AuthorDate:    Fri, 06 Sep 2024 12:59:06 +02:00
Committer:     Thomas Gleixner <tglx@linutronix.de>
CommitterDate: Tue, 17 Sep 2024 11:06:08 +02:00

riscv: Allow to enable PREEMPT_RT.

It is really time.

riscv has all the required architecture related changes, that have been
identified over time, in order to enable PREEMPT_RT. With the recent
printk changes, the last known road block has been addressed.

Allow to enable PREEMPT_RT on riscv.

Signed-off-by: Sebastian Andrzej Siewior <bigeasy@linutronix.de>
Signed-off-by: Thomas Gleixner <tglx@linutronix.de>
Tested-by: Nam Cao <namcao@linutronix.de> # Visionfive 2
Link: https://lore.kernel.org/all/20240906111841.562402-4-bigeasy@linutronix.de

---
 arch/riscv/Kconfig | 1 +
 1 file changed, 1 insertion(+)

diff --git a/arch/riscv/Kconfig b/arch/riscv/Kconfig
index 86d1f1c..82724bc 100644
--- a/arch/riscv/Kconfig
+++ b/arch/riscv/Kconfig
@@ -65,6 +65,7 @@ config RISCV
 	select ARCH_SUPPORTS_LTO_CLANG_THIN if LLD_VERSION >= 140000
 	select ARCH_SUPPORTS_PAGE_TABLE_CHECK if MMU
 	select ARCH_SUPPORTS_PER_VMA_LOCK if MMU
+	select ARCH_SUPPORTS_RT
 	select ARCH_SUPPORTS_SHADOW_CALL_STACK if HAVE_SHADOW_CALL_STACK
 	select ARCH_USE_CMPXCHG_LOCKREF if 64BIT
 	select ARCH_USE_MEMTEST

[tip: sched/rt] arm64: Allow to enable PREEMPT_RT.

[tip-bot2 for Sebastian Andrzej Siewior]

The following commit has been merged into the sched/rt branch of tip:

Commit-ID:     d8fccd9ca5f905533dc6c26cfd1f91beb8691c95
Gitweb:        https://git.kernel.org/tip/d8fccd9ca5f905533dc6c26cfd1f91beb8691c95
Author:        Sebastian Andrzej Siewior <bigeasy@linutronix.de>
AuthorDate:    Fri, 06 Sep 2024 12:59:05 +02:00
Committer:     Thomas Gleixner <tglx@linutronix.de>
CommitterDate: Tue, 17 Sep 2024 11:06:02 +02:00

arm64: Allow to enable PREEMPT_RT.

It is really time.

arm64 has all the required architecture related changes, that have been
identified over time, in order to enable PREEMPT_RT. With the recent
printk changes, the last known road block has been addressed.

Allow to enable PREEMPT_RT on arm64.

Signed-off-by: Sebastian Andrzej Siewior <bigeasy@linutronix.de>
Signed-off-by: Thomas Gleixner <tglx@linutronix.de>
Acked-by: Will Deacon <will@kernel.org>
Link: https://lore.kernel.org/all/20240906111841.562402-3-bigeasy@linutronix.de

---
 arch/arm64/Kconfig | 1 +
 1 file changed, 1 insertion(+)

diff --git a/arch/arm64/Kconfig b/arch/arm64/Kconfig
index ed15b87..7da710b 100644
--- a/arch/arm64/Kconfig
+++ b/arch/arm64/Kconfig
@@ -100,6 +100,7 @@ config ARM64
 	select ARCH_SUPPORTS_NUMA_BALANCING
 	select ARCH_SUPPORTS_PAGE_TABLE_CHECK
 	select ARCH_SUPPORTS_PER_VMA_LOCK
+	select ARCH_SUPPORTS_RT
 	select ARCH_WANT_BATCHED_UNMAP_TLB_FLUSH
 	select ARCH_WANT_COMPAT_IPC_PARSE_VERSION if COMPAT
 	select ARCH_WANT_DEFAULT_BPF_JIT

[tip: sched/rt] x86: Allow to enable PREEMPT_RT.

[tip-bot2 for Sebastian Andrzej Siewior]

The following commit has been merged into the sched/rt branch of tip:

Commit-ID:     d2d6422f8bd17c6bb205133e290625a564194496
Gitweb:        https://git.kernel.org/tip/d2d6422f8bd17c6bb205133e290625a564194496
Author:        Sebastian Andrzej Siewior <bigeasy@linutronix.de>
AuthorDate:    Fri, 06 Sep 2024 12:59:04 +02:00
Committer:     Thomas Gleixner <tglx@linutronix.de>
CommitterDate: Tue, 17 Sep 2024 11:05:53 +02:00

x86: Allow to enable PREEMPT_RT.

It is really time.

x86 has all the required architecture related changes, that have been
identified over time, in order to enable PREEMPT_RT. With the recent
printk changes, the last known road block has been addressed.

Allow to enable PREEMPT_RT on x86.

Signed-off-by: Sebastian Andrzej Siewior <bigeasy@linutronix.de>
Signed-off-by: Thomas Gleixner <tglx@linutronix.de>
Link: https://lore.kernel.org/all/20240906111841.562402-2-bigeasy@linutronix.de

---
 arch/x86/Kconfig | 1 +
 1 file changed, 1 insertion(+)

diff --git a/arch/x86/Kconfig b/arch/x86/Kconfig
index 6f1c31f..865573b 100644
--- a/arch/x86/Kconfig
+++ b/arch/x86/Kconfig
@@ -122,6 +122,7 @@ config X86
 	select ARCH_USES_CFI_TRAPS		if X86_64 && CFI_CLANG
 	select ARCH_SUPPORTS_LTO_CLANG
 	select ARCH_SUPPORTS_LTO_CLANG_THIN
+	select ARCH_SUPPORTS_RT
 	select ARCH_USE_BUILTIN_BSWAP
 	select ARCH_USE_CMPXCHG_LOCKREF		if X86_CMPXCHG64
 	select ARCH_USE_MEMTEST

Re: [PATCH 3/3] riscv: Allow to enable PREEMPT_RT.

[Sebastian Andrzej Siewior]

On 2024-09-06 11:48:03 [-0700], Palmer Dabbelt wrote:
> I don't have a test setup yet, but I figure it's a new feature so I'll just
> flip it on as a config post-rc1.  Presumably this just works in the QEMU
> virt board, or is there some wizardry I'll need to copy?

I don't think you want to enable it by default for everyone. The riscv
defconfig sets CONFIG_PREEMPT_NONE=y by default. For testing you need to
flip this to CONFIG_PREEMPT_RT=y and since CONFIG_EXPERT=y is already
set this option is available.
And yes, it works on the virt board and there is no wizardry needed ;)

Sebastian

Re: [PATCH 0/3] Allow to enable PREEMPT_RT.

[Shrikanth Hegde]

On 9/6/24 16:29, Sebastian Andrzej Siewior wrote:
> The printk bits required for PREEMPT_RT are sitting in linux-next. This
> was the last known roadblock for PREEMPT_RT. The RT queue has
> additionally the "atomic console" for the 8250 UART which is not yet in
> linux-next. This means "legacy console" behaviour as in no printing from
> atomic context in emergency cases. The 8250 UART driver is the only one
> providing "atomic console" support as of today.
> 
> With the printk bits merged, PREEMPT_RT could be enabled on X86, ARM64
> and Risc-V. These three architectures merged required changes over the
> years leaving me in a position where I have no essential changes in the
> queue that would affect them.
> ARM and POWERPC have a few essential patches left and I lost track of
> MIPS.

Hi Sebastian.

Congratulations to all PREEMPT_RT developers
and Thank you for sharing detailed info on what went through/in preempt rt over the years.

Used the latest tip/master tree for preempt_rt experiment.
tip/master was at this commit.
commit f441318ec664d99d7cb03b08557ed3b04d9af67f (origin/master, origin/HEAD)
Merge: d73d270676d8 408eb7417a92
Author: Ingo Molnar <mingo@kernel.org>
Date:   Wed Sep 25 12:33:39 2024 +0200
     Merge branch into tip/master: 'x86/splitlock'


Added the ARCH_SUPPORTS_RT in arch/powerpc/Kconfig. Selected the preempt_rt in menuconfig.
It *compiled and booted successfully* on POWERPC/ppc64le.


Occasionally below sched_warning is seen. It is seen with preempt=full too. So it is likely generic scheduler one,
Not related to RT. I will work on it and try to figure it out.
se->on_rq
WARNING: CPU: 147 PID: 3946 at kernel/sched/fair.c:5629 pick_next_entity+0x140/0x17c
NIP [c0000000001c1fa8] pick_next_entity+0x140/0x17c
LR [c0000000001c1fa4] pick_next_entity+0x13c/0x17c
Call Trace:
[c0000019f7097940] [c0000000001c1fa4] pick_next_entity+0x13c/0x17c (unreliable)
[c0000019f70979c0] [c0000000001c2044] pick_task_fair+0x60/0x128
[c0000019f7097a00] [c0000000001c76ac] pick_next_task_fair+0x68/0x434
[c0000019f7097a90] [c0000000001a7388] __pick_next_task+0x64/0x26c
[c0000019f7097ae0] [c000000000ff62f0] __schedule+0x138/0x73c
[c0000019f7097bb0] [c000000000ff699c] schedule+0x4c/0x114
[c0000019f7097c20] [c0000000005f3624] pipe_read+0x44c/0x5fc
[c0000019f7097d10] [c0000000005e385c] vfs_read+0x2dc/0x3b0
[c0000019f7097dc0] [c0000000005e4884] ksys_read+0xf4/0x144
[c0000019f7097e10] [c0000000000316f8] system_call_exception+0x128/0x360
[c0000019f7097e50] [c00000000000cedc] system_call_vectored_common+0x15c/0x2ec
--- interrupt: 3000 at 0x7fffabcb3cf4


No panic/crash was observed when running some of the microbenchmarks and few real life workloads.
Performance numbers are slightly less than preempt=none. That's likely expected.
However cyclictest numbers are a bit higher with preempt_rt compared to preempt=none.
That probably indicates there are some patches that are yet to be done.


So, Curious to know what are those patches that are left for POWERPC?
would like to work on those and get it enabled on POWERPC.
  

> 
> Sebastian
> 
> 

Re: [PATCH 0/3] Allow to enable PREEMPT_RT.

[Sebastian Andrzej Siewior]

On 2024-09-30 10:39:17 [+0530], Shrikanth Hegde wrote:
> Hi Sebastian.
Hi Shrikanth,

> 
> Added the ARCH_SUPPORTS_RT in arch/powerpc/Kconfig. Selected the preempt_rt in menuconfig.
> It *compiled and booted successfully* on POWERPC/ppc64le.

…
> So, Curious to know what are those patches that are left for POWERPC?
> would like to work on those and get it enabled on POWERPC.

Based on [0] this is what I have in my queue:
| powerpc__traps__Use_PREEMPT_RT.patch
| powerpc_pseries_iommu__Use_a_locallock_instead_local_irq_save.patch
| powerpc-pseries-Select-the-generic-memory-allocator.patch
| powerpc_kvm__Disable_in-kernel_MPIC_emulation_for_PREEMPT_RT.patch
| powerpc_stackprotector__work_around_stack-guard_init_from_atomic.patch
| POWERPC__Allow_to_enable_RT.patch

Be aware that PREEMPT_RT run only on 32bit PowerPC and 64bit from FSL
which is the embedded variant. That means it (64bit) had altivec but
also a "simple" MMU. The P-Series (server grade hardware) version has a
hashing MMU which has additional locking constrains. I never tested this
outside of qemu and this was limited to booting.

The traps patch in the queue was submitted a while ago
	https://lore.kernel.org/linuxppc-dev/20191015191821.11479-4-bigeasy@linutronix.de/

and reduced to the traps.c part.
The powerpc should be reviewed and then decided what to do with them
before enabling.

[0] https://git.kernel.org/pub/scm/linux/kernel/git/rt/linux-rt-devel.git/tree/patches/series?h=v6.11-rt7-patches&id=28e79a9ab2504e245837070f27f525520a6f5acb#n147

Sebastian

Re: [PATCH 3/3] riscv: Allow to enable PREEMPT_RT.

[Palmer Dabbelt]

On Fri, 06 Sep 2024 11:48:03 PDT (-0700), Palmer Dabbelt wrote:
> On Fri, 06 Sep 2024 08:13:24 PDT (-0700), namcao@linutronix.de wrote:
>> On Fri, Sep 06, 2024 at 12:59:06PM +0200, Sebastian Andrzej Siewior wrote:
>>> It is really time.
>>>
>>> riscv has all the required architecture related changes, that have been
>>> identified over time, in order to enable PREEMPT_RT. With the recent
>>> printk changes, the last known road block has been addressed.
>>>
>>> Allow to enable PREEMPT_RT on riscv.
>>>
>>> Signed-off-by: Sebastian Andrzej Siewior <bigeasy@linutronix.de>
>>
>> With the printk patches applied:
>>
>> Tested-by: Nam Cao <namcao@linutronix.de> # Visionfive 2
>
>
> Thanks.  LMK if you guys want me to take this through the RISC-V tree,
> but no big deal if you want it somewhere else -- and if there's some
> dependencies already going in through some sort of RT tree maybe that's
> just easier.  So
>
> Acked-by: Palmer Dabbelt <palmer@rivosinc.com>
>
> I don't have a test setup yet, but I figure it's a new feature so I'll
> just flip it on as a config post-rc1.  Presumably this just works in the
> QEMU virt board, or is there some wizardry I'll need to copy?

and it breaks my boot test script.  Looks like it's actually working 
mostly fine, I'm just not getting the "reboot: System halted" message 
that I'm checking for to make sure the system actually went down 
cleanly.

I'm not sure if this is expected behavior in RT land, or if we've got 
some sort of bug.  It sort of smells like we're losing the last printk() 
line...

>
>> Best regards,
>> Nam

Re: [PATCH 3/3] riscv: Allow to enable PREEMPT_RT.

[Palmer Dabbelt]

On Tue, 17 Sep 2024 03:44:09 PDT (-0700), bigeasy@linutronix.de wrote:
> On 2024-09-06 11:48:03 [-0700], Palmer Dabbelt wrote:
>> I don't have a test setup yet, but I figure it's a new feature so I'll just
>> flip it on as a config post-rc1.  Presumably this just works in the QEMU
>> virt board, or is there some wizardry I'll need to copy?
>
> I don't think you want to enable it by default for everyone. The riscv
> defconfig sets CONFIG_PREEMPT_NONE=y by default. For testing you need to
> flip this to CONFIG_PREEMPT_RT=y and since CONFIG_EXPERT=y is already
> set this option is available.
> And yes, it works on the virt board and there is no wizardry needed ;)

Sorry I missed this.  Just in case anyone's curious: I'm not flipping it 
on by default or anything, just adding a CONFIG_PREEMPT_RT=y 
configuration to the list of things I test before pushing to 
for-next or fixes.

>
> Sebastian

Re: [PATCH 3/3] riscv: Allow to enable PREEMPT_RT.

[Nam Cao]

On Wed, Oct 09, 2024 at 09:44:59AM -0700, Palmer Dabbelt wrote:
> On Fri, 06 Sep 2024 11:48:03 PDT (-0700), Palmer Dabbelt wrote:
> > On Fri, 06 Sep 2024 08:13:24 PDT (-0700), namcao@linutronix.de wrote:
> > > On Fri, Sep 06, 2024 at 12:59:06PM +0200, Sebastian Andrzej Siewior wrote:
> > > > It is really time.
> > > > 
> > > > riscv has all the required architecture related changes, that have been
> > > > identified over time, in order to enable PREEMPT_RT. With the recent
> > > > printk changes, the last known road block has been addressed.
> > > > 
> > > > Allow to enable PREEMPT_RT on riscv.
> > > > 
> > > > Signed-off-by: Sebastian Andrzej Siewior <bigeasy@linutronix.de>
> > > 
> > > With the printk patches applied:
> > > 
> > > Tested-by: Nam Cao <namcao@linutronix.de> # Visionfive 2
> > 
> > 
> > Thanks.  LMK if you guys want me to take this through the RISC-V tree,
> > but no big deal if you want it somewhere else -- and if there's some
> > dependencies already going in through some sort of RT tree maybe that's
> > just easier.  So
> > 
> > Acked-by: Palmer Dabbelt <palmer@rivosinc.com>
> > 
> > I don't have a test setup yet, but I figure it's a new feature so I'll
> > just flip it on as a config post-rc1.  Presumably this just works in the
> > QEMU virt board, or is there some wizardry I'll need to copy?
> 
> and it breaks my boot test script.  Looks like it's actually working mostly
> fine, I'm just not getting the "reboot: System halted" message that I'm
> checking for to make sure the system actually went down cleanly.
> 
> I'm not sure if this is expected behavior in RT land, or if we've got some
> sort of bug.  It sort of smells like we're losing the last printk() line...

I also had some occasional problem with rebooting my Visionfive 2 board,
which was fixed with:
https://lore.kernel.org/lkml/20241003084152.2422969-1-namcao@linutronix.de/

Any chance this fixes your issue as well?

Best regards,
Nam

Re: [PATCH 3/3] riscv: Allow to enable PREEMPT_RT.

[John Ogness]

On 2024-10-09, Palmer Dabbelt <palmer@dabbelt.com> wrote:
> and it breaks my boot test script.  Looks like it's actually working 
> mostly fine, I'm just not getting the "reboot: System halted" message 
> that I'm checking for to make sure the system actually went down 
> cleanly.
>
> I'm not sure if this is expected behavior in RT land, or if we've got 
> some sort of bug.  It sort of smells like we're losing the last printk() 
> line...

For PREEMPT_RT, the console printing is done via a thread. On
shutdown/reboot, the threads are no longer active to print the final
messages. There is a new console driver type (NBCON) that is available
for this. However, currently in mainline there are no console drivers
that have been converted to NBCON yet.

I am currently working [0] to get an NBCON console driver for the 8250
uart in mainline. But that will not help your case if you are using some
other console driver.

John Ogness

[0] https://lore.kernel.org/lkml/20240913140538.221708-1-john.ogness@linutronix.de

Re: [PATCH 3/3] riscv: Allow to enable PREEMPT_RT.

[Sebastian Andrzej Siewior]

On 2024-10-09 09:44:59 [-0700], Palmer Dabbelt wrote:
> 
> and it breaks my boot test script.  Looks like it's actually working mostly
> fine, I'm just not getting the "reboot: System halted" message that I'm
> checking for to make sure the system actually went down cleanly.
> 
> I'm not sure if this is expected behavior in RT land, or if we've got some
> sort of bug.  It sort of smells like we're losing the last printk() line...

Is it just defconfig + kvm_guest.config + PREEMPT_RT on "-cpu rv64
-machine virt" or is there more to it?

Sebastian