[PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Waiman Long]

When running a PREEMPT_RT debug kernel on a 2-socket Grace arm64 system,
the following bug report was produced at bootup time.

  BUG: sleeping function called from invalid context at kernel/locking/spinlock_rt.c:48
  in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 0, name: swapper/72
  preempt_count: 1, expected: 0
  RCU nest depth: 1, expected: 1
   :
  CPU: 72 UID: 0 PID: 0 Comm: swapper/72 Tainted: G        W           6.19.0-rc4-test+ #4 PREEMPT_{RT,(full)}
  Tainted: [W]=WARN
  Call trace:
    :
   rt_spin_lock+0xe4/0x408
   rmqueue_bulk+0x48/0x1de8
   __rmqueue_pcplist+0x410/0x650
   rmqueue.constprop.0+0x6a8/0x2b50
   get_page_from_freelist+0x3c0/0xe68
   __alloc_frozen_pages_noprof+0x1dc/0x348
   alloc_pages_mpol+0xe4/0x2f8
   alloc_frozen_pages_noprof+0x124/0x190
   allocate_slab+0x2f0/0x438
   new_slab+0x4c/0x80
   ___slab_alloc+0x410/0x798
   __slab_alloc.constprop.0+0x88/0x1e0
   __kmalloc_cache_noprof+0x2dc/0x4b0
   allocate_vpe_l1_table+0x114/0x788
   its_cpu_init_lpis+0x344/0x790
   its_cpu_init+0x60/0x220
   gic_starting_cpu+0x64/0xe8
   cpuhp_invoke_callback+0x438/0x6d8
   __cpuhp_invoke_callback_range+0xd8/0x1f8
   notify_cpu_starting+0x11c/0x178
   secondary_start_kernel+0xc8/0x188
   __secondary_switched+0xc0/0xc8

This is due to the fact that allocate_vpe_l1_table() will call
kzalloc() to allocate a cpumask_t when the first CPU of the
second node of the 72-cpu Grace system is being called from the
CPUHP_AP_MIPS_GIC_TIMER_STARTING state inside the starting section of
the CPU hotplug bringup pipeline where interrupt is disabled. This is an
atomic context where sleeping is not allowed and acquiring a sleeping
rt_spin_lock within kzalloc() may lead to system hang in case there is
a lock contention.

To work around this issue, a static buffer is used for cpumask
allocation when running a PREEMPT_RT kernel via the newly introduced
vpe_alloc_cpumask() helper. The static buffer is currently set to be
4 kbytes in size. As only one cpumask is needed per node, the current
size should be big enough as long as (cpumask_size() * nr_node_ids)
is not bigger than 4k.

Signed-off-by: Waiman Long <longman@redhat.com>
---
 drivers/irqchip/irq-gic-v3-its.c | 26 +++++++++++++++++++++++++-
 1 file changed, 25 insertions(+), 1 deletion(-)

diff --git a/drivers/irqchip/irq-gic-v3-its.c b/drivers/irqchip/irq-gic-v3-its.c
index ada585bfa451..9185785524dc 100644
--- a/drivers/irqchip/irq-gic-v3-its.c
+++ b/drivers/irqchip/irq-gic-v3-its.c
@@ -2896,6 +2896,30 @@ static bool allocate_vpe_l2_table(int cpu, u32 id)
 	return true;
 }
 
+static void *vpe_alloc_cpumask(void)
+{
+	/*
+	 * With PREEMPT_RT kernel, we can't call any k*alloc() APIs as they
+	 * may acquire a sleeping rt_spin_lock in an atomic context. So use
+	 * a pre-allocated buffer instead.
+	 */
+	if (IS_ENABLED(CONFIG_PREEMPT_RT)) {
+		static unsigned long mask_buf[512];
+		static atomic_t	alloc_idx;
+		int idx, mask_size = cpumask_size();
+		int nr_cpumasks = sizeof(mask_buf)/mask_size;
+
+		/*
+		 * Fetch an allocation index and if it points to a buffer within
+		 * mask_buf[], return that. Fall back to kzalloc() otherwise.
+		 */
+		idx = atomic_fetch_inc(&alloc_idx);
+		if (idx < nr_cpumasks)
+			return &mask_buf[idx * mask_size/sizeof(long)];
+	}
+	return kzalloc(sizeof(cpumask_t), GFP_ATOMIC);
+}
+
 static int allocate_vpe_l1_table(void)
 {
 	void __iomem *vlpi_base = gic_data_rdist_vlpi_base();
@@ -2927,7 +2951,7 @@ static int allocate_vpe_l1_table(void)
 	if (val & GICR_VPROPBASER_4_1_VALID)
 		goto out;
 
-	gic_data_rdist()->vpe_table_mask = kzalloc(sizeof(cpumask_t), GFP_ATOMIC);
+	gic_data_rdist()->vpe_table_mask = vpe_alloc_cpumask();
 	if (!gic_data_rdist()->vpe_table_mask)
 		return -ENOMEM;
 
-- 
2.52.0

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Marc Zyngier]

On Wed, 07 Jan 2026 21:53:53 +0000,
Waiman Long <longman@redhat.com> wrote:
> 
> When running a PREEMPT_RT debug kernel on a 2-socket Grace arm64 system,
> the following bug report was produced at bootup time.
> 
>   BUG: sleeping function called from invalid context at kernel/locking/spinlock_rt.c:48
>   in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 0, name: swapper/72
>   preempt_count: 1, expected: 0
>   RCU nest depth: 1, expected: 1
>    :
>   CPU: 72 UID: 0 PID: 0 Comm: swapper/72 Tainted: G        W           6.19.0-rc4-test+ #4 PREEMPT_{RT,(full)}
>   Tainted: [W]=WARN
>   Call trace:
>     :
>    rt_spin_lock+0xe4/0x408
>    rmqueue_bulk+0x48/0x1de8
>    __rmqueue_pcplist+0x410/0x650
>    rmqueue.constprop.0+0x6a8/0x2b50
>    get_page_from_freelist+0x3c0/0xe68
>    __alloc_frozen_pages_noprof+0x1dc/0x348
>    alloc_pages_mpol+0xe4/0x2f8
>    alloc_frozen_pages_noprof+0x124/0x190
>    allocate_slab+0x2f0/0x438
>    new_slab+0x4c/0x80
>    ___slab_alloc+0x410/0x798
>    __slab_alloc.constprop.0+0x88/0x1e0
>    __kmalloc_cache_noprof+0x2dc/0x4b0
>    allocate_vpe_l1_table+0x114/0x788
>    its_cpu_init_lpis+0x344/0x790
>    its_cpu_init+0x60/0x220
>    gic_starting_cpu+0x64/0xe8
>    cpuhp_invoke_callback+0x438/0x6d8
>    __cpuhp_invoke_callback_range+0xd8/0x1f8
>    notify_cpu_starting+0x11c/0x178
>    secondary_start_kernel+0xc8/0x188
>    __secondary_switched+0xc0/0xc8
> 
> This is due to the fact that allocate_vpe_l1_table() will call
> kzalloc() to allocate a cpumask_t when the first CPU of the
> second node of the 72-cpu Grace system is being called from the
> CPUHP_AP_MIPS_GIC_TIMER_STARTING state inside the starting section of

Surely *not* that particular state.

> the CPU hotplug bringup pipeline where interrupt is disabled. This is an
> atomic context where sleeping is not allowed and acquiring a sleeping
> rt_spin_lock within kzalloc() may lead to system hang in case there is
> a lock contention.
> 
> To work around this issue, a static buffer is used for cpumask
> allocation when running a PREEMPT_RT kernel via the newly introduced
> vpe_alloc_cpumask() helper. The static buffer is currently set to be
> 4 kbytes in size. As only one cpumask is needed per node, the current
> size should be big enough as long as (cpumask_size() * nr_node_ids)
> is not bigger than 4k.

What role does the node play here? The GIC topology has nothing to do
with NUMA. It may be true on your particular toy, but that's
definitely not true architecturally. You could, at worse, end-up with
one such cpumask per *CPU*. That'd be a braindead system, but this
code is written to support the architecture, not any particular
implementation.

> 
> Signed-off-by: Waiman Long <longman@redhat.com>
> ---
>  drivers/irqchip/irq-gic-v3-its.c | 26 +++++++++++++++++++++++++-
>  1 file changed, 25 insertions(+), 1 deletion(-)
> 
> diff --git a/drivers/irqchip/irq-gic-v3-its.c b/drivers/irqchip/irq-gic-v3-its.c
> index ada585bfa451..9185785524dc 100644
> --- a/drivers/irqchip/irq-gic-v3-its.c
> +++ b/drivers/irqchip/irq-gic-v3-its.c
> @@ -2896,6 +2896,30 @@ static bool allocate_vpe_l2_table(int cpu, u32 id)
>  	return true;
>  }
>  
> +static void *vpe_alloc_cpumask(void)
> +{
> +	/*
> +	 * With PREEMPT_RT kernel, we can't call any k*alloc() APIs as they
> +	 * may acquire a sleeping rt_spin_lock in an atomic context. So use
> +	 * a pre-allocated buffer instead.
> +	 */
> +	if (IS_ENABLED(CONFIG_PREEMPT_RT)) {
> +		static unsigned long mask_buf[512];
> +		static atomic_t	alloc_idx;
> +		int idx, mask_size = cpumask_size();
> +		int nr_cpumasks = sizeof(mask_buf)/mask_size;
> +
> +		/*
> +		 * Fetch an allocation index and if it points to a buffer within
> +		 * mask_buf[], return that. Fall back to kzalloc() otherwise.
> +		 */
> +		idx = atomic_fetch_inc(&alloc_idx);
> +		if (idx < nr_cpumasks)
> +			return &mask_buf[idx * mask_size/sizeof(long)];
> +	}

Err, no. That's horrible. I can see three ways to address this in a
more appealing way:

- you give RT a generic allocator that works for (small) atomic
  allocations. I appreciate that's not easy, and even probably
  contrary to the RT goals. But I'm also pretty sure that the GIC code
  is not the only pile of crap being caught doing that.

- you pre-compute upfront how many cpumasks you are going to require,
  based on the actual GIC topology. You do that on CPU0, outside of
  the hotplug constraints, and allocate what you need. This is
  difficult as you need to ensure the RD<->CPU matching without the
  CPUs having booted, which means wading through the DT/ACPI gunk to
  try and guess what you have.

- you delay the allocation of L1 tables to a context where you can
  perform allocations, and before we have a chance of running a guest
  on this CPU. That's probably the simplest option (though dealing
  with late onlining while guests are already running could be
  interesting...).

But I'm always going to say no to something that is a poor hack and
ultimately falling back to the same broken behaviour.

Thanks,

	M.

-- 
Without deviation from the norm, progress is not possible.

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Thomas Gleixner]

On Thu, Jan 08 2026 at 08:26, Marc Zyngier wrote:
> Err, no. That's horrible. I can see three ways to address this in a
> more appealing way:
>
> - you give RT a generic allocator that works for (small) atomic
>   allocations. I appreciate that's not easy, and even probably
>   contrary to the RT goals. But I'm also pretty sure that the GIC code
>   is not the only pile of crap being caught doing that.
>
> - you pre-compute upfront how many cpumasks you are going to require,
>   based on the actual GIC topology. You do that on CPU0, outside of
>   the hotplug constraints, and allocate what you need. This is
>   difficult as you need to ensure the RD<->CPU matching without the
>   CPUs having booted, which means wading through the DT/ACPI gunk to
>   try and guess what you have.
>
> - you delay the allocation of L1 tables to a context where you can
>   perform allocations, and before we have a chance of running a guest
>   on this CPU. That's probably the simplest option (though dealing
>   with late onlining while guests are already running could be
>   interesting...).

At the point where a CPU is brought up, the topology should be known
already, which means this can be allocated on the control CPU _before_
the new CPU comes up, no?

Thanks,

        tglx

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Marc Zyngier]

On Thu, 08 Jan 2026 22:11:33 +0000,
Thomas Gleixner <tglx@kernel.org> wrote:
> 
> On Thu, Jan 08 2026 at 08:26, Marc Zyngier wrote:
> > Err, no. That's horrible. I can see three ways to address this in a
> > more appealing way:
> >
> > - you give RT a generic allocator that works for (small) atomic
> >   allocations. I appreciate that's not easy, and even probably
> >   contrary to the RT goals. But I'm also pretty sure that the GIC code
> >   is not the only pile of crap being caught doing that.
> >
> > - you pre-compute upfront how many cpumasks you are going to require,
> >   based on the actual GIC topology. You do that on CPU0, outside of
> >   the hotplug constraints, and allocate what you need. This is
> >   difficult as you need to ensure the RD<->CPU matching without the
> >   CPUs having booted, which means wading through the DT/ACPI gunk to
> >   try and guess what you have.
> >
> > - you delay the allocation of L1 tables to a context where you can
> >   perform allocations, and before we have a chance of running a guest
> >   on this CPU. That's probably the simplest option (though dealing
> >   with late onlining while guests are already running could be
> >   interesting...).
> 
> At the point where a CPU is brought up, the topology should be known
> already, which means this can be allocated on the control CPU _before_
> the new CPU comes up, no?

No. Each CPU finds *itself* in the forest of redistributors, and from
there tries to find whether it has some shared resource with a CPU
that has booted before it. That's because firmware is absolutely awful
and can't present a consistent view of the system.

Anyway, I expect it could be solved by moving this part of the init to
an ONLINE HP callback.

Thanks,

	M.

-- 
Without deviation from the norm, progress is not possible.

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Waiman Long]

On 1/8/26 3:26 AM, Marc Zyngier wrote:
> On Wed, 07 Jan 2026 21:53:53 +0000,
> Waiman Long <longman@redhat.com> wrote:
>> When running a PREEMPT_RT debug kernel on a 2-socket Grace arm64 system,
>> the following bug report was produced at bootup time.
>>
>>    BUG: sleeping function called from invalid context at kernel/locking/spinlock_rt.c:48
>>    in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 0, name: swapper/72
>>    preempt_count: 1, expected: 0
>>    RCU nest depth: 1, expected: 1
>>     :
>>    CPU: 72 UID: 0 PID: 0 Comm: swapper/72 Tainted: G        W           6.19.0-rc4-test+ #4 PREEMPT_{RT,(full)}
>>    Tainted: [W]=WARN
>>    Call trace:
>>      :
>>     rt_spin_lock+0xe4/0x408
>>     rmqueue_bulk+0x48/0x1de8
>>     __rmqueue_pcplist+0x410/0x650
>>     rmqueue.constprop.0+0x6a8/0x2b50
>>     get_page_from_freelist+0x3c0/0xe68
>>     __alloc_frozen_pages_noprof+0x1dc/0x348
>>     alloc_pages_mpol+0xe4/0x2f8
>>     alloc_frozen_pages_noprof+0x124/0x190
>>     allocate_slab+0x2f0/0x438
>>     new_slab+0x4c/0x80
>>     ___slab_alloc+0x410/0x798
>>     __slab_alloc.constprop.0+0x88/0x1e0
>>     __kmalloc_cache_noprof+0x2dc/0x4b0
>>     allocate_vpe_l1_table+0x114/0x788
>>     its_cpu_init_lpis+0x344/0x790
>>     its_cpu_init+0x60/0x220
>>     gic_starting_cpu+0x64/0xe8
>>     cpuhp_invoke_callback+0x438/0x6d8
>>     __cpuhp_invoke_callback_range+0xd8/0x1f8
>>     notify_cpu_starting+0x11c/0x178
>>     secondary_start_kernel+0xc8/0x188
>>     __secondary_switched+0xc0/0xc8
>>
>> This is due to the fact that allocate_vpe_l1_table() will call
>> kzalloc() to allocate a cpumask_t when the first CPU of the
>> second node of the 72-cpu Grace system is being called from the
>> CPUHP_AP_MIPS_GIC_TIMER_STARTING state inside the starting section of
> Surely *not* that particular state.

My mistake, it should be CPUHP_AP_IRQ_GIC_STARTING. There are three 
static gic_starting_cpu() functions that confuse me.


>> the CPU hotplug bringup pipeline where interrupt is disabled. This is an
>> atomic context where sleeping is not allowed and acquiring a sleeping
>> rt_spin_lock within kzalloc() may lead to system hang in case there is
>> a lock contention.
>>
>> To work around this issue, a static buffer is used for cpumask
>> allocation when running a PREEMPT_RT kernel via the newly introduced
>> vpe_alloc_cpumask() helper. The static buffer is currently set to be
>> 4 kbytes in size. As only one cpumask is needed per node, the current
>> size should be big enough as long as (cpumask_size() * nr_node_ids)
>> is not bigger than 4k.
> What role does the node play here? The GIC topology has nothing to do
> with NUMA. It may be true on your particular toy, but that's
> definitely not true architecturally. You could, at worse, end-up with
> one such cpumask per *CPU*. That'd be a braindead system, but this
> code is written to support the architecture, not any particular
> implementation.
>
It is just what I have observed on the hardware that I used for 
reproducing the problem. I agree that it may be different in other arm64 
CPUs.
>> Signed-off-by: Waiman Long <longman@redhat.com>
>> ---
>>   drivers/irqchip/irq-gic-v3-its.c | 26 +++++++++++++++++++++++++-
>>   1 file changed, 25 insertions(+), 1 deletion(-)
>>
>> diff --git a/drivers/irqchip/irq-gic-v3-its.c b/drivers/irqchip/irq-gic-v3-its.c
>> index ada585bfa451..9185785524dc 100644
>> --- a/drivers/irqchip/irq-gic-v3-its.c
>> +++ b/drivers/irqchip/irq-gic-v3-its.c
>> @@ -2896,6 +2896,30 @@ static bool allocate_vpe_l2_table(int cpu, u32 id)
>>   	return true;
>>   }
>>   
>> +static void *vpe_alloc_cpumask(void)
>> +{
>> +	/*
>> +	 * With PREEMPT_RT kernel, we can't call any k*alloc() APIs as they
>> +	 * may acquire a sleeping rt_spin_lock in an atomic context. So use
>> +	 * a pre-allocated buffer instead.
>> +	 */
>> +	if (IS_ENABLED(CONFIG_PREEMPT_RT)) {
>> +		static unsigned long mask_buf[512];
>> +		static atomic_t	alloc_idx;
>> +		int idx, mask_size = cpumask_size();
>> +		int nr_cpumasks = sizeof(mask_buf)/mask_size;
>> +
>> +		/*
>> +		 * Fetch an allocation index and if it points to a buffer within
>> +		 * mask_buf[], return that. Fall back to kzalloc() otherwise.
>> +		 */
>> +		idx = atomic_fetch_inc(&alloc_idx);
>> +		if (idx < nr_cpumasks)
>> +			return &mask_buf[idx * mask_size/sizeof(long)];
>> +	}
> Err, no. That's horrible. I can see three ways to address this in a
> more appealing way:
>
> - you give RT a generic allocator that works for (small) atomic
>    allocations. I appreciate that's not easy, and even probably
>    contrary to the RT goals. But I'm also pretty sure that the GIC code
>    is not the only pile of crap being caught doing that.
>
> - you pre-compute upfront how many cpumasks you are going to require,
>    based on the actual GIC topology. You do that on CPU0, outside of
>    the hotplug constraints, and allocate what you need. This is
>    difficult as you need to ensure the RD<->CPU matching without the
>    CPUs having booted, which means wading through the DT/ACPI gunk to
>    try and guess what you have.
>
> - you delay the allocation of L1 tables to a context where you can
>    perform allocations, and before we have a chance of running a guest
>    on this CPU. That's probably the simplest option (though dealing
>    with late onlining while guests are already running could be
>    interesting...).
>
> But I'm always going to say no to something that is a poor hack and
> ultimately falling back to the same broken behaviour.

Thanks for the suggestion. I will try  the first alternative of a more 
generic memory allocator.

Cheers,
Longman

>
> Thanks,
>
> 	M.
>

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Thomas Gleixner]

On Fri, Jan 09 2026 at 16:13, Marc Zyngier wrote:
> On Thu, 08 Jan 2026 22:11:33 +0000,
> Thomas Gleixner <tglx@kernel.org> wrote:
>> At the point where a CPU is brought up, the topology should be known
>> already, which means this can be allocated on the control CPU _before_
>> the new CPU comes up, no?
>
> No. Each CPU finds *itself* in the forest of redistributors, and from
> there tries to find whether it has some shared resource with a CPU
> that has booted before it. That's because firmware is absolutely awful
> and can't present a consistent view of the system.

Groan....

> Anyway, I expect it could be solved by moving this part of the init to
> an ONLINE HP callback.

Which needs to be before CPUHP_AP_IRQ_AFFINITY_ONLINE, but even that
might be to late because there are callbacks in the STARTING section,
i.e. timer, perf, which might rely on interrupts being accessible.

Also that patch seems to be incomplete because there is another
allocation further down in allocate_vpe_l1_table()....

Thanks,

        tglx

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Marc Zyngier]

On Sun, 11 Jan 2026 09:39:07 +0000,
Thomas Gleixner <tglx@kernel.org> wrote:
> 
> On Fri, Jan 09 2026 at 16:13, Marc Zyngier wrote:
> > On Thu, 08 Jan 2026 22:11:33 +0000,
> > Thomas Gleixner <tglx@kernel.org> wrote:
> >> At the point where a CPU is brought up, the topology should be known
> >> already, which means this can be allocated on the control CPU _before_
> >> the new CPU comes up, no?
> >
> > No. Each CPU finds *itself* in the forest of redistributors, and from
> > there tries to find whether it has some shared resource with a CPU
> > that has booted before it. That's because firmware is absolutely awful
> > and can't present a consistent view of the system.
> 
> Groan....
>
> > Anyway, I expect it could be solved by moving this part of the init to
> > an ONLINE HP callback.
> 
> Which needs to be before CPUHP_AP_IRQ_AFFINITY_ONLINE, but even that
> might be to late because there are callbacks in the STARTING section,
> i.e. timer, perf, which might rely on interrupts being accessible.

Nah. This stuff is only for direct injection of vLPIs into guests, so
as long as this is done before we can schedule a vcpu on this physical
CPU, we're good. No physical interrupt is concerned with this code.

> Also that patch seems to be incomplete because there is another
> allocation further down in allocate_vpe_l1_table()....

Yeah, I wondered why page allocation wasn't affected by this issue,
but didn't try to find out.

	M.

-- 
Without deviation from the norm, progress is not possible.

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Thomas Gleixner]

On Sun, Jan 11 2026 at 10:38, Marc Zyngier wrote:
> On Sun, 11 Jan 2026 09:39:07 +0000,
> Thomas Gleixner <tglx@kernel.org> wrote:
>> 
>> On Fri, Jan 09 2026 at 16:13, Marc Zyngier wrote:
>> > On Thu, 08 Jan 2026 22:11:33 +0000,
>> > Thomas Gleixner <tglx@kernel.org> wrote:
>> >> At the point where a CPU is brought up, the topology should be known
>> >> already, which means this can be allocated on the control CPU _before_
>> >> the new CPU comes up, no?
>> >
>> > No. Each CPU finds *itself* in the forest of redistributors, and from
>> > there tries to find whether it has some shared resource with a CPU
>> > that has booted before it. That's because firmware is absolutely awful
>> > and can't present a consistent view of the system.
>> 
>> Groan....
>>
>> > Anyway, I expect it could be solved by moving this part of the init to
>> > an ONLINE HP callback.
>> 
>> Which needs to be before CPUHP_AP_IRQ_AFFINITY_ONLINE, but even that
>> might be to late because there are callbacks in the STARTING section,
>> i.e. timer, perf, which might rely on interrupts being accessible.
>
> Nah. This stuff is only for direct injection of vLPIs into guests, so
> as long as this is done before we can schedule a vcpu on this physical
> CPU, we're good. No physical interrupt is concerned with this code.

That's fine then. vCPUs are considered "user-space" tasks and can't be
scheduled before CPUHP_AP_ACTIVE sets the CPU active for the scheduler.

Thanks,

        tglx

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Waiman Long]

On 1/11/26 5:38 AM, Marc Zyngier wrote:
>> Also that patch seems to be incomplete because there is another
>> allocation further down in allocate_vpe_l1_table()....
> Yeah, I wondered why page allocation wasn't affected by this issue,
> but didn't try to find out.

The use of GFP_ATOMIC flag in the page allocation request may help it to 
dip into the reserved area and avoid taking any spinlock. In my own 
test, just removing the kzalloc() call is enough to avoid any invalid 
context warning. In the page allocation code, there is a zone lock and a 
per_cpu_pages lock. They were not acquired in my particular test case, 
though further investigation may be needed to make sure it is really safe.

Cheers,
Longman

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Marc Zyngier]

On Sun, 11 Jan 2026 16:20:45 +0000,
Thomas Gleixner <tglx@kernel.org> wrote:
> 
> On Sun, Jan 11 2026 at 10:38, Marc Zyngier wrote:
> > On Sun, 11 Jan 2026 09:39:07 +0000,
> > Thomas Gleixner <tglx@kernel.org> wrote:
> >> 
> >> On Fri, Jan 09 2026 at 16:13, Marc Zyngier wrote:
> >> > On Thu, 08 Jan 2026 22:11:33 +0000,
> >> > Thomas Gleixner <tglx@kernel.org> wrote:
> >> >> At the point where a CPU is brought up, the topology should be known
> >> >> already, which means this can be allocated on the control CPU _before_
> >> >> the new CPU comes up, no?
> >> >
> >> > No. Each CPU finds *itself* in the forest of redistributors, and from
> >> > there tries to find whether it has some shared resource with a CPU
> >> > that has booted before it. That's because firmware is absolutely awful
> >> > and can't present a consistent view of the system.
> >> 
> >> Groan....
> >>
> >> > Anyway, I expect it could be solved by moving this part of the init to
> >> > an ONLINE HP callback.
> >> 
> >> Which needs to be before CPUHP_AP_IRQ_AFFINITY_ONLINE, but even that
> >> might be to late because there are callbacks in the STARTING section,
> >> i.e. timer, perf, which might rely on interrupts being accessible.
> >
> > Nah. This stuff is only for direct injection of vLPIs into guests, so
> > as long as this is done before we can schedule a vcpu on this physical
> > CPU, we're good. No physical interrupt is concerned with this code.
> 
> That's fine then. vCPUs are considered "user-space" tasks and can't be
> scheduled before CPUHP_AP_ACTIVE sets the CPU active for the scheduler.

Waiman, can you please give the following hack a go on your box? The
machines I have are thankfully limited to a single ITS group, so I
can't directly reproduce your issue.

Thanks,

	M.

diff --git a/drivers/irqchip/irq-gic-v3-its.c b/drivers/irqchip/irq-gic-v3-its.c
index ada585bfa4517..20967000f2348 100644
--- a/drivers/irqchip/irq-gic-v3-its.c
+++ b/drivers/irqchip/irq-gic-v3-its.c
@@ -2896,7 +2896,7 @@ static bool allocate_vpe_l2_table(int cpu, u32 id)
 	return true;
 }
 
-static int allocate_vpe_l1_table(void)
+static int allocate_vpe_l1_table(unsigned int cpu)
 {
 	void __iomem *vlpi_base = gic_data_rdist_vlpi_base();
 	u64 val, gpsz, npg, pa;
@@ -3012,10 +3012,11 @@ static int allocate_vpe_l1_table(void)
 
 out:
 	gicr_write_vpropbaser(val, vlpi_base + GICR_VPROPBASER);
-	cpumask_set_cpu(smp_processor_id(), gic_data_rdist()->vpe_table_mask);
+	cpumask_set_cpu(cpu, gic_data_rdist()->vpe_table_mask);
+	dsb(sy);
 
 	pr_debug("CPU%d: VPROPBASER = %llx %*pbl\n",
-		 smp_processor_id(), val,
+		 cpu, val,
 		 cpumask_pr_args(gic_data_rdist()->vpe_table_mask));
 
 	return 0;
@@ -3264,15 +3265,9 @@ static void its_cpu_init_lpis(void)
 		val = its_clear_vpend_valid(vlpi_base, 0, 0);
 	}
 
-	if (allocate_vpe_l1_table()) {
-		/*
-		 * If the allocation has failed, we're in massive trouble.
-		 * Disable direct injection, and pray that no VM was
-		 * already running...
-		 */
-		gic_rdists->has_rvpeid = false;
-		gic_rdists->has_vlpis = false;
-	}
+	if (smp_processor_id() == 0)
+		cpuhp_setup_state(CPUHP_AP_ONLINE_DYN, "irqchip/arm/gicv3:vpe",
+				  allocate_vpe_l1_table, NULL);
 
 	/* Make sure the GIC has seen the above */
 	dsb(sy);


-- 
Without deviation from the norm, progress is not possible.

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Sebastian Andrzej Siewior]

On 2026-01-12 11:20:07 [+0000], Marc Zyngier wrote:
> On Sun, 11 Jan 2026 16:20:45 +0000,
> Thomas Gleixner <tglx@kernel.org> wrote:
> > 
> > On Sun, Jan 11 2026 at 10:38, Marc Zyngier wrote:
> > > On Sun, 11 Jan 2026 09:39:07 +0000,
> > > Thomas Gleixner <tglx@kernel.org> wrote:
> > >> 
> > >> On Fri, Jan 09 2026 at 16:13, Marc Zyngier wrote:
> > >> > On Thu, 08 Jan 2026 22:11:33 +0000,
> > >> > Thomas Gleixner <tglx@kernel.org> wrote:
> > >> >> At the point where a CPU is brought up, the topology should be known
> > >> >> already, which means this can be allocated on the control CPU _before_
> > >> >> the new CPU comes up, no?
> > >> >
> > >> > No. Each CPU finds *itself* in the forest of redistributors, and from
> > >> > there tries to find whether it has some shared resource with a CPU
> > >> > that has booted before it. That's because firmware is absolutely awful
> > >> > and can't present a consistent view of the system.
> > >> 
> > >> Groan....
> > >>
> > >> > Anyway, I expect it could be solved by moving this part of the init to
> > >> > an ONLINE HP callback.
> > >> 
> > >> Which needs to be before CPUHP_AP_IRQ_AFFINITY_ONLINE, but even that
> > >> might be to late because there are callbacks in the STARTING section,
> > >> i.e. timer, perf, which might rely on interrupts being accessible.
> > >
> > > Nah. This stuff is only for direct injection of vLPIs into guests, so
> > > as long as this is done before we can schedule a vcpu on this physical
> > > CPU, we're good. No physical interrupt is concerned with this code.
> > 
> > That's fine then. vCPUs are considered "user-space" tasks and can't be
> > scheduled before CPUHP_AP_ACTIVE sets the CPU active for the scheduler.
> 
> Waiman, can you please give the following hack a go on your box? The
> machines I have are thankfully limited to a single ITS group, so I
> can't directly reproduce your issue.
> 
> Thanks,
> 
> 	M.
> 
> diff --git a/drivers/irqchip/irq-gic-v3-its.c b/drivers/irqchip/irq-gic-v3-its.c
> index ada585bfa4517..20967000f2348 100644
> --- a/drivers/irqchip/irq-gic-v3-its.c
> +++ b/drivers/irqchip/irq-gic-v3-its.c
> @@ -2896,7 +2896,7 @@ static bool allocate_vpe_l2_table(int cpu, u32 id)
>  	return true;
>  }
>  
> -static int allocate_vpe_l1_table(void)
> +static int allocate_vpe_l1_table(unsigned int cpu)
>  {
>  	void __iomem *vlpi_base = gic_data_rdist_vlpi_base();
>  	u64 val, gpsz, npg, pa;
> @@ -3012,10 +3012,11 @@ static int allocate_vpe_l1_table(void)
>  
>  out:
>  	gicr_write_vpropbaser(val, vlpi_base + GICR_VPROPBASER);
> -	cpumask_set_cpu(smp_processor_id(), gic_data_rdist()->vpe_table_mask);
> +	cpumask_set_cpu(cpu, gic_data_rdist()->vpe_table_mask);
> +	dsb(sy);
>  
>  	pr_debug("CPU%d: VPROPBASER = %llx %*pbl\n",
> -		 smp_processor_id(), val,
> +		 cpu, val,
>  		 cpumask_pr_args(gic_data_rdist()->vpe_table_mask));
>  
>  	return 0;
> @@ -3264,15 +3265,9 @@ static void its_cpu_init_lpis(void)
>  		val = its_clear_vpend_valid(vlpi_base, 0, 0);
>  	}
>  
> -	if (allocate_vpe_l1_table()) {
> -		/*
> -		 * If the allocation has failed, we're in massive trouble.
> -		 * Disable direct injection, and pray that no VM was
> -		 * already running...
> -		 */
> -		gic_rdists->has_rvpeid = false;
> -		gic_rdists->has_vlpis = false;
> -	}
> +	if (smp_processor_id() == 0)
> +		cpuhp_setup_state(CPUHP_AP_ONLINE_DYN, "irqchip/arm/gicv3:vpe",
> +				  allocate_vpe_l1_table, NULL);

If you move it the online state then you could also
s/GFP_ATOMIC/GFP_KERNEL.

Also previously you checked the error code set has_rvpeid, has_vlpis on
failure. Now you you should the same in case of a failure during
registration.
This also happens happens on CPU hotplug and I don't see how you avoid a
second allocation. But I also don't understand why this registrations
happens on CPU0. It might be just a test patch…

>  
>  	/* Make sure the GIC has seen the above */
>  	dsb(sy);

Sebastian

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Marc Zyngier]

On Mon, 12 Jan 2026 14:08:37 +0000,
Sebastian Andrzej Siewior <bigeasy@linutronix.de> wrote:
> 
> On 2026-01-12 11:20:07 [+0000], Marc Zyngier wrote:
> > On Sun, 11 Jan 2026 16:20:45 +0000,
> > Thomas Gleixner <tglx@kernel.org> wrote:
> > > 
> > > On Sun, Jan 11 2026 at 10:38, Marc Zyngier wrote:
> > > > On Sun, 11 Jan 2026 09:39:07 +0000,
> > > > Thomas Gleixner <tglx@kernel.org> wrote:
> > > >> 
> > > >> On Fri, Jan 09 2026 at 16:13, Marc Zyngier wrote:
> > > >> > On Thu, 08 Jan 2026 22:11:33 +0000,
> > > >> > Thomas Gleixner <tglx@kernel.org> wrote:
> > > >> >> At the point where a CPU is brought up, the topology should be known
> > > >> >> already, which means this can be allocated on the control CPU _before_
> > > >> >> the new CPU comes up, no?
> > > >> >
> > > >> > No. Each CPU finds *itself* in the forest of redistributors, and from
> > > >> > there tries to find whether it has some shared resource with a CPU
> > > >> > that has booted before it. That's because firmware is absolutely awful
> > > >> > and can't present a consistent view of the system.
> > > >> 
> > > >> Groan....
> > > >>
> > > >> > Anyway, I expect it could be solved by moving this part of the init to
> > > >> > an ONLINE HP callback.
> > > >> 
> > > >> Which needs to be before CPUHP_AP_IRQ_AFFINITY_ONLINE, but even that
> > > >> might be to late because there are callbacks in the STARTING section,
> > > >> i.e. timer, perf, which might rely on interrupts being accessible.
> > > >
> > > > Nah. This stuff is only for direct injection of vLPIs into guests, so
> > > > as long as this is done before we can schedule a vcpu on this physical
> > > > CPU, we're good. No physical interrupt is concerned with this code.
> > > 
> > > That's fine then. vCPUs are considered "user-space" tasks and can't be
> > > scheduled before CPUHP_AP_ACTIVE sets the CPU active for the scheduler.
> > 
> > Waiman, can you please give the following hack a go on your box? The
> > machines I have are thankfully limited to a single ITS group, so I
> > can't directly reproduce your issue.
> > 
> > Thanks,
> > 
> > 	M.
> > 
> > diff --git a/drivers/irqchip/irq-gic-v3-its.c b/drivers/irqchip/irq-gic-v3-its.c
> > index ada585bfa4517..20967000f2348 100644
> > --- a/drivers/irqchip/irq-gic-v3-its.c
> > +++ b/drivers/irqchip/irq-gic-v3-its.c
> > @@ -2896,7 +2896,7 @@ static bool allocate_vpe_l2_table(int cpu, u32 id)
> >  	return true;
> >  }
> >  
> > -static int allocate_vpe_l1_table(void)
> > +static int allocate_vpe_l1_table(unsigned int cpu)
> >  {
> >  	void __iomem *vlpi_base = gic_data_rdist_vlpi_base();
> >  	u64 val, gpsz, npg, pa;
> > @@ -3012,10 +3012,11 @@ static int allocate_vpe_l1_table(void)
> >  
> >  out:
> >  	gicr_write_vpropbaser(val, vlpi_base + GICR_VPROPBASER);
> > -	cpumask_set_cpu(smp_processor_id(), gic_data_rdist()->vpe_table_mask);
> > +	cpumask_set_cpu(cpu, gic_data_rdist()->vpe_table_mask);
> > +	dsb(sy);
> >  
> >  	pr_debug("CPU%d: VPROPBASER = %llx %*pbl\n",
> > -		 smp_processor_id(), val,
> > +		 cpu, val,
> >  		 cpumask_pr_args(gic_data_rdist()->vpe_table_mask));
> >  
> >  	return 0;
> > @@ -3264,15 +3265,9 @@ static void its_cpu_init_lpis(void)
> >  		val = its_clear_vpend_valid(vlpi_base, 0, 0);
> >  	}
> >  
> > -	if (allocate_vpe_l1_table()) {
> > -		/*
> > -		 * If the allocation has failed, we're in massive trouble.
> > -		 * Disable direct injection, and pray that no VM was
> > -		 * already running...
> > -		 */
> > -		gic_rdists->has_rvpeid = false;
> > -		gic_rdists->has_vlpis = false;
> > -	}
> > +	if (smp_processor_id() == 0)
> > +		cpuhp_setup_state(CPUHP_AP_ONLINE_DYN, "irqchip/arm/gicv3:vpe",
> > +				  allocate_vpe_l1_table, NULL);
> 
> If you move it the online state then you could also
> s/GFP_ATOMIC/GFP_KERNEL.
> 
> Also previously you checked the error code set has_rvpeid, has_vlpis on
> failure. Now you you should the same in case of a failure during
> registration.
> This also happens happens on CPU hotplug and I don't see how you avoid a
> second allocation. But I also don't understand why this registrations
> happens on CPU0. It might be just a test patch…

It's just a test hack. There is way more things that would need to
change in order to cope with moving this to CPUHP, but I want
confirmation that this indeed solves the original issue before I start
breaking more things.

Thanks,

	M.

-- 
Without deviation from the norm, progress is not possible.

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Thomas Gleixner]

On Sun, Jan 11 2026 at 18:02, Waiman Long wrote:
> On 1/11/26 5:38 AM, Marc Zyngier wrote:
>>> Also that patch seems to be incomplete because there is another
>>> allocation further down in allocate_vpe_l1_table()....
>> Yeah, I wondered why page allocation wasn't affected by this issue,
>> but didn't try to find out.
>
> The use of GFP_ATOMIC flag in the page allocation request may help it to 
> dip into the reserved area and avoid taking any spinlock. In my own 
> test, just removing the kzalloc() call is enough to avoid any invalid 
> context warning. In the page allocation code, there is a zone lock and a 
> per_cpu_pages lock. They were not acquired in my particular test case, 
> though further investigation may be needed to make sure it is really safe.

They might be acquired though. Only alloc_pages_nolock() guarantees that
no lock is taken IIRC.

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Waiman Long]

On 1/12/26 10:09 AM, Thomas Gleixner wrote:
> On Sun, Jan 11 2026 at 18:02, Waiman Long wrote:
>> On 1/11/26 5:38 AM, Marc Zyngier wrote:
>>>> Also that patch seems to be incomplete because there is another
>>>> allocation further down in allocate_vpe_l1_table()....
>>> Yeah, I wondered why page allocation wasn't affected by this issue,
>>> but didn't try to find out.
>> The use of GFP_ATOMIC flag in the page allocation request may help it to
>> dip into the reserved area and avoid taking any spinlock. In my own
>> test, just removing the kzalloc() call is enough to avoid any invalid
>> context warning. In the page allocation code, there is a zone lock and a
>> per_cpu_pages lock. They were not acquired in my particular test case,
>> though further investigation may be needed to make sure it is really safe.
> They might be acquired though. Only alloc_pages_nolock() guarantees that
> no lock is taken IIRC.

Thanks for the suggestion. I will look into using that for page 
allocation. I had actually attempt to use kmalloc_nolock() to replace 
kzalloc() initially. Even though it removed the call to rmqueue(), but 
there were other spinlocks in the slub code that were still being 
acquired like the local_lock() or the spinlock in the get_random() code. 
So I gave up using that. Anyway, kmalloc_nolock() doesn't seem to be 
fully working yet.

Cheers,
Longman

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Sebastian Andrzej Siewior]

On 2026-01-12 12:14:30 [-0500], Waiman Long wrote:
> On 1/12/26 10:09 AM, Thomas Gleixner wrote:
> > They might be acquired though. Only alloc_pages_nolock() guarantees that
> > no lock is taken IIRC.
> 
> Thanks for the suggestion. I will look into using that for page allocation.
> I had actually attempt to use kmalloc_nolock() to replace kzalloc()
> initially. Even though it removed the call to rmqueue(), but there were
> other spinlocks in the slub code that were still being acquired like the
> local_lock() or the spinlock in the get_random() code. So I gave up using
> that. Anyway, kmalloc_nolock() doesn't seem to be fully working yet.

with kmalloc_nolock() you have to be able to deal with a NULL pointer.
Looking at kmalloc_nolock(), it has this (in_nmi() || in_hardirq())
check on PREEMPT_RT. The reasoning was unconditional raw_spinlock_t
locking and bad lock-owner recording for hardirq.
There was a trylock path for local_lock to make it work from atomic
context. But from what I can tell this goes
  kmalloc_nolock_noprof() -> __slab_alloc_node() -> __slab_alloc() ->
  ___slab_alloc() -> local_lock_cpu_slab()

The last one does local_lock_irqsave() on PREEMPT_RT which does a
spin_lock(). That means atomic context is not possible. Where did I make
a wrong turn? Or did this change recently? I do remember that Alexei
reworked parts of the allocator to make the local_lock based trylock
allocation work.

> Cheers,
> Longman

Sebastian

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Alexei Starovoitov]

On Tue, Jan 13, 2026 at 3:55 AM Sebastian Andrzej Siewior
<bigeasy@linutronix.de> wrote:
>
> On 2026-01-12 12:14:30 [-0500], Waiman Long wrote:
> > On 1/12/26 10:09 AM, Thomas Gleixner wrote:
> > > They might be acquired though. Only alloc_pages_nolock() guarantees that
> > > no lock is taken IIRC.
> >
> > Thanks for the suggestion. I will look into using that for page allocation.
> > I had actually attempt to use kmalloc_nolock() to replace kzalloc()
> > initially. Even though it removed the call to rmqueue(), but there were
> > other spinlocks in the slub code that were still being acquired like the
> > local_lock() or the spinlock in the get_random() code. So I gave up using
> > that. Anyway, kmalloc_nolock() doesn't seem to be fully working yet.
>
> with kmalloc_nolock() you have to be able to deal with a NULL pointer.
> Looking at kmalloc_nolock(), it has this (in_nmi() || in_hardirq())
> check on PREEMPT_RT. The reasoning was unconditional raw_spinlock_t
> locking and bad lock-owner recording for hardirq.
> There was a trylock path for local_lock to make it work from atomic
> context. But from what I can tell this goes
>   kmalloc_nolock_noprof() -> __slab_alloc_node() -> __slab_alloc() ->
>   ___slab_alloc() -> local_lock_cpu_slab()
>
> The last one does local_lock_irqsave() on PREEMPT_RT which does a
> spin_lock(). That means atomic context is not possible. Where did I make
> a wrong turn? Or did this change recently? I do remember that Alexei
> reworked parts of the allocator to make the local_lock based trylock
> allocation work.

Are you forgetting about local_lock_is_locked() in __slab_alloc() ?
With sheaves the whole thing will be very different.

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Sebastian Andrzej Siewior]

On 2026-01-13 15:25:26 [-0800], Alexei Starovoitov wrote:
> On Tue, Jan 13, 2026 at 3:55 AM Sebastian Andrzej Siewior
> <bigeasy@linutronix.de> wrote:
> > The last one does local_lock_irqsave() on PREEMPT_RT which does a
> > spin_lock(). That means atomic context is not possible. Where did I make
> > a wrong turn? Or did this change recently? I do remember that Alexei
> > reworked parts of the allocator to make the local_lock based trylock
> > allocation work.
> 
> Are you forgetting about local_lock_is_locked() in __slab_alloc() ?

Yeah but this just checks it. Further down the road there is
local_lock_cpu_slab() for the allocation and there is no try-lock on RT.

> With sheaves the whole thing will be very different.
Yes.

Sebastian

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Vlastimil Babka]

On 1/13/26 12:55, Sebastian Andrzej Siewior wrote:
> On 2026-01-12 12:14:30 [-0500], Waiman Long wrote:
>> On 1/12/26 10:09 AM, Thomas Gleixner wrote:
>> > They might be acquired though. Only alloc_pages_nolock() guarantees that
>> > no lock is taken IIRC.
>> 
>> Thanks for the suggestion. I will look into using that for page allocation.
>> I had actually attempt to use kmalloc_nolock() to replace kzalloc()
>> initially. Even though it removed the call to rmqueue(), but there were
>> other spinlocks in the slub code that were still being acquired like the
>> local_lock() or the spinlock in the get_random() code. So I gave up using

Hmm if get_random() code takes a spinlock, we have an unsolved
incompatibility with kmalloc_nolock() and CONFIG_SLAB_FREELIST_RANDOM.

>> that. Anyway, kmalloc_nolock() doesn't seem to be fully working yet.
> 
> with kmalloc_nolock() you have to be able to deal with a NULL pointer.

Yes. So even after we fix the current problems with incompatible context, I
think kmalloc_nolock() would still be a bad fit for hw bringup code that
should not really fail. Because the possibility of failure will always
exist. The BPF use case that motivated it is quite different.

> Looking at kmalloc_nolock(), it has this (in_nmi() || in_hardirq())
> check on PREEMPT_RT. The reasoning was unconditional raw_spinlock_t
> locking and bad lock-owner recording for hardirq.
> There was a trylock path for local_lock to make it work from atomic
> context. But from what I can tell this goes
>   kmalloc_nolock_noprof() -> __slab_alloc_node() -> __slab_alloc() ->
>   ___slab_alloc() -> local_lock_cpu_slab()
> 
> The last one does local_lock_irqsave() on PREEMPT_RT which does a
> spin_lock(). That means atomic context is not possible. Where did I make
> a wrong turn? Or did this change recently? I do remember that Alexei
> reworked parts of the allocator to make the local_lock based trylock
> allocation work.
> 
>> Cheers,
>> Longman
> 
> Sebastian

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Marc Zyngier]

On Mon, 12 Jan 2026 11:20:07 +0000,
Marc Zyngier <maz@kernel.org> wrote:
> 
> On Sun, 11 Jan 2026 16:20:45 +0000,
> Thomas Gleixner <tglx@kernel.org> wrote:
> > 
> > On Sun, Jan 11 2026 at 10:38, Marc Zyngier wrote:
> > > On Sun, 11 Jan 2026 09:39:07 +0000,
> > > Thomas Gleixner <tglx@kernel.org> wrote:
> > >> 
> > >> On Fri, Jan 09 2026 at 16:13, Marc Zyngier wrote:
> > >> > On Thu, 08 Jan 2026 22:11:33 +0000,
> > >> > Thomas Gleixner <tglx@kernel.org> wrote:
> > >> >> At the point where a CPU is brought up, the topology should be known
> > >> >> already, which means this can be allocated on the control CPU _before_
> > >> >> the new CPU comes up, no?
> > >> >
> > >> > No. Each CPU finds *itself* in the forest of redistributors, and from
> > >> > there tries to find whether it has some shared resource with a CPU
> > >> > that has booted before it. That's because firmware is absolutely awful
> > >> > and can't present a consistent view of the system.
> > >> 
> > >> Groan....
> > >>
> > >> > Anyway, I expect it could be solved by moving this part of the init to
> > >> > an ONLINE HP callback.
> > >> 
> > >> Which needs to be before CPUHP_AP_IRQ_AFFINITY_ONLINE, but even that
> > >> might be to late because there are callbacks in the STARTING section,
> > >> i.e. timer, perf, which might rely on interrupts being accessible.
> > >
> > > Nah. This stuff is only for direct injection of vLPIs into guests, so
> > > as long as this is done before we can schedule a vcpu on this physical
> > > CPU, we're good. No physical interrupt is concerned with this code.
> > 
> > That's fine then. vCPUs are considered "user-space" tasks and can't be
> > scheduled before CPUHP_AP_ACTIVE sets the CPU active for the scheduler.
> 
> Waiman, can you please give the following hack a go on your box? The
> machines I have are thankfully limited to a single ITS group, so I
> can't directly reproduce your issue.

Have you managed to try this hack? I may be able to spend some time
addressing the issue in the next cycle if I have an indication that
I'm on the right track.

Thanks,

	M.

-- 
Without deviation from the norm, progress is not possible.

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Waiman Long]

On 1/14/26 12:59 PM, Vlastimil Babka wrote:
> On 1/13/26 12:55, Sebastian Andrzej Siewior wrote:
>> On 2026-01-12 12:14:30 [-0500], Waiman Long wrote:
>>> On 1/12/26 10:09 AM, Thomas Gleixner wrote:
>>>> They might be acquired though. Only alloc_pages_nolock() guarantees that
>>>> no lock is taken IIRC.
>>> Thanks for the suggestion. I will look into using that for page allocation.
>>> I had actually attempt to use kmalloc_nolock() to replace kzalloc()
>>> initially. Even though it removed the call to rmqueue(), but there were
>>> other spinlocks in the slub code that were still being acquired like the
>>> local_lock() or the spinlock in the get_random() code. So I gave up using
> Hmm if get_random() code takes a spinlock, we have an unsolved
> incompatibility with kmalloc_nolock() and CONFIG_SLAB_FREELIST_RANDOM.
>
>>> that. Anyway, kmalloc_nolock() doesn't seem to be fully working yet.
>> with kmalloc_nolock() you have to be able to deal with a NULL pointer.
> Yes. So even after we fix the current problems with incompatible context, I
> think kmalloc_nolock() would still be a bad fit for hw bringup code that
> should not really fail. Because the possibility of failure will always
> exist. The BPF use case that motivated it is quite different.

Yes, it is an issue too that kmalloc_nolock() may fail. If that happens, 
we don't have another good alternative.

Cheers,
Longman

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Waiman Long]

On 1/21/26 3:38 AM, Marc Zyngier wrote:
> On Mon, 12 Jan 2026 11:20:07 +0000,
> Marc Zyngier <maz@kernel.org> wrote:
>> On Sun, 11 Jan 2026 16:20:45 +0000,
>> Thomas Gleixner <tglx@kernel.org> wrote:
>>> On Sun, Jan 11 2026 at 10:38, Marc Zyngier wrote:
>>>> On Sun, 11 Jan 2026 09:39:07 +0000,
>>>> Thomas Gleixner <tglx@kernel.org> wrote:
>>>>> On Fri, Jan 09 2026 at 16:13, Marc Zyngier wrote:
>>>>>> On Thu, 08 Jan 2026 22:11:33 +0000,
>>>>>> Thomas Gleixner <tglx@kernel.org> wrote:
>>>>>>> At the point where a CPU is brought up, the topology should be known
>>>>>>> already, which means this can be allocated on the control CPU _before_
>>>>>>> the new CPU comes up, no?
>>>>>> No. Each CPU finds *itself* in the forest of redistributors, and from
>>>>>> there tries to find whether it has some shared resource with a CPU
>>>>>> that has booted before it. That's because firmware is absolutely awful
>>>>>> and can't present a consistent view of the system.
>>>>> Groan....
>>>>>
>>>>>> Anyway, I expect it could be solved by moving this part of the init to
>>>>>> an ONLINE HP callback.
>>>>> Which needs to be before CPUHP_AP_IRQ_AFFINITY_ONLINE, but even that
>>>>> might be to late because there are callbacks in the STARTING section,
>>>>> i.e. timer, perf, which might rely on interrupts being accessible.
>>>> Nah. This stuff is only for direct injection of vLPIs into guests, so
>>>> as long as this is done before we can schedule a vcpu on this physical
>>>> CPU, we're good. No physical interrupt is concerned with this code.
>>> That's fine then. vCPUs are considered "user-space" tasks and can't be
>>> scheduled before CPUHP_AP_ACTIVE sets the CPU active for the scheduler.
>> Waiman, can you please give the following hack a go on your box? The
>> machines I have are thankfully limited to a single ITS group, so I
>> can't directly reproduce your issue.
> Have you managed to try this hack? I may be able to spend some time
> addressing the issue in the next cycle if I have an indication that
> I'm on the right track.

I am sorry that I was busy working on other stuff. Will try out the hack 
today and report back ASAP.

Cheers,
Longman

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Waiman Long]

On 1/21/26 3:38 AM, Marc Zyngier wrote:
> On Mon, 12 Jan 2026 11:20:07 +0000,
> Marc Zyngier <maz@kernel.org> wrote:
>> On Sun, 11 Jan 2026 16:20:45 +0000,
>> Thomas Gleixner <tglx@kernel.org> wrote:
>>> On Sun, Jan 11 2026 at 10:38, Marc Zyngier wrote:
>>>> On Sun, 11 Jan 2026 09:39:07 +0000,
>>>> Thomas Gleixner <tglx@kernel.org> wrote:
>>>>> On Fri, Jan 09 2026 at 16:13, Marc Zyngier wrote:
>>>>>> On Thu, 08 Jan 2026 22:11:33 +0000,
>>>>>> Thomas Gleixner <tglx@kernel.org> wrote:
>>>>>>> At the point where a CPU is brought up, the topology should be known
>>>>>>> already, which means this can be allocated on the control CPU _before_
>>>>>>> the new CPU comes up, no?
>>>>>> No. Each CPU finds *itself* in the forest of redistributors, and from
>>>>>> there tries to find whether it has some shared resource with a CPU
>>>>>> that has booted before it. That's because firmware is absolutely awful
>>>>>> and can't present a consistent view of the system.
>>>>> Groan....
>>>>>
>>>>>> Anyway, I expect it could be solved by moving this part of the init to
>>>>>> an ONLINE HP callback.
>>>>> Which needs to be before CPUHP_AP_IRQ_AFFINITY_ONLINE, but even that
>>>>> might be to late because there are callbacks in the STARTING section,
>>>>> i.e. timer, perf, which might rely on interrupts being accessible.
>>>> Nah. This stuff is only for direct injection of vLPIs into guests, so
>>>> as long as this is done before we can schedule a vcpu on this physical
>>>> CPU, we're good. No physical interrupt is concerned with this code.
>>> That's fine then. vCPUs are considered "user-space" tasks and can't be
>>> scheduled before CPUHP_AP_ACTIVE sets the CPU active for the scheduler.
>> Waiman, can you please give the following hack a go on your box? The
>> machines I have are thankfully limited to a single ITS group, so I
>> can't directly reproduce your issue.
> Have you managed to try this hack? I may be able to spend some time
> addressing the issue in the next cycle if I have an indication that
> I'm on the right track.

Yes, I have tried out your hack patch and the 2-socket Grace test system 
booted up without producing any bug report for a RT debug kernel. I will 
try out your official patch once it come out. So moving the memory 
allocation to a later part of the hotplug bringup pipeline where 
sleeping is allowed should work.

Cheers,
Longman

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Waiman Long]

[-- Attachment #1: Type: text/plain, Size: 798 bytes --]


On 1/21/26 3:41 PM, Waiman Long wrote:
>
>>> Waiman, can you please give the following hack a go on your box? The
>>> machines I have are thankfully limited to a single ITS group, so I
>>> can't directly reproduce your issue.
>> Have you managed to try this hack? I may be able to spend some time
>> addressing the issue in the next cycle if I have an indication that
>> I'm on the right track.
>
> Yes, I have tried out your hack patch and the 2-socket Grace test 
> system booted up without producing any bug report for a RT debug 
> kernel. I will try out your official patch once it come out. So moving 
> the memory allocation to a later part of the hotplug bringup pipeline 
> where sleeping is allowed should work. 

Attaching the dmesg log for your further investigation.

Cheers,
Longman

[-- Attachment #2: dmesg.log --]
[-- Type: text/x-log, Size: 198417 bytes --]

[    0.000000] Booting Linux on physical CPU 0x0000020000 [0x410fd4f0]
[    0.000000] Linux version 6.19.0-rc6-test+ (llong@nvidia-grace-grace-03.khw.eng.rdu2.dc.redhat.com) (gcc (GCC) 11.5.0 20240719 (Red Hat 11.5.0-14), GNU ld version 2.35.2-69.el9) #5 SMP PREEMPT_RT Wed Jan 21 22:25:23 EST 2026
[    0.000000] KASLR disabled due to lack of seed
[    0.000000] efi: EFI v2.9 by American Megatrends
[    0.000000] efi: RTPROP=0x3c565be398 ACPI 2.0=0x3c47180018 SMBIOS 3.0=0x3c565b5a18 MEMATTR=0x3c521c9018 ESRT=0x3c521db898 MOKvar=0x3c55d90000 MEMRESERVE=0x3c47193a18 
[    0.000000] esrt: Reserving ESRT space from 0x0000003c521db898 to 0x0000003c521db8f8.
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x0000003C47180018 000024 (v02 NVIDIA)
[    0.000000] ACPI: XSDT 0x0000003C4718E998 00015C (v01 NVIDIA SMCI--MB 00000001 AMI  00000001)
[    0.000000] ACPI: FACP 0x0000003C4718F898 000114 (v06 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: DSDT 0x0000003C47180098 001D80 (v02 NVIDIA SMCI--MB 00000001 INTL 20220331)
[    0.000000] ACPI: FIDT 0x0000003C4718FE98 00009C (v01 NVIDIA SMCI--MB 01072009 AMI  00010013)
[    0.000000] ACPI: SPMI 0x0000003C4718FF98 000041 (v05 NVIDIA SMCI--MB 00000000 AMI. 00000000)
[    0.000000] ACPI: SDEI 0x0000003C4718FA98 000024 (v01 NVIDIA SMCI--MB 00000001 NVDA 00000001)
[    0.000000] ACPI: HEST 0x0000003C47187518 000E2C (v01 NVIDIA SMCI--MB 00000001 NVDA 00000001)
[    0.000000] ACPI: BERT 0x0000003C4718FD98 000030 (v01 NVIDIA SMCI--MB 00000001 NVDA 00000001)
[    0.000000] ACPI: EINJ 0x0000003C4718FB18 000170 (v01 NVIDIA SMCI--MB 00000001 NVDA 00000001)
[    0.000000] ACPI: ERST 0x0000003C4718F418 000290 (v01 NVIDIA SMCI--MB 00000001 NVDA 00000001)
[    0.000000] ACPI: FPDT 0x0000003C4718FE18 000034 (v01 NVIDIA T241c2   00000001 AMI  00000001)
[    0.000000] ACPI: BGRT 0x0000003C4718F818 000038 (v01 NVIDIA SMCI--MB 01072009 AMI  00010013)
[    0.000000] ACPI: GTDT 0x0000003C4718CE18 000084 (v03 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: APIC 0x0000003C47188618 002EAC (v06 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: PPTT 0x0000003C47182D18 0041E0 (v03 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: SSDT 0x0000003C47120018 00CE32 (v02 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: SPCR 0x0000003C4718E918 000050 (v02 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: SSDT 0x0000003C4718E698 0000CC (v02 NVIDIA SMCI--MB 00000001 INTL 20220331)
[    0.000000] ACPI: SSDT 0x0000003C4718E018 000510 (v02 NVIDIA SMCI--MB 00000001 INTL 20220331)
[    0.000000] ACPI: SSDT 0x0000003C47110018 0017F6 (v02 NVIDIA BPMP_S0  00000001 INTL 20220331)
[    0.000000] ACPI: SSDT 0x0000003C4711D818 00180D (v02 NVIDIA BPMP_S1  00000001 INTL 20220331)
[    0.000000] ACPI: MCFG 0x0000003C4711FE18 0000FC (v01 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: SSDT 0x0000003C4711F398 000375 (v02 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: SSDT 0x0000003C4711F798 000375 (v02 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: SSDT 0x0000003C4718CF18 000378 (v02 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: SSDT 0x0000003C4718D318 000378 (v02 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: SSDT 0x0000003C4718D718 000378 (v02 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: SSDT 0x0000003C47119018 000378 (v02 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: SSDT 0x0000003C4711D198 00037C (v02 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: SSDT 0x0000003C4711C098 00037C (v02 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: SSDT 0x0000003C4711C498 00037C (v02 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: SSDT 0x0000003C4711C898 00037C (v02 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: SSDT 0x0000003C47119418 00037C (v02 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: SSDT 0x0000003C4711B398 00037C (v02 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: SSDT 0x0000003C4711B798 00037C (v02 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: IORT 0x0000003C47119818 000E5F (v06 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: MPAM 0x0000003C4718E798 0000E4 (v01 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: SRAT 0x0000003C47111B98 000AB8 (v03 NVIDIA SMCI--MB 00000001 ARMH 00010000)
[    0.000000] ACPI: SLIT 0x0000003C4711FF98 000030 (v01 NVIDIA SMCI--MB 00000001 AMI  00000001)
[    0.000000] ACPI: HMAT 0x0000003C4711BB98 0000D0 (v02 NVIDIA SMCI--MB 00000001 AMI  00000001)
[    0.000000] ACPI: APMT 0x0000003C4711BE18 000254 (v00 NVIDIA SMCI--MB 00000001 AMI  00000001)
[    0.000000] ACPI: SPCR: console: pl011,mmio32,0xc280000,115200
[    0.000000] ACPI: SRAT: Node 0 PXM 0 [mem 0x80000000-0x3c7fffffff]
[    0.000000] ACPI: SRAT: Node 1 PXM 1 [mem 0x100080000000-0x103c7fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x3c5ffe86c0-0x3c5fffffff]
[    0.000000] NODE_DATA(1) allocated [mem 0x103c34ccf6c0-0x103c34ce6fff]
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000080000000-0x00000000ffffffff]
[    0.000000]   DMA32    empty
[    0.000000]   Normal   [mem 0x0000000100000000-0x0000103c7fffffff]
[    0.000000]   Device   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000080000000-0x00000000fffcffff]
[    0.000000]   node   0: [mem 0x00000000fffd0000-0x00000000ffffffff]
[    0.000000]   node   0: [mem 0x0000000100000000-0x0000003c47134fff]
[    0.000000]   node   0: [mem 0x0000003c47135000-0x0000003c4717ffff]
[    0.000000]   node   0: [mem 0x0000003c47180000-0x0000003c47194fff]
[    0.000000]   node   0: [mem 0x0000003c47195000-0x0000003c4719bfff]
[    0.000000]   node   0: [mem 0x0000003c4719c000-0x0000003c5467ffff]
[    0.000000]   node   0: [mem 0x0000003c54680000-0x0000003c5560ffff]
[    0.000000]   node   0: [mem 0x0000003c55610000-0x0000003c559fffff]
[    0.000000]   node   0: [mem 0x0000003c55a00000-0x0000003c565bffff]
[    0.000000]   node   0: [mem 0x0000003c565c0000-0x0000003c587fffff]
[    0.000000]   node   0: [mem 0x0000003c59800000-0x0000003c599fffff]
[    0.000000]   node   0: [mem 0x0000003c59f00000-0x0000003c59fdffff]
[    0.000000]   node   0: [mem 0x0000003c5c000000-0x0000003c5fffffff]
[    0.000000]   node   1: [mem 0x0000100080000000-0x0000103c587fffff]
[    0.000000]   node   1: [mem 0x0000103c59800000-0x0000103c599fffff]
[    0.000000]   node   1: [mem 0x0000103c59c00000-0x0000103c59dfffff]
[    0.000000]   node   1: [mem 0x0000103c59f00000-0x0000103c59fdffff]
[    0.000000]   node   1: [mem 0x0000103c5c000000-0x0000103c7fffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x0000003c5fffffff]
[    0.000000] Initmem setup node 1 [mem 0x0000100080000000-0x0000103c7fffffff]
[    0.000000] On node 0, zone Normal: 4096 pages in unavailable ranges
[    0.000000] On node 0, zone Normal: 1280 pages in unavailable ranges
[    0.000000] On node 0, zone Normal: 8224 pages in unavailable ranges
[    0.000000] On node 1, zone Normal: 4096 pages in unavailable ranges
[    0.000000] On node 1, zone Normal: 512 pages in unavailable ranges
[    0.000000] On node 1, zone Normal: 256 pages in unavailable ranges
[    0.000000] On node 1, zone Normal: 8224 pages in unavailable ranges
[    0.000000] crashkernel reserved: 0x00000000d2800000 - 0x00000000ffe00000 (726 MB)
[    0.000000] KernelAddressSanitizer initialized (generic)
[    0.000000] psci: probing for conduit method from ACPI.
[    0.000000] psci: PSCIv1.1 detected in firmware.
[    0.000000] psci: Using standard PSCI v0.2 function IDs
[    0.000000] psci: MIGRATE_INFO_TYPE not supported.
[    0.000000] psci: SMC Calling Convention v1.2
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x20000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x40000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x50000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x60000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x70000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x80000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x90000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0xa0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0xb0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0xe0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x100000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x110000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x120000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x130000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x140000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x150000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x160000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x170000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x180000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x190000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x1a0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x1c0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x1d0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x1e0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x1f0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x200000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x210000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x220000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x230000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x240000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x250000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x260000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x270000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x280000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x290000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x2a0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x2b0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x2c0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x2d0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x2e0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x2f0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x300000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x310000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x320000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x330000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x340000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x350000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x360000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x370000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x380000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x3a0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x3b0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x3c0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x3d0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x3e0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x3f0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x400000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x410000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x420000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x430000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x440000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x460000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x480000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x490000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x4a0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x4b0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x4c0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x4d0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x4e0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x4f0000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x500000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x510000 -> Node 0
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100020000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100030000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100040000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100050000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100060000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100070000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100080000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100090000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1000a0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1000b0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1000e0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100100000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100110000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100120000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100130000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100140000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100150000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100160000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100170000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100180000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100190000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1001a0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1001c0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1001d0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1001e0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1001f0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100200000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100210000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100220000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100230000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100240000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100250000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100260000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100270000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100280000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100290000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1002a0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1002b0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1002c0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1002d0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1002e0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1002f0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100300000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100310000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100320000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100330000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100340000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100350000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100360000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100370000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100380000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1003a0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1003b0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1003c0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1003d0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1003e0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1003f0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100400000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100410000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100420000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100430000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100440000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100460000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100480000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100490000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1004a0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1004b0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1004c0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1004d0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1004e0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x1004f0000 -> Node 1
[    0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x100500000 -> Node 1
[    0.000000] percpu: Embedded 487 pages/cpu s1956512 r8192 d30048 u1994752
[    0.000000] pcpu-alloc: s1956512 r8192 d30048 u1994752 alloc=487*4096
[    0.000000] pcpu-alloc: [0] 000 [0] 001 [0] 002 [0] 003 
[    0.000000] pcpu-alloc: [0] 004 [0] 005 [0] 006 [0] 007 
[    0.000000] pcpu-alloc: [0] 008 [0] 009 [0] 010 [0] 011 
[    0.000000] pcpu-alloc: [0] 012 [0] 013 [0] 014 [0] 015 
[    0.000000] pcpu-alloc: [0] 016 [0] 017 [0] 018 [0] 019 
[    0.000000] pcpu-alloc: [0] 020 [0] 021 [0] 022 [0] 023 
[    0.000000] pcpu-alloc: [0] 024 [0] 025 [0] 026 [0] 027 
[    0.000000] pcpu-alloc: [0] 028 [0] 029 [0] 030 [0] 031 
[    0.000000] pcpu-alloc: [0] 032 [0] 033 [0] 034 [0] 035 
[    0.000000] pcpu-alloc: [0] 036 [0] 037 [0] 038 [0] 039 
[    0.000000] pcpu-alloc: [0] 040 [0] 041 [0] 042 [0] 043 
[    0.000000] pcpu-alloc: [0] 044 [0] 045 [0] 046 [0] 047 
[    0.000000] pcpu-alloc: [0] 048 [0] 049 [0] 050 [0] 051 
[    0.000000] pcpu-alloc: [0] 052 [0] 053 [0] 054 [0] 055 
[    0.000000] pcpu-alloc: [0] 056 [0] 057 [0] 058 [0] 059 
[    0.000000] pcpu-alloc: [0] 060 [0] 061 [0] 062 [0] 063 
[    0.000000] pcpu-alloc: [0] 064 [0] 065 [0] 066 [0] 067 
[    0.000000] pcpu-alloc: [0] 068 [0] 069 [0] 070 [0] 071 
[    0.000000] pcpu-alloc: [1] 072 [1] 073 [1] 074 [1] 075 
[    0.000000] pcpu-alloc: [1] 076 [1] 077 [1] 078 [1] 079 
[    0.000000] pcpu-alloc: [1] 080 [1] 081 [1] 082 [1] 083 
[    0.000000] pcpu-alloc: [1] 084 [1] 085 [1] 086 [1] 087 
[    0.000000] pcpu-alloc: [1] 088 [1] 089 [1] 090 [1] 091 
[    0.000000] pcpu-alloc: [1] 092 [1] 093 [1] 094 [1] 095 
[    0.000000] pcpu-alloc: [1] 096 [1] 097 [1] 098 [1] 099 
[    0.000000] pcpu-alloc: [1] 100 [1] 101 [1] 102 [1] 103 
[    0.000000] pcpu-alloc: [1] 104 [1] 105 [1] 106 [1] 107 
[    0.000000] pcpu-alloc: [1] 108 [1] 109 [1] 110 [1] 111 
[    0.000000] pcpu-alloc: [1] 112 [1] 113 [1] 114 [1] 115 
[    0.000000] pcpu-alloc: [1] 116 [1] 117 [1] 118 [1] 119 
[    0.000000] pcpu-alloc: [1] 120 [1] 121 [1] 122 [1] 123 
[    0.000000] pcpu-alloc: [1] 124 [1] 125 [1] 126 [1] 127 
[    0.000000] pcpu-alloc: [1] 128 [1] 129 [1] 130 [1] 131 
[    0.000000] pcpu-alloc: [1] 132 [1] 133 [1] 134 [1] 135 
[    0.000000] pcpu-alloc: [1] 136 [1] 137 [1] 138 [1] 139 
[    0.000000] pcpu-alloc: [1] 140 [1] 141 [1] 142 [1] 143 
[    0.000000] Detected PIPT I-cache on CPU0
[    0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)
[    0.000000] CPU features: detected: GICv3 CPU interface
[    0.000000] CPU features: detected: Virtualization Host Extensions
[    0.000000] CPU features: detected: Spectre-v4
[    0.000000] CPU features: detected: Spectre-BHB
[    0.000000] CPU features: detected: SSBS not fully self-synchronizing
[    0.000000] alternatives: applying boot alternatives
[    0.000000] Kernel command line: BOOT_IMAGE=(hd0,gpt2)/vmlinuz-6.19.0-rc6-test+ root=/dev/mapper/rhel_nvidia--grace--grace--03-root ro crashkernel=1G-4G:406M,4G-64G:470M,64G-:726M rd.lvm.lv=rhel_nvidia-grace-grace-03/root rd.lvm.lv=rhel_nvidia-grace-grace-03/swap
[    0.000000] printk: log_buf_len individual max cpu contribution: 4096 bytes
[    0.000000] printk: log_buf_len total cpu_extra contributions: 585728 bytes
[    0.000000] printk: log_buf_len min size: 1048576 bytes
[    0.000000] printk: log buffer data + meta data: 2097152 + 7340032 = 9437184 bytes
[    0.000000] printk: early log buf free: 1028768(98%)
[    0.000000] software IO TLB: area num 256.
[    0.000000] software IO TLB: mapped [mem 0x00000000ce800000-0x00000000d2800000] (64MB)
[    0.000000] Fallback order for Node 0: 0 1 
[    0.000000] Fallback order for Node 1: 1 0 
[    0.000000] Built 2 zonelists, mobility grouping on.  Total pages: 125671360
[    0.000000] Policy zone: Normal
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] stackdepot: allocating hash table via alloc_large_system_hash
[    0.000000] stackdepot hash table entries: 1048576 (order: 12, 16777216 bytes, linear)
[    0.000000] stackdepot: allocating space for 8192 stack pools via memblock
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=144, Nodes=2
[    0.000000] kmemleak: Kernel memory leak detector disabled
[    0.000000] allocated 1005584384 bytes of page_ext
[    0.000000] ftrace: allocating 60615 entries in 240 pages
[    0.000000] ftrace: allocated 240 pages with 4 groups
[    0.000000] Dynamic Preempt: full
[    0.000000] Running RCU self tests
[    0.000000] Running RCU synchronous self tests
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] rcu: 	RCU event tracing is enabled.
[    0.000000] rcu: 	RCU lockdep checking is enabled.
[    0.000000] rcu: 	RCU restricting CPUs from NR_CPUS=4096 to nr_cpu_ids=144.
[    0.000000] rcu: 	RCU priority boosting: priority 1 delay 500 ms.
[    0.000000] rcu: 	RCU callback double-/use-after-free debug is enabled.
[    0.000000] rcu: 	RCU_SOFTIRQ processing moved to rcuc kthreads.
[    0.000000] 	No expedited grace period (rcu_normal_after_boot).
[    0.000000] 	Trampoline variant of Tasks RCU enabled.
[    0.000000] 	Rude variant of Tasks RCU enabled.
[    0.000000] 	Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=144
[    0.000000] Running RCU synchronous self tests
[    0.000000] RCU Tasks: Setting shift to 8 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=144.
[    0.000000] RCU Tasks Rude: Setting shift to 8 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=144.
[    0.000000] RCU Tasks Trace: Setting shift to 8 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=144.
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GICv3: GIC: Using split EOI/Deactivate mode
[    0.000000] GIC: enabling workaround for GICv3: ARM64 erratum 2941627
[    0.000000] GICv3: 960 SPIs implemented
[    0.000000] GICv3: 320 Extended SPIs implemented
[    0.000000] Root IRQ handler: gic_handle_irq
[    0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI
[    0.000000] GICv3: GICv4 features: DirectLPI RVPEID Valid+Dirty 
[    0.000000] GICv3: GICD_CTLR.DS=0, SCR_EL3.FIQ=1
[    0.000000] GICv3: CPU0: found redistributor 20000 region 0:0x0000000022100000
[    0.000000] SRAT: PXM 0 -> ITS 0 -> Node 0
[    0.000000] SRAT: PXM 1 -> ITS 1 -> Node 1
[    0.000000] ITS [mem 0x22040000-0x2205ffff]
[    0.000000] ITS@0x0000000022040000: Single VMOVP capable
[    0.000000] ITS@0x0000000022040000: Using GICv4.1 mode 00000000 00000001
[    0.000000] ITS@0x0000000022040000: allocated 8192 Devices @11f130000 (indirect, esz 8, psz 64K, shr 1)
[    0.000000] ITS@0x0000000022040000: allocated 32768 Interrupt Collections @11f140000 (flat, esz 2, psz 64K, shr 1)
[    0.000000] ITS@0x0000000022040000: allocated 16384 Virtual CPUs @11f160000 (flat, esz 8, psz 64K, shr 1)
[    0.000000] ITS [mem 0x100022040000-0x10002205ffff]
[    0.000000] ITS@0x0000100022040000: Single VMOVP capable
[    0.000000] ITS@0x0000100022040000: Using GICv4.1 mode 01000000 00000001
[    0.000000] ITS@0x0000100022040000: allocated 8192 Devices @10009e330000 (indirect, esz 8, psz 64K, shr 1)
[    0.000000] ITS@0x0000100022040000: allocated 32768 Interrupt Collections @10009e340000 (flat, esz 2, psz 64K, shr 1)
[    0.000000] ITS@0x0000100022040000: allocated 16384 Virtual CPUs @10009e360000 (flat, esz 8, psz 64K, shr 1)
[    0.000000] GICv3: using LPI property table @0x000000011f180000
[    0.000000] ITS: Using DirectLPI for VPE invalidation
[    0.000000] ITS: Enabling GICv4 support
[    0.000000] GICv3: CPU0: using allocated LPI pending table @0x000000011f190000
[    0.000000] rcu: srcu_init: Setting srcu_struct sizes to big.
[    0.000000] arch_timer: cp15 timer running at 1000.00MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[    0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns
[    0.005656] Console: colour dummy device 80x25
[    0.005720] Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar
[    0.005722] ... MAX_LOCKDEP_SUBCLASSES:  8
[    0.005723] ... MAX_LOCK_DEPTH:          48
[    0.005725] ... MAX_LOCKDEP_KEYS:        8192
[    0.005726] ... CLASSHASH_SIZE:          4096
[    0.005727] ... MAX_LOCKDEP_ENTRIES:     262144
[    0.005728] ... MAX_LOCKDEP_CHAINS:      1048576
[    0.005729] ... CHAINHASH_SIZE:          524288
[    0.005730]  memory used by lock dependency info: 64065 kB
[    0.005732]  memory used for stack traces: 8320 kB
[    0.005733]  per task-struct memory footprint: 2688 bytes
[    0.006970] ACPI: Core revision 20250807
[    0.011631] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=10000000)
[    0.011638] pid_max: default: 147456 minimum: 1152
[    0.020013] landlock: Up and running.
[    0.020016] Yama: becoming mindful.
[    0.020086] SELinux:  Initializing.
[    0.027108] LSM support for eBPF active
[    0.044895] Dentry cache hash table entries: 16777216 (order: 15, 134217728 bytes, vmalloc hugepage)
[    0.053079] Inode-cache hash table entries: 8388608 (order: 14, 67108864 bytes, vmalloc hugepage)
[    0.055115] Mount-cache hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc hugepage)
[    0.055350] Mountpoint-cache hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc hugepage)
[    0.067241] Running RCU synchronous self tests
[    0.067252] Running RCU synchronous self tests
[    0.090266] rcu: Hierarchical SRCU implementation.
[    0.090270] rcu: 	Max phase no-delay instances is 1000.
[    0.100407] Timer migration: 4 hierarchy levels; 8 children per group; 3 crossnode level
[    0.121969] fsl-mc MSI: ITS@0x22040000 domain created
[    0.121990] fsl-mc MSI: ITS@0x100022040000 domain created
[    0.122034] Remapping and enabling EFI services.
[    0.140291] smp: Bringing up secondary CPUs ...
[    0.211863] Detected PIPT I-cache on CPU1
[    0.211908] GICv3: CPU1: found redistributor 40000 region 0:0x0000000022180000
[    0.211916] GICv3: CPU1: using allocated LPI pending table @0x000000011f1a0000
[    0.211981] CPU1: Booted secondary processor 0x0000040000 [0x410fd4f0]
[    0.281883] Detected PIPT I-cache on CPU2
[    0.281905] GICv3: CPU2: found redistributor 50000 region 0:0x00000000221c0000
[    0.281912] GICv3: CPU2: using allocated LPI pending table @0x000000011f1b0000
[    0.281955] CPU2: Booted secondary processor 0x0000050000 [0x410fd4f0]
[    0.351930] Detected PIPT I-cache on CPU3
[    0.351953] GICv3: CPU3: found redistributor 60000 region 0:0x0000000022200000
[    0.351959] GICv3: CPU3: using allocated LPI pending table @0x000000011f1c0000
[    0.351999] CPU3: Booted secondary processor 0x0000060000 [0x410fd4f0]
[    0.421972] Detected PIPT I-cache on CPU4
[    0.421997] GICv3: CPU4: found redistributor 70000 region 0:0x0000000022240000
[    0.422002] GICv3: CPU4: using allocated LPI pending table @0x000000011f1d0000
[    0.422048] CPU4: Booted secondary processor 0x0000070000 [0x410fd4f0]
[    0.492097] Detected PIPT I-cache on CPU5
[    0.492125] GICv3: CPU5: found redistributor 80000 region 0:0x0000000022280000
[    0.492131] GICv3: CPU5: using allocated LPI pending table @0x000000011f1e0000
[    0.492174] CPU5: Booted secondary processor 0x0000080000 [0x410fd4f0]
[    0.562139] Detected PIPT I-cache on CPU6
[    0.562165] GICv3: CPU6: found redistributor 90000 region 0:0x00000000222c0000
[    0.562171] GICv3: CPU6: using allocated LPI pending table @0x000000011f1f0000
[    0.562212] CPU6: Booted secondary processor 0x0000090000 [0x410fd4f0]
[    0.632253] Detected PIPT I-cache on CPU7
[    0.632282] GICv3: CPU7: found redistributor a0000 region 0:0x0000000022300000
[    0.632288] GICv3: CPU7: using allocated LPI pending table @0x000000011f200000
[    0.632328] CPU7: Booted secondary processor 0x00000a0000 [0x410fd4f0]
[    0.702346] Detected PIPT I-cache on CPU8
[    0.702375] GICv3: CPU8: found redistributor b0000 region 0:0x0000000022340000
[    0.702381] GICv3: CPU8: using allocated LPI pending table @0x000000011f210000
[    0.702417] CPU8: Booted secondary processor 0x00000b0000 [0x410fd4f0]
[    0.772177] Detected PIPT I-cache on CPU9
[    0.772209] GICv3: CPU9: found redistributor e0000 region 0:0x0000000022400000
[    0.772215] GICv3: CPU9: using allocated LPI pending table @0x000000011f220000
[    0.772258] CPU9: Booted secondary processor 0x00000e0000 [0x410fd4f0]
[    0.842331] Detected PIPT I-cache on CPU10
[    0.842360] GICv3: CPU10: found redistributor 100000 region 0:0x0000000022480000
[    0.842367] GICv3: CPU10: using allocated LPI pending table @0x000000011f230000
[    0.842411] CPU10: Booted secondary processor 0x0000100000 [0x410fd4f0]
[    0.912375] Detected PIPT I-cache on CPU11
[    0.912406] GICv3: CPU11: found redistributor 110000 region 0:0x00000000224c0000
[    0.912413] GICv3: CPU11: using allocated LPI pending table @0x000000011f240000
[    0.912454] CPU11: Booted secondary processor 0x0000110000 [0x410fd4f0]
[    0.982494] Detected PIPT I-cache on CPU12
[    0.982527] GICv3: CPU12: found redistributor 120000 region 0:0x0000000022500000
[    0.982532] GICv3: CPU12: using allocated LPI pending table @0x000000011f250000
[    0.982568] CPU12: Booted secondary processor 0x0000120000 [0x410fd4f0]
[    1.052551] Detected PIPT I-cache on CPU13
[    1.052585] GICv3: CPU13: found redistributor 130000 region 0:0x0000000022540000
[    1.052591] GICv3: CPU13: using allocated LPI pending table @0x000000011f260000
[    1.052625] CPU13: Booted secondary processor 0x0000130000 [0x410fd4f0]
[    1.122719] Detected PIPT I-cache on CPU14
[    1.122752] GICv3: CPU14: found redistributor 140000 region 0:0x0000000022580000
[    1.122758] GICv3: CPU14: using allocated LPI pending table @0x000000011f270000
[    1.122800] CPU14: Booted secondary processor 0x0000140000 [0x410fd4f0]
[    1.192769] Detected PIPT I-cache on CPU15
[    1.192801] GICv3: CPU15: found redistributor 150000 region 0:0x00000000225c0000
[    1.192807] GICv3: CPU15: using allocated LPI pending table @0x000000011f280000
[    1.192850] CPU15: Booted secondary processor 0x0000150000 [0x410fd4f0]
[    1.272859] Detected PIPT I-cache on CPU16
[    1.272896] GICv3: CPU16: found redistributor 160000 region 0:0x0000000022600000
[    1.272902] GICv3: CPU16: using allocated LPI pending table @0x000000011f290000
[    1.272945] CPU16: Booted secondary processor 0x0000160000 [0x410fd4f0]
[    1.342891] Detected PIPT I-cache on CPU17
[    1.342926] GICv3: CPU17: found redistributor 170000 region 0:0x0000000022640000
[    1.342932] GICv3: CPU17: using allocated LPI pending table @0x000000011f2a0000
[    1.342977] CPU17: Booted secondary processor 0x0000170000 [0x410fd4f0]
[    1.413019] Detected PIPT I-cache on CPU18
[    1.413057] GICv3: CPU18: found redistributor 180000 region 0:0x0000000022680000
[    1.413064] GICv3: CPU18: using allocated LPI pending table @0x000000011f2b0000
[    1.413102] CPU18: Booted secondary processor 0x0000180000 [0x410fd4f0]
[    1.483070] Detected PIPT I-cache on CPU19
[    1.483104] GICv3: CPU19: found redistributor 190000 region 0:0x00000000226c0000
[    1.483110] GICv3: CPU19: using allocated LPI pending table @0x000000011f2c0000
[    1.483148] CPU19: Booted secondary processor 0x0000190000 [0x410fd4f0]
[    1.553194] Detected PIPT I-cache on CPU20
[    1.553232] GICv3: CPU20: found redistributor 1a0000 region 0:0x0000000022700000
[    1.553239] GICv3: CPU20: using allocated LPI pending table @0x000000011f2d0000
[    1.553279] CPU20: Booted secondary processor 0x00001a0000 [0x410fd4f0]
[    1.623064] Detected PIPT I-cache on CPU21
[    1.623102] GICv3: CPU21: found redistributor 1c0000 region 0:0x0000000022780000
[    1.623108] GICv3: CPU21: using allocated LPI pending table @0x000000011f2e0000
[    1.623152] CPU21: Booted secondary processor 0x00001c0000 [0x410fd4f0]
[    1.693152] Detected PIPT I-cache on CPU22
[    1.693193] GICv3: CPU22: found redistributor 1d0000 region 0:0x00000000227c0000
[    1.693199] GICv3: CPU22: using allocated LPI pending table @0x000000011f2f0000
[    1.693244] CPU22: Booted secondary processor 0x00001d0000 [0x410fd4f0]
[    1.763290] Detected PIPT I-cache on CPU23
[    1.763330] GICv3: CPU23: found redistributor 1e0000 region 0:0x0000000022800000
[    1.763337] GICv3: CPU23: using allocated LPI pending table @0x000000011f300000
[    1.763380] CPU23: Booted secondary processor 0x00001e0000 [0x410fd4f0]
[    1.833347] Detected PIPT I-cache on CPU24
[    1.833385] GICv3: CPU24: found redistributor 1f0000 region 0:0x0000000022840000
[    1.833391] GICv3: CPU24: using allocated LPI pending table @0x000000011f310000
[    1.833436] CPU24: Booted secondary processor 0x00001f0000 [0x410fd4f0]
[    1.903448] Detected PIPT I-cache on CPU25
[    1.903487] GICv3: CPU25: found redistributor 200000 region 0:0x0000000022880000
[    1.903494] GICv3: CPU25: using allocated LPI pending table @0x000000011f320000
[    1.903536] CPU25: Booted secondary processor 0x0000200000 [0x410fd4f0]
[    1.973536] Detected PIPT I-cache on CPU26
[    1.973573] GICv3: CPU26: found redistributor 210000 region 0:0x00000000228c0000
[    1.973580] GICv3: CPU26: using allocated LPI pending table @0x000000011f330000
[    1.973624] CPU26: Booted secondary processor 0x0000210000 [0x410fd4f0]
[    2.043615] Detected PIPT I-cache on CPU27
[    2.043659] GICv3: CPU27: found redistributor 220000 region 0:0x0000000022900000
[    2.043665] GICv3: CPU27: using allocated LPI pending table @0x000000011f340000
[    2.043700] CPU27: Booted secondary processor 0x0000220000 [0x410fd4f0]
[    2.113705] Detected PIPT I-cache on CPU28
[    2.113746] GICv3: CPU28: found redistributor 230000 region 0:0x0000000022940000
[    2.113753] GICv3: CPU28: using allocated LPI pending table @0x000000011f350000
[    2.113790] CPU28: Booted secondary processor 0x0000230000 [0x410fd4f0]
[    2.183791] Detected PIPT I-cache on CPU29
[    2.183832] GICv3: CPU29: found redistributor 240000 region 0:0x0000000022980000
[    2.183839] GICv3: CPU29: using allocated LPI pending table @0x000000011f360000
[    2.183882] CPU29: Booted secondary processor 0x0000240000 [0x410fd4f0]
[    2.253856] Detected PIPT I-cache on CPU30
[    2.253896] GICv3: CPU30: found redistributor 250000 region 0:0x00000000229c0000
[    2.253904] GICv3: CPU30: using allocated LPI pending table @0x000000011f370000
[    2.253950] CPU30: Booted secondary processor 0x0000250000 [0x410fd4f0]
[    2.323987] Detected PIPT I-cache on CPU31
[    2.324032] GICv3: CPU31: found redistributor 260000 region 0:0x0000000022a00000
[    2.324040] GICv3: CPU31: using allocated LPI pending table @0x000000011f380000
[    2.324083] CPU31: Booted secondary processor 0x0000260000 [0x410fd4f0]
[    2.404032] Detected PIPT I-cache on CPU32
[    2.404079] GICv3: CPU32: found redistributor 270000 region 0:0x0000000022a40000
[    2.404085] GICv3: CPU32: using allocated LPI pending table @0x000000011f390000
[    2.404128] CPU32: Booted secondary processor 0x0000270000 [0x410fd4f0]
[    2.474136] Detected PIPT I-cache on CPU33
[    2.474181] GICv3: CPU33: found redistributor 280000 region 0:0x0000000022a80000
[    2.474188] GICv3: CPU33: using allocated LPI pending table @0x000000011f3a0000
[    2.474232] CPU33: Booted secondary processor 0x0000280000 [0x410fd4f0]
[    2.544274] Detected PIPT I-cache on CPU34
[    2.544319] GICv3: CPU34: found redistributor 290000 region 0:0x0000000022ac0000
[    2.544326] GICv3: CPU34: using allocated LPI pending table @0x000000011f3b0000
[    2.544365] CPU34: Booted secondary processor 0x0000290000 [0x410fd4f0]
[    2.614093] Detected PIPT I-cache on CPU35
[    2.614144] GICv3: CPU35: found redistributor 2a0000 region 0:0x0000000022b00000
[    2.614151] GICv3: CPU35: using allocated LPI pending table @0x000000011f3c0000
[    2.614190] CPU35: Booted secondary processor 0x00002a0000 [0x410fd4f0]
[    2.684199] Detected PIPT I-cache on CPU36
[    2.684252] GICv3: CPU36: found redistributor 2b0000 region 0:0x0000000022b40000
[    2.684259] GICv3: CPU36: using allocated LPI pending table @0x000000011f3d0000
[    2.684296] CPU36: Booted secondary processor 0x00002b0000 [0x410fd4f0]
[    2.754293] Detected PIPT I-cache on CPU37
[    2.754342] GICv3: CPU37: found redistributor 2c0000 region 0:0x0000000022b80000
[    2.754349] GICv3: CPU37: using allocated LPI pending table @0x000000011f3e0000
[    2.754392] CPU37: Booted secondary processor 0x00002c0000 [0x410fd4f0]
[    2.824363] Detected PIPT I-cache on CPU38
[    2.824407] GICv3: CPU38: found redistributor 2d0000 region 0:0x0000000022bc0000
[    2.824414] GICv3: CPU38: using allocated LPI pending table @0x000000011f3f0000
[    2.824457] CPU38: Booted secondary processor 0x00002d0000 [0x410fd4f0]
[    2.894482] Detected PIPT I-cache on CPU39
[    2.894527] GICv3: CPU39: found redistributor 2e0000 region 0:0x0000000022c00000
[    2.894534] GICv3: CPU39: using allocated LPI pending table @0x000000011f400000
[    2.894577] CPU39: Booted secondary processor 0x00002e0000 [0x410fd4f0]
[    2.964550] Detected PIPT I-cache on CPU40
[    2.964597] GICv3: CPU40: found redistributor 2f0000 region 0:0x0000000022c40000
[    2.964603] GICv3: CPU40: using allocated LPI pending table @0x000000011f410000
[    2.964644] CPU40: Booted secondary processor 0x00002f0000 [0x410fd4f0]
[    3.034642] Detected PIPT I-cache on CPU41
[    3.034692] GICv3: CPU41: found redistributor 300000 region 0:0x0000000022c80000
[    3.034700] GICv3: CPU41: using allocated LPI pending table @0x000000011f420000
[    3.034743] CPU41: Booted secondary processor 0x0000300000 [0x410fd4f0]
[    3.104714] Detected PIPT I-cache on CPU42
[    3.104763] GICv3: CPU42: found redistributor 310000 region 0:0x0000000022cc0000
[    3.104770] GICv3: CPU42: using allocated LPI pending table @0x000000011f430000
[    3.104806] CPU42: Booted secondary processor 0x0000310000 [0x410fd4f0]
[    3.174809] Detected PIPT I-cache on CPU43
[    3.174858] GICv3: CPU43: found redistributor 320000 region 0:0x0000000022d00000
[    3.174866] GICv3: CPU43: using allocated LPI pending table @0x000000011f440000
[    3.174908] CPU43: Booted secondary processor 0x0000320000 [0x410fd4f0]
[    3.244885] Detected PIPT I-cache on CPU44
[    3.244936] GICv3: CPU44: found redistributor 330000 region 0:0x0000000022d40000
[    3.244944] GICv3: CPU44: using allocated LPI pending table @0x000000011f450000
[    3.244981] CPU44: Booted secondary processor 0x0000330000 [0x410fd4f0]
[    3.314977] Detected PIPT I-cache on CPU45
[    3.315030] GICv3: CPU45: found redistributor 340000 region 0:0x0000000022d80000
[    3.315037] GICv3: CPU45: using allocated LPI pending table @0x000000011f460000
[    3.315078] CPU45: Booted secondary processor 0x0000340000 [0x410fd4f0]
[    3.385048] Detected PIPT I-cache on CPU46
[    3.385093] GICv3: CPU46: found redistributor 350000 region 0:0x0000000022dc0000
[    3.385100] GICv3: CPU46: using allocated LPI pending table @0x000000011f470000
[    3.385137] CPU46: Booted secondary processor 0x0000350000 [0x410fd4f0]
[    3.455187] Detected PIPT I-cache on CPU47
[    3.455239] GICv3: CPU47: found redistributor 360000 region 0:0x0000000022e00000
[    3.455246] GICv3: CPU47: using allocated LPI pending table @0x000000011f480000
[    3.455291] CPU47: Booted secondary processor 0x0000360000 [0x410fd4f0]
[    3.535255] Detected PIPT I-cache on CPU48
[    3.535304] GICv3: CPU48: found redistributor 370000 region 0:0x0000000022e40000
[    3.535311] GICv3: CPU48: using allocated LPI pending table @0x000000011f490000
[    3.535347] CPU48: Booted secondary processor 0x0000370000 [0x410fd4f0]
[    3.605090] Detected PIPT I-cache on CPU49
[    3.605143] GICv3: CPU49: found redistributor 380000 region 0:0x0000000022e80000
[    3.605150] GICv3: CPU49: using allocated LPI pending table @0x000000011f4a0000
[    3.605186] CPU49: Booted secondary processor 0x0000380000 [0x410fd4f0]
[    3.675245] Detected PIPT I-cache on CPU50
[    3.675294] GICv3: CPU50: found redistributor 3a0000 region 0:0x0000000022f00000
[    3.675302] GICv3: CPU50: using allocated LPI pending table @0x000000011f4b0000
[    3.675338] CPU50: Booted secondary processor 0x00003a0000 [0x410fd4f0]
[    3.745303] Detected PIPT I-cache on CPU51
[    3.745357] GICv3: CPU51: found redistributor 3b0000 region 0:0x0000000022f40000
[    3.745364] GICv3: CPU51: using allocated LPI pending table @0x000000011f4c0000
[    3.745402] CPU51: Booted secondary processor 0x00003b0000 [0x410fd4f0]
[    3.815407] Detected PIPT I-cache on CPU52
[    3.815462] GICv3: CPU52: found redistributor 3c0000 region 0:0x0000000022f80000
[    3.815470] GICv3: CPU52: using allocated LPI pending table @0x000000011f4d0000
[    3.815514] CPU52: Booted secondary processor 0x00003c0000 [0x410fd4f0]
[    3.885469] Detected PIPT I-cache on CPU53
[    3.885524] GICv3: CPU53: found redistributor 3d0000 region 0:0x0000000022fc0000
[    3.885533] GICv3: CPU53: using allocated LPI pending table @0x000000011f4e0000
[    3.885574] CPU53: Booted secondary processor 0x00003d0000 [0x410fd4f0]
[    3.955564] Detected PIPT I-cache on CPU54
[    3.955620] GICv3: CPU54: found redistributor 3e0000 region 0:0x0000000023000000
[    3.955628] GICv3: CPU54: using allocated LPI pending table @0x000000011f4f0000
[    3.955666] CPU54: Booted secondary processor 0x00003e0000 [0x410fd4f0]
[    4.025654] Detected PIPT I-cache on CPU55
[    4.025709] GICv3: CPU55: found redistributor 3f0000 region 0:0x0000000023040000
[    4.025717] GICv3: CPU55: using allocated LPI pending table @0x000000011f500000
[    4.025753] CPU55: Booted secondary processor 0x00003f0000 [0x410fd4f0]
[    4.095745] Detected PIPT I-cache on CPU56
[    4.095801] GICv3: CPU56: found redistributor 400000 region 0:0x0000000023080000
[    4.095807] GICv3: CPU56: using allocated LPI pending table @0x000000011f510000
[    4.095847] CPU56: Booted secondary processor 0x0000400000 [0x410fd4f0]
[    4.166068] Detected PIPT I-cache on CPU57
[    4.166126] GICv3: CPU57: found redistributor 410000 region 0:0x00000000230c0000
[    4.166132] GICv3: CPU57: using allocated LPI pending table @0x000000011f520000
[    4.166169] CPU57: Booted secondary processor 0x0000410000 [0x410fd4f0]
[    4.235935] Detected PIPT I-cache on CPU58
[    4.235990] GICv3: CPU58: found redistributor 420000 region 0:0x0000000023100000
[    4.235998] GICv3: CPU58: using allocated LPI pending table @0x000000011f530000
[    4.236036] CPU58: Booted secondary processor 0x0000420000 [0x410fd4f0]
[    4.306011] Detected PIPT I-cache on CPU59
[    4.306065] GICv3: CPU59: found redistributor 430000 region 0:0x0000000023140000
[    4.306072] GICv3: CPU59: using allocated LPI pending table @0x000000011f540000
[    4.306112] CPU59: Booted secondary processor 0x0000430000 [0x410fd4f0]
[    4.376121] Detected PIPT I-cache on CPU60
[    4.376178] GICv3: CPU60: found redistributor 440000 region 0:0x0000000023180000
[    4.376186] GICv3: CPU60: using allocated LPI pending table @0x000000011f550000
[    4.376221] CPU60: Booted secondary processor 0x0000440000 [0x410fd4f0]
[    4.446016] Detected PIPT I-cache on CPU61
[    4.446072] GICv3: CPU61: found redistributor 460000 region 0:0x0000000023200000
[    4.446080] GICv3: CPU61: using allocated LPI pending table @0x000000011f560000
[    4.446120] CPU61: Booted secondary processor 0x0000460000 [0x410fd4f0]
[    4.516115] Detected PIPT I-cache on CPU62
[    4.516166] GICv3: CPU62: found redistributor 480000 region 0:0x0000000023280000
[    4.516174] GICv3: CPU62: using allocated LPI pending table @0x000000011f570000
[    4.516212] CPU62: Booted secondary processor 0x0000480000 [0x410fd4f0]
[    4.586185] Detected PIPT I-cache on CPU63
[    4.586236] GICv3: CPU63: found redistributor 490000 region 0:0x00000000232c0000
[    4.586243] GICv3: CPU63: using allocated LPI pending table @0x000000011f580000
[    4.586281] CPU63: Booted secondary processor 0x0000490000 [0x410fd4f0]
[    4.666284] Detected PIPT I-cache on CPU64
[    4.666335] GICv3: CPU64: found redistributor 4a0000 region 0:0x0000000023300000
[    4.666341] GICv3: CPU64: using allocated LPI pending table @0x000000011f590000
[    4.666384] CPU64: Booted secondary processor 0x00004a0000 [0x410fd4f0]
[    4.736361] Detected PIPT I-cache on CPU65
[    4.736417] GICv3: CPU65: found redistributor 4b0000 region 0:0x0000000023340000
[    4.736424] GICv3: CPU65: using allocated LPI pending table @0x000000011f5a0000
[    4.736459] CPU65: Booted secondary processor 0x00004b0000 [0x410fd4f0]
[    4.806464] Detected PIPT I-cache on CPU66
[    4.806513] GICv3: CPU66: found redistributor 4c0000 region 0:0x0000000023380000
[    4.806519] GICv3: CPU66: using allocated LPI pending table @0x000000011f5b0000
[    4.806558] CPU66: Booted secondary processor 0x00004c0000 [0x410fd4f0]
[    4.876518] Detected PIPT I-cache on CPU67
[    4.876569] GICv3: CPU67: found redistributor 4d0000 region 0:0x00000000233c0000
[    4.876576] GICv3: CPU67: using allocated LPI pending table @0x000000011f5c0000
[    4.876614] CPU67: Booted secondary processor 0x00004d0000 [0x410fd4f0]
[    4.946631] Detected PIPT I-cache on CPU68
[    4.946682] GICv3: CPU68: found redistributor 4e0000 region 0:0x0000000023400000
[    4.946689] GICv3: CPU68: using allocated LPI pending table @0x000000011f5d0000
[    4.946729] CPU68: Booted secondary processor 0x00004e0000 [0x410fd4f0]
[    5.016715] Detected PIPT I-cache on CPU69
[    5.016765] GICv3: CPU69: found redistributor 4f0000 region 0:0x0000000023440000
[    5.016772] GICv3: CPU69: using allocated LPI pending table @0x000000011f5e0000
[    5.016810] CPU69: Booted secondary processor 0x00004f0000 [0x410fd4f0]
[    5.086797] Detected PIPT I-cache on CPU70
[    5.086850] GICv3: CPU70: found redistributor 500000 region 0:0x0000000023480000
[    5.086858] GICv3: CPU70: using allocated LPI pending table @0x000000011f5f0000
[    5.086899] CPU70: Booted secondary processor 0x0000500000 [0x410fd4f0]
[    5.156874] Detected PIPT I-cache on CPU71
[    5.156933] GICv3: CPU71: found redistributor 510000 region 0:0x00000000234c0000
[    5.156941] GICv3: CPU71: using allocated LPI pending table @0x000000011f600000
[    5.156980] CPU71: Booted secondary processor 0x0000510000 [0x410fd4f0]
[    5.230291] Detected PIPT I-cache on CPU72
[    5.230455] GICv3: CPU72: found redistributor 100020000 region 1:0x0000100022100000
[    5.230469] GICv3: CPU72: using allocated LPI pending table @0x000000011f610000
[    5.230550] CPU72: Booted secondary processor 0x0100020000 [0x410fd4f0]
[    5.300266] Detected PIPT I-cache on CPU73
[    5.300358] GICv3: CPU73: found redistributor 100030000 region 1:0x0000100022140000
[    5.300369] GICv3: CPU73: using allocated LPI pending table @0x000000011f620000
[    5.300421] CPU73: Booted secondary processor 0x0100030000 [0x410fd4f0]
[    5.370320] Detected PIPT I-cache on CPU74
[    5.370409] GICv3: CPU74: found redistributor 100040000 region 1:0x0000100022180000
[    5.370418] GICv3: CPU74: using allocated LPI pending table @0x000000011f630000
[    5.370472] CPU74: Booted secondary processor 0x0100040000 [0x410fd4f0]
[    5.440423] Detected PIPT I-cache on CPU75
[    5.440513] GICv3: CPU75: found redistributor 100050000 region 1:0x00001000221c0000
[    5.440523] GICv3: CPU75: using allocated LPI pending table @0x000000011f640000
[    5.440572] CPU75: Booted secondary processor 0x0100050000 [0x410fd4f0]
[    5.510450] Detected PIPT I-cache on CPU76
[    5.510541] GICv3: CPU76: found redistributor 100060000 region 1:0x0000100022200000
[    5.510550] GICv3: CPU76: using allocated LPI pending table @0x000000011f650000
[    5.510600] CPU76: Booted secondary processor 0x0100060000 [0x410fd4f0]
[    5.580529] Detected PIPT I-cache on CPU77
[    5.580618] GICv3: CPU77: found redistributor 100070000 region 1:0x0000100022240000
[    5.580629] GICv3: CPU77: using allocated LPI pending table @0x000000011f660000
[    5.580677] CPU77: Booted secondary processor 0x0100070000 [0x410fd4f0]
[    5.650703] Detected PIPT I-cache on CPU78
[    5.650790] GICv3: CPU78: found redistributor 100080000 region 1:0x0000100022280000
[    5.650800] GICv3: CPU78: using allocated LPI pending table @0x000000011f670000
[    5.650849] CPU78: Booted secondary processor 0x0100080000 [0x410fd4f0]
[    5.720741] Detected PIPT I-cache on CPU79
[    5.720832] GICv3: CPU79: found redistributor 100090000 region 1:0x00001000222c0000
[    5.720842] GICv3: CPU79: using allocated LPI pending table @0x000000011f680000
[    5.720890] CPU79: Booted secondary processor 0x0100090000 [0x410fd4f0]
[    5.800873] Detected PIPT I-cache on CPU80
[    5.800965] GICv3: CPU80: found redistributor 1000a0000 region 1:0x0000100022300000
[    5.800975] GICv3: CPU80: using allocated LPI pending table @0x000000011f690000
[    5.801024] CPU80: Booted secondary processor 0x01000a0000 [0x410fd4f0]
[    5.870930] Detected PIPT I-cache on CPU81
[    5.871023] GICv3: CPU81: found redistributor 1000b0000 region 1:0x0000100022340000
[    5.871035] GICv3: CPU81: using allocated LPI pending table @0x000000011f6a0000
[    5.871082] CPU81: Booted secondary processor 0x01000b0000 [0x410fd4f0]
[    5.940940] Detected PIPT I-cache on CPU82
[    5.941032] GICv3: CPU82: found redistributor 1000e0000 region 1:0x0000100022400000
[    5.941042] GICv3: CPU82: using allocated LPI pending table @0x000000011f6b0000
[    5.941090] CPU82: Booted secondary processor 0x01000e0000 [0x410fd4f0]
[    6.011042] Detected PIPT I-cache on CPU83
[    6.011136] GICv3: CPU83: found redistributor 100100000 region 1:0x0000100022480000
[    6.011147] GICv3: CPU83: using allocated LPI pending table @0x000000011f6c0000
[    6.011193] CPU83: Booted secondary processor 0x0100100000 [0x410fd4f0]
[    6.081120] Detected PIPT I-cache on CPU84
[    6.081210] GICv3: CPU84: found redistributor 100110000 region 1:0x00001000224c0000
[    6.081218] GICv3: CPU84: using allocated LPI pending table @0x000000011f6d0000
[    6.081264] CPU84: Booted secondary processor 0x0100110000 [0x410fd4f0]
[    6.151195] Detected PIPT I-cache on CPU85
[    6.151287] GICv3: CPU85: found redistributor 100120000 region 1:0x0000100022500000
[    6.151296] GICv3: CPU85: using allocated LPI pending table @0x000000011f6e0000
[    6.151343] CPU85: Booted secondary processor 0x0100120000 [0x410fd4f0]
[    6.221267] Detected PIPT I-cache on CPU86
[    6.221361] GICv3: CPU86: found redistributor 100130000 region 1:0x0000100022540000
[    6.221370] GICv3: CPU86: using allocated LPI pending table @0x000000011f6f0000
[    6.221413] CPU86: Booted secondary processor 0x0100130000 [0x410fd4f0]
[    6.291322] Detected PIPT I-cache on CPU87
[    6.291416] GICv3: CPU87: found redistributor 100140000 region 1:0x0000100022580000
[    6.291426] GICv3: CPU87: using allocated LPI pending table @0x000000011f700000
[    6.291472] CPU87: Booted secondary processor 0x0100140000 [0x410fd4f0]
[    6.361396] Detected PIPT I-cache on CPU88
[    6.361488] GICv3: CPU88: found redistributor 100150000 region 1:0x00001000225c0000
[    6.361497] GICv3: CPU88: using allocated LPI pending table @0x000000011f710000
[    6.361543] CPU88: Booted secondary processor 0x0100150000 [0x410fd4f0]
[    6.431577] Detected PIPT I-cache on CPU89
[    6.431669] GICv3: CPU89: found redistributor 100160000 region 1:0x0000100022600000
[    6.431678] GICv3: CPU89: using allocated LPI pending table @0x000000011f720000
[    6.431725] CPU89: Booted secondary processor 0x0100160000 [0x410fd4f0]
[    6.501617] Detected PIPT I-cache on CPU90
[    6.501710] GICv3: CPU90: found redistributor 100170000 region 1:0x0000100022640000
[    6.501718] GICv3: CPU90: using allocated LPI pending table @0x000000011f730000
[    6.501766] CPU90: Booted secondary processor 0x0100170000 [0x410fd4f0]
[    6.571715] Detected PIPT I-cache on CPU91
[    6.571807] GICv3: CPU91: found redistributor 100180000 region 1:0x0000100022680000
[    6.571816] GICv3: CPU91: using allocated LPI pending table @0x000000011f740000
[    6.571861] CPU91: Booted secondary processor 0x0100180000 [0x410fd4f0]
[    6.641808] Detected PIPT I-cache on CPU92
[    6.641902] GICv3: CPU92: found redistributor 100190000 region 1:0x00001000226c0000
[    6.641911] GICv3: CPU92: using allocated LPI pending table @0x000000011f750000
[    6.641958] CPU92: Booted secondary processor 0x0100190000 [0x410fd4f0]
[    6.711920] Detected PIPT I-cache on CPU93
[    6.712019] GICv3: CPU93: found redistributor 1001a0000 region 1:0x0000100022700000
[    6.712029] GICv3: CPU93: using allocated LPI pending table @0x000000011f760000
[    6.712078] CPU93: Booted secondary processor 0x01001a0000 [0x410fd4f0]
[    6.781824] Detected PIPT I-cache on CPU94
[    6.781921] GICv3: CPU94: found redistributor 1001c0000 region 1:0x0000100022780000
[    6.781929] GICv3: CPU94: using allocated LPI pending table @0x000000011f770000
[    6.781974] CPU94: Booted secondary processor 0x01001c0000 [0x410fd4f0]
[    6.851896] Detected PIPT I-cache on CPU95
[    6.851991] GICv3: CPU95: found redistributor 1001d0000 region 1:0x00001000227c0000
[    6.852000] GICv3: CPU95: using allocated LPI pending table @0x000000011f780000
[    6.852046] CPU95: Booted secondary processor 0x01001d0000 [0x410fd4f0]
[    6.932011] Detected PIPT I-cache on CPU96
[    6.932104] GICv3: CPU96: found redistributor 1001e0000 region 1:0x0000100022800000
[    6.932113] GICv3: CPU96: using allocated LPI pending table @0x000000011f790000
[    6.932159] CPU96: Booted secondary processor 0x01001e0000 [0x410fd4f0]
[    7.002088] Detected PIPT I-cache on CPU97
[    7.002180] GICv3: CPU97: found redistributor 1001f0000 region 1:0x0000100022840000
[    7.002189] GICv3: CPU97: using allocated LPI pending table @0x000000011f7a0000
[    7.002236] CPU97: Booted secondary processor 0x01001f0000 [0x410fd4f0]
[    7.072174] Detected PIPT I-cache on CPU98
[    7.072269] GICv3: CPU98: found redistributor 100200000 region 1:0x0000100022880000
[    7.072278] GICv3: CPU98: using allocated LPI pending table @0x000000011f7b0000
[    7.072325] CPU98: Booted secondary processor 0x0100200000 [0x410fd4f0]
[    7.142228] Detected PIPT I-cache on CPU99
[    7.142325] GICv3: CPU99: found redistributor 100210000 region 1:0x00001000228c0000
[    7.142334] GICv3: CPU99: using allocated LPI pending table @0x000000011f7c0000
[    7.142380] CPU99: Booted secondary processor 0x0100210000 [0x410fd4f0]
[    7.212293] Detected PIPT I-cache on CPU100
[    7.212385] GICv3: CPU100: found redistributor 100220000 region 1:0x0000100022900000
[    7.212394] GICv3: CPU100: using allocated LPI pending table @0x000000011f7d0000
[    7.212442] CPU100: Booted secondary processor 0x0100220000 [0x410fd4f0]
[    7.282363] Detected PIPT I-cache on CPU101
[    7.282461] GICv3: CPU101: found redistributor 100230000 region 1:0x0000100022940000
[    7.282471] GICv3: CPU101: using allocated LPI pending table @0x000000011f7e0000
[    7.282521] CPU101: Booted secondary processor 0x0100230000 [0x410fd4f0]
[    7.352494] Detected PIPT I-cache on CPU102
[    7.352591] GICv3: CPU102: found redistributor 100240000 region 1:0x0000100022980000
[    7.352600] GICv3: CPU102: using allocated LPI pending table @0x000000011f7f0000
[    7.352647] CPU102: Booted secondary processor 0x0100240000 [0x410fd4f0]
[    7.422612] Detected PIPT I-cache on CPU103
[    7.422708] GICv3: CPU103: found redistributor 100250000 region 1:0x00001000229c0000
[    7.422717] GICv3: CPU103: using allocated LPI pending table @0x000000011f800000
[    7.422766] CPU103: Booted secondary processor 0x0100250000 [0x410fd4f0]
[    7.514383] Detected PIPT I-cache on CPU104
[    7.514481] GICv3: CPU104: found redistributor 100260000 region 1:0x0000100022a00000
[    7.514490] GICv3: CPU104: using allocated LPI pending table @0x000000011f810000
[    7.514539] CPU104: Booted secondary processor 0x0100260000 [0x410fd4f0]
[    7.582804] Detected PIPT I-cache on CPU105
[    7.582898] GICv3: CPU105: found redistributor 100270000 region 1:0x0000100022a40000
[    7.582908] GICv3: CPU105: using allocated LPI pending table @0x000000011f820000
[    7.582957] CPU105: Booted secondary processor 0x0100270000 [0x410fd4f0]
[    7.652948] Detected PIPT I-cache on CPU106
[    7.653045] GICv3: CPU106: found redistributor 100280000 region 1:0x0000100022a80000
[    7.653054] GICv3: CPU106: using allocated LPI pending table @0x000000011f830000
[    7.653101] CPU106: Booted secondary processor 0x0100280000 [0x410fd4f0]
[    7.722997] Detected PIPT I-cache on CPU107
[    7.723093] GICv3: CPU107: found redistributor 100290000 region 1:0x0000100022ac0000
[    7.723102] GICv3: CPU107: using allocated LPI pending table @0x000000011f840000
[    7.723150] CPU107: Booted secondary processor 0x0100290000 [0x410fd4f0]
[    7.792900] Detected PIPT I-cache on CPU108
[    7.792995] GICv3: CPU108: found redistributor 1002a0000 region 1:0x0000100022b00000
[    7.793004] GICv3: CPU108: using allocated LPI pending table @0x000000011f850000
[    7.793052] CPU108: Booted secondary processor 0x01002a0000 [0x410fd4f0]
[    7.862991] Detected PIPT I-cache on CPU109
[    7.863088] GICv3: CPU109: found redistributor 1002b0000 region 1:0x0000100022b40000
[    7.863097] GICv3: CPU109: using allocated LPI pending table @0x000000011f860000
[    7.863142] CPU109: Booted secondary processor 0x01002b0000 [0x410fd4f0]
[    7.933121] Detected PIPT I-cache on CPU110
[    7.933215] GICv3: CPU110: found redistributor 1002c0000 region 1:0x0000100022b80000
[    7.933224] GICv3: CPU110: using allocated LPI pending table @0x000000011f870000
[    7.933269] CPU110: Booted secondary processor 0x01002c0000 [0x410fd4f0]
[    8.003171] Detected PIPT I-cache on CPU111
[    8.003266] GICv3: CPU111: found redistributor 1002d0000 region 1:0x0000100022bc0000
[    8.003274] GICv3: CPU111: using allocated LPI pending table @0x000000011f880000
[    8.003321] CPU111: Booted secondary processor 0x01002d0000 [0x410fd4f0]
[    8.083256] Detected PIPT I-cache on CPU112
[    8.083351] GICv3: CPU112: found redistributor 1002e0000 region 1:0x0000100022c00000
[    8.083360] GICv3: CPU112: using allocated LPI pending table @0x000000011f890000
[    8.083407] CPU112: Booted secondary processor 0x01002e0000 [0x410fd4f0]
[    8.153344] Detected PIPT I-cache on CPU113
[    8.153441] GICv3: CPU113: found redistributor 1002f0000 region 1:0x0000100022c40000
[    8.153449] GICv3: CPU113: using allocated LPI pending table @0x000000011f8a0000
[    8.153499] CPU113: Booted secondary processor 0x01002f0000 [0x410fd4f0]
[    8.223396] Detected PIPT I-cache on CPU114
[    8.223490] GICv3: CPU114: found redistributor 100300000 region 1:0x0000100022c80000
[    8.223499] GICv3: CPU114: using allocated LPI pending table @0x000000011f8b0000
[    8.223545] CPU114: Booted secondary processor 0x0100300000 [0x410fd4f0]
[    8.293449] Detected PIPT I-cache on CPU115
[    8.293545] GICv3: CPU115: found redistributor 100310000 region 1:0x0000100022cc0000
[    8.293554] GICv3: CPU115: using allocated LPI pending table @0x000000011f8c0000
[    8.293601] CPU115: Booted secondary processor 0x0100310000 [0x410fd4f0]
[    8.363601] Detected PIPT I-cache on CPU116
[    8.363699] GICv3: CPU116: found redistributor 100320000 region 1:0x0000100022d00000
[    8.363708] GICv3: CPU116: using allocated LPI pending table @0x000000011f8d0000
[    8.363755] CPU116: Booted secondary processor 0x0100320000 [0x410fd4f0]
[    8.433752] Detected PIPT I-cache on CPU117
[    8.433848] GICv3: CPU117: found redistributor 100330000 region 1:0x0000100022d40000
[    8.433857] GICv3: CPU117: using allocated LPI pending table @0x000000011f8e0000
[    8.433903] CPU117: Booted secondary processor 0x0100330000 [0x410fd4f0]
[    8.503788] Detected PIPT I-cache on CPU118
[    8.503885] GICv3: CPU118: found redistributor 100340000 region 1:0x0000100022d80000
[    8.503895] GICv3: CPU118: using allocated LPI pending table @0x000000011f8f0000
[    8.503944] CPU118: Booted secondary processor 0x0100340000 [0x410fd4f0]
[    8.573860] Detected PIPT I-cache on CPU119
[    8.573955] GICv3: CPU119: found redistributor 100350000 region 1:0x0000100022dc0000
[    8.573965] GICv3: CPU119: using allocated LPI pending table @0x000000011f900000
[    8.574013] CPU119: Booted secondary processor 0x0100350000 [0x410fd4f0]
[    8.644039] Detected PIPT I-cache on CPU120
[    8.644136] GICv3: CPU120: found redistributor 100360000 region 1:0x0000100022e00000
[    8.644146] GICv3: CPU120: using allocated LPI pending table @0x000000011f910000
[    8.644193] CPU120: Booted secondary processor 0x0100360000 [0x410fd4f0]
[    8.714055] Detected PIPT I-cache on CPU121
[    8.714155] GICv3: CPU121: found redistributor 100370000 region 1:0x0000100022e40000
[    8.714165] GICv3: CPU121: using allocated LPI pending table @0x000000011f920000
[    8.714212] CPU121: Booted secondary processor 0x0100370000 [0x410fd4f0]
[    8.783991] Detected PIPT I-cache on CPU122
[    8.784091] GICv3: CPU122: found redistributor 100380000 region 1:0x0000100022e80000
[    8.784100] GICv3: CPU122: using allocated LPI pending table @0x000000011f930000
[    8.784144] CPU122: Booted secondary processor 0x0100380000 [0x410fd4f0]
[    8.854089] Detected PIPT I-cache on CPU123
[    8.854187] GICv3: CPU123: found redistributor 1003a0000 region 1:0x0000100022f00000
[    8.854195] GICv3: CPU123: using allocated LPI pending table @0x000000011f940000
[    8.854238] CPU123: Booted secondary processor 0x01003a0000 [0x410fd4f0]
[    8.924170] Detected PIPT I-cache on CPU124
[    8.924267] GICv3: CPU124: found redistributor 1003b0000 region 1:0x0000100022f40000
[    8.924276] GICv3: CPU124: using allocated LPI pending table @0x000000011f950000
[    8.924319] CPU124: Booted secondary processor 0x01003b0000 [0x410fd4f0]
[    8.994262] Detected PIPT I-cache on CPU125
[    8.994360] GICv3: CPU125: found redistributor 1003c0000 region 1:0x0000100022f80000
[    8.994370] GICv3: CPU125: using allocated LPI pending table @0x000000011f960000
[    8.994415] CPU125: Booted secondary processor 0x01003c0000 [0x410fd4f0]
[    9.064304] Detected PIPT I-cache on CPU126
[    9.064401] GICv3: CPU126: found redistributor 1003d0000 region 1:0x0000100022fc0000
[    9.064410] GICv3: CPU126: using allocated LPI pending table @0x000000011f970000
[    9.064456] CPU126: Booted secondary processor 0x01003d0000 [0x410fd4f0]
[    9.134380] Detected PIPT I-cache on CPU127
[    9.134478] GICv3: CPU127: found redistributor 1003e0000 region 1:0x0000100023000000
[    9.134487] GICv3: CPU127: using allocated LPI pending table @0x000000011f980000
[    9.134533] CPU127: Booted secondary processor 0x01003e0000 [0x410fd4f0]
[    9.214457] Detected PIPT I-cache on CPU128
[    9.214556] GICv3: CPU128: found redistributor 1003f0000 region 1:0x0000100023040000
[    9.214564] GICv3: CPU128: using allocated LPI pending table @0x000000011f990000
[    9.214610] CPU128: Booted secondary processor 0x01003f0000 [0x410fd4f0]
[    9.284607] Detected PIPT I-cache on CPU129
[    9.284711] GICv3: CPU129: found redistributor 100400000 region 1:0x0000100023080000
[    9.284721] GICv3: CPU129: using allocated LPI pending table @0x000000011f9a0000
[    9.284769] CPU129: Booted secondary processor 0x0100400000 [0x410fd4f0]
[    9.354696] Detected PIPT I-cache on CPU130
[    9.354799] GICv3: CPU130: found redistributor 100410000 region 1:0x00001000230c0000
[    9.354807] GICv3: CPU130: using allocated LPI pending table @0x000000011f9b0000
[    9.354856] CPU130: Booted secondary processor 0x0100410000 [0x410fd4f0]
[    9.424806] Detected PIPT I-cache on CPU131
[    9.424906] GICv3: CPU131: found redistributor 100420000 region 1:0x0000100023100000
[    9.424916] GICv3: CPU131: using allocated LPI pending table @0x000000011f9c0000
[    9.424961] CPU131: Booted secondary processor 0x0100420000 [0x410fd4f0]
[    9.494852] Detected PIPT I-cache on CPU132
[    9.494956] GICv3: CPU132: found redistributor 100430000 region 1:0x0000100023140000
[    9.494965] GICv3: CPU132: using allocated LPI pending table @0x000000011f9d0000
[    9.495012] CPU132: Booted secondary processor 0x0100430000 [0x410fd4f0]
[    9.564978] Detected PIPT I-cache on CPU133
[    9.565084] GICv3: CPU133: found redistributor 100440000 region 1:0x0000100023180000
[    9.565093] GICv3: CPU133: using allocated LPI pending table @0x000000011f9e0000
[    9.565138] CPU133: Booted secondary processor 0x0100440000 [0x410fd4f0]
[    9.634919] Detected PIPT I-cache on CPU134
[    9.635019] GICv3: CPU134: found redistributor 100460000 region 1:0x0000100023200000
[    9.635028] GICv3: CPU134: using allocated LPI pending table @0x000000011f9f0000
[    9.635074] CPU134: Booted secondary processor 0x0100460000 [0x410fd4f0]
[    9.705021] Detected PIPT I-cache on CPU135
[    9.705124] GICv3: CPU135: found redistributor 100480000 region 1:0x0000100023280000
[    9.705133] GICv3: CPU135: using allocated LPI pending table @0x000000011fa00000
[    9.705179] CPU135: Booted secondary processor 0x0100480000 [0x410fd4f0]
[    9.775089] Detected PIPT I-cache on CPU136
[    9.775191] GICv3: CPU136: found redistributor 100490000 region 1:0x00001000232c0000
[    9.775200] GICv3: CPU136: using allocated LPI pending table @0x000000011fa10000
[    9.775244] CPU136: Booted secondary processor 0x0100490000 [0x410fd4f0]
[    9.845158] Detected PIPT I-cache on CPU137
[    9.845258] GICv3: CPU137: found redistributor 1004a0000 region 1:0x0000100023300000
[    9.845268] GICv3: CPU137: using allocated LPI pending table @0x000000011fa20000
[    9.845314] CPU137: Booted secondary processor 0x01004a0000 [0x410fd4f0]
[    9.915235] Detected PIPT I-cache on CPU138
[    9.915336] GICv3: CPU138: found redistributor 1004b0000 region 1:0x0000100023340000
[    9.915346] GICv3: CPU138: using allocated LPI pending table @0x000000011fa30000
[    9.915392] CPU138: Booted secondary processor 0x01004b0000 [0x410fd4f0]
[    9.985268] Detected PIPT I-cache on CPU139
[    9.985372] GICv3: CPU139: found redistributor 1004c0000 region 1:0x0000100023380000
[    9.985381] GICv3: CPU139: using allocated LPI pending table @0x000000011fa40000
[    9.985426] CPU139: Booted secondary processor 0x01004c0000 [0x410fd4f0]
[   10.055344] Detected PIPT I-cache on CPU140
[   10.055447] GICv3: CPU140: found redistributor 1004d0000 region 1:0x00001000233c0000
[   10.055456] GICv3: CPU140: using allocated LPI pending table @0x000000011fa50000
[   10.055500] CPU140: Booted secondary processor 0x01004d0000 [0x410fd4f0]
[   10.125494] Detected PIPT I-cache on CPU141
[   10.125596] GICv3: CPU141: found redistributor 1004e0000 region 1:0x0000100023400000
[   10.125606] GICv3: CPU141: using allocated LPI pending table @0x000000011fa60000
[   10.125650] CPU141: Booted secondary processor 0x01004e0000 [0x410fd4f0]
[   10.195568] Detected PIPT I-cache on CPU142
[   10.195671] GICv3: CPU142: found redistributor 1004f0000 region 1:0x0000100023440000
[   10.195681] GICv3: CPU142: using allocated LPI pending table @0x000000011fa70000
[   10.195726] CPU142: Booted secondary processor 0x01004f0000 [0x410fd4f0]
[   10.265703] Detected PIPT I-cache on CPU143
[   10.265808] GICv3: CPU143: found redistributor 100500000 region 1:0x0000100023480000
[   10.265817] GICv3: CPU143: using allocated LPI pending table @0x000000011fa80000
[   10.265863] CPU143: Booted secondary processor 0x0100500000 [0x410fd4f0]
[   10.267068] smp: Brought up 2 nodes, 144 CPUs
[   10.267077] SMP: Total of 144 processors activated.
[   10.267079] CPU: All CPU(s) started at EL2
[   10.267082] CPU features: detected: Branch Target Identification
[   10.267085] CPU features: detected: ARMv8.4 Translation Table Level
[   10.267087] CPU features: detected: Instruction cache invalidation not required for I/D coherence
[   10.267088] CPU features: detected: Data cache clean to the PoU not required for I/D coherence
[   10.267091] CPU features: detected: Common not Private translations
[   10.267093] CPU features: detected: CRC32 instructions
[   10.267094] CPU features: detected: Data cache clean to Point of Deep Persistence
[   10.267096] CPU features: detected: Data cache clean to Point of Persistence
[   10.267097] CPU features: detected: Data independent timing control (DIT)
[   10.267098] CPU features: detected: E0PD
[   10.267100] CPU features: detected: Enhanced Privileged Access Never
[   10.267102] CPU features: detected: Enhanced Virtualization Traps
[   10.267103] CPU features: detected: Generic authentication (architected QARMA5 algorithm)
[   10.267106] CPU features: detected: RCpc load-acquire (LDAPR)
[   10.267108] CPU features: detected: LSE atomic instructions
[   10.267109] CPU features: detected: Privileged Access Never
[   10.267111] CPU features: detected: PMUv3
[   10.267112] CPU features: detected: RAS Extension Support
[   10.267113] CPU features: detected: RASv1p1 Extension Support
[   10.267114] CPU features: detected: Speculation barrier (SB)
[   10.267114] CPU features: detected: Stage-2 Force Write-Back
[   10.267115] CPU features: detected: TLB range maintenance instructions
[   10.267116] CPU features: detected: XNX
[   10.267118] CPU features: detected: Memory Partitioning And Monitoring
[   10.267119] CPU features: detected: Memory Partitioning And Monitoring Virtualisation
[   10.267121] CPU features: detected: Speculative Store Bypassing Safe (SSBS)
[   10.267121] CPU features: detected: Scalable Vector Extension
[   10.268214] alternatives: applying system-wide alternatives
[   10.272684] CPU features: detected: Activity Monitors Unit (AMU) on CPU0-143
[   10.272692] CPU features: detected: ICV_DIR_EL1 trapping
[   10.272693] CPU features: detected: Hardware dirty bit management on CPU0-143
[   10.272698] SVE: maximum available vector length 16 bytes per vector
[   10.272701] SVE: default vector length 16 bytes per vector
[   10.296637] Memory: 427904528K/502685440K available (43520K kernel code, 15998K rwdata, 14996K rodata, 22912K init, 98316K bss, 73332008K reserved, 0K cma-reserved)
[   10.413741] devtmpfs: initialized
[   12.154294] Running RCU synchronous self tests
[   12.154492] Running RCU synchronous self tests
[   12.155506] Running RCU Tasks wait API self tests
[   12.367602] Running RCU Tasks Rude wait API self tests
[   12.367606] Running RCU Tasks Trace wait API self tests
[   12.533130] DMA-API: preallocated 65536 debug entries
[   12.533135] DMA-API: debugging enabled by kernel config
[   12.533141] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[   12.535571] posixtimers hash table entries: 131072 (order: 13, 19922944 bytes, vmalloc hugepage)
[   12.545310] futex hash table entries: 32768 (6291456 bytes on 2 NUMA nodes, total 12288 KiB, vmalloc).
[   12.548821] 0 pages in range for non-PLT usage
[   12.548824] 475280 pages in range for PLT usage

[   12.558379] *************************************************************
[   12.558381] **     NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE    **
[   12.558383] **                                                         **
[   12.558384] **  IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL  **
[   12.558386] **                                                         **
[   12.558387] ** This means that this kernel is built to expose internal **
[   12.558388] ** IOMMU data structures, which may compromise security on **
[   12.558390] ** your system.                                            **
[   12.558392] **                                                         **
[   12.558393] ** If you see this message and you are not debugging the   **
[   12.558395] ** kernel, report this immediately to your vendor!         **
[   12.558395] **                                                         **
[   12.558396] **     NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE    **
[   12.558398] *************************************************************
[   12.559185] SMBIOS 3.6.0 present.
[   12.559191] DMI: Supermicro ARS-221GL-NR-01/G1SMH, BIOS 2.0 07/12/2024
[   12.559292] DMI: Memory slots populated: 2/2
[   12.569674] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[   12.576334] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations
[   12.576708] Callback from call_rcu_tasks_trace() invoked.
[   12.576961] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[   12.577589] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[   12.578348] audit: initializing netlink subsys (disabled)
[   12.578790] audit: type=2000 audit(12.560:1): state=initialized audit_enabled=0 res=1
[   12.582446] thermal_sys: Registered thermal governor 'fair_share'
[   12.582452] thermal_sys: Registered thermal governor 'step_wise'
[   12.582458] thermal_sys: Registered thermal governor 'user_space'
[   12.582657] cpuidle: using governor menu
[   12.583105] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[   12.586170] ASID allocator initialised with 65536 entries
[   12.587061] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[   12.589841] Serial: AMBA PL011 UART driver
[   12.607402] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages
[   12.607406] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page
[   12.607409] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages
[   12.607410] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page
[   12.607411] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages
[   12.607413] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page
[   12.607414] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages
[   12.607416] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page
[   12.632929] ACPI: Added _OSI(Module Device)
[   12.632933] ACPI: Added _OSI(Processor Device)
[   12.632936] ACPI: Added _OSI(Processor Aggregator Device)
[   12.726809] Callback from call_rcu_tasks() invoked.
[   12.761469] ACPI: 19 ACPI AML tables successfully acquired and loaded
[   12.813759] ACPI: Interpreter enabled
[   12.813763] ACPI: Using GIC for interrupt routing
[   12.822738] ACPI: MCFG table detected, 13 entries
[   12.838088] HEST: Table parsing has been initialized.
[   12.838614] sdei: SDEIv1.0 (0x0) detected in firmware.
[   12.860007] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[   12.866773] ACPI: IORT: SMMU-v3[11000000] Mapped to Proximity domain 0
[   12.867850] ACPI: IORT: SMMU-v3[12000000] Mapped to Proximity domain 0
[   12.868681] ACPI: IORT: SMMU-v3[15000000] Mapped to Proximity domain 0
[   12.869572] ACPI: IORT: SMMU-v3[16000000] Mapped to Proximity domain 0
[   12.870407] ACPI: IORT: SMMU-v3[5000000] Mapped to Proximity domain 0
[   12.871249] ACPI: IORT: SMMU-v3[100011000000] Mapped to Proximity domain 1
[   12.872076] ACPI: IORT: SMMU-v3[100012000000] Mapped to Proximity domain 1
[   12.872892] ACPI: IORT: SMMU-v3[100015000000] Mapped to Proximity domain 1
[   12.873746] ACPI: IORT: SMMU-v3[100016000000] Mapped to Proximity domain 1
[   12.874644] ACPI: IORT: SMMU-v3[100005000000] Mapped to Proximity domain 1
[   13.235304] ACPI: CPU0 has been hot-added
[   13.236663] ACPI: CPU1 has been hot-added
[   13.237901] ACPI: CPU2 has been hot-added
[   13.239140] ACPI: CPU3 has been hot-added
[   13.240322] ACPI: CPU4 has been hot-added
[   13.241525] ACPI: CPU5 has been hot-added
[   13.242721] ACPI: CPU6 has been hot-added
[   13.244006] ACPI: CPU7 has been hot-added
[   13.245298] ACPI: CPU8 has been hot-added
[   13.246515] ACPI: CPU9 has been hot-added
[   13.247721] ACPI: CPU10 has been hot-added
[   13.248963] ACPI: CPU11 has been hot-added
[   13.250174] ACPI: CPU12 has been hot-added
[   13.251401] ACPI: CPU13 has been hot-added
[   13.252597] ACPI: CPU14 has been hot-added
[   13.253823] ACPI: CPU15 has been hot-added
[   13.255097] ACPI: CPU16 has been hot-added
[   13.256331] ACPI: CPU17 has been hot-added
[   13.257539] ACPI: CPU18 has been hot-added
[   13.258810] ACPI: CPU19 has been hot-added
[   13.260000] ACPI: CPU20 has been hot-added
[   13.261208] ACPI: CPU21 has been hot-added
[   13.262434] ACPI: CPU22 has been hot-added
[   13.263672] ACPI: CPU23 has been hot-added
[   13.264918] ACPI: CPU24 has been hot-added
[   13.266121] ACPI: CPU25 has been hot-added
[   13.267352] ACPI: CPU26 has been hot-added
[   13.268554] ACPI: CPU27 has been hot-added
[   13.269736] ACPI: CPU28 has been hot-added
[   13.270936] ACPI: CPU29 has been hot-added
[   13.272132] ACPI: CPU30 has been hot-added
[   13.273396] ACPI: CPU31 has been hot-added
[   13.274603] ACPI: CPU32 has been hot-added
[   13.275848] ACPI: CPU33 has been hot-added
[   13.277028] ACPI: CPU34 has been hot-added
[   13.278266] ACPI: CPU35 has been hot-added
[   13.279465] ACPI: CPU36 has been hot-added
[   13.280660] ACPI: CPU37 has been hot-added
[   13.281853] ACPI: CPU38 has been hot-added
[   13.283090] ACPI: CPU39 has been hot-added
[   13.284310] ACPI: CPU40 has been hot-added
[   13.285587] ACPI: CPU41 has been hot-added
[   13.286770] ACPI: CPU42 has been hot-added
[   13.288011] ACPI: CPU43 has been hot-added
[   13.289192] ACPI: CPU44 has been hot-added
[   13.290398] ACPI: CPU45 has been hot-added
[   13.291598] ACPI: CPU46 has been hot-added
[   13.292858] ACPI: CPU47 has been hot-added
[   13.294056] ACPI: CPU48 has been hot-added
[   13.295301] ACPI: CPU49 has been hot-added
[   13.296505] ACPI: CPU50 has been hot-added
[   13.297787] ACPI: CPU51 has been hot-added
[   13.298969] ACPI: CPU52 has been hot-added
[   13.300165] ACPI: CPU53 has been hot-added
[   13.301347] ACPI: CPU54 has been hot-added
[   13.302619] ACPI: CPU55 has been hot-added
[   13.303844] ACPI: CPU56 has been hot-added
[   13.305125] ACPI: CPU57 has been hot-added
[   13.306350] ACPI: CPU58 has been hot-added
[   13.307598] ACPI: CPU59 has been hot-added
[   13.308787] ACPI: CPU60 has been hot-added
[   13.310022] ACPI: CPU61 has been hot-added
[   13.311233] ACPI: CPU62 has been hot-added
[   13.312503] ACPI: CPU63 has been hot-added
[   13.313716] ACPI: CPU64 has been hot-added
[   13.314993] ACPI: CPU65 has been hot-added
[   13.316229] ACPI: CPU66 has been hot-added
[   13.317444] ACPI: CPU67 has been hot-added
[   13.318654] ACPI: CPU68 has been hot-added
[   13.319860] ACPI: CPU69 has been hot-added
[   13.321076] ACPI: CPU70 has been hot-added
[   13.322347] ACPI: CPU71 has been hot-added
[   13.323590] ACPI: CPU72 has been hot-added
[   13.324791] ACPI: CPU73 has been hot-added
[   13.326043] ACPI: CPU74 has been hot-added
[   13.327277] ACPI: CPU75 has been hot-added
[   13.328523] ACPI: CPU76 has been hot-added
[   13.329741] ACPI: CPU77 has been hot-added
[   13.330938] ACPI: CPU78 has been hot-added
[   13.332190] ACPI: CPU79 has been hot-added
[   13.333390] ACPI: CPU80 has been hot-added
[   13.334605] ACPI: CPU81 has been hot-added
[   13.335852] ACPI: CPU82 has been hot-added
[   13.337129] ACPI: CPU83 has been hot-added
[   13.338321] ACPI: CPU84 has been hot-added
[   13.339532] ACPI: CPU85 has been hot-added
[   13.340735] ACPI: CPU86 has been hot-added
[   13.341989] ACPI: CPU87 has been hot-added
[   13.343184] ACPI: CPU88 has been hot-added
[   13.344379] ACPI: CPU89 has been hot-added
[   13.345635] ACPI: CPU90 has been hot-added
[   13.346857] ACPI: CPU91 has been hot-added
[   13.348059] ACPI: CPU92 has been hot-added
[   13.349251] ACPI: CPU93 has been hot-added
[   13.350445] ACPI: CPU94 has been hot-added
[   13.351697] ACPI: CPU95 has been hot-added
[   13.352890] ACPI: CPU96 has been hot-added
[   13.354104] ACPI: CPU97 has been hot-added
[   13.355317] ACPI: CPU98 has been hot-added
[   13.356547] ACPI: CPU99 has been hot-added
[   13.357753] ACPI: CPU100 has been hot-added
[   13.358950] ACPI: CPU101 has been hot-added
[   13.360157] ACPI: CPU102 has been hot-added
[   13.361400] ACPI: CPU103 has been hot-added
[   13.362618] ACPI: CPU104 has been hot-added
[   13.363863] ACPI: CPU105 has been hot-added
[   13.365087] ACPI: CPU106 has been hot-added
[   13.366336] ACPI: CPU107 has been hot-added
[   13.367559] ACPI: CPU108 has been hot-added
[   13.368770] ACPI: CPU109 has been hot-added
[   13.370000] ACPI: CPU110 has been hot-added
[   13.371257] ACPI: CPU111 has been hot-added
[   13.372433] ACPI: CPU112 has been hot-added
[   13.373659] ACPI: CPU113 has been hot-added
[   13.374843] ACPI: CPU114 has been hot-added
[   13.376143] ACPI: CPU115 has been hot-added
[   13.377362] ACPI: CPU116 has been hot-added
[   13.378570] ACPI: CPU117 has been hot-added
[   13.379767] ACPI: CPU118 has been hot-added
[   13.381028] ACPI: CPU119 has been hot-added
[   13.382217] ACPI: CPU120 has been hot-added
[   13.383429] ACPI: CPU121 has been hot-added
[   13.384635] ACPI: CPU122 has been hot-added
[   13.385909] ACPI: CPU123 has been hot-added
[   13.387114] ACPI: CPU124 has been hot-added
[   13.388322] ACPI: CPU125 has been hot-added
[   13.389516] ACPI: CPU126 has been hot-added
[   13.390761] ACPI: CPU127 has been hot-added
[   13.391959] ACPI: CPU128 has been hot-added
[   13.393168] ACPI: CPU129 has been hot-added
[   13.394369] ACPI: CPU130 has been hot-added
[   13.395623] ACPI: CPU131 has been hot-added
[   13.396827] ACPI: CPU132 has been hot-added
[   13.398015] ACPI: CPU133 has been hot-added
[   13.399220] ACPI: CPU134 has been hot-added
[   13.400491] ACPI: CPU135 has been hot-added
[   13.401687] ACPI: CPU136 has been hot-added
[   13.402891] ACPI: CPU137 has been hot-added
[   13.404090] ACPI: CPU138 has been hot-added
[   13.405362] ACPI: CPU139 has been hot-added
[   13.406604] ACPI: CPU140 has been hot-added
[   13.407811] ACPI: CPU141 has been hot-added
[   13.409015] ACPI: CPU142 has been hot-added
[   13.410272] ACPI: CPU143 has been hot-added
[   13.414563] ARMH0011:00: ttyAMA0 at MMIO 0xc280000 (irq = 86, base_baud = 0) is a SBSA
[   13.414874] printk: console [ttyAMA0] enabled
[   13.429272] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[   13.429303] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[   13.430244] acpi PNP0A08:00: _OSC: platform does not support [PME AER DPC]
[   13.431754] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PCIeCapability LTR]
[   13.439765] acpi PNP0A08:00: ECAM area [mem 0x600010000000-0x60001fffffff] reserved by PNP0C02:02
[   13.457548] acpi PNP0A08:00: ECAM at [mem 0x600010000000-0x60001fffffff] for [bus 00-ff]
[   13.457729] ACPI: Remapped I/O 0x0000600020000000 to [io  0x0000-0xffff window]
[   13.459172] PCI host bridge to bus 0000:00
[   13.459249] pci_bus 0000:00: root bus resource [mem 0x600040000000-0x6000bfffffff window] (bus address [0x40000000-0xbfffffff])
[   13.459256] pci_bus 0000:00: root bus resource [mem 0x6000c0000000-0x607fffffffff window]
[   13.459261] pci_bus 0000:00: root bus resource [io  0x0000-0xffff window]
[   13.459272] pci_bus 0000:00: root bus resource [bus 00-ff]
[   13.459407] pci 0000:00:00.0: [10de:22b2] type 01 class 0x060400 PCIe Root Port
[   13.459435] pci 0000:00:00.0: PCI bridge to [bus 01]
[   13.459465] pci 0000:00:00.0: enabling Extended Tags
[   13.459672] pci 0000:00:00.0: PME# supported from D0 D3hot
[   13.465268] pci_bus 0000:00: on NUMA node 0
[   13.465281] pci 0000:00:00.0: bridge window [io  0x1000-0x0fff] to [bus 01] add_size 1000
[   13.465290] pci 0000:00:00.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 01] add_size 200000 add_align 100000
[   13.465299] pci 0000:00:00.0: bridge window [mem 0x00100000-0x000fffff] to [bus 01] add_size 200000 add_align 100000
[   13.465331] pci 0000:00:00.0: bridge window [mem 0x600040000000-0x6000401fffff]: assigned
[   13.465338] pci 0000:00:00.0: bridge window [mem 0x6000c0000000-0x6000c01fffff 64bit pref]: assigned
[   13.465343] pci 0000:00:00.0: bridge window [io  0x1000-0x1fff]: assigned
[   13.465361] pci 0000:00:00.0: PCI bridge to [bus 01]
[   13.465366] pci 0000:00:00.0:   bridge window [io  0x1000-0x1fff]
[   13.465371] pci 0000:00:00.0:   bridge window [mem 0x600040000000-0x6000401fffff]
[   13.465374] pci 0000:00:00.0:   bridge window [mem 0x6000c0000000-0x6000c01fffff 64bit pref]
[   13.465379] pci_bus 0000:00: resource 4 [mem 0x600040000000-0x6000bfffffff window]
[   13.465383] pci_bus 0000:00: resource 5 [mem 0x6000c0000000-0x607fffffffff window]
[   13.465386] pci_bus 0000:00: resource 6 [io  0x0000-0xffff window]
[   13.465389] pci_bus 0000:01: resource 0 [io  0x1000-0x1fff]
[   13.465391] pci_bus 0000:01: resource 1 [mem 0x600040000000-0x6000401fffff]
[   13.465393] pci_bus 0000:01: resource 2 [mem 0x6000c0000000-0x6000c01fffff 64bit pref]
[   13.466647] ACPI: PCI Root Bridge [PCI1] (domain 0001 [bus 00-ff])
[   13.466666] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[   13.467467] acpi PNP0A08:01: _OSC: platform does not support [PME AER DPC]
[   13.468828] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PCIeCapability LTR]
[   13.476892] acpi PNP0A08:01: ECAM area [mem 0x608010000000-0x60801fffffff] reserved by PNP0C02:03
[   13.494581] acpi PNP0A08:01: ECAM at [mem 0x608010000000-0x60801fffffff] for [bus 00-ff]
[   13.494693] ACPI: Remapped I/O 0x0000608020000000 to [io  0x10000-0x1ffff window]
[   13.495857] PCI host bridge to bus 0001:00
[   13.495908] pci_bus 0001:00: root bus resource [mem 0x608040000000-0x6080bfffffff window] (bus address [0x40000000-0xbfffffff])
[   13.495914] pci_bus 0001:00: root bus resource [mem 0x6080c0000000-0x60ffffffffff window]
[   13.495920] pci_bus 0001:00: root bus resource [io  0x10000-0x1ffff window] (bus address [0x0000-0xffff])
[   13.495929] pci_bus 0001:00: root bus resource [bus 00-ff]
[   13.495988] pci 0001:00:00.0: [10de:22b8] type 01 class 0x060400 PCIe Root Port
[   13.496013] pci 0001:00:00.0: PCI bridge to [bus 01]
[   13.496040] pci 0001:00:00.0: enabling Extended Tags
[   13.496191] pci 0001:00:00.0: PME# supported from D0 D3hot
[   13.500977] pci_bus 0001:00: on NUMA node 0
[   13.500985] pci 0001:00:00.0: bridge window [io  0x1000-0x0fff] to [bus 01] add_size 1000
[   13.500994] pci 0001:00:00.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 01] add_size 200000 add_align 100000
[   13.501001] pci 0001:00:00.0: bridge window [mem 0x00100000-0x000fffff] to [bus 01] add_size 200000 add_align 100000
[   13.501026] pci 0001:00:00.0: bridge window [mem 0x608040000000-0x6080401fffff]: assigned
[   13.501032] pci 0001:00:00.0: bridge window [mem 0x6080c0000000-0x6080c01fffff 64bit pref]: assigned
[   13.501037] pci 0001:00:00.0: bridge window [io  0x10000-0x10fff]: assigned
[   13.501052] pci 0001:00:00.0: PCI bridge to [bus 01]
[   13.501056] pci 0001:00:00.0:   bridge window [io  0x10000-0x10fff]
[   13.501060] pci 0001:00:00.0:   bridge window [mem 0x608040000000-0x6080401fffff]
[   13.501065] pci 0001:00:00.0:   bridge window [mem 0x6080c0000000-0x6080c01fffff 64bit pref]
[   13.501069] pci_bus 0001:00: resource 4 [mem 0x608040000000-0x6080bfffffff window]
[   13.501072] pci_bus 0001:00: resource 5 [mem 0x6080c0000000-0x60ffffffffff window]
[   13.501075] pci_bus 0001:00: resource 6 [io  0x10000-0x1ffff window]
[   13.501077] pci_bus 0001:01: resource 0 [io  0x10000-0x10fff]
[   13.501079] pci_bus 0001:01: resource 1 [mem 0x608040000000-0x6080401fffff]
[   13.501082] pci_bus 0001:01: resource 2 [mem 0x6080c0000000-0x6080c01fffff 64bit pref]
[   13.502197] ACPI: PCI Root Bridge [PCI2] (domain 0002 [bus 00-ff])
[   13.502214] acpi PNP0A08:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[   13.503037] acpi PNP0A08:02: _OSC: platform does not support [PME AER DPC]
[   13.504425] acpi PNP0A08:02: _OSC: OS now controls [PCIeHotplug PCIeCapability LTR]
[   13.512523] acpi PNP0A08:02: ECAM area [mem 0x610010000000-0x61001fffffff] reserved by PNP0C02:04
[   13.530250] acpi PNP0A08:02: ECAM at [mem 0x610010000000-0x61001fffffff] for [bus 00-ff]
[   13.530376] ACPI: Remapped I/O 0x0000610020000000 to [io  0x20000-0x2ffff window]
[   13.531533] PCI host bridge to bus 0002:00
[   13.531591] pci_bus 0002:00: root bus resource [mem 0x610040000000-0x6100bfffffff window] (bus address [0x40000000-0xbfffffff])
[   13.531597] pci_bus 0002:00: root bus resource [mem 0x6100c0000000-0x617fffffffff window]
[   13.531602] pci_bus 0002:00: root bus resource [io  0x20000-0x2ffff window] (bus address [0x0000-0xffff])
[   13.531611] pci_bus 0002:00: root bus resource [bus 00-ff]
[   13.531687] pci 0002:00:00.0: [10de:22b2] type 01 class 0x060400 PCIe Root Port
[   13.531713] pci 0002:00:00.0: PCI bridge to [bus 01]
[   13.531742] pci 0002:00:00.0: enabling Extended Tags
[   13.531936] pci 0002:00:00.0: PME# supported from D0 D3hot
[   13.536823] pci_bus 0002:00: on NUMA node 0
[   13.536835] pci 0002:00:00.0: bridge window [io  0x1000-0x0fff] to [bus 01] add_size 1000
[   13.536843] pci 0002:00:00.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 01] add_size 200000 add_align 100000
[   13.536849] pci 0002:00:00.0: bridge window [mem 0x00100000-0x000fffff] to [bus 01] add_size 200000 add_align 100000
[   13.536875] pci 0002:00:00.0: bridge window [mem 0x610040000000-0x6100401fffff]: assigned
[   13.536881] pci 0002:00:00.0: bridge window [mem 0x6100c0000000-0x6100c01fffff 64bit pref]: assigned
[   13.536886] pci 0002:00:00.0: bridge window [io  0x20000-0x20fff]: assigned
[   13.536901] pci 0002:00:00.0: PCI bridge to [bus 01]
[   13.536904] pci 0002:00:00.0:   bridge window [io  0x20000-0x20fff]
[   13.536909] pci 0002:00:00.0:   bridge window [mem 0x610040000000-0x6100401fffff]
[   13.536912] pci 0002:00:00.0:   bridge window [mem 0x6100c0000000-0x6100c01fffff 64bit pref]
[   13.536917] pci_bus 0002:00: resource 4 [mem 0x610040000000-0x6100bfffffff window]
[   13.536920] pci_bus 0002:00: resource 5 [mem 0x6100c0000000-0x617fffffffff window]
[   13.536923] pci_bus 0002:00: resource 6 [io  0x20000-0x2ffff window]
[   13.536925] pci_bus 0002:01: resource 0 [io  0x20000-0x20fff]
[   13.536927] pci_bus 0002:01: resource 1 [mem 0x610040000000-0x6100401fffff]
[   13.536930] pci_bus 0002:01: resource 2 [mem 0x6100c0000000-0x6100c01fffff 64bit pref]
[   13.538071] ACPI: PCI Root Bridge [PCI4] (domain 0004 [bus 00-ff])
[   13.538089] acpi PNP0A08:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[   13.538903] acpi PNP0A08:03: _OSC: platform does not support [PME AER DPC]
[   13.540303] acpi PNP0A08:03: _OSC: OS now controls [PCIeHotplug PCIeCapability LTR]
[   13.548556] acpi PNP0A08:03: ECAM area [mem 0x620010000000-0x62001fffffff] reserved by PNP0C02:05
[   13.566394] acpi PNP0A08:03: ECAM at [mem 0x620010000000-0x62001fffffff] for [bus 00-ff]
[   13.566559] ACPI: Remapped I/O 0x0000620020000000 to [io  0x30000-0x3ffff window]
[   13.567716] PCI host bridge to bus 0004:00
[   13.567767] pci_bus 0004:00: root bus resource [mem 0x620040000000-0x6200bfffffff window] (bus address [0x40000000-0xbfffffff])
[   13.567772] pci_bus 0004:00: root bus resource [mem 0x6200c0000000-0x627fffffffff window]
[   13.567777] pci_bus 0004:00: root bus resource [io  0x30000-0x3ffff window] (bus address [0x0000-0xffff])
[   13.567787] pci_bus 0004:00: root bus resource [bus 00-ff]
[   13.567853] pci 0004:00:00.0: [10de:22b2] type 01 class 0x060400 PCIe Root Port
[   13.567878] pci 0004:00:00.0: PCI bridge to [bus 01]
[   13.567904] pci 0004:00:00.0: enabling Extended Tags
[   13.568063] pci 0004:00:00.0: PME# supported from D0 D3hot
[   13.573211] pci_bus 0004:00: on NUMA node 0
[   13.573223] pci 0004:00:00.0: bridge window [io  0x1000-0x0fff] to [bus 01] add_size 1000
[   13.573231] pci 0004:00:00.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 01] add_size 200000 add_align 100000
[   13.573237] pci 0004:00:00.0: bridge window [mem 0x00100000-0x000fffff] to [bus 01] add_size 200000 add_align 100000
[   13.573267] pci 0004:00:00.0: bridge window [mem 0x620040000000-0x6200401fffff]: assigned
[   13.573273] pci 0004:00:00.0: bridge window [mem 0x6200c0000000-0x6200c01fffff 64bit pref]: assigned
[   13.573278] pci 0004:00:00.0: bridge window [io  0x30000-0x30fff]: assigned
[   13.573293] pci 0004:00:00.0: PCI bridge to [bus 01]
[   13.573297] pci 0004:00:00.0:   bridge window [io  0x30000-0x30fff]
[   13.573301] pci 0004:00:00.0:   bridge window [mem 0x620040000000-0x6200401fffff]
[   13.573305] pci 0004:00:00.0:   bridge window [mem 0x6200c0000000-0x6200c01fffff 64bit pref]
[   13.573311] pci_bus 0004:00: resource 4 [mem 0x620040000000-0x6200bfffffff window]
[   13.573314] pci_bus 0004:00: resource 5 [mem 0x6200c0000000-0x627fffffffff window]
[   13.573316] pci_bus 0004:00: resource 6 [io  0x30000-0x3ffff window]
[   13.573318] pci_bus 0004:01: resource 0 [io  0x30000-0x30fff]
[   13.573321] pci_bus 0004:01: resource 1 [mem 0x620040000000-0x6200401fffff]
[   13.573324] pci_bus 0004:01: resource 2 [mem 0x6200c0000000-0x6200c01fffff 64bit pref]
[   13.574489] ACPI: PCI Root Bridge [PCI6] (domain 0006 [bus 00-ff])
[   13.574508] acpi PNP0A08:04: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[   13.575384] acpi PNP0A08:04: _OSC: platform does not support [PME AER DPC]
[   13.576825] acpi PNP0A08:04: _OSC: OS now controls [PCIeHotplug PCIeCapability LTR]
[   13.585267] acpi PNP0A08:04: ECAM area [mem 0x630010000000-0x63001fffffff] reserved by PNP0C02:06
[   13.603041] acpi PNP0A08:04: ECAM at [mem 0x630010000000-0x63001fffffff] for [bus 00-ff]
[   13.603185] ACPI: Remapped I/O 0x0000630020000000 to [io  0x40000-0x4ffff window]
[   13.604328] PCI host bridge to bus 0006:00
[   13.604380] pci_bus 0006:00: root bus resource [mem 0x630040000000-0x6300bfffffff window] (bus address [0x40000000-0xbfffffff])
[   13.604386] pci_bus 0006:00: root bus resource [mem 0x6300c0000000-0x63ffffffffff window]
[   13.604391] pci_bus 0006:00: root bus resource [io  0x40000-0x4ffff window] (bus address [0x0000-0xffff])
[   13.604402] pci_bus 0006:00: root bus resource [bus 00-ff]
[   13.604458] pci 0006:00:00.0: [10de:22b2] type 01 class 0x060400 PCIe Root Port
[   13.604479] pci 0006:00:00.0: PCI bridge to [bus 01]
[   13.604487] pci 0006:00:00.0:   bridge window [mem 0x630040000000-0x6300401fffff]
[   13.604496] pci 0006:00:00.0:   bridge window [mem 0x6300c0000000-0x6300c3ffffff 64bit pref]
[   13.604507] pci 0006:00:00.0: enabling Extended Tags
[   13.604631] pci 0006:00:00.0: PME# supported from D0 D3hot
[   13.609728] pci 0006:01:00.0: [15b3:101f] type 00 class 0x020000 PCIe Endpoint
[   13.610112] pci 0006:01:00.0: BAR 0 [mem 0x6300c2000000-0x6300c3ffffff 64bit pref]
[   13.610158] pci 0006:01:00.0: ROM [mem 0x630040100000-0x6300401fffff pref]
[   13.610209] pci 0006:01:00.0: enabling Extended Tags
[   13.611330] pci 0006:01:00.0: PME# supported from D3cold
[   13.611869] pci 0006:01:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]
[   13.611871] pci 0006:01:00.0: VF BAR 0 [mem 0x00000000-0x007fffff 64bit pref]: contains BAR 0 for 8 VFs
[   13.615276] pci 0006:01:00.1: [15b3:101f] type 00 class 0x020000 PCIe Endpoint
[   13.615711] pci 0006:01:00.1: BAR 0 [mem 0x6300c0000000-0x6300c1ffffff 64bit pref]
[   13.615756] pci 0006:01:00.1: ROM [mem 0x630040000000-0x6300400fffff pref]
[   13.615807] pci 0006:01:00.1: enabling Extended Tags
[   13.616685] pci 0006:01:00.1: PME# supported from D3cold
[   13.617204] pci 0006:01:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]
[   13.617207] pci 0006:01:00.1: VF BAR 0 [mem 0x00000000-0x007fffff 64bit pref]: contains BAR 0 for 8 VFs
[   13.620166] pci_bus 0006:00: on NUMA node 0
[   13.620176] pci 0006:00:00.0: bridge window [io  0x1000-0x0fff] to [bus 01] add_size 1000
[   13.620193] pci 0006:00:00.0: bridge window [mem 0x02000000-0x05ffffff 64bit pref] to [bus 01] add_size 2000000 add_align 2000000
[   13.620206] pci 0006:00:00.0: bridge window [mem 0x00100000-0x000fffff] to [bus 01] add_size 400000 add_align 100000
[   13.620234] pci 0006:00:00.0: bridge window [mem 0x6300c0000000-0x6300c5ffffff 64bit pref]: assigned
[   13.620240] pci 0006:00:00.0: bridge window [mem 0x630040000000-0x6300403fffff]: assigned
[   13.620245] pci 0006:00:00.0: bridge window [io  0x40000-0x40fff]: assigned
[   13.620294] pci 0006:01:00.0: BAR 0 [mem 0x6300c0000000-0x6300c1ffffff 64bit pref]: assigned
[   13.620375] pci 0006:01:00.1: BAR 0 [mem 0x6300c2000000-0x6300c3ffffff 64bit pref]: assigned
[   13.620456] pci 0006:01:00.0: ROM [mem 0x630040000000-0x6300400fffff pref]: assigned
[   13.620462] pci 0006:01:00.0: VF BAR 0 [mem 0x6300c4000000-0x6300c47fffff 64bit pref]: assigned
[   13.620506] pci 0006:01:00.1: ROM [mem 0x630040100000-0x6300401fffff pref]: assigned
[   13.620512] pci 0006:01:00.1: VF BAR 0 [mem 0x6300c4800000-0x6300c4ffffff 64bit pref]: assigned
[   13.620575] pci 0006:00:00.0: PCI bridge to [bus 01]
[   13.620579] pci 0006:00:00.0:   bridge window [io  0x40000-0x40fff]
[   13.620584] pci 0006:00:00.0:   bridge window [mem 0x630040000000-0x6300403fffff]
[   13.620587] pci 0006:00:00.0:   bridge window [mem 0x6300c0000000-0x6300c5ffffff 64bit pref]
[   13.620592] pci_bus 0006:00: resource 4 [mem 0x630040000000-0x6300bfffffff window]
[   13.620595] pci_bus 0006:00: resource 5 [mem 0x6300c0000000-0x63ffffffffff window]
[   13.620597] pci_bus 0006:00: resource 6 [io  0x40000-0x4ffff window]
[   13.620600] pci_bus 0006:01: resource 0 [io  0x40000-0x40fff]
[   13.620603] pci_bus 0006:01: resource 1 [mem 0x630040000000-0x6300403fffff]
[   13.620605] pci_bus 0006:01: resource 2 [mem 0x6300c0000000-0x6300c5ffffff 64bit pref]
[   13.623862] ACPI: PCI Root Bridge [PCI8] (domain 0008 [bus 00-ff])
[   13.623881] acpi PNP0A08:05: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[   13.624701] acpi PNP0A08:05: _OSC: platform does not support [PME AER DPC]
[   13.626074] acpi PNP0A08:05: _OSC: OS now controls [PCIeHotplug PCIeCapability LTR]
[   13.634535] acpi PNP0A08:05: ECAM area [mem 0x650010000000-0x65001fffffff] reserved by PNP0C02:07
[   13.652288] acpi PNP0A08:05: ECAM at [mem 0x650010000000-0x65001fffffff] for [bus 00-ff]
[   13.652431] ACPI: Remapped I/O 0x0000650020000000 to [io  0x50000-0x5ffff window]
[   13.653550] PCI host bridge to bus 0008:00
[   13.653616] pci_bus 0008:00: root bus resource [mem 0x650040000000-0x6500bfffffff window] (bus address [0x40000000-0xbfffffff])
[   13.653621] pci_bus 0008:00: root bus resource [mem 0x6500c0000000-0x65ffffffffff window]
[   13.653627] pci_bus 0008:00: root bus resource [io  0x50000-0x5ffff window] (bus address [0x0000-0xffff])
[   13.653636] pci_bus 0008:00: root bus resource [bus 00-ff]
[   13.653694] pci 0008:00:00.0: [10de:22b9] type 01 class 0x060400 PCIe Root Port
[   13.653715] pci 0008:00:00.0: PCI bridge to [bus 01-02]
[   13.653722] pci 0008:00:00.0:   bridge window [io  0x50000-0x50fff]
[   13.653726] pci 0008:00:00.0:   bridge window [mem 0x650040000000-0x6500410fffff]
[   13.653743] pci 0008:00:00.0: enabling Extended Tags
[   13.653880] pci 0008:00:00.0: PME# supported from D0 D3hot
[   13.658838] pci 0008:01:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge
[   13.658879] pci 0008:01:00.0: PCI bridge to [bus 02]
[   13.658891] pci 0008:01:00.0:   bridge window [io  0x50000-0x50fff]
[   13.658897] pci 0008:01:00.0:   bridge window [mem 0x650040000000-0x6500410fffff]
[   13.658932] pci 0008:01:00.0: enabling Extended Tags
[   13.659096] pci 0008:01:00.0: supports D1 D2
[   13.659100] pci 0008:01:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[   13.660726] pci_bus 0008:02: extended config space not accessible
[   13.661187] pci 0008:02:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint
[   13.661249] pci 0008:02:00.0: BAR 0 [mem 0x650040000000-0x650040ffffff]
[   13.661255] pci 0008:02:00.0: BAR 1 [mem 0x650041000000-0x65004103ffff]
[   13.661260] pci 0008:02:00.0: BAR 2 [io  0x50000-0x5007f]
[   13.661387] pci 0008:02:00.0: supports D1 D2
[   13.661389] pci 0008:02:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[   13.662674] pci_bus 0008:00: on NUMA node 0
[   13.662690] pci 0008:00:00.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 01-02] add_size 200000 add_align 100000
[   13.662719] pci 0008:00:00.0: bridge window [mem 0x650040000000-0x6500417fffff]: assigned
[   13.662726] pci 0008:00:00.0: bridge window [mem 0x6500c0000000-0x6500c01fffff 64bit pref]: assigned
[   13.662732] pci 0008:00:00.0: bridge window [io  0x50000-0x50fff]: assigned
[   13.662752] pci 0008:01:00.0: bridge window [mem 0x650040000000-0x6500417fffff]: assigned
[   13.662757] pci 0008:01:00.0: bridge window [io  0x50000-0x50fff]: assigned
[   13.662774] pci 0008:02:00.0: BAR 0 [mem 0x650040000000-0x650040ffffff]: assigned
[   13.662785] pci 0008:02:00.0: BAR 1 [mem 0x650041000000-0x65004103ffff]: assigned
[   13.662793] pci 0008:02:00.0: BAR 2 [io  0x50000-0x5007f]: assigned
[   13.662805] pci 0008:01:00.0: PCI bridge to [bus 02]
[   13.662810] pci 0008:01:00.0:   bridge window [io  0x50000-0x50fff]
[   13.662816] pci 0008:01:00.0:   bridge window [mem 0x650040000000-0x6500417fffff]
[   13.662825] pci 0008:00:00.0: PCI bridge to [bus 01-02]
[   13.662829] pci 0008:00:00.0:   bridge window [io  0x50000-0x50fff]
[   13.662833] pci 0008:00:00.0:   bridge window [mem 0x650040000000-0x6500417fffff]
[   13.662837] pci 0008:00:00.0:   bridge window [mem 0x6500c0000000-0x6500c01fffff 64bit pref]
[   13.662842] pci_bus 0008:00: resource 4 [mem 0x650040000000-0x6500bfffffff window]
[   13.662844] pci_bus 0008:00: resource 5 [mem 0x6500c0000000-0x65ffffffffff window]
[   13.662847] pci_bus 0008:00: resource 6 [io  0x50000-0x5ffff window]
[   13.662850] pci_bus 0008:01: resource 0 [io  0x50000-0x50fff]
[   13.662852] pci_bus 0008:01: resource 1 [mem 0x650040000000-0x6500417fffff]
[   13.662855] pci_bus 0008:01: resource 2 [mem 0x6500c0000000-0x6500c01fffff 64bit pref]
[   13.662858] pci_bus 0008:02: resource 0 [io  0x50000-0x50fff]
[   13.662860] pci_bus 0008:02: resource 1 [mem 0x650040000000-0x6500417fffff]
[   13.664983] ACPI: PCI Root Bridge [PC10] (domain 0010 [bus 00-ff])
[   13.665002] acpi PNP0A08:06: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[   13.665833] acpi PNP0A08:06: _OSC: platform does not support [PME AER DPC]
[   13.667246] acpi PNP0A08:06: _OSC: OS now controls [PCIeHotplug PCIeCapability LTR]
[   13.675826] acpi PNP0A08:06: ECAM area [mem 0x680010000000-0x68001fffffff] reserved by PNP0C02:08
[   13.694091] acpi PNP0A08:06: ECAM at [mem 0x680010000000-0x68001fffffff] for [bus 00-ff]
[   13.694228] ACPI: Remapped I/O 0x0000680020000000 to [io  0x60000-0x6ffff window]
[   13.695471] PCI host bridge to bus 0010:00
[   13.695521] pci_bus 0010:00: root bus resource [mem 0x680040000000-0x6800bfffffff window] (bus address [0x40000000-0xbfffffff])
[   13.695526] pci_bus 0010:00: root bus resource [mem 0x6800c0000000-0x687fffffffff window]
[   13.695546] pci_bus 0010:00: root bus resource [io  0x60000-0x6ffff window] (bus address [0x0000-0xffff])
[   13.695555] pci_bus 0010:00: root bus resource [bus 00-ff]
[   13.695625] pci 0010:00:00.0: [10de:22b2] type 01 class 0x060400 PCIe Root Port
[   13.695657] pci 0010:00:00.0: PCI bridge to [bus 01]
[   13.695689] pci 0010:00:00.0: enabling Extended Tags
[   13.695867] pci 0010:00:00.0: PME# supported from D0 D3hot
[   13.700770] pci_bus 0010:00: on NUMA node 1
[   13.700781] pci 0010:00:00.0: bridge window [io  0x1000-0x0fff] to [bus 01] add_size 1000
[   13.700802] pci 0010:00:00.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 01] add_size 200000 add_align 100000
[   13.700808] pci 0010:00:00.0: bridge window [mem 0x00100000-0x000fffff] to [bus 01] add_size 200000 add_align 100000
[   13.700836] pci 0010:00:00.0: bridge window [mem 0x680040000000-0x6800401fffff]: assigned
[   13.700842] pci 0010:00:00.0: bridge window [mem 0x6800c0000000-0x6800c01fffff 64bit pref]: assigned
[   13.700847] pci 0010:00:00.0: bridge window [io  0x60000-0x60fff]: assigned
[   13.700867] pci 0010:00:00.0: PCI bridge to [bus 01]
[   13.700871] pci 0010:00:00.0:   bridge window [io  0x60000-0x60fff]
[   13.700877] pci 0010:00:00.0:   bridge window [mem 0x680040000000-0x6800401fffff]
[   13.700881] pci 0010:00:00.0:   bridge window [mem 0x6800c0000000-0x6800c01fffff 64bit pref]
[   13.700887] pci_bus 0010:00: resource 4 [mem 0x680040000000-0x6800bfffffff window]
[   13.700890] pci_bus 0010:00: resource 5 [mem 0x6800c0000000-0x687fffffffff window]
[   13.700892] pci_bus 0010:00: resource 6 [io  0x60000-0x6ffff window]
[   13.700895] pci_bus 0010:01: resource 0 [io  0x60000-0x60fff]
[   13.700897] pci_bus 0010:01: resource 1 [mem 0x680040000000-0x6800401fffff]
[   13.700899] pci_bus 0010:01: resource 2 [mem 0x6800c0000000-0x6800c01fffff 64bit pref]
[   13.702069] ACPI: PCI Root Bridge [PC11] (domain 0011 [bus 00-ff])
[   13.702087] acpi PNP0A08:07: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[   13.702887] acpi PNP0A08:07: _OSC: platform does not support [PME AER DPC]
[   13.704329] acpi PNP0A08:07: _OSC: OS now controls [PCIeHotplug PCIeCapability LTR]
[   13.713103] acpi PNP0A08:07: ECAM area [mem 0x688010000000-0x68801fffffff] reserved by PNP0C02:09
[   13.731047] acpi PNP0A08:07: ECAM at [mem 0x688010000000-0x68801fffffff] for [bus 00-ff]
[   13.731199] ACPI: Remapped I/O 0x0000688020000000 to [io  0x70000-0x7ffff window]
[   13.732396] PCI host bridge to bus 0011:00
[   13.732449] pci_bus 0011:00: root bus resource [mem 0x688040000000-0x6880bfffffff window] (bus address [0x40000000-0xbfffffff])
[   13.732455] pci_bus 0011:00: root bus resource [mem 0x6880c0000000-0x68ffffffffff window]
[   13.732461] pci_bus 0011:00: root bus resource [io  0x70000-0x7ffff window] (bus address [0x0000-0xffff])
[   13.732473] pci_bus 0011:00: root bus resource [bus 00-ff]
[   13.732558] pci 0011:00:00.0: [10de:22b8] type 01 class 0x060400 PCIe Root Port
[   13.732592] pci 0011:00:00.0: PCI bridge to [bus 01]
[   13.732627] pci 0011:00:00.0: enabling Extended Tags
[   13.732848] pci 0011:00:00.0: PME# supported from D0 D3hot
[   13.737873] pci_bus 0011:00: on NUMA node 1
[   13.737883] pci 0011:00:00.0: bridge window [io  0x1000-0x0fff] to [bus 01] add_size 1000
[   13.737891] pci 0011:00:00.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 01] add_size 200000 add_align 100000
[   13.737897] pci 0011:00:00.0: bridge window [mem 0x00100000-0x000fffff] to [bus 01] add_size 200000 add_align 100000
[   13.737927] pci 0011:00:00.0: bridge window [mem 0x688040000000-0x6880401fffff]: assigned
[   13.737933] pci 0011:00:00.0: bridge window [mem 0x6880c0000000-0x6880c01fffff 64bit pref]: assigned
[   13.737939] pci 0011:00:00.0: bridge window [io  0x70000-0x70fff]: assigned
[   13.737955] pci 0011:00:00.0: PCI bridge to [bus 01]
[   13.737960] pci 0011:00:00.0:   bridge window [io  0x70000-0x70fff]
[   13.737964] pci 0011:00:00.0:   bridge window [mem 0x688040000000-0x6880401fffff]
[   13.737968] pci 0011:00:00.0:   bridge window [mem 0x6880c0000000-0x6880c01fffff 64bit pref]
[   13.737973] pci_bus 0011:00: resource 4 [mem 0x688040000000-0x6880bfffffff window]
[   13.737975] pci_bus 0011:00: resource 5 [mem 0x6880c0000000-0x68ffffffffff window]
[   13.737978] pci_bus 0011:00: resource 6 [io  0x70000-0x7ffff window]
[   13.737980] pci_bus 0011:01: resource 0 [io  0x70000-0x70fff]
[   13.737983] pci_bus 0011:01: resource 1 [mem 0x688040000000-0x6880401fffff]
[   13.737985] pci_bus 0011:01: resource 2 [mem 0x6880c0000000-0x6880c01fffff 64bit pref]
[   13.739169] ACPI: PCI Root Bridge [PC12] (domain 0012 [bus 00-ff])
[   13.739187] acpi PNP0A08:08: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[   13.740014] acpi PNP0A08:08: _OSC: platform does not support [PME AER DPC]
[   13.741369] acpi PNP0A08:08: _OSC: OS now controls [PCIeHotplug PCIeCapability LTR]
[   13.750248] acpi PNP0A08:08: ECAM area [mem 0x690010000000-0x69001fffffff] reserved by PNP0C02:0a
[   13.768649] acpi PNP0A08:08: ECAM at [mem 0x690010000000-0x69001fffffff] for [bus 00-ff]
[   13.768785] ACPI: Remapped I/O 0x0000690020000000 to [io  0x80000-0x8ffff window]
[   13.769943] PCI host bridge to bus 0012:00
[   13.769992] pci_bus 0012:00: root bus resource [mem 0x690040000000-0x6900bfffffff window] (bus address [0x40000000-0xbfffffff])
[   13.769998] pci_bus 0012:00: root bus resource [mem 0x6900c0000000-0x697fffffffff window]
[   13.770003] pci_bus 0012:00: root bus resource [io  0x80000-0x8ffff window] (bus address [0x0000-0xffff])
[   13.770013] pci_bus 0012:00: root bus resource [bus 00-ff]
[   13.770079] pci 0012:00:00.0: [10de:22b2] type 01 class 0x060400 PCIe Root Port
[   13.770111] pci 0012:00:00.0: PCI bridge to [bus 01]
[   13.770144] pci 0012:00:00.0: enabling Extended Tags
[   13.770325] pci 0012:00:00.0: PME# supported from D0 D3hot
[   13.775256] pci_bus 0012:00: on NUMA node 1
[   13.775284] pci 0012:00:00.0: bridge window [io  0x1000-0x0fff] to [bus 01] add_size 1000
[   13.775293] pci 0012:00:00.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 01] add_size 200000 add_align 100000
[   13.775300] pci 0012:00:00.0: bridge window [mem 0x00100000-0x000fffff] to [bus 01] add_size 200000 add_align 100000
[   13.775331] pci 0012:00:00.0: bridge window [mem 0x690040000000-0x6900401fffff]: assigned
[   13.775338] pci 0012:00:00.0: bridge window [mem 0x6900c0000000-0x6900c01fffff 64bit pref]: assigned
[   13.775344] pci 0012:00:00.0: bridge window [io  0x80000-0x80fff]: assigned
[   13.775362] pci 0012:00:00.0: PCI bridge to [bus 01]
[   13.775366] pci 0012:00:00.0:   bridge window [io  0x80000-0x80fff]
[   13.775372] pci 0012:00:00.0:   bridge window [mem 0x690040000000-0x6900401fffff]
[   13.775376] pci 0012:00:00.0:   bridge window [mem 0x6900c0000000-0x6900c01fffff 64bit pref]
[   13.775381] pci_bus 0012:00: resource 4 [mem 0x690040000000-0x6900bfffffff window]
[   13.775385] pci_bus 0012:00: resource 5 [mem 0x6900c0000000-0x697fffffffff window]
[   13.775387] pci_bus 0012:00: resource 6 [io  0x80000-0x8ffff window]
[   13.775390] pci_bus 0012:01: resource 0 [io  0x80000-0x80fff]
[   13.775392] pci_bus 0012:01: resource 1 [mem 0x690040000000-0x6900401fffff]
[   13.775394] pci_bus 0012:01: resource 2 [mem 0x6900c0000000-0x6900c01fffff 64bit pref]
[   13.776561] ACPI: PCI Root Bridge [PC14] (domain 0014 [bus 00-ff])
[   13.776577] acpi PNP0A08:09: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[   13.777376] acpi PNP0A08:09: _OSC: platform does not support [PME AER DPC]
[   13.778759] acpi PNP0A08:09: _OSC: OS now controls [PCIeHotplug PCIeCapability LTR]
[   13.787810] acpi PNP0A08:09: ECAM area [mem 0x6a0010000000-0x6a001fffffff] reserved by PNP0C02:0b
[   13.805568] acpi PNP0A08:09: ECAM at [mem 0x6a0010000000-0x6a001fffffff] for [bus 00-ff]
[   13.805730] ACPI: Remapped I/O 0x00006a0020000000 to [io  0x90000-0x9ffff window]
[   13.806902] PCI host bridge to bus 0014:00
[   13.806956] pci_bus 0014:00: root bus resource [mem 0x6a0040000000-0x6a00bfffffff window] (bus address [0x40000000-0xbfffffff])
[   13.806962] pci_bus 0014:00: root bus resource [mem 0x6a00c0000000-0x6a7fffffffff window]
[   13.806967] pci_bus 0014:00: root bus resource [io  0x90000-0x9ffff window] (bus address [0x0000-0xffff])
[   13.806978] pci_bus 0014:00: root bus resource [bus 00-ff]
[   13.807043] pci 0014:00:00.0: [10de:22b2] type 01 class 0x060400 PCIe Root Port
[   13.807067] pci 0014:00:00.0: PCI bridge to [bus 01]
[   13.807077] pci 0014:00:00.0:   bridge window [mem 0x6a0040000000-0x6a00400fffff]
[   13.807097] pci 0014:00:00.0: enabling Extended Tags
[   13.807242] pci 0014:00:00.0: PME# supported from D0 D3hot
[   13.812123] pci 0014:01:00.0: [144d:a80a] type 00 class 0x010802 PCIe Endpoint
[   13.812173] pci 0014:01:00.0: BAR 0 [mem 0x6a0040010000-0x6a0040013fff 64bit]
[   13.812185] pci 0014:01:00.0: ROM [mem 0x6a0040000000-0x6a004000ffff pref]
[   13.812197] pci 0014:01:00.0: enabling Extended Tags
[   13.813641] pci_bus 0014:00: on NUMA node 1
[   13.813651] pci 0014:00:00.0: bridge window [io  0x1000-0x0fff] to [bus 01] add_size 1000
[   13.813659] pci 0014:00:00.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 01] add_size 200000 add_align 100000
[   13.813668] pci 0014:00:00.0: bridge window [mem 0x00100000-0x001fffff] to [bus 01] add_size 200000 add_align 100000
[   13.813698] pci 0014:00:00.0: bridge window [mem 0x6a0040000000-0x6a00402fffff]: assigned
[   13.813704] pci 0014:00:00.0: bridge window [mem 0x6a00c0000000-0x6a00c01fffff 64bit pref]: assigned
[   13.813711] pci 0014:00:00.0: bridge window [io  0x90000-0x90fff]: assigned
[   13.813752] pci 0014:01:00.0: ROM [mem 0x6a0040000000-0x6a004000ffff pref]: assigned
[   13.813760] pci 0014:01:00.0: BAR 0 [mem 0x6a0040010000-0x6a0040013fff 64bit]: assigned
[   13.813778] pci 0014:00:00.0: PCI bridge to [bus 01]
[   13.813783] pci 0014:00:00.0:   bridge window [io  0x90000-0x90fff]
[   13.813788] pci 0014:00:00.0:   bridge window [mem 0x6a0040000000-0x6a00402fffff]
[   13.813792] pci 0014:00:00.0:   bridge window [mem 0x6a00c0000000-0x6a00c01fffff 64bit pref]
[   13.813797] pci_bus 0014:00: resource 4 [mem 0x6a0040000000-0x6a00bfffffff window]
[   13.813800] pci_bus 0014:00: resource 5 [mem 0x6a00c0000000-0x6a7fffffffff window]
[   13.813803] pci_bus 0014:00: resource 6 [io  0x90000-0x9ffff window]
[   13.813805] pci_bus 0014:01: resource 0 [io  0x90000-0x90fff]
[   13.813807] pci_bus 0014:01: resource 1 [mem 0x6a0040000000-0x6a00402fffff]
[   13.813810] pci_bus 0014:01: resource 2 [mem 0x6a00c0000000-0x6a00c01fffff 64bit pref]
[   13.815506] ACPI: PCI Root Bridge [PC15] (domain 0015 [bus 00-ff])
[   13.815525] acpi PNP0A08:0a: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[   13.816362] acpi PNP0A08:0a: _OSC: platform does not support [PME AER DPC]
[   13.817718] acpi PNP0A08:0a: _OSC: OS now controls [PCIeHotplug PCIeCapability LTR]
[   13.826831] acpi PNP0A08:0a: ECAM area [mem 0x6a8010000000-0x6a801fffffff] reserved by PNP0C02:0c
[   13.844701] acpi PNP0A08:0a: ECAM at [mem 0x6a8010000000-0x6a801fffffff] for [bus 00-ff]
[   13.844851] ACPI: Remapped I/O 0x00006a8020000000 to [io  0xa0000-0xaffff window]
[   13.846048] PCI host bridge to bus 0015:00
[   13.846096] pci_bus 0015:00: root bus resource [mem 0x6a8040000000-0x6a80bfffffff window] (bus address [0x40000000-0xbfffffff])
[   13.846102] pci_bus 0015:00: root bus resource [mem 0x6a80c0000000-0x6affffffffff window]
[   13.846107] pci_bus 0015:00: root bus resource [io  0xa0000-0xaffff window] (bus address [0x0000-0xffff])
[   13.846117] pci_bus 0015:00: root bus resource [bus 00-ff]
[   13.846182] pci 0015:00:00.0: [10de:22b8] type 01 class 0x060400 PCIe Root Port
[   13.846206] pci 0015:00:00.0: PCI bridge to [bus 01]
[   13.846217] pci 0015:00:00.0:   bridge window [mem 0x6a8040000000-0x6a80400fffff]
[   13.846235] pci 0015:00:00.0: enabling Extended Tags
[   13.846385] pci 0015:00:00.0: PME# supported from D0 D3hot
[   13.851301] pci 0015:01:00.0: [144d:a80a] type 00 class 0x010802 PCIe Endpoint
[   13.851350] pci 0015:01:00.0: BAR 0 [mem 0x6a8040010000-0x6a8040013fff 64bit]
[   13.851361] pci 0015:01:00.0: ROM [mem 0x6a8040000000-0x6a804000ffff pref]
[   13.851371] pci 0015:01:00.0: enabling Extended Tags
[   13.852828] pci_bus 0015:00: on NUMA node 1
[   13.852837] pci 0015:00:00.0: bridge window [io  0x1000-0x0fff] to [bus 01] add_size 1000
[   13.852846] pci 0015:00:00.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 01] add_size 200000 add_align 100000
[   13.852854] pci 0015:00:00.0: bridge window [mem 0x00100000-0x001fffff] to [bus 01] add_size 200000 add_align 100000
[   13.852899] pci 0015:00:00.0: bridge window [mem 0x6a8040000000-0x6a80402fffff]: assigned
[   13.852905] pci 0015:00:00.0: bridge window [mem 0x6a80c0000000-0x6a80c01fffff 64bit pref]: assigned
[   13.852911] pci 0015:00:00.0: bridge window [io  0xa0000-0xa0fff]: assigned
[   13.852941] pci 0015:01:00.0: ROM [mem 0x6a8040000000-0x6a804000ffff pref]: assigned
[   13.852947] pci 0015:01:00.0: BAR 0 [mem 0x6a8040010000-0x6a8040013fff 64bit]: assigned
[   13.852965] pci 0015:00:00.0: PCI bridge to [bus 01]
[   13.852969] pci 0015:00:00.0:   bridge window [io  0xa0000-0xa0fff]
[   13.852974] pci 0015:00:00.0:   bridge window [mem 0x6a8040000000-0x6a80402fffff]
[   13.852978] pci 0015:00:00.0:   bridge window [mem 0x6a80c0000000-0x6a80c01fffff 64bit pref]
[   13.852983] pci_bus 0015:00: resource 4 [mem 0x6a8040000000-0x6a80bfffffff window]
[   13.852986] pci_bus 0015:00: resource 5 [mem 0x6a80c0000000-0x6affffffffff window]
[   13.852990] pci_bus 0015:00: resource 6 [io  0xa0000-0xaffff window]
[   13.852992] pci_bus 0015:01: resource 0 [io  0xa0000-0xa0fff]
[   13.852995] pci_bus 0015:01: resource 1 [mem 0x6a8040000000-0x6a80402fffff]
[   13.852997] pci_bus 0015:01: resource 2 [mem 0x6a80c0000000-0x6a80c01fffff 64bit pref]
[   13.854666] ACPI: PCI Root Bridge [PC16] (domain 0016 [bus 00-ff])
[   13.854684] acpi PNP0A08:0b: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[   13.855515] acpi PNP0A08:0b: _OSC: platform does not support [PME AER DPC]
[   13.856893] acpi PNP0A08:0b: _OSC: OS now controls [PCIeHotplug PCIeCapability LTR]
[   13.866130] acpi PNP0A08:0b: ECAM area [mem 0x6b0010000000-0x6b001fffffff] reserved by PNP0C02:0d
[   13.884692] acpi PNP0A08:0b: ECAM at [mem 0x6b0010000000-0x6b001fffffff] for [bus 00-ff]
[   13.884836] ACPI: Remapped I/O 0x00006b0020000000 to [io  0xb0000-0xbffff window]
[   13.886081] PCI host bridge to bus 0016:00
[   13.886131] pci_bus 0016:00: root bus resource [mem 0x6b0040000000-0x6b00bfffffff window] (bus address [0x40000000-0xbfffffff])
[   13.886137] pci_bus 0016:00: root bus resource [mem 0x6b00c0000000-0x6bffffffffff window]
[   13.886142] pci_bus 0016:00: root bus resource [io  0xb0000-0xbffff window] (bus address [0x0000-0xffff])
[   13.886153] pci_bus 0016:00: root bus resource [bus 00-ff]
[   13.886245] pci 0016:00:00.0: [10de:22b2] type 01 class 0x060400 PCIe Root Port
[   13.886280] pci 0016:00:00.0: PCI bridge to [bus 01]
[   13.886318] pci 0016:00:00.0: enabling Extended Tags
[   13.886501] pci 0016:00:00.0: PME# supported from D0 D3hot
[   13.891529] pci_bus 0016:00: on NUMA node 1
[   13.891541] pci 0016:00:00.0: bridge window [io  0x1000-0x0fff] to [bus 01] add_size 1000
[   13.891549] pci 0016:00:00.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 01] add_size 200000 add_align 100000
[   13.891556] pci 0016:00:00.0: bridge window [mem 0x00100000-0x000fffff] to [bus 01] add_size 200000 add_align 100000
[   13.891586] pci 0016:00:00.0: bridge window [mem 0x6b0040000000-0x6b00401fffff]: assigned
[   13.891592] pci 0016:00:00.0: bridge window [mem 0x6b00c0000000-0x6b00c01fffff 64bit pref]: assigned
[   13.891598] pci 0016:00:00.0: bridge window [io  0xb0000-0xb0fff]: assigned
[   13.891613] pci 0016:00:00.0: PCI bridge to [bus 01]
[   13.891617] pci 0016:00:00.0:   bridge window [io  0xb0000-0xb0fff]
[   13.891623] pci 0016:00:00.0:   bridge window [mem 0x6b0040000000-0x6b00401fffff]
[   13.891626] pci 0016:00:00.0:   bridge window [mem 0x6b00c0000000-0x6b00c01fffff 64bit pref]
[   13.891632] pci_bus 0016:00: resource 4 [mem 0x6b0040000000-0x6b00bfffffff window]
[   13.891636] pci_bus 0016:00: resource 5 [mem 0x6b00c0000000-0x6bffffffffff window]
[   13.891639] pci_bus 0016:00: resource 6 [io  0xb0000-0xbffff window]
[   13.891641] pci_bus 0016:01: resource 0 [io  0xb0000-0xb0fff]
[   13.891643] pci_bus 0016:01: resource 1 [mem 0x6b0040000000-0x6b00401fffff]
[   13.891646] pci_bus 0016:01: resource 2 [mem 0x6b00c0000000-0x6b00c01fffff 64bit pref]
[   13.892820] ACPI: PCI Root Bridge [PC18] (domain 0018 [bus 00-ff])
[   13.892837] acpi PNP0A08:0c: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[   13.893655] acpi PNP0A08:0c: _OSC: platform does not support [PME AER DPC]
[   13.895017] acpi PNP0A08:0c: _OSC: OS now controls [PCIeHotplug PCIeCapability LTR]
[   13.904355] acpi PNP0A08:0c: ECAM area [mem 0x6d0010000000-0x6d001fffffff] reserved by PNP0C02:0e
[   13.923171] acpi PNP0A08:0c: ECAM at [mem 0x6d0010000000-0x6d001fffffff] for [bus 00-ff]
[   13.923325] ACPI: Remapped I/O 0x00006d0020000000 to [io  0xc0000-0xcffff window]
[   13.924489] PCI host bridge to bus 0018:00
[   13.924542] pci_bus 0018:00: root bus resource [mem 0x6d0040000000-0x6d00bfffffff window] (bus address [0x40000000-0xbfffffff])
[   13.924547] pci_bus 0018:00: root bus resource [mem 0x6d00c0000000-0x6dffffffffff window]
[   13.924552] pci_bus 0018:00: root bus resource [io  0xc0000-0xcffff window] (bus address [0x0000-0xffff])
[   13.924562] pci_bus 0018:00: root bus resource [bus 00-ff]
[   13.924636] pci 0018:00:00.0: [10de:22b9] type 01 class 0x060400 PCIe Root Port
[   13.924667] pci 0018:00:00.0: PCI bridge to [bus 01]
[   13.924679] pci 0018:00:00.0:   bridge window [mem 0x6d0040000000-0x6d00400fffff]
[   13.924704] pci 0018:00:00.0: enabling Extended Tags
[   13.924887] pci 0018:00:00.0: PME# supported from D0 D3hot
[   13.929915] pci 0018:01:00.0: [1912:0014] type 00 class 0x0c0330 PCIe Endpoint
[   13.930032] pci 0018:01:00.0: BAR 0 [mem 0x6d0040000000-0x6d0040001fff 64bit]
[   13.930280] pci 0018:01:00.0: PME# supported from D0 D3hot D3cold
[   13.930427] pci 0018:01:00.0: 2.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s PCIe x1 link at 0018:00:00.0 (capable of 4.000 Gb/s with 5.0 GT/s PCIe x1 link)
[   13.931840] pci_bus 0018:00: on NUMA node 1
[   13.931850] pci 0018:00:00.0: bridge window [io  0x1000-0x0fff] to [bus 01] add_size 1000
[   13.931858] pci 0018:00:00.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 01] add_size 200000 add_align 100000
[   13.931863] pci 0018:00:00.0: bridge window [mem 0x00100000-0x001fffff] to [bus 01] add_size 100000 add_align 100000
[   13.931890] pci 0018:00:00.0: bridge window [mem 0x6d0040000000-0x6d00401fffff]: assigned
[   13.931896] pci 0018:00:00.0: bridge window [mem 0x6d00c0000000-0x6d00c01fffff 64bit pref]: assigned
[   13.931901] pci 0018:00:00.0: bridge window [io  0xc0000-0xc0fff]: assigned
[   13.931918] pci 0018:01:00.0: BAR 0 [mem 0x6d0040000000-0x6d0040001fff 64bit]: assigned
[   13.931943] pci 0018:00:00.0: PCI bridge to [bus 01]
[   13.931948] pci 0018:00:00.0:   bridge window [io  0xc0000-0xc0fff]
[   13.931952] pci 0018:00:00.0:   bridge window [mem 0x6d0040000000-0x6d00401fffff]
[   13.931956] pci 0018:00:00.0:   bridge window [mem 0x6d00c0000000-0x6d00c01fffff 64bit pref]
[   13.931961] pci_bus 0018:00: resource 4 [mem 0x6d0040000000-0x6d00bfffffff window]
[   13.931963] pci_bus 0018:00: resource 5 [mem 0x6d00c0000000-0x6dffffffffff window]
[   13.931965] pci_bus 0018:00: resource 6 [io  0xc0000-0xcffff window]
[   13.931967] pci_bus 0018:01: resource 0 [io  0xc0000-0xc0fff]
[   13.931969] pci_bus 0018:01: resource 1 [mem 0x6d0040000000-0x6d00401fffff]
[   13.931970] pci_bus 0018:01: resource 2 [mem 0x6d00c0000000-0x6d00c01fffff 64bit pref]
[   13.948201] iommu: Default domain type: Translated
[   13.948208] iommu: DMA domain TLB invalidation policy: lazy mode
[   13.971794] SCSI subsystem initialized
[   13.972857] libata version 3.00 loaded.
[   13.973500] ACPI: bus type USB registered
[   13.974070] usbcore: registered new interface driver usbfs
[   13.974328] usbcore: registered new interface driver hub
[   13.975081] usbcore: registered new device driver usb
[   13.976060] pps_core: LinuxPPS API ver. 1 registered
[   13.976063] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[   13.976120] PTP clock support registered
[   13.978563] EDAC MC: Ver: 3.0.0
[   13.979586] EDAC DEBUG: edac_mc_sysfs_init: device mc created
[   13.980257] scmi_core: SCMI protocol bus registered
[   13.981072] efivars: Registered efivars operations
[   14.022292] NetLabel: Initializing
[   14.022297] NetLabel:  domain hash size = 128
[   14.022300] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[   14.022558] NetLabel:  unlabeled traffic allowed by default
[   14.023596] pci 0008:02:00.0: vgaarb: setting as boot VGA device
[   14.023601] pci 0008:02:00.0: vgaarb: bridge control possible
[   14.023604] pci 0008:02:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
[   14.023659] vgaarb: loaded
[   14.036860] clocksource: Switched to clocksource arch_sys_counter
[   14.038425] MPAM enabled with 1 PARTIDs and 1 PMGs
[   14.052828] VFS: Disk quotas dquot_6.6.0
[   14.053460] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[   14.061988] pnp: PnP ACPI init
[   14.068277] system 00:00: [mem 0x600010000000-0x60001fffffff window] could not be reserved
[   14.069329] system 00:01: [mem 0x608010000000-0x60801fffffff window] could not be reserved
[   14.070245] system 00:02: [mem 0x610010000000-0x61001fffffff window] could not be reserved
[   14.071160] system 00:03: [mem 0x620010000000-0x62001fffffff window] could not be reserved
[   14.072031] system 00:04: [mem 0x630010000000-0x63001fffffff window] could not be reserved
[   14.072939] system 00:05: [mem 0x650010000000-0x65001fffffff window] could not be reserved
[   14.073868] system 00:06: [mem 0x680010000000-0x68001fffffff window] could not be reserved
[   14.074770] system 00:07: [mem 0x688010000000-0x68801fffffff window] could not be reserved
[   14.075645] system 00:08: [mem 0x690010000000-0x69001fffffff window] could not be reserved
[   14.076540] system 00:09: [mem 0x6a0010000000-0x6a001fffffff window] could not be reserved
[   14.077456] system 00:0a: [mem 0x6a8010000000-0x6a801fffffff window] could not be reserved
[   14.078428] system 00:0b: [mem 0x6b0010000000-0x6b001fffffff window] could not be reserved
[   14.079327] system 00:0c: [mem 0x6d0010000000-0x6d001fffffff window] could not be reserved
[   14.079403] pnp: PnP ACPI: found 13 devices
[   14.124277] NET: Registered PF_INET protocol family
[   14.125043] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc hugepage)
[   14.141361] tcp_listen_portaddr_hash hash table entries: 65536 (order: 12, 9961472 bytes, vmalloc hugepage)
[   14.144173] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, vmalloc hugepage)
[   14.145864] TCP established hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc hugepage)
[   14.148018] TCP bind hash table entries: 65536 (order: 13, 19922944 bytes, vmalloc hugepage)
[   14.151738] TCP: Hash tables configured (established 524288 bind 65536)
[   14.161221] MPTCP token hash table entries: 65536 (order: 12, 11010048 bytes, vmalloc hugepage)
[   14.166562] UDP hash table entries: 65536 (order: 13, 32505856 bytes, vmalloc hugepage)
[   14.177469] UDP-Lite hash table entries: 65536 (order: 13, 32505856 bytes, vmalloc hugepage)
[   14.194046] NET: Registered PF_UNIX/PF_LOCAL protocol family
[   14.194197] NET: Registered PF_XDP protocol family
[   14.195255] PCI: CLS 64 bytes, default 64
[   14.195696] ACPI: bus type thunderbolt registered
[   14.196240] Trying to unpack rootfs image as initramfs...
[   14.229790] kvm [1]: nv: 568 coarse grained trap handlers
[   14.231217] kvm [1]: IPA Size Limit: 48 bits
[   14.231324] kvm [1]: GICv4 support disabled
[   14.231327] kvm [1]: GICv3: no GICV resource entry
[   14.231329] kvm [1]: disabling GICv2 emulation
[   14.231454] kvm [1]: GIC system register CPU interface enabled
[   14.231506] kvm [1]: vgic interrupt IRQ9
[   14.231743] kvm [1]: VHE mode initialized successfully
[   14.311503] Initialise system trusted keyrings
[   14.311851] Key type blacklist registered
[   14.312631] workingset: timestamp_bits=37 max_order=27 bucket_order=0
[   14.324662] integrity: Platform Keyring initialized
[   14.324717] integrity: Machine keyring initialized
[   14.326512] cryptd: max_cpu_qlen set to 1000
[   14.328157] cryptomgr_test (1509) used greatest stack depth: 28640 bytes left
[   14.337719] NET: Registered PF_ALG protocol family
[   14.337875] Key type asymmetric registered
[   14.337913] Asymmetric key parser 'x509' registered
[   14.338778] cryptomgr_test (1510) used greatest stack depth: 28208 bytes left
[   14.339586] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243)
[   14.340805] io scheduler mq-deadline registered
[   14.340815] io scheduler kyber registered
[   14.341924] io scheduler bfq registered
[   14.347860] atomic64_test: passed
[   14.637088] thermal LNXTHERM:00: registered as thermal_zone0
[   14.637101] ACPI: thermal: Thermal Zone [TZ00] (51 C)
[   14.644362] thermal LNXTHERM:01: registered as thermal_zone1
[   14.644373] ACPI: thermal: Thermal Zone [TZ01] (52 C)
[   14.657834] thermal LNXTHERM:02: registered as thermal_zone2
[   14.657846] ACPI: thermal: Thermal Zone [TZ02] (51 C)
[   14.664993] thermal LNXTHERM:03: registered as thermal_zone3
[   14.665003] ACPI: thermal: Thermal Zone [TZ03] (53 C)
[   14.672188] thermal LNXTHERM:04: registered as thermal_zone4
[   14.672197] ACPI: thermal: Thermal Zone [TZ04] (52 C)
[   14.679409] thermal LNXTHERM:05: registered as thermal_zone5
[   14.679420] ACPI: thermal: Thermal Zone [TZ05] (52 C)
[   14.686558] thermal LNXTHERM:06: registered as thermal_zone6
[   14.686568] ACPI: thermal: Thermal Zone [TZ06] (52 C)
[   14.693859] thermal LNXTHERM:07: registered as thermal_zone7
[   14.693871] ACPI: thermal: Thermal Zone [TZ07] (47 C)
[   14.702863] thermal LNXTHERM:08: registered as thermal_zone8
[   14.702872] ACPI: thermal: Thermal Zone [TZ08] (42 C)
[   14.710743] thermal LNXTHERM:09: registered as thermal_zone9
[   14.710754] ACPI: thermal: Thermal Zone [TZ09] (53 C)
[   14.717927] thermal LNXTHERM:0a: registered as thermal_zone10
[   14.717936] ACPI: thermal: Thermal Zone [TZ0A] (40 C)
[   14.725097] thermal LNXTHERM:0b: registered as thermal_zone11
[   14.725108] ACPI: thermal: Thermal Zone [TZ0B] (43 C)
[   14.732262] thermal LNXTHERM:0c: registered as thermal_zone12
[   14.732272] ACPI: thermal: Thermal Zone [TZ0C] (48 C)
[   14.739258] thermal LNXTHERM:0d: registered as thermal_zone13
[   14.739270] ACPI: thermal: Thermal Zone [TZ0D] (47 C)
[   14.746203] thermal LNXTHERM:0e: registered as thermal_zone14
[   14.746213] ACPI: thermal: Thermal Zone [TZ0E] (48 C)
[   14.758918] thermal LNXTHERM:0f: registered as thermal_zone15
[   14.758932] ACPI: thermal: Thermal Zone [TZ0F] (49 C)
[   14.765823] thermal LNXTHERM:10: registered as thermal_zone16
[   14.765834] ACPI: thermal: Thermal Zone [TZ10] (47 C)
[   14.776649] thermal LNXTHERM:11: registered as thermal_zone17
[   14.776659] ACPI: thermal: Thermal Zone [TZ11] (47 C)
[   14.789645] thermal LNXTHERM:12: registered as thermal_zone18
[   14.789658] ACPI: thermal: Thermal Zone [TZ12] (47 C)
[   14.801055] thermal LNXTHERM:13: registered as thermal_zone19
[   14.801067] ACPI: thermal: Thermal Zone [TZ13] (44 C)
[   14.810280] thermal LNXTHERM:14: registered as thermal_zone20
[   14.810293] ACPI: thermal: Thermal Zone [TZ14] (39 C)
[   14.819751] thermal LNXTHERM:15: registered as thermal_zone21
[   14.819761] ACPI: thermal: Thermal Zone [TZ15] (49 C)
[   14.826574] thermal LNXTHERM:16: registered as thermal_zone22
[   14.826584] ACPI: thermal: Thermal Zone [TZ16] (37 C)
[   14.840370] thermal LNXTHERM:17: registered as thermal_zone23
[   14.840381] ACPI: thermal: Thermal Zone [TZ17] (39 C)
[   14.843280] thermal LNXTHERM:18: registered as thermal_zone24
[   14.843290] ACPI: thermal: Thermal Zone [TZL0] (47 C)
[   14.845896] thermal LNXTHERM:19: registered as thermal_zone25
[   14.845905] ACPI: thermal: Thermal Zone [TZL1] (51 C)
[   14.847312] ERST: Error Record Serialization Table (ERST) support is initialized.
[   14.847559] pstore: Using crash dump compression: deflate
[   14.847645] pstore: Registered erst as persistent store backend
[   14.848947] ACPI GTDT: found 1 SBSA generic Watchdog(s).
[   14.873675] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[   14.895135] arm-smmu-v3 arm-smmu-v3.10.auto: found companion CMDQV device: NVDA200C:00
[   14.895146] arm-smmu-v3 arm-smmu-v3.10.auto: option mask 0x10
[   14.896615] arm-smmu-v3 arm-smmu-v3.10.auto: ias 48-bit, oas 48-bit (features 0x001e1fbf)
[   14.896939] arm-smmu-v3 arm-smmu-v3.10.auto: allocated 65536 entries for cmdq
[   14.897073] arm-smmu-v3 arm-smmu-v3.10.auto: allocated 32768 entries for evtq
[   14.897843] arm-smmu-v3 arm-smmu-v3.10.auto: allocated 65536 entries for priq
[   14.899287] arm-smmu-v3 arm-smmu-v3.10.auto: allocated 65536 entries for vcmdq0
[   14.899401] arm-smmu-v3 arm-smmu-v3.10.auto: allocated 65536 entries for vcmdq1
[   14.899563] arm-smmu-v3 arm-smmu-v3.10.auto: msi_domain absent - falling back to wired irqs
[   14.900479] arm-smmu-v3 arm-smmu-v3.10.auto: no priq irq - PRI will be broken
[   14.904394] platform NVDA2006:00: Adding to iommu group 0
[   14.904852] platform NVDA2003:00: Adding to iommu group 1
[   14.905331] platform NVDA1513:00: Adding to iommu group 2
[   14.931315] pci 0000:00:00.0: Adding to iommu group 3
[   14.932719] pci 0001:00:00.0: Adding to iommu group 4
[   14.945938] arm-smmu-v3 arm-smmu-v3.11.auto: found companion CMDQV device: NVDA200C:01
[   14.945945] arm-smmu-v3 arm-smmu-v3.11.auto: option mask 0x10
[   14.947144] arm-smmu-v3 arm-smmu-v3.11.auto: ias 48-bit, oas 48-bit (features 0x001e1fbf)
[   14.947209] arm-smmu-v3 arm-smmu-v3.11.auto: allocated 65536 entries for cmdq
[   14.947286] arm-smmu-v3 arm-smmu-v3.11.auto: allocated 32768 entries for evtq
[   14.948058] arm-smmu-v3 arm-smmu-v3.11.auto: allocated 65536 entries for priq
[   14.948186] arm-smmu-v3 arm-smmu-v3.11.auto: allocated 65536 entries for vcmdq0
[   14.948248] arm-smmu-v3 arm-smmu-v3.11.auto: allocated 65536 entries for vcmdq1
[   14.948290] arm-smmu-v3 arm-smmu-v3.11.auto: msi_domain absent - falling back to wired irqs
[   14.948853] arm-smmu-v3 arm-smmu-v3.11.auto: no priq irq - PRI will be broken
[   14.953564] pci 0002:00:00.0: Adding to iommu group 5
[   14.961017] arm-smmu-v3 arm-smmu-v3.12.auto: found companion CMDQV device: NVDA200C:02
[   14.961023] arm-smmu-v3 arm-smmu-v3.12.auto: option mask 0x10
[   14.962087] arm-smmu-v3 arm-smmu-v3.12.auto: ias 48-bit, oas 48-bit (features 0x001e1fbf)
[   14.962142] arm-smmu-v3 arm-smmu-v3.12.auto: allocated 65536 entries for cmdq
[   14.962202] arm-smmu-v3 arm-smmu-v3.12.auto: allocated 32768 entries for evtq
[   14.962797] arm-smmu-v3 arm-smmu-v3.12.auto: allocated 65536 entries for priq
[   14.962923] arm-smmu-v3 arm-smmu-v3.12.auto: allocated 65536 entries for vcmdq0
[   14.962994] arm-smmu-v3 arm-smmu-v3.12.auto: allocated 65536 entries for vcmdq1
[   14.963019] arm-smmu-v3 arm-smmu-v3.12.auto: msi_domain absent - falling back to wired irqs
[   14.963581] arm-smmu-v3 arm-smmu-v3.12.auto: no priq irq - PRI will be broken
[   14.972459] pci 0004:00:00.0: Adding to iommu group 6
[   14.972874] pci 0006:00:00.0: Adding to iommu group 7
[   14.973323] pci 0006:01:00.0: Adding to iommu group 8
[   14.973753] pci 0006:01:00.1: Adding to iommu group 9
[   14.996392] arm-smmu-v3 arm-smmu-v3.13.auto: found companion CMDQV device: NVDA200C:03
[   14.996399] arm-smmu-v3 arm-smmu-v3.13.auto: option mask 0x10
[   14.997539] arm-smmu-v3 arm-smmu-v3.13.auto: ias 48-bit, oas 48-bit (features 0x001e1fbf)
[   14.997599] arm-smmu-v3 arm-smmu-v3.13.auto: allocated 65536 entries for cmdq
[   14.997676] arm-smmu-v3 arm-smmu-v3.13.auto: allocated 32768 entries for evtq
[   14.998294] arm-smmu-v3 arm-smmu-v3.13.auto: allocated 65536 entries for priq
[   14.998420] arm-smmu-v3 arm-smmu-v3.13.auto: allocated 65536 entries for vcmdq0
[   14.998480] arm-smmu-v3 arm-smmu-v3.13.auto: allocated 65536 entries for vcmdq1
[   14.998521] arm-smmu-v3 arm-smmu-v3.13.auto: msi_domain absent - falling back to wired irqs
[   14.999073] arm-smmu-v3 arm-smmu-v3.13.auto: no priq irq - PRI will be broken
[   15.044276] arm-smmu-v3 arm-smmu-v3.14.auto: found companion CMDQV device: NVDA200C:04
[   15.044282] arm-smmu-v3 arm-smmu-v3.14.auto: option mask 0x10
[   15.045363] arm-smmu-v3 arm-smmu-v3.14.auto: ias 48-bit, oas 48-bit (features 0x001e1fbf)
[   15.045420] arm-smmu-v3 arm-smmu-v3.14.auto: allocated 65536 entries for cmdq
[   15.045478] arm-smmu-v3 arm-smmu-v3.14.auto: allocated 32768 entries for evtq
[   15.046082] arm-smmu-v3 arm-smmu-v3.14.auto: allocated 65536 entries for priq
[   15.046285] arm-smmu-v3 arm-smmu-v3.14.auto: allocated 65536 entries for vcmdq0
[   15.046356] arm-smmu-v3 arm-smmu-v3.14.auto: allocated 65536 entries for vcmdq1
[   15.046380] arm-smmu-v3 arm-smmu-v3.14.auto: msi_domain absent - falling back to wired irqs
[   15.046989] arm-smmu-v3 arm-smmu-v3.14.auto: no priq irq - PRI will be broken
[   15.061965] pci 0008:00:00.0: Adding to iommu group 10
[   15.062384] pci 0008:01:00.0: Adding to iommu group 11
[   15.062700] pci 0008:02:00.0: Adding to iommu group 11
[   15.076183] arm-smmu-v3 arm-smmu-v3.15.auto: found companion CMDQV device: NVDA200C:05
[   15.076189] arm-smmu-v3 arm-smmu-v3.15.auto: option mask 0x10
[   15.080475] arm-smmu-v3 arm-smmu-v3.15.auto: ias 48-bit, oas 48-bit (features 0x001e1fbf)
[   15.080592] arm-smmu-v3 arm-smmu-v3.15.auto: allocated 65536 entries for cmdq
[   15.080715] arm-smmu-v3 arm-smmu-v3.15.auto: allocated 32768 entries for evtq
[   15.081348] arm-smmu-v3 arm-smmu-v3.15.auto: allocated 65536 entries for priq
[   15.081595] arm-smmu-v3 arm-smmu-v3.15.auto: allocated 65536 entries for vcmdq0
[   15.081701] arm-smmu-v3 arm-smmu-v3.15.auto: allocated 65536 entries for vcmdq1
[   15.081744] arm-smmu-v3 arm-smmu-v3.15.auto: msi_domain absent - falling back to wired irqs
[   15.082280] arm-smmu-v3 arm-smmu-v3.15.auto: no priq irq - PRI will be broken
[   15.086164] pci 0010:00:00.0: Adding to iommu group 12
[   15.086579] pci 0011:00:00.0: Adding to iommu group 13
[   15.098427] arm-smmu-v3 arm-smmu-v3.16.auto: found companion CMDQV device: NVDA200C:06
[   15.098433] arm-smmu-v3 arm-smmu-v3.16.auto: option mask 0x10
[   15.100021] arm-smmu-v3 arm-smmu-v3.16.auto: ias 48-bit, oas 48-bit (features 0x001e1fbf)
[   15.100148] arm-smmu-v3 arm-smmu-v3.16.auto: allocated 65536 entries for cmdq
[   15.100256] arm-smmu-v3 arm-smmu-v3.16.auto: allocated 32768 entries for evtq
[   15.100925] arm-smmu-v3 arm-smmu-v3.16.auto: allocated 65536 entries for priq
[   15.101172] arm-smmu-v3 arm-smmu-v3.16.auto: allocated 65536 entries for vcmdq0
[   15.101299] arm-smmu-v3 arm-smmu-v3.16.auto: allocated 65536 entries for vcmdq1
[   15.101328] arm-smmu-v3 arm-smmu-v3.16.auto: msi_domain absent - falling back to wired irqs
[   15.101909] arm-smmu-v3 arm-smmu-v3.16.auto: no priq irq - PRI will be broken
[   15.105791] pci 0012:00:00.0: Adding to iommu group 14
[   15.112668] arm-smmu-v3 arm-smmu-v3.17.auto: found companion CMDQV device: NVDA200C:07
[   15.112675] arm-smmu-v3 arm-smmu-v3.17.auto: option mask 0x10
[   15.113764] arm-smmu-v3 arm-smmu-v3.17.auto: ias 48-bit, oas 48-bit (features 0x001e1fbf)
[   15.113869] arm-smmu-v3 arm-smmu-v3.17.auto: allocated 65536 entries for cmdq
[   15.113987] arm-smmu-v3 arm-smmu-v3.17.auto: allocated 32768 entries for evtq
[   15.114618] arm-smmu-v3 arm-smmu-v3.17.auto: allocated 65536 entries for priq
[   15.114884] arm-smmu-v3 arm-smmu-v3.17.auto: allocated 65536 entries for vcmdq0
[   15.114992] arm-smmu-v3 arm-smmu-v3.17.auto: allocated 65536 entries for vcmdq1
[   15.115033] arm-smmu-v3 arm-smmu-v3.17.auto: msi_domain absent - falling back to wired irqs
[   15.115591] arm-smmu-v3 arm-smmu-v3.17.auto: no priq irq - PRI will be broken
[   15.119578] pci 0014:00:00.0: Adding to iommu group 15
[   15.120013] pci 0014:01:00.0: Adding to iommu group 16
[   15.120446] pci 0015:00:00.0: Adding to iommu group 17
[   15.120861] pci 0015:01:00.0: Adding to iommu group 18
[   15.121273] pci 0016:00:00.0: Adding to iommu group 19
[   15.151294] arm-smmu-v3 arm-smmu-v3.18.auto: found companion CMDQV device: NVDA200C:08
[   15.151301] arm-smmu-v3 arm-smmu-v3.18.auto: option mask 0x10
[   15.152473] arm-smmu-v3 arm-smmu-v3.18.auto: ias 48-bit, oas 48-bit (features 0x001e1fbf)
[   15.152577] arm-smmu-v3 arm-smmu-v3.18.auto: allocated 65536 entries for cmdq
[   15.152701] arm-smmu-v3 arm-smmu-v3.18.auto: allocated 32768 entries for evtq
[   15.153358] arm-smmu-v3 arm-smmu-v3.18.auto: allocated 65536 entries for priq
[   15.153608] arm-smmu-v3 arm-smmu-v3.18.auto: allocated 65536 entries for vcmdq0
[   15.153727] arm-smmu-v3 arm-smmu-v3.18.auto: allocated 65536 entries for vcmdq1
[   15.153756] arm-smmu-v3 arm-smmu-v3.18.auto: msi_domain absent - falling back to wired irqs
[   15.154322] arm-smmu-v3 arm-smmu-v3.18.auto: no priq irq - PRI will be broken
[   15.168889] arm-smmu-v3 arm-smmu-v3.19.auto: found companion CMDQV device: NVDA200C:09
[   15.168895] arm-smmu-v3 arm-smmu-v3.19.auto: option mask 0x10
[   15.171586] arm-smmu-v3 arm-smmu-v3.19.auto: ias 48-bit, oas 48-bit (features 0x001e1fbf)
[   15.171695] arm-smmu-v3 arm-smmu-v3.19.auto: allocated 65536 entries for cmdq
[   15.171811] arm-smmu-v3 arm-smmu-v3.19.auto: allocated 32768 entries for evtq
[   15.172451] arm-smmu-v3 arm-smmu-v3.19.auto: allocated 65536 entries for priq
[   15.172697] arm-smmu-v3 arm-smmu-v3.19.auto: allocated 65536 entries for vcmdq0
[   15.172802] arm-smmu-v3 arm-smmu-v3.19.auto: allocated 65536 entries for vcmdq1
[   15.172846] arm-smmu-v3 arm-smmu-v3.19.auto: msi_domain absent - falling back to wired irqs
[   15.173397] arm-smmu-v3 arm-smmu-v3.19.auto: no priq irq - PRI will be broken
[   15.187240] pci 0018:00:00.0: Adding to iommu group 20
[   15.188156] pci 0018:01:00.0: Adding to iommu group 21
[   15.202548] ACPI: bus type drm_connector registered
[   15.625312] rdac: device handler registered
[   15.625855] hp_sw: device handler registered
[   15.625864] emc: device handler registered
[   15.626752] alua: device handler registered
[   16.312224] Freeing initrd memory: 168740K
[   16.477519] tegra-qspi NVDA1513:00: Looking for DMA channel "rx" at index 1...
[   16.587631] tegra-qspi NVDA1513:00: cannot use DMA: -19
[   16.587635] tegra-qspi NVDA1513:00: falling back to PIO
[   16.587684] tegra-qspi NVDA1513:00: device reset failed
[   16.589200] tegra-qspi NVDA1513:00: registered host spi0
[   16.885557] xhci-pci-renesas 0018:01:00.0: failed to load firmware renesas_usb_fw.mem, fallback to ROM
[   16.886049] xhci-pci-renesas 0018:01:00.0: xHCI Host Controller
[   16.887574] xhci-pci-renesas 0018:01:00.0: new USB bus registered, assigned bus number 1
[   16.887697] xhci-pci-renesas 0018:01:00.0: Zeroing 64bit base registers, expecting fault
[   16.887805] xhci-pci-renesas 0018:01:00.0: Fault detected
[   16.887857] arm-smmu-v3 arm-smmu-v3.19.auto: event 0x10 received:
[   16.887863] arm-smmu-v3 arm-smmu-v3.19.auto: 	0x0001010000000010
[   16.887866] arm-smmu-v3 arm-smmu-v3.19.auto: 	0x0000020800000000
[   16.887868] arm-smmu-v3 arm-smmu-v3.19.auto: 	0x0000000000000000
[   16.887871] arm-smmu-v3 arm-smmu-v3.19.auto: 	0x0000000000000000
[   16.887874] arm-smmu-v3 arm-smmu-v3.19.auto: event: F_TRANSLATION client: 0018:01:00.0 sid: 0x10100 ssid: 0x0 iova: 0x0 ipa: 0x0
[   16.887878] arm-smmu-v3 arm-smmu-v3.19.auto: unpriv data read s1 "Input address caused fault" stag: 0x0
[   17.000303] xhci-pci-renesas 0018:01:00.0: hcc params 0x014051cf hci version 0x100 quirks 0x0000000100000010
[   17.008544] xhci-pci-renesas 0018:01:00.0: xHCI Host Controller
[   17.009633] xhci-pci-renesas 0018:01:00.0: new USB bus registered, assigned bus number 2
[   17.009665] xhci-pci-renesas 0018:01:00.0: Host supports USB 3.0 SuperSpeed
[   17.011070] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.19
[   17.011081] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[   17.011083] usb usb1: Product: xHCI Host Controller
[   17.011086] usb usb1: Manufacturer: Linux 6.19.0-rc6-test+ xhci-hcd
[   17.011088] usb usb1: SerialNumber: 0018:01:00.0
[   17.014461] hub 1-0:1.0: USB hub found
[   17.014745] hub 1-0:1.0: 4 ports detected
[   17.019352] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[   17.019758] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 6.19
[   17.019763] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[   17.019766] usb usb2: Product: xHCI Host Controller
[   17.019768] usb usb2: Manufacturer: Linux 6.19.0-rc6-test+ xhci-hcd
[   17.019770] usb usb2: SerialNumber: 0018:01:00.0
[   17.022521] hub 2-0:1.0: USB hub found
[   17.022632] hub 2-0:1.0: 4 ports detected
[   17.028150] usbcore: registered new interface driver usbserial_generic
[   17.028460] usbserial: USB Serial support registered for generic
[   17.030201] mousedev: PS/2 mouse device common for all mice
[   17.034296] rtc-efi rtc-efi.0: registered as rtc0
[   17.034995] rtc-efi rtc-efi.0: setting system clock to 2026-01-22T03:40:56 UTC (1769053256)
[   17.041245] EDAC DEBUG: assign_dmi_dimm_info: DIMM0: Registered-SDR size = 245760 MB(ECC)
[   17.041252] EDAC DEBUG: assign_dmi_dimm_info: 	type 35, detail 0x2080, width 576(total 512)
[   17.041256] EDAC DEBUG: assign_dmi_dimm_info: DIMM1: Registered-SDR size = 245760 MB(ECC)
[   17.041259] EDAC DEBUG: assign_dmi_dimm_info: 	type 35, detail 0x2080, width 576(total 512)
[   17.041424] ghes_edac: This system has 2 DIMM sockets.
[   17.041429] EDAC DEBUG: edac_mc_add_mc_with_groups: 
[   17.042004] EDAC DEBUG: edac_create_sysfs_mci_device: device mc0 created
[   17.042465] EDAC DEBUG: edac_create_dimm_object: device dimm0 created at location memory 0 
[   17.042838] EDAC DEBUG: edac_create_dimm_object: device dimm1 created at location memory 1 
[   17.043116] EDAC MC0: Giving out device to module ghes_edac.c controller ghes_edac: DEV ghes (INTERRUPT)
[   17.059000] simple-framebuffer simple-framebuffer.0: [drm] Registered 1 planes with drm panic
[   17.059843] [drm] Initialized simpledrm 1.0.0 for simple-framebuffer.0 on minor 0
[   17.093550] Console: switching to colour frame buffer device 128x48
[   17.107338] simple-framebuffer simple-framebuffer.0: [drm] fb0: simpledrmdrmfb frame buffer device
[   17.112360] SMCCC: SOC_ID: ID = jep106:036b:0241 Revision = 0x00000002
[   17.115460] hid: raw HID events driver (C) Jiri Kosina
[   17.116646] usbcore: registered new interface driver usbhid
[   17.116649] usbhid: USB HID core driver
[   17.128031] hw perfevents: enabled with armv8_pmuv3_0 PMU driver, 7 (0,8000003f) counters available
[   17.128396] watchdog: NMI not fully supported
[   17.128399] watchdog: Hard watchdog permanently disabled
[   17.138973] drop_monitor: Initializing network drop monitor service
[   17.139546] Initializing XFRM netlink socket
[   17.142773] NET: Registered PF_INET6 protocol family
[   17.158311] Segment Routing with IPv6
[   17.158471] In-situ OAM (IOAM) with IPv6
[   17.158608] NET: Registered PF_PACKET protocol family
[   17.158982] mpls_gso: MPLS GSO support
[   17.256517] registered taskstats version 1
[   17.285672] Loading compiled-in X.509 certificates
[   17.293041] cryptomgr_test (1589) used greatest stack depth: 27872 bytes left
[   17.293395] cryptomgr_probe (1588) used greatest stack depth: 27392 bytes left
[   17.294107] Loaded X.509 cert 'Build time autogenerated kernel key: 29b45c195cee3562dd86b40c016f3fd6174d1994'
[   17.387730] usb 2-2: new SuperSpeed USB device number 2 using xhci-pci-renesas
[   17.410816] usb 2-2: New USB device found, idVendor=0451, idProduct=8140, bcdDevice= 1.00
[   17.410826] usb 2-2: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[   17.425633] hub 2-2:1.0: USB hub found
[   17.426256] hub 2-2:1.0: 4 ports detected
[   17.468145] Demotion targets for Node 0: null
[   17.468150] Demotion targets for Node 1: null
[   17.468905] debug_vm_pgtable: [debug_vm_pgtable         ]: Validating architecture page table helpers
[   17.469320] page_owner is disabled
[   17.471684] Key type .fscrypt registered
[   17.471691] Key type fscrypt-provisioning registered
[   17.474044] Key type big_key registered
[   17.474809] Key type encrypted registered
[   17.474860] cryptomgr_test (1594) used greatest stack depth: 27312 bytes left
[   17.475375] ima: secureboot mode disabled
[   17.475423] ima: No TPM chip found, activating TPM-bypass!
[   17.475468] Loading compiled-in module X.509 certificates
[   17.476159] Loaded X.509 cert 'Build time autogenerated kernel key: 29b45c195cee3562dd86b40c016f3fd6174d1994'
[   17.476555] ima: Allocated hash algorithm: sha256
[   17.477303] ima: No architecture policies found
[   17.477736] evm: Initialising EVM extended attributes:
[   17.477740] evm: security.selinux
[   17.477744] evm: security.SMACK64 (disabled)
[   17.477746] evm: security.SMACK64EXEC (disabled)
[   17.477749] evm: security.SMACK64TRANSMUTE (disabled)
[   17.477750] evm: security.SMACK64MMAP (disabled)
[   17.477752] evm: security.apparmor (disabled)
[   17.477754] evm: security.ima
[   17.477756] evm: security.capability
[   17.477758] evm: HMAC attrs: 0x1
[   17.481065] cryptomgr_test (1600) used greatest stack depth: 26976 bytes left
[   17.491375] cryptomgr_test (1648) used greatest stack depth: 26832 bytes left
[   17.491720] cryptomgr_test (1649) used greatest stack depth: 26096 bytes left
[   17.493114] Running certificate verification RSA selftest
[   17.493954] cryptomgr_test (1608) used greatest stack depth: 25936 bytes left
[   17.494500] cryptomgr_test (1659) used greatest stack depth: 25552 bytes left
[   17.500355] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db'
[   17.500956] Running certificate verification ECDSA selftest
[   17.530006] Loaded X.509 cert 'Certificate verification ECDSA self-testing key: 2900bcea1deb7bc8479a84a23d758efdfdd2b2d3'
[   17.679637] pcieport 0000:00:00.0: pciehp: Slot #0 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[   17.684376] pcieport 0001:00:00.0: pciehp: Slot #1 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[   17.688081] pcieport 0002:00:00.0: pciehp: Slot #2 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[   17.691345] pcieport 0004:00:00.0: pciehp: Slot #4 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[   17.694598] pcieport 0006:00:00.0: pciehp: Slot #6 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[   17.769325] pcieport 0008:00:00.0: pciehp: Slot #8 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[   17.779260] pcieport 0010:00:00.0: pciehp: Slot #16 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[   17.782859] pcieport 0011:00:00.0: pciehp: Slot #17 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[   17.786608] pcieport 0012:00:00.0: pciehp: Slot #18 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[   17.791204] pcieport 0014:00:00.0: pciehp: Slot #20 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[   17.795629] pcieport 0015:00:00.0: pciehp: Slot #21 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[   17.801467] pcieport 0016:00:00.0: pciehp: Slot #22 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[   17.805979] pcieport 0018:00:00.0: pciehp: Slot #24 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[   17.812422] clk: Disabling unused clocks
[   17.812511] PM: genpd: Disabling unused power domains
[   17.922370] Freeing unused kernel memory: 22912K
[   17.956783] usb 1-1: new high-speed USB device number 2 using xhci-pci-renesas
[   18.110142] usb 1-1: New USB device found, idVendor=1d6b, idProduct=0107, bcdDevice= 1.00
[   18.110148] usb 1-1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[   18.110151] usb 1-1: Product: USB Virtual Hub
[   18.110154] usb 1-1: Manufacturer: Aspeed
[   18.110156] usb 1-1: SerialNumber: 00000000
[   18.115967] hub 1-1:1.0: USB hub found
[   18.116519] hub 1-1:1.0: 7 ports detected
[   18.246731] usb 1-2: new high-speed USB device number 3 using xhci-pci-renesas
[   18.400147] usb 1-2: New USB device found, idVendor=0451, idProduct=8142, bcdDevice= 1.00
[   18.400151] usb 1-2: New USB device strings: Mfr=0, Product=0, SerialNumber=1
[   18.400154] usb 1-2: SerialNumber: A8061861A4FD
[   18.405542] hub 1-2:1.0: USB hub found
[   18.406020] hub 1-2:1.0: 4 ports detected
[   19.254459] Checked W+X mappings: passed, no W+X pages found
[   19.254503] Run /init as init process
[   19.254506]   with arguments:
[   19.254509]     /init
[   19.254511]   with environment:
[   19.254512]     HOME=/
[   19.254513]     TERM=linux
[   19.406742] usb 1-1.1: new high-speed USB device number 4 using xhci-pci-renesas
[   19.466348] systemd[1]: systemd 252-64.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[   19.471296] systemd[1]: Detected architecture arm64.
[   19.471307] systemd[1]: Running in initrd.
[   19.539832] usb 1-1.1: New USB device found, idVendor=0557, idProduct=9241, bcdDevice= 5.04
[   19.539838] usb 1-1.1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[   19.539841] usb 1-1.1: Product: SMCI HID KM
[   19.539844] usb 1-1.1: Manufacturer: Linux 5.4.62 with aspeed_vhub
[   19.557204] input: Linux 5.4.62 with aspeed_vhub SMCI HID KM as /devices/pci0018:00/0018:00:00.0/0018:01:00.0/usb1/1-1/1-1.1/1-1.1:1.0/0003:0557:9241.0001/input/input0
[   19.605528] systemd[1]: Hostname set to <nvidia-grace-grace-03.khw.eng.rdu2.dc.redhat.com>.
[   19.930201] hid-generic 0003:0557:9241.0001: input,hidraw0: USB HID v1.00 Keyboard [Linux 5.4.62 with aspeed_vhub SMCI HID KM] on usb-0018:01:00.0-1.1/input0
[   19.935654] input: Linux 5.4.62 with aspeed_vhub SMCI HID KM as /devices/pci0018:00/0018:00:00.0/0018:01:00.0/usb1/1-1/1-1.1/1-1.1:1.1/0003:0557:9241.0002/input/input1
[   19.938144] hid-generic 0003:0557:9241.0002: input,hidraw1: USB HID v1.00 Mouse [Linux 5.4.62 with aspeed_vhub SMCI HID KM] on usb-0018:01:00.0-1.1/input1
[   19.996859] ln (1747) used greatest stack depth: 25152 bytes left
[   19.998348] systemd-debug-g (1736) used greatest stack depth: 24976 bytes left
[   20.006376] systemd-gpt-aut (1740) used greatest stack depth: 24528 bytes left
[   20.007167] systemd-hiberna (1742) used greatest stack depth: 24016 bytes left
[   20.016776] usb 1-1.2: new high-speed USB device number 5 using xhci-pci-renesas
[   20.151277] usb 1-1.2: New USB device found, idVendor=0b1f, idProduct=03ee, bcdDevice= 5.04
[   20.151285] usb 1-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[   20.151288] usb 1-1.2: Product: RNDIS/Ethernet Gadget
[   20.151292] usb 1-1.2: Manufacturer: Linux 5.4.62 with aspeed_vhub
[   20.241676] systemd[1]: Queued start job for default target Initrd Default Target.
[   20.363168] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[   20.467409] systemd[1]: Reached target Initrd /usr File System.
[   20.495790] systemd[1]: Reached target Local File Systems.
[   20.527081] systemd[1]: Reached target Path Units.
[   20.561889] systemd[1]: Reached target Slice Units.
[   20.597184] systemd[1]: Reached target Swaps.
[   20.627397] systemd[1]: Reached target Timer Units.
[   20.663479] systemd[1]: Listening on D-Bus System Message Bus Socket.
[   20.695923] systemd[1]: Listening on Journal Socket (/dev/log).
[   20.732419] systemd[1]: Listening on Journal Socket.
[   20.772316] systemd[1]: Listening on udev Control Socket.
[   20.812227] systemd[1]: Listening on udev Kernel Socket.
[   20.856220] systemd[1]: Reached target Socket Units.
[   21.018117] systemd[1]: Starting Create List of Static Device Nodes...
[   21.129044] systemd[1]: Starting Journal Service...
[   21.200746] systemd[1]: Starting Load Kernel Modules...
[   21.251089] fuse: init (API version 7.45)
[   21.278830] systemd[1]: Starting Create System Users...
[   21.345090] systemd[1]: Starting Setup Virtual Console...
[   21.440755] systemd[1]: Finished Create List of Static Device Nodes.
[   21.520529] systemd[1]: Finished Load Kernel Modules.
[   21.573918] systemd[1]: Finished Setup Virtual Console.
[   21.688867] systemd[1]: dracut ask for additional cmdline parameters was skipped because no trigger condition checks were met.
[   21.797666] systemd[1]: Starting dracut cmdline hook...
[   21.963085] systemd[1]: Starting Apply Kernel Variables...
[   22.015201] systemd[1]: Started Journal Service.
[   22.172349] systemd-escape (1901) used greatest stack depth: 23936 bytes left
[   22.848325] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[   22.849430] device-mapper: uevent: version 1.0.3
[   22.853233] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev
[   32.296509] IPMI message handler: version 39.2
[   32.308864] ipmi device interface
[   32.363283] power_meter ACPI000D:01: Found ACPI power meter.
[   32.365990] power_meter ACPI000D:01: Ignoring unsafe software power cap!
[   32.369065] power_meter ACPI000D:02: Found ACPI power meter.
[   32.371001] power_meter ACPI000D:03: Found ACPI power meter.
[   32.372471] power_meter ACPI000D:05: Found ACPI power meter.
[   32.372933] power_meter ACPI000D:05: Ignoring unsafe software power cap!
[   32.373984] power_meter ACPI000D:06: Found ACPI power meter.
[   32.375400] power_meter ACPI000D:07: Found ACPI power meter.
[   32.682695] tegra-i2c NVDA0301:00: Looking for DMA channel "tx" at index 0...
[   32.682821] tegra-i2c NVDA0301:00: cannot use DMA: -19
[   32.682825] tegra-i2c NVDA0301:00: falling back to PIO
[   32.709272] usbcore: registered new device driver onboard-usb-dev
[   32.742874] usbcore: registered new interface driver cdc_ether
[   32.757476] Key type psk registered
[   32.761153] sbsa-gwdt sbsa-gwdt.0: Initialized with 10s timeout @ 1000000000 Hz, action=0.
[   32.795203] rndis_host 1-1.2:2.0 usb0: register 'rndis_host' at usb-0018:01:00.0-1.2, RNDIS device, be:3a:f2:b6:05:9f
[   32.796644] usbcore: registered new interface driver rndis_host
[   32.949135] nvme nvme0: pci function 0014:01:00.0
[   32.953240] nvme nvme1: pci function 0015:01:00.0
[   33.061678] nvme nvme1: D3 entry latency set to 8 seconds
[   33.077406] nvme nvme0: D3 entry latency set to 8 seconds
[   33.169941] rndis_host 1-1.2:2.0 enP24s24u1u2c2: renamed from usb0
[   33.295638] mlx5_core 0006:01:00.0: firmware version: 26.35.2000
[   33.295712] mlx5_core 0006:01:00.0: 126.024 Gb/s available PCIe bandwidth (16.0 GT/s PCIe x8 link)
[   33.580077] nvme nvme1: 129/0/0 default/read/poll queues
[   33.612122] nvme nvme0: 129/0/0 default/read/poll queues
[   33.983998]  nvme1n1: p1
[   34.005892]  nvme0n1: p1 p2 p3
[   34.134225] mlx5_core 0006:01:00.0: Rate limit: 127 rates are supported, range: 0Mbps to 24414Mbps
[   34.135257] mlx5_core 0006:01:00.0: E-Switch: Total vports 10, per vport: max uc(128) max mc(2048)
[   34.138355] mlx5_core 0006:01:00.0: Flow counters bulk query buffer size increased, bulk_query_len(8)
[   34.218041] mlx5_core 0006:01:00.0: Port module event: module 0, Cable plugged
[   34.219555] mlx5_core 0006:01:00.0: mlx5_pcie_event:331:(pid 246): PCIe slot advertised sufficient power (27W).
[   34.248111] debugfs: 'netdev@(____ptrval____)' already exists in 'ref_tracker'
[   34.693020] mlx5_core 0006:01:00.0: MLX5E: StrdRq(1) RqSz(8) StrdSz(2048) RxCqeCmprss(0 enhanced)
[   34.788199] mlx5_core 0006:01:00.1: firmware version: 26.35.2000
[   34.788265] mlx5_core 0006:01:00.1: 126.024 Gb/s available PCIe bandwidth (16.0 GT/s PCIe x8 link)
[   35.639361] mlx5_core 0006:01:00.1: Rate limit: 127 rates are supported, range: 0Mbps to 24414Mbps
[   35.640127] mlx5_core 0006:01:00.1: E-Switch: Total vports 10, per vport: max uc(128) max mc(2048)
[   35.642457] mlx5_core 0006:01:00.1: Flow counters bulk query buffer size increased, bulk_query_len(8)
[   35.705160] mlx5_core 0006:01:00.1: Port module event: module 1, Cable unplugged
[   35.705771] mlx5_core 0006:01:00.1: mlx5_pcie_event:331:(pid 246): PCIe slot advertised sufficient power (27W).
[   35.748125] debugfs: 'netdev@(____ptrval____)' already exists in 'ref_tracker'
[   36.215447] mlx5_core 0006:01:00.1: MLX5E: StrdRq(1) RqSz(8) StrdSz(2048) RxCqeCmprss(0 enhanced)
[   36.237615] mlx5_core 0006:01:00.0 enP6s6f0np0: renamed from eth0
[   36.367642] mlx5_core 0006:01:00.1 enP6s6f1np1: renamed from eth1
[   40.083658] systemd-udevd (2004) used greatest stack depth: 22896 bytes left
[   40.895011] random: crng init done
[   42.687582] SGI XFS with ACLs, security attributes, scrub, verbose warnings, quota, no debug enabled
[   42.754740] XFS (dm-0): Mounting V5 Filesystem 266a637c-2b55-4847-ae64-4d3dfd4fead7
[   42.774329] XFS (dm-0): Ending clean mount
[   42.785327] mount (2656) used greatest stack depth: 21648 bytes left
[   45.139337] hrtimer: interrupt took 30304 ns
[   45.834861] systemd-journald[1798]: Received SIGTERM from PID 1 (systemd).
[   46.538594] audit: type=1404 audit(1769053286.000:2): enforcing=1 old_enforcing=0 auid=4294967295 ses=4294967295 enabled=1 old-enabled=1 lsm=selinux res=1
[   47.304633] SELinux:  Permission firmware_load in class system not defined in policy.
[   47.312721] SELinux:  Permission kexec_image_load in class system not defined in policy.
[   47.312761] SELinux:  Permission kexec_initramfs_load in class system not defined in policy.
[   47.312764] SELinux:  Permission policy_load in class system not defined in policy.
[   47.312765] SELinux:  Permission x509_certificate_load in class system not defined in policy.
[   47.312779] SELinux:  Permission watch_mountns in class file not defined in policy.
[   47.312782] SELinux:  Permission watch_mountns in class dir not defined in policy.
[   47.312787] SELinux:  Permission watch_mountns in class lnk_file not defined in policy.
[   47.312789] SELinux:  Permission watch_mountns in class chr_file not defined in policy.
[   47.312792] SELinux:  Permission watch_mountns in class blk_file not defined in policy.
[   47.312794] SELinux:  Permission watch_mountns in class sock_file not defined in policy.
[   47.312797] SELinux:  Permission watch_mountns in class fifo_file not defined in policy.
[   47.312810] SELinux:  Permission nlmsg in class netlink_route_socket not defined in policy.
[   47.312813] SELinux:  Permission nlmsg in class netlink_tcpdiag_socket not defined in policy.
[   47.312816] SELinux:  Permission nlmsg in class netlink_xfrm_socket not defined in policy.
[   47.312820] SELinux:  Permission nlmsg in class netlink_audit_socket not defined in policy.
[   47.312854] SELinux:  Permission watch_mountns in class anon_inode not defined in policy.
[   47.312856] SELinux:  Permission allowed in class io_uring not defined in policy.
[   47.312857] SELinux:  Class user_namespace not defined in policy.
[   47.312859] SELinux:  Class memfd_file not defined in policy.
[   47.312861] SELinux: the above unknown classes and permissions will be allowed
[   47.401414] SELinux:  policy capability network_peer_controls=1
[   47.401420] SELinux:  policy capability open_perms=1
[   47.401422] SELinux:  policy capability extended_socket_class=1
[   47.401425] SELinux:  policy capability always_check_network=0
[   47.401427] SELinux:  policy capability cgroup_seclabel=1
[   47.401429] SELinux:  policy capability nnp_nosuid_transition=1
[   47.401431] SELinux:  policy capability genfs_seclabel_symlinks=1
[   47.401433] SELinux:  policy capability ioctl_skip_cloexec=0
[   47.401435] SELinux:  policy capability userspace_initial_context=0
[   47.401437] SELinux:  policy capability netlink_xperm=0
[   47.401439] SELinux:  policy capability netif_wildcard=0
[   47.401441] SELinux:  policy capability genfs_seclabel_wildcard=0
[   47.401443] SELinux:  policy capability functionfs_seclabel=0
[   47.401446] SELinux:  policy capability memfd_class=0
[   48.544164] audit: type=1403 audit(1769053288.000:3): auid=4294967295 ses=4294967295 lsm=selinux res=1
[   48.564807] systemd[1]: Successfully loaded SELinux policy in 2.120303s.
[   48.678910] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 83.988ms.
[   48.690158] systemd[1]: systemd 252-64.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[   48.694061] systemd[1]: Detected architecture arm64.
[   49.265029] systemd-rc-local-generator[2747]: /etc/rc.d/rc.local is not marked executable, skipping.
[   49.790143] systemd[1]: initrd-switch-root.service: Deactivated successfully.
[   49.792762] systemd[1]: Stopped Switch Root.
[   49.818876] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.
[   49.829900] systemd[1]: Created slice Virtual Machine and Container Slice.
[   49.863916] systemd[1]: Created slice Slice /system/getty.
[   49.893767] systemd[1]: Created slice Slice /system/serial-getty.
[   49.933760] systemd[1]: Created slice Slice /system/sshd-keygen.
[   49.974444] systemd[1]: Created slice Slice /system/systemd-fsck.
[   50.016182] systemd[1]: Created slice User and Session Slice.
[   50.038017] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[   50.078634] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[   50.119698] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[   50.156922] systemd[1]: Reached target Local Encrypted Volumes.
[   50.196884] systemd[1]: Stopped target Switch Root.
[   50.226864] systemd[1]: Stopped target Initrd File Systems.
[   50.266872] systemd[1]: Stopped target Initrd Root File System.
[   50.306871] systemd[1]: Reached target Local Integrity Protected Volumes.
[   50.336894] systemd[1]: Reached target Path Units.
[   50.366925] systemd[1]: Reached target Slice Units.
[   50.396875] systemd[1]: Reached target System Time Set.
[   50.416885] systemd[1]: Reached target Local Verity Protected Volumes.
[   50.458514] systemd[1]: Listening on Device-mapper event daemon FIFOs.
[   50.500542] systemd[1]: Listening on LVM2 poll daemon socket.
[   50.694085] systemd[1]: Listening on RPCbind Server Activation Socket.
[   50.727050] systemd[1]: Reached target RPC Port Mapper.
[   50.750972] systemd[1]: Listening on Process Core Dump Socket.
[   50.787842] systemd[1]: Listening on initctl Compatibility Named Pipe.
[   50.830193] systemd[1]: Listening on udev Control Socket.
[   50.858513] systemd[1]: Listening on udev Kernel Socket.
[   50.997184] systemd[1]: Activating swap /dev/mapper/rhel_nvidia--grace--grace--03-swap...
[   51.016424] Adding 4194300k swap on /dev/mapper/rhel_nvidia--grace--grace--03-swap.  Priority:-1 extents:1 across:4194300k SS
[   51.052152] systemd[1]: Mounting Huge Pages File System...
[   51.091524] systemd[1]: Mounting POSIX Message Queue File System...
[   51.132731] systemd[1]: Mounting Kernel Debug File System...
[   51.183285] systemd[1]: Mounting Kernel Trace File System...
[   51.217080] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab).
[   51.217777] systemd[1]: iscsi-starter.service was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/var/lib/iscsi/nodes).
[   51.233020] systemd[1]: Starting Create List of Static Device Nodes...
[   51.289585] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling...
[   51.337920] systemd[1]: Starting Load Kernel Module configfs...
[   51.375728] nvme nvme0: using unchecked data buffer
[   51.408838] systemd[1]: Starting Load Kernel Module drm...
[   51.457215] systemd[1]: Starting Load Kernel Module efi_pstore...
[   51.498262] systemd[1]: Starting Load Kernel Module fuse...
[   51.550603] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network...
[   51.588674] systemd[1]: systemd-fsck-root.service: Deactivated successfully.
[   51.591441] systemd[1]: Stopped File System Check on Root Device.
[   51.617314] systemd[1]: Stopped Journal Service.
[   51.671237] systemd[1]: Starting Journal Service...
[   51.720959] systemd[1]: Starting Load Kernel Modules...
[   51.769616] systemd[1]: Starting Generate network units from Kernel command line...
[   51.797072] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f).
[   51.811099] systemd[1]: Starting Remount Root and Kernel File Systems...
[   51.857365] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met.
[   51.870263] systemd[1]: Starting Coldplug All udev Devices...
[   51.910339] systemd[1]: Activated swap /dev/mapper/rhel_nvidia--grace--grace--03-swap.
[   51.944951] systemd[1]: Started Journal Service.
[   52.601727] systemd-journald[2789]: Received client request to flush runtime journal.
[   60.232346] XFS (nvme0n1p2): Mounting V5 Filesystem c3469703-b076-4391-be7e-7057f3d45688
[   60.248729] XFS (nvme0n1p2): Ending clean mount
[   60.353495]  cs_system_cfg: CoreSight Configuration manager initialised
[   60.416135] ipmi_si: IPMI System Interface driver
[   60.419744] ipmi_si: Unable to find any System Interface(s)
[   60.475206] CSCFG registered ete0
[   60.475938] coresight ete0: CPU0: ete v1.0 initialized
[   60.482064] coresight stm0: STM32 initialized
[   60.503389] CSCFG registered ete1
[   60.503421] coresight ete1: CPU1: ete v1.0 initialized
[   60.526948] CSCFG registered ete2
[   60.526979] coresight ete2: CPU2: ete v1.0 initialized
[   60.529828] coresight stm1: STM32 initialized
[   60.533850] CSCFG registered ete3
[   60.533856] coresight ete3: CPU3: ete v1.0 initialized
[   60.541777] CSCFG registered ete4
[   60.541783] coresight ete4: CPU4: ete v1.0 initialized
[   60.547152] CSCFG registered ete5
[   60.547158] coresight ete5: CPU5: ete v1.0 initialized
[   60.550765] CSCFG registered ete6
[   60.550769] coresight ete6: CPU6: ete v1.0 initialized
[   60.558470] i2c i2c-0: supports SMBALERT#
[   60.560477] CSCFG registered ete7
[   60.560481] coresight ete7: CPU7: ete v1.0 initialized
[   60.569692] CSCFG registered ete8
[   60.569697] coresight ete8: CPU8: ete v1.0 initialized
[   60.573420] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.20.auto: option mask 0x0
[   60.582912] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.20.auto: Registered PMU @ 0x0000000011002000 using 4 counters with Global(Counter0) filter settings
[   60.583706] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.21.auto: option mask 0x0
[   60.584763] arm_spe_pmu arm,spe-v1: probed SPEv1.1 for CPUs 0-143 [max_record_sz 64, align 64, features 0x17]
[   60.587229] CSCFG registered ete9
[   60.587234] coresight ete9: CPU9: ete v1.0 initialized
[   60.589417] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.21.auto: Registered PMU @ 0x0000000011042000 using 4 counters with Global(Counter0) filter settings
[   60.590621] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.22.auto: option mask 0x0
[   60.611427] MACsec IEEE 802.1AE
[   60.612124] CSCFG registered ete10
[   60.612130] coresight ete10: CPU10: ete v1.0 initialized
[   60.612179] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.22.auto: Registered PMU @ 0x0000000011062000 using 4 counters with Global(Counter0) filter settings
[   60.612732] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.23.auto: option mask 0x0
[   60.626085] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.23.auto: Registered PMU @ 0x0000000011082000 using 4 counters with Global(Counter0) filter settings
[   60.626575] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.24.auto: option mask 0x0
[   60.633305] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.24.auto: Registered PMU @ 0x00000000110a2000 using 4 counters with Global(Counter0) filter settings
[   60.633959] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.25.auto: option mask 0x0
[   60.638411] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.25.auto: Registered PMU @ 0x0000000012002000 using 4 counters with Global(Counter0) filter settings
[   60.639164] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.26.auto: option mask 0x0
[   60.639711] CSCFG registered ete11
[   60.639716] coresight ete11: CPU11: ete v1.0 initialized
[   60.651699] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.26.auto: Registered PMU @ 0x0000000012042000 using 4 counters with Global(Counter0) filter settings
[   60.653308] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.27.auto: option mask 0x0
[   60.658348] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.27.auto: Registered PMU @ 0x0000000012062000 using 4 counters with Global(Counter0) filter settings
[   60.658804] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.28.auto: option mask 0x0
[   60.659112] CSCFG registered ete12
[   60.659117] coresight ete12: CPU12: ete v1.0 initialized
[   60.664674] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.28.auto: Registered PMU @ 0x0000000012082000 using 4 counters with Global(Counter0) filter settings
[   60.665793] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.29.auto: option mask 0x0
[   60.670099] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.29.auto: Registered PMU @ 0x00000000120a2000 using 4 counters with Global(Counter0) filter settings
[   60.670902] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.30.auto: option mask 0x0
[   60.673406] CSCFG registered ete13
[   60.673412] coresight ete13: CPU13: ete v1.0 initialized
[   60.674564] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.30.auto: Registered PMU @ 0x0000000015002000 using 4 counters with Global(Counter0) filter settings
[   60.675580] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.31.auto: option mask 0x0
[   60.680063] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.31.auto: Registered PMU @ 0x0000000015042000 using 4 counters with Global(Counter0) filter settings
[   60.680645] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.32.auto: option mask 0x0
[   60.683568] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.32.auto: Registered PMU @ 0x0000000015062000 using 4 counters with Global(Counter0) filter settings
[   60.684016] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.33.auto: option mask 0x0
[   60.688679] CSCFG registered ete14
[   60.688684] coresight ete14: CPU14: ete v1.0 initialized
[   60.688736] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.33.auto: Registered PMU @ 0x0000000015082000 using 4 counters with Global(Counter0) filter settings
[   60.689503] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.34.auto: option mask 0x0
[   60.695351] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.34.auto: Registered PMU @ 0x00000000150a2000 using 4 counters with Global(Counter0) filter settings
[   60.696074] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.35.auto: option mask 0x0
[   60.701953] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.35.auto: Registered PMU @ 0x0000000016002000 using 4 counters with Global(Counter0) filter settings
[   60.702397] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.36.auto: option mask 0x0
[   60.705769] CSCFG registered ete15
[   60.705774] coresight ete15: CPU15: ete v1.0 initialized
[   60.708679] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.36.auto: Registered PMU @ 0x0000000016042000 using 4 counters with Global(Counter0) filter settings
[   60.709064] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.37.auto: option mask 0x0
[   60.711454] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.37.auto: Registered PMU @ 0x0000000016062000 using 4 counters with Global(Counter0) filter settings
[   60.712425] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.38.auto: option mask 0x0
[   60.717150] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.38.auto: Registered PMU @ 0x0000000005002000 using 4 counters with Global(Counter0) filter settings
[   60.718743] CSCFG registered ete16
[   60.718748] coresight ete16: CPU16: ete v1.0 initialized
[   60.718776] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.39.auto: option mask 0x0
[   60.724111] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.39.auto: Registered PMU @ 0x0000000005042000 using 4 counters with Global(Counter0) filter settings
[   60.724689] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.40.auto: option mask 0x0
[   60.727594] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.40.auto: Registered PMU @ 0x0000000005062000 using 4 counters with Global(Counter0) filter settings
[   60.728174] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.41.auto: option mask 0x0
[   60.731852] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.41.auto: Registered PMU @ 0x0000100011002000 using 4 counters with Global(Counter0) filter settings
[   60.732396] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.42.auto: option mask 0x0
[   60.733346] CSCFG registered ete17
[   60.733351] coresight ete17: CPU17: ete v1.0 initialized
[   60.736046] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.42.auto: Registered PMU @ 0x0000100011042000 using 4 counters with Global(Counter0) filter settings
[   60.736591] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.43.auto: option mask 0x0
[   60.740010] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.43.auto: Registered PMU @ 0x0000100011062000 using 4 counters with Global(Counter0) filter settings
[   60.740682] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.44.auto: option mask 0x0
[   60.745329] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.44.auto: Registered PMU @ 0x0000100011082000 using 4 counters with Global(Counter0) filter settings
[   60.745792] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.45.auto: option mask 0x0
[   60.748223] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.45.auto: Registered PMU @ 0x00001000110a2000 using 4 counters with Global(Counter0) filter settings
[   60.748391] CSCFG registered ete18
[   60.748397] coresight ete18: CPU18: ete v1.0 initialized
[   60.749384] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.46.auto: option mask 0x0
[   60.752786] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.46.auto: Registered PMU @ 0x0000100012002000 using 4 counters with Global(Counter0) filter settings
[   60.753303] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.47.auto: option mask 0x0
[   60.756042] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.47.auto: Registered PMU @ 0x0000100012042000 using 4 counters with Global(Counter0) filter settings
[   60.756602] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.48.auto: option mask 0x0
[   60.758394] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.48.auto: Registered PMU @ 0x0000100012062000 using 4 counters with Global(Counter0) filter settings
[   60.758810] CSCFG registered ete19
[   60.758815] coresight ete19: CPU19: ete v1.0 initialized
[   60.758953] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.49.auto: option mask 0x0
[   60.762168] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.49.auto: Registered PMU @ 0x0000100012082000 using 4 counters with Global(Counter0) filter settings
[   60.764535] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.50.auto: option mask 0x0
[   60.765774] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.50.auto: Registered PMU @ 0x00001000120a2000 using 4 counters with Global(Counter0) filter settings
[   60.766161] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.51.auto: option mask 0x0
[   60.767508] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.51.auto: Registered PMU @ 0x0000100015002000 using 4 counters with Global(Counter0) filter settings
[   60.768954] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.52.auto: option mask 0x0
[   60.770590] CSCFG registered ete20
[   60.770595] coresight ete20: CPU20: ete v1.0 initialized
[   60.771031] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.52.auto: Registered PMU @ 0x0000100015042000 using 4 counters with Global(Counter0) filter settings
[   60.771525] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.53.auto: option mask 0x0
[   60.774063] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.53.auto: Registered PMU @ 0x0000100015062000 using 4 counters with Global(Counter0) filter settings
[   60.774424] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.54.auto: option mask 0x0
[   60.777156] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.54.auto: Registered PMU @ 0x0000100015082000 using 4 counters with Global(Counter0) filter settings
[   60.777468] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.55.auto: option mask 0x0
[   60.778906] CSCFG registered ete21
[   60.778911] coresight ete21: CPU21: ete v1.0 initialized
[   60.779172] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.55.auto: Registered PMU @ 0x00001000150a2000 using 4 counters with Global(Counter0) filter settings
[   60.779653] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.56.auto: option mask 0x0
[   60.782140] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.56.auto: Registered PMU @ 0x0000100016002000 using 4 counters with Global(Counter0) filter settings
[   60.782501] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.57.auto: option mask 0x0
[   60.784811] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.57.auto: Registered PMU @ 0x0000100016042000 using 4 counters with Global(Counter0) filter settings
[   60.785112] CSCFG registered ete22
[   60.785118] coresight ete22: CPU22: ete v1.0 initialized
[   60.785196] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.58.auto: option mask 0x0
[   60.790593] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.58.auto: Registered PMU @ 0x0000100016062000 using 4 counters with Global(Counter0) filter settings
[   60.791208] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.59.auto: option mask 0x0
[   60.793613] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.59.auto: Registered PMU @ 0x0000100005002000 using 4 counters with Global(Counter0) filter settings
[   60.794144] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.60.auto: option mask 0x0
[   60.794599] CSCFG registered ete23
[   60.794605] coresight ete23: CPU23: ete v1.0 initialized
[   60.800635] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.60.auto: Registered PMU @ 0x0000100005042000 using 4 counters with Global(Counter0) filter settings
[   60.802391] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.61.auto: option mask 0x0
[   60.805872] arm-smmu-v3-pmcg arm-smmu-v3-pmcg.61.auto: Registered PMU @ 0x0000100005062000 using 4 counters with Global(Counter0) filter settings
[   60.808649] CSCFG registered ete24
[   60.808654] coresight ete24: CPU24: ete v1.0 initialized
[   60.817239] CSCFG registered ete25
[   60.817244] coresight ete25: CPU25: ete v1.0 initialized
[   60.834450] ipmi_ssif: IPMI SSIF Interface driver
[   60.842916] EINJ: Error INJection is initialized.
[   60.843912] CSCFG registered ete26
[   60.843919] coresight ete26: CPU26: ete v1.0 initialized
[   60.854830] CSCFG registered ete27
[   60.854835] coresight ete27: CPU27: ete v1.0 initialized
[   60.865184] CSCFG registered ete28
[   60.865189] coresight ete28: CPU28: ete v1.0 initialized
[   60.885485] ipmi_ssif i2c-IPI0001:00: ipmi_ssif: Trying ACPI-specified SSIF interface at i2c address 0x10, adapter NVDA0301:00, slave address 0x20
[   60.891764] CSCFG registered ete29
[   60.891769] coresight ete29: CPU29: ete v1.0 initialized
[   60.894438] Console: switching to colour dummy device 80x25
[   60.896652] CSCFG registered ete30
[   60.896656] coresight ete30: CPU30: ete v1.0 initialized
[   60.904567] CSCFG registered ete31
[   60.904572] coresight ete31: CPU31: ete v1.0 initialized
[   60.968018] CSCFG registered ete32
[   60.968027] coresight ete32: CPU32: ete v1.0 initialized
[   60.992325] CSCFG registered ete33
[   60.992332] coresight ete33: CPU33: ete v1.0 initialized
[   61.005471] CSCFG registered ete34
[   61.005476] coresight ete34: CPU34: ete v1.0 initialized
[   61.009939] modprobe (3470) used greatest stack depth: 21056 bytes left
[   61.019487] CSCFG registered ete35
[   61.019492] coresight ete35: CPU35: ete v1.0 initialized
[   61.025128] CSCFG registered ete36
[   61.025133] coresight ete36: CPU36: ete v1.0 initialized
[   61.040364] CSCFG registered ete37
[   61.040372] coresight ete37: CPU37: ete v1.0 initialized
[   61.082204] CSCFG registered ete38
[   61.082209] coresight ete38: CPU38: ete v1.0 initialized
[   61.093430] ipmi_ssif i2c-IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x1d10, dev_id: 0x20)
[   61.100792] ast 0008:02:00.0: enabling device (0002 -> 0003)
[   61.100920] ast 0008:02:00.0: Using default configuration
[   61.100923] ast 0008:02:00.0: AST 2600 detected
[   61.101963] CSCFG registered ete39
[   61.101969] coresight ete39: CPU39: ete v1.0 initialized
[   61.102274] ast 0008:02:00.0: [drm] Using ASPEED DisplayPort transmitter
[   61.117773] ast 0008:02:00.0: [drm] Registered 1 planes with drm panic
[   61.121887] CSCFG registered ete40
[   61.121892] coresight ete40: CPU40: ete v1.0 initialized
[   61.132064] CSCFG registered ete41
[   61.132069] coresight ete41: CPU41: ete v1.0 initialized
[   61.141892] CSCFG registered ete42
[   61.141898] coresight ete42: CPU42: ete v1.0 initialized
[   61.152246] CSCFG registered ete43
[   61.152252] coresight ete43: CPU43: ete v1.0 initialized
[   61.160756] CSCFG registered ete44
[   61.160761] coresight ete44: CPU44: ete v1.0 initialized
[   61.168985] CSCFG registered ete45
[   61.168990] coresight ete45: CPU45: ete v1.0 initialized
[   61.175454] CSCFG registered ete46
[   61.175458] coresight ete46: CPU46: ete v1.0 initialized
[   61.183831] CSCFG registered ete47
[   61.183836] coresight ete47: CPU47: ete v1.0 initialized
[   61.192328] CSCFG registered ete48
[   61.192333] coresight ete48: CPU48: ete v1.0 initialized
[   61.203292] CSCFG registered ete49
[   61.203297] coresight ete49: CPU49: ete v1.0 initialized
[   61.212384] CSCFG registered ete50
[   61.212388] coresight ete50: CPU50: ete v1.0 initialized
[   61.221235] CSCFG registered ete51
[   61.221239] coresight ete51: CPU51: ete v1.0 initialized
[   61.230839] CSCFG registered ete52
[   61.230843] coresight ete52: CPU52: ete v1.0 initialized
[   61.249451] CSCFG registered ete53
[   61.249456] coresight ete53: CPU53: ete v1.0 initialized
[   61.257396] [drm] Initialized ast 0.1.0 for 0008:02:00.0 on minor 0
[   61.264435] CSCFG registered ete54
[   61.264440] coresight ete54: CPU54: ete v1.0 initialized
[   61.284196] CSCFG registered ete55
[   61.284203] coresight ete55: CPU55: ete v1.0 initialized
[   61.297330] CSCFG registered ete56
[   61.297336] coresight ete56: CPU56: ete v1.0 initialized
[   61.321946] Console: switching to colour frame buffer device 128x48
[   61.353753] CSCFG registered ete57
[   61.353760] coresight ete57: CPU57: ete v1.0 initialized
[   61.364835] ast 0008:02:00.0: [drm] fb0: astdrmfb frame buffer device
[   61.373314] CSCFG registered ete58
[   61.373320] coresight ete58: CPU58: ete v1.0 initialized
[   61.390403] CSCFG registered ete59
[   61.390409] coresight ete59: CPU59: ete v1.0 initialized
[   61.404572] CSCFG registered ete60
[   61.404577] coresight ete60: CPU60: ete v1.0 initialized
[   61.421682] CSCFG registered ete61
[   61.421687] coresight ete61: CPU61: ete v1.0 initialized
[   61.437551] CSCFG registered ete62
[   61.437557] coresight ete62: CPU62: ete v1.0 initialized
[   61.451034] CSCFG registered ete63
[   61.451041] coresight ete63: CPU63: ete v1.0 initialized
[   61.461743] CSCFG registered ete64
[   61.461748] coresight ete64: CPU64: ete v1.0 initialized
[   61.472564] CSCFG registered ete65
[   61.472568] coresight ete65: CPU65: ete v1.0 initialized
[   61.483274] CSCFG registered ete66
[   61.483279] coresight ete66: CPU66: ete v1.0 initialized
[   61.493681] CSCFG registered ete67
[   61.493686] coresight ete67: CPU67: ete v1.0 initialized
[   61.504601] CSCFG registered ete68
[   61.504606] coresight ete68: CPU68: ete v1.0 initialized
[   61.515303] CSCFG registered ete69
[   61.515307] coresight ete69: CPU69: ete v1.0 initialized
[   61.526620] CSCFG registered ete70
[   61.526625] coresight ete70: CPU70: ete v1.0 initialized
[   61.536774] CSCFG registered ete71
[   61.536779] coresight ete71: CPU71: ete v1.0 initialized
[   61.545754] CSCFG registered ete72
[   61.545758] coresight ete72: CPU72: ete v1.0 initialized
[   61.555669] CSCFG registered ete73
[   61.555674] coresight ete73: CPU73: ete v1.0 initialized
[   61.565792] CSCFG registered ete74
[   61.565797] coresight ete74: CPU74: ete v1.0 initialized
[   61.576421] CSCFG registered ete75
[   61.576426] coresight ete75: CPU75: ete v1.0 initialized
[   61.585231] CSCFG registered ete76
[   61.585236] coresight ete76: CPU76: ete v1.0 initialized
[   61.597877] CSCFG registered ete77
[   61.597881] coresight ete77: CPU77: ete v1.0 initialized
[   61.609749] CSCFG registered ete78
[   61.609754] coresight ete78: CPU78: ete v1.0 initialized
[   61.622338] CSCFG registered ete79
[   61.622343] coresight ete79: CPU79: ete v1.0 initialized
[   61.636266] CSCFG registered ete80
[   61.636272] coresight ete80: CPU80: ete v1.0 initialized
[   61.649978] CSCFG registered ete81
[   61.649983] coresight ete81: CPU81: ete v1.0 initialized
[   61.659997] CSCFG registered ete82
[   61.660004] coresight ete82: CPU82: ete v1.0 initialized
[   61.670363] CSCFG registered ete83
[   61.670369] coresight ete83: CPU83: ete v1.0 initialized
[   61.679622] CSCFG registered ete84
[   61.679627] coresight ete84: CPU84: ete v1.0 initialized
[   61.689308] CSCFG registered ete85
[   61.689313] coresight ete85: CPU85: ete v1.0 initialized
[   61.700388] CSCFG registered ete86
[   61.700393] coresight ete86: CPU86: ete v1.0 initialized
[   61.710841] CSCFG registered ete87
[   61.710846] coresight ete87: CPU87: ete v1.0 initialized
[   61.723813] CSCFG registered ete88
[   61.723817] coresight ete88: CPU88: ete v1.0 initialized
[   61.735217] CSCFG registered ete89
[   61.735222] coresight ete89: CPU89: ete v1.0 initialized
[   61.746918] CSCFG registered ete90
[   61.746923] coresight ete90: CPU90: ete v1.0 initialized
[   61.759320] CSCFG registered ete91
[   61.759325] coresight ete91: CPU91: ete v1.0 initialized
[   61.769426] CSCFG registered ete92
[   61.769431] coresight ete92: CPU92: ete v1.0 initialized
[   61.781565] CSCFG registered ete93
[   61.781569] coresight ete93: CPU93: ete v1.0 initialized
[   61.794458] CSCFG registered ete94
[   61.794463] coresight ete94: CPU94: ete v1.0 initialized
[   61.805461] CSCFG registered ete95
[   61.805467] coresight ete95: CPU95: ete v1.0 initialized
[   61.818621] CSCFG registered ete96
[   61.818626] coresight ete96: CPU96: ete v1.0 initialized
[   61.829960] CSCFG registered ete97
[   61.829965] coresight ete97: CPU97: ete v1.0 initialized
[   61.843598] CSCFG registered ete98
[   61.843602] coresight ete98: CPU98: ete v1.0 initialized
[   61.856500] CSCFG registered ete99
[   61.856505] coresight ete99: CPU99: ete v1.0 initialized
[   61.869371] CSCFG registered ete100
[   61.869375] coresight ete100: CPU100: ete v1.0 initialized
[   61.882640] CSCFG registered ete101
[   61.882644] coresight ete101: CPU101: ete v1.0 initialized
[   61.893662] CSCFG registered ete102
[   61.893667] coresight ete102: CPU102: ete v1.0 initialized
[   61.905911] CSCFG registered ete103
[   61.905915] coresight ete103: CPU103: ete v1.0 initialized
[   61.919675] CSCFG registered ete104
[   61.919680] coresight ete104: CPU104: ete v1.0 initialized
[   61.931477] CSCFG registered ete105
[   61.931482] coresight ete105: CPU105: ete v1.0 initialized
[   61.943470] CSCFG registered ete106
[   61.943475] coresight ete106: CPU106: ete v1.0 initialized
[   61.956610] CSCFG registered ete107
[   61.956615] coresight ete107: CPU107: ete v1.0 initialized
[   61.971417] CSCFG registered ete108
[   61.971422] coresight ete108: CPU108: ete v1.0 initialized
[   61.984475] CSCFG registered ete109
[   61.984479] coresight ete109: CPU109: ete v1.0 initialized
[   61.998386] CSCFG registered ete110
[   61.998391] coresight ete110: CPU110: ete v1.0 initialized
[   62.009838] CSCFG registered ete111
[   62.009843] coresight ete111: CPU111: ete v1.0 initialized
[   62.021731] CSCFG registered ete112
[   62.021736] coresight ete112: CPU112: ete v1.0 initialized
[   62.033261] CSCFG registered ete113
[   62.033266] coresight ete113: CPU113: ete v1.0 initialized
[   62.046174] CSCFG registered ete114
[   62.046179] coresight ete114: CPU114: ete v1.0 initialized
[   62.059733] CSCFG registered ete115
[   62.059738] coresight ete115: CPU115: ete v1.0 initialized
[   62.075391] CSCFG registered ete116
[   62.075396] coresight ete116: CPU116: ete v1.0 initialized
[   62.090898] CSCFG registered ete117
[   62.090903] coresight ete117: CPU117: ete v1.0 initialized
[   62.103186] CSCFG registered ete118
[   62.103191] coresight ete118: CPU118: ete v1.0 initialized
[   62.114390] CSCFG registered ete119
[   62.114395] coresight ete119: CPU119: ete v1.0 initialized
[   62.128797] CSCFG registered ete120
[   62.128802] coresight ete120: CPU120: ete v1.0 initialized
[   62.140560] CSCFG registered ete121
[   62.140565] coresight ete121: CPU121: ete v1.0 initialized
[   62.151652] CSCFG registered ete122
[   62.151657] coresight ete122: CPU122: ete v1.0 initialized
[   62.163515] CSCFG registered ete123
[   62.163520] coresight ete123: CPU123: ete v1.0 initialized
[   62.175089] CSCFG registered ete124
[   62.175094] coresight ete124: CPU124: ete v1.0 initialized
[   62.188479] CSCFG registered ete125
[   62.188483] coresight ete125: CPU125: ete v1.0 initialized
[   62.201280] CSCFG registered ete126
[   62.201285] coresight ete126: CPU126: ete v1.0 initialized
[   62.216017] CSCFG registered ete127
[   62.216022] coresight ete127: CPU127: ete v1.0 initialized
[   62.231423] CSCFG registered ete128
[   62.231428] coresight ete128: CPU128: ete v1.0 initialized
[   62.245370] CSCFG registered ete129
[   62.245374] coresight ete129: CPU129: ete v1.0 initialized
[   62.257442] CSCFG registered ete130
[   62.257446] coresight ete130: CPU130: ete v1.0 initialized
[   62.267798] CSCFG registered ete131
[   62.267802] coresight ete131: CPU131: ete v1.0 initialized
[   62.281963] CSCFG registered ete132
[   62.281968] coresight ete132: CPU132: ete v1.0 initialized
[   62.295603] CSCFG registered ete133
[   62.295609] coresight ete133: CPU133: ete v1.0 initialized
[   62.309286] CSCFG registered ete134
[   62.309291] coresight ete134: CPU134: ete v1.0 initialized
[   62.324038] CSCFG registered ete135
[   62.324042] coresight ete135: CPU135: ete v1.0 initialized
[   62.337392] CSCFG registered ete136
[   62.337398] coresight ete136: CPU136: ete v1.0 initialized
[   62.349905] CSCFG registered ete137
[   62.349910] coresight ete137: CPU137: ete v1.0 initialized
[   62.362546] CSCFG registered ete138
[   62.362550] coresight ete138: CPU138: ete v1.0 initialized
[   62.377504] CSCFG registered ete139
[   62.377509] coresight ete139: CPU139: ete v1.0 initialized
[   62.390676] CSCFG registered ete140
[   62.390681] coresight ete140: CPU140: ete v1.0 initialized
[   62.402700] CSCFG registered ete141
[   62.402704] coresight ete141: CPU141: ete v1.0 initialized
[   62.413983] CSCFG registered ete142
[   62.413988] coresight ete142: CPU142: ete v1.0 initialized
[   62.425485] CSCFG registered ete143
[   62.425490] coresight ete143: CPU143: ete v1.0 initialized
[   63.899820] XFS (dm-2): Mounting V5 Filesystem 01654aa4-7809-4c8c-b416-b6c4f888b7df
[   63.926465] XFS (dm-2): Ending clean mount
[   64.677592] RPC: Registered named UNIX socket transport module.
[   64.678169] RPC: Registered udp transport module.
[   64.678175] RPC: Registered tcp transport module.
[   64.678179] RPC: Registered tcp-with-tls transport module.
[   64.678183] RPC: Registered tcp NFSv4.1 backchannel transport module.
[   67.235528] sadc (3889) used greatest stack depth: 20864 bytes left
[   68.113617] systemd-udevd (3093) used greatest stack depth: 20672 bytes left
[   68.128010] systemd-udevd (3184) used greatest stack depth: 20608 bytes left
[   70.067685] mlx5_core 0006:01:00.0 enP6s6f0np0: Link up
[   70.124372] mlx5_core 0006:01:00.0 mlx5_0: Port: 1 Link ACTIVE
[   71.712277] DMA-API: dma_debug_entry pool grown to 131072 (200%)
[   71.829560] mlx5_core 0006:01:00.1 enP6s6f1np1: Link down
[   83.965160] block dm-0: the capability attribute has been deprecated.
[   84.752064] block nvme0n1: No UUID available providing old NGUID
[  122.190748] dracut-install (6220) used greatest stack depth: 19568 bytes left
[  146.810672] dracut-install (8692) used greatest stack depth: 19472 bytes left

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Waiman Long]

On 1/21/26 10:49 PM, Waiman Long wrote:
>
> On 1/21/26 3:41 PM, Waiman Long wrote:
>>
>>>> Waiman, can you please give the following hack a go on your box? The
>>>> machines I have are thankfully limited to a single ITS group, so I
>>>> can't directly reproduce your issue.
>>> Have you managed to try this hack? I may be able to spend some time
>>> addressing the issue in the next cycle if I have an indication that
>>> I'm on the right track.
>>
>> Yes, I have tried out your hack patch and the 2-socket Grace test 
>> system booted up without producing any bug report for a RT debug 
>> kernel. I will try out your official patch once it come out. So 
>> moving the memory allocation to a later part of the hotplug bringup 
>> pipeline where sleeping is allowed should work. 
>
> Attaching the dmesg log for your further investigation. 

Ping,

Are you planning to send out an official patch soon?

Thanks,
Longman

Re: [PATCH] irqchip/gic-v3-its: Don't acquire rt_spin_lock in allocate_vpe_l1_table()

[Marc Zyngier]

On Mon, 09 Mar 2026 19:06:04 +0000,
Waiman Long <longman@redhat.com> wrote:
> 
> On 1/21/26 10:49 PM, Waiman Long wrote:
> > 
> > On 1/21/26 3:41 PM, Waiman Long wrote:
> >> 
> >>>> Waiman, can you please give the following hack a go on your box? The
> >>>> machines I have are thankfully limited to a single ITS group, so I
> >>>> can't directly reproduce your issue.
> >>> Have you managed to try this hack? I may be able to spend some time
> >>> addressing the issue in the next cycle if I have an indication that
> >>> I'm on the right track.
> >> 
> >> Yes, I have tried out your hack patch and the 2-socket Grace test
> >> system booted up without producing any bug report for a RT debug
> >> kernel. I will try out your official patch once it come out. So
> >> moving the memory allocation to a later part of the hotplug bringup
> >> pipeline where sleeping is allowed should work. 
> > 
> > Attaching the dmesg log for your further investigation. 
> 
> Ping,
> 
> Are you planning to send out an official patch soon?

Soon? On a geological scale, certainly. On a more practical scale,
when I get time, which hasn't happened so far in this cycle ($WORK
gets, unsurprisingly, in the way of solving problems I don't have).

If that's not soon enough, feel free to expand the hack I posted to
include all boot-time tables.

Thanks,

	M.

-- 
Without deviation from the norm, progress is not possible.