From: JerryJun <jerryjun123@163.com>
To: "Jan Kiszka" <jan.kiszka@siemens.com>,
"xenomai@lists.linux.dev" <xenomai@lists.linux.dev>
Subject: Re:Re: schedule delay 15ms
Date: Thu, 13 Nov 2025 12:00:22 +0800 (CST) [thread overview]
Message-ID: <25a5a707.3daf.19a7b5f1c16.Coremail.jerryjun123@163.com> (raw)
In-Reply-To: <d14c720e-021e-4fc8-8aba-340903db0fdf@siemens.com>
[-- Attachment #1: Type: text/plain, Size: 17203 bytes --]
We conducted tests on the kernel version v5.10.245-cip65-dovetail1. The test results are attached. During this period, we also performed latency tests, which showed a 10ms delay at 7174.313414 -> 7174.323086. irq 114 is net driver interrupt 。
At 2025-11-12 16:23:03, "Jan Kiszka" wrote:
>On 12.11.25 07:09, JerryJun wrote:
>>
>> hi：
>> We are encountering some scheduling issues. Within a 15ms time interval (99058.151147 -> 99058.167775), no real-time threads were scheduled,
>> including the swapper idle thread. We have a 1ms-polling-rt-task running on CPU1, but it was also not scheduled during this period.
>> Even the RTDM interrupts from peripherals were not responded to or processed. What could be the reason for this?
>>
>> Architecture： x86_64
>> linux kernel：5.10.199-dovetail1
>
>This version is 2 years old. Did you also check if the latest release
>(v5.10.245-cip65-dovetail1) has this issue?
>
>> cobalt：3.2.4
>> kernel cmdline: xenomai.supported_cpus=0xf idle=halt nosmap
>>
>> Thread-name CPU PRIO
>> main-thread 0 26
>> rt-task1 1 86
>> rt-task3 1 91
>> rt-task4 1 85
>> 1ms-polling-rt-task 1 94
>> rt-task2 2 85
>> rt-task5 2 92
>> rt-task6 2 92
>> rt-task7 2 85
>> rt-task8 2 85
>> rt-task13 2 90
>> rt-task15 2 85
>> kernel-drv-task11 2 98
>> kernel-drv-task10 3 94
>> kernel-drv-task12 3 98
>> kernel-drv-task14 3 98
>>
>> perf record -e cobalt_core:cobalt_schedule
>>
>> swapper 0 [001] 99058.149903: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task1 56487 [001] 99058.149905: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.149930: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task2 56508 [002] 99058.149932: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150029: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task2 56508 [002] 99058.150031: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [001] 99058.150034: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.150035: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.150036: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task4 56486 [001] 99058.150037: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [001] 99058.150052: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task1 56487 [001] 99058.150055: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150073: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task5 56510 [002] 99058.150075: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150078: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task6 56507 [002] 99058.150079: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150127: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task7 56499 [002] 99058.150131: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task7 56499 [002] 99058.150147: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task7 56499 [002] 99058.150148: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task2 56508 [002] 99058.150149: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task8 56496 [002] 99058.150150: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [001] 99058.150184: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.150185: cobalt_core:cobalt_schedule: status=0x10000000
>> t-task3 56485 [001] 99058.150186: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task4 56486 [001] 99058.150187: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [001] 99058.150202: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task1 56487 [001] 99058.150205: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150246: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task2 56508 [002] 99058.150248: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [001] 99058.150334: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.150335: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.150336: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task4 56486 [001] 99058.150337: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150345: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task2 56508 [002] 99058.150347: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [001] 99058.150352: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task1 56487 [001] 99058.150355: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [003] 99058.150366: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150372: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task5 56510 [002] 99058.150374: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150376: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task6 56507 [002] 99058.150378: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150381: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task7 56499 [002] 99058.150383: cobalt_core:cobalt_schedule: status=0x10000000
>> kernel-drv-task10 24070 [003] 99058.150387: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150444: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task2 56508 [002] 99058.150446: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150447: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task8 56496 [002] 99058.150448: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [001] 99058.150484: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.150485: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.150486: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task4 56486 [001] 99058.150487: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [001] 99058.150502: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task1 56487 [001] 99058.150504: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [003] 99058.150505: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task1 56487 [001] 99058.150505: cobalt_core:cobalt_schedule: status=0x10000000
>> kernel-drv-task10 24070 [003] 99058.150517: cobalt_core:cobalt_schedule: status=0x10000000
>> main-thread 24485 [002] 99058.150543: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task2 56508 [002] 99058.150544: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [001] 99058.150564: cobalt_core:cobalt_schedule: status=0x10000000
>> 1ms-polling-rt-task 56488 [001] 99058.150567: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [001] 99058.150611: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task1 56487 [001] 99058.150613: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150630: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task7 56499 [002] 99058.150632: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [001] 99058.150634: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.150635: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.150636: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task4 56486 [001] 99058.150637: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150642: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task2 56508 [002] 99058.150643: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150671: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task5 56510 [002] 99058.150673: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150675: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task6 56507 [002] 99058.150677: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150740: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task2 56508 [002] 99058.150742: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150745: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task8 56496 [002] 99058.150747: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [001] 99058.150761: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task1 56487 [001] 99058.150763: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [001] 99058.150783: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.150785: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.150786: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task4 56486 [001] 99058.150787: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150839: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task2 56508 [002] 99058.150841: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150879: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task7 56499 [002] 99058.150881: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [001] 99058.150911: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task1 56487 [001] 99058.150913: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [001] 99058.150933: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.150934: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.150935: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task4 56486 [001] 99058.150936: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150938: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task2 56508 [002] 99058.150940: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150970: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task5 56510 [002] 99058.150971: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.150974: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task6 56507 [002] 99058.150975: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.151037: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task2 56508 [002] 99058.151039: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.151044: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task8 56496 [002] 99058.151046: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [001] 99058.151060: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task1 56487 [001] 99058.151063: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [001] 99058.151082: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.151084: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.151085: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task4 56486 [001] 99058.151086: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.151138: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task7 56499 [002] 99058.151143: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task2 56508 [002] 99058.151147: cobalt_core:cobalt_schedule: status=0x10000000
>> (---schedule delay 15ms---)
>> swapper 0 [003] 99058.167775: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [001] 99058.167776: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.167777: cobalt_core:cobalt_schedule: status=0x10000000
>> 1ms-polling-rt-task 56488 [001] 99058.167792: cobalt_core:cobalt_schedule: status=0x10000000
>> kernel-drv-task11 24077 [002] 99058.167794: cobalt_core:cobalt_schedule: status=0x10000000
>> 1ms-polling-rt-task 56488 [001] 99058.167795: cobalt_core:cobalt_schedule: status=0x10000000
>> kernel-drv-task12 24088 [003] 99058.167797: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.167798: cobalt_core:cobalt_schedule: status=0x10000000
>> kernel-drv-task11 24077 [002] 99058.167801: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task5 56510 [002] 99058.167803: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task1 56487 [001] 99058.167804: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task6 56507 [002] 99058.167805: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task4 56486 [001] 99058.167807: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task13 56506 [002] 99058.167808: cobalt_core:cobalt_schedule: status=0x10000000
>> kernel-drv-task10 24070 [003] 99058.167809: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task2 56508 [002] 99058.167810: cobalt_core:cobalt_schedule: status=0x10000000
>> kernel-drv-task10 24070 [003] 99058.167811: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task13 56506 [002] 99058.167816: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [003] 99058.167817: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task13 56506 [002] 99058.167824: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task13 56506 [002] 99058.167826: cobalt_core:cobalt_schedule: status=0x10000000
>> kernel-drv-task10 24070 [003] 99058.167827: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task8 56496 [002] 99058.167828: cobalt_core:cobalt_schedule: status=0x10000000
>> kernel-drv-task10 24070 [003] 99058.167829: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task13 56506 [002] 99058.167833: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [003] 99058.167834: cobalt_core:cobalt_schedule: status=0x10000000
>> kernel-drv-task10 24070 [003] 99058.167843: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [001] 99058.167893: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task13 56506 [002] 99058.167894: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task7 56499 [002] 99058.167896: cobalt_core:cobalt_schedule: status=0x10000000
>> 1ms-polling-rt-task 56488 [001] 99058.167897: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task15 56598 [002] 99058.167898: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task13 56506 [002] 99058.167906: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task13 56506 [002] 99058.167921: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task15 56598 [002] 99058.167933: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task2 56508 [002] 99058.167934: cobalt_core:cobalt_schedule: status=0x10000000
>> main-thread 24483 [001] 99058.167945: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.167948: cobalt_core:cobalt_schedule: status=0x10000000
>> main-thread 56538 [003] 99058.167950: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.167950: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.167952: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.167953: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.167954: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.167955: cobalt_core:cobalt_schedule: status=0x10000000
>> kernel-drv-task10 24070 [003] 99058.167955: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task3 56485 [001] 99058.167956: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task1 56487 [001] 99058.167960: cobalt_core:cobalt_schedule: status=0x10000000
>> rt-task4 56486 [001] 99058.167962: cobalt_core:cobalt_schedule: status=0x10000000
>> kernel-drv-task11 24077 [002] 99058.167968: cobalt_core:cobalt_schedule: status=0x10000000
>> kernel-drv-task14 24083 [003] 99058.167976: cobalt_core:cobalt_schedule: status=0x10000000
>> kernel-drv-task14 24083 [003] 99058.167977: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.167977: cobalt_core:cobalt_schedule: status=0x10000000
>> kernel-drv-task12 24088 [003] 99058.167989: cobalt_core:cobalt_schedule: status=0x10000000
>> kernel-drv-task11 24077 [002] 99058.167990: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [002] 99058.167993: cobalt_core:cobalt_schedule: status=0x10000000
>> kernel-drv-task10 24070 [003] 99058.167996: cobalt_core:cobalt_schedule: status=0x10000000
>> swapper 0 [001] 99058.167997: cobalt_core:cobalt_schedule: status=0x10000000
>> kernel-drv-task14 24083 [003] 99058.168000: cobalt_core:cobalt_schedule: status=0x10000000
>>
>
>For a deeper analysis, it would be good to trace all cobalt* and all
>irq* events. Those may tell us if we are not getting irqs at all or if
>something is blocking their processing.
>
>Jan
>
>--
>Siemens AG, Foundational Technologies
>Linux Expert Center
[-- Attachment #2: schedule-delay.txt --]
[-- Type: text/plain, Size: 33451 bytes --]
swapper 0 [002] 7174.313272: cobalt_core:cobalt_timer_start: timer=0xffff888470136828([watchdog]) value=1000000000 interval=0 mode=0x0
rt-task2 3170 [002] 7174.313273: cobalt_core:cobalt_trace_pid: pid=3170, prio=85
swapper 0 [000] 7174.313273: cobalt_core:cobalt_timer_expire: timer=0xffffc9000096a458
swapper 0 [000] 7174.313274: cobalt_core:cobalt_synch_wakeup: synch=0xffffc9000096a540
swapper 0 [000] 7174.313274: cobalt_core:cobalt_thread_resume: name=sampling-10721 pid=10724 mask=0x2
swapper 0 [000] 7174.313274: cobalt_core:cobalt_trace_pid: pid=10724, prio=99
swapper 0 [000] 7174.313275: cobalt_core:cobalt_schedule: status=0x10000000
rt-task2 3170 [002] 7174.313275: cobalt_core:cobalt_thread_suspend: pid=3170 mask=0x4 timeout=7174288833545 timeout_mode=1 wchan=(nil)
rt-task2 3170 [002] 7174.313275: cobalt_core:cobalt_timer_start: timer=0xffffc9000096eef0(MAIN-TASK) value=7174288833545 interval=0 mode=0x1
rt-task2 3170 [002] 7174.313275: cobalt_core:cobalt_schedule: status=0x10000000
rt-task2 3170 [002] 7174.313276: cobalt_core:cobalt_trace_pid: pid=3170, prio=85
rt-task2 3170 [002] 7174.313276: cobalt_core:cobalt_switch_context: prev_name=rt-task2tor prev_pid=3170 prev_prio=85 prev_state=0x48044 ==> next_name=ROOT/2 next_pid=0 next_prio=-1
rt-task2 3170 [002] 7174.313276: cobalt_core:cobalt_timer_stop: timer=0xffff888470136828
swapper 0 [002] 7174.313277: cobalt_core:cobalt_trace_pid: pid=0, prio=-1
swapper 0 [000] 7174.313277: cobalt_core:cobalt_trace_pid: pid=0, prio=-1
swapper 0 [000] 7174.313278: cobalt_core:cobalt_switch_context: prev_name=ROOT/0 prev_pid=0 prev_prio=-1 prev_state=0x18008 ==> next_name=sampling-10721 next_pid=10724 next_prio=99
swapper 0 [000] 7174.313278: cobalt_core:cobalt_timer_start: timer=0xffff888470036828([watchdog]) value=1000000000 interval=0 mode=0x0
swapper 0 [001] 7174.313279: irq:irq_pipeline_entry: irq=33027
sampling-10721 10724 [000] 7174.313279: cobalt_core:cobalt_trace_pid: pid=10724, prio=99
swapper 0 [001] 7174.313279: cobalt_core:cobalt_timer_expire: timer=0xffffc90000977ef0
swapper 0 [001] 7174.313280: cobalt_core:cobalt_thread_resume: name=rt-task1 pid=3147 mask=0x4
swapper 0 [001] 7174.313280: cobalt_core:cobalt_trace_pid: pid=3147, prio=86
swapper 0 [001] 7174.313280: cobalt_core:cobalt_timer_stop: timer=0xffffc90000977ef0
swapper 0 [001] 7174.313281: cobalt_core:cobalt_schedule: status=0x10000000
sampling-10721 10724 [000] 7174.313281: cobalt_core:cobalt_synch_sleepon: synch=0xffffc9000096a540
sampling-10721 10724 [000] 7174.313281: cobalt_core:cobalt_thread_suspend: pid=10724 mask=0x2 timeout=0 timeout_mode=0 wchan=0xffffc9000096a540
sampling-10721 10724 [000] 7174.313281: cobalt_core:cobalt_schedule: status=0x10000000
sampling-10721 10724 [000] 7174.313282: cobalt_core:cobalt_trace_pid: pid=10724, prio=99
sampling-10721 10724 [000] 7174.313282: cobalt_core:cobalt_switch_context: prev_name=sampling-10721 prev_pid=10724 prev_prio=99 prev_state=0x4c042 ==> next_name=ROOT/0 next_pid=0 next_prio=-1
sampling-10721 10724 [000] 7174.313282: cobalt_core:cobalt_timer_stop: timer=0xffff888470036828
swapper 0 [000] 7174.313283: cobalt_core:cobalt_trace_pid: pid=0, prio=-1
swapper 0 [001] 7174.313283: cobalt_core:cobalt_trace_pid: pid=0, prio=-1
swapper 0 [001] 7174.313284: cobalt_core:cobalt_switch_context: prev_name=ROOT/1 prev_pid=0 prev_prio=-1 prev_state=0x18008 ==> next_name=rt-task1 next_pid=3147 next_prio=86
swapper 0 [001] 7174.313284: cobalt_core:cobalt_timer_start: timer=0xffff8884700b6828([watchdog]) value=1000000000 interval=0 mode=0x0
rt-task1 3147 [001] 7174.313285: cobalt_core:cobalt_trace_pid: pid=3147, prio=86
rt-task1 3147 [001] 7174.313287: cobalt_core:cobalt_thread_suspend: pid=3147 mask=0x4 timeout=7174288896564 timeout_mode=1 wchan=(nil)
rt-task1 3147 [001] 7174.313287: cobalt_core:cobalt_timer_start: timer=0xffffc90000977ef0(MAIN-TASK) value=7174288896564 interval=0 mode=0x1
rt-task1 3147 [001] 7174.313287: cobalt_core:cobalt_schedule: status=0x10000000
rt-task1 3147 [001] 7174.313288: cobalt_core:cobalt_trace_pid: pid=3147, prio=86
rt-task1 3147 [001] 7174.313288: cobalt_core:cobalt_switch_context: prev_name=rt-task1 prev_pid=3147 prev_prio=86 prev_state=0x48044 ==> next_name=ROOT/1 next_pid=0 next_prio=-1
rt-task1 3147 [001] 7174.313289: cobalt_core:cobalt_timer_stop: timer=0xffff8884700b6828
swapper 0 [001] 7174.313289: cobalt_core:cobalt_trace_pid: pid=0, prio=-1
swapper 0 [003] 7174.313300: irq:irq_pipeline_entry: irq=33027
swapper 0 [003] 7174.313301: cobalt_core:cobalt_timer_expire: timer=0xffff8884701b6298
swapper 0 [003] 7174.313305: cobalt_core:cobalt_timer_start: timer=0xffff8884701b6298([host-timer/3]) value=83456 interval=0 mode=0x0
swapper 0 [001] 7174.313309: irq:irq_pipeline_entry: irq=33027
swapper 0 [001] 7174.313309: cobalt_core:cobalt_timer_expire: timer=0xffff8884700b6298
swapper 0 [001] 7174.313311: cobalt_core:cobalt_timer_start: timer=0xffff8884700b6298([host-timer/1]) value=194701 interval=0 mode=0x0
swapper 0 [002] 7174.313360: irq:irq_pipeline_entry: irq=33027
swapper 0 [002] 7174.313361: cobalt_core:cobalt_timer_expire: timer=0xffffc900009736f0
swapper 0 [002] 7174.313361: cobalt_core:cobalt_thread_resume: name=rt-task7 or pid=3161 mask=0x4
swapper 0 [002] 7174.313361: cobalt_core:cobalt_trace_pid: pid=3161, prio=85
swapper 0 [002] 7174.313362: cobalt_core:cobalt_timer_stop: timer=0xffffc900009736f0
swapper 0 [002] 7174.313362: cobalt_core:cobalt_schedule: status=0x10000000
swapper 0 [002] 7174.313362: cobalt_core:cobalt_trace_pid: pid=0, prio=-1
swapper 0 [002] 7174.313363: cobalt_core:cobalt_switch_context: prev_name=ROOT/2 prev_pid=0 prev_prio=-1 prev_state=0x18008 ==> next_name=rt-task7 or next_pid=3161 next_prio=85
swapper 0 [001] 7174.313363: irq:irq_pipeline_entry: irq=33027
swapper 0 [002] 7174.313363: cobalt_core:cobalt_timer_start: timer=0xffff888470136828([watchdog]) value=1000000000 interval=0 mode=0x0
rt-task7 3161 [002] 7174.313364: cobalt_core:cobalt_trace_pid: pid=3161, prio=85
swapper 0 [001] 7174.313364: cobalt_core:cobalt_timer_expire: timer=0xffffc90000979cf0
swapper 0 [001] 7174.313365: cobalt_core:cobalt_thread_resume: name=rt-task3 pid=3145 mask=0x4
swapper 0 [001] 7174.313365: cobalt_core:cobalt_trace_pid: pid=3145, prio=91
swapper 0 [001] 7174.313365: cobalt_core:cobalt_timer_stop: timer=0xffffc90000979cf0
swapper 0 [001] 7174.313365: cobalt_core:cobalt_synch_forget: synch=0xffffc9000097ab08
rt-task7 3161 [002] 7174.313366: cobalt_core:cobalt_thread_suspend: pid=3161 mask=0x4 timeout=7174289074552 timeout_mode=1 wchan=(nil)
swapper 0 [001] 7174.313366: cobalt_core:cobalt_schedule: status=0x10000000
rt-task7 3161 [002] 7174.313366: cobalt_core:cobalt_timer_start: timer=0xffffc900009736f0(MAIN-TASK) value=7174289074552 interval=0 mode=0x1
rt-task7 3161 [002] 7174.313367: cobalt_core:cobalt_schedule: status=0x10000000
rt-task7 3161 [002] 7174.313367: cobalt_core:cobalt_trace_pid: pid=3161, prio=85
rt-task7 3161 [002] 7174.313367: cobalt_core:cobalt_switch_context: prev_name=rt-task7 or prev_pid=3161 prev_prio=85 prev_state=0x48044 ==> next_name=ROOT/2 next_pid=0 next_prio=-1
rt-task7 3161 [002] 7174.313368: cobalt_core:cobalt_timer_stop: timer=0xffff888470136828
swapper 0 [002] 7174.313368: cobalt_core:cobalt_trace_pid: pid=0, prio=-1
swapper 0 [001] 7174.313369: cobalt_core:cobalt_trace_pid: pid=0, prio=-1
swapper 0 [001] 7174.313369: cobalt_core:cobalt_switch_context: prev_name=ROOT/1 prev_pid=0 prev_prio=-1 prev_state=0x18008 ==> next_name=rt-task3 next_pid=3145 next_prio=91
swapper 0 [001] 7174.313369: cobalt_core:cobalt_timer_start: timer=0xffff8884700b6828([watchdog]) value=1000000000 interval=0 mode=0x0
rt-task3 3145 [001] 7174.313370: cobalt_core:cobalt_trace_pid: pid=3145, prio=91
swapper 0 [002] 7174.313371: irq:irq_pipeline_entry: irq=33027
rt-task3 3145 [001] 7174.313371: irq:irq_pipeline_entry: irq=33027
swapper 0 [002] 7174.313371: cobalt_core:cobalt_timer_expire: timer=0xffffc9000096eef0
swapper 0 [002] 7174.313371: cobalt_core:cobalt_thread_resume: name=rt-task2tor pid=3170 mask=0x4
swapper 0 [002] 7174.313372: cobalt_core:cobalt_trace_pid: pid=3170, prio=85
swapper 0 [000] 7174.313372: irq:irq_pipeline_entry: irq=33027
swapper 0 [002] 7174.313372: cobalt_core:cobalt_timer_stop: timer=0xffffc9000096eef0
swapper 0 [002] 7174.313372: cobalt_core:cobalt_schedule: status=0x10000000
rt-task3 3145 [001] 7174.313372: cobalt_core:cobalt_timer_expire: timer=0xffffc90000978ef0
rt-task3 3145 [001] 7174.313373: cobalt_core:cobalt_thread_resume: name=rt-task476 pid=3146 mask=0x4
rt-task3 3145 [001] 7174.313373: cobalt_core:cobalt_trace_pid: pid=3146, prio=85
rt-task3 3145 [001] 7174.313373: cobalt_core:cobalt_timer_stop: timer=0xffffc90000978ef0
rt-task3 3145 [001] 7174.313374: cobalt_core:cobalt_schedule: status=0x10000000
swapper 0 [000] 7174.313374: cobalt_core:cobalt_timer_expire: timer=0xffffc9000096a458
swapper 0 [000] 7174.313374: cobalt_core:cobalt_synch_wakeup: synch=0xffffc9000096a540
swapper 0 [000] 7174.313374: cobalt_core:cobalt_thread_resume: name=sampling-10721 pid=10724 mask=0x2
swapper 0 [000] 7174.313375: cobalt_core:cobalt_trace_pid: pid=10724, prio=99
swapper 0 [000] 7174.313375: cobalt_core:cobalt_schedule: status=0x10000000
swapper 0 [002] 7174.313375: cobalt_core:cobalt_trace_pid: pid=0, prio=-1
swapper 0 [002] 7174.313376: cobalt_core:cobalt_switch_context: prev_name=ROOT/2 prev_pid=0 prev_prio=-1 prev_state=0x18008 ==> next_name=rt-task2tor next_pid=3170 next_prio=85
swapper 0 [002] 7174.313376: cobalt_core:cobalt_timer_start: timer=0xffff888470136828([watchdog]) value=1000000000 interval=0 mode=0x0
rt-task2 3170 [002] 7174.313377: cobalt_core:cobalt_trace_pid: pid=3170, prio=85
rt-task3 3145 [001] 7174.313377: cobalt_core:cobalt_trace_pid: pid=3145, prio=91
swapper 0 [000] 7174.313378: cobalt_core:cobalt_trace_pid: pid=0, prio=-1
swapper 0 [000] 7174.313378: cobalt_core:cobalt_switch_context: prev_name=ROOT/0 prev_pid=0 prev_prio=-1 prev_state=0x18008 ==> next_name=sampling-10721 next_pid=10724 next_prio=99
swapper 0 [000] 7174.313379: cobalt_core:cobalt_timer_start: timer=0xffff888470036828([watchdog]) value=1000000000 interval=0 mode=0x0
sampling-10721 10724 [000] 7174.313379: cobalt_core:cobalt_trace_pid: pid=10724, prio=99
rt-task2 3170 [002] 7174.313380: cobalt_core:cobalt_thread_suspend: pid=3170 mask=0x4 timeout=7174288937443 timeout_mode=1 wchan=(nil)
rt-task2 3170 [002] 7174.313380: cobalt_core:cobalt_timer_start: timer=0xffffc9000096eef0(MAIN-TASK) value=7174288937443 interval=0 mode=0x1
rt-task2 3170 [002] 7174.313381: cobalt_core:cobalt_schedule: status=0x10000000
rt-task2 3170 [002] 7174.313381: cobalt_core:cobalt_trace_pid: pid=3170, prio=85
rt-task2 3170 [002] 7174.313381: cobalt_core:cobalt_switch_context: prev_name=rt-task2tor prev_pid=3170 prev_prio=85 prev_state=0x48044 ==> next_name=ROOT/2 next_pid=0 next_prio=-1
rt-task2 3170 [002] 7174.313382: cobalt_core:cobalt_timer_stop: timer=0xffff888470136828
swapper 0 [002] 7174.313382: cobalt_core:cobalt_trace_pid: pid=0, prio=-1
rt-task3 3145 [001] 7174.313383: cobalt_core:cobalt_synch_acquire: synch=0xffffc9000097a908
sampling-10721 10724 [000] 7174.313383: cobalt_core:cobalt_synch_sleepon: synch=0xffffc9000096a540
sampling-10721 10724 [000] 7174.313384: cobalt_core:cobalt_thread_suspend: pid=10724 mask=0x2 timeout=0 timeout_mode=0 wchan=0xffffc9000096a540
sampling-10721 10724 [000] 7174.313384: cobalt_core:cobalt_schedule: status=0x10000000
sampling-10721 10724 [000] 7174.313384: cobalt_core:cobalt_trace_pid: pid=10724, prio=99
sampling-10721 10724 [000] 7174.313385: cobalt_core:cobalt_switch_context: prev_name=sampling-10721 prev_pid=10724 prev_prio=99 prev_state=0x4c042 ==> next_name=ROOT/0 next_pid=0 next_prio=-1
sampling-10721 10724 [000] 7174.313385: cobalt_core:cobalt_timer_stop: timer=0xffff888470036828
swapper 0 [000] 7174.313386: cobalt_core:cobalt_trace_pid: pid=0, prio=-1
rt-task3 3145 [001] 7174.313386: cobalt_core:cobalt_synch_release: synch=0xffffc9000097a908
rt-task3 3145 [001] 7174.313386: cobalt_core:cobalt_synch_sleepon: synch=0xffffc9000097ab08
rt-task3 3145 [001] 7174.313387: cobalt_core:cobalt_thread_suspend: pid=3145 mask=0x2 timeout=7174288993625 timeout_mode=1 wchan=0xffffc9000097ab08
rt-task3 3145 [001] 7174.313387: cobalt_core:cobalt_timer_start: timer=0xffffc90000979cf0(MAIN-TASK) value=7174288993625 interval=0 mode=0x1
rt-task3 3145 [001] 7174.313387: cobalt_core:cobalt_schedule: status=0x10000000
rt-task3 3145 [001] 7174.313388: cobalt_core:cobalt_trace_pid: pid=3145, prio=91
rt-task3 3145 [001] 7174.313388: cobalt_core:cobalt_switch_context: prev_name=rt-task3 prev_pid=3145 prev_prio=91 prev_state=0x48046 ==> next_name=rt-task476 next_pid=3146 next_prio=85
rt-task4 3146 [001] 7174.313389: cobalt_core:cobalt_trace_pid: pid=3146, prio=85
swapper 0 [003] 7174.313389: irq:irq_pipeline_entry: irq=33027
rt-task4 3146 [001] 7174.313390: cobalt_core:cobalt_thread_suspend: pid=3146 mask=0x4 timeout=7174288999408 timeout_mode=1 wchan=(nil)
rt-task4 3146 [001] 7174.313390: cobalt_core:cobalt_timer_start: timer=0xffffc90000978ef0(MAIN-TASK) value=7174288999408 interval=0 mode=0x1
rt-task4 3146 [001] 7174.313390: cobalt_core:cobalt_schedule: status=0x10000000
rt-task4 3146 [001] 7174.313391: cobalt_core:cobalt_trace_pid: pid=3146, prio=85
rt-task4 3146 [001] 7174.313391: cobalt_core:cobalt_switch_context: prev_name=rt-task476 prev_pid=3146 prev_prio=85 prev_state=0x48044 ==> next_name=ROOT/1 next_pid=0 next_prio=-1
rt-task4 3146 [001] 7174.313391: cobalt_core:cobalt_timer_stop: timer=0xffff8884700b6828
swapper 0 [001] 7174.313392: cobalt_core:cobalt_trace_pid: pid=0, prio=-1
swapper 0 [003] 7174.313392: cobalt_core:cobalt_timer_expire: timer=0xffff8884701b6298
swapper 0 [003] 7174.313396: cobalt_core:cobalt_timer_start: timer=0xffff8884701b6298([host-timer/3]) value=84197 interval=0 mode=0x0
swapper 0 [003] 7174.313414: irq:irq_pipeline_entry: irq=114
swapper 0 [003] 7174.323086: irq:irq_pipeline_entry: irq=33027
swapper 0 [000] 7174.323087: irq:irq_pipeline_entry: irq=33027
swapper 0 [001] 7174.323087: irq:irq_pipeline_entry: irq=33027
swapper 0 [002] 7174.323087: irq:irq_pipeline_entry: irq=33027
swapper 0 [003] 7174.323087: cobalt_core:cobalt_timer_expire: timer=0xffffffffa0a546b8
swapper 0 [003] 7174.323088: cobalt_core:cobalt_thread_resume: name=kernel-drv-task11 pid=2456 mask=0x4
swapper 0 [003] 7174.323088: cobalt_core:cobalt_trace_pid: pid=2456, prio=94
swapper 0 [003] 7174.323088: cobalt_core:cobalt_timer_stop: timer=0xffffffffa0a546b8
swapper 0 [003] 7174.323088: cobalt_core:cobalt_synch_forget: synch=0xffffffffa0a549e8
swapper 0 [003] 7174.323089: cobalt_core:cobalt_timer_expire: timer=0xffff8884701b6298
swapper 0 [000] 7174.323089: cobalt_core:cobalt_timer_expire: timer=0xffff888470036298
swapper 0 [003] 7174.323089: cobalt_core:cobalt_schedule: status=0x10000000
swapper 0 [000] 7174.323090: cobalt_core:cobalt_timer_expire: timer=0xffffc9000096a458
swapper 0 [000] 7174.323090: cobalt_core:cobalt_synch_wakeup: synch=0xffffc9000096a540
swapper 0 [000] 7174.323090: cobalt_core:cobalt_thread_resume: name=sampling-10721 pid=10724 mask=0x2
swapper 0 [000] 7174.323090: cobalt_core:cobalt_trace_pid: pid=10724, prio=99
swapper 0 [000] 7174.323091: cobalt_core:cobalt_schedule: status=0x10000000
swapper 0 [001] 7174.323091: cobalt_core:cobalt_timer_expire: timer=0xffffc90000977ef0
swapper 0 [001] 7174.323092: cobalt_core:cobalt_thread_resume: name=rt-task1 pid=3147 mask=0x4
swapper 0 [001] 7174.323092: cobalt_core:cobalt_trace_pid: pid=3147, prio=86
swapper 0 [001] 7174.323092: cobalt_core:cobalt_timer_stop: timer=0xffffc90000977ef0
swapper 0 [001] 7174.323092: cobalt_core:cobalt_timer_expire: timer=0xffff8884700b6298
swapper 0 [001] 7174.323093: cobalt_core:cobalt_timer_expire: timer=0xffffc90000979cf0
swapper 0 [001] 7174.323093: cobalt_core:cobalt_thread_resume: name=rt-task3 pid=3145 mask=0x4
swapper 0 [001] 7174.323093: cobalt_core:cobalt_trace_pid: pid=3145, prio=91
swapper 0 [001] 7174.323093: cobalt_core:cobalt_timer_stop: timer=0xffffc90000979cf0
swapper 0 [001] 7174.323094: cobalt_core:cobalt_synch_forget: synch=0xffffc9000097ab08
swapper 0 [001] 7174.323094: cobalt_core:cobalt_timer_expire: timer=0xffffc90000978ef0
swapper 0 [001] 7174.323094: cobalt_core:cobalt_thread_resume: name=rt-task476 pid=3146 mask=0x4
swapper 0 [001] 7174.323095: cobalt_core:cobalt_trace_pid: pid=3146, prio=85
swapper 0 [001] 7174.323095: cobalt_core:cobalt_timer_stop: timer=0xffffc90000978ef0
swapper 0 [001] 7174.323095: cobalt_core:cobalt_timer_expire: timer=0xffffc900009770f0
swapper 0 [001] 7174.323095: cobalt_core:cobalt_thread_resume: name=1ms-polling-task76 pid=3148 mask=0x4
swapper 0 [001] 7174.323096: cobalt_core:cobalt_trace_pid: pid=3148, prio=93
swapper 0 [001] 7174.323096: cobalt_core:cobalt_timer_stop: timer=0xffffc900009770f0
swapper 0 [001] 7174.323096: cobalt_core:cobalt_timer_expire: timer=0xffffc900009752f0
swapper 0 [001] 7174.323097: cobalt_core:cobalt_thread_resume: name=rt-task20076 pid=3150 mask=0x4
swapper 0 [001] 7174.323097: cobalt_core:cobalt_trace_pid: pid=3150, prio=93
swapper 0 [001] 7174.323097: cobalt_core:cobalt_timer_stop: timer=0xffffc900009752f0
swapper 0 [001] 7174.323097: cobalt_core:cobalt_synch_forget: synch=0xffffffffa0a83d80
swapper 0 [002] 7174.323098: cobalt_core:cobalt_timer_expire: timer=0xffffc9000096eef0
swapper 0 [001] 7174.323098: cobalt_core:cobalt_schedule: status=0x10000000
swapper 0 [002] 7174.323098: cobalt_core:cobalt_thread_resume: name=rt-task2tor pid=3170 mask=0x4
swapper 0 [002] 7174.323099: cobalt_core:cobalt_trace_pid: pid=3170, prio=85
swapper 0 [002] 7174.323099: cobalt_core:cobalt_timer_stop: timer=0xffffc9000096eef0
swapper 0 [002] 7174.323099: cobalt_core:cobalt_timer_expire: timer=0xffffc9000096e0f0
swapper 0 [002] 7174.323099: cobalt_core:cobalt_thread_resume: name=rt-task5 pid=3172 mask=0x4
swapper 0 [002] 7174.323100: cobalt_core:cobalt_trace_pid: pid=3172, prio=92
swapper 0 [002] 7174.323100: cobalt_core:cobalt_timer_stop: timer=0xffffc9000096e0f0
swapper 0 [002] 7174.323100: cobalt_core:cobalt_timer_expire: timer=0xffffc9000096fcf0
swapper 0 [002] 7174.323100: cobalt_core:cobalt_thread_resume: name=rt-task6 pid=3169 mask=0x4
swapper 0 [002] 7174.323101: cobalt_core:cobalt_trace_pid: pid=3169, prio=92
swapper 0 [002] 7174.323101: cobalt_core:cobalt_timer_stop: timer=0xffffc9000096fcf0
swapper 0 [002] 7174.323101: cobalt_core:cobalt_timer_expire: timer=0xffffc900009744f0
swapper 0 [002] 7174.323102: cobalt_core:cobalt_thread_resume: name=rt-task8 pid=3158 mask=0x4
swapper 0 [002] 7174.323102: cobalt_core:cobalt_trace_pid: pid=3158, prio=85
swapper 0 [002] 7174.323102: cobalt_core:cobalt_timer_stop: timer=0xffffc900009744f0
swapper 0 [002] 7174.323102: cobalt_core:cobalt_timer_expire: timer=0xffffc900009736f0
swapper 0 [002] 7174.323103: cobalt_core:cobalt_thread_resume: name=rt-task7 or pid=3161 mask=0x4
swapper 0 [002] 7174.323103: cobalt_core:cobalt_trace_pid: pid=3161, prio=85
swapper 0 [002] 7174.323103: cobalt_core:cobalt_timer_stop: timer=0xffffc900009736f0
swapper 0 [002] 7174.323103: cobalt_core:cobalt_timer_expire: timer=0xffff888470136298
swapper 0 [002] 7174.323104: cobalt_core:cobalt_timer_expire: timer=0xffffffffa0a83fe0
swapper 0 [002] 7174.323104: cobalt_core:cobalt_thread_resume: name=kernel-drv-task11 pid=2462 mask=0x4
swapper 0 [002] 7174.323104: cobalt_core:cobalt_trace_pid: pid=2462, prio=98
swapper 0 [002] 7174.323104: cobalt_core:cobalt_timer_stop: timer=0xffffffffa0a83fe0
swapper 0 [002] 7174.323105: cobalt_core:cobalt_synch_forget: synch=0xffffffffa0a84310
swapper 0 [003] 7174.323105: cobalt_core:cobalt_trace_pid: pid=0, prio=-1
swapper 0 [002] 7174.323105: cobalt_core:cobalt_schedule: status=0x10000000
swapper 0 [003] 7174.323106: cobalt_core:cobalt_switch_context: prev_name=ROOT/3 prev_pid=0 prev_prio=-1 prev_state=0x18008 ==> next_name=kernel-drv-task11 next_pid=2456 next_prio=94
swapper 0 [003] 7174.323106: cobalt_core:cobalt_timer_start: timer=0xffff8884701b6828([watchdog]) value=1000000000 interval=0 mode=0x0
kernel-drv-task11 2456 [003] 7174.323107: cobalt_core:cobalt_trace_pid: pid=2456, prio=94
swapper 0 [000] 7174.323108: cobalt_core:cobalt_trace_pid: pid=0, prio=-1
swapper 0 [000] 7174.323108: cobalt_core:cobalt_switch_context: prev_name=ROOT/0 prev_pid=0 prev_prio=-1 prev_state=0x18008 ==> next_name=sampling-10721 next_pid=10724 next_prio=99
swapper 0 [000] 7174.323109: cobalt_core:cobalt_timer_start: timer=0xffff888470036828([watchdog]) value=1000000000 interval=0 mode=0x0
sampling-10721 10724 [000] 7174.323110: cobalt_core:cobalt_trace_pid: pid=10724, prio=99
swapper 0 [001] 7174.323110: cobalt_core:cobalt_trace_pid: pid=0, prio=-1
swapper 0 [001] 7174.323111: cobalt_core:cobalt_switch_context: prev_name=ROOT/1 prev_pid=0 prev_prio=-1 prev_state=0x18008 ==> next_name=1ms-polling-task76 next_pid=3148 next_prio=93
swapper 0 [001] 7174.323111: cobalt_core:cobalt_timer_start: timer=0xffff8884700b6828([watchdog]) value=1000000000 interval=0 mode=0x0
1ms-polling-task 3148 [001] 7174.323112: cobalt_core:cobalt_trace_pid: pid=3148, prio=93
swapper 0 [002] 7174.323113: cobalt_core:cobalt_trace_pid: pid=0, prio=-1
1ms-polling-task 3148 [001] 7174.323113: irq:irq_pipeline_entry: irq=83
swapper 0 [002] 7174.323113: cobalt_core:cobalt_switch_context: prev_name=ROOT/2 prev_pid=0 prev_prio=-1 prev_state=0x18008 ==> next_name=kernel-drv-task11 next_pid=2462 next_prio=98
swapper 0 [002] 7174.323113: cobalt_core:cobalt_timer_start: timer=0xffff888470136828([watchdog]) value=1000000000 interval=0 mode=0x0
kernel-drv-task11 2462 [002] 7174.323114: cobalt_core:cobalt_trace_pid: pid=2462, prio=98
sampling-10721 10724 [000] 7174.323115: cobalt_core:cobalt_synch_sleepon: synch=0xffffc9000096a540
sampling-10721 10724 [000] 7174.323115: cobalt_core:cobalt_thread_suspend: pid=10724 mask=0x2 timeout=0 timeout_mode=0 wchan=0xffffc9000096a540
sampling-10721 10724 [000] 7174.323116: cobalt_core:cobalt_schedule: status=0x10000000
sampling-10721 10724 [000] 7174.323116: cobalt_core:cobalt_trace_pid: pid=10724, prio=99
sampling-10721 10724 [000] 7174.323116: cobalt_core:cobalt_switch_context: prev_name=sampling-10721 prev_pid=10724 prev_prio=99 prev_state=0x4c042 ==> next_name=ROOT/0 next_pid=0 next_prio=-1
sampling-10721 10724 [000] 7174.323117: cobalt_core:cobalt_timer_stop: timer=0xffff888470036828
swapper 0 [000] 7174.323117: cobalt_core:cobalt_trace_pid: pid=0, prio=-1
kernel-drv-task11 2456 [003] 7174.323124: irq:irq_pipeline_entry: irq=33044
swapper 0 [000] 7174.323125: cobalt_core:cobalt_timer_start: timer=0xffff888470036298([host-timer/0]) value=1415302 interval=0 mode=0x0
1ms-polling-task 3148 [001] 7174.323125: irq:irq_pipeline_entry: irq=33044
swapper 0 [000] 7174.323126: cobalt_core:cobalt_timer_start: timer=0xffff888470036298([host-timer/0]) value=7336453 interval=0 mode=0x0
swapper 0 [000] 7174.323126: cobalt_core:cobalt_timer_start: timer=0xffff888470036298([host-timer/0]) value=1413993 interval=0 mode=0x0
1ms-polling-task 3148 [001] 7174.323127: cobalt_core:cobalt_synch_sleepon: synch=0xffffffffa0a54058
1ms-polling-task 3148 [001] 7174.323127: cobalt_core:cobalt_thread_suspend: pid=3148 mask=0x2 timeout=0 timeout_mode=0 wchan=0xffffffffa0a54058
1ms-polling-task 3148 [001] 7174.323127: cobalt_core:cobalt_schedule: status=0x10000000
1ms-polling-task 3148 [001] 7174.323128: cobalt_core:cobalt_trace_pid: pid=3148, prio=93
1ms-polling-task 3148 [001] 7174.323128: cobalt_core:cobalt_switch_context: prev_name=1ms-polling-task76 prev_pid=3148 prev_prio=93 prev_state=0x48042 ==> next_name=rt-task20076 next_pid=3150 next_prio=93
rt-task20 3150 [001] 7174.323129: cobalt_core:cobalt_trace_pid: pid=3150, prio=93
kernel-drv-task11 2456 [003] 7174.323130: cobalt_core:cobalt_synch_wakeup: synch=0xffffffffa0a54058
kernel-drv-task11 2462 [002] 7174.323130: irq:irq_pipeline_entry: irq=33044
kernel-drv-task11 2456 [003] 7174.323131: cobalt_core:cobalt_thread_resume: name=1ms-polling-task76 pid=3148 mask=0x2
kernel-drv-task11 2456 [003] 7174.323131: cobalt_core:cobalt_trace_pid: pid=3148, prio=93
kernel-drv-task11 2456 [003] 7174.323131: cobalt_core:cobalt_schedule: status=0x10000000
kernel-drv-task11 2456 [003] 7174.323132: cobalt_core:cobalt_trace_pid: pid=2456, prio=94
rt-task20 3150 [001] 7174.323133: irq:irq_pipeline_entry: irq=33025
MAIN-TASK 3128 [000] 7174.323133: cobalt_core:cobalt_timer_start: timer=0xffff888470036298([host-timer/0]) value=999886 interval=0 mode=0x0
rt-task20 3150 [001] 7174.323133: cobalt_core:cobalt_schedule_remote: status=0x10000000
rt-task20 3150 [001] 7174.323134: cobalt_core:cobalt_schedule: status=0x10000000
rt-task20 3150 [001] 7174.323135: cobalt_core:cobalt_trace_pid: pid=3150, prio=93
kernel-drv-task11 2462 [002] 7174.323136: cobalt_core:cobalt_synch_sleepon: synch=0xffffffffa0a839b8
kernel-drv-task11 2462 [002] 7174.323136: cobalt_core:cobalt_thread_suspend: pid=2462 mask=0x2 timeout=0 timeout_mode=0 wchan=0xffffffffa0a839b8
kernel-drv-task11 2462 [002] 7174.323137: cobalt_core:cobalt_schedule: status=0x10000000
kernel-drv-task11 2462 [002] 7174.323137: cobalt_core:cobalt_trace_pid: pid=2462, prio=98
kernel-drv-task11 2462 [002] 7174.323138: cobalt_core:cobalt_switch_context: prev_name=kernel-drv-task11 prev_pid=2462 prev_prio=98 prev_state=0x42 ==> next_name=rt-task5 next_pid=3172 next_prio=92
rt-task5 3172 [002] 7174.323138: cobalt_core:cobalt_trace_pid: pid=3172, prio=92
latency test result:
RTD| -2.334| -0.852| 24.850| 96| 0| -2.585| 9636.115
RTD| -2.417| -0.840| 27.158| 96| 0| -2.585| 9636.115
RTD| -2.408| -0.850| 26.248| 96| 0| -2.585| 9636.115
RTD| -2.453| -0.769| 23.633| 96| 0| -2.585| 9636.115
RTD| -2.288| -0.778| 26.945| 96| 0| -2.585| 9636.115
RTD| -2.415| -0.811| 28.071| 96| 0| -2.585| 9636.115
RTD| -2.345| -0.863| 22.760| 96| 0| -2.585| 9636.115
RTD| -2.369| -0.810| 26.263| 96| 0| -2.585| 9636.115
RTD| -2.307| -0.874| 23.359| 96| 0| -2.585| 9636.115
RTD| -2.334| -0.890| 27.921| 96| 0| -2.585| 9636.115
RTD| -2.374| -0.757| 24.251| 96| 0| -2.585| 9636.115
RTD| -2.440| -0.786| 19.938| 96| 0| -2.585| 9636.115
RTD| -2.343| -0.823| 27.010| 96| 0| -2.585| 9636.115
RTD| -2.339| -0.902| 29.216| 96| 0| -2.585| 9636.115
RTD| -2.351| -0.826| 19.601| 96| 0| -2.585| 9636.115
RTT| 00:37:28 (periodic user-mode task, 100 us period, priority 99)
RTH|----lat min|----lat avg|----lat max|-overrun|---msw|---lat best|--lat worst
RTD| -2.338| -0.859| 28.091| 96| 0| -2.585| 9636.115
RTD| -2.342| -0.905| 23.030| 96| 0| -2.585| 9636.115
RTD| -2.402| -0.778| 26.933| 96| 0| -2.585| 9636.115
RTD| -2.318| -0.726| 27.356| 96| 0| -2.585| 9636.115
RTD| -2.332| -0.820| 19.761| 96| 0| -2.585| 9636.115
RTD| -2.393| -0.868| 24.489| 96| 0| -2.585| 9636.115
next prev parent reply other threads:[~2025-11-13 4:00 UTC|newest]
Thread overview: 11+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-11-12 6:09 schedule delay 15ms JerryJun
2025-11-12 8:23 ` Jan Kiszka
2025-11-13 4:00 ` JerryJun [this message]
2025-11-13 5:31 ` Jan Kiszka
2025-11-14 2:48 ` JerryJun
2025-11-14 5:38 ` Jan Kiszka
2025-11-18 15:31 ` JerryJun
2025-11-18 16:00 ` Jan Kiszka
2025-11-20 8:10 ` JerryJun
2025-11-20 18:53 ` Jan Kiszka
2025-11-26 3:20 ` JerryJun
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=25a5a707.3daf.19a7b5f1c16.Coremail.jerryjun123@163.com \
--to=jerryjun123@163.com \
--cc=jan.kiszka@siemens.com \
--cc=xenomai@lists.linux.dev \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.