From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id C00D1C433F5 for ; Tue, 11 Oct 2022 09:13:53 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229508AbiJKJNw (ORCPT ); Tue, 11 Oct 2022 05:13:52 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:41580 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229436AbiJKJNw (ORCPT ); Tue, 11 Oct 2022 05:13:52 -0400 Received: from mx1.molgen.mpg.de (mx3.molgen.mpg.de [141.14.17.11]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 77BC1EE18; Tue, 11 Oct 2022 02:13:50 -0700 (PDT) Received: from [192.168.0.2] (ip5f5aef0e.dynamic.kabel-deutschland.de [95.90.239.14]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) (Authenticated sender: pmenzel) by mx.molgen.mpg.de (Postfix) with ESMTPSA id EB00C61EA1929; Tue, 11 Oct 2022 11:13:48 +0200 (CEST) Message-ID: Date: Tue, 11 Oct 2022 11:13:48 +0200 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.3.2 Subject: Re: How to trace serial console init during boot-time? Content-Language: en-US To: Steven Rostedt Cc: Ingo Molnar , Greg Kroah-Hartman , linux-serial@vger.kernel.org, Petr Mladek , Sergey Senozhatsky , LKML References: <9af98779-6964-e971-41ba-667c9cd34e60@molgen.mpg.de> <20221008164326.00b70ee4@rorschach.local.home> From: Paul Menzel In-Reply-To: <20221008164326.00b70ee4@rorschach.local.home> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-serial@vger.kernel.org Dear Steven, Thank you very much for the quick reply. Am 08.10.22 um 22:43 schrieb Steven Rostedt: > On Fri, 7 Oct 2022 15:30:56 +0200 Paul Menzel wrote: >> I am trying to do boot-time tracing of `univ8250_console_init()`: >> >> [ 0.126636] ftrace: allocating 41793 entries in 164 pages >> [ 0.132446] ftrace: allocated 164 pages with 3 groups >> […] >> [ 0.167334] calling con_init+0x0/0x239 @ 0 >> [ 0.170217] Console: colour VGA+ 80x25 >> [ 0.190381] printk: console [tty0] enabled >> [ 0.190484] initcall con_init+0x0/0x239 returned 0 after 0 usecs >> [ 0.190487] calling hvc_console_init+0x0/0x18 @ 0 >> [ 0.190489] initcall hvc_console_init+0x0/0x18 returned 0 after 0 usecs >> [ 0.190491] calling univ8250_console_init+0x0/0x2b @ 0 >> [ 1.488645] printk: console [ttyS0] enabled >> [ 1.492945] initcall univ8250_console_init+0x0/0x2b returned 0 after 0 usecs >> […] >> [ 1.670397] calling trace_init_perf_perm_irq_work_exit+0x0/0x17 @ 1 >> [ 1.670399] initcall trace_init_perf_perm_irq_work_exit+0x0/0x17 returned 0 after 0 usecs >> […] >> [ 1.673339] calling trace_init_flags_sys_enter+0x0/0x13 @ 1 >> [ 1.673342] initcall trace_init_flags_sys_enter+0x0/0x13 returned 0 after 0 usecs >> [ 1.673344] calling trace_init_flags_sys_exit+0x0/0x13 @ 1 >> [ 1.673346] initcall trace_init_flags_sys_exit+0x0/0x13 returned 0 after 0 usecs >> [ 1.673348] calling cpu_stop_init+0x0/0x87 @ 1 >> [ 1.673364] initcall cpu_stop_init+0x0/0x87 returned 0 after 0 usecs >> [ 1.673366] calling init_kprobes+0x0/0x149 @ 1 >> [ 1.673495] initcall init_kprobes+0x0/0x149 returned 0 after 0 usecs >> [ 1.673497] calling init_events+0x0/0x4d @ 1 >> [ 1.673502] initcall init_events+0x0/0x4d returned 0 after 0 usecs >> [ 1.673504] calling init_trace_printk+0x0/0xc @ 1 >> [ 1.673505] initcall init_trace_printk+0x0/0xc returned 0 after 0 usecs >> [ 1.673507] calling event_trace_enable_again+0x0/0x23 @ 1 >> [ 1.673508] initcall event_trace_enable_again+0x0/0x23 returned 0 after 0 usecs >> >> The function `univ8250_console_init()` is not available in >> `/sys/kernel/debug/tracing/available_filter_functions`, so I’d like to >> trace `univ8250_console_setup()`: >> >> initcall_debug log_buf_len=32M trace_buf_size=262144K trace_clock=global trace_options=nooverwrite,funcgraph-abstime,funcgraph-cpu,funcgraph-duration,funcgraph-proc,funcgraph-tail,nofuncgraph-overhead,context-info,graph-time ftrace=function_graph ftrace_graph_max_depth=2 ftrace_graph_filter=univ8250_console_setup tp_printk >> >> Unfortunately, `/sys/kernel/debug/tracing/trace` is empty, so I guess >> the console happens before ftrace is available? > > "function" tracing is enabled by then (I just tested it), but > "function_graph" is not. Function graph requires trace events enabled, > but I could see what happens if I do enabled it ;-) > >> >> Is there another way to trace the serial console init, without having to >> add print statements? > > Use "ftrace=function" but then you will get everything. You could add a > "set_filter=:traceoff" to set a trigger that would disable > tracing, if you can find a function that would be good to stop tracing > with. Thank you. That worked. As I didn’t use a trigger to stop tracing, the resulting trace was over 1 GB in size, but I found what I was looking for. > Otherwise, I could take a look to see what it takes to get function > graph tracing working that early. Having earlier tracing is always an improvement, but right now it’s not necessary at least for me anymore. Thank you again. Kind regards, Paul PS: With the trace, I started the thread *Do not delay boot when printing log to serial console during startup?* [1]. [1]: https://lore.kernel.org/linux-serial/c87cc376-3b0d-8fda-7fc1-555c930faaf1@molgen.mpg.de/