All of lore.kernel.org
 help / color / mirror / Atom feed
From: Ingo Molnar <mingo-X9Un+BFzKDI@public.gmane.org>
To: Kevin Shanahan <kmshanah-biM/RbsGxha6c6uEtOJ/EA@public.gmane.org>
Cc: "Rafael J. Wysocki" <rjw-KKrjLPT3xs0@public.gmane.org>,
	Linux Kernel Mailing List
	<linux-kernel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>,
	Kernel Testers List
	<kernel-testers-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>,
	Mike Galbraith <efault-Mmb7MZpHnFY@public.gmane.org>,
	bugme-daemon-590EEB7GvNiWaY/ihj7yzEB+6BGkLq7r@public.gmane.org,
	Steven Rostedt <rostedt-nx8X9YLhiw1AfugRpC6u6w@public.gmane.org>,
	Peter Zijlstra
	<a.p.zijlstra-/NLkJaSkS4VmR6Xm/wNWPw@public.gmane.org>
Subject: Re: [Bug #12465] KVM guests stalling on 2.6.28 (bisected) [bug 12465]
Date: Sun, 22 Feb 2009 18:27:58 +0100	[thread overview]
Message-ID: <20090222172758.GH6570@elte.hu> (raw)
In-Reply-To: <1235299155.5021.6.camel-9TBizaOOD0ujuAshGpSIhRCuuivNXqWP@public.gmane.org>


* Kevin Shanahan <kmshanah-biM/RbsGxha6c6uEtOJ/EA@public.gmane.org> wrote:

> On Sun, 2009-02-15 at 11:04 +0100, Ingo Molnar wrote:
> > qemu-sy-4237 has been scheduled away, and the system appeared to have done
> > nothing in the meantime. That's not something that really looks like a
> > scheduler regression - there is nothing the scheduler can do if KVM
> > decides to block a task.
> > 
> > It would be nice to enhance this single-CPU trace some more - to more
> > surgically see what is going on. Firstly, absolute timestamps would be
> > nice:
> > 
> >   echo funcgraph-abstime  > trace_options
> >   echo funcgraph-proc     > trace_options
> > 
> > as it's a bit hard to see the global timescale of events.
> 
> I was going to try and grab the trace with absolute timestamps 
> tonight, but that option doesn't seem to be available in 
> Linus' current kernel.
> 
> flexo:/sys/kernel/debug/tracing# echo 0 > tracing_enabled
> flexo:/sys/kernel/debug/tracing# echo function_graph > current_tracer
> flexo:/sys/kernel/debug/tracing# echo funcgraph-proc > trace_options
> flexo:/sys/kernel/debug/tracing# echo funcgraph-abstime  > trace_options
> -su: echo: write error: Invalid argument
> flexo:/sys/kernel/debug/tracing# cat trace_options 
> print-parent nosym-offset nosym-addr noverbose noraw nohex nobin noblock
> nostacktrace nosched-tree ftrace_printk noftrace_preempt nobranch
> annotate nouserstacktrace nosym-userobj noprintk-msg-only
> nofuncgraph-overrun funcgraph-cpu funcgraph-overhead funcgraph-proc 
> flexo:/sys/kernel/debug/tracing# uname -a
> Linux flexo 2.6.29-rc5-00299-gadfafef #6 SMP Sun Feb 22 20:09:37 CST
> 2009 x86_64 GNU/Linux
> 
> What am I missing?

(replying here too - replied in the bugzilla already)

that's a feature of the latest tracing tree, so if you try -tip 
you'll have it.

	Ingo

WARNING: multiple messages have this Message-ID (diff)
From: Ingo Molnar <mingo@elte.hu>
To: Kevin Shanahan <kmshanah@ucwb.org.au>
Cc: "Rafael J. Wysocki" <rjw@sisk.pl>,
	Linux Kernel Mailing List <linux-kernel@vger.kernel.org>,
	Kernel Testers List <kernel-testers@vger.kernel.org>,
	Mike Galbraith <efault@gmx.de>,
	bugme-daemon@bugzilla.kernel.org,
	Steven Rostedt <rostedt@goodmis.org>,
	Peter Zijlstra <a.p.zijlstra@chello.nl>
Subject: Re: [Bug #12465] KVM guests stalling on 2.6.28 (bisected) [bug 12465]
Date: Sun, 22 Feb 2009 18:27:58 +0100	[thread overview]
Message-ID: <20090222172758.GH6570@elte.hu> (raw)
In-Reply-To: <1235299155.5021.6.camel@kulgan.wumi.org.au>


* Kevin Shanahan <kmshanah@ucwb.org.au> wrote:

> On Sun, 2009-02-15 at 11:04 +0100, Ingo Molnar wrote:
> > qemu-sy-4237 has been scheduled away, and the system appeared to have done
> > nothing in the meantime. That's not something that really looks like a
> > scheduler regression - there is nothing the scheduler can do if KVM
> > decides to block a task.
> > 
> > It would be nice to enhance this single-CPU trace some more - to more
> > surgically see what is going on. Firstly, absolute timestamps would be
> > nice:
> > 
> >   echo funcgraph-abstime  > trace_options
> >   echo funcgraph-proc     > trace_options
> > 
> > as it's a bit hard to see the global timescale of events.
> 
> I was going to try and grab the trace with absolute timestamps 
> tonight, but that option doesn't seem to be available in 
> Linus' current kernel.
> 
> flexo:/sys/kernel/debug/tracing# echo 0 > tracing_enabled
> flexo:/sys/kernel/debug/tracing# echo function_graph > current_tracer
> flexo:/sys/kernel/debug/tracing# echo funcgraph-proc > trace_options
> flexo:/sys/kernel/debug/tracing# echo funcgraph-abstime  > trace_options
> -su: echo: write error: Invalid argument
> flexo:/sys/kernel/debug/tracing# cat trace_options 
> print-parent nosym-offset nosym-addr noverbose noraw nohex nobin noblock
> nostacktrace nosched-tree ftrace_printk noftrace_preempt nobranch
> annotate nouserstacktrace nosym-userobj noprintk-msg-only
> nofuncgraph-overrun funcgraph-cpu funcgraph-overhead funcgraph-proc 
> flexo:/sys/kernel/debug/tracing# uname -a
> Linux flexo 2.6.29-rc5-00299-gadfafef #6 SMP Sun Feb 22 20:09:37 CST
> 2009 x86_64 GNU/Linux
> 
> What am I missing?

(replying here too - replied in the bugzilla already)

that's a feature of the latest tracing tree, so if you try -tip 
you'll have it.

	Ingo

  parent reply	other threads:[~2009-02-22 17:27 UTC|newest]

Thread overview: 130+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2009-02-14 20:48 2.6.29-rc5: Reported regressions 2.6.27 -> 2.6.28 Rafael J. Wysocki
2009-02-14 20:48 ` Rafael J. Wysocki
2009-02-14 20:48 ` [Bug #12061] snd_hda_intel: power_save: sound cracks on powerdown Rafael J. Wysocki
2009-02-14 20:48   ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12209] oldish top core dumps (in its meminfo() function) Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12160] networking oops after resume from s2ram (2.6.28-rc6) Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12208] uml is very slow on 2.6.28 host Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-22 13:58   ` Américo Wang
2009-02-22 13:58     ` Américo Wang
     [not found]     ` <20090222135818.GA12782-2ZPHldtDychwKoX9GjgWag@public.gmane.org>
2009-02-23 14:27       ` Miklos Szeredi
2009-02-23 14:27         ` Miklos Szeredi
2009-02-14 20:50 ` [Bug #12265] FPU emulation broken in 2.6.28-rc8 ? Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-14 23:23   ` Ingo Molnar
2009-02-14 23:23     ` Ingo Molnar
2009-02-14 20:50 ` [Bug #12337] ~100 extra wakeups reported by powertop Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-14 23:35   ` Alberto Gonzalez
2009-02-14 23:35     ` Alberto Gonzalez
     [not found]     ` <535841.27007.qm-XPPYsw2aJMuB9c0Qi4KiSl5cfvJIxWXgQQ4Iyu8u01E@public.gmane.org>
2009-02-15 14:20       ` Rafael J. Wysocki
2009-02-15 14:20         ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12224] journal activity on inactive partition causes inactive harddrive spinup Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-23 12:22   ` Theodore Tso
2009-02-23 12:22     ` Theodore Tso
     [not found]     ` <20090223122248.GD19739-3s7WtUTddSA@public.gmane.org>
2009-02-23 14:36       ` Rafael J. Wysocki
2009-02-23 14:36         ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12263] Sata soft reset filling log Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-15 20:47   ` Justin Madru
2009-02-15 21:21     ` Rafael J. Wysocki
2009-02-15 22:30       ` Ingo Molnar
2009-02-15 23:12         ` Rafael J. Wysocki
2009-02-16 15:18           ` Sergei Shtylyov
2009-02-16 15:21             ` Ingo Molnar
     [not found]             ` <499983DF.5050503-hkdhdckH98+B+jHODAdFcQ@public.gmane.org>
2009-02-16 15:21               ` Sergei Shtylyov
2009-02-16 15:21                 ` Sergei Shtylyov
     [not found]                 ` <49998480.3090408-hkdhdckH98+B+jHODAdFcQ@public.gmane.org>
2009-02-16 15:31                   ` Sergei Shtylyov
2009-02-16 15:31                     ` Sergei Shtylyov
2009-02-16 19:23                     ` Justin Madru
     [not found]                       ` <4999BD1A.1060101-u1xxEuL7cY4AvxtiuMwx3w@public.gmane.org>
2009-02-16 19:42                         ` Sergei Shtylyov
2009-02-16 19:42                           ` Sergei Shtylyov
     [not found]                           ` <4999C195.5050905-hkdhdckH98+B+jHODAdFcQ@public.gmane.org>
2009-02-16 21:40                             ` Justin Madru
2009-02-16 21:40                               ` Justin Madru
     [not found]                               ` <4999DD31.4010504-u1xxEuL7cY4AvxtiuMwx3w@public.gmane.org>
2009-02-17 11:19                                 ` Hugh Dickins
2009-02-17 11:19                                   ` Hugh Dickins
2009-02-17 19:08                                   ` Justin Madru
     [not found]                                     ` <499B0B3E.3070101-u1xxEuL7cY4AvxtiuMwx3w@public.gmane.org>
2009-02-18  1:03                                       ` Sergei Shtylyov
2009-02-18  1:03                                         ` Sergei Shtylyov
2009-02-18  6:42                                         ` Justin Madru
2009-02-14 20:50 ` [Bug #12393] debugging in dosemu causes lots of 'scheduling while atomic' Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12395] 2.6.28-rc9: oprofile regression Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12401] 2.6.28 regression: xbacklight broken on ThinkPad X61s Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-15 13:44   ` Matthew Garrett
2009-02-15 13:44     ` Matthew Garrett
     [not found]     ` <20090215134409.GC21670-1xO5oi07KQx4cg9Nei1l7Q@public.gmane.org>
2009-02-15 14:38       ` Rafael J. Wysocki
2009-02-15 14:38         ` Rafael J. Wysocki
     [not found]         ` <200902151538.29766.rjw-KKrjLPT3xs0@public.gmane.org>
2009-02-15 22:16           ` Tino Keitel
2009-02-15 22:16             ` Tino Keitel
     [not found]             ` <20090215221647.GA15392-z7fNteJZwjmqk56C3691EA@public.gmane.org>
2009-02-16  1:16               ` Matthew Garrett
2009-02-16  1:16                 ` Matthew Garrett
     [not found]                 ` <20090216011600.GA28929-1xO5oi07KQx4cg9Nei1l7Q@public.gmane.org>
2009-02-16 12:37                   ` Ingo Molnar
2009-02-16 12:37                     ` Ingo Molnar
     [not found]                     ` <20090216123740.GB7047-X9Un+BFzKDI@public.gmane.org>
2009-02-16 12:42                       ` Matthew Garrett
2009-02-16 12:42                         ` Matthew Garrett
2009-02-14 20:50 ` [Bug #12403] TTY problem on linux-2.6.28-rc7 Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-16 16:12   ` Aristeu Rozanski
2009-02-16 16:12     ` Aristeu Rozanski
2009-02-16 20:42     ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12406] 2.6.28 thinks that my PS/2 mouse is a touchpad Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-15  6:14   ` Alexander E. Patrakov
2009-02-15  6:14     ` Alexander E. Patrakov
     [not found]     ` <20090215111446.789c1f8a-OVPaBHQY1ulUCDrD4VgvSg@public.gmane.org>
2009-02-15 14:40       ` Rafael J. Wysocki
2009-02-15 14:40         ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12405] oops in __bounce_end_io_read under kvm Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12404] Oops in 2.6.28-rc9 and -rc8 -- mtrr issues / e1000e Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12411] 2.6.28: BUG in r8169 Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12407] Kernel 2.6.28 regression: Hang after hibernate Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12408] Funny problem with 2.6.28: Kernel stalls Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12409] NULL pointer dereference at get_stats() Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12500] r8169: NETDEV WATCHDOG: eth0 (r8169): transmit timed out Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12421] GPF on 2.6.28 and 2.6.28-rc9-git3, e1000e and e1000 issues Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12465] KVM guests stalling on 2.6.28 (bisected) Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-15  9:48   ` [Bug #12465] KVM guests stalling on 2.6.28 (bisected) [Bug 12465] Kevin Shanahan
2009-02-15  9:48     ` Kevin Shanahan
2009-02-15 10:04     ` Ingo Molnar
     [not found]       ` <20090215100454.GA30314-X9Un+BFzKDI@public.gmane.org>
2009-02-22 10:39         ` [Bug #12465] KVM guests stalling on 2.6.28 (bisected) [bug 12465] Kevin Shanahan
2009-02-22 10:39           ` Kevin Shanahan
     [not found]           ` <1235299155.5021.6.camel-9TBizaOOD0ujuAshGpSIhRCuuivNXqWP@public.gmane.org>
2009-02-22 17:27             ` Ingo Molnar [this message]
2009-02-22 17:27               ` Ingo Molnar
2009-02-23 11:38         ` [Bug #12465] KVM guests stalling on 2.6.28 (bisected) [Bug 12465] Kevin Shanahan
2009-02-23 11:38           ` Kevin Shanahan
2009-02-14 20:50 ` [Bug #12559] Huawei E169 doesn't work as mass storage anymore Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12612] hard lockup when interrupting cdda2wav Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-17 17:16   ` Matthias Reichl
2009-02-17 17:16     ` Matthias Reichl
     [not found]     ` <20090217171601.GA3351-vtPv7MOkFPkAvxtiuMwx3w@public.gmane.org>
2009-02-17 20:23       ` Rafael J. Wysocki
2009-02-17 20:23         ` Rafael J. Wysocki
     [not found]         ` <200902172123.13052.rjw-KKrjLPT3xs0@public.gmane.org>
2009-02-19 13:49           ` FUJITA Tomonori
2009-02-19 13:49             ` FUJITA Tomonori
2009-02-14 20:50 ` [Bug #12614] WOL with forcedeth broken since f55c21fd9a92a444e55ad1ca4e4732d56661bf2e Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12619] Regression 2.6.28 and last - boot failed Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12634] video distortion and lockup with i830 video chip and 2.6.28.3 Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12645] DMI low-memory-protect quirk causes resume hang on Samsung NC10 Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12690] DPMS (LCD powersave, poweroff) don't work Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki
2009-02-14 20:50 ` [Bug #12658] ThrustMaster Firestorm Dual Power 3 Gamepads stopped working Rafael J. Wysocki
2009-02-14 20:50   ` Rafael J. Wysocki

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20090222172758.GH6570@elte.hu \
    --to=mingo-x9un+bfzkdi@public.gmane.org \
    --cc=a.p.zijlstra-/NLkJaSkS4VmR6Xm/wNWPw@public.gmane.org \
    --cc=bugme-daemon-590EEB7GvNiWaY/ihj7yzEB+6BGkLq7r@public.gmane.org \
    --cc=efault-Mmb7MZpHnFY@public.gmane.org \
    --cc=kernel-testers-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=kmshanah-biM/RbsGxha6c6uEtOJ/EA@public.gmane.org \
    --cc=linux-kernel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=rjw-KKrjLPT3xs0@public.gmane.org \
    --cc=rostedt-nx8X9YLhiw1AfugRpC6u6w@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.