All of lore.kernel.org
 help / color / mirror / Atom feed
From: Dave Jones <davej@redhat.com>
To: Linus Torvalds <torvalds@linux-foundation.org>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	Linux Kernel <linux-kernel@vger.kernel.org>,
	Tejun Heo <tj@kernel.org>
Subject: Re: excessive kworker activity when idle. (was Re: vma corruption in today's -git)
Date: Wed, 30 Mar 2011 23:55:12 -0400	[thread overview]
Message-ID: <20110331035511.GA1255@redhat.com> (raw)
In-Reply-To: <AANLkTikYAAYcYxTdKAxQjDxVQ7qrZGEfXg+gpfwcj1=-@mail.gmail.com>

On Wed, Mar 30, 2011 at 08:37:21PM -0700, Linus Torvalds wrote:
 > You don't see some nice thread description
 > in 'top' any more (like you used to when everybody created their own
 > threads and didn't do the common worker thread thing), and the best
 > approach literally seems to be something like
 > 
 >    perf record -ag sleep 10
 >    perf report
 > 
 > which does tend to show what's going on, but it's still a ridiculous
 > way to this.

I tried that, and wasn't particularly enlightened.

+      6.53%  kworker/1:2  [kernel.kallsyms]  [k] read_hpet            
+      4.83%  kworker/0:0  [kernel.kallsyms]  [k] read_hpet           
+      4.28%  kworker/0:0  [kernel.kallsyms]  [k] arch_local_irq_restore 
+      4.03%  kworker/1:2  [kernel.kallsyms]  [k] arch_local_irq_restore  
+      3.10%  kworker/0:0  [kernel.kallsyms]  [k] do_raw_spin_trylock      
+      2.88%  kworker/1:2  [kernel.kallsyms]  [k] do_raw_spin_trylock       
+      2.85%  kworker/1:2  [kernel.kallsyms]  [k] debug_locks_off  
+      2.69%  kworker/0:0  [kernel.kallsyms]  [k] debug_locks_off   
+      2.48%  kworker/0:0  [kernel.kallsyms]  [k] lock_release       
+      2.26%  kworker/1:2  [kernel.kallsyms]  [k] lock_release        
+      2.03%  kworker/0:0  [kernel.kallsyms]  [k] lock_acquire         
+      1.88%  kworker/0:0  [kernel.kallsyms]  [k] arch_local_save_flags 
+      1.87%  kworker/1:2  [kernel.kallsyms]  [k] lock_acquire           
+      1.82%  kworker/1:2  [kernel.kallsyms]  [k] arch_local_save_flags 
+      1.81%  kworker/1:2  [kernel.kallsyms]  [k] arch_local_irq_save    
+      1.78%  kworker/0:0  [kernel.kallsyms]  [k] arch_local_irq_save     
+      1.56%  kworker/0:0  [kernel.kallsyms]  [k] lock_acquired            
+      1.53%  kworker/1:2  [kernel.kallsyms]  [k] __lock_acquire            
+      1.51%  kworker/0:0  [kernel.kallsyms]  [k] __lock_acquire             
+      1.29%  kworker/0:0  [kernel.kallsyms]  [k] native_write_msr_safe       
+      1.23%  kworker/1:2  [kernel.kallsyms]  [k] cpu_relax                    
+      1.17%  kworker/1:2  [kernel.kallsyms]  [k] lock_acquired                 
+      1.17%  kworker/0:0  [kernel.kallsyms]  [k] trace_hardirqs_off_caller      
+      1.11%  kworker/1:2  [kernel.kallsyms]  [k] trace_hardirqs_off_caller       
+      1.08%  kworker/1:2  [kernel.kallsyms]  [k] native_write_msr_safe   
+      1.02%  kworker/0:0  [kernel.kallsyms]  [k] _raw_spin_lock_irqsave   
+      0.92%  kworker/0:0  [kernel.kallsyms]  [k] process_one_work          
+      0.87%  kworker/1:2  [kernel.kallsyms]  [k] _raw_spin_lock_irqsave     
+      0.80%  kworker/0:0  [kernel.kallsyms]  [k] flush_to_ldisc       
+      0.76%  kworker/1:2  [kernel.kallsyms]  [k] process_one_work      
+      0.76%  kworker/1:2  [kernel.kallsyms]  [k] flush_to_ldisc         
+      0.72%  kworker/0:0  [kernel.kallsyms]  [k] arch_local_irq_restore  
+      0.71%  kworker/1:2  [kernel.kallsyms]  [k] arch_local_irq_restore   
+      0.64%  kworker/1:2  [kernel.kallsyms]  [k] do_raw_spin_unlock        
+      0.63%  kworker/0:0  [kernel.kallsyms]  [k] perf_event_task_tick       
+      0.61%  kworker/1:2  [kernel.kallsyms]  [k] ktime_get                   
+      0.59%  kworker/0:0  [kernel.kallsyms]  [k] _raw_spin_unlock_irqrestore  

this is what led me to try the other perf methods. the kmem traces were
the only things that really jumped out.

 > (Powertop can also do it, and is probably a better thing to use, I'm
 > just used to "perf record" for other reasons, so..)

Tried that too, here's what it said..

Summary: 0.0 wakeups/second,  0.0 GPU ops/second and 0.0 VFS ops/sec

                Usage       Events/s    Category       Description
            -2147483648 ms/s   0.0        Timer
            -2147483648 ms/s   0.0        kWork
            35151589 ms/s    0.0        Timer
            35151588 ms/s    0.0        Timer
            35151587 ms/s    0.0        Timer
            35151586 ms/s    0.0        Timer
            35151585 ms/s    0.0        Timer
            35151585 ms/s    0.0        Timer
            35151584 ms/s    0.0        Timer
            35151583 ms/s    0.0        Timer
            35151582 ms/s    0.0        Timer
            35151581 ms/s    0.0        Timer
            35151581 ms/s    0.0        Timer
            35151580 ms/s    0.0        Timer

Not exactly helpful.

	Dave


  reply	other threads:[~2011-03-31  3:56 UTC|newest]

Thread overview: 27+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-03-29  4:09 vma corruption in today's -git Dave Jones
2011-03-29  4:19 ` Américo Wang
2011-03-29  4:26   ` Dave Jones
2011-03-29  4:22 ` Linus Torvalds
2011-03-31  3:09   ` excessive kworker activity when idle. (was Re: vma corruption in today's -git) Dave Jones
2011-03-31  3:34     ` Dave Jones
2011-03-31  3:44       ` Linus Torvalds
2011-03-31  4:08         ` Dave Jones
2011-03-31 15:53           ` Linus Torvalds
2011-03-31 16:21             ` Linus Torvalds
2011-03-31 21:38               ` Linus Torvalds
2011-03-31 14:59         ` Paul E. McKenney
2011-03-31  3:37     ` Linus Torvalds
2011-03-31  3:55       ` Dave Jones [this message]
2011-03-31  5:32         ` Linus Torvalds
2011-03-31 14:21           ` Arnaldo Carvalho de Melo
2011-03-31 14:58           ` Dave Jones
2011-03-31 15:03             ` Dave Jones
2011-03-31 15:09               ` Dave Jones
2011-03-31 15:45                 ` Linus Torvalds
2011-03-31 15:25               ` Linus Torvalds
2011-03-31 15:49                 ` Dave Jones
2011-03-31 15:58                   ` Linus Torvalds
2011-03-31 16:13                     ` Dave Jones
2011-03-31  6:56       ` Tejun Heo
2011-03-31 10:37         ` [PATCH] workqueue: document debugging tricks Florian Mickler
2011-03-31 11:41           ` Tejun Heo

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20110331035511.GA1255@redhat.com \
    --to=davej@redhat.com \
    --cc=akpm@linux-foundation.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=tj@kernel.org \
    --cc=torvalds@linux-foundation.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.