All of lore.kernel.org
 help / color / mirror / Atom feed
From: Larry Finger <Larry.Finger@lwfinger.net>
To: LKML <linux-kernel@vger.kernel.org>
Subject: Possible IRQ lock inversion from 2.6.29-Linus-03321-gbe0ea69 (2.6.29-git)
Date: Fri, 27 Mar 2009 00:07:33 -0500	[thread overview]
Message-ID: <49CC5F15.4020404@lwfinger.net> (raw)

On my x86_64 dual core system, I get the following messages logged.


=========================================================
[ INFO: possible irq lock inversion dependency detected ]
2.6.29-Linus-03321-gbe0ea69 #55
---------------------------------------------------------
swapper/0 just changed the state of lock:
 (fasync_lock){..+.}, at: [<ffffffff802c7073>] kill_fasync+0x2c/0x4e
but this lock took another, hard-irq-unsafe lock in the past:
 (&f->f_lock){--..}

and interrupts could create inverse lock ordering between them.


other info that might help us debug this:
4 locks held by swapper/0:
 #0:  (&serio->lock){+...}, at: [<ffffffff803c47a4>] serio_interrupt+0x2b/0x83
 #1:  (&dev->event_lock){+...}, at: [<ffffffff803c8bd3>] input_event+0x40/0x7d
 #2:  (rcu_read_lock){..--}, at: [<ffffffff803c7541>] input_pass_event+0x0/0xcc
 #3:  (rcu_read_lock){..--}, at: [<ffffffff803cbad3>] evdev_event+0x0/0xfd

the first lock's dependencies:
-> (fasync_lock){..+.} ops: 0 {
   initial-use  at:
                        [<ffffffff80262870>] __lock_acquire+0x79e/0x1697
                        [<ffffffff802637be>] lock_acquire+0x55/0x71
                        [<ffffffff804642bf>] _write_lock_irq+0x37/0x43
                        [<ffffffff802c6bf5>] fasync_helper+0x57/0x110
                        [<ffffffff802ea28c>] locks_delete_lock+0x50/0x9f
                        [<ffffffff802ea819>] __posix_lock_file+0x326/0x549
                        [<ffffffff802eaa8c>] vfs_lock_file+0x38/0x3a
                        [<ffffffff802eab1f>] locks_remove_posix+0x91/0xb2
                        [<ffffffff802b9634>] filp_close+0x56/0x68
                        [<ffffffff802b96f0>] sys_close+0xaa/0xe9
                        [<ffffffff8020c2cb>] system_call_fastpath+0x16/0x1b
                        [<ffffffffffffffff>] 0xffffffffffffffff
   in-hardirq-R at:
                        [<ffffffffffffffff>] 0xffffffffffffffff
 }
 ... key      at: [<ffffffff805f7db8>] fasync_lock+0x18/0x30
 -> (&f->f_lock){--..} ops: 0 {
    initial-use  at:
                          [<ffffffff80262870>] __lock_acquire+0x79e/0x1697
                          [<ffffffff802637be>] lock_acquire+0x55/0x71
                          [<ffffffff80464126>] _spin_lock+0x31/0x3d
                          [<ffffffff802c6c74>] fasync_helper+0xd6/0x110
                          [<ffffffff802ea28c>] locks_delete_lock+0x50/0x9f
                          [<ffffffff802ea819>] __posix_lock_file+0x326/0x549
                          [<ffffffff802eaa8c>] vfs_lock_file+0x38/0x3a
                          [<ffffffff802eab1f>] locks_remove_posix+0x91/0xb2
                          [<ffffffff802b9634>] filp_close+0x56/0x68
                          [<ffffffff802b96f0>] sys_close+0xaa/0xe9
                          [<ffffffff8020c2cb>] system_call_fastpath+0x16/0x1b
                          [<ffffffffffffffff>] 0xffffffffffffffff
    softirq-on-W at:
                          [<ffffffff80262857>] __lock_acquire+0x785/0x1697
                          [<ffffffff802637be>] lock_acquire+0x55/0x71
                          [<ffffffff80464126>] _spin_lock+0x31/0x3d
                          [<ffffffff802c7505>] sys_fcntl+0x2aa/0x36c
                          [<ffffffff8020c2cb>] system_call_fastpath+0x16/0x1b
                          [<ffffffffffffffff>] 0xffffffffffffffff
    hardirq-on-W at:
                          [<ffffffff8026282e>] __lock_acquire+0x75c/0x1697
                          [<ffffffff802637be>] lock_acquire+0x55/0x71
                          [<ffffffff80464126>] _spin_lock+0x31/0x3d
                          [<ffffffff802c7505>] sys_fcntl+0x2aa/0x36c
                          [<ffffffff8020c2cb>] system_call_fastpath+0x16/0x1b
                          [<ffffffffffffffff>] 0xffffffffffffffff
  }
  ... key      at: [<ffffffff81096e08>] __key.20386+0x0/0x8
 ... acquired at:
   [<ffffffff80263404>] __lock_acquire+0x1332/0x1697
   [<ffffffff802637be>] lock_acquire+0x55/0x71
   [<ffffffff80464126>] _spin_lock+0x31/0x3d
   [<ffffffff802c6c74>] fasync_helper+0xd6/0x110
   [<ffffffff802ea28c>] locks_delete_lock+0x50/0x9f
   [<ffffffff802ea819>] __posix_lock_file+0x326/0x549
   [<ffffffff802eaa8c>] vfs_lock_file+0x38/0x3a
   [<ffffffff802eab1f>] locks_remove_posix+0x91/0xb2
   [<ffffffff802b9634>] filp_close+0x56/0x68
   [<ffffffff802b96f0>] sys_close+0xaa/0xe9
   [<ffffffff8020c2cb>] system_call_fastpath+0x16/0x1b
   [<ffffffffffffffff>] 0xffffffffffffffff


the second lock's dependencies:
-> (&f->f_lock){--..} ops: 0 {
   initial-use  at:
                        [<ffffffff80262870>] __lock_acquire+0x79e/0x1697
                        [<ffffffff802637be>] lock_acquire+0x55/0x71
                        [<ffffffff80464126>] _spin_lock+0x31/0x3d
                        [<ffffffff802c6c74>] fasync_helper+0xd6/0x110
                        [<ffffffff802ea28c>] locks_delete_lock+0x50/0x9f
                        [<ffffffff802ea819>] __posix_lock_file+0x326/0x549
                        [<ffffffff802eaa8c>] vfs_lock_file+0x38/0x3a
                        [<ffffffff802eab1f>] locks_remove_posix+0x91/0xb2
                        [<ffffffff802b9634>] filp_close+0x56/0x68
                        [<ffffffff802b96f0>] sys_close+0xaa/0xe9
                        [<ffffffff8020c2cb>] system_call_fastpath+0x16/0x1b
                        [<ffffffffffffffff>] 0xffffffffffffffff
   softirq-on-W at:
                        [<ffffffff80262857>] __lock_acquire+0x785/0x1697
                        [<ffffffff802637be>] lock_acquire+0x55/0x71
                        [<ffffffff80464126>] _spin_lock+0x31/0x3d
                        [<ffffffff802c7505>] sys_fcntl+0x2aa/0x36c
                        [<ffffffff8020c2cb>] system_call_fastpath+0x16/0x1b
                        [<ffffffffffffffff>] 0xffffffffffffffff
   hardirq-on-W at:
                        [<ffffffff8026282e>] __lock_acquire+0x75c/0x1697
                        [<ffffffff802637be>] lock_acquire+0x55/0x71
                        [<ffffffff80464126>] _spin_lock+0x31/0x3d
                        [<ffffffff802c7505>] sys_fcntl+0x2aa/0x36c
                        [<ffffffff8020c2cb>] system_call_fastpath+0x16/0x1b
                        [<ffffffffffffffff>] 0xffffffffffffffff
 }
 ... key      at: [<ffffffff81096e08>] __key.20386+0x0/0x8

stack backtrace:
Pid: 0, comm: swapper Not tainted 2.6.29-Linus-03321-gbe0ea69 #55
Call Trace:
 <IRQ>  [<ffffffff80260a11>] print_irq_inversion_bug+0x175/0x184
 [<ffffffff80260ab8>] check_usage_forwards+0x98/0xa1
 [<ffffffff8026113b>] mark_lock+0x5dd/0xa2b
 [<ffffffff80262748>] __lock_acquire+0x676/0x1697
 [<ffffffff80262870>] ? __lock_acquire+0x79e/0x1697
 [<ffffffff802637be>] lock_acquire+0x55/0x71
 [<ffffffff802c7073>] ? kill_fasync+0x2c/0x4e
 [<ffffffff8046442b>] _read_lock+0x34/0x41
 [<ffffffff802c7073>] ? kill_fasync+0x2c/0x4e
 [<ffffffff802c7073>] kill_fasync+0x2c/0x4e
 [<ffffffff803cb7bd>] evdev_pass_event+0x6e/0x77
 [<ffffffff803cbb47>] evdev_event+0x74/0xfd
 [<ffffffff803cbad3>] ? evdev_event+0x0/0xfd
 [<ffffffff803c75a5>] input_pass_event+0x64/0xcc
 [<ffffffff803c7541>] ? input_pass_event+0x0/0xcc
 [<ffffffff803c7cdf>] input_handle_event+0x339/0x345
 [<ffffffff803c8bf6>] input_event+0x63/0x7d
 [<ffffffff803d1275>] alps_process_packet+0x3b7/0x4cc
 [<ffffffff803d13e5>] alps_process_byte+0x5b/0x6e
 [<ffffffff803ce797>] psmouse_handle_byte+0x17/0x10d
 [<ffffffff803cf766>] psmouse_interrupt+0x277/0x285
 [<ffffffff803c47a4>] ? serio_interrupt+0x2b/0x83
 [<ffffffff803c47c0>] serio_interrupt+0x47/0x83
 [<ffffffff803c58b7>] i8042_interrupt+0x200/0x215
 [<ffffffff8027b277>] handle_IRQ_event+0x6b/0xa1
 [<ffffffff8027c55c>] handle_edge_irq+0xeb/0x131
 [<ffffffff80464a25>] __irqentry_text_start+0x6d/0xd8
 [<ffffffff8020cd13>] ret_from_intr+0x0/0xf
 <EOI>  [<ffffffff8025d068>] ? tick_broadcast_oneshot_control+0x1f/0x102
 [<ffffffff802130e6>] ? default_idle+0x35/0x4f
 [<ffffffff802130e4>] ? default_idle+0x33/0x4f
 [<ffffffff802131ed>] ? c1e_idle+0xda/0x101
 [<ffffffff8025713e>] ? atomic_notifier_call_chain+0xf/0x11
 [<ffffffff8020b1f6>] ? cpu_idle+0x5c/0x9d
 [<ffffffff80451797>] ? rest_init+0x6b/0x6d

             reply	other threads:[~2009-03-27  5:08 UTC|newest]

Thread overview: 6+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2009-03-27  5:07 Larry Finger [this message]
2009-03-27 12:54 ` Possible IRQ lock inversion from 2.6.29-Linus-03321-gbe0ea69 (2.6.29-git) Bartlomiej Zolnierkiewicz
2009-03-27 18:06   ` Jonathan Corbet
2009-03-27 19:05     ` Larry Finger
2009-03-28  0:32     ` Peter Zijlstra
2009-03-28 13:36     ` Bartlomiej Zolnierkiewicz

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=49CC5F15.4020404@lwfinger.net \
    --to=larry.finger@lwfinger.net \
    --cc=linux-kernel@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.