From: Sebastian Riemer <sebastian.riemer-EIkl63zCoXaH+58JC4qpiA@public.gmane.org>
To: Roland Dreier <roland-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
Or Gerlitz <ogerlitz-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>,
"ri-EIkl63zCoXaH+58JC4qpiA@public.gmane.org"
<ri-EIkl63zCoXaH+58JC4qpiA@public.gmane.org>
Subject: IB softirq race
Date: Fri, 10 Aug 2012 15:03:52 +0200 [thread overview]
Message-ID: <502506B8.7080203@profitbricks.com> (raw)
Hi Roland,
we've got a gateway machine which is connected to the internet via
ethernet and is connected with our KVM VMs-providing cloud
infrastructure via IB.
There must have been a race with softirqs. We've got a custom kernel
module ("xt_ETHOIP6_gw") which handles the Ethernet<>IB.
The trace looks like that it caused the kernel trace together with the
tun driver. What does the "(O)" mean?
Should we look at our kernel module for better locking? What are the
common data structures with which races can occur? Something with the
connection manager?
Cheers,
Sebastian
WARNING: at net/sched/sch_generic.c:255 dev_watchdog+0x22c/0x240()
Hardware name: H8DGU
NETDEV WATCHDOG: ib0 (mlx4_core): transmit queue 0 timed out
Modules linked in: ipt_LOG xt_ETHOIP6_gw(O) ip6table_mangle
iptable_mangle ip6table_filter ip6_tables tun(O) bridge stp llc rdma_ucm
rdma_cm iw_cm ib_addr ib_ipoib ib_cm ib_sa ib_uverbs ib_umad ib_qib
mlx4_ib xt_multiport iptable_filter ip_tables x_tables ib_mthca ib_mad
ib_core kvm_amd kvm psmouse tpm_tis tpm tpm_bios amd64_edac_mod
i2c_piix4 edac_core serio_raw evdev edac_mce_amd button processor
thermal_sys mlx4_en sg usb_storage mlx4_core ixgbe dca mdio [last
unloaded: scsi_wait_scan]
Pid: 3, comm: ksoftirqd/0 Tainted: G O 3.2.8-gw #1
Call Trace:
[<ffffffff81047dbb>] ? warn_slowpath_common+0x7b/0xc0
[<ffffffff81047eb5>] ? warn_slowpath_fmt+0x45/0x50
[<ffffffff81058333>] ? mod_timer+0x153/0x2a0
[<ffffffff81584bec>] ? dev_watchdog+0x22c/0x240
[<ffffffff810572a8>] ? run_timer_softirq+0x158/0x360
[<ffffffff815849c0>] ? __netdev_watchdog_up+0x70/0x70
[<ffffffff8168dc8a>] ? __schedule+0x2ea/0x7e0
[<ffffffff8104e481>] ? __do_softirq+0xb1/0x1e0
[<ffffffff8104e661>] ? run_ksoftirqd+0xb1/0x160
[<ffffffff8104e5b0>] ? __do_softirq+0x1e0/0x1e0
[<ffffffff8104e5b0>] ? __do_softirq+0x1e0/0x1e0
[<ffffffff81069176>] ? kthread+0x96/0xa0
[<ffffffff816997b4>] ? kernel_thread_helper+0x4/0x10
[<ffffffff810690e0>] ? kthread_worker_fn+0x180/0x180
[<ffffffff816997b0>] ? gs_change+0x13/0x13
---[ end trace a4ac921bb1a9d647 ]---
ib0: transmit timeout: latency 1770 msecs
ib0: queue stopped 1, tx_head 39614, tx_tail 39614
--
Sebastian Riemer
Linux Kernel Developer
ProfitBricks GmbH • Greifswalder Str. 207 • 10405 Berlin, Germany
www.profitbricks.com • sebastian.riemer-EIkl63zCoXaH+58JC4qpiA@public.gmane.org
Tel.: +49 - 30 - 60 98 56 991 - 915
Sitz der Gesellschaft: Berlin
Registergericht: Amtsgericht Charlottenburg, HRB 125506 B
Geschäftsführer: Andreas Gauger, Achim Weiss
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
next reply other threads:[~2012-08-10 13:03 UTC|newest]
Thread overview: 2+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-08-10 13:03 Sebastian Riemer [this message]
[not found] ` <502506B8.7080203-EIkl63zCoXaH+58JC4qpiA@public.gmane.org>
2012-08-10 20:51 ` IB softirq race Roland Dreier
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=502506B8.7080203@profitbricks.com \
--to=sebastian.riemer-eikl63zcoxah+58jc4qpia@public.gmane.org \
--cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=ogerlitz-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org \
--cc=ri-EIkl63zCoXaH+58JC4qpiA@public.gmane.org \
--cc=roland-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.