* Re: [PATCH 11/12 net-2.6.25] [NETNS]: Routing cache virtualization.
From: David Miller @ 2008-01-23 7:51 UTC (permalink / raw)
To: den; +Cc: netdev, devel, containers
In-Reply-To: <1201074387-7366-2-git-send-email-den@openvz.org>
From: "Denis V. Lunev" <den@openvz.org>
Date: Wed, 23 Jan 2008 10:46:26 +0300
> Basically, this piece looks relatively easy. Namespace is already available
> on the dst entry via device and the device is safe to dereferrence. Compare
> it with one of a searcher and skip entry if appropriate.
>
> The only exception is ip_rt_frag_needed. So, add namespace parameter to it.
>
> Signed-off-by: Denis V. Lunev <den@openvz.org>
Applied.
^ permalink raw reply
* Re: [PATCH 12/12 net-2.6.25] [NETNS]: Add namespace for ICMP replying code.
From: David Miller @ 2008-01-23 7:51 UTC (permalink / raw)
To: den; +Cc: netdev, devel, containers
In-Reply-To: <1201074387-7366-3-git-send-email-den@openvz.org>
From: "Denis V. Lunev" <den@openvz.org>
Date: Wed, 23 Jan 2008 10:46:27 +0300
> All needed API is done, the namespace is available when required from the
> device on the DST entry from the incoming packet. So, just replace init_net
> with proper namespace.
>
> Other protocols will follow.
>
> Signed-off-by: Denis V. Lunev <den@openvz.org>
Applied, thanks.
^ permalink raw reply
* Re: Assertions in latest kernels
From: Krishna Kumar2 @ 2008-01-23 7:52 UTC (permalink / raw)
To: netdev
In-Reply-To: <OFBE734C49.5B16C8E9-ON652573D9.002548B8-652573D9.0026407B@in.ibm.com>
Sorry for the duplicate bug report, I just saw that Dave Young had already
reported three of the
4 assertions that I was getting. The only different assert I am getting is:
iperf with multiple threads almost always gets these 4, *especially* when I
do some batching :).
static void tcp_fastretrans_alert(struct sock *sk, int pkts_acked, int flag)
{
...
if (WARN_ON(!tp->sacked_out && tp->fackets_out))
tp->fackets_out = 0;
...
}
Jan 13 20:57:08 elm3b39 kernel: ------------[ cut here ]------------
Jan 13 20:57:08 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2506
Jan 13 20:57:08 elm3b39 kernel: NIP: c0000000003a0358 LR: c0000000003a0808 CTR: c0000000003d7d90
Jan 13 20:57:08 elm3b39 kernel: REGS: c0000000e60f6e00 TRAP: 0700 Not tainted (2.6.24-rc6)
Jan 13 20:57:08 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24024088 XER: 00000010
Jan 13 20:57:08 elm3b39 kernel: TASK = c0000001d20d1060[0] 'swapper' THREAD: c0000000e60f4000 CPU: 5
Jan 13 20:57:08 elm3b39 kernel: GPR00: 0000000000000001 c0000000e60f7080 c0000000005f1f00 c0000000dcccd280
Jan 13 20:57:08 elm3b39 kernel: GPR04: 000000009845ceac 0000000000000000 00000000000000fb 00000000000000f7
Jan 13 20:57:08 elm3b39 kernel: GPR08: 0000000000000000 0000000000000001 0000000000000000 c0000000003d8230
Jan 13 20:57:08 elm3b39 kernel: GPR12: 0000000044000022 c000000000554380 0000000000000000 0000000003ab69d3
Jan 13 20:57:08 elm3b39 kernel: GPR16: 00000000000000fa 0000000000000008 0000000000000008 c0000000dcccd348
Jan 13 20:57:08 elm3b39 kernel: GPR20: 000000009845ceac 0000000000000001 0000000000000000 0000000000000004
Jan 13 20:57:08 elm3b39 kernel: GPR24: 0000000044004082 0000000024004082 c0000000dcccd280 000000000000050e
Jan 13 20:57:08 elm3b39 kernel: GPR28: 0000000000000003 00000000000000f7 c0000000005ba670 000000000000050e
Jan 13 20:57:08 elm3b39 kernel: NIP [c0000000003a0358] .tcp_ack+0xa98/0x1fe0
Jan 13 20:57:08 elm3b39 kernel: LR [c0000000003a0808] .tcp_ack+0xf48/0x1fe0
Jan 13 20:57:08 elm3b39 kernel: Call Trace:
Jan 13 20:57:08 elm3b39 kernel: [c0000000e60f7080] [c0000000003a0808] .tcp_ack+0xf48/0x1fe0 (unreliable)
Jan 13 20:57:08 elm3b39 kernel: [c0000000e60f71e0] [c0000000003a5a24] .tcp_rcv_established+0x4d4/0x8f0
Jan 13 20:57:08 elm3b39 kernel: [c0000000e60f7290] [c0000000003add54] .tcp_v4_do_rcv+0x134/0x2a0
Jan 13 20:57:08 elm3b39 kernel: [c0000000e60f7350] [c0000000003b013c] .tcp_v4_rcv+0x75c/0x8d0
Jan 13 20:57:08 elm3b39 kernel: [c0000000e60f7410] [c000000000389fa0] .ip_local_deliver+0xf0/0x2d0
Jan 13 20:57:08 elm3b39 kernel: [c0000000e60f74a0] [c00000000038a4b4] .ip_rcv+0x334/0x6d0
Jan 13 20:57:08 elm3b39 kernel: [c0000000e60f7570] [c000000000358e6c] .netif_receive_skb+0x32c/0x630
Jan 13 20:57:08 elm3b39 kernel: [c0000000e60f7650] [d00000000040d27c] .ipoib_ib_handle_rx_wc+0x1dc/0x3a0 [ib_ipoib]
Jan 13 20:57:08 elm3b39 kernel: [c0000000e60f7700] [d00000000040ea6c] .ipoib_poll+0x24c/0x2b0 [ib_ipoib]
Jan 13 20:57:08 elm3b39 kernel: [c0000000e60f77e0] [c00000000035c830] .net_rx_action+0x1f0/0x2a0
Jan 13 20:57:08 elm3b39 kernel: [c0000000e60f78a0] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 13 20:57:08 elm3b39 kernel: [c0000000e60f7960] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 13 20:57:08 elm3b39 kernel: [c0000000e60f79e0] [c00000000005b134] .irq_exit+0x74/0x90
Jan 13 20:57:08 elm3b39 kernel: [c0000000e60f7a60] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 13 20:57:09 elm3b39 kernel: [c0000000e60f7ae0] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 13 20:57:09 elm3b39 kernel: --- Exception: 501 at .pseries_dedicated_idle_sleep+0xe8/0x1c0
Jan 13 20:57:09 elm3b39 kernel: LR = .pseries_dedicated_idle_sleep+0xe0/0x1c0
Jan 13 20:57:09 elm3b39 kernel: [c0000000e60f7dd0] [0000000000000000] .__start+0x4000000000000000/0x8 (unreliable)
Jan 13 20:57:09 elm3b39 kernel: [c0000000e60f7e70] [c000000000011fec] .cpu_idle+0x13c/0x250
Jan 13 20:57:09 elm3b39 kernel: [c0000000e60f7f00] [c00000000002bd5c] .start_secondary+0x14c/0x190
Jan 13 20:57:09 elm3b39 kernel: [c0000000e60f7f90] [c000000000008364] .start_secondary_prolog+0xc/0x10
Jan 13 20:57:09 elm3b39 kernel: Instruction dump:
Jan 13 20:57:09 elm3b39 kernel: 815a055c 39200000 38000000 2f8a0000 409e0020 801a0560 2f800000 7d200026
Jan 13 20:57:09 elm3b39 kernel: 5529fffe 69290001 79290620 7d204b78 <0b090000> 2fa00000 409e1464 7f280120
^ permalink raw reply
* Re: Assertions in latest kernels
From: David Miller @ 2008-01-23 7:57 UTC (permalink / raw)
To: krkumar2; +Cc: netdev
In-Reply-To: <OFC47DE839.9B2F85A5-ON652573D9.002BA994-652573D9.002B38BA@in.ibm.com>
From: Krishna Kumar2 <krkumar2@in.ibm.com>
Date: Wed, 23 Jan 2008 13:22:05 +0530
> Sorry for the duplicate bug report, I just saw that Dave Young had already
> reported three of the
> 4 assertions that I was getting. The only different assert I am getting is:
>
> iperf with multiple threads almost always gets these 4, *especially* when I
> do some batching :).
>
> static void tcp_fastretrans_alert(struct sock *sk, int pkts_acked, int flag)
> {
> ...
> if (WARN_ON(!tp->sacked_out && tp->fackets_out))
> tp->fackets_out = 0;
> ...
> }
Does this assertion show up first or do you get the other TCP
ones first? It might be important, in that if you get the
others ones first that corrupted state might be what leads to
this one.
^ permalink raw reply
* Re: Assertions in latest kernels
From: Krishna Kumar2 @ 2008-01-23 8:22 UTC (permalink / raw)
To: David Miller; +Cc: netdev
In-Reply-To: <20080122.235723.52174015.davem@davemloft.net>
David Miller <davem@davemloft.net> wrote on 01/23/2008 01:27:23 PM:
> > iperf with multiple threads almost always gets these 4, *especially*
when I
> > do some batching :).
> >
> > static void tcp_fastretrans_alert(struct sock *sk, int pkts_acked, int
flag)
> > {
> > ...
> > if (WARN_ON(!tp->sacked_out && tp->fackets_out))
> > tp->fackets_out = 0;
> > ...
> > }
>
> Does this assertion show up first or do you get the other TCP
> ones first? It might be important, in that if you get the
> others ones first that corrupted state might be what leads to
> this one.
Hi Dave,
I looked at my *old* messages file and found this assert (2506) was first
to hit (atleast in
two messages file). It hit 5 times, then I got a different one that I had
not reported earlier:
"KERNEL: assertion (packets <= tp->packets_out) failed at
net/ipv4/tcp_input.c (2139)"
(though this was hidden in my report under the panic for tcp_input.c:2528.
Then another two thousand times of the 2506 asserts.
Today I installed the latest untouched kernel, rebooted system and got the
following errors
in sequence, but no 2506 errors (which I have always got when running
batching in the last
2-3 weeks):
Jan 22 02:07:55 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 22 02:07:56 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 22 02:07:56 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 22 02:07:57 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 22 02:07:58 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 22 02:07:59 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 22 02:07:59 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 22 02:08:00 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 22 02:08:01 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 22 02:08:01 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
Jan 22 02:08:02 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
Jan 22 02:08:03 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
Jan 22 02:08:03 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
Jan 22 02:08:04 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
Jan 22 02:08:05 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
Jan 22 02:08:06 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
Jan 22 02:08:06 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
Jan 22 02:08:07 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:1767
Jan 22 02:08:07 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 22 02:08:08 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
Jan 22 02:08:09 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 22 02:08:10 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
Jan 22 02:08:10 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 22 02:08:11 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
Jan 22 02:08:12 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 22 02:08:12 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 22 02:08:13 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
Jan 22 02:08:14 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 22 02:08:15 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 22 02:08:15 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:1767
Jan 22 02:08:16 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:1767
Jan 22 02:08:16 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:1767
Jan 22 02:08:17 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 22 02:08:18 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
Jan 22 02:08:18 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 22 02:08:19 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
Jan 22 02:08:19 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
and so on for another 700 counts.
The unique asserts are:
1767: tcp_verify_left_out (from tcp_entry_frto)
2169: tcp_verify_left_out (from tcp_mark_head_lost)
2528: tcp_verify_left_out (from tcp_fastretrans_alert)
3063: tcp_verify_left_out (from tcp_process_frto)
(where 2169 seems to preceed any other asserts)
The other two asserts that I got only with batching are:
2139: BUG_TRAP(packets <= tp->packets_out); (in tcp_mark_head_lost)
2506: WARN_ON(!tp->sacked_out && tp->fackets_out) (in
tcp_fastretrans_alert)
(where 2506 always seems to preceed any other asserts).
thanks,
- KK
^ permalink raw reply
* Re: 2.6.24-rc8-mm1 : net tcp_input.c warnings
From: Ilpo Järvinen @ 2008-01-23 8:41 UTC (permalink / raw)
To: Dave Young; +Cc: LKML, Netdev, Andrew Morton
In-Reply-To: <a8e1da0801222344l101c2b90s363821c26bc8cb55@mail.gmail.com>
[-- Attachment #1: Type: TEXT/PLAIN, Size: 9210 bytes --]
On Wed, 23 Jan 2008, Dave Young wrote:
> On Jan 23, 2008 3:41 PM, Ilpo Järvinen <ilpo.jarvinen@helsinki.fi> wrote:
> >
> > On Tue, 22 Jan 2008, David Miller wrote:
> >
> > > From: "Dave Young" <hidave.darkstar@gmail.com>
> > > Date: Wed, 23 Jan 2008 09:44:30 +0800
> > >
> > > > On Jan 22, 2008 6:47 PM, Ilpo Järvinen <ilpo.jarvinen@helsinki.fi> wrote:
> > > > > [PATCH] [TCP]: debug S+L
> > > >
> > > > Thanks, If there's new findings I will let you know.
> > >
> > > Thanks for helping with this bug Dave.
> >
> > I noticed btw that there thing might (is likely to) spuriously trigger at
> > WARN_ON(sacked != tp->sacked_out); because those won't be equal when SACK
> > is not enabled. If that does happen too often, I send a fixed patch for
> > it, yet, the fact that I print print tp->rx_opt.sack_ok allows
> > identification of those cases already as it's zero when SACK is not
> > enabled.
> >
> > Just ask if you need the updated debug patch.
>
> Thanks, please send, I would like to get it.
There you go. I fixed non-SACK case by adding tcp_is_sack checks there and
also added two verifys to tcp_ack to see if there's corruption outside of
TCP.
--
i.
[PATCH] [TCP]: debug S+L
---
include/net/tcp.h | 8 +++-
net/ipv4/tcp_input.c | 10 +++++
net/ipv4/tcp_ipv4.c | 101 +++++++++++++++++++++++++++++++++++++++++++++++++
net/ipv4/tcp_output.c | 21 +++++++---
4 files changed, 133 insertions(+), 7 deletions(-)
diff --git a/include/net/tcp.h b/include/net/tcp.h
index 7de4ea3..0685035 100644
--- a/include/net/tcp.h
+++ b/include/net/tcp.h
@@ -272,6 +272,8 @@ DECLARE_SNMP_STAT(struct tcp_mib, tcp_statistics);
#define TCP_ADD_STATS_BH(field, val) SNMP_ADD_STATS_BH(tcp_statistics, field, val)
#define TCP_ADD_STATS_USER(field, val) SNMP_ADD_STATS_USER(tcp_statistics, field, val)
+extern void tcp_verify_wq(struct sock *sk);
+
extern void tcp_v4_err(struct sk_buff *skb, u32);
extern void tcp_shutdown (struct sock *sk, int how);
@@ -768,7 +770,11 @@ static inline __u32 tcp_current_ssthresh(const struct sock *sk)
}
/* Use define here intentionally to get WARN_ON location shown at the caller */
-#define tcp_verify_left_out(tp) WARN_ON(tcp_left_out(tp) > tp->packets_out)
+#define tcp_verify_left_out(tp) \
+ do { \
+ WARN_ON(tcp_left_out(tp) > tp->packets_out); \
+ tcp_verify_wq((struct sock *)tp); \
+ } while(0)
extern void tcp_enter_cwr(struct sock *sk, const int set_ssthresh);
extern __u32 tcp_init_cwnd(struct tcp_sock *tp, struct dst_entry *dst);
diff --git a/net/ipv4/tcp_input.c b/net/ipv4/tcp_input.c
index fa2c85c..cdacf70 100644
--- a/net/ipv4/tcp_input.c
+++ b/net/ipv4/tcp_input.c
@@ -2645,6 +2645,10 @@ static void tcp_fastretrans_alert(struct sock *sk, int pkts_acked, int flag)
if (do_lost || (tcp_is_fack(tp) && tcp_head_timedout(sk)))
tcp_update_scoreboard(sk, fast_rexmit);
tcp_cwnd_down(sk, flag);
+
+ WARN_ON(tcp_write_queue_head(sk) == NULL);
+ WARN_ON(!tp->packets_out);
+
tcp_xmit_retransmit_queue(sk);
}
@@ -2848,6 +2852,8 @@ static int tcp_clean_rtx_queue(struct sock *sk, int prior_fackets)
tcp_clear_all_retrans_hints(tp);
}
+ tcp_verify_left_out(tp);
+
if (skb && (TCP_SKB_CB(skb)->sacked & TCPCB_SACKED_ACKED))
flag |= FLAG_SACK_RENEGING;
@@ -3175,6 +3181,8 @@ static int tcp_ack(struct sock *sk, struct sk_buff *skb, int flag)
prior_fackets = tp->fackets_out;
prior_in_flight = tcp_packets_in_flight(tp);
+ tcp_verify_left_out(tp);
+
if (!(flag & FLAG_SLOWPATH) && after(ack, prior_snd_una)) {
/* Window is constant, pure forward advance.
* No more checks are required.
@@ -3237,6 +3245,8 @@ static int tcp_ack(struct sock *sk, struct sk_buff *skb, int flag)
if ((flag & FLAG_FORWARD_PROGRESS) || !(flag & FLAG_NOT_DUP))
dst_confirm(sk->sk_dst_cache);
+ tcp_verify_left_out(tp);
+
return 1;
no_queue:
diff --git a/net/ipv4/tcp_ipv4.c b/net/ipv4/tcp_ipv4.c
index 9aea88b..7e8ab40 100644
--- a/net/ipv4/tcp_ipv4.c
+++ b/net/ipv4/tcp_ipv4.c
@@ -108,6 +108,107 @@ struct inet_hashinfo __cacheline_aligned tcp_hashinfo = {
.lhash_wait = __WAIT_QUEUE_HEAD_INITIALIZER(tcp_hashinfo.lhash_wait),
};
+void tcp_print_queue(struct sock *sk)
+{
+ struct tcp_sock *tp = tcp_sk(sk);
+ struct sk_buff *skb;
+ char s[50+1];
+ char h[50+1];
+ int idx = 0;
+ int i;
+
+ tcp_for_write_queue(skb, sk) {
+ if (skb == tcp_send_head(sk))
+ break;
+
+ for (i = 0; i < tcp_skb_pcount(skb); i++) {
+ if (TCP_SKB_CB(skb)->sacked & TCPCB_SACKED_ACKED) {
+ s[idx] = 'S';
+ if (TCP_SKB_CB(skb)->sacked & TCPCB_LOST)
+ s[idx] = 'B';
+
+ } else if (TCP_SKB_CB(skb)->sacked & TCPCB_LOST) {
+ s[idx] = 'L';
+ } else {
+ s[idx] = ' ';
+ }
+ if (s[idx] != ' ' && skb->len < tp->mss_cache)
+ s[idx] += 'a' - 'A';
+
+ if (i == 0) {
+ if (TCP_SKB_CB(skb)->seq == tcp_highest_sack_seq(tp))
+ h[idx] = 'h';
+ else
+ h[idx] = '+';
+ } else {
+ h[idx] = '-';
+ }
+
+ if (++idx >= 50) {
+ s[idx] = 0;
+ h[idx] = 0;
+ printk(KERN_ERR "TCP wq(s) %s\n", s);
+ printk(KERN_ERR "TCP wq(h) %s\n", h);
+ idx = 0;
+ }
+ }
+ }
+ if (idx) {
+ s[idx] = '<';
+ s[idx+1] = 0;
+ h[idx] = '<';
+ h[idx+1] = 0;
+ printk(KERN_ERR "TCP wq(s) %s\n", s);
+ printk(KERN_ERR "TCP wq(h) %s\n", h);
+ }
+ printk(KERN_ERR "l%u s%u f%u p%u seq: su%u hs%u sn%u\n",
+ tp->lost_out, tp->sacked_out, tp->fackets_out, tp->packets_out,
+ tp->snd_una, tcp_highest_sack_seq(tp), tp->snd_nxt);
+}
+
+void tcp_verify_wq(struct sock *sk)
+{
+ struct tcp_sock *tp = tcp_sk(sk);
+ u32 lost = 0;
+ u32 sacked = 0;
+ u32 packets = 0;
+ struct sk_buff *skb;
+
+ tcp_for_write_queue(skb, sk) {
+ if (skb == tcp_send_head(sk))
+ break;
+
+ if (TCP_SKB_CB(skb)->sacked & TCPCB_SACKED_ACKED) {
+ sacked += tcp_skb_pcount(skb);
+ if (TCP_SKB_CB(skb)->sacked & TCPCB_LOST)
+ printk(KERN_ERR "Sacked bitmap S+L: %u %u-%u/%u\n",
+ TCP_SKB_CB(skb)->sacked,
+ TCP_SKB_CB(skb)->end_seq - tp->snd_una,
+ TCP_SKB_CB(skb)->seq - tp->snd_una,
+ tp->snd_una);
+ }
+ if (TCP_SKB_CB(skb)->sacked & TCPCB_LOST)
+ lost += tcp_skb_pcount(skb);
+
+ packets += tcp_skb_pcount(skb);
+ }
+
+ WARN_ON(lost != tp->lost_out);
+ WARN_ON(tcp_is_sack(tp) && (sacked != tp->sacked_out));
+ WARN_ON(packets != tp->packets_out);
+ if ((lost != tp->lost_out) ||
+ (tcp_is_sack(tp) && (sacked != tp->sacked_out)) ||
+ (packets != tp->packets_out)) {
+ printk(KERN_ERR "P: %u L: %u vs %u S: %u vs %u w: %u-%u (%u)\n",
+ tp->packets_out,
+ lost, tp->lost_out,
+ sacked, tp->sacked_out,
+ tp->snd_una, tp->snd_nxt,
+ tp->rx_opt.sack_ok);
+ tcp_print_queue(sk);
+ }
+}
+
static int tcp_v4_get_port(struct sock *sk, unsigned short snum)
{
return inet_csk_get_port(&tcp_hashinfo, sk, snum,
diff --git a/net/ipv4/tcp_output.c b/net/ipv4/tcp_output.c
index 89f0188..648340f 100644
--- a/net/ipv4/tcp_output.c
+++ b/net/ipv4/tcp_output.c
@@ -779,10 +779,9 @@ int tcp_fragment(struct sock *sk, struct sk_buff *skb, u32 len,
tp->lost_out -= diff;
/* Adjust Reno SACK estimate. */
- if (tcp_is_reno(tp) && diff > 0) {
+ if (tcp_is_reno(tp) && diff > 0)
tcp_dec_pcount_approx_int(&tp->sacked_out, diff);
- tcp_verify_left_out(tp);
- }
+
tcp_adjust_fackets_out(sk, skb, diff);
}
@@ -790,6 +789,8 @@ int tcp_fragment(struct sock *sk, struct sk_buff *skb, u32 len,
skb_header_release(buff);
tcp_insert_write_queue_after(skb, buff, sk);
+ tcp_verify_left_out(tp);
+
return 0;
}
@@ -1463,6 +1464,7 @@ static int tcp_write_xmit(struct sock *sk, unsigned int mss_now, int nonagle)
} else if (result > 0) {
sent_pkts = 1;
}
+ tcp_verify_left_out(tp);
while ((skb = tcp_send_head(sk))) {
unsigned int limit;
@@ -1764,6 +1766,7 @@ static void tcp_retrans_try_collapse(struct sock *sk, struct sk_buff *skb,
tcp_clear_retrans_hints_partial(tp);
sk_wmem_free_skb(sk, next_skb);
+ tcp_verify_left_out(tp);
}
/* Do a simple retransmit without using the backoff mechanisms in
@@ -1795,13 +1798,13 @@ void tcp_simple_retransmit(struct sock *sk)
}
}
+ tcp_verify_left_out(tp);
+
tcp_clear_all_retrans_hints(tp);
if (!lost)
return;
- tcp_verify_left_out(tp);
-
/* Don't muck with the congestion window here.
* Reason is that we do not increase amount of _data_
* in network, but units changed and effective
@@ -1970,8 +1973,10 @@ void tcp_xmit_retransmit_queue(struct sock *sk)
* packet to be MSS sized and all the
* packet counting works out.
*/
- if (tcp_packets_in_flight(tp) >= tp->snd_cwnd)
+ if (tcp_packets_in_flight(tp) >= tp->snd_cwnd) {
+ tcp_verify_left_out(tp);
return;
+ }
if (sacked & TCPCB_LOST) {
if (!(sacked & (TCPCB_SACKED_ACKED|TCPCB_SACKED_RETRANS))) {
@@ -1997,6 +2002,8 @@ void tcp_xmit_retransmit_queue(struct sock *sk)
}
}
+ tcp_verify_left_out(tp);
+
/* OK, demanded retransmission is finished. */
/* Forward retransmissions are possible only during Recovery. */
@@ -2054,6 +2061,8 @@ void tcp_xmit_retransmit_queue(struct sock *sk)
NET_INC_STATS_BH(LINUX_MIB_TCPFORWARDRETRANS);
}
+
+ tcp_verify_left_out(tp);
}
/* Send a fin. The caller locks the socket for us. This cannot be
--
1.5.2.2
^ permalink raw reply related
* Re: [PATCH 12/12 net-2.6.25] [NETNS]: Add namespace for ICMP replying code.
From: Mathieu Lacage @ 2008-01-23 9:16 UTC (permalink / raw)
To: David Miller
Cc: containers-qjLDD68F18O7TbgM5vRIOg, den-GEFAQzZX7r8dnm+yROfE0A,
netdev-u79uwXL29TY76Z2rM5mHXA
In-Reply-To: <20080122.235130.84789113.davem-fT/PcQaiUtIeIZ0/mPfg9Q@public.gmane.org>
hi,
On Tue, 2008-01-22 at 23:51 -0800, David Miller wrote:
> From: "Denis V. Lunev" <den-GEFAQzZX7r8dnm+yROfE0A@public.gmane.org>
> Date: Wed, 23 Jan 2008 10:46:27 +0300
>
> > All needed API is done, the namespace is available when required from the
> > device on the DST entry from the incoming packet. So, just replace init_net
> > with proper namespace.
> >
> > Other protocols will follow.
> >
> > Signed-off-by: Denis V. Lunev <den-GEFAQzZX7r8dnm+yROfE0A@public.gmane.org>
>
> Applied, thanks.
I have been following the netns patches on this ML for a while but I
still have not figured out in which tree the patches fed to David Miller
are applied. I have attempted to grep the public trees 'davem/net-2.6'
and 'davem/net-2.6.25' but without much success so far. Is there a
public git tree I can clone which contains all the netns patches which
David Miller state are 'Applied' ?
thank you,
Mathieu
^ permalink raw reply
* Re: Assertions in latest kernels
From: Ilpo Järvinen @ 2008-01-23 9:17 UTC (permalink / raw)
To: Krishna Kumar2; +Cc: David Miller, Netdev
In-Reply-To: <OF331AFFAC.CEF61228-ON652573D9.002CF47B-652573D9.002E0A84@in.ibm.com>
On Wed, 23 Jan 2008, Krishna Kumar2 wrote:
> David Miller <davem@davemloft.net> wrote on 01/23/2008 01:27:23 PM:
>
> > > iperf with multiple threads almost always gets these 4, *especially*
> when I
> > > do some batching :).
> > >
> > > static void tcp_fastretrans_alert(struct sock *sk, int pkts_acked, int
> flag)
> > > {
> > > ...
> > > if (WARN_ON(!tp->sacked_out && tp->fackets_out))
> > > tp->fackets_out = 0;
> > > ...
> > > }
> >
> > Does this assertion show up first or do you get the other TCP
> > ones first? It might be important, in that if you get the
> > others ones first that corrupted state might be what leads to
> > this one.
>
> Hi Dave,
>
> I looked at my *old* messages file and found this assert (2506) was first
> to hit (atleast in
> two messages file). It hit 5 times, then I got a different one that I had
> not reported earlier:
>
> "KERNEL: assertion (packets <= tp->packets_out) failed at
> net/ipv4/tcp_input.c (2139)"
>
> (though this was hidden in my report under the panic for tcp_input.c:2528.
>
> Then another two thousand times of the 2506 asserts.
>
> Today I installed the latest untouched kernel, rebooted system and got the
> following errors
> in sequence, but no 2506 errors (which I have always got when running
> batching in the last
> 2-3 weeks):
>
> Jan 22 02:07:55 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
> Jan 22 02:07:56 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
> Jan 22 02:07:56 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
> Jan 22 02:07:57 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
> Jan 22 02:07:58 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
> Jan 22 02:07:59 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
> Jan 22 02:07:59 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
> Jan 22 02:08:00 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
> Jan 22 02:08:01 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
> Jan 22 02:08:01 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
> Jan 22 02:08:02 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
> Jan 22 02:08:03 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
> Jan 22 02:08:03 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
> Jan 22 02:08:04 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
> Jan 22 02:08:05 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
> Jan 22 02:08:06 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
> Jan 22 02:08:06 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
> Jan 22 02:08:07 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:1767
> Jan 22 02:08:07 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
> Jan 22 02:08:08 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
> Jan 22 02:08:09 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
> Jan 22 02:08:10 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
> Jan 22 02:08:10 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
> Jan 22 02:08:11 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
> Jan 22 02:08:12 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
> Jan 22 02:08:12 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
> Jan 22 02:08:13 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
> Jan 22 02:08:14 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
> Jan 22 02:08:15 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
> Jan 22 02:08:15 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:1767
> Jan 22 02:08:16 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:1767
> Jan 22 02:08:16 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:1767
> Jan 22 02:08:17 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
> Jan 22 02:08:18 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
> Jan 22 02:08:18 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
> Jan 22 02:08:19 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2528
> Jan 22 02:08:19 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
>
> and so on for another 700 counts.
>
> The unique asserts are:
> 1767: tcp_verify_left_out (from tcp_entry_frto)
> 2169: tcp_verify_left_out (from tcp_mark_head_lost)
> 2528: tcp_verify_left_out (from tcp_fastretrans_alert)
> 3063: tcp_verify_left_out (from tcp_process_frto)
> (where 2169 seems to preceed any other asserts)
Once you get one of these, you'll get a large number of them, maybe I
should just change it to WARN_ON_ONCE to stop confusing people with the
rest.
> The other two asserts that I got only with batching are:
> 2139: BUG_TRAP(packets <= tp->packets_out); (in tcp_mark_head_lost)
> 2506: WARN_ON(!tp->sacked_out && tp->fackets_out) (in
> tcp_fastretrans_alert)
> (where 2506 always seems to preceed any other asserts).
It's almost impossible to know which of these is the main cause and the
first occuring due to reasons I'll not copy here. What a strange thing
that it has been super quiet on this front until now everybody is seeing
it, could there be something unrelated to TCP which has broken it all
recently?
Good thing is that you seem to be able to reproduce it were nicely.
Please try with this beauty below... Hopefully got it correctly matching
to mainline, in contrast to version I sent Dave Y., there's some added
candy which catches highest_sack corruption as well, at least it compiles
already :-).
--
i.
[PATCH] TCP: debug S+L (for mainline, not compatible with mm or net-2.6.25)
---
include/net/tcp.h | 8 +++-
net/ipv4/tcp_input.c | 10 ++++
net/ipv4/tcp_ipv4.c | 123 +++++++++++++++++++++++++++++++++++++++++++++++++
net/ipv4/tcp_output.c | 21 ++++++--
4 files changed, 155 insertions(+), 7 deletions(-)
diff --git a/include/net/tcp.h b/include/net/tcp.h
index cb5b033..9ea62f9 100644
--- a/include/net/tcp.h
+++ b/include/net/tcp.h
@@ -272,6 +272,8 @@ DECLARE_SNMP_STAT(struct tcp_mib, tcp_statistics);
#define TCP_ADD_STATS_BH(field, val) SNMP_ADD_STATS_BH(tcp_statistics, field, val)
#define TCP_ADD_STATS_USER(field, val) SNMP_ADD_STATS_USER(tcp_statistics, field, val)
+extern void tcp_verify_wq(struct sock *sk);
+
extern void tcp_v4_err(struct sk_buff *skb, u32);
extern void tcp_shutdown (struct sock *sk, int how);
@@ -769,7 +771,11 @@ static inline __u32 tcp_current_ssthresh(const struct sock *sk)
}
/* Use define here intentionally to get WARN_ON location shown at the caller */
-#define tcp_verify_left_out(tp) WARN_ON(tcp_left_out(tp) > tp->packets_out)
+#define tcp_verify_left_out(tp) \
+ do { \
+ WARN_ON(tcp_left_out(tp) > tp->packets_out); \
+ tcp_verify_wq((struct sock *)tp); \
+ } while(0)
extern void tcp_enter_cwr(struct sock *sk, const int set_ssthresh);
extern __u32 tcp_init_cwnd(struct tcp_sock *tp, struct dst_entry *dst);
diff --git a/net/ipv4/tcp_input.c b/net/ipv4/tcp_input.c
index b39f0d8..1e4db05 100644
--- a/net/ipv4/tcp_input.c
+++ b/net/ipv4/tcp_input.c
@@ -2529,6 +2529,10 @@ tcp_fastretrans_alert(struct sock *sk, int pkts_acked, int flag)
if (do_lost || tcp_head_timedout(sk))
tcp_update_scoreboard(sk);
tcp_cwnd_down(sk, flag);
+
+ WARN_ON(tcp_write_queue_head(sk) == NULL);
+ WARN_ON(!tp->packets_out);
+
tcp_xmit_retransmit_queue(sk);
}
@@ -2744,6 +2748,8 @@ static int tcp_clean_rtx_queue(struct sock *sk, s32 *seq_rtt_p,
tcp_clear_all_retrans_hints(tp);
}
+ tcp_verify_left_out(tp);
+
if (flag & FLAG_ACKED) {
u32 pkts_acked = prior_packets - tp->packets_out;
const struct tcp_congestion_ops *ca_ops
@@ -3070,6 +3076,8 @@ static int tcp_ack(struct sock *sk, struct sk_buff *skb, int flag)
prior_fackets = tp->fackets_out;
prior_in_flight = tcp_packets_in_flight(tp);
+ tcp_verify_left_out(tp);
+
if (!(flag&FLAG_SLOWPATH) && after(ack, prior_snd_una)) {
/* Window is constant, pure forward advance.
* No more checks are required.
@@ -3131,6 +3139,8 @@ static int tcp_ack(struct sock *sk, struct sk_buff *skb, int flag)
if ((flag & FLAG_FORWARD_PROGRESS) || !(flag&FLAG_NOT_DUP))
dst_confirm(sk->sk_dst_cache);
+ tcp_verify_left_out(tp);
+
return 1;
no_queue:
diff --git a/net/ipv4/tcp_ipv4.c b/net/ipv4/tcp_ipv4.c
index 652c323..9c56153 100644
--- a/net/ipv4/tcp_ipv4.c
+++ b/net/ipv4/tcp_ipv4.c
@@ -108,6 +108,129 @@ struct inet_hashinfo __cacheline_aligned tcp_hashinfo = {
.lhash_wait = __WAIT_QUEUE_HEAD_INITIALIZER(tcp_hashinfo.lhash_wait),
};
+void tcp_print_queue(struct sock *sk)
+{
+ struct tcp_sock *tp = tcp_sk(sk);
+ struct sk_buff *skb;
+ char s[50+1];
+ char h[50+1];
+ int idx = 0;
+ int i;
+
+ tcp_for_write_queue(skb, sk) {
+ if (skb == tcp_send_head(sk))
+ break;
+
+ for (i = 0; i < tcp_skb_pcount(skb); i++) {
+ if (TCP_SKB_CB(skb)->sacked & TCPCB_SACKED_ACKED) {
+ s[idx] = 'S';
+ if (TCP_SKB_CB(skb)->sacked & TCPCB_LOST)
+ s[idx] = 'B';
+
+ } else if (TCP_SKB_CB(skb)->sacked & TCPCB_LOST) {
+ s[idx] = 'L';
+ } else {
+ s[idx] = ' ';
+ }
+ if (s[idx] != ' ' && skb->len < tp->mss_cache)
+ s[idx] += 'a' - 'A';
+
+ if (i == 0) {
+ if ((TCP_SKB_CB(skb)->seq == tp->highest_sack) &&
+ (tp->fastpath_skb_hint == skb))
+ h[idx] = 'x';
+ else if (TCP_SKB_CB(skb)->seq == tp->highest_sack)
+ h[idx] = 'h';
+ else if (tp->fastpath_skb_hint == skb)
+ h[idx] = 'f';
+ else
+ h[idx] = '+';
+ } else {
+ h[idx] = '-';
+ }
+
+ if (++idx >= 50) {
+ s[idx] = 0;
+ h[idx] = 0;
+ printk(KERN_ERR "TCP wq(s) %s\n", s);
+ printk(KERN_ERR "TCP wq(h) %s\n", h);
+ idx = 0;
+ }
+ }
+ }
+ if (idx) {
+ s[idx] = '<';
+ s[idx+1] = 0;
+ h[idx] = '<';
+ h[idx+1] = 0;
+ printk(KERN_ERR "TCP wq(s) %s\n", s);
+ printk(KERN_ERR "TCP wq(h) %s\n", h);
+ }
+ printk(KERN_ERR "l%u s%u f%u p%u seq: su%u hs%u sn%u\n",
+ tp->lost_out, tp->sacked_out, tp->fackets_out, tp->packets_out,
+ tp->snd_una, tp->highest_sack, tp->snd_nxt);
+}
+
+void tcp_verify_wq(struct sock *sk)
+{
+ struct tcp_sock *tp = tcp_sk(sk);
+ u32 lost = 0;
+ u32 sacked = 0;
+ u32 packets = 0;
+ u32 fackets = 0;
+ int hint_failed_at = -1;
+ int highest_sack_corrupt = 0;
+ struct sk_buff *skb;
+
+ tcp_for_write_queue(skb, sk) {
+ if (skb == tcp_send_head(sk))
+ break;
+
+ if (WARN_ON((tp->fastpath_skb_hint == skb) &&
+ packets != tp->fastpath_cnt_hint))
+ hint_failed_at = packets;
+
+ if (TCP_SKB_CB(skb)->sacked & TCPCB_SACKED_ACKED) {
+ sacked += tcp_skb_pcount(skb);
+ if (TCP_SKB_CB(skb)->sacked & TCPCB_LOST)
+ printk(KERN_ERR "Sacked bitmap S+L: %u %u-%u/%u\n",
+ TCP_SKB_CB(skb)->sacked,
+ TCP_SKB_CB(skb)->end_seq - tp->snd_una,
+ TCP_SKB_CB(skb)->seq - tp->snd_una,
+ tp->snd_una);
+ fackets = sacked;
+ if (WARN_ON(after(TCP_SKB_CB(skb)->seq, tp->highest_sack)))
+ highest_sack_corrupt = 1;
+ }
+ if (TCP_SKB_CB(skb)->sacked & TCPCB_LOST)
+ lost += tcp_skb_pcount(skb);
+
+ packets += tcp_skb_pcount(skb);
+ }
+
+ WARN_ON(lost != tp->lost_out);
+ WARN_ON(tcp_is_sack(tp) && (sacked != tp->sacked_out));
+ WARN_ON(packets != tp->packets_out);
+ WARN_ON(fackets != tp->fackets_out);
+
+ if ((lost != tp->lost_out) ||
+ (tcp_is_sack(tp) && (sacked != tp->sacked_out)) ||
+ (packets != tp->packets_out) ||
+ (fackets != tp->fackets_out) ||
+ (hint_failed_at != -1) ||
+ highest_sack_corrupt) {
+ printk(KERN_ERR "P: %u L: %u vs %u S: %u vs %u F: %u vs %u H: %u vs %u w: %u-%u (%u, %u)\n",
+ tp->packets_out,
+ lost, tp->lost_out,
+ sacked, tp->sacked_out,
+ fackets, tp->fackets_out,
+ hint_failed_at, tp->fastpath_cnt_hint,
+ tp->snd_una, tp->snd_nxt,
+ tp->rx_opt.sack_ok, highest_sack_corrupt);
+ tcp_print_queue(sk);
+ }
+}
+
static int tcp_v4_get_port(struct sock *sk, unsigned short snum)
{
return inet_csk_get_port(&tcp_hashinfo, sk, snum,
diff --git a/net/ipv4/tcp_output.c b/net/ipv4/tcp_output.c
index f4c1eef..cce7531 100644
--- a/net/ipv4/tcp_output.c
+++ b/net/ipv4/tcp_output.c
@@ -768,10 +768,9 @@ int tcp_fragment(struct sock *sk, struct sk_buff *skb, u32 len, unsigned int mss
tp->lost_out -= diff;
/* Adjust Reno SACK estimate. */
- if (tcp_is_reno(tp) && diff > 0) {
+ if (tcp_is_reno(tp) && diff > 0)
tcp_dec_pcount_approx_int(&tp->sacked_out, diff);
- tcp_verify_left_out(tp);
- }
+
tcp_adjust_fackets_out(tp, skb, diff);
}
@@ -779,6 +778,8 @@ int tcp_fragment(struct sock *sk, struct sk_buff *skb, u32 len, unsigned int mss
skb_header_release(buff);
tcp_insert_write_queue_after(skb, buff, sk);
+ tcp_verify_left_out(tp);
+
return 0;
}
@@ -1439,6 +1440,7 @@ static int tcp_write_xmit(struct sock *sk, unsigned int mss_now, int nonagle)
} else if (result > 0) {
sent_pkts = 1;
}
+ tcp_verify_left_out(tp);
while ((skb = tcp_send_head(sk))) {
unsigned int limit;
@@ -1760,6 +1762,7 @@ static void tcp_retrans_try_collapse(struct sock *sk, struct sk_buff *skb, int m
sk_stream_free_skb(sk, next_skb);
}
+ tcp_verify_left_out(tp);
}
/* Do a simple retransmit without using the backoff mechanisms in
@@ -1791,13 +1794,13 @@ void tcp_simple_retransmit(struct sock *sk)
}
}
+ tcp_verify_left_out(tp);
+
tcp_clear_all_retrans_hints(tp);
if (!lost)
return;
- tcp_verify_left_out(tp);
-
/* Don't muck with the congestion window here.
* Reason is that we do not increase amount of _data_
* in network, but units changed and effective
@@ -1966,8 +1969,10 @@ void tcp_xmit_retransmit_queue(struct sock *sk)
* packet to be MSS sized and all the
* packet counting works out.
*/
- if (tcp_packets_in_flight(tp) >= tp->snd_cwnd)
+ if (tcp_packets_in_flight(tp) >= tp->snd_cwnd) {
+ tcp_verify_left_out(tp);
return;
+ }
if (sacked & TCPCB_LOST) {
if (!(sacked&(TCPCB_SACKED_ACKED|TCPCB_SACKED_RETRANS))) {
@@ -1993,6 +1998,8 @@ void tcp_xmit_retransmit_queue(struct sock *sk)
}
}
+ tcp_verify_left_out(tp);
+
/* OK, demanded retransmission is finished. */
/* Forward retransmissions are possible only during Recovery. */
@@ -2050,6 +2057,8 @@ void tcp_xmit_retransmit_queue(struct sock *sk)
NET_INC_STATS_BH(LINUX_MIB_TCPFORWARDRETRANS);
}
+
+ tcp_verify_left_out(tp);
}
--
1.5.2.2
^ permalink raw reply related
* Re: [PATCH 12/12 net-2.6.25] [NETNS]: Add namespace for ICMP replying code.
From: YOSHIFUJI Hideaki / 吉藤英明 @ 2008-01-23 9:30 UTC (permalink / raw)
To: mathieu.lacage; +Cc: davem, den, containers, netdev, yoshfuji
In-Reply-To: <1201079789.10778.26.camel@mistigri.inria.fr>
In article <1201079789.10778.26.camel@mistigri.inria.fr> (at Wed, 23 Jan 2008 10:16:29 +0100), Mathieu Lacage <mathieu.lacage@sophia.inria.fr> says:
> I have been following the netns patches on this ML for a while but I
> still have not figured out in which tree the patches fed to David Miller
> are applied. I have attempted to grep the public trees 'davem/net-2.6'
> and 'davem/net-2.6.25' but without much success so far. Is there a
> public git tree I can clone which contains all the netns patches which
> David Miller state are 'Applied' ?
I'm cloning from
git://git.kernel.org/pub/scm/linux/kernel/git/davem/net-2.6.25.git
There may be some time-lag.
--yoshfuji
^ permalink raw reply
* 2.6.24-rc8 ppp regression
From: maximilian attems @ 2008-01-23 9:35 UTC (permalink / raw)
To: netdev
when killing a wvdial usb modem session:
Jan 22 23:23:03 dual pppd[7941]: Terminating on signal 15
Jan 22 23:23:03 dual pppd[7941]: Connect time 92.2 minutes.
Jan 22 23:23:03 dual pppd[7941]: Sent 1322316 bytes, received 8587156 bytes.
Jan 22 23:23:03 dual pppd[7941]: Connection terminated.
Jan 22 23:23:05 dual kernel: usb 3-2: USB disconnect, address 5
Jan 22 23:23:05 dual kernel: option 3-2:1.0: device disconnected
Jan 22 23:23:05 dual kernel: option1 ttyUSB1: GSM modem (1-port) converter now disconnected from ttyUSB1
Jan 22 23:23:05 dual kernel: option 3-2:1.1: device disconnected
Jan 22 23:23:13 dual kernel: unregister_netdevice: waiting for ppp0 to become free. Usage count = 1
Jan 22 23:23:44 dual last message repeated 3 times
Jan 22 23:23:54 dual kernel: unregister_netdevice: waiting for ppp0 to become free. Usage count = 1
2.6.24-rc7 works fine, not yet bisected, will do later in the evening.
--
maks
^ permalink raw reply
* Re: Assertions in latest kernels
From: Ilpo Järvinen @ 2008-01-23 9:53 UTC (permalink / raw)
To: Krishna Kumar2; +Cc: David Miller, Netdev
In-Reply-To: <OF6C895B68.E4A75EFD-ON652573D9.0034E821-652573D9.0034BF2E@in.ibm.com>
On Wed, 23 Jan 2008, Krishna Kumar2 wrote:
> Hi Ilpo,
>
> > It's almost impossible to know which of these is the main cause and the
> > first occuring due to reasons I'll not copy here. What a strange thing
> > that it has been super quiet on this front until now everybody is seeing
> > it, could there be something unrelated to TCP which has broken it all
> > recently?
>
> I have been getting this for atleast 3 weeks but I was quiet since those
> were kernels that I had modified.
Since you can easily reproduce it, lets just figure out what's causing it
hard way, rather than digging the endless git-logs... :-)
> > Good thing is that you seem to be able to reproduce it were nicely.
> > Please try with this beauty below... Hopefully got it correctly matching
> > to mainline, in contrast to version I sent Dave Y., there's some added
> > candy which catches highest_sack corruption as well, at least it compiles
>
> > already :-).
>
> There were couple of patch apply failures in .c files which I fixed by
> hand.
> But when compiling, I got these errors (I am using DM's 2.6.24-rc7 kernel,
> net-2.6.25.git):
Well, that's annoying, you didn't mention net-2.6.25 back then, it sure
is incompatible with it like already the patch title said... :-)
> net/ipv4/tcp_output.c: In function 'tcp_push_one':
> net/ipv4/tcp_output.c:1573: error: 'tp' undeclared (first use in this
> function)
> net/ipv4/tcp_output.c:1573: error: (Each undeclared identifier is reported
> only once
> net/ipv4/tcp_output.c:1573: error: for each function it appears in.)
...This is either due to mismerge or due your modifications.
Lets re-iterate, compiled ok for me tcp_{ipv4,input,output}.o...
--
i.
[PATCH] [TCP]: debug S+L (for net-2.5.26 / mm, incompatible with mainline)
---
include/net/tcp.h | 8 +++-
net/ipv4/tcp_input.c | 10 +++++
net/ipv4/tcp_ipv4.c | 107 +++++++++++++++++++++++++++++++++++++++++++++++++
net/ipv4/tcp_output.c | 21 +++++++---
4 files changed, 139 insertions(+), 7 deletions(-)
diff --git a/include/net/tcp.h b/include/net/tcp.h
index 7de4ea3..0685035 100644
--- a/include/net/tcp.h
+++ b/include/net/tcp.h
@@ -272,6 +272,8 @@ DECLARE_SNMP_STAT(struct tcp_mib, tcp_statistics);
#define TCP_ADD_STATS_BH(field, val) SNMP_ADD_STATS_BH(tcp_statistics, field, val)
#define TCP_ADD_STATS_USER(field, val) SNMP_ADD_STATS_USER(tcp_statistics, field, val)
+extern void tcp_verify_wq(struct sock *sk);
+
extern void tcp_v4_err(struct sk_buff *skb, u32);
extern void tcp_shutdown (struct sock *sk, int how);
@@ -768,7 +770,11 @@ static inline __u32 tcp_current_ssthresh(const struct sock *sk)
}
/* Use define here intentionally to get WARN_ON location shown at the caller */
-#define tcp_verify_left_out(tp) WARN_ON(tcp_left_out(tp) > tp->packets_out)
+#define tcp_verify_left_out(tp) \
+ do { \
+ WARN_ON(tcp_left_out(tp) > tp->packets_out); \
+ tcp_verify_wq((struct sock *)tp); \
+ } while(0)
extern void tcp_enter_cwr(struct sock *sk, const int set_ssthresh);
extern __u32 tcp_init_cwnd(struct tcp_sock *tp, struct dst_entry *dst);
diff --git a/net/ipv4/tcp_input.c b/net/ipv4/tcp_input.c
index fa2c85c..cdacf70 100644
--- a/net/ipv4/tcp_input.c
+++ b/net/ipv4/tcp_input.c
@@ -2645,6 +2645,10 @@ static void tcp_fastretrans_alert(struct sock *sk, int pkts_acked, int flag)
if (do_lost || (tcp_is_fack(tp) && tcp_head_timedout(sk)))
tcp_update_scoreboard(sk, fast_rexmit);
tcp_cwnd_down(sk, flag);
+
+ WARN_ON(tcp_write_queue_head(sk) == NULL);
+ WARN_ON(!tp->packets_out);
+
tcp_xmit_retransmit_queue(sk);
}
@@ -2848,6 +2852,8 @@ static int tcp_clean_rtx_queue(struct sock *sk, int prior_fackets)
tcp_clear_all_retrans_hints(tp);
}
+ tcp_verify_left_out(tp);
+
if (skb && (TCP_SKB_CB(skb)->sacked & TCPCB_SACKED_ACKED))
flag |= FLAG_SACK_RENEGING;
@@ -3175,6 +3181,8 @@ static int tcp_ack(struct sock *sk, struct sk_buff *skb, int flag)
prior_fackets = tp->fackets_out;
prior_in_flight = tcp_packets_in_flight(tp);
+ tcp_verify_left_out(tp);
+
if (!(flag & FLAG_SLOWPATH) && after(ack, prior_snd_una)) {
/* Window is constant, pure forward advance.
* No more checks are required.
@@ -3237,6 +3245,8 @@ static int tcp_ack(struct sock *sk, struct sk_buff *skb, int flag)
if ((flag & FLAG_FORWARD_PROGRESS) || !(flag & FLAG_NOT_DUP))
dst_confirm(sk->sk_dst_cache);
+ tcp_verify_left_out(tp);
+
return 1;
no_queue:
diff --git a/net/ipv4/tcp_ipv4.c b/net/ipv4/tcp_ipv4.c
index 9aea88b..c95682e 100644
--- a/net/ipv4/tcp_ipv4.c
+++ b/net/ipv4/tcp_ipv4.c
@@ -108,6 +108,113 @@ struct inet_hashinfo __cacheline_aligned tcp_hashinfo = {
.lhash_wait = __WAIT_QUEUE_HEAD_INITIALIZER(tcp_hashinfo.lhash_wait),
};
+void tcp_print_queue(struct sock *sk)
+{
+ struct tcp_sock *tp = tcp_sk(sk);
+ struct sk_buff *skb;
+ char s[50+1];
+ char h[50+1];
+ int idx = 0;
+ int i;
+
+ tcp_for_write_queue(skb, sk) {
+ if (skb == tcp_send_head(sk))
+ break;
+
+ for (i = 0; i < tcp_skb_pcount(skb); i++) {
+ if (TCP_SKB_CB(skb)->sacked & TCPCB_SACKED_ACKED) {
+ s[idx] = 'S';
+ if (TCP_SKB_CB(skb)->sacked & TCPCB_LOST)
+ s[idx] = 'B';
+
+ } else if (TCP_SKB_CB(skb)->sacked & TCPCB_LOST) {
+ s[idx] = 'L';
+ } else {
+ s[idx] = ' ';
+ }
+ if (s[idx] != ' ' && skb->len < tp->mss_cache)
+ s[idx] += 'a' - 'A';
+
+ if (i == 0) {
+ if (skb == tcp_highest_sack(sk))
+ h[idx] = 'h';
+ else
+ h[idx] = '+';
+ } else {
+ h[idx] = '-';
+ }
+
+ if (++idx >= 50) {
+ s[idx] = 0;
+ h[idx] = 0;
+ printk(KERN_ERR "TCP wq(s) %s\n", s);
+ printk(KERN_ERR "TCP wq(h) %s\n", h);
+ idx = 0;
+ }
+ }
+ }
+ if (idx) {
+ s[idx] = '<';
+ s[idx+1] = 0;
+ h[idx] = '<';
+ h[idx+1] = 0;
+ printk(KERN_ERR "TCP wq(s) %s\n", s);
+ printk(KERN_ERR "TCP wq(h) %s\n", h);
+ }
+ printk(KERN_ERR "l%u s%u f%u p%u seq: su%u hs%u sn%u\n",
+ tp->lost_out, tp->sacked_out, tp->fackets_out, tp->packets_out,
+ tp->snd_una, tcp_highest_sack_seq(tp), tp->snd_nxt);
+}
+
+void tcp_verify_wq(struct sock *sk)
+{
+ struct tcp_sock *tp = tcp_sk(sk);
+ u32 lost = 0;
+ u32 sacked = 0;
+ u32 packets = 0;
+ u32 fackets = 0;
+ struct sk_buff *skb;
+
+ tcp_for_write_queue(skb, sk) {
+ if (skb == tcp_send_head(sk))
+ break;
+
+ if (TCP_SKB_CB(skb)->sacked & TCPCB_SACKED_ACKED) {
+ sacked += tcp_skb_pcount(skb);
+ if (TCP_SKB_CB(skb)->sacked & TCPCB_LOST)
+ printk(KERN_ERR "Sacked bitmap S+L: %u %u-%u/%u\n",
+ TCP_SKB_CB(skb)->sacked,
+ TCP_SKB_CB(skb)->end_seq - tp->snd_una,
+ TCP_SKB_CB(skb)->seq - tp->snd_una,
+ tp->snd_una);
+ fackets = sacked;
+ }
+ if (TCP_SKB_CB(skb)->sacked & TCPCB_LOST)
+ lost += tcp_skb_pcount(skb);
+
+ packets += tcp_skb_pcount(skb);
+ }
+
+ WARN_ON(lost != tp->lost_out);
+ WARN_ON(tcp_is_sack(tp) && (sacked != tp->sacked_out));
+ WARN_ON(packets != tp->packets_out);
+ WARN_ON(fackets != tp->fackets_out);
+
+ if ((lost != tp->lost_out) ||
+ (tcp_is_sack(tp) && (sacked != tp->sacked_out)) ||
+ (packets != tp->packets_out) ||
+ (fackets != tp->fackets_out)) {
+ printk(KERN_ERR "P: %u L: %u vs %u S: %u vs %u F: %u vs %u w: %u-%u (%u)\n",
+ tp->packets_out,
+ lost, tp->lost_out,
+ sacked, tp->sacked_out,
+ fackets, tp->fackets_out,
+ tp->snd_una, tp->snd_nxt,
+ tp->rx_opt.sack_ok);
+ tcp_print_queue(sk);
+ }
+}
+
static int tcp_v4_get_port(struct sock *sk, unsigned short snum)
{
return inet_csk_get_port(&tcp_hashinfo, sk, snum,
diff --git a/net/ipv4/tcp_output.c b/net/ipv4/tcp_output.c
index 89f0188..648340f 100644
--- a/net/ipv4/tcp_output.c
+++ b/net/ipv4/tcp_output.c
@@ -779,10 +779,9 @@ int tcp_fragment(struct sock *sk, struct sk_buff *skb, u32 len,
tp->lost_out -= diff;
/* Adjust Reno SACK estimate. */
- if (tcp_is_reno(tp) && diff > 0) {
+ if (tcp_is_reno(tp) && diff > 0)
tcp_dec_pcount_approx_int(&tp->sacked_out, diff);
- tcp_verify_left_out(tp);
- }
+
tcp_adjust_fackets_out(sk, skb, diff);
}
@@ -790,6 +789,8 @@ int tcp_fragment(struct sock *sk, struct sk_buff *skb, u32 len,
skb_header_release(buff);
tcp_insert_write_queue_after(skb, buff, sk);
+ tcp_verify_left_out(tp);
+
return 0;
}
@@ -1463,6 +1464,7 @@ static int tcp_write_xmit(struct sock *sk, unsigned int mss_now, int nonagle)
} else if (result > 0) {
sent_pkts = 1;
}
+ tcp_verify_left_out(tp);
while ((skb = tcp_send_head(sk))) {
unsigned int limit;
@@ -1764,6 +1766,7 @@ static void tcp_retrans_try_collapse(struct sock *sk, struct sk_buff *skb,
tcp_clear_retrans_hints_partial(tp);
sk_wmem_free_skb(sk, next_skb);
+ tcp_verify_left_out(tp);
}
/* Do a simple retransmit without using the backoff mechanisms in
@@ -1795,13 +1798,13 @@ void tcp_simple_retransmit(struct sock *sk)
}
}
+ tcp_verify_left_out(tp);
+
tcp_clear_all_retrans_hints(tp);
if (!lost)
return;
- tcp_verify_left_out(tp);
-
/* Don't muck with the congestion window here.
* Reason is that we do not increase amount of _data_
* in network, but units changed and effective
@@ -1970,8 +1973,10 @@ void tcp_xmit_retransmit_queue(struct sock *sk)
* packet to be MSS sized and all the
* packet counting works out.
*/
- if (tcp_packets_in_flight(tp) >= tp->snd_cwnd)
+ if (tcp_packets_in_flight(tp) >= tp->snd_cwnd) {
+ tcp_verify_left_out(tp);
return;
+ }
if (sacked & TCPCB_LOST) {
if (!(sacked & (TCPCB_SACKED_ACKED|TCPCB_SACKED_RETRANS))) {
@@ -1997,6 +2002,8 @@ void tcp_xmit_retransmit_queue(struct sock *sk)
}
}
+ tcp_verify_left_out(tp);
+
/* OK, demanded retransmission is finished. */
/* Forward retransmissions are possible only during Recovery. */
@@ -2054,6 +2061,8 @@ void tcp_xmit_retransmit_queue(struct sock *sk)
NET_INC_STATS_BH(LINUX_MIB_TCPFORWARDRETRANS);
}
+
+ tcp_verify_left_out(tp);
}
/* Send a fin. The caller locks the socket for us. This cannot be
--
1.5.2.2
^ permalink raw reply related
* Re: [PATCH] pci-skeleton: Misc fixes to build neatly
From: Jeff Garzik @ 2008-01-23 9:59 UTC (permalink / raw)
To: Jike Song; +Cc: netdev, linux-kernel
In-Reply-To: <df9815e70801212216v79ff8137kccc6a94ddb96c818@mail.gmail.com>
Jike Song wrote:
> Hello Jeff,
>
> The pci-skeleton.c has several problems with compilation, such as missing args
> when calling synchronize_irq(). Fix it.
>
> Signed-off-by: Jike Song <albcamus@gmail.com>
> ---
> drivers/net/pci-skeleton.c | 49 ++++++++++++++++++++++---------------------
> 1 files changed, 25 insertions(+), 24 deletions(-)
ACK but git-am (everybody's patch import tool) says the patch is corrupted
^ permalink raw reply
* [git patches] net driver fixes
From: Jeff Garzik @ 2008-01-23 10:05 UTC (permalink / raw)
To: David Miller; +Cc: netdev
Francois noted that these warranted promotion from net-2.6.25.git to
current 2.6.24-rc.
NOTE: These changesets were cherry-picked from net-2.6.25, without any
modifications. Any future rebase or merge should hopefully notice this
automatically.
Please pull from 'upstream-davem' branch of
master.kernel.org:/pub/scm/linux/kernel/git/jgarzik/netdev-2.6.git upstream-davem
to receive the following updates:
drivers/net/sis190.c | 21 ++++++++++-----------
1 files changed, 10 insertions(+), 11 deletions(-)
Francois Romieu (4):
sis190: add cmos ram access code for the SiS19x/968 chipset pair
sis190: remove duplicate INIT_WORK
sis190: mdio operation failure is not correctly detected
sis190: scheduling while atomic error
diff --git a/drivers/net/sis190.c b/drivers/net/sis190.c
index 7eab072..b570402 100644
--- a/drivers/net/sis190.c
+++ b/drivers/net/sis190.c
@@ -372,7 +372,7 @@ static void __mdio_cmd(void __iomem *ioaddr, u32 ctl)
msleep(1);
}
- if (i > 999)
+ if (i > 99)
printk(KERN_ERR PFX "PHY command failed !\n");
}
@@ -847,10 +847,8 @@ static void sis190_soft_reset(void __iomem *ioaddr)
{
SIS_W32(IntrControl, 0x8000);
SIS_PCI_COMMIT();
- msleep(1);
SIS_W32(IntrControl, 0x0);
sis190_asic_down(ioaddr);
- msleep(1);
}
static void sis190_hw_start(struct net_device *dev)
@@ -1041,8 +1039,6 @@ static int sis190_open(struct net_device *dev)
if (rc < 0)
goto err_free_rx_1;
- INIT_WORK(&tp->phy_task, sis190_phy_task);
-
sis190_request_timer(dev);
rc = request_irq(dev->irq, sis190_interrupt, IRQF_SHARED, dev->name, dev);
@@ -1549,28 +1545,31 @@ static int __devinit sis190_get_mac_addr_from_eeprom(struct pci_dev *pdev,
}
/**
- * sis190_get_mac_addr_from_apc - Get MAC address for SiS965 model
+ * sis190_get_mac_addr_from_apc - Get MAC address for SiS96x model
* @pdev: PCI device
* @dev: network device to get address for
*
- * SiS965 model, use APC CMOS RAM to store MAC address.
+ * SiS96x model, use APC CMOS RAM to store MAC address.
* APC CMOS RAM is accessed through ISA bridge.
* MAC address is read into @net_dev->dev_addr.
*/
static int __devinit sis190_get_mac_addr_from_apc(struct pci_dev *pdev,
struct net_device *dev)
{
+ static const u16 __devinitdata ids[] = { 0x0965, 0x0966, 0x0968 };
struct sis190_private *tp = netdev_priv(dev);
struct pci_dev *isa_bridge;
u8 reg, tmp8;
- int i;
+ unsigned int i;
net_probe(tp, KERN_INFO "%s: Read MAC address from APC.\n",
pci_name(pdev));
- isa_bridge = pci_get_device(PCI_VENDOR_ID_SI, 0x0965, NULL);
- if (!isa_bridge)
- isa_bridge = pci_get_device(PCI_VENDOR_ID_SI, 0x0966, NULL);
+ for (i = 0; i < ARRAY_SIZE(ids); i++) {
+ isa_bridge = pci_get_device(PCI_VENDOR_ID_SI, ids[i], NULL);
+ if (isa_bridge)
+ break;
+ }
if (!isa_bridge) {
net_probe(tp, KERN_INFO "%s: Can not find ISA bridge.\n",
^ permalink raw reply related
* Re: [PATCH] pci-skeleton: Misc fixes to build neatly
From: Jike Song @ 2008-01-23 10:16 UTC (permalink / raw)
To: Jeff Garzik; +Cc: netdev, linux-kernel
In-Reply-To: <47970FF9.7010009@garzik.org>
On 1/23/08, Jeff Garzik <jeff@garzik.org> wrote:
>
> ACK but git-am (everybody's patch import tool) says the patch is corrupted
>
Hi Jeff,
Thank you very much for your acknowledgement! This is my first patch
for Linux kernel, sorry for the corruption. I'll resend it ASAP.
Regards,
Jike
^ permalink raw reply
* Re: Assertions in latest kernels
From: Krishna Kumar2 @ 2008-01-23 10:38 UTC (permalink / raw)
To: Ilpo Järvinen; +Cc: David Miller, Netdev
In-Reply-To: <Pine.LNX.4.64.0801231140120.31652@kivilampi-30.cs.helsinki.fi>
ilpo.jarvinen@helsinki.fi wrote on 01/23/2008 03:23:24 PM:
> > There were couple of patch apply failures in .c files which I fixed by
> > hand.
> > But when compiling, I got these errors (I am using DM's 2.6.24-rc7
kernel,
> > net-2.6.25.git):
>
> Well, that's annoying, you didn't mention net-2.6.25 back then, it sure
> is incompatible with it like already the patch title said... :-)
I did mention that in my first mail:
"Bits are unmodified 2.6.24-rc7 bits downloaded today (Jan 23rd)".
I tried it hoping it would not change a lot, but it didn't work
obviously :)
> ...This is either due to mismerge or due your modifications.
Again, it was due to wrong patch bits (to reiterate, I am using
unmodified bits without any modifications), but let's move ahead.
Your patch in this mail applied cleanly for me, and I am compiling
now.
- KK
^ permalink raw reply
* Re: Assertions in latest kernels
From: Ilpo Järvinen @ 2008-01-23 10:49 UTC (permalink / raw)
To: David Miller; +Cc: Krishna Kumar2, Netdev
In-Reply-To: <Pine.LNX.4.64.0801231140120.31652@kivilampi-30.cs.helsinki.fi>
[-- Attachment #1: Type: TEXT/PLAIN, Size: 2953 bytes --]
On Wed, 23 Jan 2008, Ilpo Järvinen wrote:
> On Wed, 23 Jan 2008, Krishna Kumar2 wrote:
>
> > Hi Ilpo,
> >
> > > It's almost impossible to know which of these is the main cause and the
> > > first occuring due to reasons I'll not copy here. What a strange thing
> > > that it has been super quiet on this front until now everybody is seeing
> > > it, could there be something unrelated to TCP which has broken it all
> > > recently?
> >
> > I have been getting this for atleast 3 weeks but I was quiet since those
> > were kernels that I had modified.
>
> Since you can easily reproduce it, lets just figure out what's causing it
> hard way, rather than digging the endless git-logs... :-)
Hmm, perhaps it could be something related to this (and some untested
path somewhere which is now exposed):
commit 4a55b553f691abadaa63570dfc714e20913561c1
Author: Ilpo Järvinen <ilpo.jarvinen@helsinki.fi>
Date: Thu Dec 20 20:36:03 2007 -0800
[TCP]: Fix TSO deferring
Dave, what do you think? Wouldn't explain the one -rc only report though
from Denys. Another one I'm a bit unsure of is this:
commit 757c32944b80fd95542bd66f06032ab773034d53
Author: Ilpo Järvinen <ilpo.jarvinen@helsinki.fi>
Date: Thu Jan 3 20:39:01 2008 -0800
[TCP]: Perform setting of common control fields in one place
->sacked field is cleared in tcp_retransmit_skb due to a subtle change,
which might be buggy.... However, I find it rather unlikely that this
would explain Kumar's case. Anyway, here's the one that reverts the
problematic part of it. ...and this is net-2.6.25 as well so it won't
solve Denys' case either.
--
i.
--
[PATCH] [TCP]: Revert part of "[TCP]: Perform setting of common control..."
This commit reverts part of 757c32944b80fd95542bd66f06032ab773034d53
([TCP]: Perform setting of common control fields in one place)
because it's not valid to clear ->sacked field like that without
additional precautions with counters, mostly lost_out, sacked_out
should not be set due to reneging which kicks in much earlier than
this.
Signed-off-by: Ilpo Järvinen <ilpo.jarvinen@helsinki.fi>
---
net/ipv4/tcp_output.c | 8 +++++---
1 files changed, 5 insertions(+), 3 deletions(-)
diff --git a/net/ipv4/tcp_output.c b/net/ipv4/tcp_output.c
index 648340f..f6cbc1f 100644
--- a/net/ipv4/tcp_output.c
+++ b/net/ipv4/tcp_output.c
@@ -1887,10 +1887,12 @@ int tcp_retransmit_skb(struct sock *sk, struct sk_buff *skb)
(TCP_SKB_CB(skb)->flags & TCPCB_FLAG_FIN) &&
tp->snd_una == (TCP_SKB_CB(skb)->end_seq - 1)) {
if (!pskb_trim(skb, 0)) {
- /* Reuse, even though it does some unnecessary work */
- tcp_init_nondata_skb(skb, TCP_SKB_CB(skb)->end_seq - 1,
- TCP_SKB_CB(skb)->flags);
+ TCP_SKB_CB(skb)->seq = TCP_SKB_CB(skb)->end_seq - 1;
+ skb_shinfo(skb)->gso_segs = 1;
+ skb_shinfo(skb)->gso_size = 0;
+ skb_shinfo(skb)->gso_type = 0;
skb->ip_summed = CHECKSUM_NONE;
+ skb->csum = 0;
}
}
--
1.5.2.2
^ permalink raw reply related
* Re: 2.6.24-rc8 ppp regression
From: Ben Hutchings @ 2008-01-23 10:53 UTC (permalink / raw)
To: maximilian attems; +Cc: netdev
In-Reply-To: <20080123093509.GA4718@stro.at>
maximilian attems wrote:
>
> when killing a wvdial usb modem session:
>
> Jan 22 23:23:03 dual pppd[7941]: Terminating on signal 15
> Jan 22 23:23:03 dual pppd[7941]: Connect time 92.2 minutes.
> Jan 22 23:23:03 dual pppd[7941]: Sent 1322316 bytes, received 8587156 bytes.
> Jan 22 23:23:03 dual pppd[7941]: Connection terminated.
> Jan 22 23:23:05 dual kernel: usb 3-2: USB disconnect, address 5
> Jan 22 23:23:05 dual kernel: option 3-2:1.0: device disconnected
> Jan 22 23:23:05 dual kernel: option1 ttyUSB1: GSM modem (1-port) converter now disconnected from ttyUSB1
> Jan 22 23:23:05 dual kernel: option 3-2:1.1: device disconnected
> Jan 22 23:23:13 dual kernel: unregister_netdevice: waiting for ppp0 to become free. Usage count = 1
> Jan 22 23:23:44 dual last message repeated 3 times
> Jan 22 23:23:54 dual kernel: unregister_netdevice: waiting for ppp0 to become free. Usage count = 1
This is a known bug which doesn't just affect PPP:
<http://bugzilla.kernel.org/show_bug.cgi?id=9778>.
Ben.
--
Ben Hutchings, Senior Software Engineer, Solarflare Communications
Not speaking for my employer; that's the marketing department's job.
^ permalink raw reply
* Re: Assertions in latest kernels
From: David Miller @ 2008-01-23 10:57 UTC (permalink / raw)
To: ilpo.jarvinen; +Cc: krkumar2, netdev
In-Reply-To: <Pine.LNX.4.64.0801231043220.31652@kivilampi-30.cs.helsinki.fi>
From: "Ilpo_Järvinen" <ilpo.jarvinen@helsinki.fi>
Date: Wed, 23 Jan 2008 11:17:05 +0200 (EET)
> What a strange thing that it has been super quiet on this front
> until now everybody is seeing it, could there be something unrelated
> to TCP which has broken it all recently?
I think it is simply "capture effect".
One person reports the problem, and then others see it and
say "me too" because they were previously too busy to report
their instance of the problem.
Another thing is that a developer is sometimes working on something
and they do not want to pollute the bug reporting if the code they are
writing is what is causing the bug via some indirect corruptions or
whatever :-)
^ permalink raw reply
* Re: [PATCH 2.6.25 1/1]S2io: Multiqueue network device support implementation
From: Andi Kleen @ 2008-01-23 10:58 UTC (permalink / raw)
To: Sreenivasa Honnur; +Cc: netdev, jeff, support
In-Reply-To: <Pine.GSO.4.10.10801221942530.24414-100000@guinness>
Sreenivasa Honnur <Sreenivasa.Honnur@neterion.com> writes:
> Multiqueue netwrok device support implementation.
> - Added a loadable parameter "multiq" to enable/disable multiqueue support,
> by default it is disabled.
> - skb->queue_mapping is not used for queue/fifo selection. FIFO iselection is
> based on IP-TOS value, 0x0-0xF TOS values are mapped to 8 FIFOs.
Standard way to use that would be using skb->priority
But I'm surprised you bother with TOS for multi queues at all. TOS
isn't a too important mechanism.
I would have thought the primary use case would be per CPU TX completion
interrupts. With that the queue should be selected based on
the the current CPU.
-Andi
^ permalink raw reply
* Re: 2.6.24-rc8 ppp regression
From: David Miller @ 2008-01-23 10:58 UTC (permalink / raw)
To: max; +Cc: netdev
In-Reply-To: <20080123093509.GA4718@stro.at>
From: maximilian attems <max@stro.at>
Date: Wed, 23 Jan 2008 10:35:09 +0100
> Jan 22 23:23:54 dual kernel: unregister_netdevice: waiting for ppp0 to become free. Usage count = 1
Already fixed by:
[NEIGH]: Revert 'Fix race between neigh_parms_release and neightbl_fill_parms'
Commit 9cd40029423701c376391da59d2c6469672b4bed (Fix race between
neigh_parms_release and neightbl_fill_parms) introduced device
reference counting regressions for several people, see:
http://bugzilla.kernel.org/show_bug.cgi?id=9778
for example.
Signed-off-by: David S. Miller <davem@davemloft.net>
diff --git a/net/core/neighbour.c b/net/core/neighbour.c
index cc8a2f1..29b8ee4 100644
--- a/net/core/neighbour.c
+++ b/net/core/neighbour.c
@@ -1316,6 +1316,8 @@ void neigh_parms_release(struct neigh_table *tbl, struct neigh_parms *parms)
*p = parms->next;
parms->dead = 1;
write_unlock_bh(&tbl->lock);
+ if (parms->dev)
+ dev_put(parms->dev);
call_rcu(&parms->rcu_head, neigh_rcu_free_parms);
return;
}
@@ -1326,8 +1328,6 @@ void neigh_parms_release(struct neigh_table *tbl, struct neigh_parms *parms)
void neigh_parms_destroy(struct neigh_parms *parms)
{
- if (parms->dev)
- dev_put(parms->dev);
kfree(parms);
}
^ permalink raw reply related
* Re: [git patches] net driver fixes
From: David Miller @ 2008-01-23 11:01 UTC (permalink / raw)
To: jeff; +Cc: netdev
In-Reply-To: <20080123100518.GA12590@havoc.gtf.org>
From: Jeff Garzik <jeff@garzik.org>
Date: Wed, 23 Jan 2008 05:05:18 -0500
> master.kernel.org:/pub/scm/linux/kernel/git/jgarzik/netdev-2.6.git upstream-davem
Pulled into net-2.6, thanks Jeff.
^ permalink raw reply
* Re: 2.6.24-rc8-mm1 : net tcp_input.c warnings
From: Ilpo Järvinen @ 2008-01-23 11:01 UTC (permalink / raw)
To: Dave Young; +Cc: LKML, Netdev, Andrew Morton
In-Reply-To: <Pine.LNX.4.64.0801231034300.31652@kivilampi-30.cs.helsinki.fi>
[-- Attachment #1: Type: TEXT/PLAIN, Size: 1471 bytes --]
On Wed, 23 Jan 2008, Ilpo Järvinen wrote:
> On Wed, 23 Jan 2008, Dave Young wrote:
>
> > On Jan 23, 2008 3:41 PM, Ilpo Järvinen <ilpo.jarvinen@helsinki.fi> wrote:
> > >
> > > On Tue, 22 Jan 2008, David Miller wrote:
> > >
> > > > From: "Dave Young" <hidave.darkstar@gmail.com>
> > > > Date: Wed, 23 Jan 2008 09:44:30 +0800
> > > >
> > > > > On Jan 22, 2008 6:47 PM, Ilpo Järvinen <ilpo.jarvinen@helsinki.fi> wrote:
> > > > > > [PATCH] [TCP]: debug S+L
> > > > >
> > > > > Thanks, If there's new findings I will let you know.
> > > >
> > > > Thanks for helping with this bug Dave.
> > >
> > > I noticed btw that there thing might (is likely to) spuriously trigger at
> > > WARN_ON(sacked != tp->sacked_out); because those won't be equal when SACK
> > > is not enabled. If that does happen too often, I send a fixed patch for
> > > it, yet, the fact that I print print tp->rx_opt.sack_ok allows
> > > identification of those cases already as it's zero when SACK is not
> > > enabled.
> > >
> > > Just ask if you need the updated debug patch.
> >
> > Thanks, please send, I would like to get it.
>
> There you go. I fixed non-SACK case by adding tcp_is_sack checks there and
> also added two verifys to tcp_ack to see if there's corruption outside of
> TCP.
There's some discussion about a problem that is very likely the same as in
here (sorry for not remembering to cc you in there due to rapid progress):
http://marc.info/?t=120107174200003&r=1&w=2
--
i.
^ permalink raw reply
* Re: 2.6.24-rc8 ppp regression
From: maximilian attems @ 2008-01-23 11:02 UTC (permalink / raw)
To: David Miller; +Cc: netdev, Ben Hutchings
In-Reply-To: <20080123.025854.07563459.davem@davemloft.net>
On Wed, Jan 23, 2008 at 02:58:54AM -0800, David Miller wrote:
> From: maximilian attems <max@stro.at>
> Date: Wed, 23 Jan 2008 10:35:09 +0100
>
> > Jan 22 23:23:54 dual kernel: unregister_netdevice: waiting for ppp0 to become free. Usage count = 1
>
> Already fixed by:
>
thanks.
--
maks
^ permalink raw reply
* Re: Assertions in latest kernels
From: Krishna Kumar2 @ 2008-01-23 11:02 UTC (permalink / raw)
To: Ilpo Järvinen; +Cc: David Miller, Netdev
In-Reply-To: <Pine.LNX.4.64.0801231140120.31652@kivilampi-30.cs.helsinki.fi>
While running with this patch, I got these errors (pasted at the end
of this mail).
The list of unique errors are:
net/ipv4/tcp_input.c:1767
net/ipv4/tcp_input.c:2169
net/ipv4/tcp_input.c:2855
net/ipv4/tcp_input.c:3184
net/ipv4/tcp_input.c:3248
net/ipv4/tcp_output.c:1467
net/ipv4/tcp_output.c:1977
Thanks,
- KK
Jan 23 02:50:59 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:50:59 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 23 02:50:59 elm3b39 kernel: NIP: c00000000039ec58 LR: c00000000039ecd0 CTR: c0000000003d8680
Jan 23 02:50:59 elm3b39 kernel: REGS: c0000000cbffe700 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:50:59 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24044424 XER: 00000020
Jan 23 02:50:59 elm3b39 kernel: TASK = c0000000ce1d3660[4821] 'iperf' THREAD: c0000000cbffc000 CPU: 0
Jan 23 02:50:59 elm3b39 kernel: GPR00: 0000000000000001 c0000000cbffe980 c0000000005fa880 c0000000ce520180
Jan 23 02:50:59 elm3b39 kernel: GPR04: c0000000c77f2380 0000000000000001 c0000000003d8680 0001271dd0770000
Jan 23 02:50:59 elm3b39 kernel: GPR08: c00000000061ff78 0000000000000008 0000000000000100 0000000000000005
Jan 23 02:50:59 elm3b39 kernel: GPR12: 0000000024042422 c000000000556700 0000000000000000 0000000000012723
Jan 23 02:50:59 elm3b39 kernel: GPR16: 0000000000000005 c0000000ce520248 00000000745afc5e 0000000000000001
Jan 23 02:50:59 elm3b39 kernel: GPR20: ffffffffffffffff ffffffffffffffff 0000000000000000 0000000000000001
Jan 23 02:50:59 elm3b39 kernel: GPR24: 0000000000000000 0000000000000001 0000000000000001 c0000000ce520248
Jan 23 02:50:59 elm3b39 kernel: GPR28: 0000000000000000 c0000000ce520180 c0000000005c2e68 c0000000c7084700
Jan 23 02:50:59 elm3b39 kernel: NIP [c00000000039ec58] .tcp_mark_head_lost+0x128/0x1e0
Jan 23 02:50:59 elm3b39 kernel: LR [c00000000039ecd0] .tcp_mark_head_lost+0x1a0/0x1e0
Jan 23 02:50:59 elm3b39 kernel: Call Trace:
Jan 23 02:50:59 elm3b39 kernel: [c0000000cbffe980] [c0000000005c2e68] 0xc0000000005c2e68 (unreliable)
Jan 23 02:50:59 elm3b39 kernel: [c0000000cbffea30] [c0000000003a18a0] .tcp_ack+0x1a70/0x20d0
Jan 23 02:50:59 elm3b39 kernel: [c0000000cbffeb90] [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:50:59 elm3b39 kernel: [c0000000cbffec40] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:50:59 elm3b39 kernel: [c0000000cbffed00] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:50:59 elm3b39 kernel: [c0000000cbffedc0] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:50:59 elm3b39 kernel: [c0000000cbffee50] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:50:59 elm3b39 kernel: [c0000000cbffef20] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:50:59 elm3b39 kernel: [c0000000cbfff000] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff110] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff1c0] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff280] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff340] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff3c0] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff440] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff4c0] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:00 elm3b39 kernel: --- Exception: 501 at .__alloc_skb+0x108/0x190
Jan 23 02:51:00 elm3b39 kernel: LR = .__alloc_skb+0xa4/0x190
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff7b0] [c000000000352118] .__alloc_skb+0x88/0x190 (unreliable)
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff850] [c000000000399248] .sk_stream_alloc_skb+0x48/0x170
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff8e0] [c00000000039a914] .tcp_sendmsg+0x454/0xe90
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfffa10] [c0000000003475f4] .sock_aio_write+0x164/0x180
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfffb40] [c0000000000cf3b4] .do_sync_write+0xd4/0x170
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfffcf0] [c0000000000cfe34] .vfs_write+0x1c4/0x1d0
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfffd90] [c0000000000d07ec] .sys_write+0x4c/0x90
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfffe30] [c0000000000086ac] syscall_exit+0x0/0x40
Jan 23 02:51:00 elm3b39 kernel: Instruction dump:
Jan 23 02:51:00 elm3b39 kernel: 7fbfd800 419e0010 e81d01d8 7fa0f800 409eff78 801d055c 813d0558 817d046c
Jan 23 02:51:00 elm3b39 kernel: 7d290214 7f895840 7c000026 5400f7fe <0b000000> 7fa3eb78 48010391 60000000
Jan 23 02:51:00 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:00 elm3b39 kernel: Badness at net/ipv4/tcp_output.c:1977
Jan 23 02:51:00 elm3b39 kernel: NIP: c0000000003a9628 LR: c0000000003a155c CTR: c0000000003d8680
Jan 23 02:51:00 elm3b39 kernel: REGS: c0000000cbffe710 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:00 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24042424 XER: 00000020
Jan 23 02:51:00 elm3b39 kernel: TASK = c0000000ce1d3660[4821] 'iperf' THREAD: c0000000cbffc000 CPU: 0
Jan 23 02:51:00 elm3b39 kernel: GPR00: fffffffffffffffd c0000000cbffe990 c0000000005fa880 c0000000ce520180
Jan 23 02:51:00 elm3b39 kernel: GPR04: 0000000000000000 0000000000000003 0000000000000005 0000000000000005
Jan 23 02:51:00 elm3b39 kernel: GPR08: 0000000000000004 0000000000000001 0000000000000005 0000000000000003
Jan 23 02:51:00 elm3b39 kernel: GPR12: 0000000024042422 c000000000556700 0000000000000000 0000000000012723
Jan 23 02:51:00 elm3b39 kernel: GPR16: 0000000000000005 c0000000ce520248 00000000745afc5e 0000000000000001
Jan 23 02:51:00 elm3b39 kernel: GPR20: ffffffffffffffff ffffffffffffffff 0000000000000000 0000000000000001
Jan 23 02:51:00 elm3b39 kernel: GPR24: 0000000000000000 0000000024048422 c0000000ce520180 c0000000ce520248
Jan 23 02:51:00 elm3b39 kernel: GPR28: 0000000000000000 c0000000ce520180 c0000000005c2ff0 c0000000cb45eb00
Jan 23 02:51:00 elm3b39 kernel: NIP [c0000000003a9628] .tcp_xmit_retransmit_queue+0x408/0x500
Jan 23 02:51:00 elm3b39 kernel: LR [c0000000003a155c] .tcp_ack+0x172c/0x20d0
Jan 23 02:51:00 elm3b39 kernel: Call Trace:
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbffe990] [c0000000cbffea30] 0xc0000000cbffea30 (unreliable)
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbffea30] [c0000000003a155c] .tcp_ack+0x172c/0x20d0
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbffeb90] [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbffec40] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbffed00] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbffedc0] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbffee50] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbffef20] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff000] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff110] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff1c0] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff280] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff340] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff3c0] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff440] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff4c0] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:00 elm3b39 kernel: --- Exception: 501 at .__alloc_skb+0x108/0x190
Jan 23 02:51:00 elm3b39 kernel: LR = .__alloc_skb+0xa4/0x190
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff7b0] [c000000000352118] .__alloc_skb+0x88/0x190 (unreliable)
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff850] [c000000000399248] .sk_stream_alloc_skb+0x48/0x170
Jan 23 02:51:00 elm3b39 kernel: [c0000000cbfff8e0] [c00000000039a914] .tcp_sendmsg+0x454/0xe90
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbfffa10] [c0000000003475f4] .sock_aio_write+0x164/0x180
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbfffb40] [c0000000000cf3b4] .do_sync_write+0xd4/0x170
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbfffcf0] [c0000000000cfe34] .vfs_write+0x1c4/0x1d0
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbfffd90] [c0000000000d07ec] .sys_write+0x4c/0x90
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbfffe30] [c0000000000086ac] syscall_exit+0x0/0x40
Jan 23 02:51:01 elm3b39 kernel: Instruction dump:
Jan 23 02:51:01 elm3b39 kernel: 80bd055c 4bfffeac e80300c8 3b6300c8 3b800000 7fbb0000 419efc4c 7c1f0378
Jan 23 02:51:01 elm3b39 kernel: 4bfffc44 7f8a4840 7d200026 5529effe <0b090000> 7fa3eb78 480059c1 60000000
Jan 23 02:51:01 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:01 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:3248
Jan 23 02:51:01 elm3b39 kernel: NIP: c0000000003a0eec LR: c0000000003a155c CTR: c0000000003d8680
Jan 23 02:51:01 elm3b39 kernel: REGS: c0000000cbffe7b0 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:01 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24042424 XER: 00000020
Jan 23 02:51:01 elm3b39 kernel: TASK = c0000000ce1d3660[4821] 'iperf' THREAD: c0000000cbffc000 CPU: 0
Jan 23 02:51:01 elm3b39 kernel: GPR00: 0000000000000001 c0000000cbffea30 c0000000005fa880 c0000000ce520180
Jan 23 02:51:01 elm3b39 kernel: GPR04: 0000000000000005 c00000000060e400 0000000000000005 0000000000000005
Jan 23 02:51:01 elm3b39 kernel: GPR08: 0000000000000004 0000000000000008 0000000000000000 0000000000000005
Jan 23 02:51:01 elm3b39 kernel: GPR12: 0000000000000000 c000000000556700 0000000000000000 0000000000012723
Jan 23 02:51:01 elm3b39 kernel: GPR16: 0000000000000005 c0000000ce520248 00000000745afc5e 0000000000000001
Jan 23 02:51:01 elm3b39 kernel: GPR20: ffffffffffffffff ffffffffffffffff 0000000000000000 0000000000000001
Jan 23 02:51:01 elm3b39 kernel: GPR24: 0000000000000000 0000000024048422 c0000000ce520180 0000000024042428
Jan 23 02:51:01 elm3b39 kernel: GPR28: 0000000000000000 0000000000000005 c0000000005c2e68 0000000000000000
Jan 23 02:51:01 elm3b39 kernel: NIP [c0000000003a0eec] .tcp_ack+0x10bc/0x20d0
Jan 23 02:51:01 elm3b39 kernel: LR [c0000000003a155c] .tcp_ack+0x172c/0x20d0
Jan 23 02:51:01 elm3b39 kernel: Call Trace:
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbffea30] [c0000000003a155c] .tcp_ack+0x172c/0x20d0 (unreliable)
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbffeb90] [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbffec40] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbffed00] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbffedc0] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbffee50] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbffef20] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbfff000] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbfff110] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbfff1c0] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbfff280] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbfff340] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbfff3c0] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbfff440] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbfff4c0] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:01 elm3b39 kernel: --- Exception: 501 at .__alloc_skb+0x108/0x190
Jan 23 02:51:01 elm3b39 kernel: LR = .__alloc_skb+0xa4/0x190
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbfff7b0] [c000000000352118] .__alloc_skb+0x88/0x190 (unreliable)
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbfff850] [c000000000399248] .sk_stream_alloc_skb+0x48/0x170
Jan 23 02:51:01 elm3b39 kernel: [c0000000cbfff8e0] [c00000000039a914] .tcp_sendmsg+0x454/0xe90
Jan 23 02:51:02 elm3b39 kernel: [c0000000cbfffa10] [c0000000003475f4] .sock_aio_write+0x164/0x180
Jan 23 02:51:02 elm3b39 kernel: [c0000000cbfffb40] [c0000000000cf3b4] .do_sync_write+0xd4/0x170
Jan 23 02:51:02 elm3b39 kernel: [c0000000cbfffcf0] [c0000000000cfe34] .vfs_write+0x1c4/0x1d0
Jan 23 02:51:02 elm3b39 kernel: [c0000000cbfffd90] [c0000000000d07ec] .sys_write+0x4c/0x90
Jan 23 02:51:02 elm3b39 kernel: [c0000000cbfffe30] [c0000000000086ac] syscall_exit+0x0/0x40
Jan 23 02:51:02 elm3b39 kernel: Instruction dump:
Jan 23 02:51:02 elm3b39 kernel: 2fa90000 419e0010 e8be8020 e8050000 f8090028 801a055c 813a0558 817a046c
Jan 23 02:51:02 elm3b39 kernel: 7d290214 7f895840 7c000026 5400f7fe <0b000000> 7f43d378 4800e0fd 60000000
Jan 23 02:51:02 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:02 elm3b39 kernel: Badness at net/ipv4/tcp_output.c:1467
Jan 23 02:51:02 elm3b39 kernel: NIP: c0000000003a99e0 LR: c0000000003a5d80 CTR: c0000000003d8680
Jan 23 02:51:02 elm3b39 kernel: REGS: c0000000cbffe810 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:02 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24042444 XER: 20000020
Jan 23 02:51:02 elm3b39 kernel: TASK = c0000000ce1d3660[4821] 'iperf' THREAD: c0000000cbffc000 CPU: 0
Jan 23 02:51:02 elm3b39 kernel: GPR00: 0000000000000001 c0000000cbffea90 c0000000005fa880 c0000000ce520180
Jan 23 02:51:02 elm3b39 kernel: GPR04: 00000000000005a8 0000000000000001 0000000000000005 0000000000000005
Jan 23 02:51:02 elm3b39 kernel: GPR08: 0000000000000003 0000000000000008 0000000000000005 c0000000ce520180
Jan 23 02:51:02 elm3b39 kernel: GPR12: 0000000024042422 c000000000556700 0000000000000038 d000000000106000
Jan 23 02:51:02 elm3b39 kernel: GPR16: 00000000000006c0 0000000000000008 c0000000ccb95000 c0000000cc198cc0
Jan 23 02:51:02 elm3b39 kernel: GPR20: c0000000ccb95700 c0000000ce176800 c00000000061e980 c00000000061fdd8
Jan 23 02:51:02 elm3b39 kernel: GPR24: 0000000000000001 0000000000000020 0000000000000000 00000000000005a8
Jan 23 02:51:02 elm3b39 kernel: GPR28: c0000000cb883780 c0000000ce520180 c0000000005c2ff0 c0000000ce520180
Jan 23 02:51:02 elm3b39 kernel: NIP [c0000000003a99e0] .__tcp_push_pending_frames+0xa0/0xa20
Jan 23 02:51:02 elm3b39 kernel: LR [c0000000003a5d80] .tcp_rcv_established+0x350/0x8f0
Jan 23 02:51:02 elm3b39 kernel: Call Trace:
Jan 23 02:51:02 elm3b39 kernel: [c0000000cbffea90] [c0000000003a9b08] .__tcp_push_pending_frames+0x1c8/0xa20 (unreliable)
Jan 23 02:51:02 elm3b39 kernel: [c0000000cbffeb90] [c0000000003a5d80] .tcp_rcv_established+0x350/0x8f0
Jan 23 02:51:02 elm3b39 kernel: [c0000000cbffec40] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:02 elm3b39 kernel: [c0000000cbffed00] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:03 elm3b39 kernel: [c0000000cbffedc0] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:03 elm3b39 kernel: [c0000000cbffee50] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:03 elm3b39 kernel: [c0000000cbffef20] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:03 elm3b39 kernel: [c0000000cbfff000] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:03 elm3b39 kernel: [c0000000cbfff110] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:03 elm3b39 kernel: [c0000000cbfff1c0] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:03 elm3b39 kernel: [c0000000cbfff280] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:03 elm3b39 kernel: [c0000000cbfff340] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:03 elm3b39 kernel: [c0000000cbfff3c0] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:03 elm3b39 kernel: [c0000000cbfff440] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:03 elm3b39 kernel: [c0000000cbfff4c0] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:03 elm3b39 kernel: --- Exception: 501 at .__alloc_skb+0x108/0x190
Jan 23 02:51:03 elm3b39 kernel: LR = .__alloc_skb+0xa4/0x190
Jan 23 02:51:03 elm3b39 kernel: [c0000000cbfff7b0] [c000000000352118] .__alloc_skb+0x88/0x190 (unreliable)
Jan 23 02:51:03 elm3b39 kernel: [c0000000cbfff850] [c000000000399248] .sk_stream_alloc_skb+0x48/0x170
Jan 23 02:51:03 elm3b39 kernel: [c0000000cbfff8e0] [c00000000039a914] .tcp_sendmsg+0x454/0xe90
Jan 23 02:51:03 elm3b39 kernel: [c0000000cbfffa10] [c0000000003475f4] .sock_aio_write+0x164/0x180
Jan 23 02:51:03 elm3b39 kernel: [c0000000cbfffb40] [c0000000000cf3b4] .do_sync_write+0xd4/0x170
Jan 23 02:51:03 elm3b39 kernel: [c0000000cbfffcf0] [c0000000000cfe34] .vfs_write+0x1c4/0x1d0
Jan 23 02:51:03 elm3b39 kernel: [c0000000cbfffd90] [c0000000000d07ec] .sys_write+0x4c/0x90
Jan 23 02:51:03 elm3b39 kernel: [c0000000cbfffe30] [c0000000000086ac] syscall_exit+0x0/0x40
Jan 23 02:51:03 elm3b39 kernel: Instruction dump:
Jan 23 02:51:03 elm3b39 kernel: 419e0484 80030390 2f800000 409e0394 80fd046c 811d055c 815d0558 3b400000
Jan 23 02:51:03 elm3b39 kernel: 7d2a4214 7f893840 7c000026 5400f7fe <0b000000> 7fa3eb78 48005609 60000000
Jan 23 02:51:03 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:03 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 23 02:51:03 elm3b39 kernel: NIP: c00000000039ec58 LR: c00000000039ecd0 CTR: c0000000003d8680
Jan 23 02:51:03 elm3b39 kernel: REGS: c0000000cbffe700 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:03 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24044424 XER: 00000020
Jan 23 02:51:03 elm3b39 kernel: TASK = c0000000ce1d3660[4821] 'iperf' THREAD: c0000000cbffc000 CPU: 0
Jan 23 02:51:03 elm3b39 kernel: GPR00: 0000000000000001 c0000000cbffe980 c0000000005fa880 c0000000cca44700
Jan 23 02:51:03 elm3b39 kernel: GPR04: c0000000cbbe0a80 0000000000000001 c0000000003d8680 0001271dd0770000
Jan 23 02:51:04 elm3b39 kernel: GPR08: c00000000061ff78 0000000000000008 0000000000000100 0000000000000005
Jan 23 02:51:04 elm3b39 kernel: GPR12: 0000000024042422 c000000000556700 0000000000000000 0000000000012724
Jan 23 02:51:04 elm3b39 kernel: GPR16: 0000000000000005 c0000000cca447c8 0000000074cf85f7 0000000000000001
Jan 23 02:51:04 elm3b39 kernel: GPR20: ffffffffffffffff ffffffffffffffff 0000000000000000 0000000000000001
Jan 23 02:51:04 elm3b39 kernel: GPR24: 0000000000000000 0000000000000001 0000000000000001 c0000000cca447c8
Jan 23 02:51:04 elm3b39 kernel: GPR28: 0000000000000000 c0000000cca44700 c0000000005c2e68 c0000000c7120080
Jan 23 02:51:04 elm3b39 kernel: NIP [c00000000039ec58] .tcp_mark_head_lost+0x128/0x1e0
Jan 23 02:51:04 elm3b39 kernel: LR [c00000000039ecd0] .tcp_mark_head_lost+0x1a0/0x1e0
Jan 23 02:51:04 elm3b39 kernel: Call Trace:
Jan 23 02:51:04 elm3b39 kernel: [c0000000cbffe980] [c0000000005c2e68] 0xc0000000005c2e68 (unreliable)
Jan 23 02:51:04 elm3b39 kernel: [c0000000cbffea30] [c0000000003a18a0] .tcp_ack+0x1a70/0x20d0
Jan 23 02:51:04 elm3b39 kernel: [c0000000cbffeb90] [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:04 elm3b39 kernel: [c0000000cbffec40] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:04 elm3b39 kernel: [c0000000cbffed00] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:04 elm3b39 kernel: [c0000000cbffedc0] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:04 elm3b39 kernel: [c0000000cbffee50] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:04 elm3b39 kernel: [c0000000cbffef20] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:04 elm3b39 kernel: [c0000000cbfff000] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:04 elm3b39 kernel: [c0000000cbfff110] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:04 elm3b39 kernel: [c0000000cbfff1c0] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:04 elm3b39 kernel: [c0000000cbfff280] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:04 elm3b39 kernel: [c0000000cbfff340] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:04 elm3b39 kernel: [c0000000cbfff3c0] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:04 elm3b39 kernel: [c0000000cbfff440] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:04 elm3b39 kernel: [c0000000cbfff4c0] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:04 elm3b39 kernel: --- Exception: 501 at .__alloc_skb+0x108/0x190
Jan 23 02:51:04 elm3b39 kernel: LR = .__alloc_skb+0xa4/0x190
Jan 23 02:51:04 elm3b39 kernel: [c0000000cbfff7b0] [c000000000352118] .__alloc_skb+0x88/0x190 (unreliable)
Jan 23 02:51:04 elm3b39 kernel: [c0000000cbfff850] [c000000000399248] .sk_stream_alloc_skb+0x48/0x170
Jan 23 02:51:05 elm3b39 kernel: [c0000000cbfff8e0] [c00000000039a914] .tcp_sendmsg+0x454/0xe90
Jan 23 02:51:05 elm3b39 kernel: [c0000000cbfffa10] [c0000000003475f4] .sock_aio_write+0x164/0x180
Jan 23 02:51:05 elm3b39 kernel: [c0000000cbfffb40] [c0000000000cf3b4] .do_sync_write+0xd4/0x170
Jan 23 02:51:05 elm3b39 kernel: [c0000000cbfffcf0] [c0000000000cfe34] .vfs_write+0x1c4/0x1d0
Jan 23 02:51:05 elm3b39 kernel: [c0000000cbfffd90] [c0000000000d07ec] .sys_write+0x4c/0x90
Jan 23 02:51:05 elm3b39 kernel: [c0000000cbfffe30] [c0000000000086ac] syscall_exit+0x0/0x40
Jan 23 02:51:05 elm3b39 kernel: Instruction dump:
Jan 23 02:51:05 elm3b39 kernel: 7fbfd800 419e0010 e81d01d8 7fa0f800 409eff78 801d055c 813d0558 817d046c
Jan 23 02:51:05 elm3b39 kernel: 7d290214 7f895840 7c000026 5400f7fe <0b000000> 7fa3eb78 48010391 60000000
Jan 23 02:51:05 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:05 elm3b39 kernel: Badness at net/ipv4/tcp_output.c:1977
Jan 23 02:51:05 elm3b39 kernel: NIP: c0000000003a9628 LR: c0000000003a155c CTR: c0000000003d8680
Jan 23 02:51:05 elm3b39 kernel: REGS: c0000000cbffe710 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:05 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24042424 XER: 00000020
Jan 23 02:51:05 elm3b39 kernel: TASK = c0000000ce1d3660[4821] 'iperf' THREAD: c0000000cbffc000 CPU: 0
Jan 23 02:51:05 elm3b39 kernel: GPR00: fffffffffffffffd c0000000cbffe990 c0000000005fa880 c0000000cca44700
Jan 23 02:51:05 elm3b39 kernel: GPR04: 0000000000000000 0000000000000003 0000000000000005 0000000000000005
Jan 23 02:51:05 elm3b39 kernel: GPR08: 0000000000000004 0000000000000001 0000000000000005 0000000000000003
Jan 23 02:51:05 elm3b39 kernel: GPR12: 0000000024042422 c000000000556700 0000000000000000 0000000000012724
Jan 23 02:51:05 elm3b39 kernel: GPR16: 0000000000000005 c0000000cca447c8 0000000074cf85f7 0000000000000001
Jan 23 02:51:05 elm3b39 kernel: GPR20: ffffffffffffffff ffffffffffffffff 0000000000000000 0000000000000001
Jan 23 02:51:05 elm3b39 kernel: GPR24: 0000000000000000 0000000024048422 c0000000cca44700 c0000000cca447c8
Jan 23 02:51:05 elm3b39 kernel: GPR28: 0000000000000000 c0000000cca44700 c0000000005c2ff0 c0000000c73b3d00
Jan 23 02:51:05 elm3b39 kernel: NIP [c0000000003a9628] .tcp_xmit_retransmit_queue+0x408/0x500
Jan 23 02:51:05 elm3b39 kernel: LR [c0000000003a155c] .tcp_ack+0x172c/0x20d0
Jan 23 02:51:05 elm3b39 kernel: Call Trace:
Jan 23 02:51:05 elm3b39 kernel: [c0000000cbffe990] [c0000000cbffea30] 0xc0000000cbffea30 (unreliable)
Jan 23 02:51:05 elm3b39 kernel: [c0000000cbffea30] [c0000000003a155c] .tcp_ack+0x172c/0x20d0
Jan 23 02:51:05 elm3b39 kernel: [c0000000cbffeb90] [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:05 elm3b39 kernel: [c0000000cbffec40] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:05 elm3b39 kernel: [c0000000cbffed00] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbffedc0] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbffee50] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbffef20] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbfff000] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbfff110] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbfff1c0] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbfff280] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbfff340] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbfff3c0] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbfff440] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbfff4c0] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:06 elm3b39 kernel: --- Exception: 501 at .__alloc_skb+0x108/0x190
Jan 23 02:51:06 elm3b39 kernel: LR = .__alloc_skb+0xa4/0x190
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbfff7b0] [c000000000352118] .__alloc_skb+0x88/0x190 (unreliable)
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbfff850] [c000000000399248] .sk_stream_alloc_skb+0x48/0x170
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbfff8e0] [c00000000039a914] .tcp_sendmsg+0x454/0xe90
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbfffa10] [c0000000003475f4] .sock_aio_write+0x164/0x180
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbfffb40] [c0000000000cf3b4] .do_sync_write+0xd4/0x170
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbfffcf0] [c0000000000cfe34] .vfs_write+0x1c4/0x1d0
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbfffd90] [c0000000000d07ec] .sys_write+0x4c/0x90
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbfffe30] [c0000000000086ac] syscall_exit+0x0/0x40
Jan 23 02:51:06 elm3b39 kernel: Instruction dump:
Jan 23 02:51:06 elm3b39 kernel: 80bd055c 4bfffeac e80300c8 3b6300c8 3b800000 7fbb0000 419efc4c 7c1f0378
Jan 23 02:51:06 elm3b39 kernel: 4bfffc44 7f8a4840 7d200026 5529effe <0b090000> 7fa3eb78 480059c1 60000000
Jan 23 02:51:06 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:06 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:3248
Jan 23 02:51:06 elm3b39 kernel: NIP: c0000000003a0eec LR: c0000000003a155c CTR: c0000000003d8680
Jan 23 02:51:06 elm3b39 kernel: REGS: c0000000cbffe7b0 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:06 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24042424 XER: 00000020
Jan 23 02:51:06 elm3b39 kernel: TASK = c0000000ce1d3660[4821] 'iperf' THREAD: c0000000cbffc000 CPU: 0
Jan 23 02:51:06 elm3b39 kernel: GPR00: 0000000000000001 c0000000cbffea30 c0000000005fa880 c0000000cca44700
Jan 23 02:51:06 elm3b39 kernel: GPR04: 0000000000000005 c00000000060e400 0000000000000005 0000000000000005
Jan 23 02:51:06 elm3b39 kernel: GPR08: 0000000000000004 0000000000000008 0000000000000000 0000000000000005
Jan 23 02:51:06 elm3b39 kernel: GPR12: 0000000000000000 c000000000556700 0000000000000000 0000000000012724
Jan 23 02:51:06 elm3b39 kernel: GPR16: 0000000000000005 c0000000cca447c8 0000000074cf85f7 0000000000000001
Jan 23 02:51:06 elm3b39 kernel: GPR20: ffffffffffffffff ffffffffffffffff 0000000000000000 0000000000000001
Jan 23 02:51:06 elm3b39 kernel: GPR24: 0000000000000000 0000000024048422 c0000000cca44700 0000000024042428
Jan 23 02:51:06 elm3b39 kernel: GPR28: 0000000000000000 0000000000000005 c0000000005c2e68 0000000000000000
Jan 23 02:51:06 elm3b39 kernel: NIP [c0000000003a0eec] .tcp_ack+0x10bc/0x20d0
Jan 23 02:51:06 elm3b39 kernel: LR [c0000000003a155c] .tcp_ack+0x172c/0x20d0
Jan 23 02:51:06 elm3b39 kernel: Call Trace:
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbffea30] [c0000000003a155c] .tcp_ack+0x172c/0x20d0 (unreliable)
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbffeb90] [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbffec40] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbffed00] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbffedc0] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbffee50] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:06 elm3b39 kernel: [c0000000cbffef20] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff000] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff110] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff1c0] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff280] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff340] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff3c0] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff440] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff4c0] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:07 elm3b39 kernel: --- Exception: 501 at .__alloc_skb+0x108/0x190
Jan 23 02:51:07 elm3b39 kernel: LR = .__alloc_skb+0xa4/0x190
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff7b0] [c000000000352118] .__alloc_skb+0x88/0x190 (unreliable)
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff850] [c000000000399248] .sk_stream_alloc_skb+0x48/0x170
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff8e0] [c00000000039a914] .tcp_sendmsg+0x454/0xe90
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfffa10] [c0000000003475f4] .sock_aio_write+0x164/0x180
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfffb40] [c0000000000cf3b4] .do_sync_write+0xd4/0x170
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfffcf0] [c0000000000cfe34] .vfs_write+0x1c4/0x1d0
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfffd90] [c0000000000d07ec] .sys_write+0x4c/0x90
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfffe30] [c0000000000086ac] syscall_exit+0x0/0x40
Jan 23 02:51:07 elm3b39 kernel: Instruction dump:
Jan 23 02:51:07 elm3b39 kernel: 2fa90000 419e0010 e8be8020 e8050000 f8090028 801a055c 813a0558 817a046c
Jan 23 02:51:07 elm3b39 kernel: 7d290214 7f895840 7c000026 5400f7fe <0b000000> 7f43d378 4800e0fd 60000000
Jan 23 02:51:07 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:07 elm3b39 kernel: Badness at net/ipv4/tcp_output.c:1467
Jan 23 02:51:07 elm3b39 kernel: NIP: c0000000003a99e0 LR: c0000000003a5d80 CTR: c0000000003d8680
Jan 23 02:51:07 elm3b39 kernel: REGS: c0000000cbffe810 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:07 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24042444 XER: 20000020
Jan 23 02:51:07 elm3b39 kernel: TASK = c0000000ce1d3660[4821] 'iperf' THREAD: c0000000cbffc000 CPU: 0
Jan 23 02:51:07 elm3b39 kernel: GPR00: 0000000000000001 c0000000cbffea90 c0000000005fa880 c0000000cca44700
Jan 23 02:51:07 elm3b39 kernel: GPR04: 00000000000005a8 0000000000000001 0000000000000005 0000000000000005
Jan 23 02:51:07 elm3b39 kernel: GPR08: 0000000000000003 0000000000000008 0000000000000005 c0000000cca44700
Jan 23 02:51:07 elm3b39 kernel: GPR12: 0000000024042422 c000000000556700 0000000000000023 d000000000106000
Jan 23 02:51:07 elm3b39 kernel: GPR16: 0000000000000c20 0000000000000003 c0000000ccb95000 c0000000cc198cc0
Jan 23 02:51:07 elm3b39 kernel: GPR20: c0000000ccb95700 c0000000ce176800 c00000000061e980 c00000000061fdd8
Jan 23 02:51:07 elm3b39 kernel: GPR24: 0000000000000001 0000000000000020 0000000000000000 00000000000005a8
Jan 23 02:51:07 elm3b39 kernel: GPR28: c0000000cb241180 c0000000cca44700 c0000000005c2ff0 c0000000cca44700
Jan 23 02:51:07 elm3b39 kernel: NIP [c0000000003a99e0] .__tcp_push_pending_frames+0xa0/0xa20
Jan 23 02:51:07 elm3b39 kernel: LR [c0000000003a5d80] .tcp_rcv_established+0x350/0x8f0
Jan 23 02:51:07 elm3b39 kernel: Call Trace:
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbffea90] [c00000000039877c] .tcp_done+0x8c/0x110 (unreliable)
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbffeb90] [c0000000003a5d80] .tcp_rcv_established+0x350/0x8f0
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbffec40] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbffed00] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbffedc0] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbffee50] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbffef20] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff000] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff110] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff1c0] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff280] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff340] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff3c0] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff440] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff4c0] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:07 elm3b39 kernel: --- Exception: 501 at .__alloc_skb+0x108/0x190
Jan 23 02:51:07 elm3b39 kernel: LR = .__alloc_skb+0xa4/0x190
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff7b0] [c000000000352118] .__alloc_skb+0x88/0x190 (unreliable)
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff850] [c000000000399248] .sk_stream_alloc_skb+0x48/0x170
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfff8e0] [c00000000039a914] .tcp_sendmsg+0x454/0xe90
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfffa10] [c0000000003475f4] .sock_aio_write+0x164/0x180
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfffb40] [c0000000000cf3b4] .do_sync_write+0xd4/0x170
Jan 23 02:51:07 elm3b39 kernel: [c0000000cbfffcf0] [c0000000000cfe34] .vfs_write+0x1c4/0x1d0
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbfffd90] [c0000000000d07ec] .sys_write+0x4c/0x90
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbfffe30] [c0000000000086ac] syscall_exit+0x0/0x40
Jan 23 02:51:08 elm3b39 kernel: Instruction dump:
Jan 23 02:51:08 elm3b39 kernel: 419e0484 80030390 2f800000 409e0394 80fd046c 811d055c 815d0558 3b400000
Jan 23 02:51:08 elm3b39 kernel: 7d2a4214 7f893840 7c000026 5400f7fe <0b000000> 7fa3eb78 48005609 60000000
Jan 23 02:51:08 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:08 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 23 02:51:08 elm3b39 kernel: NIP: c00000000039ec58 LR: c00000000039ecd0 CTR: c0000000003d8680
Jan 23 02:51:08 elm3b39 kernel: REGS: c0000000cbffe700 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:08 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24044424 XER: 00000020
Jan 23 02:51:08 elm3b39 kernel: TASK = c0000000ce1d3660[4821] 'iperf' THREAD: c0000000cbffc000 CPU: 0
Jan 23 02:51:08 elm3b39 kernel: GPR00: 0000000000000001 c0000000cbffe980 c0000000005fa880 c0000000ccd47900
Jan 23 02:51:08 elm3b39 kernel: GPR04: c0000000cbf94300 0000000000000001 c0000000003d8680 0001271dd0770000
Jan 23 02:51:08 elm3b39 kernel: GPR08: c00000000061ff78 0000000000000008 0000000000000100 0000000000000005
Jan 23 02:51:08 elm3b39 kernel: GPR12: 0000000024042422 c000000000556700 0000000000000000 000000000001272b
Jan 23 02:51:08 elm3b39 kernel: GPR16: 0000000000000005 c0000000ccd479c8 0000000074399665 0000000000000001
Jan 23 02:51:08 elm3b39 kernel: GPR20: ffffffffffffffff ffffffffffffffff 0000000000000000 0000000000000001
Jan 23 02:51:08 elm3b39 kernel: GPR24: 0000000000000000 0000000000000001 0000000000000001 c0000000ccd479c8
Jan 23 02:51:08 elm3b39 kernel: GPR28: 0000000000000000 c0000000ccd47900 c0000000005c2e68 c0000000cbb50580
Jan 23 02:51:08 elm3b39 kernel: NIP [c00000000039ec58] .tcp_mark_head_lost+0x128/0x1e0
Jan 23 02:51:08 elm3b39 kernel: LR [c00000000039ecd0] .tcp_mark_head_lost+0x1a0/0x1e0
Jan 23 02:51:08 elm3b39 kernel: Call Trace:
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbffe980] [c0000000005c2e68] 0xc0000000005c2e68 (unreliable)
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbffea30] [c0000000003a18a0] .tcp_ack+0x1a70/0x20d0
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbffeb90] [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbffec40] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbffed00] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbffedc0] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbffee50] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbffef20] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbfff000] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbfff110] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbfff1c0] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbfff280] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbfff340] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbfff3c0] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbfff440] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbfff4c0] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:08 elm3b39 kernel: --- Exception: 501 at .__alloc_skb+0x108/0x190
Jan 23 02:51:08 elm3b39 kernel: LR = .__alloc_skb+0xa4/0x190
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbfff7b0] [c000000000352118] .__alloc_skb+0x88/0x190 (unreliable)
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbfff850] [c000000000399248] .sk_stream_alloc_skb+0x48/0x170
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbfff8e0] [c00000000039a914] .tcp_sendmsg+0x454/0xe90
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbfffa10] [c0000000003475f4] .sock_aio_write+0x164/0x180
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbfffb40] [c0000000000cf3b4] .do_sync_write+0xd4/0x170
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbfffcf0] [c0000000000cfe34] .vfs_write+0x1c4/0x1d0
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbfffd90] [c0000000000d07ec] .sys_write+0x4c/0x90
Jan 23 02:51:08 elm3b39 kernel: [c0000000cbfffe30] [c0000000000086ac] syscall_exit+0x0/0x40
Jan 23 02:51:08 elm3b39 kernel: Instruction dump:
Jan 23 02:51:08 elm3b39 kernel: 7fbfd800 419e0010 e81d01d8 7fa0f800 409eff78 801d055c 813d0558 817d046c
Jan 23 02:51:08 elm3b39 kernel: 7d290214 7f895840 7c000026 5400f7fe <0b000000> 7fa3eb78 48010391 60000000
Jan 23 02:51:08 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:09 elm3b39 kernel: Badness at net/ipv4/tcp_output.c:1977
Jan 23 02:51:09 elm3b39 kernel: NIP: c0000000003a9628 LR: c0000000003a155c CTR: c0000000003d8680
Jan 23 02:51:09 elm3b39 kernel: REGS: c0000000cbffe710 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:09 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24042424 XER: 00000020
Jan 23 02:51:09 elm3b39 kernel: TASK = c0000000ce1d3660[4821] 'iperf' THREAD: c0000000cbffc000 CPU: 0
Jan 23 02:51:09 elm3b39 kernel: GPR00: fffffffffffffffd c0000000cbffe990 c0000000005fa880 c0000000ccd47900
Jan 23 02:51:09 elm3b39 kernel: GPR04: 0000000000000000 0000000000000003 0000000000000005 0000000000000005
Jan 23 02:51:09 elm3b39 kernel: GPR08: 0000000000000004 0000000000000001 0000000000000005 0000000000000003
Jan 23 02:51:09 elm3b39 kernel: GPR12: 0000000024042422 c000000000556700 0000000000000000 000000000001272b
Jan 23 02:51:09 elm3b39 kernel: GPR16: 0000000000000005 c0000000ccd479c8 0000000074399665 0000000000000001
Jan 23 02:51:09 elm3b39 kernel: GPR20: ffffffffffffffff ffffffffffffffff 0000000000000000 0000000000000001
Jan 23 02:51:09 elm3b39 kernel: GPR24: 0000000000000000 0000000024048422 c0000000ccd47900 c0000000ccd479c8
Jan 23 02:51:09 elm3b39 kernel: GPR28: 0000000000000000 c0000000ccd47900 c0000000005c2ff0 c0000000c73b3900
Jan 23 02:51:09 elm3b39 kernel: NIP [c0000000003a9628] .tcp_xmit_retransmit_queue+0x408/0x500
Jan 23 02:51:09 elm3b39 kernel: LR [c0000000003a155c] .tcp_ack+0x172c/0x20d0
Jan 23 02:51:09 elm3b39 kernel: Call Trace:
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbffe990] [c0000000cbffea30] 0xc0000000cbffea30 (unreliable)
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbffea30] [c0000000003a155c] .tcp_ack+0x172c/0x20d0
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbffeb90] [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbffec40] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbffed00] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbffedc0] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbffee50] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbffef20] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbfff000] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbfff110] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbfff1c0] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbfff280] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbfff340] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbfff3c0] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbfff440] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbfff4c0] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:09 elm3b39 kernel: --- Exception: 501 at .__alloc_skb+0x108/0x190
Jan 23 02:51:09 elm3b39 kernel: LR = .__alloc_skb+0xa4/0x190
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbfff7b0] [c000000000352118] .__alloc_skb+0x88/0x190 (unreliable)
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbfff850] [c000000000399248] .sk_stream_alloc_skb+0x48/0x170
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbfff8e0] [c00000000039a914] .tcp_sendmsg+0x454/0xe90
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbfffa10] [c0000000003475f4] .sock_aio_write+0x164/0x180
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbfffb40] [c0000000000cf3b4] .do_sync_write+0xd4/0x170
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbfffcf0] [c0000000000cfe34] .vfs_write+0x1c4/0x1d0
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbfffd90] [c0000000000d07ec] .sys_write+0x4c/0x90
Jan 23 02:51:09 elm3b39 kernel: [c0000000cbfffe30] [c0000000000086ac] syscall_exit+0x0/0x40
Jan 23 02:51:09 elm3b39 kernel: Instruction dump:
Jan 23 02:51:09 elm3b39 kernel: 80bd055c 4bfffeac e80300c8 3b6300c8 3b800000 7fbb0000 419efc4c 7c1f0378
Jan 23 02:51:09 elm3b39 kernel: 4bfffc44 7f8a4840 7d200026 5529effe <0b090000> 7fa3eb78 480059c1 60000000
Jan 23 02:51:09 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:09 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:3248
Jan 23 02:51:09 elm3b39 kernel: NIP: c0000000003a0eec LR: c0000000003a155c CTR: c0000000003d8680
Jan 23 02:51:09 elm3b39 kernel: REGS: c0000000cbffe7b0 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:09 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24042424 XER: 00000020
Jan 23 02:51:09 elm3b39 kernel: TASK = c0000000ce1d3660[4821] 'iperf' THREAD: c0000000cbffc000 CPU: 0
Jan 23 02:51:09 elm3b39 kernel: GPR00: 0000000000000001 c0000000cbffea30 c0000000005fa880 c0000000ccd47900
Jan 23 02:51:09 elm3b39 kernel: GPR04: 0000000000000005 c00000000060e400 0000000000000005 0000000000000005
Jan 23 02:51:09 elm3b39 kernel: GPR08: 0000000000000004 0000000000000008 0000000000000000 0000000000000005
Jan 23 02:51:09 elm3b39 kernel: GPR12: 0000000000000000 c000000000556700 0000000000000000 000000000001272b
Jan 23 02:51:09 elm3b39 kernel: GPR16: 0000000000000005 c0000000ccd479c8 0000000074399665 0000000000000001
Jan 23 02:51:09 elm3b39 kernel: GPR20: ffffffffffffffff ffffffffffffffff 0000000000000000 0000000000000001
Jan 23 02:51:09 elm3b39 kernel: GPR24: 0000000000000000 0000000024048422 c0000000ccd47900 0000000024042428
Jan 23 02:51:09 elm3b39 kernel: GPR28: 0000000000000000 0000000000000005 c0000000005c2e68 0000000000000000
Jan 23 02:51:09 elm3b39 kernel: NIP [c0000000003a0eec] .tcp_ack+0x10bc/0x20d0
Jan 23 02:51:09 elm3b39 kernel: LR [c0000000003a155c] .tcp_ack+0x172c/0x20d0
Jan 23 02:51:10 elm3b39 kernel: Call Trace:
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbffea30] [c0000000003a155c] .tcp_ack+0x172c/0x20d0 (unreliable)
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbffeb90] [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbffec40] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbffed00] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbffedc0] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbffee50] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbffef20] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbfff000] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbfff110] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbfff1c0] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbfff280] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbfff340] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbfff3c0] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbfff440] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbfff4c0] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:10 elm3b39 kernel: --- Exception: 501 at .__alloc_skb+0x108/0x190
Jan 23 02:51:10 elm3b39 kernel: LR = .__alloc_skb+0xa4/0x190
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbfff7b0] [c000000000352118] .__alloc_skb+0x88/0x190 (unreliable)
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbfff850] [c000000000399248] .sk_stream_alloc_skb+0x48/0x170
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbfff8e0] [c00000000039a914] .tcp_sendmsg+0x454/0xe90
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbfffa10] [c0000000003475f4] .sock_aio_write+0x164/0x180
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbfffb40] [c0000000000cf3b4] .do_sync_write+0xd4/0x170
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbfffcf0] [c0000000000cfe34] .vfs_write+0x1c4/0x1d0
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbfffd90] [c0000000000d07ec] .sys_write+0x4c/0x90
Jan 23 02:51:10 elm3b39 kernel: [c0000000cbfffe30] [c0000000000086ac] syscall_exit+0x0/0x40
Jan 23 02:51:10 elm3b39 kernel: Instruction dump:
Jan 23 02:51:10 elm3b39 kernel: 2fa90000 419e0010 e8be8020 e8050000 f8090028 801a055c 813a0558 817a046c
Jan 23 02:51:10 elm3b39 kernel: 7d290214 7f895840 7c000026 5400f7fe <0b000000> 7f43d378 4800e0fd 60000000
Jan 23 02:51:10 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:10 elm3b39 kernel: Badness at net/ipv4/tcp_output.c:1467
Jan 23 02:51:10 elm3b39 kernel: NIP: c0000000003a99e0 LR: c0000000003a5d80 CTR: c0000000003d8680
Jan 23 02:51:11 elm3b39 kernel: REGS: c0000000cbffe810 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:11 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24042444 XER: 20000020
Jan 23 02:51:11 elm3b39 kernel: TASK = c0000000ce1d3660[4821] 'iperf' THREAD: c0000000cbffc000 CPU: 0
Jan 23 02:51:11 elm3b39 kernel: GPR00: 0000000000000001 c0000000cbffea90 c0000000005fa880 c0000000ccd47900
Jan 23 02:51:11 elm3b39 kernel: GPR04: 00000000000005a8 0000000000000001 0000000000000005 0000000000000005
Jan 23 02:51:11 elm3b39 kernel: GPR08: 0000000000000003 0000000000000008 0000000000000005 c0000000ccd47900
Jan 23 02:51:11 elm3b39 kernel: GPR12: 0000000024042422 c000000000556700 0000000000000027 d000000000106000
Jan 23 02:51:11 elm3b39 kernel: GPR16: 00000000000014a0 0000000000000007 c0000000ccb95000 c0000000cc198cc0
Jan 23 02:51:11 elm3b39 kernel: GPR20: c0000000ccb95700 c0000000ce176800 c00000000061e980 c00000000061fdd8
Jan 23 02:51:11 elm3b39 kernel: GPR24: 0000000000000001 0000000000000020 0000000000000000 00000000000005a8
Jan 23 02:51:11 elm3b39 kernel: GPR28: c0000000cb699080 c0000000ccd47900 c0000000005c2ff0 c0000000ccd47900
Jan 23 02:51:11 elm3b39 kernel: NIP [c0000000003a99e0] .__tcp_push_pending_frames+0xa0/0xa20
Jan 23 02:51:11 elm3b39 kernel: LR [c0000000003a5d80] .tcp_rcv_established+0x350/0x8f0
Jan 23 02:51:11 elm3b39 kernel: Call Trace:
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbffea90] [c0000000003a9b08] .__tcp_push_pending_frames+0x1c8/0xa20 (unreliable)
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbffeb90] [c0000000003a5d80] .tcp_rcv_established+0x350/0x8f0
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbffec40] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbffed00] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbffedc0] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbffee50] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbffef20] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbfff000] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbfff110] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbfff1c0] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbfff280] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbfff340] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbfff3c0] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbfff440] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbfff4c0] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:11 elm3b39 kernel: --- Exception: 501 at .__alloc_skb+0x108/0x190
Jan 23 02:51:11 elm3b39 kernel: LR = .__alloc_skb+0xa4/0x190
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbfff7b0] [c000000000352118] .__alloc_skb+0x88/0x190 (unreliable)
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbfff850] [c000000000399248] .sk_stream_alloc_skb+0x48/0x170
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbfff8e0] [c00000000039a914] .tcp_sendmsg+0x454/0xe90
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbfffa10] [c0000000003475f4] .sock_aio_write+0x164/0x180
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbfffb40] [c0000000000cf3b4] .do_sync_write+0xd4/0x170
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbfffcf0] [c0000000000cfe34] .vfs_write+0x1c4/0x1d0
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbfffd90] [c0000000000d07ec] .sys_write+0x4c/0x90
Jan 23 02:51:11 elm3b39 kernel: [c0000000cbfffe30] [c0000000000086ac] syscall_exit+0x0/0x40
Jan 23 02:51:11 elm3b39 kernel: Instruction dump:
Jan 23 02:51:11 elm3b39 kernel: 419e0484 80030390 2f800000 409e0394 80fd046c <0>------------[ cut here ]------------
Jan 23 02:51:11 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:1767
Jan 23 02:51:11 elm3b39 kernel: NIP: c0000000003a4918 LR: c0000000003ac640 CTR: c0000000003ac210
Jan 23 02:51:11 elm3b39 kernel: REGS: c0000000ce0f7400 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:11 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 28000024 XER: 20000020
Jan 23 02:51:11 elm3b39 kernel: TASK = c0000000ce0f10e0[0] 'swapper' THREAD: c0000000ce0f4000 CPU: 2
Jan 23 02:51:11 elm3b39 kernel: GPR00: 0000000000000001 c0000000ce0f7680 c0000000005fa880 c0000000ce520180
Jan 23 02:51:11 elm3b39 kernel: GPR04: c00000000076bae8 0000000100012758 0000000000000000 0000000000000000
Jan 23 02:51:11 elm3b39 kernel: GPR08: 0000000000000000 0000000000000008 c0000000cb45eb38 0000000000000005
Jan 23 02:51:11 elm3b39 kernel: GPR12: 0000000088000028 c000000000556c00 0000000000000000 0000000000c00020
Jan 23 02:51:11 elm3b39 kernel: GPR16: 0000000000000002 0000000000000000 0000000000000000 0000000000000000
Jan 23 02:51:11 elm3b39 kernel: GPR20: 0000000000000000 0000000000000000 0000000000000000 c00000000060e400
Jan 23 02:51:11 elm3b39 kernel: GPR24: c0000000ce0f4000 0000000000000000 c0000000ce520248 c00000000060e400
Jan 23 02:51:11 elm3b39 kernel: GPR28: 000000000000000f c0000000ce0f7830 c0000000005c2e68 c0000000ce520180
Jan 23 02:51:12 elm3b39 kernel: NIP [c0000000003a4918] .tcp_enter_frto+0x118/0x390
Jan 23 02:51:12 elm3b39 kernel: LR [c0000000003ac640] .tcp_write_timer+0x430/0x810
Jan 23 02:51:12 elm3b39 kernel: Call Trace:
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f7680] [c0000000ce0f7710] 0xc0000000ce0f7710 (unreliable)
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f7710] [c0000000003ac640] .tcp_write_timer+0x430/0x810
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f77c0] [c0000000000614f4] .run_timer_softirq+0x1c4/0x2a0
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f7890] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f7950] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f79d0] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f7a50] [c0000000000261b4] .timer_interrupt+0x134/0x150
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f7ae0] [c000000000003600] decrementer_common+0x100/0x180
Jan 23 02:51:12 elm3b39 kernel: --- Exception: 901 at .ppc64_runlatch_off+0x20/0x60
Jan 23 02:51:12 elm3b39 kernel: LR = .pseries_dedicated_idle_sleep+0xe0/0x1c0
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f7dd0] [0000000000000000] .__start+0x4000000000000000/0x8 (unreliable)
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f7e70] [c000000000011fec] .cpu_idle+0x13c/0x250
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f7f00] [c00000000002bd5c] .start_secondary+0x14c/0x190
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f7f90] [c000000000008364] .start_secondary_prolog+0xc/0x10
Jan 23 02:51:12 elm3b39 kernel: Instruction dump:
Jan 23 02:51:12 elm3b39 kernel: e92b00a8 7d295214 a1690008 7c0b0050 901f0470 801f055c 813f0558 817f046c
Jan 23 02:51:12 elm3b39 kernel: 7d290214 7f895840 7c000026 5400f7fe <0b000000> 7fe3fb78 4800a6d1 60000000
Jan 23 02:51:12 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:12 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:1767
Jan 23 02:51:12 elm3b39 kernel: NIP: c0000000003a4918 LR: c0000000003ac640 CTR: c0000000003ac210
Jan 23 02:51:12 elm3b39 kernel: REGS: c0000000ce0f7400 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:12 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 22000024 XER: 20000020
Jan 23 02:51:12 elm3b39 kernel: TASK = c0000000ce0f10e0[0] 'swapper' THREAD: c0000000ce0f4000 CPU: 2
Jan 23 02:51:12 elm3b39 kernel: GPR00: 0000000000000001 c0000000ce0f7680 c0000000005fa880 c0000000cca44700
Jan 23 02:51:12 elm3b39 kernel: GPR04: 0000000000000001 0000000100012758 0000000000000100 c000000000431928
Jan 23 02:51:12 elm3b39 kernel: GPR08: 0000000000000000 0000000000000008 c0000000c73b3d38 0000000000000005
Jan 23 02:51:12 elm3b39 kernel: GPR12: 0000000048000028 c000000000556c00 0000000000000000 0000000000c00020
Jan 23 02:51:12 elm3b39 kernel: GPR16: 0000000000000002 0000000000000000 0000000000000000 0000000000000000
Jan 23 02:51:12 elm3b39 kernel: GPR20: 0000000000000000 0000000000000000 0000000000000000 c00000000060e400
Jan 23 02:51:12 elm3b39 kernel: GPR24: c0000000ce0f4000 0000000000000000 c0000000cca447c8 c00000000060e400
Jan 23 02:51:12 elm3b39 kernel: GPR28: 000000000000000f c0000000ce0f7830 c0000000005c2e68 c0000000cca44700
Jan 23 02:51:12 elm3b39 kernel: NIP [c0000000003a4918] .tcp_enter_frto+0x118/0x390
Jan 23 02:51:12 elm3b39 kernel: LR [c0000000003ac640] .tcp_write_timer+0x430/0x810
Jan 23 02:51:12 elm3b39 kernel: Call Trace:
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f7680] [c0000000ce0f7710] 0xc0000000ce0f7710 (unreliable)
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f7710] [c0000000003ac640] .tcp_write_timer+0x430/0x810
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f77c0] [c0000000000614f4] .run_timer_softirq+0x1c4/0x2a0
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f7890] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f7950] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f79d0] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f7a50] [c0000000000261b4] .timer_interrupt+0x134/0x150
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f7ae0] [c000000000003600] decrementer_common+0x100/0x180
Jan 23 02:51:12 elm3b39 kernel: --- Exception: 901 at .ppc64_runlatch_off+0x20/0x60
Jan 23 02:51:12 elm3b39 kernel: LR = .pseries_dedicated_idle_sleep+0xe0/0x1c0
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f7dd0] [0000000000000000] .__start+0x4000000000000000/0x8 (unreliable)
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f7e70] [c000000000011fec] .cpu_idle+0x13c/0x250
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f7f00] [c00000000002bd5c] .start_secondary+0x14c/0x190
Jan 23 02:51:12 elm3b39 kernel: [c0000000ce0f7f90] [c000000000008364] .start_secondary_prolog+0xc/0x10
Jan 23 02:51:12 elm3b39 kernel: Instruction dump:
Jan 23 02:51:12 elm3b39 kernel: e92b00a8 7d295214 a1690008 7c0b0050 901f0470 801f055c 813f0558 817f046c
Jan 23 02:51:12 elm3b39 kernel: 7d290214 7f895840 7c000026 5400f7fe <0b000000> 7fe3fb78 4800a6d1 60000000
Jan 23 02:51:12 elm3b39 kernel: 811d055c 815d0558 3b400000
Jan 23 02:51:12 elm3b39 kernel: 7d2a4214 7f893840 7c000026 5400f7fe <0b000000> 7fa3eb78 48005609 60000000
Jan 23 02:51:12 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:12 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:1767
Jan 23 02:51:12 elm3b39 kernel: NIP: c0000000003a4918 LR: c0000000003ac640 CTR: c0000000003ac210
Jan 23 02:51:12 elm3b39 kernel: REGS: c0000000ce0f7400 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:13 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 22000024 XER: 20000020
Jan 23 02:51:13 elm3b39 kernel: TASK = c0000000ce0f10e0[0] 'swapper' THREAD: c0000000ce0f4000 CPU: 2
Jan 23 02:51:13 elm3b39 kernel: GPR00: 0000000000000001 c0000000ce0f7680 c0000000005fa880 c0000000ccd47900
Jan 23 02:51:13 elm3b39 kernel: GPR04: 0000000000000001 0000000100012758 0000000000000100 c000000000431928
Jan 23 02:51:13 elm3b39 kernel: GPR08: 0000000000000000 0000000000000008 c0000000c73b3938 0000000000000005
Jan 23 02:51:13 elm3b39 kernel: GPR12: 0000000042000028 c000000000556c00 0000000000000000 0000000000c00020
Jan 23 02:51:13 elm3b39 kernel: GPR16: 0000000000000002 0000000000000000 0000000000000000 0000000000000000
Jan 23 02:51:13 elm3b39 kernel: GPR20: 0000000000000000 0000000000000000 0000000000000000 c00000000060e400
Jan 23 02:51:13 elm3b39 kernel: GPR24: c0000000ce0f4000 0000000000000000 c0000000ccd479c8 c00000000060e400
Jan 23 02:51:13 elm3b39 kernel: GPR28: 000000000000000f c0000000ce0f7830 c0000000005c2e68 c0000000ccd47900
Jan 23 02:51:13 elm3b39 kernel: NIP [c0000000003a4918] .tcp_enter_frto+0x118/0x390
Jan 23 02:51:13 elm3b39 kernel: LR [c0000000003ac640] .tcp_write_timer+0x430/0x810
Jan 23 02:51:13 elm3b39 kernel: Call Trace:
Jan 23 02:51:13 elm3b39 kernel: [c0000000ce0f7680] [c0000000ce0f7710] 0xc0000000ce0f7710 (unreliable)
Jan 23 02:51:13 elm3b39 kernel: [c0000000ce0f7710] [c0000000003ac640] .tcp_write_timer+0x430/0x810
Jan 23 02:51:13 elm3b39 kernel: [c0000000ce0f77c0] [c0000000000614f4] .run_timer_softirq+0x1c4/0x2a0
Jan 23 02:51:13 elm3b39 kernel: [c0000000ce0f7890] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:13 elm3b39 kernel: [c0000000ce0f7950] [c00000000000c4a4] <0>------------[ cut here ]------------
Jan 23 02:51:13 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:3184
Jan 23 02:51:13 elm3b39 kernel: NIP: c0000000003a0010 LR: c0000000003a5d54 CTR: c00000000021f110
Jan 23 02:51:13 elm3b39 kernel: REGS: c0000000005fed30 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:13 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 44004024 XER: 20000020
Jan 23 02:51:13 elm3b39 kernel: TASK = c000000000555e50[0] 'swapper' THREAD: c0000000005fc000 CPU: 0
Jan 23 02:51:13 elm3b39 kernel: GPR00: 0000000000000001 c0000000005fefb0 c0000000005fa880 c0000000ce520180
Jan 23 02:51:13 elm3b39 kernel: GPR04: c0000000cb3fad80 0000000000000001 0000000000000003 000000000000b59e
Jan 23 02:51:13 elm3b39 kernel: GPR08: 0000000000000005 0000000000000008 0000000000000000 0000000000000001
Jan 23 02:51:13 elm3b39 kernel: GPR12: 0000000024002022 c000000000556700 0000000000000000 d000000000106000
Jan 23 02:51:13 elm3b39 kernel: GPR16: 0000000000000ac0 0000000000000000 00000000745b1316 c0000000cc198cc0
Jan 23 02:51:13 elm3b39 kernel: GPR20: c0000000ccb95700 c0000000ce176800 c00000000061e980 c00000000061fdd8
Jan 23 02:51:13 elm3b39 kernel: GPR24: c0000000cc2a208e c0000000cb3fad80 c0000000ce520180 00000000745afc5e
Jan 23 02:51:13 elm3b39 kernel: GPR28: 00000000867fa105 0000000000000400 c0000000005c2e68 c0000000cb3fadb8
Jan 23 02:51:13 elm3b39 kernel: NIP [c0000000003a0010] .tcp_ack+0x1e0/0x20d0
Jan 23 02:51:13 elm3b39 kernel: LR [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:13 elm3b39 kernel: Call Trace:
Jan 23 02:51:13 elm3b39 kernel: [c0000000005fefb0] [c00000000061e980] 0xc00000000061e980 (unreliable)
Jan 23 02:51:13 elm3b39 kernel: [c0000000005ff110] [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:13 elm3b39 kernel: [c0000000005ff1c0] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:13 elm3b39 kernel: [c0000000005ff280] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:13 elm3b39 kernel: [c0000000005ff340] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:13 elm3b39 kernel: [c0000000005ff3d0] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:13 elm3b39 kernel: [c0000000005ff4a0] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:13 elm3b39 kernel: [c0000000005ff580] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:13 elm3b39 kernel: [c0000000005ff690] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:13 elm3b39 kernel: [c0000000005ff740] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:13 elm3b39 kernel: [c0000000005ff800] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:13 elm3b39 kernel: [c0000000005ff8c0] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:13 elm3b39 kernel: [c0000000005ff940] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:13 elm3b39 kernel: [c0000000005ff9c0] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:13 elm3b39 kernel: [c0000000005ffa40] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:13 elm3b39 kernel: --- Exception: 501 at .pseries_dedicated_idle_sleep+0xec/0x1c0
Jan 23 02:51:13 elm3b39 kernel: LR = .pseries_dedicated_idle_sleep+0xe0/0x1c0
Jan 23 02:51:13 elm3b39 kernel: [c0000000005ffd30] [000000000211e3d8] 0x211e3d8 (unreliable)
Jan 23 02:51:13 elm3b39 kernel: [c0000000005ffdd0] [c000000000011fec] .cpu_idle+0x13c/0x250
Jan 23 02:51:13 elm3b39 kernel: [c0000000005ffe60] [c000000000009b08] .rest_init+0x78/0x90
Jan 23 02:51:13 elm3b39 kernel: [c0000000005ffee0] [c0000000004e8a24] .start_kernel+0x354/0x400
Jan 23 02:51:13 elm3b39 kernel: [c0000000005fff90] [c000000000008524] .start_here_common+0x54/0xb0
Jan 23 02:51:13 elm3b39 kernel: Instruction dump:
Jan 23 02:51:13 elm3b39 kernel: 813a046c f92100a0 7d283214 60000000 815a0560 e80100a0 f94100c0 7f890040
Jan 23 02:51:13 elm3b39 kernel: 7c000026 5400f7fe 817a0470 f96100a8 <0b000000> 7f43d378 4800efd9 60000000
Jan 23 02:51:13 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:14 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2855
Jan 23 02:51:14 elm3b39 kernel: NIP: c0000000003a0464 LR: c0000000003a0410 CTR: c00000000021f110
Jan 23 02:51:14 elm3b39 kernel: REGS: c0000000005fed30 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:14 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24048088 XER: 20000020
Jan 23 02:51:14 elm3b39 kernel: TASK = c000000000555e50[0] 'swapper' THREAD: c0000000005fc000 CPU: 0
Jan 23 02:51:14 elm3b39 kernel: GPR00: 0000000000000003 c0000000005fefb0 c0000000005fa880 0000000000000001
Jan 23 02:51:14 elm3b39 kernel: GPR04: c0000000c77f2380 0000000000000002 00000000745b1316 0000000000000000
Jan 23 02:51:14 elm3b39 kernel: GPR08: c000000000556700 0000000000000001 c0000000c77f2100 0000000000000017
Jan 23 02:51:14 elm3b39 kernel: GPR12: 0000000000000000 c000000000556700 0000000000000000 0000000000012771
Jan 23 02:51:14 elm3b39 kernel: GPR16: 0000000000000001 c0000000ce520248 00000000745b1316 0000000000000001
Jan 23 02:51:14 elm3b39 kernel: GPR20: 000000000000004f 000000000000004f 0000000000000005 000000000000000c
Jan 23 02:51:14 elm3b39 kernel: GPR24: 00000000745b1316 0000000000000004 c0000000ce520180 c0000000c77f23b8
Jan 23 02:51:14 elm3b39 kernel: GPR28: 0000000000000001 0000000000000005 c0000000005c2e68 c0000000c7084700
Jan 23 02:51:14 elm3b39 kernel: NIP [c0000000003a0464] .tcp_ack+0x634/0x20d0
Jan 23 02:51:14 elm3b39 kernel: LR [c0000000003a0410] .tcp_ack+0x5e0/0x20d0
Jan 23 02:51:14 elm3b39 kernel: Call Trace:
Jan 23 02:51:14 elm3b39 kernel: [c0000000005fefb0] [c0000000003a0410] .tcp_ack+0x5e0/0x20d0 (unreliable)
Jan 23 02:51:14 elm3b39 kernel: [c0000000005ff110] [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:14 elm3b39 kernel: [c0000000005ff1c0] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:14 elm3b39 kernel: [c0000000005ff280] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:14 elm3b39 kernel: [c0000000005ff340] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:14 elm3b39 kernel: [c0000000005ff3d0] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:14 elm3b39 kernel: [c0000000005ff4a0] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:14 elm3b39 kernel: [c0000000005ff580] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:14 elm3b39 kernel: [c0000000005ff690] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:14 elm3b39 kernel: [c0000000005ff740] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:14 elm3b39 kernel: [c0000000005ff800] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:14 elm3b39 kernel: [c0000000005ff8c0] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:14 elm3b39 kernel: [c0000000005ff940] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:14 elm3b39 kernel: [c0000000005ff9c0] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:14 elm3b39 kernel: [c0000000005ffa40] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:14 elm3b39 kernel: --- Exception: 501 at .pseries_dedicated_idle_sleep+0xec/0x1c0
Jan 23 02:51:14 elm3b39 kernel: LR = .pseries_dedicated_idle_sleep+0xe0/0x1c0
Jan 23 02:51:14 elm3b39 kernel: [c0000000005ffd30] [000000000211e3d8] 0x211e3d8 (unreliable)
Jan 23 02:51:14 elm3b39 kernel: [c0000000005ffdd0] [c000000000011fec] .cpu_idle+0x13c/0x250
Jan 23 02:51:14 elm3b39 kernel: [c0000000005ffe60] [c000000000009b08] .rest_init+0x78/0x90
Jan 23 02:51:14 elm3b39 kernel: [c0000000005ffee0] [c0000000004e8a24] .start_kernel+0x354/0x400
Jan 23 02:51:14 elm3b39 kernel: [c0000000005fff90] [c000000000008524] .start_here_common+0x54/0xb0
Jan 23 02:51:14 elm3b39 kernel: Instruction dump:
Jan 23 02:51:14 elm3b39 kernel: 41920010 e81a01d8 7fbf0000 409efdb0 80fa046c 7eddb378 813a055c 801a0558
Jan 23 02:51:14 elm3b39 kernel: 7c004a14 7f870040 7d200026 5529effe <0b090000> 7f43d378 4800eb85 60000000
Jan 23 02:51:14 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:14 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:3184
Jan 23 02:51:14 elm3b39 kernel: NIP: c0000000003a0010 LR: c0000000003a5d54 CTR: c00000000021f110
Jan 23 02:51:14 elm3b39 kernel: REGS: c0000000005fed30 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:14 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 44004024 XER: 20000020
Jan 23 02:51:14 elm3b39 kernel: TASK = c000000000555e50[0] 'swapper' THREAD: c0000000005fc000 CPU: 0
Jan 23 02:51:14 elm3b39 kernel: GPR00: 0000000000000001 c0000000005fefb0 c0000000005fa880 c0000000cca44700
Jan 23 02:51:14 elm3b39 kernel: GPR04: c0000000cb3fad80 0000000000000001 0000000000000003 000000000000b5a0
Jan 23 02:51:14 elm3b39 kernel: GPR08: 0000000000000005 0000000000000008 0000000000000000 0000000000000001
Jan 23 02:51:14 elm3b39 kernel: GPR12: 0000000024002022 c000000000556700 0000000000000001 d000000000106000
Jan 23 02:51:14 elm3b39 kernel: GPR16: 0000000000000ae0 0000000000000001 0000000074cf9caf c0000000cc198cc0
Jan 23 02:51:14 elm3b39 kernel: GPR20: c0000000ccb95700 c0000000ce176800 c00000000061e980 c00000000061fdd8
Jan 23 02:51:14 elm3b39 kernel: GPR24: c0000000cc2a208e c0000000cb3fad80 c0000000cca44700 0000000074cf85f7
Jan 23 02:51:14 elm3b39 kernel: GPR28: 000000008680b8c1 0000000000000400 c0000000005c2e68 c0000000cb3fadb8
Jan 23 02:51:14 elm3b39 kernel: NIP [c0000000003a0010] .tcp_ack+0x1e0/0x20d0
Jan 23 02:51:14 elm3b39 kernel: LR [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:14 elm3b39 kernel: Call Trace:
Jan 23 02:51:14 elm3b39 kernel: [c0000000005fefb0] [c00000000061e980] 0xc00000000061e980 (unreliable)
Jan 23 02:51:14 elm3b39 kernel: [c0000000005ff110] [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:14 elm3b39 kernel: [c0000000005ff1c0] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff280] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff340] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff3d0] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff4a0] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff580] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff690] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff740] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff800] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff8c0] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff940] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff9c0] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ffa40] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:15 elm3b39 kernel: --- Exception: 501 at .pseries_dedicated_idle_sleep+0xec/0x1c0
Jan 23 02:51:15 elm3b39 kernel: LR = .pseries_dedicated_idle_sleep+0xe0/0x1c0
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ffd30] [000000000211e3d8] 0x211e3d8 (unreliable)
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ffdd0] [c000000000011fec] .cpu_idle+0x13c/0x250
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ffe60] [c000000000009b08] .rest_init+0x78/0x90
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ffee0] [c0000000004e8a24] .start_kernel+0x354/0x400
Jan 23 02:51:15 elm3b39 kernel: [c0000000005fff90] [c000000000008524] .start_here_common+0x54/0xb0
Jan 23 02:51:15 elm3b39 kernel: Instruction dump:
Jan 23 02:51:15 elm3b39 kernel: 813a046c f92100a0 7d283214 60000000 815a0560 e80100a0 f94100c0 7f890040
Jan 23 02:51:15 elm3b39 kernel: 7c000026 5400f7fe 817a0470 f96100a8 <0b000000> 7f43d378 4800efd9 60000000
Jan 23 02:51:15 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:15 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2855
Jan 23 02:51:15 elm3b39 kernel: NIP: c0000000003a0464 LR: c0000000003a0410 CTR: c00000000021f110
Jan 23 02:51:15 elm3b39 kernel: REGS: c0000000005fed30 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:15 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24048088 XER: 20000020
Jan 23 02:51:15 elm3b39 kernel: TASK = c000000000555e50[0] 'swapper' THREAD: c0000000005fc000 CPU: 0
Jan 23 02:51:15 elm3b39 kernel: GPR00: 0000000000000003 c0000000005fefb0 c0000000005fa880 0000000000000001
Jan 23 02:51:15 elm3b39 kernel: GPR04: c0000000cbbe0a80 0000000000000002 0000000074cf9caf 0000000000000000
Jan 23 02:51:15 elm3b39 kernel: GPR08: c000000000556700 0000000000000001 c0000000cbbe0000 000000000000001b
Jan 23 02:51:15 elm3b39 kernel: GPR12: 0000000000000000 c000000000556700 0000000000000000 0000000000012771
Jan 23 02:51:15 elm3b39 kernel: GPR16: 0000000000000001 c0000000cca447c8 0000000074cf9caf 0000000000000001
Jan 23 02:51:15 elm3b39 kernel: GPR20: 000000000000004f 000000000000004f 0000000000000005 000000000000000c
Jan 23 02:51:15 elm3b39 kernel: GPR24: 0000000074cf9caf 0000000000000004 c0000000cca44700 c0000000cbbe0ab8
Jan 23 02:51:15 elm3b39 kernel: GPR28: 0000000000000001 0000000000000005 c0000000005c2e68 c0000000c7120080
Jan 23 02:51:15 elm3b39 kernel: NIP [c0000000003a0464] .tcp_ack+0x634/0x20d0
Jan 23 02:51:15 elm3b39 kernel: LR [c0000000003a0410] .tcp_ack+0x5e0/0x20d0
Jan 23 02:51:15 elm3b39 kernel: Call Trace:
Jan 23 02:51:15 elm3b39 kernel: [c0000000005fefb0] [c0000000003a0410] .tcp_ack+0x5e0/0x20d0 (unreliable)
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff110] [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff1c0] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff280] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff340] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff3d0] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff4a0] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff580] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff690] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff740] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff800] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff8c0] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff940] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ff9c0] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ffa40] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:15 elm3b39 kernel: --- Exception: 501 at .pseries_dedicated_idle_sleep+0xec/0x1c0
Jan 23 02:51:15 elm3b39 kernel: LR = .pseries_dedicated_idle_sleep+0xe0/0x1c0
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ffd30] [000000000211e3d8] 0x211e3d8 (unreliable)
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ffdd0] [c000000000011fec] .cpu_idle+0x13c/0x250
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ffe60] [c000000000009b08] .rest_init+0x78/0x90
Jan 23 02:51:15 elm3b39 kernel: [c0000000005ffee0] [c0000000004e8a24] .start_kernel+0x354/0x400
Jan 23 02:51:15 elm3b39 kernel: [c0000000005fff90] [c000000000008524] .start_here_common+0x54/0xb0
Jan 23 02:51:16 elm3b39 kernel: Instruction dump:
Jan 23 02:51:16 elm3b39 kernel: 41920010 e81a01d8 7fbf0000 409efdb0 80fa046c 7eddb378 813a055c 801a0558
Jan 23 02:51:16 elm3b39 kernel: 7c004a14 7f870040 7d200026 5529effe <0b090000> 7f43d378 4800eb85 60000000
Jan 23 02:51:16 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:16 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2169
Jan 23 02:51:16 elm3b39 kernel: NIP: c00000000039ec58 LR: c00000000039ecd0 CTR: c0000000003d8680
Jan 23 02:51:16 elm3b39 kernel: REGS: c0000000005fec80 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:16 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24044024 XER: 00000020
Jan 23 02:51:16 elm3b39 kernel: TASK = c000000000555e50[0] 'swapper' THREAD: c0000000005fc000 CPU: 0
Jan 23 02:51:16 elm3b39 kernel: GPR00: 0000000000000001 c0000000005fef00 c0000000005fa880 c0000000c725f900
Jan 23 02:51:16 elm3b39 kernel: GPR04: c0000000cb8e7100 0000000000000001 c0000000003d8680 0001271dd0770000
Jan 23 02:51:16 elm3b39 kernel: GPR08: c00000000061ff78 0000000000000008 0000000000000100 0000000000000005
Jan 23 02:51:16 elm3b39 kernel: GPR12: 0000000024042022 c000000000556700 0000000000000000 0000000000012773
Jan 23 02:51:16 elm3b39 kernel: GPR16: 0000000000000005 c0000000c725f9c8 0000000074ce5b1e 0000000000000001
Jan 23 02:51:16 elm3b39 kernel: GPR20: ffffffffffffffff ffffffffffffffff 0000000000000000 0000000000000001
Jan 23 02:51:16 elm3b39 kernel: GPR24: 0000000000000000 0000000000000001 0000000000000001 c0000000c725f9c8
Jan 23 02:51:16 elm3b39 kernel: GPR28: 0000000000000000 c0000000c725f900 c0000000005c2e68 c0000000cb9acb80
Jan 23 02:51:16 elm3b39 kernel: NIP [c00000000039ec58] .tcp_mark_head_lost+0x128/0x1e0
Jan 23 02:51:16 elm3b39 kernel: LR [c00000000039ecd0] .tcp_mark_head_lost+0x1a0/0x1e0
Jan 23 02:51:16 elm3b39 kernel: Call Trace:
Jan 23 02:51:16 elm3b39 kernel: [c0000000005fef00] [c0000000005c2e68] 0xc0000000005c2e68 (unreliable)
Jan 23 02:51:16 elm3b39 kernel: [c0000000005fefb0] [c0000000003a18a0] .tcp_ack+0x1a70/0x20d0
Jan 23 02:51:16 elm3b39 kernel: [c0000000005ff110] [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:16 elm3b39 kernel: [c0000000005ff1c0] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:16 elm3b39 kernel: [c0000000005ff280] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:16 elm3b39 kernel: [c0000000005ff340] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:16 elm3b39 kernel: [c0000000005ff3d0] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:16 elm3b39 kernel: [c0000000005ff4a0] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:16 elm3b39 kernel: [c0000000005ff580] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:16 elm3b39 kernel: [c0000000005ff690] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:16 elm3b39 kernel: [c0000000005ff740] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:16 elm3b39 kernel: [c0000000005ff800] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:16 elm3b39 kernel: [c0000000005ff8c0] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:16 elm3b39 kernel: [c0000000005ff940] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:16 elm3b39 kernel: [c0000000005ff9c0] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:16 elm3b39 kernel: [c0000000005ffa40] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:16 elm3b39 kernel: --- Exception: 501 at .pseries_dedicated_idle_sleep+0xec/0x1c0
Jan 23 02:51:16 elm3b39 kernel: LR = .pseries_dedicated_idle_sleep+0xe0/0x1c0
Jan 23 02:51:16 elm3b39 kernel: [c0000000005ffd30] [000000000211e3d8] 0x211e3d8 (unreliable)
Jan 23 02:51:16 elm3b39 kernel: [c0000000005ffdd0] [c000000000011fec] .cpu_idle+0x13c/0x250
Jan 23 02:51:16 elm3b39 kernel: [c0000000005ffe60] [c000000000009b08] .rest_init+0x78/0x90
Jan 23 02:51:16 elm3b39 kernel: [c0000000005ffee0] [c0000000004e8a24] .start_kernel+0x354/0x400
Jan 23 02:51:16 elm3b39 kernel: [c0000000005fff90] [c000000000008524] .start_here_common+0x54/0xb0
Jan 23 02:51:16 elm3b39 kernel: Instruction dump:
Jan 23 02:51:16 elm3b39 kernel: 7fbfd800 419e0010 e81d01d8 7fa0f800 409eff78 801d055c 813d0558 817d046c
Jan 23 02:51:16 elm3b39 kernel: 7d290214 7f895840 7c000026 5400f7fe <0b000000> 7fa3eb78 48010391 60000000
Jan 23 02:51:16 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:16 elm3b39 kernel: Badness at net/ipv4/tcp_output.c:1977
Jan 23 02:51:16 elm3b39 kernel: NIP: c0000000003a9628 LR: c0000000003a155c CTR: c0000000003d8680
Jan 23 02:51:16 elm3b39 kernel: REGS: c0000000005fec90 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:16 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24042024 XER: 00000020
Jan 23 02:51:16 elm3b39 kernel: TASK = c000000000555e50[0] 'swapper' THREAD: c0000000005fc000 CPU: 0
Jan 23 02:51:16 elm3b39 kernel: GPR00: fffffffffffffffd c0000000005fef10 c0000000005fa880 c0000000c725f900
Jan 23 02:51:16 elm3b39 kernel: GPR04: 0000000000000000 0000000000000003 0000000000000005 0000000000000005
Jan 23 02:51:16 elm3b39 kernel: GPR08: 0000000000000004 0000000000000001 0000000000000005 0000000000000003
Jan 23 02:51:16 elm3b39 kernel: GPR12: 0000000024042022 c000000000556700 0000000000000000 0000000000012773
Jan 23 02:51:16 elm3b39 kernel: GPR16: 0000000000000005 c0000000c725f9c8 0000000074ce5b1e 0000000000000001
Jan 23 02:51:16 elm3b39 kernel: GPR20: ffffffffffffffff ffffffffffffffff 0000000000000000 0000000000000001
Jan 23 02:51:16 elm3b39 kernel: GPR24: 0000000000000000 0000000024008022 c0000000c725f900 c0000000c725f9c8
Jan 23 02:51:16 elm3b39 kernel: GPR28: 0000000000000000 c0000000c725f900 c0000000005c2ff0 c0000000c756db00
Jan 23 02:51:16 elm3b39 kernel: NIP [c0000000003a9628] .tcp_xmit_retransmit_queue+0x408/0x500
Jan 23 02:51:16 elm3b39 kernel: LR [c0000000003a155c] .tcp_ack+0x172c/0x20d0
Jan 23 02:51:17 elm3b39 kernel: Call Trace:
Jan 23 02:51:17 elm3b39 kernel: [c0000000005fef10] [c0000000005fefb0] 0xc0000000005fefb0 (unreliable)
Jan 23 02:51:17 elm3b39 kernel: [c0000000005fefb0] [c0000000003a155c] .tcp_ack+0x172c/0x20d0
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff110] [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff1c0] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff280] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff340] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff3d0] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff4a0] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff580] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff690] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff740] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff800] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff8c0] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff940] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff9c0] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ffa40] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:17 elm3b39 kernel: --- Exception: 501 at .pseries_dedicated_idle_sleep+0xec/0x1c0
Jan 23 02:51:17 elm3b39 kernel: LR = .pseries_dedicated_idle_sleep+0xe0/0x1c0
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ffd30] [000000000211e3d8] 0x211e3d8 (unreliable)
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ffdd0] [c000000000011fec] .cpu_idle+0x13c/0x250
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ffe60] [c000000000009b08] .rest_init+0x78/0x90
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ffee0] [c0000000004e8a24] .start_kernel+0x354/0x400
Jan 23 02:51:17 elm3b39 kernel: [c0000000005fff90] [c000000000008524] .start_here_common+0x54/0xb0
Jan 23 02:51:17 elm3b39 kernel: Instruction dump:
Jan 23 02:51:17 elm3b39 kernel: 80bd055c 4bfffeac e80300c8 3b6300c8 3b800000 7fbb0000 419efc4c 7c1f0378
Jan 23 02:51:17 elm3b39 kernel: 4bfffc44 7f8a4840 7d200026 5529effe <0b090000> 7fa3eb78 480059c1 60000000
Jan 23 02:51:17 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:17 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:3248
Jan 23 02:51:17 elm3b39 kernel: NIP: c0000000003a0eec LR: c0000000003a155c CTR: c0000000003d8680
Jan 23 02:51:17 elm3b39 kernel: REGS: c0000000005fed30 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:17 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24042024 XER: 00000020
Jan 23 02:51:17 elm3b39 kernel: TASK = c000000000555e50[0] 'swapper' THREAD: c0000000005fc000 CPU: 0
Jan 23 02:51:17 elm3b39 kernel: GPR00: 0000000000000001 c0000000005fefb0 c0000000005fa880 c0000000c725f900
Jan 23 02:51:17 elm3b39 kernel: GPR04: 0000000000000005 c00000000060e400 0000000000000005 0000000000000005
Jan 23 02:51:17 elm3b39 kernel: GPR08: 0000000000000004 0000000000000008 0000000000000000 0000000000000005
Jan 23 02:51:17 elm3b39 kernel: GPR12: 0000000000000000 c000000000556700 0000000000000000 0000000000012773
Jan 23 02:51:17 elm3b39 kernel: GPR16: 0000000000000005 c0000000c725f9c8 0000000074ce5b1e 0000000000000001
Jan 23 02:51:17 elm3b39 kernel: GPR20: ffffffffffffffff ffffffffffffffff 0000000000000000 0000000000000001
Jan 23 02:51:17 elm3b39 kernel: GPR24: 0000000000000000 0000000024008022 c0000000c725f900 0000000024002028
Jan 23 02:51:17 elm3b39 kernel: GPR28: 0000000000000000 0000000000000005 c0000000005c2e68 0000000000000000
Jan 23 02:51:17 elm3b39 kernel: NIP [c0000000003a0eec] .tcp_ack+0x10bc/0x20d0
Jan 23 02:51:17 elm3b39 kernel: LR [c0000000003a155c] .tcp_ack+0x172c/0x20d0
Jan 23 02:51:17 elm3b39 kernel: Call Trace:
Jan 23 02:51:17 elm3b39 kernel: [c0000000005fefb0] [c0000000003a155c] .tcp_ack+0x172c/0x20d0 (unreliable)
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff110] [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff1c0] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff280] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff340] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff3d0] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff4a0] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff580] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff690] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff740] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff800] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff8c0] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff940] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ff9c0] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:17 elm3b39 kernel: [c0000000005ffa40] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:17 elm3b39 kernel: --- Exception: 501 at .pseries_dedicated_idle_sleep+0xec/0x1c0
Jan 23 02:51:17 elm3b39 kernel: LR = .pseries_dedicated_idle_sleep+0xe0/0x1c0
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ffd30] [000000000211e3d8] 0x211e3d8 (unreliable)
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ffdd0] [c000000000011fec] .cpu_idle+0x13c/0x250
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ffe60] [c000000000009b08] .rest_init+0x78/0x90
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ffee0] [c0000000004e8a24] .start_kernel+0x354/0x400
Jan 23 02:51:18 elm3b39 kernel: [c0000000005fff90] [c000000000008524] .start_here_common+0x54/0xb0
Jan 23 02:51:18 elm3b39 kernel: Instruction dump:
Jan 23 02:51:18 elm3b39 kernel: 2fa90000 419e0010 e8be8020 e8050000 f8090028 801a055c 813a0558 817a046c
Jan 23 02:51:18 elm3b39 kernel: 7d290214 7f895840 7c000026 5400f7fe <0b000000> 7f43d378 4800e0fd 60000000
Jan 23 02:51:18 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:18 elm3b39 kernel: Badness at net/ipv4/tcp_output.c:1467
Jan 23 02:51:18 elm3b39 kernel: NIP: c0000000003a99e0 LR: c0000000003a5d80 CTR: c0000000003d8680
Jan 23 02:51:18 elm3b39 kernel: REGS: c0000000005fed90 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:18 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24002044 XER: 20000020
Jan 23 02:51:18 elm3b39 kernel: TASK = c000000000555e50[0] 'swapper' THREAD: c0000000005fc000 CPU: 0
Jan 23 02:51:18 elm3b39 kernel: GPR00: 0000000000000001 c0000000005ff010 c0000000005fa880 c0000000c725f900
Jan 23 02:51:18 elm3b39 kernel: GPR04: 00000000000005a8 0000000000000001 0000000000000005 0000000000000005
Jan 23 02:51:18 elm3b39 kernel: GPR08: 0000000000000003 0000000000000008 0000000000000005 c0000000c725f900
Jan 23 02:51:18 elm3b39 kernel: GPR12: 0000000024002022 c000000000556700 000000000000001f d000000000106000
Jan 23 02:51:18 elm3b39 kernel: GPR16: 0000000000001ea0 000000000000000f c0000000ccb95000 c0000000cc198cc0
Jan 23 02:51:18 elm3b39 kernel: GPR20: c0000000ccb95700 c0000000ce176800 c00000000061e980 c00000000061fdd8
Jan 23 02:51:18 elm3b39 kernel: GPR24: 0000000000000001 0000000000000020 0000000000000000 00000000000005a8
Jan 23 02:51:18 elm3b39 kernel: GPR28: c0000000cb699280 c0000000c725f900 c0000000005c2ff0 c0000000c725f900
Jan 23 02:51:18 elm3b39 kernel: NIP [c0000000003a99e0] .__tcp_push_pending_frames+0xa0/0xa20
Jan 23 02:51:18 elm3b39 kernel: LR [c0000000003a5d80] .tcp_rcv_established+0x350/0x8f0
Jan 23 02:51:18 elm3b39 kernel: Call Trace:
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ff010] [c0000000003a9b08] .__tcp_push_pending_frames+0x1c8/0xa20 (unreliable)
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ff110] [c0000000003a5d80] .tcp_rcv_established+0x350/0x8f0
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ff1c0] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ff280] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ff340] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ff3d0] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ff4a0] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ff580] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ff690] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ff740] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ff800] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ff8c0] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ff940] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ff9c0] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ffa40] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:18 elm3b39 kernel: --- Exception: 501 at .pseries_dedicated_idle_sleep+0xec/0x1c0
Jan 23 02:51:18 elm3b39 kernel: LR = .pseries_dedicated_idle_sleep+0xe0/0x1c0
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ffd30] [000000000211e3d8] 0x211e3d8 (unreliable)
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ffdd0] [c000000000011fec] .cpu_idle+0x13c/0x250
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ffe60] [c000000000009b08] .rest_init+0x78/0x90
Jan 23 02:51:18 elm3b39 kernel: [c0000000005ffee0] [c0000000004e8a24] .start_kernel+0x354/0x400
Jan 23 02:51:18 elm3b39 kernel: [c0000000005fff90] [c000000000008524] .start_here_common+0x54/0xb0
Jan 23 02:51:18 elm3b39 kernel: Instruction dump:
Jan 23 02:51:18 elm3b39 kernel: 419e0484 80030390 2f800000 409e0394 80fd046c 811d055c 815d0558 3b400000
Jan 23 02:51:18 elm3b39 kernel: 7d2a4214 7f893840 7c000026 5400f7fe <0b000000> 7fa3eb78 48005609 60000000
Jan 23 02:51:18 elm3b39 kernel: .do_softirq+0x64/0xa0
Jan 23 02:51:18 elm3b39 kernel: [c0000000ce0f79d0] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:18 elm3b39 kernel: [c0000000ce0f7a50] [c0000000000261b4] .timer_interrupt+0x134/0x150
Jan 23 02:51:18 elm3b39 kernel: [c0000000ce0f7ae0] [c000000000003600] decrementer_common+0x100/0x180
Jan 23 02:51:18 elm3b39 kernel: --- Exception: 901 at .ppc64_runlatch_off+0x20/0x60
Jan 23 02:51:18 elm3b39 kernel: LR = .pseries_dedicated_idle_sleep+0xe0/0x1c0
Jan 23 02:51:18 elm3b39 kernel: [c0000000ce0f7dd0] [0000000000000000] .__start+0x4000000000000000/0x8 (unreliable)
Jan 23 02:51:18 elm3b39 kernel: [c0000000ce0f7e70] [c000000000011fec] .cpu_idle+0x13c/0x250
Jan 23 02:51:18 elm3b39 kernel: [c0000000ce0f7f00] [c00000000002bd5c] .start_secondary+0x14c/0x190
Jan 23 02:51:18 elm3b39 kernel: [c0000000ce0f7f90] [c000000000008364] .start_secondary_prolog+0xc/0x10
Jan 23 02:51:18 elm3b39 kernel: Instruction dump:
Jan 23 02:51:18 elm3b39 kernel: e92b00a8 7d295214 a1690008 7c0b0050 901f0470 801f055c 813f0558 817f046c
Jan 23 02:51:19 elm3b39 kernel: 7d290214 7f895840 7c000026 5400f7fe <0b000000> 7fe3fb78 4800a6d1 60000000
Jan 23 02:51:19 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:19 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:1767
Jan 23 02:51:19 elm3b39 kernel: NIP: c0000000003a4918 LR: c0000000003ac640 CTR: c0000000003ac210
Jan 23 02:51:19 elm3b39 kernel: REGS: c0000000ce0f7400 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:19 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 22000024 XER: 20000020
Jan 23 02:51:19 elm3b39 kernel: TASK = c0000000ce0f10e0[0] 'swapper' THREAD: c0000000ce0f4000 CPU: 2
Jan 23 02:51:19 elm3b39 kernel: GPR00: 0000000000000001 c0000000ce0f7680 c0000000005fa880 c0000000c725f900
Jan 23 02:51:19 elm3b39 kernel: GPR04: 0000000000000001 0000000100012758 0000000000000100 c000000000431928
Jan 23 02:51:19 elm3b39 kernel: GPR08: 0000000000000000 0000000000000008 c0000000c756db38 0000000000000005
Jan 23 02:51:19 elm3b39 kernel: GPR12: 0000000042000028 c000000000556c00 0000000000000000 0000000000c00020
Jan 23 02:51:19 elm3b39 kernel: GPR16: 0000000000000002 0000000000000000 0000000000000000 0000000000000000
Jan 23 02:51:19 elm3b39 kernel: GPR20: 0000000000000000 0000000000000000 0000000000000000 c00000000060e400
Jan 23 02:51:19 elm3b39 kernel: GPR24: c0000000ce0f4000 0000000000000000 c0000000c725f9c8 c00000000060e400
Jan 23 02:51:19 elm3b39 kernel: GPR28: 000000000000000f c0000000ce0f7830 c0000000005c2e68 c0000000c725f900
Jan 23 02:51:19 elm3b39 kernel: NIP [c0000000003a4918] .tcp_enter_frto+0x118/0x390
Jan 23 02:51:19 elm3b39 kernel: LR [c0000000003ac640] .tcp_write_timer+0x430/0x810
Jan 23 02:51:19 elm3b39 kernel: Call Trace:
Jan 23 02:51:19 elm3b39 kernel: [c0000000ce0f7680] [c0000000ce0f7710] 0xc0000000ce0f7710 (unreliable)
Jan 23 02:51:19 elm3b39 kernel: [c0000000ce0f7710] [c0000000003ac640] .tcp_write_timer+0x430/0x810
Jan 23 02:51:19 elm3b39 kernel: [c0000000ce0f77c0] [c0000000000614f4] .run_timer_softirq+0x1c4/0x2a0
Jan 23 02:51:19 elm3b39 kernel: [c0000000ce0f7890] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:19 elm3b39 kernel: [c0000000ce0f7950] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:19 elm3b39 kernel: [c0000000ce0f79d0] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:19 elm3b39 kernel: [c0000000ce0f7a50] [c0000000000261b4] .timer_interrupt+0x134/0x150
Jan 23 02:51:19 elm3b39 kernel: [c0000000ce0f7ae0] [c000000000003600] decrementer_common+0x100/0x180
Jan 23 02:51:19 elm3b39 kernel: --- Exception: 901 at .ppc64_runlatch_off+0x20/0x60
Jan 23 02:51:19 elm3b39 kernel: LR = .pseries_dedicated_idle_sleep+0xe0/0x1c0
Jan 23 02:51:19 elm3b39 kernel: [c0000000ce0f7dd0] [0000000000000000] .__start+0x4000000000000000/0x8 (unreliable)
Jan 23 02:51:19 elm3b39 kernel: [c0000000ce0f7e70] [c000000000011fec] .cpu_idle+0x13c/0x250
Jan 23 02:51:19 elm3b39 kernel: [c0000000ce0f7f00] [c00000000002bd5c] .start_secondary+0x14c/0x190
Jan 23 02:51:19 elm3b39 kernel: [c0000000ce0f7f90] [c000000000008364] <0>------------[ cut here ]------------
Jan 23 02:51:19 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:3184
Jan 23 02:51:19 elm3b39 kernel: NIP: c0000000003a0010 LR: c0000000003a5d54 CTR: c00000000021f110
Jan 23 02:51:19 elm3b39 kernel: REGS: c0000000005fed30 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:19 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 44004024 XER: 20000020
Jan 23 02:51:19 elm3b39 kernel: TASK = c000000000555e50[0] 'swapper' THREAD: c0000000005fc000 CPU: 0
Jan 23 02:51:19 elm3b39 kernel: GPR00: 0000000000000001 c0000000005fefb0 c0000000005fa880 c0000000ccd47900
Jan 23 02:51:19 elm3b39 kernel: GPR04: c0000000cb463080 0000000000000001 0000000000000003 000000000000b5a2
Jan 23 02:51:19 elm3b39 kernel: GPR08: 0000000000000005 0000000000000008 0000000000000000 0000000000000001
Jan 23 02:51:19 elm3b39 kernel: GPR12: 0000000024002022 c000000000556700 0000000000000000 d000000000106000
Jan 23 02:51:19 elm3b39 kernel: GPR16: 0000000000000ce0 0000000000000000 000000007439ad1d c0000000cc198cc0
Jan 23 02:51:19 elm3b39 kernel: GPR20: c0000000ccb95700 c0000000ce176800 c00000000061e980 c00000000061fdd8
Jan 23 02:51:19 elm3b39 kernel: GPR24: c0000000cb7dec8e c0000000cb463080 c0000000ccd47900 0000000074399665
Jan 23 02:51:19 elm3b39 kernel: GPR28: 000000008638548c 0000000000000400 c0000000005c2e68 c0000000cb4630b8
Jan 23 02:51:19 elm3b39 kernel: NIP [c0000000003a0010] .tcp_ack+0x1e0/0x20d0
Jan 23 02:51:19 elm3b39 kernel: LR [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:19 elm3b39 kernel: Call Trace:
Jan 23 02:51:19 elm3b39 kernel: [c0000000005fefb0] [c00000000061e980] 0xc00000000061e980 (unreliable)
Jan 23 02:51:19 elm3b39 kernel: [c0000000005ff110] [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:19 elm3b39 kernel: [c0000000005ff1c0] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:19 elm3b39 kernel: [c0000000005ff280] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:19 elm3b39 kernel: [c0000000005ff340] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:19 elm3b39 kernel: [c0000000005ff3d0] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:19 elm3b39 kernel: [c0000000005ff4a0] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:19 elm3b39 kernel: [c0000000005ff580] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:19 elm3b39 kernel: [c0000000005ff690] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:19 elm3b39 kernel: [c0000000005ff740] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:19 elm3b39 kernel: [c0000000005ff800] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:19 elm3b39 kernel: [c0000000005ff8c0] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ff940] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ff9c0] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ffa40] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:20 elm3b39 kernel: --- Exception: 501 at .pseries_dedicated_idle_sleep+0xf0/0x1c0
Jan 23 02:51:20 elm3b39 kernel: LR = .pseries_dedicated_idle_sleep+0xe0/0x1c0
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ffd30] [000000000211e3d8] 0x211e3d8 (unreliable)
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ffdd0] [c000000000011fec] .cpu_idle+0x13c/0x250
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ffe60] [c000000000009b08] .rest_init+0x78/0x90
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ffee0] [c0000000004e8a24] .start_kernel+0x354/0x400
Jan 23 02:51:20 elm3b39 kernel: [c0000000005fff90] [c000000000008524] .start_here_common+0x54/0xb0
Jan 23 02:51:20 elm3b39 kernel: Instruction dump:
Jan 23 02:51:20 elm3b39 kernel: 813a046c f92100a0 7d283214 60000000 815a0560 e80100a0 f94100c0 7f890040
Jan 23 02:51:20 elm3b39 kernel: 7c000026 5400f7fe 817a0470 f96100a8 <0b000000> 7f43d378 4800efd9 60000000
Jan 23 02:51:20 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:20 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2855
Jan 23 02:51:20 elm3b39 kernel: NIP: c0000000003a0464 LR: c0000000003a0410 CTR: c00000000021f110
Jan 23 02:51:20 elm3b39 kernel: REGS: c0000000005fed30 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:20 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24048088 XER: 20000020
Jan 23 02:51:20 elm3b39 kernel: TASK = c000000000555e50[0] 'swapper' THREAD: c0000000005fc000 CPU: 0
Jan 23 02:51:20 elm3b39 kernel: GPR00: 0000000000000003 c0000000005fefb0 c0000000005fa880 0000000000000001
Jan 23 02:51:20 elm3b39 kernel: GPR04: c0000000cbf94300 0000000000000002 000000007439ad1d 0000000000000000
Jan 23 02:51:20 elm3b39 kernel: GPR08: c000000000556700 0000000000000001 c0000000cbf94080 0000000000000031
Jan 23 02:51:20 elm3b39 kernel: GPR12: 0000000000000000 c000000000556700 0000000000000000 00000000000127d9
Jan 23 02:51:20 elm3b39 kernel: GPR16: 0000000000000001 c0000000ccd479c8 000000007439ad1d 0000000000000001
Jan 23 02:51:20 elm3b39 kernel: GPR20: 00000000000000b7 00000000000000b6 0000000000000005 000000000000000c
Jan 23 02:51:20 elm3b39 kernel: GPR24: 000000007439ad1d 0000000000000004 c0000000ccd47900 c0000000cbf94338
Jan 23 02:51:20 elm3b39 kernel: GPR28: 0000000000000001 0000000000000005 c0000000005c2e68 c0000000cbb50580
Jan 23 02:51:20 elm3b39 kernel: NIP [c0000000003a0464] .tcp_ack+0x634/0x20d0
Jan 23 02:51:20 elm3b39 kernel: LR [c0000000003a0410] .tcp_ack+0x5e0/0x20d0
Jan 23 02:51:20 elm3b39 kernel: Call Trace:
Jan 23 02:51:20 elm3b39 kernel: [c0000000005fefb0] [c0000000003a0410] .tcp_ack+0x5e0/0x20d0 (unreliable)
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ff110] [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ff1c0] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ff280] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ff340] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ff3d0] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ff4a0] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ff580] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ff690] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ff740] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ff800] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ff8c0] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ff940] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ff9c0] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ffa40] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:20 elm3b39 kernel: --- Exception: 501 at .pseries_dedicated_idle_sleep+0xf0/0x1c0
Jan 23 02:51:20 elm3b39 kernel: LR = .pseries_dedicated_idle_sleep+0xe0/0x1c0
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ffd30] [000000000211e3d8] 0x211e3d8 (unreliable)
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ffdd0] [c000000000011fec] .cpu_idle+0x13c/0x250
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ffe60] [c000000000009b08] .rest_init+0x78/0x90
Jan 23 02:51:20 elm3b39 kernel: [c0000000005ffee0] [c0000000004e8a24] .start_kernel+0x354/0x400
Jan 23 02:51:20 elm3b39 kernel: [c0000000005fff90] [c000000000008524] .start_here_common+0x54/0xb0
Jan 23 02:51:20 elm3b39 kernel: Instruction dump:
Jan 23 02:51:20 elm3b39 kernel: 41920010 e81a01d8 7fbf0000 409efdb0 80fa046c 7eddb378 813a055c 801a0558
Jan 23 02:51:20 elm3b39 kernel: 7c004a14 7f870040 7d200026 5529effe <0b090000> 7f43d378 4800eb85 60000000
Jan 23 02:51:20 elm3b39 kernel: .start_secondary_prolog+0xc/0x10
Jan 23 02:51:20 elm3b39 kernel: Instruction dump:
Jan 23 02:51:20 elm3b39 kernel: e92b00a8 7d295214 a1690008 7c0b0050 901f0470 801f055c 813f0558 817f046c
Jan 23 02:51:20 elm3b39 kernel: 7d290214 7f895840 7c000026 5400f7fe <0b000000> 7fe3fb78 4800a6d1 60000000
Jan 23 02:51:20 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:20 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:3184
Jan 23 02:51:20 elm3b39 kernel: NIP: c0000000003a0010 LR: c0000000003a5d54 CTR: c00000000021f110
Jan 23 02:51:21 elm3b39 kernel: REGS: c0000000005fed30 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:21 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 44004024 XER: 20000020
Jan 23 02:51:21 elm3b39 kernel: TASK = c000000000555e50[0] 'swapper' THREAD: c0000000005fc000 CPU: 0
Jan 23 02:51:21 elm3b39 kernel: GPR00: 0000000000000001 c0000000005fefb0 c0000000005fa880 c0000000c725f900
Jan 23 02:51:21 elm3b39 kernel: GPR04: c0000000cb463d80 0000000000000001 0000000000000003 000000000000b5b2
Jan 23 02:51:21 elm3b39 kernel: GPR08: 0000000000000005 0000000000000008 0000000000000000 0000000000000001
Jan 23 02:51:21 elm3b39 kernel: GPR12: 0000000024002022 c000000000556700 0000000000000000 d000000000106000
Jan 23 02:51:21 elm3b39 kernel: GPR16: 0000000000001ba0 0000000000000000 0000000074ce71d6 c0000000cc198cc0
Jan 23 02:51:21 elm3b39 kernel: GPR20: c0000000ccb95700 c0000000ce176800 c00000000061e980 c00000000061fdd8
Jan 23 02:51:21 elm3b39 kernel: GPR24: c0000000c7687c8e c0000000cb463d80 c0000000c725f900 0000000074ce5b1e
Jan 23 02:51:21 elm3b39 kernel: GPR28: 00000000868ec881 0000000000000400 c0000000005c2e68 c0000000cb463db8
Jan 23 02:51:21 elm3b39 kernel: NIP [c0000000003a0010] .tcp_ack+0x1e0/0x20d0
Jan 23 02:51:21 elm3b39 kernel: LR [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:21 elm3b39 kernel: Call Trace:
Jan 23 02:51:21 elm3b39 kernel: [c0000000005fefb0] [c00000000061e980] 0xc00000000061e980 (unreliable)
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ff110] [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ff1c0] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ff280] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ff340] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ff3d0] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ff4a0] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ff580] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ff690] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ff740] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ff800] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ff8c0] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ff940] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ff9c0] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ffa40] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:21 elm3b39 kernel: --- Exception: 501 at .pseries_dedicated_idle_sleep+0xf0/0x1c0
Jan 23 02:51:21 elm3b39 kernel: LR = .pseries_dedicated_idle_sleep+0xe0/0x1c0
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ffd30] [000000000211e3d8] 0x211e3d8 (unreliable)
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ffdd0] [c000000000011fec] .cpu_idle+0x13c/0x250
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ffe60] [c000000000009b08] .rest_init+0x78/0x90
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ffee0] [c0000000004e8a24] .start_kernel+0x354/0x400
Jan 23 02:51:21 elm3b39 kernel: [c0000000005fff90] [c000000000008524] .start_here_common+0x54/0xb0
Jan 23 02:51:21 elm3b39 kernel: Instruction dump:
Jan 23 02:51:21 elm3b39 kernel: 813a046c f92100a0 7d283214 60000000 815a0560 e80100a0 f94100c0 7f890040
Jan 23 02:51:21 elm3b39 kernel: 7c000026 5400f7fe 817a0470 f96100a8 <0b000000> 7f43d378 4800efd9 60000000
Jan 23 02:51:21 elm3b39 kernel: ------------[ cut here ]------------
Jan 23 02:51:21 elm3b39 kernel: Badness at net/ipv4/tcp_input.c:2855
Jan 23 02:51:21 elm3b39 kernel: NIP: c0000000003a0464 LR: c0000000003a0410 CTR: c00000000021f110
Jan 23 02:51:21 elm3b39 kernel: REGS: c0000000005fed30 TRAP: 0700 Not tainted (2.6.24-rc7)
Jan 23 02:51:21 elm3b39 kernel: MSR: 8000000000029032 <EE,ME,IR,DR> CR: 24048088 XER: 20000020
Jan 23 02:51:21 elm3b39 kernel: TASK = c000000000555e50[0] 'swapper' THREAD: c0000000005fc000 CPU: 0
Jan 23 02:51:21 elm3b39 kernel: GPR00: 0000000000000003 c0000000005fefb0 c0000000005fa880 0000000000000001
Jan 23 02:51:21 elm3b39 kernel: GPR04: c0000000cb8e7100 0000000000000002 0000000074ce71d6 0000000000000000
Jan 23 02:51:21 elm3b39 kernel: GPR08: c000000000556700 0000000000000001 c0000000cb8e7080 000000000000002b
Jan 23 02:51:21 elm3b39 kernel: GPR12: 0000000000000000 c000000000556700 0000000000000000 0000000000012801
Jan 23 02:51:21 elm3b39 kernel: GPR16: 0000000000000001 c0000000c725f9c8 0000000074ce71d6 0000000000000001
Jan 23 02:51:21 elm3b39 kernel: GPR20: 00000000000000df 0000000000000090 0000000000000005 000000000000000c
Jan 23 02:51:21 elm3b39 kernel: GPR24: 0000000074ce71d6 0000000000000004 c0000000c725f900 c0000000cb8e7138
Jan 23 02:51:21 elm3b39 kernel: GPR28: 0000000000000001 0000000000000005 c0000000005c2e68 c0000000cb9acb80
Jan 23 02:51:21 elm3b39 kernel: NIP [c0000000003a0464] .tcp_ack+0x634/0x20d0
Jan 23 02:51:21 elm3b39 kernel: LR [c0000000003a0410] .tcp_ack+0x5e0/0x20d0
Jan 23 02:51:21 elm3b39 kernel: Call Trace:
Jan 23 02:51:21 elm3b39 kernel: [c0000000005fefb0] [c0000000003a0410] .tcp_ack+0x5e0/0x20d0 (unreliable)
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ff110] [c0000000003a5d54] .tcp_rcv_established+0x324/0x8f0
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ff1c0] [c0000000003ae204] .tcp_v4_do_rcv+0x134/0x2a0
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ff280] [c0000000003b0c48] .tcp_v4_rcv+0x8a8/0x8d0
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ff340] [c00000000038a870] .ip_local_deliver+0xf0/0x2d0
Jan 23 02:51:21 elm3b39 kernel: [c0000000005ff3d0] [c00000000038ad84] .ip_rcv+0x334/0x6d0
Jan 23 02:51:22 elm3b39 kernel: [c0000000005ff4a0] [c000000000359e7c] .netif_receive_skb+0x32c/0x630
Jan 23 02:51:22 elm3b39 kernel: [c0000000005ff580] [d00000000020d540] .e1000_clean_rx_irq+0x250/0x6c0 [e1000]
Jan 23 02:51:22 elm3b39 kernel: [c0000000005ff690] [d0000000002086c4] .e1000_clean+0x74/0x310 [e1000]
Jan 23 02:51:22 elm3b39 kernel: [c0000000005ff740] [c00000000035d670] .net_rx_action+0x1f0/0x300
Jan 23 02:51:22 elm3b39 kernel: [c0000000005ff800] [c00000000005af78] .__do_softirq+0xe8/0x1e0
Jan 23 02:51:22 elm3b39 kernel: [c0000000005ff8c0] [c00000000000c4a4] .do_softirq+0x64/0xa0
Jan 23 02:51:22 elm3b39 kernel: [c0000000005ff940] [c00000000005b134] .irq_exit+0x74/0x90
Jan 23 02:51:22 elm3b39 kernel: [c0000000005ff9c0] [c00000000000cd90] .do_IRQ+0xe0/0x120
Jan 23 02:51:22 elm3b39 kernel: [c0000000005ffa40] [c000000000004780] hardware_interrupt_entry+0x18/0x98
Jan 23 02:51:22 elm3b39 kernel: --- Exception: 501 at .pseries_dedicated_idle_sleep+0xf0/0x1c0
Jan 23 02:51:22 elm3b39 kernel: LR = .pseries_dedicated_idle_sleep+0xe0/0x1c0
Jan 23 02:51:22 elm3b39 kernel: [c0000000005ffd30] [000000000211e3d8] 0x211e3d8 (unreliable)
Jan 23 02:51:22 elm3b39 kernel: [c0000000005ffdd0] [c000000000011fec] .cpu_idle+0x13c/0x250
Jan 23 02:51:22 elm3b39 kernel: [c0000000005ffe60] [c000000000009b08] .rest_init+0x78/0x90
Jan 23 02:51:22 elm3b39 kernel: [c0000000005ffee0] [c0000000004e8a24] .start_kernel+0x354/0x400
Jan 23 02:51:22 elm3b39 kernel: [c0000000005fff90] [c000000000008524] .start_here_common+0x54/0xb0
Jan 23 02:51:22 elm3b39 kernel: Instruction dump:
Jan 23 02:51:22 elm3b39 kernel: 41920010 e81a01d8 7fbf0000 409efdb0 80fa046c 7eddb378 813a055c 801a0558
Jan 23 02:51:22 elm3b39 kernel: 7c004a14 7f870040 7d200026 5529effe <0b090000> 7f43d378 4800eb85 60000000
^ permalink raw reply
* Re: Assertions in latest kernels
From: David Miller @ 2008-01-23 11:06 UTC (permalink / raw)
To: ilpo.jarvinen; +Cc: krkumar2, netdev
In-Reply-To: <Pine.LNX.4.64.0801231215250.31652@kivilampi-30.cs.helsinki.fi>
From: "Ilpo_Järvinen" <ilpo.jarvinen@helsinki.fi>
Date: Wed, 23 Jan 2008 12:49:31 +0200 (EET)
> On Wed, 23 Jan 2008, Ilpo Järvinen wrote:
>
> Hmm, perhaps it could be something related to this (and some untested
> path somewhere which is now exposed):
>
> commit 4a55b553f691abadaa63570dfc714e20913561c1
> Author: Ilpo Järvinen <ilpo.jarvinen@helsinki.fi>
> Date: Thu Dec 20 20:36:03 2007 -0800
>
> [TCP]: Fix TSO deferring
>
> Dave, what do you think? Wouldn't explain the one -rc only report though
> from Denys. Another one I'm a bit unsure of is this:
Right, this would be something to consider for the net-2.6.25
and thus -mm cases, but not for 2.6.24* since this patch didn't
go there.
I don't see how this change could matter offhand. Even with that
incorrect TSO test, the same set of write queue configurations can
still occur just some less likely than after the patch.
I would expect the usual global test coverage to narrow that gap.
> commit 757c32944b80fd95542bd66f06032ab773034d53
> Author: Ilpo Järvinen <ilpo.jarvinen@helsinki.fi>
> Date: Thu Jan 3 20:39:01 2008 -0800
>
> [TCP]: Perform setting of common control fields in one place
>
> ->sacked field is cleared in tcp_retransmit_skb due to a subtle change,
> which might be buggy.... However, I find it rather unlikely that this
> would explain Kumar's case. Anyway, here's the one that reverts the
> problematic part of it. ...and this is net-2.6.25 as well so it won't
> solve Denys' case either.
I also suspect this one isn't the cause.
I think we'll be better off once we get some more data,
and therefore be able to make more correlations between
the various failures.
Anyways your patch here is a good start as it will provable
eliminate this as a possibility.
^ permalink raw reply
page: next (older) | prev (newer) | latest
- recent:[subjects (threaded)|topics (new)|topics (active)]
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox