All of lore.kernel.org
 help / color / mirror / Atom feed
From: Ben Greear <greearb@candelatech.com>
To: ath9k-devel@lists.ath9k.org
Subject: [ath9k-devel] Anyone doing WiFi throughput tests?
Date: Tue, 29 May 2012 20:47:09 -0700	[thread overview]
Message-ID: <4FC5983D.3080806@candelatech.com> (raw)
In-Reply-To: <CAA93jw6jTDCLh+_=hv6HcvfAuNah33uag7hHnZTMW8=92nvcqA@mail.gmail.com>

On 05/29/2012 08:22 PM, Dave Taht wrote:
> On Wed, May 30, 2012 at 1:06 AM, Ben Greear<greearb@candelatech.com>  wrote:
>> On 05/29/2012 12:07 PM, Christian Lamparter wrote:
>>>
>>> On Tuesday, May 29, 2012 08:23:20 PM Ben Greear wrote:
>>>>
>>>> On 05/27/2012 08:08 AM, Ben Greear wrote:
>>>>>
>>>>> On 05/26/2012 09:39 AM, Sujith Manoharan wrote:
>>>>
>>>> We started testing with two AR9380 NICs today (one AP, the other STA).
>>>> I applied Felix's skb optimization patch, and the ath9k memleak fix patch
>>>> on top of 3.3.7+.
>>>>
>>>> The system has 2GB RAM, but it is 32-bit kernel, so not all
>>>> is available to the networking code...  That said, the OOM
>>>> killer kills VNC and such.
>>>>
>>>> Anyway, I'll try some memleak debugging to see if
>>>> I can find any leaks.  It seems to me that we should
>>>> not actually OOM just by trying to transmit too fast
>>>> on a station interface :P
>>>
>>> well, there's that:
>>> http://comments.gmane.org/gmane.linux.drivers.ath9k.devel/8233
>>>
>>> It might not fix the bug, but it can save you time to confirm
>>> that is not related to this particular skb leak.
>>
>>
>> I ported this to 3.3.7+ and applied it to my kernel
>> trees.  It has tested out fine so far, though it did not
>> actually fix the problem I was having.  That was not
>> a real leak, just always-growing pending queue length,
>> probably due to some issue with our version of pktgen.
>>
>> It is mostly a port-by-hand type of thing since
>> there are lots of conflicts.  Let me know if you'd
>> like me to post my version (and plz confirm your
>> signed-off-by).
>
> please! (and cc cerowrt-devel at lists.bufferbloat.net)
>
> I'm hoping this string of patches will have some bearing on my own
> bug: http://www.bufferbloat.net/issues/379
>
> (while I'm trying to not write a line of code for a while, others on my
>   list are struggling with this)

For your bug, do you get any warnings on a serial console?

What does 'top' show?  Ie, why is the load so high?  Just
flogging the kernel with pkts shouldn't explode the load.

Maybe processes are blocked trying to take a lock..maybe
a networking lock?

Tried enabling lockdep in this scenario, and maybe the
hard/soft deadlock detection logic?

If you back off the traffic, does the system recover?  If so,
maybe your CPU just can't handle the load....

If you think the mac80211 pending queues are backing up, cat out
/debug/ieee*/phy*/queues

That was the symptom I saw today with pktgen, but I think that is probably
more the fault of pktgen and may not be an issue with more normal traffic
flow.

Thanks,
Ben


-- 
Ben Greear <greearb@candelatech.com>
Candela Technologies Inc  http://www.candelatech.com

WARNING: multiple messages have this Message-ID (diff)
From: Ben Greear <greearb@candelatech.com>
To: Dave Taht <dave.taht@gmail.com>
Cc: cerowrt-devel@lists.bufferbloat.net,
	Christian Lamparter <chunkeey@googlemail.com>,
	Sujith Manoharan <c_manoha@qca.qualcomm.com>,
	"ath9k-devel@lists.ath9k.org" <ath9k-devel@venema.h4ckr.net>,
	"linux-wireless@vger.kernel.org" <linux-wireless@vger.kernel.org>
Subject: Re: [ath9k-devel] Anyone doing WiFi throughput tests?
Date: Tue, 29 May 2012 20:47:09 -0700	[thread overview]
Message-ID: <4FC5983D.3080806@candelatech.com> (raw)
In-Reply-To: <CAA93jw6jTDCLh+_=hv6HcvfAuNah33uag7hHnZTMW8=92nvcqA@mail.gmail.com>

On 05/29/2012 08:22 PM, Dave Taht wrote:
> On Wed, May 30, 2012 at 1:06 AM, Ben Greear<greearb@candelatech.com>  wrote:
>> On 05/29/2012 12:07 PM, Christian Lamparter wrote:
>>>
>>> On Tuesday, May 29, 2012 08:23:20 PM Ben Greear wrote:
>>>>
>>>> On 05/27/2012 08:08 AM, Ben Greear wrote:
>>>>>
>>>>> On 05/26/2012 09:39 AM, Sujith Manoharan wrote:
>>>>
>>>> We started testing with two AR9380 NICs today (one AP, the other STA).
>>>> I applied Felix's skb optimization patch, and the ath9k memleak fix patch
>>>> on top of 3.3.7+.
>>>>
>>>> The system has 2GB RAM, but it is 32-bit kernel, so not all
>>>> is available to the networking code...  That said, the OOM
>>>> killer kills VNC and such.
>>>>
>>>> Anyway, I'll try some memleak debugging to see if
>>>> I can find any leaks.  It seems to me that we should
>>>> not actually OOM just by trying to transmit too fast
>>>> on a station interface :P
>>>
>>> well, there's that:
>>> http://comments.gmane.org/gmane.linux.drivers.ath9k.devel/8233
>>>
>>> It might not fix the bug, but it can save you time to confirm
>>> that is not related to this particular skb leak.
>>
>>
>> I ported this to 3.3.7+ and applied it to my kernel
>> trees.  It has tested out fine so far, though it did not
>> actually fix the problem I was having.  That was not
>> a real leak, just always-growing pending queue length,
>> probably due to some issue with our version of pktgen.
>>
>> It is mostly a port-by-hand type of thing since
>> there are lots of conflicts.  Let me know if you'd
>> like me to post my version (and plz confirm your
>> signed-off-by).
>
> please! (and cc cerowrt-devel at lists.bufferbloat.net)
>
> I'm hoping this string of patches will have some bearing on my own
> bug: http://www.bufferbloat.net/issues/379
>
> (while I'm trying to not write a line of code for a while, others on my
>   list are struggling with this)

For your bug, do you get any warnings on a serial console?

What does 'top' show?  Ie, why is the load so high?  Just
flogging the kernel with pkts shouldn't explode the load.

Maybe processes are blocked trying to take a lock..maybe
a networking lock?

Tried enabling lockdep in this scenario, and maybe the
hard/soft deadlock detection logic?

If you back off the traffic, does the system recover?  If so,
maybe your CPU just can't handle the load....

If you think the mac80211 pending queues are backing up, cat out
/debug/ieee*/phy*/queues

That was the symptom I saw today with pktgen, but I think that is probably
more the fault of pktgen and may not be an issue with more normal traffic
flow.

Thanks,
Ben


-- 
Ben Greear <greearb@candelatech.com>
Candela Technologies Inc  http://www.candelatech.com

  reply	other threads:[~2012-05-30  3:47 UTC|newest]

Thread overview: 90+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2012-05-26  3:17 [ath9k-devel] Anyone doing WiFi throughput tests? Ben Greear
2012-05-26  3:17 ` Ben Greear
2012-05-26  3:24 ` [ath9k-devel] " Sujith Manoharan
2012-05-26  3:24   ` Sujith Manoharan
2012-05-26  5:48   ` [ath9k-devel] " Joe Semler
2012-05-26  5:48     ` Joe Semler
2012-05-26  7:43     ` Sujith Manoharan
2012-05-26  7:43       ` Sujith Manoharan
2012-05-26  7:55       ` Josef Semler
2012-05-26 11:28         ` Sujith Manoharan
2012-05-26 11:28           ` Sujith Manoharan
2012-05-26 12:35         ` Felix Fietkau
2012-05-26 12:35           ` Felix Fietkau
2012-05-26 17:15           ` Joe Semler
2012-05-26 17:15             ` Joe Semler
2012-05-26 17:50             ` Adrian Chadd
2012-05-26 17:50               ` Adrian Chadd
2012-05-29 10:24               ` Josef Semler
2012-05-29 10:58                 ` Felix Fietkau
2012-05-29 10:58                   ` Felix Fietkau
2012-05-26 18:27             ` Felix Fietkau
2012-05-26 18:27               ` Felix Fietkau
2012-05-26 15:37   ` Ben Greear
2012-05-26 15:37     ` Ben Greear
2012-05-26 16:24     ` [ath9k-devel] " Sujith Manoharan
2012-05-26 16:24       ` Sujith Manoharan
2012-05-26 16:39       ` [ath9k-devel] " Sujith Manoharan
2012-05-26 16:39         ` Sujith Manoharan
2012-05-27 15:08         ` [ath9k-devel] " Ben Greear
2012-05-27 15:08           ` Ben Greear
2012-05-27 16:48           ` [ath9k-devel] " Peter Stuge
2012-05-27 17:38             ` Adrian Chadd
2012-05-27 17:40           ` Adrian Chadd
2012-05-27 17:40             ` Adrian Chadd
2012-05-27 18:14             ` [ath9k-devel] " Felix Fietkau
2012-05-27 18:14               ` Felix Fietkau
2012-05-27 23:15               ` [ath9k-devel] " Adrian Chadd
2012-05-27 23:15                 ` Adrian Chadd
2012-05-27 23:29                 ` [ath9k-devel] " Felix Fietkau
2012-05-27 23:29                   ` Felix Fietkau
2012-05-28  3:55             ` [ath9k-devel] " Ben Greear
2012-05-28  3:55               ` Ben Greear
2012-05-28  6:50               ` [ath9k-devel] " Adrian Chadd
2012-05-28  6:50                 ` Adrian Chadd
2012-05-28  7:15                 ` [ath9k-devel] " Sujith Manoharan
2012-05-28  7:15                   ` Sujith Manoharan
2012-05-28 20:07                   ` [ath9k-devel] " Adrian Chadd
2012-05-28 20:07                     ` Adrian Chadd
2012-05-31 19:24                     ` [ath9k-devel] " Adrian Chadd
2012-05-31 19:24                       ` Adrian Chadd
2012-05-31 22:31                       ` [ath9k-devel] " Ben Greear
2012-05-31 22:31                         ` Ben Greear
2012-05-29 18:23           ` [ath9k-devel] " Ben Greear
2012-05-29 18:23             ` Ben Greear
2012-05-29 19:07             ` Christian Lamparter
2012-05-29 19:07               ` Christian Lamparter
2012-05-29 19:19               ` Ben Greear
2012-05-29 19:19                 ` Ben Greear
2012-05-30  0:06               ` Ben Greear
2012-05-30  0:06                 ` Ben Greear
2012-05-30  3:22                 ` Dave Taht
2012-05-30  3:22                   ` Dave Taht
2012-05-30  3:47                   ` Ben Greear [this message]
2012-05-30  3:47                     ` Ben Greear
2012-05-31  2:29             ` Sujith Manoharan
2012-05-31  2:29               ` Sujith Manoharan
2012-05-26 17:58     ` Christian Lamparter
2012-05-26 17:58       ` Christian Lamparter
2012-05-29  8:14       ` [ath9k-devel] " Zefir Kurtisi
2012-05-29  8:14         ` Zefir Kurtisi
2012-05-29 10:09         ` [ath9k-devel] " Peter Stuge
2012-05-26 17:56 ` Adrian Chadd
2012-05-26 17:56   ` Adrian Chadd
2012-05-27  2:05   ` [ath9k-devel] " Sujith Manoharan
2012-05-27  2:05     ` Sujith Manoharan
2012-05-27  2:09     ` [ath9k-devel] " Sujith Manoharan
2012-05-27  2:09       ` Sujith Manoharan
2012-05-27  2:16       ` Ben Greear
2012-05-27  2:16         ` Ben Greear
2012-05-27  2:23         ` Sujith Manoharan
2012-05-27  2:23           ` Sujith Manoharan
2012-05-27 11:30       ` Felix Fietkau
2012-05-27 11:30         ` Felix Fietkau
2012-05-27 12:32       ` Adrian Chadd
2012-05-27 12:32         ` Adrian Chadd
2012-05-27 12:31     ` Adrian Chadd
2012-05-27 12:31       ` Adrian Chadd
2012-06-15 21:08   ` [ath9k-devel] " Stephen Donecker
2012-06-16 21:03     ` Adrian Chadd
2012-06-20  2:20       ` Stephen Donecker

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4FC5983D.3080806@candelatech.com \
    --to=greearb@candelatech.com \
    --cc=ath9k-devel@lists.ath9k.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.