* TUN device performance regression
@ 2014-04-14 11:31 Martin Filip
2014-04-14 11:42 ` Martin Filip
0 siblings, 1 reply; 6+ messages in thread
From: Martin Filip @ 2014-04-14 11:31 UTC (permalink / raw)
To: netdev
[-- Attachment #1: Type: text/plain, Size: 580 bytes --]
Hello,
I've noticed significant TUN device performance drop between 3.13 and
3.14 kernels, problem seems to persist until current git version.
With good kernel I can achieve full 100mbps through openvpn without any
problem, with problematic kernel TX performance drops down to ~50kbps.
According to git bisect it seems that root of all evil is commit
53d6471cef17262d3ad1c7ce8982a234244f68ec.
I can confirm that performance is great again with current kernel when I
revert this one.
--
Martin Filip
e-mail: nexus@smoula.net
jabberID: nexus@smoula.net
http://www.smoula.net
[-- Attachment #2: bisect.log --]
[-- Type: text/x-log, Size: 2994 bytes --]
git bisect start
# bad: [c9eaa447e77efe77b7fa4c953bd62de8297fd6c5] Linux 3.15-rc1
git bisect bad c9eaa447e77efe77b7fa4c953bd62de8297fd6c5
# good: [d8ec26d7f8287f5788a494f56e8814210f0e64be] Linux 3.13
git bisect good d8ec26d7f8287f5788a494f56e8814210f0e64be
# good: [d265d9ac6c7c3201f0fea737cdf9c74e50415178] [media] exynos4-is: Use external s5k6a3 sensor driver
git bisect good d265d9ac6c7c3201f0fea737cdf9c74e50415178
# bad: [ec0159503ae74aeb834e78366bdf4b9663ca1129] hwmon: (k10temp) Add support for AMD F16 M30h processor
git bisect bad ec0159503ae74aeb834e78366bdf4b9663ca1129
# bad: [c70929147a10fa4538886cb23b934b509c4c0e49] Merge tag 'sound-3.15-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/tiwai/sound
git bisect bad c70929147a10fa4538886cb23b934b509c4c0e49
# bad: [683b6c6f82a60fabf47012581c2cfbf1b037ab95] Merge branch 'irq-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect bad 683b6c6f82a60fabf47012581c2cfbf1b037ab95
# bad: [462bf234a82ae1ae9d7628f59bc81022591e1348] Merge branch 'core-locking-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect bad 462bf234a82ae1ae9d7628f59bc81022591e1348
# good: [8712a00514e50aafa7c9bf5cd3955fa60758e53b] Merge branch 'akpm' (patches from Andrew Morton)
git bisect good 8712a00514e50aafa7c9bf5cd3955fa60758e53b
# good: [92f99731e61a3487781762d4e6ae8b1576e68e07] Merge tag 'sound-3.14' of git://git.kernel.org/pub/scm/linux/kernel/git/tiwai/sound
git bisect good 92f99731e61a3487781762d4e6ae8b1576e68e07
# good: [f217c44ebd41ce7369d2df07622b2839479183b0] Merge tag 'trace-fixes-v3.14-rc7-v2' of git://git.kernel.org/pub/scm/linux/kernel/git/rostedt/linux-trace
git bisect good f217c44ebd41ce7369d2df07622b2839479183b0
# bad: [49d8137a4039c63c834827f4bfe875e27bb9c521] Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net
git bisect bad 49d8137a4039c63c834827f4bfe875e27bb9c521
# bad: [fc92f745f8d0d3736ce5afb00a905d7cc61f9c46] bridge: Fix crash with vlan filtering and tcpdump
git bisect bad fc92f745f8d0d3736ce5afb00a905d7cc61f9c46
# good: [97a5221f56bad2e1c7e8ab55da4ac4748ef59c64] net/mlx4_core: pass pci_device_id.driver_data to __mlx4_init_one during reset
git bisect good 97a5221f56bad2e1c7e8ab55da4ac4748ef59c64
# good: [99b192da9c99284ad3374132e56f66995cadc6b4] bridge: Fix handling stacked vlan tags
git bisect good 99b192da9c99284ad3374132e56f66995cadc6b4
# good: [c15b1ccadb323ea50023e8f1cca2954129a62b51] ipv6: move DAD and addrconf_verify processing to workqueue
git bisect good c15b1ccadb323ea50023e8f1cca2954129a62b51
# good: [898602a049504dea256e696ee3152dc0b788a393] MAINTAINERS: bonding: change email address
git bisect good 898602a049504dea256e696ee3152dc0b788a393
# bad: [53d6471cef17262d3ad1c7ce8982a234244f68ec] net: Account for all vlan headers in skb_mac_gso_segment
git bisect bad 53d6471cef17262d3ad1c7ce8982a234244f68ec
# first bad commit: [53d6471cef17262d3ad1c7ce8982a234244f68ec] net: Account for all vlan headers in skb_mac_gso_segment
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: TUN device performance regression
2014-04-14 11:31 TUN device performance regression Martin Filip
@ 2014-04-14 11:42 ` Martin Filip
2014-04-14 13:54 ` Vlad Yasevich
2014-04-14 14:43 ` Vlad Yasevich
0 siblings, 2 replies; 6+ messages in thread
From: Martin Filip @ 2014-04-14 11:42 UTC (permalink / raw)
To: netdev
> Hello,
>
> I've noticed significant TUN device performance drop between 3.13 and
> 3.14 kernels, problem seems to persist until current git version.
>
> With good kernel I can achieve full 100mbps through openvpn without any
> problem, with problematic kernel TX performance drops down to ~50kbps.
>
> According to git bisect it seems that root of all evil is commit
> 53d6471cef17262d3ad1c7ce8982a234244f68ec.
>
> I can confirm that performance is great again with current kernel when I
> revert this one.
>
I've forgot to mention kernel bug:
https://bugzilla.kernel.org/show_bug.cgi?id=74051
--
Martin Filip
e-mail: nexus@smoula.net
jabberID: nexus@smoula.net
http://www.smoula.net
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: TUN device performance regression
2014-04-14 11:42 ` Martin Filip
@ 2014-04-14 13:54 ` Vlad Yasevich
2014-04-14 14:43 ` Vlad Yasevich
1 sibling, 0 replies; 6+ messages in thread
From: Vlad Yasevich @ 2014-04-14 13:54 UTC (permalink / raw)
To: Martin Filip, netdev
On 04/14/2014 07:42 AM, Martin Filip wrote:
>> Hello,
>>
>> I've noticed significant TUN device performance drop between 3.13 and
>> 3.14 kernels, problem seems to persist until current git version.
>>
>> With good kernel I can achieve full 100mbps through openvpn without any
>> problem, with problematic kernel TX performance drops down to ~50kbps.
>>
>> According to git bisect it seems that root of all evil is commit
>> 53d6471cef17262d3ad1c7ce8982a234244f68ec.
>>
>> I can confirm that performance is great again with current kernel when I
>> revert this one.
>>
> I've forgot to mention kernel bug:
> https://bugzilla.kernel.org/show_bug.cgi?id=74051
>
Thanks for the report. I am taking a look.
-vlad
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: TUN device performance regression
2014-04-14 11:42 ` Martin Filip
2014-04-14 13:54 ` Vlad Yasevich
@ 2014-04-14 14:43 ` Vlad Yasevich
2014-04-14 14:51 ` Martin Filip
2014-04-21 14:00 ` Marc Haber
1 sibling, 2 replies; 6+ messages in thread
From: Vlad Yasevich @ 2014-04-14 14:43 UTC (permalink / raw)
To: Martin Filip, netdev
On 04/14/2014 07:42 AM, Martin Filip wrote:
>> Hello,
>>
>> I've noticed significant TUN device performance drop between 3.13 and
>> 3.14 kernels, problem seems to persist until current git version.
>>
>> With good kernel I can achieve full 100mbps through openvpn without any
>> problem, with problematic kernel TX performance drops down to ~50kbps.
>>
>> According to git bisect it seems that root of all evil is commit
>> 53d6471cef17262d3ad1c7ce8982a234244f68ec.
>>
>> I can confirm that performance is great again with current kernel when I
>> revert this one.
>>
> I've forgot to mention kernel bug:
> https://bugzilla.kernel.org/show_bug.cgi?id=74051
>
Could you please try this patch.
---
net/core/dev.c | 2 +-
1 files changed, 1 insertions(+), 1 deletions(-)
diff --git a/net/core/dev.c b/net/core/dev.c
index 45fa2f1..6088927 100644
--- a/net/core/dev.c
+++ b/net/core/dev.c
@@ -2289,7 +2289,7 @@ EXPORT_SYMBOL(skb_checksum_help);
__be16 skb_network_protocol(struct sk_buff *skb, int *depth)
{
__be16 type = skb->protocol;
- int vlan_depth = ETH_HLEN;
+ int vlan_depth = skb->mac_len;
/* Tunnel gso handlers can set protocol to ethernet. */
if (type == htons(ETH_P_TEB)) {
^ permalink raw reply related [flat|nested] 6+ messages in thread* Re: TUN device performance regression
2014-04-14 14:43 ` Vlad Yasevich
@ 2014-04-14 14:51 ` Martin Filip
2014-04-21 14:00 ` Marc Haber
1 sibling, 0 replies; 6+ messages in thread
From: Martin Filip @ 2014-04-14 14:51 UTC (permalink / raw)
To: Vlad Yasevich; +Cc: netdev
Vlad Yasevich píše v Po 14. 04. 2014 v 10:43 -0400:
> On 04/14/2014 07:42 AM, Martin Filip wrote:
> >> Hello,
> >>
> >> I've noticed significant TUN device performance drop between 3.13 and
> >> 3.14 kernels, problem seems to persist until current git version.
> >>
> >> With good kernel I can achieve full 100mbps through openvpn without any
> >> problem, with problematic kernel TX performance drops down to ~50kbps.
> >>
> >> According to git bisect it seems that root of all evil is commit
> >> 53d6471cef17262d3ad1c7ce8982a234244f68ec.
> >>
> >> I can confirm that performance is great again with current kernel when I
> >> revert this one.
> >>
> > I've forgot to mention kernel bug:
> > https://bugzilla.kernel.org/show_bug.cgi?id=74051
> >
>
> Could you please try this patch.
>
> ---
> net/core/dev.c | 2 +-
> 1 files changed, 1 insertions(+), 1 deletions(-)
>
> diff --git a/net/core/dev.c b/net/core/dev.c
> index 45fa2f1..6088927 100644
> --- a/net/core/dev.c
> +++ b/net/core/dev.c
> @@ -2289,7 +2289,7 @@ EXPORT_SYMBOL(skb_checksum_help);
> __be16 skb_network_protocol(struct sk_buff *skb, int *depth)
> {
> __be16 type = skb->protocol;
> - int vlan_depth = ETH_HLEN;
> + int vlan_depth = skb->mac_len;
>
> /* Tunnel gso handlers can set protocol to ethernet. */
> if (type == htons(ETH_P_TEB)) {
Hello,
thank you for your quick response. This seems to fix the problem, my
test case worked fine with it!
--
Martin Filip
e-mail: nexus@smoula.net
jabberID: nexus@smoula.net
http://www.smoula.net
^ permalink raw reply [flat|nested] 6+ messages in thread* Re: TUN device performance regression
2014-04-14 14:43 ` Vlad Yasevich
2014-04-14 14:51 ` Martin Filip
@ 2014-04-21 14:00 ` Marc Haber
1 sibling, 0 replies; 6+ messages in thread
From: Marc Haber @ 2014-04-21 14:00 UTC (permalink / raw)
To: Vlad Yasevich; +Cc: Martin Filip, netdev
On Mon, Apr 14, 2014 at 10:43:14AM -0400, Vlad Yasevich wrote:
> Could you please try this patch.
I was recently bitten by this issue as well and I can confirm that
this patch fixes the issue for me as well in 3.14.1.
Greetings
Marc
--
-----------------------------------------------------------------------------
Marc Haber | "I don't trust Computers. They | Mailadresse im Header
Mannheim, Germany | lose things." Winona Ryder | Fon: *49 621 31958061
Nordisch by Nature | How to make an American Quilt | Fax: *49 621 31958062
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2014-04-21 14:27 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2014-04-14 11:31 TUN device performance regression Martin Filip
2014-04-14 11:42 ` Martin Filip
2014-04-14 13:54 ` Vlad Yasevich
2014-04-14 14:43 ` Vlad Yasevich
2014-04-14 14:51 ` Martin Filip
2014-04-21 14:00 ` Marc Haber
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).