From: "Paul E. McKenney" <paulmck@linux.vnet.ibm.com>
To: Nikolay Ulyanitsky <lystor@gmail.com>
Cc: linux-kernel@vger.kernel.org
Subject: Re: [3.10.22+][3.12][performance regression] - huge softirq increase on netfilter
Date: Wed, 11 Dec 2013 14:34:26 -0800 [thread overview]
Message-ID: <20131211223426.GV4208@linux.vnet.ibm.com> (raw)
In-Reply-To: <CA+Mediw7p6CEHAvP0p=MdCQmWL10QASVpxTo-_WDsvFgxziyww@mail.gmail.com>
On Wed, Dec 11, 2013 at 02:01:29PM +0200, Nikolay Ulyanitsky wrote:
> Hello
>
>
> 3.10.22 has new 2 patches that increase softirq from 0.0% to 15.0% in
> comparison with 3.10.21 on my software routers:
>
> 78ab8cb netfilter: nf_conntrack: use RCU safe kfree for conntrack
> extensions
This one fixes a use-after-free bug, so reverting it might be unwise.
However, it looks like it should only be affecting networking connection
tracking. Is that an important part of your workload?
Also, are you checking overall CPU consumption? One effect of this
patch is to shift overhead from process level to softirq, so please check
process-level CPU consumption to make sure you have a fair comparison.
> 873be93 ipc/sem.c: synchronize semop and semctl with IPC_RMID
This one also fixes some bugs. But I don't immediately see why it
should increase softirq CPU consumption.
Thanx, Paul
> Screenshots:
> Server1 (ipt_NETFLOW): http://s12.postimg.org/5eprc03tp/vega.png
> Server2 (NAT): http://s27.postimg.org/swj3he8dv/mimosa.png
>
>
> Server1:
> 3.10.21: softirq = 0%
> 3.10.22+, 3.12.4: softirq = 15%
> 3.10.22+, 3.12.4 WITHOUT 78ab8cb, WITH 873be93: softirq = 1%
> 3.10.22+, 3.12.4 WITHOUT 78ab8cb, WITHOUT 873be93: softirq = 0%
>
>
> Hardware:
> 2 x Xeon 3.2GHz, Intel SE7520, 4 x Intel 82576 Gigabit Network
>
> CentOS 6.5 x86_64
>
>
> Kernel configs:
> 3.12.4: http://pastebin.com/ugTWFeJg
> 3.10.22: http://pastebin.com/N8z4UAV5
>
>
> Please fix/revert these patches.
>
>
> Thanks
>
>
> –
>
> With best regards,
>
> Nikolay Ulyanitsky
> --
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at http://www.tux.org/lkml/
>
prev parent reply other threads:[~2013-12-11 22:34 UTC|newest]
Thread overview: 2+ messages / expand[flat|nested] mbox.gz Atom feed top
2013-12-11 12:01 [3.10.22+][3.12][performance regression] - huge softirq increase on netfilter Nikolay Ulyanitsky
2013-12-11 22:34 ` Paul E. McKenney [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20131211223426.GV4208@linux.vnet.ibm.com \
--to=paulmck@linux.vnet.ibm.com \
--cc=linux-kernel@vger.kernel.org \
--cc=lystor@gmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox