From: Giuliano Colla <giuliano.colla@fastwebnet.it>
To: Michael Hewitt <mhewitt@aha.com>, linux-rt-users@vger.kernel.org
Subject: Re: Eliminating Packet Latency
Date: Tue, 15 Mar 2016 20:22:36 +0100	[thread overview]
Message-ID: <56E860FC.70706@fastwebnet.it> (raw)
In-Reply-To: <262920A1-2716-4D46-9A0F-7E7DC93EE24D@aha.com>
Il 14/03/2016 22:02, Michael Hewitt ha scritto:
> We are using a real time Linux kernel (3.10.0) in a network appliance in order to achieve extremely consistent packet delivery times.  Generally, we see packet delivery variations of less than 100 microseconds, which is fabulous.  Occasionally, we see a packet delivery delay in excess of 1000 microseconds.  We are hoping to eliminate these spikes, which occur perhaps 1-2 times in a 24 hour period.
>
> The machine configuration is as follows.  Thread IRQs are enabled, and we have elevated the priority of both the irq threads that service the specific network interface to 55.  We have also elevated the priority of the relevant user space thread to 49.  We are running on a 4 core Intel Xeon E3-1220v3 with an Intel NIC and the igb version 5.3.2 driver.  We disabled interrupt throttling in the Intel driver (rx-usecs = 0, tx-usecs = 0).  SE Linux is disabled, eliminating a huge packet latency spike during login.  We are running CentOS 7.1 tuned for network latency ("tuned-adm profile network-latency").  IRQ balancing is disabled.  BIOS CPU power management is set to maximum performance.
>
I'm using a 3.10 line kernel four our real-time applications (actually a 
3.10.10). We have experienced (quite unexpectedly) a better overall 
performance (reduced latency) with the on demand governor than with the 
performance governor. As the performance achieved was sufficient four 
our purposes in both cases we didn't investigate further. Maybe it's 
worth a try.
Giuliano
next prev parent reply	other threads:[~2016-03-15 19:28 UTC|newest]
Thread overview: 6+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2016-03-14 21:02 Eliminating Packet Latency Michael Hewitt
2016-03-14 21:29 ` Dave Rolenc
2016-03-15  8:55 ` Stanislav Meduna
2016-03-15 17:24   ` Dave Rolenc
2016-03-15 19:22 ` Giuliano Colla [this message]
  -- strict thread matches above, loose matches on Subject: below --
2016-03-30 13:08 Sebastian Andrzej Siewior
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox
  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):
  git send-email \
    --in-reply-to=56E860FC.70706@fastwebnet.it \
    --to=giuliano.colla@fastwebnet.it \
    --cc=linux-rt-users@vger.kernel.org \
    --cc=mhewitt@aha.com \
    /path/to/YOUR_REPLY
  https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
  Be sure your reply has a Subject: header at the top and a blank line
  before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).