From: "Bendik Rønning Opstad" <bro.devel@gmail.com>
To: "David S. Miller" <davem@davemloft.net>, <netdev@vger.kernel.org>
Cc: "Yuchung Cheng" <ycheng@google.com>,
"Eric Dumazet" <eric.dumazet@gmail.com>,
"Neal Cardwell" <ncardwell@google.com>,
"Andreas Petlund" <apetlund@simula.no>,
"Carsten Griwodz" <griff@simula.no>,
"Pål Halvorsen" <paalh@simula.no>,
"Jonas Markussen" <jonassm@ifi.uio.no>,
"Kristian Evensen" <kristian.evensen@gmail.com>,
"Kenneth Klette Jonassen" <kennetkl@ifi.uio.no>
Subject: [PATCH v6 net-next 0/2] tcp: Redundant Data Bundling (RDB)
Date: Thu, 3 Mar 2016 19:06:26 +0100 [thread overview]
Message-ID: <1457028388-18226-1-git-send-email-bro.devel+kernel@gmail.com> (raw)
In-Reply-To: <1445633413-3532-1-git-send-email-bro.devel+kernel@gmail.com>
Redundant Data Bundling (RDB) is a mechanism for TCP aimed at reducing
the latency for applications sending time-dependent data.
Latency-sensitive applications or services, such as online games and
remote desktop, produce traffic with thin-stream characteristics,
characterized by small packets and a relatively high ITT. By bundling
already sent data in packets with new data, RDB alleviates head-of-line
blocking by reducing the need to retransmit data segments when packets
are lost. RDB is a continuation on the work on latency improvements for
TCP in Linux, previously resulting in two thin-stream mechanisms in the
Linux kernel
(https://github.com/torvalds/linux/blob/master/Documentation/networking/tcp-thin.txt).
The RDB implementation has been thoroughly tested, and shows
significant latency reductions when packet loss occurs[1]. The tests
show that, by imposing restrictions on the bundling rate, it can be
made not to negatively affect competing traffic in an unfair manner.
Note: Current patch set depends on the patch "tcp: refactor struct tcp_skb_cb"
(http://patchwork.ozlabs.org/patch/510674)
These patches have also been tested with as set of packetdrill scripts
located at
https://github.com/bendikro/packetdrill/tree/master/gtests/net/packetdrill/tests/linux/rdb
(The tests require patching packetdrill with a new socket option:
https://github.com/bendikro/packetdrill/commit/9916b6c53e33dd04329d29b7d8baf703b2c2ac1b)
Detailed info about the RDB mechanism can be found at
http://mlab.no/blog/2015/10/redundant-data-bundling-in-tcp, as well as
in the paper "Latency and Fairness Trade-Off for Thin Streams using
Redundant Data Bundling in TCP"[2].
[1] http://home.ifi.uio.no/paalh/students/BendikOpstad.pdf
[2] http://home.ifi.uio.no/bendiko/rdb_fairness_tradeoff.pdf
Changes:
v6 (PATCH):
* tcp-Add-Redundant-Data-Bundling-RDB:
* Renamed rdb_ack_event() to tcp_rdb_ack_event() (Thanks DaveM)
* Minor doc changes
* tcp-Add-DPIFL-thin-stream-detection-mechanism:
* Minor doc changes
v5 (PATCH):
* tcp-Add-Redundant-Data-Bundling-RDB:
* Removed two unnecessary EXPORT_SYMOBOLs (Thanks Eric)
* Renamed skb_append_data() to tcp_skb_append_data() (Thanks Eric)
* Fixed bugs in additions to ipv4_table (sysctl_net_ipv4.c)
* Merged the two if tests for max payload of RDB packet in
rdb_can_bundle_test()
* Renamed rdb_check_rtx_queue_loss() to rdb_detect_loss()
and restructured to reduce indentation.
* Improved docs
* Revised commit message to be more detailed.
* tcp-Add-DPIFL-thin-stream-detection-mechanism:
* Fixed bug in additions to ipv4_table (sysctl_net_ipv4.c)
v4 (PATCH):
* tcp-Add-Redundant-Data-Bundling-RDB:
* Moved skb_append_data() to tcp_output.c and call this
function from tcp_collapse_retrans() as well.
* Merged functionality of create_rdb_skb() into
tcp_transmit_rdb_skb()
* Removed one parameter from rdb_can_bundle_test()
v3 (PATCH):
* tcp-Add-Redundant-Data-Bundling-RDB:
* Changed name of sysctl variable from tcp_rdb_max_skbs to
tcp_rdb_max_packets after comment from Eric Dumazet about
not exposing internal (kernel) names like skb.
* Formatting and function docs fixes
v2 (RFC/PATCH):
* tcp-Add-DPIFL-thin-stream-detection-mechanism:
* Change calculation in tcp_stream_is_thin_dpifl based on
feedback from Eric Dumazet.
* tcp-Add-Redundant-Data-Bundling-RDB:
* Removed setting nonagle in do_tcp_setsockopt (TCP_RDB)
to reduce complexity as commented by Neal Cardwell.
* Cleaned up loss detection code in rdb_check_rtx_queue_loss
v1 (RFC/PATCH)
Bendik Rønning Opstad (2):
tcp: Add DPIFL thin stream detection mechanism
tcp: Add Redundant Data Bundling (RDB)
Documentation/networking/ip-sysctl.txt | 23 ++++
include/linux/skbuff.h | 1 +
include/linux/tcp.h | 3 +-
include/net/tcp.h | 36 ++++++
include/uapi/linux/tcp.h | 1 +
net/core/skbuff.c | 2 +-
net/ipv4/Makefile | 3 +-
net/ipv4/sysctl_net_ipv4.c | 34 +++++
net/ipv4/tcp.c | 16 ++-
net/ipv4/tcp_input.c | 3 +
net/ipv4/tcp_output.c | 48 ++++---
net/ipv4/tcp_rdb.c | 228 +++++++++++++++++++++++++++++++++
12 files changed, 375 insertions(+), 23 deletions(-)
create mode 100644 net/ipv4/tcp_rdb.c
--
1.9.1
next prev parent reply other threads:[~2016-03-03 18:06 UTC|newest]
Thread overview: 63+ messages / expand[flat|nested] mbox.gz Atom feed top
2015-10-23 20:50 [PATCH RFC net-next 0/2] tcp: Redundant Data Bundling (RDB) Bendik Rønning Opstad
2015-10-23 20:50 ` [PATCH RFC net-next 1/2] tcp: Add DPIFL thin stream detection mechanism Bendik Rønning Opstad
2015-10-23 21:44 ` Eric Dumazet
[not found] ` <1445636654.22974.193.camel-XN9IlZ5yJG9HTL0Zs8A6p/gx64E7kk8eUsxypvmhUTTZJqsBc5GL+g@public.gmane.org>
2015-10-25 5:56 ` Bendik Rønning Opstad
2015-10-23 20:50 ` [PATCH RFC net-next 2/2] tcp: Add Redundant Data Bundling (RDB) Bendik Rønning Opstad
2015-10-26 14:50 ` Neal Cardwell
2015-10-26 21:35 ` Andreas Petlund
2015-10-26 21:58 ` Yuchung Cheng
2015-10-27 19:15 ` Jonas Markussen
2015-10-29 22:53 ` Bendik Rønning Opstad
2015-11-02 9:18 ` David Laight
2015-11-02 9:37 ` David Laight
2015-11-05 2:06 ` Bendik Rønning Opstad
2015-10-24 6:11 ` [PATCH RFC net-next 0/2] tcp: " Yuchung Cheng
2015-10-24 8:00 ` Jonas Markussen
[not found] ` <61F74109-9FDC-485A-978B-714B7AA27445-6miFZF/5cTBuMpJDpNschA@public.gmane.org>
2015-10-24 12:57 ` Eric Dumazet
2015-11-09 19:40 ` Bendik Rønning Opstad
2015-11-23 16:26 ` [PATCH RFC v2 " Bendik Rønning Opstad
2015-11-23 16:26 ` [PATCH RFC v2 net-next 1/2] tcp: Add DPIFL thin stream detection mechanism Bendik Rønning Opstad
2015-11-23 16:26 ` [PATCH RFC v2 net-next 2/2] tcp: Add Redundant Data Bundling (RDB) Bendik Rønning Opstad
2015-11-23 17:43 ` Eric Dumazet
2015-11-23 20:05 ` Bendik Rønning Opstad
2016-02-02 19:23 ` [PATCH v3 net-next 0/2] tcp: " Bendik Rønning Opstad
2016-02-02 19:23 ` [PATCH v3 net-next 1/2] tcp: Add DPIFL thin stream detection mechanism Bendik Rønning Opstad
2016-02-02 19:23 ` [PATCH v3 net-next 2/2] tcp: Add Redundant Data Bundling (RDB) Bendik Rønning Opstad
2016-02-02 20:35 ` Eric Dumazet
2016-02-03 18:17 ` Bendik Rønning Opstad
2016-02-03 19:34 ` Eric Dumazet
[not found] ` <CAF8eE=VOuoNLQHtkRwM9ZG+vJ-uH2ufVW5y_pS24rGqWh4Qa2g@mail.gmail.com>
2016-02-08 17:30 ` Bendik Rønning Opstad
2016-02-08 17:38 ` Bendik Rønning Opstad
2016-02-16 13:51 ` [PATCH v4 net-next 0/2] tcp: " Bendik Rønning Opstad
2016-02-16 13:51 ` [PATCH v4 net-next 1/2] tcp: Add DPIFL thin stream detection mechanism Bendik Rønning Opstad
2016-02-16 13:51 ` [PATCH v4 net-next 2/2] tcp: Add Redundant Data Bundling (RDB) Bendik Rønning Opstad
2016-02-18 15:18 ` Eric Dumazet
2016-02-19 14:12 ` Bendik Rønning Opstad
2016-02-24 21:12 ` [PATCH v5 net-next 0/2] tcp: " Bendik Rønning Opstad
2016-02-24 21:12 ` [PATCH v5 net-next 1/2] tcp: Add DPIFL thin stream detection mechanism Bendik Rønning Opstad
2016-02-24 21:12 ` [PATCH v5 net-next 2/2] tcp: Add Redundant Data Bundling (RDB) Bendik Rønning Opstad
2016-03-02 19:52 ` David Miller
2016-03-02 22:33 ` Bendik Rønning Opstad
2016-03-03 18:06 ` Bendik Rønning Opstad [this message]
2016-03-07 19:36 ` [PATCH v6 net-next 0/2] tcp: " David Miller
2016-03-10 0:20 ` Yuchung Cheng
2016-03-10 1:45 ` Jonas Markussen
2016-03-10 2:27 ` Yuchung Cheng
2016-03-12 9:23 ` Jonas Markussen
2016-03-13 23:18 ` Bendik Rønning Opstad
2016-03-14 21:59 ` Yuchung Cheng
2016-03-18 14:25 ` Bendik Rønning Opstad
2016-03-03 18:06 ` [PATCH v6 net-next 1/2] tcp: Add DPIFL thin stream detection mechanism Bendik Rønning Opstad
2016-03-03 18:06 ` [PATCH v6 net-next 2/2] tcp: Add Redundant Data Bundling (RDB) Bendik Rønning Opstad
2016-03-14 21:15 ` Eric Dumazet
2016-03-15 1:04 ` Rick Jones
2016-03-15 18:09 ` Yuchung Cheng
2016-03-18 17:58 ` Bendik Rønning Opstad
2016-03-14 21:54 ` Yuchung Cheng
2016-03-15 0:40 ` Bill Fink
2016-03-17 23:26 ` Bendik Rønning Opstad
2016-03-21 18:54 ` Yuchung Cheng
2016-06-16 17:12 ` Bendik Rønning Opstad
2016-06-22 14:56 ` [PATCH v7 net-next 0/2] tcp: " Bendik Rønning Opstad
2016-06-22 14:56 ` [PATCH v7 net-next 1/2] tcp: Add DPIFL thin stream detection mechanism Bendik Rønning Opstad
2016-06-22 14:56 ` [PATCH v7 net-next 2/2] tcp: Add Redundant Data Bundling (RDB) Bendik Rønning Opstad
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1457028388-18226-1-git-send-email-bro.devel+kernel@gmail.com \
--to=bro.devel@gmail.com \
--cc=apetlund@simula.no \
--cc=davem@davemloft.net \
--cc=eric.dumazet@gmail.com \
--cc=griff@simula.no \
--cc=jonassm@ifi.uio.no \
--cc=kennetkl@ifi.uio.no \
--cc=kristian.evensen@gmail.com \
--cc=ncardwell@google.com \
--cc=netdev@vger.kernel.org \
--cc=paalh@simula.no \
--cc=ycheng@google.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).