* Re: Thousands of interfaces [not found] <20061031092550.GA8201@tufnell.london.poggs.net> @ 2006-10-31 9:31 ` David Miller 2006-10-31 15:55 ` Ben Greear 2006-10-31 18:22 ` Stephen Hemminger 0 siblings, 2 replies; 4+ messages in thread From: David Miller @ 2006-10-31 9:31 UTC (permalink / raw) To: peter.hicks; +Cc: linux-kernel, netdev From: Peter Hicks <peter.hicks@poggs.co.uk> Date: Tue, 31 Oct 2006 09:25:50 +0000 [ Discussion belongs on netdev@vger.kernel.org, added to CC: ] > I have a dual 3GHz Xeon machine with a 2.4.21 kernel and thousands (15k+) of > ipip tunnel interfaces. These are being used to tunnel traffic from remote > routers, over a private network, and handed off to a third party. ... > Is it possible to speed up creation of the interfaces? Currently it takes > around 24 hours. Is there are more efficient way to handle a very large > number of IP-IP tunnels? Would upgrading to a 2.6 kernel be of use? We just simply never imagined people would use IP tunnels on this scale. The following kernel patch is a quick hack that will get things to work quickly for you, but longer term we need to add dynamic hash table growth to this thing (and SIT tunnel, and IP GRE tunnel, etc. etc. etc.) diff --git a/net/ipv4/ipip.c b/net/ipv4/ipip.c index 0c45565..78055cf 100644 --- a/net/ipv4/ipip.c +++ b/net/ipv4/ipip.c @@ -117,8 +117,8 @@ #include <net/ipip.h> #include <net/inet_ecn.h> #include <net/xfrm.h> -#define HASH_SIZE 16 -#define HASH(addr) ((addr^(addr>>4))&0xF) +#define HASH_SIZE 16384 +#define HASH(addr) ((addr^(addr>>14))&(HASH_SIZE - 1)) static int ipip_fb_tunnel_init(struct net_device *dev); static int ipip_tunnel_init(struct net_device *dev); ^ permalink raw reply related [flat|nested] 4+ messages in thread
* Re: Thousands of interfaces 2006-10-31 9:31 ` Thousands of interfaces David Miller @ 2006-10-31 15:55 ` Ben Greear 2006-10-31 18:22 ` Stephen Hemminger 1 sibling, 0 replies; 4+ messages in thread From: Ben Greear @ 2006-10-31 15:55 UTC (permalink / raw) To: David Miller; +Cc: peter.hicks, linux-kernel, netdev David Miller wrote: > From: Peter Hicks <peter.hicks@poggs.co.uk> > Date: Tue, 31 Oct 2006 09:25:50 +0000 > > [ Discussion belongs on netdev@vger.kernel.org, added to CC: ] > > >> I have a dual 3GHz Xeon machine with a 2.4.21 kernel and thousands (15k+) of >> ipip tunnel interfaces. These are being used to tunnel traffic from remote >> routers, over a private network, and handed off to a third party. >> > ... > >> Is it possible to speed up creation of the interfaces? Currently it takes >> around 24 hours. Is there are more efficient way to handle a very large >> number of IP-IP tunnels? Would upgrading to a 2.6 kernel be of use? >> > > 2.6 (and the associated 'ip' tool) does have some improvements for showing very large numbers of interfaces. I haven't tried more than a few thousand though... Ben -- Ben Greear <greearb@candelatech.com> Candela Technologies Inc http://www.candelatech.com ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: Thousands of interfaces 2006-10-31 9:31 ` Thousands of interfaces David Miller 2006-10-31 15:55 ` Ben Greear @ 2006-10-31 18:22 ` Stephen Hemminger 2006-10-31 21:36 ` David Miller 1 sibling, 1 reply; 4+ messages in thread From: Stephen Hemminger @ 2006-10-31 18:22 UTC (permalink / raw) To: David Miller; +Cc: peter.hicks, linux-kernel, netdev On Tue, 31 Oct 2006 01:31:54 -0800 (PST) David Miller <davem@davemloft.net> wrote: > From: Peter Hicks <peter.hicks@poggs.co.uk> > Date: Tue, 31 Oct 2006 09:25:50 +0000 > > [ Discussion belongs on netdev@vger.kernel.org, added to CC: ] > > > I have a dual 3GHz Xeon machine with a 2.4.21 kernel and thousands (15k+) of > > ipip tunnel interfaces. These are being used to tunnel traffic from remote > > routers, over a private network, and handed off to a third party. > ... > > Is it possible to speed up creation of the interfaces? Currently it takes > > around 24 hours. Is there are more efficient way to handle a very large > > number of IP-IP tunnels? Would upgrading to a 2.6 kernel be of use? > 2.4 has a several N^2 searches for interfaces (and is in deep freeze by now). 2.6 had several changes to handle 1000's of interfaces. -- Stephen Hemminger <shemminger@osdl.org> ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: Thousands of interfaces 2006-10-31 18:22 ` Stephen Hemminger @ 2006-10-31 21:36 ` David Miller 0 siblings, 0 replies; 4+ messages in thread From: David Miller @ 2006-10-31 21:36 UTC (permalink / raw) To: shemminger; +Cc: peter.hicks, linux-kernel, netdev From: Stephen Hemminger <shemminger@osdl.org> Date: Tue, 31 Oct 2006 10:22:22 -0800 > On Tue, 31 Oct 2006 01:31:54 -0800 (PST) > David Miller <davem@davemloft.net> wrote: > > > From: Peter Hicks <peter.hicks@poggs.co.uk> > > Date: Tue, 31 Oct 2006 09:25:50 +0000 > > > > [ Discussion belongs on netdev@vger.kernel.org, added to CC: ] > > > > > I have a dual 3GHz Xeon machine with a 2.4.21 kernel and thousands (15k+) of > > > ipip tunnel interfaces. These are being used to tunnel traffic from remote > > > routers, over a private network, and handed off to a third party. > > ... > > > Is it possible to speed up creation of the interfaces? Currently it takes > > > around 24 hours. Is there are more efficient way to handle a very large > > > number of IP-IP tunnels? Would upgrading to a 2.6 kernel be of use? > > > > > 2.4 has a several N^2 searches for interfaces (and is in deep freeze by now). > 2.6 had several changes to handle 1000's of interfaces. Oops I didn't notice this was with 2.4.x. Indeed, 2.4.x definitely cannot handle large numbers of networking interfaces at all without major surgery. 2.6.x should handle this significantly better. ^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2006-10-31 21:36 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
[not found] <20061031092550.GA8201@tufnell.london.poggs.net>
2006-10-31 9:31 ` Thousands of interfaces David Miller
2006-10-31 15:55 ` Ben Greear
2006-10-31 18:22 ` Stephen Hemminger
2006-10-31 21:36 ` David Miller
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).