netdev.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: "Dâniel Fraga" <fragabr@gmail.com>
To: "Ilpo Järvinen" <ilpo.jarvinen@helsinki.fi>
Cc: David Miller <davem@davemloft.net>,
	thomas.jarosch@intra2net.com, billfink@mindspring.com,
	Netdev <netdev@vger.kernel.org>, Patrick Hardy <kaber@trash.net>,
	netfilter-devel@vger.kernel.org, kadlec@blackhole.kfki.hu
Subject: Re: [PATCH] tcp FRTO: in-order-only "TCP proxy" fragility workaround
Date: Tue, 26 Aug 2008 18:17:31 -0300	[thread overview]
Message-ID: <20080826181731.4581fd2c@tux> (raw)
In-Reply-To: <Pine.LNX.4.64.0808262034001.1168@wrl-59.cs.helsinki.fi>

On Tue, 26 Aug 2008 23:40:58 +0300 (EEST)
"Ilpo Järvinen" <ilpo.jarvinen@helsinki.fi> wrote:

> If you want to, a tcpdump from normal, working case wouldn't hurt either 
> to show the "normal pattern" on network level and that is trivial to 
> produce in no time now that you know the commands etc. I guess... :-)

	Ok, there it is:

http://www.abusar.org/htb/dump-normal.log
	
	Just the port 995... I checked email, then received a message,
checked again, just the normal behaviour.

> They might not be that interested until we have something more concrete 
> than what we know currently... :-)

	Ok :) And you're right, because if I disable frto and htb *and*
the problem has gone, there's a huge chance to be something related to
kernel. Or a mix of kernel and user space problem which happens just
when frto and/or htb are used.

> Can you explain a bit more. Does it resolve during it or some time after 
> it? And more importantly how do you know that it resolves? Ie., what is 
> the normal behavior (be more specific than "it works" :-), how do know 
> that it's working).

	Ok. For example:

1) the connection is normal, then suddenly it stalls. I cannot receive
mail, nor download nntp messages, nor access ftp etc.

2) I do on my client machine a "nmap -sS server" and...

3) ...imediatelly the connection is not stalled anymore.

	Now I remembered one thing and I'd like to make a question (I
hope it isn't a stupid question): dynticks (tickless) were implemented
for x86-64 in 2.6.24 kernel and I started to use dynticks in 2.6.24. Could 
it be affecting the server behaviour? I use dynticks (enabled) on all
my machines, but does it make sense to use in a server environment?
Could the dynticks cause this? Until now, I don't think so, but... who
knows?

http://kernelnewbies.org/Linux_2_6_24#head-4edc562fa1b9fa8e5da5adaf1beab057237c325d

> It seems that either we lack some traffic between the parties or simply 
> need to find out what the userspace is doing, and in the latter case what 
> happens in the network might not be relevant at all. Is there possibility 
> that we miss an alternative route by using the host rule for tcpdump (at 
> the server)? Nmap starts at 22:26:26.613098, the last packet in the client 
> log is at 22:26:01.452842. Alternatively, the port 995 was not the right 
> one to track (though there's clearly this on network level visible problem 
> with it too)... :-(

	I tracked the 995 port, because I have problems reading email
pro pop3s (995). Should I do it different with tcpdump? 

> You might jump into conclusions too quickly every now and then, more
> time might be needed to really ensure something is working. Obviously
> if any non-workingness is noticed, it's always a counter-proof even if 
> long working periods occur in between.

	Ok. It seems a complex issue. You're right. I need more
patience ;)

> In syscall terms this ListenOverflow means that int listen(int sockfd, int 
> backlog); (see man -S 2 listen) is given some size as backlog for those 
> connections that are not yet accept()'ed, and that is exhausted when the 
> ListenOverflow gets incremented (ie., if I'm not completely wrong :-)).

	Hmm interesting.

> You might want to look on dovecot how to make it accept more concurrent 
> connections, perhaps the login_max_processes_count might the right one
> (I quickly glanced http://wiki.dovecot.org/LoginProcess) though this is 
> somewhat site configuration dependant according to that page.

	Yes, I have login_max_processes_count = 128 (the default) and I
have just a few users (just 10 users), so I think it's not the problem.
 
> You could try setting up some script which does something along these 
> lines and then redirect its during the event to some file (+ tcpdumping 
> the thing obviously):
> 
> while [ : ]; do
> 	date "+%s.%N"
> 	cat /proc/net/{netstat,snmp}
> 	sleep 1
> done

	Ok. You're helping a lot. Thanks Ilpo ;)


-- 
--
To unsubscribe from this list: send the line "unsubscribe netfilter-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

  reply	other threads:[~2008-08-26 21:17 UTC|newest]

Thread overview: 107+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <47EA0DAB.7080205@securenet.de>
     [not found] ` <Pine.LNX.4.64.0807042251500.4142@blackhole.kfki.hu>
     [not found]   ` <200807071118.32988.thomas.jarosch@intra2net.com>
2008-07-07 13:18     ` TCP connection stalls under 2.6.24.7 Thomas Jarosch
2008-07-10 13:17       ` Jozsef Kadlecsik
2008-07-10 14:12         ` Thomas Jarosch
2008-07-10 21:21           ` Jozsef Kadlecsik
2008-07-11 14:33             ` Thomas Jarosch
2008-07-15 11:47               ` Thomas Jarosch
2008-07-15 16:10                 ` Thomas Jarosch
2008-07-15 18:30                   ` Dâniel Fraga
2008-07-31  4:47                     ` Dâniel Fraga
2008-07-31  7:39                       ` Ilpo Järvinen
2008-08-02 12:24                         ` Dâniel Fraga
2008-07-15 20:17                   ` Ilpo Järvinen
2008-07-16  8:07                     ` Thomas Jarosch
2008-07-16  9:03                     ` Thomas Jarosch
2008-07-17 13:55                       ` Ilpo Järvinen
2008-07-17 15:15                         ` Thomas Jarosch
2008-07-17 15:53                           ` Ilpo Järvinen
2008-07-18  9:14                             ` Thomas Jarosch
2008-07-18 13:55                               ` Ilpo Järvinen
2008-07-18 14:02                                 ` Thomas Jarosch
2008-07-19  7:35                                   ` Ilpo Järvinen
2008-07-25 10:00                                   ` Ilpo Järvinen
2008-07-25 13:00                                     ` Thomas Jarosch
2008-07-25 14:06                                       ` Ilpo Järvinen
2008-07-25 15:34                                         ` Thomas Jarosch
2008-07-31  7:39                                           ` Thomas Jarosch
2008-07-31 12:44                                             ` Dâniel Fraga
2008-07-31 13:47                                               ` Thomas Jarosch
2008-07-31 14:11                                                 ` Dâniel Fraga
2008-08-06 18:53                                                 ` Dâniel Fraga
2008-08-07  6:54                                                   ` Ilpo Järvinen
2008-08-07 11:50                                                     ` Denys Fedoryshchenko
2008-08-07 12:11                                                       ` Thomas Jarosch
2008-08-07 12:14                                                       ` Ilpo Järvinen
2008-08-07 12:23                                                         ` Denys Fedoryshchenko
2008-08-08  9:56                                                           ` Ilpo Järvinen
2008-08-08 10:32                                                             ` Denys Fedoryshchenko
2008-08-07 11:33                                                   ` [PATCH] tcp FRTO: in-order-only "TCP proxy" fragility workaround Ilpo Järvinen
2008-08-08  4:42                                                     ` Bill Fink
2008-08-08 10:32                                                       ` Ilpo Järvinen
2008-08-11 21:44                                                         ` David Miller
2008-08-12  7:46                                                           ` Thomas Jarosch
2008-08-12  8:18                                                             ` David Miller
2008-08-12 17:43                                                               ` Dâniel Fraga
2008-08-12 17:52                                                                 ` Ilpo Järvinen
2008-08-13 17:53                                                                   ` Dâniel Fraga
2008-08-13 18:34                                                                     ` Ilpo Järvinen
2008-08-15  4:34                                                                       ` Dâniel Fraga
2008-08-15  7:06                                                                         ` Ilpo Järvinen
2008-08-15 21:35                                                                           ` Dâniel Fraga
2008-08-15 22:06                                                                             ` Ilpo Järvinen
2008-08-15 23:57                                                                               ` Dâniel Fraga
2008-08-16  2:15                                                                               ` Dâniel Fraga
2008-08-16  7:10                                                                                 ` Ilpo Järvinen
2008-08-16 19:18                                                                                   ` Ilpo Järvinen
2008-08-17  0:36                                                                                     ` Dâniel Fraga
2008-08-19 10:38                                                                                       ` Ilpo Järvinen
2008-08-20  0:34                                                                                         ` Dâniel Fraga
2008-08-20  7:57                                                                                           ` Ilpo Järvinen
2008-08-20 12:37                                                                                           ` Ilpo Järvinen
2008-08-22 21:32                                                                                             ` Dâniel Fraga
2008-08-22 21:37                                                                                               ` David Miller
2008-08-23 14:14                                                                                                 ` Dâniel Fraga
2008-08-23 14:38                                                                                                   ` Ilpo Järvinen
2008-08-24 19:38                                                                                                     ` Dâniel Fraga
2008-08-26 14:10                                                                                                       ` Ilpo Järvinen
2008-08-26 14:32                                                                                                         ` Ilpo Järvinen
2008-08-26 17:18                                                                                                         ` Dâniel Fraga
2008-08-26 20:40                                                                                                           ` Ilpo Järvinen
2008-08-26 21:17                                                                                                             ` Dâniel Fraga [this message]
2008-08-27 10:22                                                                                                               ` Ilpo Järvinen
2008-08-27 19:51                                                                                                                 ` Dâniel Fraga
2008-08-27 20:32                                                                                                                   ` Ilpo Järvinen
2008-08-27 20:50                                                                                                                     ` Dâniel Fraga
2008-08-27 21:25                                                                                                                       ` Ilpo Järvinen
2008-08-27 21:42                                                                                                                         ` Dâniel Fraga
2008-08-27 22:24                                                                                                                           ` Dâniel Fraga
2008-08-28 21:49                                                                                                             ` Dâniel Fraga
2008-08-29 13:07                                                                                                               ` Ilpo Järvinen
2008-08-29 17:41                                                                                                                 ` Dâniel Fraga
2008-09-01  7:11                                                                                                                   ` Ilpo Järvinen
2008-08-30  6:56                                                                                                                 ` Dâniel Fraga
2008-09-01  7:11                                                                                                                   ` Ilpo Järvinen
2008-09-07  8:17                                                                                                                     ` Dâniel Fraga
2008-09-08 10:27                                                                                                                       ` Ilpo Järvinen
2008-09-08 20:20                                                                                                                         ` Dâniel Fraga
2008-09-11 13:44                                                                                                                           ` Ilpo Järvinen
2008-09-11 17:30                                                                                                                             ` Dâniel Fraga
2008-09-12 10:16                                                                                                                               ` Ilpo Järvinen
2008-09-13 23:31                                                                                                                                 ` Dâniel Fraga
2008-09-16 12:10                                                                                                                                   ` Ilpo Järvinen
2008-09-16 14:24                                                                                                                                     ` Dâniel Fraga
2008-09-17 10:23                                                                                                                                       ` Ilpo Järvinen
2008-09-18 20:35                                                                                                                                         ` Dâniel Fraga
2008-09-18 21:04                                                                                                                                           ` Ilpo Järvinen
2008-09-21  3:02                                                                                                                                             ` Dâniel Fraga
2008-09-22  4:23                                                                                                                                             ` Dâniel Fraga
2008-09-22 11:22                                                                                                                                               ` Ilpo Järvinen
2008-09-22 16:13                                                                                                                                                 ` Dâniel Fraga
2008-09-15 19:42                                                                                                                                 ` Dâniel Fraga
2008-09-11 18:12                                                                                                                             ` Dâniel Fraga
2008-08-15 21:59                                                                           ` Dâniel Fraga
2008-08-13  8:00                                                               ` Thomas Jarosch
2008-08-22 21:18                                                             ` Ilpo Järvinen
2008-08-11 21:41                                                       ` David Miller
2008-08-25 16:45 Thomas Jarosch
2008-08-26 12:03 ` Ilpo Järvinen

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20080826181731.4581fd2c@tux \
    --to=fragabr@gmail.com \
    --cc=billfink@mindspring.com \
    --cc=davem@davemloft.net \
    --cc=ilpo.jarvinen@helsinki.fi \
    --cc=kaber@trash.net \
    --cc=kadlec@blackhole.kfki.hu \
    --cc=netdev@vger.kernel.org \
    --cc=netfilter-devel@vger.kernel.org \
    --cc=thomas.jarosch@intra2net.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).