Re: [PATCH 2.6.23-rc6 Resending] NETWORKING : Edge Triggered EPOLLOUT events get missed for TCP sockets

Davide Libenzi
2007-09-20T22:37:30Z

On Thu, 20 Sep 2007, Nagendra Tomar wrote:

>
> --- Davide Libenzi <davidel@xmailserver.org> wrote:
>
> > Looking back at it, I think the current TCP code is right, once you look
> > at the "event" to be a output buffer full->with_space transition.
> > If you drop an fd inside epoll with EPOLLOUT|EPOLLET and you get an event
> > (free space on the output buffer), if you do not consume it (say a
> > tcp_sendmsg that re-fill the buffer), you can't see other OUT event
> > anymore since they happen on the full->with_space transition.
> > Yes, I know, the read size (EPOLLIN) works differently and you get an
> > event for every packet you receive. And yes, I do not like asymmetric
> > things. But that does not make the EPOLLOUT|EPOLLET wrong IMO.
> >
>
> I agree that ET means the event should happen at the transition
> from nospace->space condition, but isn't the other case (event is
> delivered every time the event actually happens) more usable.
> Also the epoll man page says so
>
> "... Edge Triggered event distribution delivers events only when
> events happens on the monitored file."
>
> This serves the purpose of ET (reducing the number of poll events) and
> at the same time makes userspace coding easier. My userspace code
> has the liberty of deciding when it can write to the socket. f.e. the
> sendfile buffer management example that I quoted in my earlier post
> will be difficult with the current ET|POLLOUT behaviour. I cannot
> write in full-buffer units. I'll ve to write partial buffers just to
> fill the TCP writeq which is needed to trigger the event.

That's not what POLLOUT means in the Unix meaning. POLLOUT indicates the
ability to write, and it is not meant as to signal every time a packet
(skb) is sent on the wire (and the buffer released).
In your particular application, you could simply split the sendfile into
appropriately sized chunks, and handle the buffer realease in there.

- Davide