From mboxrd@z Thu Jan 1 00:00:00 1970 From: Eric Wong Subject: Re: [RFC v2] epoll: avoid spinlock contention with wfcqueue Date: Mon, 18 Mar 2013 20:20:18 +0000 Message-ID: <20130318202018.GA17114@dcvr.yhbt.net> References: <20130314044215.GA27312@dcvr.yhbt.net> <20130318110722.GA8798@dcvr.yhbt.net> <20130318130649.GA15947@Krystal> <20130318173237.GB8798@dcvr.yhbt.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Cc: linux-kernel@vger.kernel.org, Davide Libenzi , Al Viro , Andrew Morton , linux-fsdevel@vger.kernel.org To: Mathieu Desnoyers Return-path: Content-Disposition: inline In-Reply-To: <20130318173237.GB8798@dcvr.yhbt.net> Sender: linux-kernel-owner@vger.kernel.org List-Id: linux-fsdevel.vger.kernel.org Eric Wong wrote: > Mathieu Desnoyers wrote: > > I'm also not entirely sure why you need to add enum epoll_item_state > > along with expensive atomic ops to compute the state. Wouldn't it be > > enough to know in which queue the nodes are located ? If need be, you > > could add new queues, e.g. one per state. So instead of marking states, > > you would simply re-enqueue the nodes into per-state queues. This would > > simplify zombie management and save a couple of brains in the process. ;-) > > Is there a quick way to know which queue the node is located? > > ep_enqueue may fire from several places at once (ep_poll_callback, > ep_insert/ep_modify) so I think guarding it with something (currently > ep_mark_ready) is required. We used to use ep->lock to protect all the > "if (!ep_is_linked) list_add_tail" calls, too. I now think the EP_STATE_DEQUEUE state (and associated loop) is unnecessary. I only had it for the EPOLLET case. Safe usage of EPOLLET requires hitting EAGAIN before expecting an event anyways (as documented by epoll(7)). So the potential of "losing" an event while it is being sent to userspace existed before, and it still exists now. For an app which uses EPOLLET improperly (by not relying on EAGAIN), the window for "losing" an event is slightly larger, but probably still too small to matter... This change wouldn't affect level-trigger (most epoll users, I think) nor EPOLLONESHOT users. Hopefully I'll be able to test more, soon.