From mboxrd@z Thu Jan 1 00:00:00 1970 From: Jeff Moyer Subject: Re: [RFC PATCH 0/7] Non-blockling buffered fs read (page cache only) Date: Tue, 16 Sep 2014 15:30:04 -0400 Message-ID: References: Mime-Version: 1.0 Content-Type: text/plain Cc: linux-kernel@vger.kernel.org, Christoph Hellwig , linux-fsdevel@vger.kernel.org, linux-aio@kvack.org, Mel Gorman , Volker Lendecke , Tejun Heo To: Milosz Tanski Return-path: In-Reply-To: (Milosz Tanski's message of "Mon, 15 Sep 2014 16:20:01 -0400") Sender: owner-linux-aio@kvack.org List-Id: linux-fsdevel.vger.kernel.org Milosz Tanski writes: > This patcheset introduces an ability to perform a non-blocking read from > regular files in buffered IO mode. This works by only for those filesystems > that have data in the page cache. > > It does this by introducing new syscalls new syscalls readv2/writev2 and > preadv2/pwritev2. These new syscalls behave like the network sendmsg, recvmsg > syscalls that accept an extra flag argument (O_NONBLOCK). > > It's a very common patern today (samba, libuv, etc..) use a large threadpool to > perform buffered IO operations. They submit the work form another thread > that performs network IO and epoll or other threads that perform CPU work. This > leads to increased latency for processing, esp. in the case of data that's > already cached in the page cache. > > With the new interface the applications will now be able to fetch the data in > their network / cpu bound thread(s) and only defer to a threadpool if it's not > there. In our own application (VLDB) we've observed a decrease in latency for > "fast" request by avoiding unnecessary queuing and having to swap out current > tasks in IO bound work threads. > > I have co-developed these changes with Christoph Hellwig, a whole lot of his > fixes went into the first patch in the series (were squashed with his > approval). > > I am going to post the perf report in a reply-to to this RFC. You can send the performance data along with the patch series, no need to separate it off in a reply. One additional patch I'd like to see is a man page update. That would help clarify exactly what you're trying to accomplish. I look forward to v2! Cheers, Jeff -- To unsubscribe, send a message with 'unsubscribe linux-aio' in the body to majordomo@kvack.org. For more info on Linux AIO, see: http://www.kvack.org/aio/ Don't email: aart@kvack.org