From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Message-ID: <5451A8A3.8020106@kernel.dk> Date: Wed, 29 Oct 2014 20:55:31 -0600 From: Jens Axboe MIME-Version: 1.0 Subject: Re: fio rbd completions (Was: fio rbd hang for block sizes > 1M) References: <5449BBB3.7090109@catalyst.net.nz> <544E63EA.1010204@kernel.dk> <544E6691.106@kernel.dk> <544E6A8D.1040608@kernel.dk> <544EC05D.7040807@catalyst.net.nz> <544EC7F1.6010900@kernel.dk> <544ED37D.6060800@catalyst.net.nz> <79432849-2F58-4738-82E1-E4D8AB10A6AE@kernel.dk> <544FB2F2.2060703@kernel.dk> <544FCDBD.7070106@kernel.dk> <5450FA47.2030203@kernel.dk> In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit To: Ketor D Cc: Mark Kirkwood , Mark Nelson , Mark Nelson , "fio@vger.kernel.org" , "xan.peng" , "ceph-devel@vger.kernel.org" List-ID: On 2014-10-29 20:50, Ketor D wrote: > Hi Jens, > > The current code runs good! > > Test Conf: jobs=1 iodepth=1 bs=4k > > if busy_poll = 1, IOPS is 38989. > if busy_poll = 0, IOPS is 33031. > > And busy_poll=0 test result looks no difference from the old code than > do not have sorted events wait. Good to hear! I think we can safely say that we've pushed rbd as far as we can. At least on the fio side. Still appears to be some suboptimal parts of the librbd API. And the kernel rbd driver could definitely be improved a lot as well. Using busy_poll on the user side gets rid of a sleep/wakeup cycle at that end, but the kernel driver still punts and offloads any work item to a work queue... Thanks for all your testing through this, really appreciated! -- Jens Axboe