From: Jens Axboe <axboe@kernel.dk>
To: Ben England <bengland@redhat.com>, fio@vger.kernel.org
Cc: Tim Wilkinson <twilkins@redhat.com>,
Andrew Theurer <atheurer@redhat.com>,
John Harrigan <jharriga@redhat.com>
Subject: Re: problem with fio --client and latency logs
Date: Fri, 27 May 2016 11:02:10 -0600 [thread overview]
Message-ID: <57487D92.7070306@kernel.dk> (raw)
In-Reply-To: <57485CF7.2070308@kernel.dk>
On 05/27/2016 08:43 AM, Jens Axboe wrote:
> On 05/26/2016 01:11 PM, Ben England wrote:
>> recently I noticed a problem in master branch when fio --client is
>> used. latency logs generated with it have large numbers of "0, 0, 0,
>> 0" records at the end of the file. I have a simple reproducer fio
>> jobfile:
>>
>> --------- reproducer.fiojob ----
>> [global]
>> numjobs=1
>> directory=/var/tmp
>>
>> [shared-files]
>> rw=randread
>> write_lat_log=1thr
>> ioengine=sync
>> bs=4k # I/O size
>> filesize=1g # file size
>> runtime=20
>> -------------
>>
>> If you run this job file like this:
>>
>> # fio --server --daemonize=/var/run/fiosvr.pid
>> # fio --client=localhost reproducer.fiojob
>>
>> You get the latency log 1thr_clat.1.log with the 0 records at the
>> end. If you run the same job file with:
>>
>> # fio reproducer.fiojob
>>
>> You don't get the 0 records. This explains why Ceph CBT does not have
>> the problem, for example.
>>
>> I bisected fio history using git until I found the first commit that
>> failed:
>>
>> -------
>> commit 0cba0f919ee6af7dd65df436884336cff9c903f9
>> Author: Jens Axboe <axboe@fb.com>
>> Date: Thu Dec 17 14:54:15 2015 -0700
>>
>> client/server: transparent handling of storing compressed logs
>>
>> Signed-off-by: Jens Axboe <axboe@fb.com>
>> ------
>>
>> I could use some help figuring out what went wrong at this point, the
>> diffs were complicated but it seemed possible that this commit was
>> related to my problem.
>
> I have a good idea what this might be, I'll take a look at it.
http://git.kernel.dk/cgit/fio/commit/?id=e35fb4c43ecc5b9d35cb5d980e811d3408fc5a4e
This should fix it, can you try with current -git?
--
Jens Axboe
next prev parent reply other threads:[~2016-05-27 17:02 UTC|newest]
Thread overview: 5+ messages / expand[flat|nested] mbox.gz Atom feed top
[not found] <671811755.66182002.1464284748641.JavaMail.zimbra@redhat.com>
2016-05-26 19:11 ` problem with fio --client and latency logs Ben England
2016-05-27 14:43 ` Jens Axboe
2016-05-27 17:02 ` Jens Axboe [this message]
2016-05-27 19:29 ` Ben England
2016-05-27 19:33 ` Jens Axboe
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=57487D92.7070306@kernel.dk \
--to=axboe@kernel.dk \
--cc=atheurer@redhat.com \
--cc=bengland@redhat.com \
--cc=fio@vger.kernel.org \
--cc=jharriga@redhat.com \
--cc=twilkins@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox