Flexible I/O Tester development
 help / color / mirror / Atom feed
From: Jens Axboe <axboe@kernel.dk>
To: Ben England <bengland@redhat.com>, fio@vger.kernel.org
Cc: Tim Wilkinson <twilkins@redhat.com>,
	Andrew Theurer <atheurer@redhat.com>,
	John Harrigan <jharriga@redhat.com>
Subject: Re: problem with fio --client and latency logs
Date: Fri, 27 May 2016 11:02:10 -0600	[thread overview]
Message-ID: <57487D92.7070306@kernel.dk> (raw)
In-Reply-To: <57485CF7.2070308@kernel.dk>

On 05/27/2016 08:43 AM, Jens Axboe wrote:
> On 05/26/2016 01:11 PM, Ben England wrote:
>> recently I noticed a problem in master branch when fio --client is
>> used.  latency logs generated with it have large numbers of "0, 0, 0,
>> 0" records at the end of the file.  I have a simple reproducer fio
>> jobfile:
>>
>> --------- reproducer.fiojob ----
>> [global]
>> numjobs=1
>> directory=/var/tmp
>>
>> [shared-files]
>> rw=randread
>> write_lat_log=1thr
>> ioengine=sync
>> bs=4k      # I/O size
>> filesize=1g  # file size
>> runtime=20
>> -------------
>>
>> If you run this job file like this:
>>
>> # fio --server --daemonize=/var/run/fiosvr.pid
>> # fio --client=localhost reproducer.fiojob
>>
>> You get the latency log 1thr_clat.1.log with the 0 records at the
>> end.  If you run the same job file with:
>>
>> # fio reproducer.fiojob
>>
>> You don't get the 0 records.  This explains why Ceph CBT does not have
>> the problem, for example.
>>
>> I bisected fio history using git until I found the first commit that
>> failed:
>>
>> -------
>> commit 0cba0f919ee6af7dd65df436884336cff9c903f9
>> Author: Jens Axboe <axboe@fb.com>
>> Date:   Thu Dec 17 14:54:15 2015 -0700
>>
>>      client/server: transparent handling of storing compressed logs
>>
>>      Signed-off-by: Jens Axboe <axboe@fb.com>
>> ------
>>
>> I could use some help figuring out what went wrong at this point, the
>> diffs were complicated but it seemed possible that this commit was
>> related to my problem.
>
> I have a good idea what this might be, I'll take a look at it.

http://git.kernel.dk/cgit/fio/commit/?id=e35fb4c43ecc5b9d35cb5d980e811d3408fc5a4e

This should fix it, can you try with current -git?

-- 
Jens Axboe



  reply	other threads:[~2016-05-27 17:02 UTC|newest]

Thread overview: 5+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <671811755.66182002.1464284748641.JavaMail.zimbra@redhat.com>
2016-05-26 19:11 ` problem with fio --client and latency logs Ben England
2016-05-27 14:43   ` Jens Axboe
2016-05-27 17:02     ` Jens Axboe [this message]
2016-05-27 19:29       ` Ben England
2016-05-27 19:33         ` Jens Axboe

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=57487D92.7070306@kernel.dk \
    --to=axboe@kernel.dk \
    --cc=atheurer@redhat.com \
    --cc=bengland@redhat.com \
    --cc=fio@vger.kernel.org \
    --cc=jharriga@redhat.com \
    --cc=twilkins@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox