All of lore.kernel.org
 help / color / mirror / Atom feed
From: Jens Axboe <axboe@kernel.dk>
To: Karthick Srinivasachary <karthick@pernixdata.com>
Cc: fio@vger.kernel.org
Subject: Re: Repeat given pattern with buffer_compress_percentage
Date: Thu, 04 Dec 2014 08:27:11 -0700	[thread overview]
Message-ID: <54807D4F.9080207@kernel.dk> (raw)
In-Reply-To: <CAGmU4NSC=7ZjjnieWxjFs8xqrVjY0gdMGWwJCTRogXKpUzBbcA@mail.gmail.com>

On 12/04/2014 12:53 AM, Karthick Srinivasachary wrote:
> Hi Jens,
>
> Thanks for your response and quick fix.. Much appreciated.
> Tried few things and saw couple issues, summarizing below. Please let
> me know if I am missing something.
>
> 1. Looks like buffer_compress_percentage with verify option is not
> giving expected compression percentage
>
> fio --name=global --rw=write --buffer_compress_percentage=50
> --name=job1 --filename=/root/test1 --size=100m --refill_buffers
> --verify=md5
>
> lz4 could compress fio data file
>
> lz4 /root/test1
> Compressed 104857600 bytes into 104857715 bytes ==> 100.00%

The verify buffers are filled differently. It will take a bit more code 
juggling to make that honor the buffer_pattern as a fill pattern. I'll 
take a look at it.

> 2. buffer_compress_percentage with buffer_pattern + refill_buffers is
> not giving expected compression percentage (Data is highly
> compressible).
>
> fio --name=global --rw=write --buffer_compress_percentage=50
> --name=job1 --filename=/root/test1 --size=100m --refill_buffers
> --buffer_pattern=111
>
> root@ubuntu-base:~/fio-master# lz4 /root/test1
> Compressed filename will be : /root/test1.lz4
> Compressed 104857600 bytes into 463065 bytes ==> 0.44%

That's a bug in how we clear refill_buffers when we set a buffer 
pattern, that's not correct anymore with the combination of buffer 
compression and pattern. Fixed and pushed.

-- 
Jens Axboe



  reply	other threads:[~2014-12-04 15:27 UTC|newest]

Thread overview: 15+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-12-03 18:48 Repeat given pattern with buffer_compress_percentage Karthick Srinivasachary
2014-12-03 19:45 ` Andrey Kuzmin
2014-12-03 19:49   ` Karthick Srinivasachary
2014-12-03 19:52     ` Andrey Kuzmin
2014-12-04  2:42 ` Jens Axboe
2014-12-04  2:49   ` Jens Axboe
2014-12-04  2:58     ` Jens Axboe
2014-12-04  7:53       ` Karthick Srinivasachary
2014-12-04 15:27         ` Jens Axboe [this message]
2014-12-04 22:41           ` Jens Axboe
2014-12-05  7:25             ` Karthick Srinivasachary
2014-12-05 17:02               ` Jens Axboe
2014-12-05 17:20                 ` Jens Axboe
2014-12-05 17:46                   ` Jens Axboe
2014-12-05 20:06                     ` Karthick Srinivasachary

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=54807D4F.9080207@kernel.dk \
    --to=axboe@kernel.dk \
    --cc=fio@vger.kernel.org \
    --cc=karthick@pernixdata.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.