How to get IOPS when using terse output

How to get IOPS when using terse output

[Peter Xu]

Hi, all,

I failed to find IOPS results for read/write under terse mode (with 
--minimal param when invoking fio program), while IOPS does exist in 
normal output without --minimal param.

It seems that I even cannot calculate it out only with the tersed output 
(since I don't know the total number of IO). Then, how should I get IOPS 
results when using terse output?

Yours,
Peter

RE: How to get IOPS when using terse output

[Carl Zwanzig]

Hello,

IOPS is definitely in the terse output. IIRC it's the column just after the bandwidth (don't remember the column # off hand; I have a awk script to pull out the interesting data). Look at the bottom of the HOWTO file for the layout of terse output.

z!

________________________________________
From: fio-owner@vger.kernel.org [fio-owner@vger.kernel.org] on behalf of Peter Xu [xzpeter@gmail.com]
Sent: Wednesday, February 13, 2013 2:44 AM
To: fio@vger.kernel.org
Subject: How to get IOPS when using terse output

Hi, all,

I failed to find IOPS results for read/write under terse mode (with
--minimal param when invoking fio program), while IOPS does exist in
normal output without --minimal param.

It seems that I even cannot calculate it out only with the tersed output
(since I don't know the total number of IO). Then, how should I get IOPS
results when using terse output?

RE: How to get IOPS when using terse output

[Carl Zwanzig]

As I mentioned, I use an awk script to extract the relevant parts

B/W columns $7 and $48
IOPS columns $8 and $49
completion latency columns $16 and $57

z!

Re: How to get IOPS when using terse output

[Jens Axboe]

On Wed, Feb 13 2013, Peter Xu wrote:
> Hi, all,
> 
> I failed to find IOPS results for read/write under terse mode (with
> --minimal param when invoking fio program), while IOPS does exist in normal
> output without --minimal param.
> 
> It seems that I even cannot calculate it out only with the tersed output
> (since I don't know the total number of IO). Then, how should I get IOPS
> results when using terse output?

As Carl mentions, the IOPS are there. But let me make a suggestion to
move over to the json format instead. It's easy to parse by computers
and humans, and new performance metrics can be added without causing
breakage in existing setups. The minimal/csv format is somewhat fragile
for that.

That said, IOPS is there in the minimal output :-)

-- 
Jens Axboe

Re: How to get IOPS when using terse output

[Georg Schönberger]

----- Original Message -----
> From: "Jens Axboe" <axboe@kernel.dk>
> To: "Peter Xu" <xzpeter@gmail.com>
> Cc: fio@vger.kernel.org
> Sent: Monday, 18 February, 2013 9:08:29 AM
> Subject: Re: How to get IOPS when using terse output
> 
> On Wed, Feb 13 2013, Peter Xu wrote:
> > Hi, all,
> > 
> > I failed to find IOPS results for read/write under terse mode (with
> > --minimal param when invoking fio program), while IOPS does exist
> > in normal
> > output without --minimal param.
> > 
> > It seems that I even cannot calculate it out only with the tersed
> > output
> > (since I don't know the total number of IO). Then, how should I get
> > IOPS
> > results when using terse output?
> 
> As Carl mentions, the IOPS are there. But let me make a suggestion to
> move over to the json format instead. It's easy to parse by computers
> and humans, and new performance metrics can be added without causing
> breakage in existing setups. The minimal/csv format is somewhat
> fragile
> for that.
> 
> That said, IOPS is there in the minimal output :-)
> 
> --
> Jens Axboe
> 
Maybe you consider that version 3 of the terse output is only used since Fio version 2.0.3!
Before that I think that IOPS are not in the terse output (http://freecode.com/projects/fio/releases/341331).
In the current Debian (http://packages.debian.org/squeeze/fio) and Ubuntu LTS releases (http://packages.ubuntu.com/precise/fio) the Fio version is before 2.0.3 and therefore the terse output is not of version 3.

As Jens said, you can also switch to JSON format instead.
So maybe you are stuck to use Fio from the git repo to have a newer version.

Regards, Georg

Re: How to get IOPS when using terse output

[Jens Axboe]

On Mon, Feb 18 2013, Georg Sch�nberger wrote:
> ----- Original Message -----
> > From: "Jens Axboe" <axboe@kernel.dk>
> > To: "Peter Xu" <xzpeter@gmail.com>
> > Cc: fio@vger.kernel.org
> > Sent: Monday, 18 February, 2013 9:08:29 AM
> > Subject: Re: How to get IOPS when using terse output
> > 
> > On Wed, Feb 13 2013, Peter Xu wrote:
> > > Hi, all,
> > > 
> > > I failed to find IOPS results for read/write under terse mode (with
> > > --minimal param when invoking fio program), while IOPS does exist
> > > in normal
> > > output without --minimal param.
> > > 
> > > It seems that I even cannot calculate it out only with the tersed
> > > output
> > > (since I don't know the total number of IO). Then, how should I get
> > > IOPS
> > > results when using terse output?
> > 
> > As Carl mentions, the IOPS are there. But let me make a suggestion to
> > move over to the json format instead. It's easy to parse by computers
> > and humans, and new performance metrics can be added without causing
> > breakage in existing setups. The minimal/csv format is somewhat
> > fragile
> > for that.
> > 
> > That said, IOPS is there in the minimal output :-)
> > 
> > --
> > Jens Axboe
> > 
> Maybe you consider that version 3 of the terse output is only used
> since Fio version 2.0.3!  Before that I think that IOPS are not in the
> terse output (http://freecode.com/projects/fio/releases/341331).  In
> the current Debian (http://packages.debian.org/squeeze/fio) and Ubuntu
> LTS releases (http://packages.ubuntu.com/precise/fio) the Fio version
> is before 2.0.3 and therefore the terse output is not of version 3.

Ah yes, good point, I always seem to assume that people are running fio
out of the git repo. But yes, the IOPS is a recent(ish) addition. Though
2.0.3 is more than a year old at this point.

> As Jens said, you can also switch to JSON format instead.
> So maybe you are stuck to use Fio from the git repo to have a newer version.

Yep, json is an even newer addition than terse v3, so an update is in
order in any case.

-- 
Jens Axboe