Huge eta with Read/Write Mix Job and job hangs

Huge eta with Read/Write Mix Job and job hangs

[Lakshmi]

[-- Attachment #1.1: Type: text/plain, Size: 715 bytes --]

Hi Jens,
  I am using the below job file, and this works fine when the numjobs is
less(ex: 5,10) however when I specify a huge numjobs , the job hangs and
shows a huge eta as shown in the attached figure.

When I just run a 100% Reads (71K) or 100% writes(20K) separately  with the
below below parameters it works fine, but it is only when i do a mix of
reads and writes.

Any idea what is going on and if i am missing something?
OS:RHEL7
HDDs(sdf):2x300GB Hdds on RAID10

[test]
 name=test
 ioengine=posixaio
 invalidate=1
 iodepth=32
 bs=71K,20K
 group_reporting=1
 rw=randrw
 rwmixread=96
 rwmixwrite=4
 direct=1
 buffered=0
 size=1M
 time_based
 runtime=300
 filename=/dev/sdf
 numjobs=64

Please help!!
Thanks

[-- Attachment #1.2: Type: text/html, Size: 931 bytes --]

[-- Attachment #2: Huge_eta_RWmix.png --]
[-- Type: image/png, Size: 11043 bytes --]

Re: Huge eta with Read/Write Mix Job and job hangs

[Jens Axboe]

On 12/17/2014 01:22 PM, Lakshmi wrote:
> Hi Jens,
>   I am using the below job file, and this works fine when the numjobs is
> less(ex: 5,10) however when I specify a huge numjobs , the job hangs and
> shows a huge eta as shown in the attached figure.
> 
> When I just run a 100% Reads (71K) or 100% writes(20K) separately  with
> the below below parameters it works fine, but it is only when i do a mix
> of reads and writes.
> 
> Any idea what is going on and if i am missing something?
> OS:RHEL7
> HDDs(sdf):2x300GB Hdds on RAID10
> 
> [test]
>  name=test
>  ioengine=posixaio
>  invalidate=1
>  iodepth=32
>  bs=71K,20K
>  group_reporting=1
>  rw=randrw
>  rwmixread=96
>  rwmixwrite=4
>  direct=1
>  buffered=0
>  size=1M
>  time_based
>  runtime=300
>  filename=/dev/sdf
>  numjobs=64

Doesn't reproduce here. Please update to the latest fio version and see
if it still reproduce, before I spend any time looking at this.

-- 
Jens Axboe

Re: Huge eta with Read/Write Mix Job and job hangs

[Lakshmi]

[-- Attachment #1: Type: text/plain, Size: 1146 bytes --]

Hi Jens,
 I am using the latest version 2.1.10 .

Thanks

On Wed, Dec 17, 2014 at 2:50 PM, Jens Axboe <axboe@kernel.dk> wrote:
>
> On 12/17/2014 01:22 PM, Lakshmi wrote:
> > Hi Jens,
> >   I am using the below job file, and this works fine when the numjobs is
> > less(ex: 5,10) however when I specify a huge numjobs , the job hangs and
> > shows a huge eta as shown in the attached figure.
> >
> > When I just run a 100% Reads (71K) or 100% writes(20K) separately  with
> > the below below parameters it works fine, but it is only when i do a mix
> > of reads and writes.
> >
> > Any idea what is going on and if i am missing something?
> > OS:RHEL7
> > HDDs(sdf):2x300GB Hdds on RAID10
> >
> > [test]
> >  name=test
> >  ioengine=posixaio
> >  invalidate=1
> >  iodepth=32
> >  bs=71K,20K
> >  group_reporting=1
> >  rw=randrw
> >  rwmixread=96
> >  rwmixwrite=4
> >  direct=1
> >  buffered=0
> >  size=1M
> >  time_based
> >  runtime=300
> >  filename=/dev/sdf
> >  numjobs=64
>
> Doesn't reproduce here. Please update to the latest fio version and see
> if it still reproduce, before I spend any time looking at this.
>
> --
> Jens Axboe
>
>

[-- Attachment #2: Type: text/html, Size: 1796 bytes --]

Re: Huge eta with Read/Write Mix Job and job hangs

[Jens Axboe]

[-- Attachment #1: Type: text/plain, Size: 179 bytes --]



> On Dec 17, 2014, at 4:44 PM, Lakshmi <sendtold@gmail.com> wrote:
> 
> Hi Jens,
>  I am using the latest version 2.1.10 .

No, that's not the latest. Grab 2.2.0 and try that.


[-- Attachment #2: Type: text/html, Size: 783 bytes --]