* raw device size used by fio
@ 2012-08-08 18:29 Kyle Hailey
2012-08-14 13:09 ` Jens Axboe
0 siblings, 1 reply; 4+ messages in thread
From: Kyle Hailey @ 2012-08-08 18:29 UTC (permalink / raw)
To: fio
I was running a number of tests with raw devices and no size set (but
did use offsets).
In the case where a raw device is specified but no size, what
happens? does fio have a way to figure out the size of the raw device?
What is the usage of the size parameter when there are multiple raw devices.
For example if I have multiple raw devices
filename=/dev/rdsk/c4t3d0p0:/dev/rdsk/c4t4d0p0
and a set size
size=8000m
will it treat the 8000m as the total size of the two devices or is the
8000m the size of each?
If it's the total, then I guess fio can't work with multiple raw
devices of different sizes?
Thanks
--
- Kyle
O: +1.415.341.3430
F: +1.650.494.1676
275 Middlefield Road, Suite 50
Menlo Park, CA 94025
http://www.delphix.com
^ permalink raw reply [flat|nested] 4+ messages in thread* Re: raw device size used by fio
2012-08-08 18:29 raw device size used by fio Kyle Hailey
@ 2012-08-14 13:09 ` Jens Axboe
2012-09-14 17:57 ` Kyle Hailey
2012-09-14 18:11 ` Kyle Hailey
0 siblings, 2 replies; 4+ messages in thread
From: Jens Axboe @ 2012-08-14 13:09 UTC (permalink / raw)
To: Kyle Hailey; +Cc: fio
On 08/08/2012 08:29 PM, Kyle Hailey wrote:
> I was running a number of tests with raw devices and no size set (but
> did use offsets).
> In the case where a raw device is specified but no size, what
> happens? does fio have a way to figure out the size of the raw device?
Yes, fio will figure out the size. If it could not, then it'll complain
since it doesn't know how much IO to do.
> What is the usage of the size parameter when there are multiple raw devices.
> For example if I have multiple raw devices
>
> filename=/dev/rdsk/c4t3d0p0:/dev/rdsk/c4t4d0p0
>
> and a set size
>
> size=8000m
>
> will it treat the 8000m as the total size of the two devices or is the
> 8000m the size of each?
It'll do 8000m of IO in total.
> If it's the total, then I guess fio can't work with multiple raw
> devices of different sizes?
Sure, lets say the first is 2g and the second is 10g. You should end up
with 2g of IO done from the first one, the remainder from the last one.
At least with the default file service policy.
--
Jens Axboe
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: raw device size used by fio
2012-08-14 13:09 ` Jens Axboe
@ 2012-09-14 17:57 ` Kyle Hailey
2012-09-14 18:11 ` Kyle Hailey
1 sibling, 0 replies; 4+ messages in thread
From: Kyle Hailey @ 2012-09-14 17:57 UTC (permalink / raw)
To: Jens Axboe; +Cc: fio
[-- Attachment #1.1: Type: text/plain, Size: 2114 bytes --]
Follow-up question: Is this following a correct picture, if job file has
files=/dev/disk1:/dev/disk2:/dev/diskN
size=S
will this use the first S/N bytes of each file / disk?
If I have a raw device of 16GB and I specify
files=/dev/disk1
size=8g
rw=randread
will fio scatter the 8G of reads across the 16GB or will it limit the reads
to the first 8G?
I want to do the latter. I'm setting up fio to test I/O subsystems but I
first have to initialize the I/O subsystem with writes because some I/O
subsystems "know" there is no data if the data has never been written to,
but I want to limit the amount of data I have to initialize. For example
yesterday the client had 8TB of raw LUNs. It would have been sufficient for
my testing purposes to only use the first 8G across their 16 LUNs.
Thanks
Kyle
On Tue, Aug 14, 2012 at 6:09 AM, Jens Axboe <axboe@kernel.dk> wrote:
> On 08/08/2012 08:29 PM, Kyle Hailey wrote:
> > I was running a number of tests with raw devices and no size set (but
> > did use offsets).
> > In the case where a raw device is specified but no size, what
> > happens? does fio have a way to figure out the size of the raw device?
>
> Yes, fio will figure out the size. If it could not, then it'll complain
> since it doesn't know how much IO to do.
>
> > What is the usage of the size parameter when there are multiple raw
> devices.
> > For example if I have multiple raw devices
> >
> > filename=/dev/rdsk/c4t3d0p0:/dev/rdsk/c4t4d0p0
> >
> > and a set size
> >
> > size=8000m
> >
> > will it treat the 8000m as the total size of the two devices or is the
> > 8000m the size of each?
>
> It'll do 8000m of IO in total.
>
> > If it's the total, then I guess fio can't work with multiple raw
> > devices of different sizes?
>
> Sure, lets say the first is 2g and the second is 10g. You should end up
> with 2g of IO done from the first one, the remainder from the last one.
> At least with the default file service policy.
>
> --
> Jens Axboe
>
>
--
- Kyle
O: +1.415.341.3430
F: +1.650.494.1676
275 Middlefield Road, Suite 50
Menlo Park, CA 94025
http://www.delphix.com
[-- Attachment #1.2: Type: text/html, Size: 4760 bytes --]
[-- Attachment #2: image.png --]
[-- Type: image/png, Size: 821 bytes --]
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: raw device size used by fio
2012-08-14 13:09 ` Jens Axboe
2012-09-14 17:57 ` Kyle Hailey
@ 2012-09-14 18:11 ` Kyle Hailey
1 sibling, 0 replies; 4+ messages in thread
From: Kyle Hailey @ 2012-09-14 18:11 UTC (permalink / raw)
To: Jens Axboe; +Cc: fio
Follow-up question: Is this following a correct picture, if job file has
files=/dev/disk1:/dev/disk2:/dev/diskN
size=S
will this use the first S/N bytes of each file / disk?
If I have a raw device of 16GB and I specify
files=/dev/disk1
size=8g
rw=randread
will fio scatter the 8G of reads across the 16GB or will it limit the
reads to the first 8G?
I want to do the latter. I'm setting up fio to test I/O subsystems but
I first have to initialize the I/O subsystem with writes because some
I/O subsystems "know" there is no data if the data has never been
written to, but I want to limit the amount of data I have to
initialize. For example yesterday the client had 8TB of raw LUNs. It
would have been sufficient for my testing purposes to only use the
first 8G across their 16 LUNs.
Thanks
Kyle
On Tue, Aug 14, 2012 at 6:09 AM, Jens Axboe <axboe@kernel.dk> wrote:
>
> On 08/08/2012 08:29 PM, Kyle Hailey wrote:
> > I was running a number of tests with raw devices and no size set (but
> > did use offsets).
> > In the case where a raw device is specified but no size, what
> > happens? does fio have a way to figure out the size of the raw device?
>
> Yes, fio will figure out the size. If it could not, then it'll complain
> since it doesn't know how much IO to do.
>
> > What is the usage of the size parameter when there are multiple raw
> > devices.
> > For example if I have multiple raw devices
> >
> > filename=/dev/rdsk/c4t3d0p0:/dev/rdsk/c4t4d0p0
> >
> > and a set size
> >
> > size=8000m
> >
> > will it treat the 8000m as the total size of the two devices or is the
> > 8000m the size of each?
>
> It'll do 8000m of IO in total.
>
> > If it's the total, then I guess fio can't work with multiple raw
> > devices of different sizes?
>
> Sure, lets say the first is 2g and the second is 10g. You should end up
> with 2g of IO done from the first one, the remainder from the last one.
> At least with the default file service policy.
>
> --
> Jens Axboe
>
--
- Kyle
O: +1.415.341.3430
F: +1.650.494.1676
275 Middlefield Road, Suite 50
Menlo Park, CA 94025
http://www.delphix.com
^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2012-09-14 18:11 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2012-08-08 18:29 raw device size used by fio Kyle Hailey
2012-08-14 13:09 ` Jens Axboe
2012-09-14 17:57 ` Kyle Hailey
2012-09-14 18:11 ` Kyle Hailey
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
![[-- Attachment #2: image.png --] [-- Type: image/png, Size: 821 bytes --]](../../CACiQ3FCocuuM_EaH4ZkfqqDdyEwg8oSGqUZPiErA+SqCWvvMZw@mail.gmail.com/2-image.png){kind=link}