* Re: Backend ObjectStore engine performance bench with FIO
[not found] <99767EA2E27DD44DB4E9F9B9ACA458C03BD7EFC9@SSIEXCH-MB3.ssi.samsung.com>
@ 2015-09-25 18:22 ` Casey Bodley
2015-09-29 20:06 ` Casey Bodley
0 siblings, 1 reply; 6+ messages in thread
From: Casey Bodley @ 2015-09-25 18:22 UTC (permalink / raw)
To: James (Fei) Liu-SSI; +Cc: Xiaoxi Chen, Sage Weil, ceph-devel
Great work James!
----- Original Message -----
> From: "James (Fei) Liu-SSI" <james.liu@ssi.samsung.com>
> To: "Xiaoxi Chen" <xiaoxi.chen@intel.com>, "Casey Bodley" <cbodley@redhat.com>
> Cc: "Sage Weil" <sage@newdream.net>, ceph-devel@vger.kernel.org
> Sent: Friday, September 25, 2015 1:55:29 PM
> Subject: Backend ObjectStore engine performance bench with FIO
>
> Hi Xiaoxi,
>
> With changing the IO mode from aio to sync, we make fio against newstore
> works. Even with sync engine(I am still debugging the aio engine in
> newstore with Xiaoxi) in newstore, Newstore still performing the best
> among all of backstore engine with our initial setup(Thoroughly test will
> be run soon). Attachment is the initial data we collected for your
> reference. Thanks for great help from Xiaoxi from regarding to Newstore
> development to support FIO.
>
> Hi Casey,
> Let me know if you need any help to put fio-ceph-objectstore into upstream.
> After then , I can commit all of mine into upstream.
My pull request at https://github.com/ceph/ceph/pull/5943 is still pending. If you have patches that you'd like included, I would be happy to pull them in; just point me to a branch.
>
> Thanks,
> James
>
Thanks,
Casey
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Backend ObjectStore engine performance bench with FIO
2015-09-25 18:22 ` Backend ObjectStore engine performance bench with FIO Casey Bodley
@ 2015-09-29 20:06 ` Casey Bodley
2015-09-29 21:12 ` James (Fei) Liu-SSI
2015-09-30 0:47 ` Chen, Xiaoxi
0 siblings, 2 replies; 6+ messages in thread
From: Casey Bodley @ 2015-09-29 20:06 UTC (permalink / raw)
To: James (Fei) Liu-SSI; +Cc: ceph-devel
Hi James/Haomai/Xiaoxi,
I spent some more time on the fio-objectstore branch, and pushed an update.
In testing, I realized that it was using the io_unit's start time to name the
objects, which meant that every write operation was creating a separate object.
In addition to fixing this to use fio's filenames for object names, I also
added support for the open_file() and close_file() functions. It now creates
objects of the proper size on startup, so read-only jobs will work normally.
It also removes its objects on exit.
On startup, it no longer calls create_collection() if it already exists, so I
was able to re-run fio jobs over and over again without having to clear the
data directory (tested with FileStore and KeyValueStore).
Casey
----- Original Message -----
> Great work James!
>
> ----- Original Message -----
> > From: "James (Fei) Liu-SSI" <james.liu@ssi.samsung.com>
> > To: "Xiaoxi Chen" <xiaoxi.chen@intel.com>, "Casey Bodley"
> > <cbodley@redhat.com>
> > Cc: "Sage Weil" <sage@newdream.net>, ceph-devel@vger.kernel.org
> > Sent: Friday, September 25, 2015 1:55:29 PM
> > Subject: Backend ObjectStore engine performance bench with FIO
> >
> > Hi Xiaoxi,
> >
> > With changing the IO mode from aio to sync, we make fio against newstore
> > works. Even with sync engine(I am still debugging the aio engine in
> > newstore with Xiaoxi) in newstore, Newstore still performing the best
> > among all of backstore engine with our initial setup(Thoroughly test
> > will
> > be run soon). Attachment is the initial data we collected for your
> > reference. Thanks for great help from Xiaoxi from regarding to Newstore
> > development to support FIO.
> >
> > Hi Casey,
> > Let me know if you need any help to put fio-ceph-objectstore into
> > upstream.
> > After then , I can commit all of mine into upstream.
>
> My pull request at https://github.com/ceph/ceph/pull/5943 is still pending.
> If you have patches that you'd like included, I would be happy to pull them
> in; just point me to a branch.
>
> >
> > Thanks,
> > James
> >
>
> Thanks,
> Casey
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
>
^ permalink raw reply [flat|nested] 6+ messages in thread
* RE: Backend ObjectStore engine performance bench with FIO
2015-09-29 20:06 ` Casey Bodley
@ 2015-09-29 21:12 ` James (Fei) Liu-SSI
2015-09-30 0:47 ` Chen, Xiaoxi
1 sibling, 0 replies; 6+ messages in thread
From: James (Fei) Liu-SSI @ 2015-09-29 21:12 UTC (permalink / raw)
To: Casey Bodley; +Cc: ceph-devel@vger.kernel.org
Hi Casey,
Great job.
Regards,
James
-----Original Message-----
From: Casey Bodley [mailto:cbodley@redhat.com]
Sent: Tuesday, September 29, 2015 1:06 PM
To: James (Fei) Liu-SSI
Cc: ceph-devel@vger.kernel.org
Subject: Re: Backend ObjectStore engine performance bench with FIO
Hi James/Haomai/Xiaoxi,
I spent some more time on the fio-objectstore branch, and pushed an update.
In testing, I realized that it was using the io_unit's start time to name the objects, which meant that every write operation was creating a separate object.
In addition to fixing this to use fio's filenames for object names, I also added support for the open_file() and close_file() functions. It now creates objects of the proper size on startup, so read-only jobs will work normally.
It also removes its objects on exit.
On startup, it no longer calls create_collection() if it already exists, so I was able to re-run fio jobs over and over again without having to clear the data directory (tested with FileStore and KeyValueStore).
Casey
----- Original Message -----
> Great work James!
>
> ----- Original Message -----
> > From: "James (Fei) Liu-SSI" <james.liu@ssi.samsung.com>
> > To: "Xiaoxi Chen" <xiaoxi.chen@intel.com>, "Casey Bodley"
> > <cbodley@redhat.com>
> > Cc: "Sage Weil" <sage@newdream.net>, ceph-devel@vger.kernel.org
> > Sent: Friday, September 25, 2015 1:55:29 PM
> > Subject: Backend ObjectStore engine performance bench with FIO
> >
> > Hi Xiaoxi,
> >
> > With changing the IO mode from aio to sync, we make fio against newstore
> > works. Even with sync engine(I am still debugging the aio engine in
> > newstore with Xiaoxi) in newstore, Newstore still performing the best
> > among all of backstore engine with our initial setup(Thoroughly test
> > will
> > be run soon). Attachment is the initial data we collected for your
> > reference. Thanks for great help from Xiaoxi from regarding to Newstore
> > development to support FIO.
> >
> > Hi Casey,
> > Let me know if you need any help to put fio-ceph-objectstore into
> > upstream.
> > After then , I can commit all of mine into upstream.
>
> My pull request at https://github.com/ceph/ceph/pull/5943 is still pending.
> If you have patches that you'd like included, I would be happy to pull
> them in; just point me to a branch.
>
> >
> > Thanks,
> > James
> >
>
> Thanks,
> Casey
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel"
> in the body of a message to majordomo@vger.kernel.org More majordomo
> info at http://vger.kernel.org/majordomo-info.html
>
^ permalink raw reply [flat|nested] 6+ messages in thread
* RE: Backend ObjectStore engine performance bench with FIO
2015-09-29 20:06 ` Casey Bodley
2015-09-29 21:12 ` James (Fei) Liu-SSI
@ 2015-09-30 0:47 ` Chen, Xiaoxi
2015-09-30 13:57 ` Casey Bodley
1 sibling, 1 reply; 6+ messages in thread
From: Chen, Xiaoxi @ 2015-09-30 0:47 UTC (permalink / raw)
To: Casey Bodley, James (Fei) Liu-SSI; +Cc: ceph-devel@vger.kernel.org
Hi Casey,
Would it better if we create an integration brunch on ceph/ceph/wip-fio-objstore to allow more people try and improve it? Seems James has some patches.
-Xiaoxi
> -----Original Message-----
> From: ceph-devel-owner@vger.kernel.org [mailto:ceph-devel-
> owner@vger.kernel.org] On Behalf Of Casey Bodley
> Sent: Wednesday, September 30, 2015 4:06 AM
> To: James (Fei) Liu-SSI
> Cc: ceph-devel@vger.kernel.org
> Subject: Re: Backend ObjectStore engine performance bench with FIO
>
> Hi James/Haomai/Xiaoxi,
>
> I spent some more time on the fio-objectstore branch, and pushed an
> update.
>
> In testing, I realized that it was using the io_unit's start time to name the
> objects, which meant that every write operation was creating a separate
> object.
> In addition to fixing this to use fio's filenames for object names, I also added
> support for the open_file() and close_file() functions. It now creates objects
> of the proper size on startup, so read-only jobs will work normally.
> It also removes its objects on exit.
>
> On startup, it no longer calls create_collection() if it already exists, so I was
> able to re-run fio jobs over and over again without having to clear the data
> directory (tested with FileStore and KeyValueStore).
>
> Casey
>
> ----- Original Message -----
> > Great work James!
> >
> > ----- Original Message -----
> > > From: "James (Fei) Liu-SSI" <james.liu@ssi.samsung.com>
> > > To: "Xiaoxi Chen" <xiaoxi.chen@intel.com>, "Casey Bodley"
> > > <cbodley@redhat.com>
> > > Cc: "Sage Weil" <sage@newdream.net>, ceph-devel@vger.kernel.org
> > > Sent: Friday, September 25, 2015 1:55:29 PM
> > > Subject: Backend ObjectStore engine performance bench with FIO
> > >
> > > Hi Xiaoxi,
> > >
> > > With changing the IO mode from aio to sync, we make fio against
> newstore
> > > works. Even with sync engine(I am still debugging the aio engine in
> > > newstore with Xiaoxi) in newstore, Newstore still performing the best
> > > among all of backstore engine with our initial setup(Thoroughly test
> > > will
> > > be run soon). Attachment is the initial data we collected for your
> > > reference. Thanks for great help from Xiaoxi from regarding to
> Newstore
> > > development to support FIO.
> > >
> > > Hi Casey,
> > > Let me know if you need any help to put fio-ceph-objectstore into
> > > upstream.
> > > After then , I can commit all of mine into upstream.
> >
> > My pull request at https://github.com/ceph/ceph/pull/5943 is still pending.
> > If you have patches that you'd like included, I would be happy to pull
> > them in; just point me to a branch.
> >
> > >
> > > Thanks,
> > > James
> > >
> >
> > Thanks,
> > Casey
> > --
> > To unsubscribe from this list: send the line "unsubscribe ceph-devel"
> > in the body of a message to majordomo@vger.kernel.org More
> majordomo
> > info at http://vger.kernel.org/majordomo-info.html
> >
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the
> body of a message to majordomo@vger.kernel.org More majordomo info at
> http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Backend ObjectStore engine performance bench with FIO
2015-09-30 0:47 ` Chen, Xiaoxi
@ 2015-09-30 13:57 ` Casey Bodley
2015-09-30 18:30 ` James (Fei) Liu-SSI
0 siblings, 1 reply; 6+ messages in thread
From: Casey Bodley @ 2015-09-30 13:57 UTC (permalink / raw)
To: Xiaoxi Chen; +Cc: James (Fei) Liu-SSI, ceph-devel
Hi Xiaoxi,
I pushed a new branch wip-fio-objectstore to ceph's github. I look forward to seeing James' work!
Thanks,
Casey
----- Original Message -----
> Hi Casey,
> Would it better if we create an integration brunch on
> ceph/ceph/wip-fio-objstore to allow more people try and improve it?
> Seems James has some patches.
>
> -Xiaoxi
>
> > -----Original Message-----
> > From: ceph-devel-owner@vger.kernel.org [mailto:ceph-devel-
> > owner@vger.kernel.org] On Behalf Of Casey Bodley
> > Sent: Wednesday, September 30, 2015 4:06 AM
> > To: James (Fei) Liu-SSI
> > Cc: ceph-devel@vger.kernel.org
> > Subject: Re: Backend ObjectStore engine performance bench with FIO
> >
> > Hi James/Haomai/Xiaoxi,
> >
> > I spent some more time on the fio-objectstore branch, and pushed an
> > update.
> >
> > In testing, I realized that it was using the io_unit's start time to name
> > the
> > objects, which meant that every write operation was creating a separate
> > object.
> > In addition to fixing this to use fio's filenames for object names, I also
> > added
> > support for the open_file() and close_file() functions. It now creates
> > objects
> > of the proper size on startup, so read-only jobs will work normally.
> > It also removes its objects on exit.
> >
> > On startup, it no longer calls create_collection() if it already exists, so
> > I was
> > able to re-run fio jobs over and over again without having to clear the
> > data
> > directory (tested with FileStore and KeyValueStore).
> >
> > Casey
> >
> > ----- Original Message -----
> > > Great work James!
> > >
> > > ----- Original Message -----
> > > > From: "James (Fei) Liu-SSI" <james.liu@ssi.samsung.com>
> > > > To: "Xiaoxi Chen" <xiaoxi.chen@intel.com>, "Casey Bodley"
> > > > <cbodley@redhat.com>
> > > > Cc: "Sage Weil" <sage@newdream.net>, ceph-devel@vger.kernel.org
> > > > Sent: Friday, September 25, 2015 1:55:29 PM
> > > > Subject: Backend ObjectStore engine performance bench with FIO
> > > >
> > > > Hi Xiaoxi,
> > > >
> > > > With changing the IO mode from aio to sync, we make fio against
> > newstore
> > > > works. Even with sync engine(I am still debugging the aio engine in
> > > > newstore with Xiaoxi) in newstore, Newstore still performing the
> > > > best
> > > > among all of backstore engine with our initial setup(Thoroughly test
> > > > will
> > > > be run soon). Attachment is the initial data we collected for your
> > > > reference. Thanks for great help from Xiaoxi from regarding to
> > Newstore
> > > > development to support FIO.
> > > >
> > > > Hi Casey,
> > > > Let me know if you need any help to put fio-ceph-objectstore into
> > > > upstream.
> > > > After then , I can commit all of mine into upstream.
> > >
> > > My pull request at https://github.com/ceph/ceph/pull/5943 is still
> > > pending.
> > > If you have patches that you'd like included, I would be happy to pull
> > > them in; just point me to a branch.
> > >
> > > >
> > > > Thanks,
> > > > James
> > > >
> > >
> > > Thanks,
> > > Casey
> > > --
> > > To unsubscribe from this list: send the line "unsubscribe ceph-devel"
> > > in the body of a message to majordomo@vger.kernel.org More
> > majordomo
> > > info at http://vger.kernel.org/majordomo-info.html
> > >
> > --
> > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> > the
> > body of a message to majordomo@vger.kernel.org More majordomo info at
> > http://vger.kernel.org/majordomo-info.html
> N�����r��y���b�X��ǧv�^�){.n�+���z�]z���{ay�ʇڙ�,j��f���h���z��w������j:+v���w�j�m��������zZ+��ݢj"��
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 6+ messages in thread
* RE: Backend ObjectStore engine performance bench with FIO
2015-09-30 13:57 ` Casey Bodley
@ 2015-09-30 18:30 ` James (Fei) Liu-SSI
0 siblings, 0 replies; 6+ messages in thread
From: James (Fei) Liu-SSI @ 2015-09-30 18:30 UTC (permalink / raw)
To: Casey Bodley, Xiaoxi Chen; +Cc: ceph-devel@vger.kernel.org
Hi Casey and Xiaoxi,
The next challenge to us is to figure out why the performance is so bad with fio-ceph-objectstore. With our initial performance data, the newstore is ~ 9 times worse than raw block device access in terms of IOPS and raw data.
As I mentioned , The sync engine is might be the bottleneck. Anything else in your mind will be the bottleneck?
Regards,
James
-----Original Message-----
From: Casey Bodley [mailto:cbodley@redhat.com]
Sent: Wednesday, September 30, 2015 6:57 AM
To: Xiaoxi Chen
Cc: James (Fei) Liu-SSI; ceph-devel@vger.kernel.org
Subject: Re: Backend ObjectStore engine performance bench with FIO
Hi Xiaoxi,
I pushed a new branch wip-fio-objectstore to ceph's github. I look forward to seeing James' work!
Thanks,
Casey
----- Original Message -----
> Hi Casey,
> Would it better if we create an integration brunch on
> ceph/ceph/wip-fio-objstore to allow more people try and improve it?
> Seems James has some patches.
>
> -Xiaoxi
>
> > -----Original Message-----
> > From: ceph-devel-owner@vger.kernel.org [mailto:ceph-devel-
> > owner@vger.kernel.org] On Behalf Of Casey Bodley
> > Sent: Wednesday, September 30, 2015 4:06 AM
> > To: James (Fei) Liu-SSI
> > Cc: ceph-devel@vger.kernel.org
> > Subject: Re: Backend ObjectStore engine performance bench with FIO
> >
> > Hi James/Haomai/Xiaoxi,
> >
> > I spent some more time on the fio-objectstore branch, and pushed an
> > update.
> >
> > In testing, I realized that it was using the io_unit's start time to
> > name the objects, which meant that every write operation was
> > creating a separate object.
> > In addition to fixing this to use fio's filenames for object names,
> > I also added support for the open_file() and close_file() functions.
> > It now creates objects of the proper size on startup, so read-only
> > jobs will work normally.
> > It also removes its objects on exit.
> >
> > On startup, it no longer calls create_collection() if it already
> > exists, so I was able to re-run fio jobs over and over again without
> > having to clear the data directory (tested with FileStore and
> > KeyValueStore).
> >
> > Casey
> >
> > ----- Original Message -----
> > > Great work James!
> > >
> > > ----- Original Message -----
> > > > From: "James (Fei) Liu-SSI" <james.liu@ssi.samsung.com>
> > > > To: "Xiaoxi Chen" <xiaoxi.chen@intel.com>, "Casey Bodley"
> > > > <cbodley@redhat.com>
> > > > Cc: "Sage Weil" <sage@newdream.net>, ceph-devel@vger.kernel.org
> > > > Sent: Friday, September 25, 2015 1:55:29 PM
> > > > Subject: Backend ObjectStore engine performance bench with FIO
> > > >
> > > > Hi Xiaoxi,
> > > >
> > > > With changing the IO mode from aio to sync, we make fio
> > > > against
> > newstore
> > > > works. Even with sync engine(I am still debugging the aio engine in
> > > > newstore with Xiaoxi) in newstore, Newstore still performing the
> > > > best
> > > > among all of backstore engine with our initial setup(Thoroughly test
> > > > will
> > > > be run soon). Attachment is the initial data we collected for your
> > > > reference. Thanks for great help from Xiaoxi from regarding
> > > > to
> > Newstore
> > > > development to support FIO.
> > > >
> > > > Hi Casey,
> > > > Let me know if you need any help to put fio-ceph-objectstore into
> > > > upstream.
> > > > After then , I can commit all of mine into upstream.
> > >
> > > My pull request at https://github.com/ceph/ceph/pull/5943 is still
> > > pending.
> > > If you have patches that you'd like included, I would be happy to
> > > pull them in; just point me to a branch.
> > >
> > > >
> > > > Thanks,
> > > > James
> > > >
> > >
> > > Thanks,
> > > Casey
> > > --
> > > To unsubscribe from this list: send the line "unsubscribe ceph-devel"
> > > in the body of a message to majordomo@vger.kernel.org More
> > majordomo
> > > info at http://vger.kernel.org/majordomo-info.html
> > >
> > --
> > To unsubscribe from this list: send the line "unsubscribe
> > ceph-devel" in the body of a message to majordomo@vger.kernel.org
> > More majordomo info at http://vger.kernel.org/majordomo-info.html
> N r y b X ǧv ^ ){.n + z ]z {ay ʇڙ ,j f h z w j
> :+v w j m zZ+ ݢj"
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2015-09-30 18:30 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
[not found] <99767EA2E27DD44DB4E9F9B9ACA458C03BD7EFC9@SSIEXCH-MB3.ssi.samsung.com>
2015-09-25 18:22 ` Backend ObjectStore engine performance bench with FIO Casey Bodley
2015-09-29 20:06 ` Casey Bodley
2015-09-29 21:12 ` James (Fei) Liu-SSI
2015-09-30 0:47 ` Chen, Xiaoxi
2015-09-30 13:57 ` Casey Bodley
2015-09-30 18:30 ` James (Fei) Liu-SSI
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.