* Re: Backend ObjectStore engine performance bench with FIO [not found] <99767EA2E27DD44DB4E9F9B9ACA458C03BD7EFC9@SSIEXCH-MB3.ssi.samsung.com> @ 2015-09-25 18:22 ` Casey Bodley 2015-09-29 20:06 ` Casey Bodley 0 siblings, 1 reply; 6+ messages in thread From: Casey Bodley @ 2015-09-25 18:22 UTC (permalink / raw) To: James (Fei) Liu-SSI; +Cc: Xiaoxi Chen, Sage Weil, ceph-devel Great work James! ----- Original Message ----- > From: "James (Fei) Liu-SSI" <james.liu@ssi.samsung.com> > To: "Xiaoxi Chen" <xiaoxi.chen@intel.com>, "Casey Bodley" <cbodley@redhat.com> > Cc: "Sage Weil" <sage@newdream.net>, ceph-devel@vger.kernel.org > Sent: Friday, September 25, 2015 1:55:29 PM > Subject: Backend ObjectStore engine performance bench with FIO > > Hi Xiaoxi, > > With changing the IO mode from aio to sync, we make fio against newstore > works. Even with sync engine(I am still debugging the aio engine in > newstore with Xiaoxi) in newstore, Newstore still performing the best > among all of backstore engine with our initial setup(Thoroughly test will > be run soon). Attachment is the initial data we collected for your > reference. Thanks for great help from Xiaoxi from regarding to Newstore > development to support FIO. > > Hi Casey, > Let me know if you need any help to put fio-ceph-objectstore into upstream. > After then , I can commit all of mine into upstream. My pull request at https://github.com/ceph/ceph/pull/5943 is still pending. If you have patches that you'd like included, I would be happy to pull them in; just point me to a branch. > > Thanks, > James > Thanks, Casey ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Backend ObjectStore engine performance bench with FIO 2015-09-25 18:22 ` Backend ObjectStore engine performance bench with FIO Casey Bodley @ 2015-09-29 20:06 ` Casey Bodley 2015-09-29 21:12 ` James (Fei) Liu-SSI 2015-09-30 0:47 ` Chen, Xiaoxi 0 siblings, 2 replies; 6+ messages in thread From: Casey Bodley @ 2015-09-29 20:06 UTC (permalink / raw) To: James (Fei) Liu-SSI; +Cc: ceph-devel Hi James/Haomai/Xiaoxi, I spent some more time on the fio-objectstore branch, and pushed an update. In testing, I realized that it was using the io_unit's start time to name the objects, which meant that every write operation was creating a separate object. In addition to fixing this to use fio's filenames for object names, I also added support for the open_file() and close_file() functions. It now creates objects of the proper size on startup, so read-only jobs will work normally. It also removes its objects on exit. On startup, it no longer calls create_collection() if it already exists, so I was able to re-run fio jobs over and over again without having to clear the data directory (tested with FileStore and KeyValueStore). Casey ----- Original Message ----- > Great work James! > > ----- Original Message ----- > > From: "James (Fei) Liu-SSI" <james.liu@ssi.samsung.com> > > To: "Xiaoxi Chen" <xiaoxi.chen@intel.com>, "Casey Bodley" > > <cbodley@redhat.com> > > Cc: "Sage Weil" <sage@newdream.net>, ceph-devel@vger.kernel.org > > Sent: Friday, September 25, 2015 1:55:29 PM > > Subject: Backend ObjectStore engine performance bench with FIO > > > > Hi Xiaoxi, > > > > With changing the IO mode from aio to sync, we make fio against newstore > > works. Even with sync engine(I am still debugging the aio engine in > > newstore with Xiaoxi) in newstore, Newstore still performing the best > > among all of backstore engine with our initial setup(Thoroughly test > > will > > be run soon). Attachment is the initial data we collected for your > > reference. Thanks for great help from Xiaoxi from regarding to Newstore > > development to support FIO. > > > > Hi Casey, > > Let me know if you need any help to put fio-ceph-objectstore into > > upstream. > > After then , I can commit all of mine into upstream. > > My pull request at https://github.com/ceph/ceph/pull/5943 is still pending. > If you have patches that you'd like included, I would be happy to pull them > in; just point me to a branch. > > > > > Thanks, > > James > > > > Thanks, > Casey > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > ^ permalink raw reply [flat|nested] 6+ messages in thread
* RE: Backend ObjectStore engine performance bench with FIO 2015-09-29 20:06 ` Casey Bodley @ 2015-09-29 21:12 ` James (Fei) Liu-SSI 2015-09-30 0:47 ` Chen, Xiaoxi 1 sibling, 0 replies; 6+ messages in thread From: James (Fei) Liu-SSI @ 2015-09-29 21:12 UTC (permalink / raw) To: Casey Bodley; +Cc: ceph-devel@vger.kernel.org Hi Casey, Great job. Regards, James -----Original Message----- From: Casey Bodley [mailto:cbodley@redhat.com] Sent: Tuesday, September 29, 2015 1:06 PM To: James (Fei) Liu-SSI Cc: ceph-devel@vger.kernel.org Subject: Re: Backend ObjectStore engine performance bench with FIO Hi James/Haomai/Xiaoxi, I spent some more time on the fio-objectstore branch, and pushed an update. In testing, I realized that it was using the io_unit's start time to name the objects, which meant that every write operation was creating a separate object. In addition to fixing this to use fio's filenames for object names, I also added support for the open_file() and close_file() functions. It now creates objects of the proper size on startup, so read-only jobs will work normally. It also removes its objects on exit. On startup, it no longer calls create_collection() if it already exists, so I was able to re-run fio jobs over and over again without having to clear the data directory (tested with FileStore and KeyValueStore). Casey ----- Original Message ----- > Great work James! > > ----- Original Message ----- > > From: "James (Fei) Liu-SSI" <james.liu@ssi.samsung.com> > > To: "Xiaoxi Chen" <xiaoxi.chen@intel.com>, "Casey Bodley" > > <cbodley@redhat.com> > > Cc: "Sage Weil" <sage@newdream.net>, ceph-devel@vger.kernel.org > > Sent: Friday, September 25, 2015 1:55:29 PM > > Subject: Backend ObjectStore engine performance bench with FIO > > > > Hi Xiaoxi, > > > > With changing the IO mode from aio to sync, we make fio against newstore > > works. Even with sync engine(I am still debugging the aio engine in > > newstore with Xiaoxi) in newstore, Newstore still performing the best > > among all of backstore engine with our initial setup(Thoroughly test > > will > > be run soon). Attachment is the initial data we collected for your > > reference. Thanks for great help from Xiaoxi from regarding to Newstore > > development to support FIO. > > > > Hi Casey, > > Let me know if you need any help to put fio-ceph-objectstore into > > upstream. > > After then , I can commit all of mine into upstream. > > My pull request at https://github.com/ceph/ceph/pull/5943 is still pending. > If you have patches that you'd like included, I would be happy to pull > them in; just point me to a branch. > > > > > Thanks, > > James > > > > Thanks, > Casey > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel" > in the body of a message to majordomo@vger.kernel.org More majordomo > info at http://vger.kernel.org/majordomo-info.html > ^ permalink raw reply [flat|nested] 6+ messages in thread
* RE: Backend ObjectStore engine performance bench with FIO 2015-09-29 20:06 ` Casey Bodley 2015-09-29 21:12 ` James (Fei) Liu-SSI @ 2015-09-30 0:47 ` Chen, Xiaoxi 2015-09-30 13:57 ` Casey Bodley 1 sibling, 1 reply; 6+ messages in thread From: Chen, Xiaoxi @ 2015-09-30 0:47 UTC (permalink / raw) To: Casey Bodley, James (Fei) Liu-SSI; +Cc: ceph-devel@vger.kernel.org Hi Casey, Would it better if we create an integration brunch on ceph/ceph/wip-fio-objstore to allow more people try and improve it? Seems James has some patches. -Xiaoxi > -----Original Message----- > From: ceph-devel-owner@vger.kernel.org [mailto:ceph-devel- > owner@vger.kernel.org] On Behalf Of Casey Bodley > Sent: Wednesday, September 30, 2015 4:06 AM > To: James (Fei) Liu-SSI > Cc: ceph-devel@vger.kernel.org > Subject: Re: Backend ObjectStore engine performance bench with FIO > > Hi James/Haomai/Xiaoxi, > > I spent some more time on the fio-objectstore branch, and pushed an > update. > > In testing, I realized that it was using the io_unit's start time to name the > objects, which meant that every write operation was creating a separate > object. > In addition to fixing this to use fio's filenames for object names, I also added > support for the open_file() and close_file() functions. It now creates objects > of the proper size on startup, so read-only jobs will work normally. > It also removes its objects on exit. > > On startup, it no longer calls create_collection() if it already exists, so I was > able to re-run fio jobs over and over again without having to clear the data > directory (tested with FileStore and KeyValueStore). > > Casey > > ----- Original Message ----- > > Great work James! > > > > ----- Original Message ----- > > > From: "James (Fei) Liu-SSI" <james.liu@ssi.samsung.com> > > > To: "Xiaoxi Chen" <xiaoxi.chen@intel.com>, "Casey Bodley" > > > <cbodley@redhat.com> > > > Cc: "Sage Weil" <sage@newdream.net>, ceph-devel@vger.kernel.org > > > Sent: Friday, September 25, 2015 1:55:29 PM > > > Subject: Backend ObjectStore engine performance bench with FIO > > > > > > Hi Xiaoxi, > > > > > > With changing the IO mode from aio to sync, we make fio against > newstore > > > works. Even with sync engine(I am still debugging the aio engine in > > > newstore with Xiaoxi) in newstore, Newstore still performing the best > > > among all of backstore engine with our initial setup(Thoroughly test > > > will > > > be run soon). Attachment is the initial data we collected for your > > > reference. Thanks for great help from Xiaoxi from regarding to > Newstore > > > development to support FIO. > > > > > > Hi Casey, > > > Let me know if you need any help to put fio-ceph-objectstore into > > > upstream. > > > After then , I can commit all of mine into upstream. > > > > My pull request at https://github.com/ceph/ceph/pull/5943 is still pending. > > If you have patches that you'd like included, I would be happy to pull > > them in; just point me to a branch. > > > > > > > > Thanks, > > > James > > > > > > > Thanks, > > Casey > > -- > > To unsubscribe from this list: send the line "unsubscribe ceph-devel" > > in the body of a message to majordomo@vger.kernel.org More > majordomo > > info at http://vger.kernel.org/majordomo-info.html > > > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the > body of a message to majordomo@vger.kernel.org More majordomo info at > http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Backend ObjectStore engine performance bench with FIO 2015-09-30 0:47 ` Chen, Xiaoxi @ 2015-09-30 13:57 ` Casey Bodley 2015-09-30 18:30 ` James (Fei) Liu-SSI 0 siblings, 1 reply; 6+ messages in thread From: Casey Bodley @ 2015-09-30 13:57 UTC (permalink / raw) To: Xiaoxi Chen; +Cc: James (Fei) Liu-SSI, ceph-devel Hi Xiaoxi, I pushed a new branch wip-fio-objectstore to ceph's github. I look forward to seeing James' work! Thanks, Casey ----- Original Message ----- > Hi Casey, > Would it better if we create an integration brunch on > ceph/ceph/wip-fio-objstore to allow more people try and improve it? > Seems James has some patches. > > -Xiaoxi > > > -----Original Message----- > > From: ceph-devel-owner@vger.kernel.org [mailto:ceph-devel- > > owner@vger.kernel.org] On Behalf Of Casey Bodley > > Sent: Wednesday, September 30, 2015 4:06 AM > > To: James (Fei) Liu-SSI > > Cc: ceph-devel@vger.kernel.org > > Subject: Re: Backend ObjectStore engine performance bench with FIO > > > > Hi James/Haomai/Xiaoxi, > > > > I spent some more time on the fio-objectstore branch, and pushed an > > update. > > > > In testing, I realized that it was using the io_unit's start time to name > > the > > objects, which meant that every write operation was creating a separate > > object. > > In addition to fixing this to use fio's filenames for object names, I also > > added > > support for the open_file() and close_file() functions. It now creates > > objects > > of the proper size on startup, so read-only jobs will work normally. > > It also removes its objects on exit. > > > > On startup, it no longer calls create_collection() if it already exists, so > > I was > > able to re-run fio jobs over and over again without having to clear the > > data > > directory (tested with FileStore and KeyValueStore). > > > > Casey > > > > ----- Original Message ----- > > > Great work James! > > > > > > ----- Original Message ----- > > > > From: "James (Fei) Liu-SSI" <james.liu@ssi.samsung.com> > > > > To: "Xiaoxi Chen" <xiaoxi.chen@intel.com>, "Casey Bodley" > > > > <cbodley@redhat.com> > > > > Cc: "Sage Weil" <sage@newdream.net>, ceph-devel@vger.kernel.org > > > > Sent: Friday, September 25, 2015 1:55:29 PM > > > > Subject: Backend ObjectStore engine performance bench with FIO > > > > > > > > Hi Xiaoxi, > > > > > > > > With changing the IO mode from aio to sync, we make fio against > > newstore > > > > works. Even with sync engine(I am still debugging the aio engine in > > > > newstore with Xiaoxi) in newstore, Newstore still performing the > > > > best > > > > among all of backstore engine with our initial setup(Thoroughly test > > > > will > > > > be run soon). Attachment is the initial data we collected for your > > > > reference. Thanks for great help from Xiaoxi from regarding to > > Newstore > > > > development to support FIO. > > > > > > > > Hi Casey, > > > > Let me know if you need any help to put fio-ceph-objectstore into > > > > upstream. > > > > After then , I can commit all of mine into upstream. > > > > > > My pull request at https://github.com/ceph/ceph/pull/5943 is still > > > pending. > > > If you have patches that you'd like included, I would be happy to pull > > > them in; just point me to a branch. > > > > > > > > > > > Thanks, > > > > James > > > > > > > > > > Thanks, > > > Casey > > > -- > > > To unsubscribe from this list: send the line "unsubscribe ceph-devel" > > > in the body of a message to majordomo@vger.kernel.org More > > majordomo > > > info at http://vger.kernel.org/majordomo-info.html > > > > > -- > > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > > the > > body of a message to majordomo@vger.kernel.org More majordomo info at > > http://vger.kernel.org/majordomo-info.html > N�����r��y���b�X��ǧv�^�){.n�+���z�]z���{ay�ʇڙ�,j��f���h���z��w������j:+v���w�j�m��������zZ+��ݢj"�� -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 6+ messages in thread
* RE: Backend ObjectStore engine performance bench with FIO 2015-09-30 13:57 ` Casey Bodley @ 2015-09-30 18:30 ` James (Fei) Liu-SSI 0 siblings, 0 replies; 6+ messages in thread From: James (Fei) Liu-SSI @ 2015-09-30 18:30 UTC (permalink / raw) To: Casey Bodley, Xiaoxi Chen; +Cc: ceph-devel@vger.kernel.org Hi Casey and Xiaoxi, The next challenge to us is to figure out why the performance is so bad with fio-ceph-objectstore. With our initial performance data, the newstore is ~ 9 times worse than raw block device access in terms of IOPS and raw data. As I mentioned , The sync engine is might be the bottleneck. Anything else in your mind will be the bottleneck? Regards, James -----Original Message----- From: Casey Bodley [mailto:cbodley@redhat.com] Sent: Wednesday, September 30, 2015 6:57 AM To: Xiaoxi Chen Cc: James (Fei) Liu-SSI; ceph-devel@vger.kernel.org Subject: Re: Backend ObjectStore engine performance bench with FIO Hi Xiaoxi, I pushed a new branch wip-fio-objectstore to ceph's github. I look forward to seeing James' work! Thanks, Casey ----- Original Message ----- > Hi Casey, > Would it better if we create an integration brunch on > ceph/ceph/wip-fio-objstore to allow more people try and improve it? > Seems James has some patches. > > -Xiaoxi > > > -----Original Message----- > > From: ceph-devel-owner@vger.kernel.org [mailto:ceph-devel- > > owner@vger.kernel.org] On Behalf Of Casey Bodley > > Sent: Wednesday, September 30, 2015 4:06 AM > > To: James (Fei) Liu-SSI > > Cc: ceph-devel@vger.kernel.org > > Subject: Re: Backend ObjectStore engine performance bench with FIO > > > > Hi James/Haomai/Xiaoxi, > > > > I spent some more time on the fio-objectstore branch, and pushed an > > update. > > > > In testing, I realized that it was using the io_unit's start time to > > name the objects, which meant that every write operation was > > creating a separate object. > > In addition to fixing this to use fio's filenames for object names, > > I also added support for the open_file() and close_file() functions. > > It now creates objects of the proper size on startup, so read-only > > jobs will work normally. > > It also removes its objects on exit. > > > > On startup, it no longer calls create_collection() if it already > > exists, so I was able to re-run fio jobs over and over again without > > having to clear the data directory (tested with FileStore and > > KeyValueStore). > > > > Casey > > > > ----- Original Message ----- > > > Great work James! > > > > > > ----- Original Message ----- > > > > From: "James (Fei) Liu-SSI" <james.liu@ssi.samsung.com> > > > > To: "Xiaoxi Chen" <xiaoxi.chen@intel.com>, "Casey Bodley" > > > > <cbodley@redhat.com> > > > > Cc: "Sage Weil" <sage@newdream.net>, ceph-devel@vger.kernel.org > > > > Sent: Friday, September 25, 2015 1:55:29 PM > > > > Subject: Backend ObjectStore engine performance bench with FIO > > > > > > > > Hi Xiaoxi, > > > > > > > > With changing the IO mode from aio to sync, we make fio > > > > against > > newstore > > > > works. Even with sync engine(I am still debugging the aio engine in > > > > newstore with Xiaoxi) in newstore, Newstore still performing the > > > > best > > > > among all of backstore engine with our initial setup(Thoroughly test > > > > will > > > > be run soon). Attachment is the initial data we collected for your > > > > reference. Thanks for great help from Xiaoxi from regarding > > > > to > > Newstore > > > > development to support FIO. > > > > > > > > Hi Casey, > > > > Let me know if you need any help to put fio-ceph-objectstore into > > > > upstream. > > > > After then , I can commit all of mine into upstream. > > > > > > My pull request at https://github.com/ceph/ceph/pull/5943 is still > > > pending. > > > If you have patches that you'd like included, I would be happy to > > > pull them in; just point me to a branch. > > > > > > > > > > > Thanks, > > > > James > > > > > > > > > > Thanks, > > > Casey > > > -- > > > To unsubscribe from this list: send the line "unsubscribe ceph-devel" > > > in the body of a message to majordomo@vger.kernel.org More > > majordomo > > > info at http://vger.kernel.org/majordomo-info.html > > > > > -- > > To unsubscribe from this list: send the line "unsubscribe > > ceph-devel" in the body of a message to majordomo@vger.kernel.org > > More majordomo info at http://vger.kernel.org/majordomo-info.html > N r y b X ǧv ^ ){.n + z ]z {ay ʇڙ ,j f h z w j > :+v w j m zZ+ ݢj" ^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2015-09-30 18:30 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
[not found] <99767EA2E27DD44DB4E9F9B9ACA458C03BD7EFC9@SSIEXCH-MB3.ssi.samsung.com>
2015-09-25 18:22 ` Backend ObjectStore engine performance bench with FIO Casey Bodley
2015-09-29 20:06 ` Casey Bodley
2015-09-29 21:12 ` James (Fei) Liu-SSI
2015-09-30 0:47 ` Chen, Xiaoxi
2015-09-30 13:57 ` Casey Bodley
2015-09-30 18:30 ` James (Fei) Liu-SSI
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.