keyvaluestore speed up?

keyvaluestore speed up?

[Xinze Chi]

hi, all:

    Currently at keyvaluestore, osd send sync
request(submit_transaction_sync) to filestore when it finishes a
transaction. But sata disk is not suitable for doing sync request. ssd
disk is more suitable.

    So I think whether we could separate leveldb *.log file with *.sst
file and move *.log to ssd
disk, which is similar with journal file in ceph.

    But now, the original leveldb do not support to separate log file
and sst file.

    Wait for your comment.

    Thanks.

Re: keyvaluestore speed up?

[Haomai Wang]

On Thu, Mar 19, 2015 at 5:22 PM, Xinze Chi <xmdxcxz@gmail.com> wrote:
> hi, all:
>
>     Currently at keyvaluestore, osd send sync
> request(submit_transaction_sync) to filestore when it finishes a
> transaction. But sata disk is not suitable for doing sync request. ssd
> disk is more suitable.

I think here you mean disk not filestore.

>
>     So I think whether we could separate leveldb *.log file with *.sst
> file and move *.log to ssd
> disk, which is similar with journal file in ceph.
>
>     But now, the original leveldb do not support to separate log file
> and sst file.
>
>     Wait for your comment.
>
>     Thanks.



-- 
Best Regards,

Wheat

RE: keyvaluestore speed up?

[Shu, Xinxin]

I think rocksdb can support this configuration.

Cheers,
xinxin

-----Original Message-----
From: ceph-devel-owner@vger.kernel.org [mailto:ceph-devel-owner@vger.kernel.org] On Behalf Of Xinze Chi
Sent: Thursday, March 19, 2015 5:23 PM
To: Sage Weil; sjust@redhat.com; Haomai Wang; ceph-devel@vger.kernel.org
Subject: keyvaluestore speed up?

hi, all:

    Currently at keyvaluestore, osd send sync
request(submit_transaction_sync) to filestore when it finishes a transaction. But sata disk is not suitable for doing sync request. ssd disk is more suitable.

    So I think whether we could separate leveldb *.log file with *.sst file and move *.log to ssd disk, which is similar with journal file in ceph.

    But now, the original leveldb do not support to separate log file and sst file.

    Wait for your comment.

    Thanks.
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: keyvaluestore speed up?

[Ning Yao]

2015-03-20 10:22 GMT+08:00 Shu, Xinxin <xinxin.shu@intel.com>:
> I think rocksdb can support this configuration.
>
I do not find this option in rocksdb. If you know, can you provide
this option to redirect the WAL file?

Regards
Ning Yao


> Cheers,
> xinxin
>
> -----Original Message-----
> From: ceph-devel-owner@vger.kernel.org [mailto:ceph-devel-owner@vger.kernel.org] On Behalf Of Xinze Chi
> Sent: Thursday, March 19, 2015 5:23 PM
> To: Sage Weil; sjust@redhat.com; Haomai Wang; ceph-devel@vger.kernel.org
> Subject: keyvaluestore speed up?
>
> hi, all:
>
>     Currently at keyvaluestore, osd send sync
> request(submit_transaction_sync) to filestore when it finishes a transaction. But sata disk is not suitable for doing sync request. ssd disk is more suitable.
>
>     So I think whether we could separate leveldb *.log file with *.sst file and move *.log to ssd disk, which is similar with journal file in ceph.
>
>     But now, the original leveldb do not support to separate log file and sst file.
>
>     Wait for your comment.
>
>     Thanks.
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: keyvaluestore speed up?

[Mark Kirkwood]

On 24/03/15 19:53, Ning Yao wrote:
> 2015-03-20 10:22 GMT+08:00 Shu, Xinxin <xinxin.shu@intel.com>:
>> I think rocksdb can support this configuration.
>>
> I do not find this option in rocksdb. If you know, can you provide
> this option to redirect the WAL file?
>
>

I think you want to set:

rocksdb wal dir = path_to_fast_wal


I was playing with this a while back - pointing it to an SSD 
dramatically boosts IOPS!

Cheers

Mark