From mboxrd@z Thu Jan 1 00:00:00 1970 Content-Type: multipart/mixed; boundary="===============7961564328202523976==" MIME-Version: 1.0 From: helloway Subject: Re: [SPDK] Topic from last week's community meeting Date: Sat, 28 Sep 2019 02:06:01 +0000 Message-ID: <603a4b99.609e.162e0d7c18c.Coremail.simple_hlw@163.com> In-Reply-To: KAWPR01MB128203C00B694E0F72EC184BA2B60@KAWPR01MB1282.jpnprd01.prod.outlook.com List-ID: To: spdk@lists.01.org --===============7961564328202523976== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Hi Shuhei, What do you mean the "log structured data store"? Does it mean K/V data wil= l be directly converted into blobs which are stored in blobstore? I am very interested in what you mentioned, I wonder whether it is related = to the blobkv I have proposed? [0][1] Can you share more information with m= e? If you have some spare time, please visit them. I really hope to hear mo= re about it from you. [0]https://trello.com/c/pUk7psc3/62-blobkv-blobstore-object-design [1]https://trello.com/c/K6Bj3KeO/63-blobkv-design-interface-to-add Thx, Helloway On 04/18/2018 09:36=EF=BC=8C=E6=9D=BE=E6=9C=AC=E5=91=A8=E5=B9=B3 / MATSUMOT= O=EF=BC=8CSHUUHEI wrote=EF=BC=9A Hi Paul, Thanks for you reply. In the meeting, I got good understanding about blobstore and related modul= es and applications, and I shared that a few ideas were mainly about customized bdev modules. My point is to develop a sample implementation suitable for SPDK of more fl= ash friendly (sequential write) block store with some additional features, = e.g., compression. Utilizing both front-end and back-end of SPDK and implementing customized b= dev layer will require deep understanding of SPDK to us. Any sample implementation may be helpful not only for us but also for commu= nity. Activity from now on will be very experimental and not organizational yet. = Hence pace may be very slow. The first activity may be a patch with in a couple of months about indexed = allocation, direct blocks, single indirect, double indirect, ... I hope these make sense to you and we will be able to have more discussion = in near future. Thanks, SHuhei =E5=B7=AE=E5=87=BA=E4=BA=BA: SPDK =E3=81=8C L= use, Paul E =E3=81=AE=E4=BB=A3=E7=90=86=E3=81=A7= =E9=80=81=E4=BF=A1 =E9=80=81=E4=BF=A1=E6=97=A5=E6=99=82: 2018=E5=B9=B44=E6=9C=8817=E6=97=A5 23= :31:10 =E5=AE=9B=E5=85=88: Storage Performance Development Kit =E4=BB=B6=E5=90=8D: [!][SPDK] Topic from last week's community meeting = Hi Shuhei, = I was out of town last week and missed the meeting but saw on Trello you ha= d the topic below: = =E2=80=9Ca few idea: log structured data store , data store with compressio= n, and metadata replication of Blobstore=E2=80=9D = Which I=E2=80=99d be pretty interested in working on with you or at least h= earing more about it. When you get a chance, no hurry, can you please expa= nd a little on how the conversation went and what you=E2=80=99re looking at= specifically? = Thanks! Paul = =20 --===============7961564328202523976== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGh0bWw+CjxoZWFkPgogICAgPG1ldGEgaHR0cC1lcXVpdj0iQ29udGVudC1UeXBlIiBjb250ZW50 PSJ0ZXh0L2h0bWw7IGNoYXJzZXQ9VVRGLTgiPgo8L2hlYWQ+Cjxib2R5Pgo8c3R5bGU+CiAgICBm b250ewogICAgICAgIGxpbmUtaGVpZ2h0OiAxLjY7CiAgICB9CiAgICB1bCxvbHsKICAgICAgICBw YWRkaW5nLWxlZnQ6IDIwcHg7CiAgICAgICAgbGlzdC1zdHlsZS1wb3NpdGlvbjogaW5zaWRlOwog ICAgfQo8L3N0eWxlPgo8ZGl2IHN0eWxlPSJmb250LWZhbWlseTomcXVvdDtIZWx2ZXRpY2EmcXVv dDs7IGxpbmUtaGVpZ2h0OjEuNjsiPgogICAgPGRpdj4KPGRpdj5IaSBTaHVoZWksPC9kaXY+PGRp dj48YnI+PC9kaXY+PGRpdj5XaGF0IGRvIHlvdSBtZWFuIHRoZSAibG9nIHN0cnVjdHVyZWQgZGF0 YSBzdG9yZSI/IERvZXMgaXQgbWVhbiBLL1YgZGF0YSB3aWxsIGJlIGRpcmVjdGx5IGNvbnZlcnRl ZCBpbnRvIGJsb2JzIHdoaWNoIGFyZSBzdG9yZWQgaW4gYmxvYnN0b3JlPzwvZGl2PjxkaXY+PGJy PjwvZGl2PjxkaXY+SSBhbSB2ZXJ5IGludGVyZXN0ZWQgaW4gd2hhdCB5b3UgbWVudGlvbmVkLCBJ IHdvbmRlciB3aGV0aGVyIGl0IGlzIHJlbGF0ZWQgdG8gdGhlIGJsb2JrdiBJIGhhdmUgcHJvcG9z ZWQ/IFswXVsxXSBDYW4geW91IHNoYXJlIG1vcmUgaW5mb3JtYXRpb24gd2l0aCBtZT8gSWYgeW91 IGhhdmUgc29tZSBzcGFyZSB0aW1lLCBwbGVhc2UgdmlzaXQgdGhlbS4gSSByZWFsbHkgaG9wZSB0 byBoZWFyIG1vcmUgYWJvdXQgaXQgZnJvbSB5b3UuPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5b MF08YSBocmVmPSJodHRwczovL3RyZWxsby5jb20vYy9wVWs3cHNjMy82Mi1ibG9ia3YtYmxvYnN0 b3JlLW9iamVjdC1kZXNpZ24iPmh0dHBzOi8vdHJlbGxvLmNvbS9jL3BVazdwc2MzLzYyLWJsb2Jr di1ibG9ic3RvcmUtb2JqZWN0LWRlc2lnbjwvYT48L2Rpdj48ZGl2PlsxXTxhIGhyZWY9Imh0dHBz Oi8vdHJlbGxvLmNvbS9jL0s2QmozS2VPLzYzLWJsb2Jrdi1kZXNpZ24taW50ZXJmYWNlLXRvLWFk ZCI+aHR0cHM6Ly90cmVsbG8uY29tL2MvSzZCajNLZU8vNjMtYmxvYmt2LWRlc2lnbi1pbnRlcmZh Y2UtdG8tYWRkPC9hPjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+VGh4LDwvZGl2PjxkaXY+SGVs bG93YXk8L2Rpdj48ZGl2IGlkPSJudGVzLXBjbWFpbC1zaWduYXR1cmUiIHN0eWxlPSJmb250LWZh bWlseTonJyI+PGZvbnQgc3R5bGU9InBhZGRpbmc6IDA7IG1hcmdpbjowOyI+ICAgICAgICAgICAg ICAgIDwvZm9udD4KCjwvZGl2Pjxicj4KPC9kaXY+PGRpdiBjbGFzcz0iSi1yZXBseSIgc3R5bGU9 ImJhY2tncm91bmQtY29sb3I6I2YyZjJmMjtjb2xvcjpibGFjaztwYWRkaW5nLXRvcDo2cHg7cGFk ZGluZy1ib3R0b206NnB4O2JvcmRlci1yYWRpdXM6M3B4Oy1tb3otYm9yZGVyLXJhZGl1czozcHg7 LXdlYmtpdC1ib3JkZXItcmFkaXVzOjNweDttYXJnaW4tdG9wOjQ1cHg7bWFyZ2luLWJvdHRvbToy MHB4O2ZvbnQtZmFtaWx5OicnOyI+CiAgICA8ZGl2IHN0eWxlPSJmb250LXNpemU6MTJweDtsaW5l LWhlaWdodDoxLjY7d29yZC1icmVhazpicmVhay1hbGw7bWFyZ2luLWxlZnQ6MTBweDttYXJnaW4t cmlnaHQ6MTBweCI+T24gPHNwYW4gY2xhc3M9Im1haWwtZGF0ZSI+MDQvMTgvMjAxOCAwOTozNjwv c3Bhbj7vvIw8YSBjbGFzcz0ibWFpbC10byIgc3R5bGU9InRleHQtZGVjb3JhdGlvbjpub25lO2Nv bG9yOiMyYTgzZjI7IiBocmVmPSJtYWlsdG86c2h1aGVpLm1hdHN1bW90by54dEBoaXRhY2hpLmNv bSI+5p2+5pys5ZGo5bmzIC8gTUFUU1VNT1RP77yMU0hVVUhFSSZsdDtzaHVoZWkubWF0c3Vtb3Rv Lnh0QGhpdGFjaGkuY29tJmd0OzwvYT4gd3JvdGXvvJogPC9kaXY+CjwvZGl2Pgo8YmxvY2txdW90 ZSBpZD0ibnRlcy1wY21haWwtcXVvdGUiIHN0eWxlPSJtYXJnaW46IDA7IHBhZGRpbmc6IDA7IGZv bnQtc2l6ZTogMTRweDsgZm9udC1mYW1pbHk6ICcnOyI+CjxzdHlsZSB0eXBlPSJ0ZXh0L2NzcyI+ PCEtLSBQIHttYXJnaW4tdG9wOjA7bWFyZ2luLWJvdHRvbTowO30gLS0+Cjwvc3R5bGU+CjxkaXYg aWQ9ImRpdnRhZ2RlZmF1bHR3cmFwcGVyIiBzdHlsZT0iZm9udC1zaXplOjEycHQ7Y29sb3I6IzAw MDAwMDtmb250LWZhbWlseTpDYWxpYnJpLEhlbHZldGljYSxzYW5zLXNlcmlmOyIgZGlyPSJsdHIi Pgo8cCBzdHlsZT0ibWFyZ2luLXRvcDowO21hcmdpbi1ib3R0b206MCI+SGkgUGF1bCw8L3A+Cjxw IHN0eWxlPSJtYXJnaW4tdG9wOjA7bWFyZ2luLWJvdHRvbTowIj48YnI+CjwvcD4KPHAgc3R5bGU9 Im1hcmdpbi10b3A6MDttYXJnaW4tYm90dG9tOjAiPlRoYW5rcyBmb3IgeW91IHJlcGx5LjwvcD4K PHAgc3R5bGU9Im1hcmdpbi10b3A6MDttYXJnaW4tYm90dG9tOjAiPjxicj4KPC9wPgo8cCBzdHls ZT0ibWFyZ2luLXRvcDowO21hcmdpbi1ib3R0b206MCI+SW4gdGhlIG1lZXRpbmcsJm5ic3A7IEkg Z290IGdvb2QgdW5kZXJzdGFuZGluZyBhYm91dCBibG9ic3RvcmUgYW5kIHJlbGF0ZWQgbW9kdWxl cyBhbmQgYXBwbGljYXRpb25zLDwvcD4KPHAgc3R5bGU9Im1hcmdpbi10b3A6MDttYXJnaW4tYm90 dG9tOjAiPmFuZCBJIHNoYXJlZCB0aGF0IGEgZmV3IGlkZWFzIHdlcmUgbWFpbmx5IGFib3V0IGN1 c3RvbWl6ZWQgYmRldiBtb2R1bGVzLjwvcD4KPHAgc3R5bGU9Im1hcmdpbi10b3A6MDttYXJnaW4t Ym90dG9tOjAiPjxicj4KPC9wPgo8cCBzdHlsZT0ibWFyZ2luLXRvcDowO21hcmdpbi1ib3R0b206 MCI+TXkgcG9pbnQgaXMgdG8gZGV2ZWxvcCBhIHNhbXBsZSBpbXBsZW1lbnRhdGlvbiBzdWl0YWJs ZSBmb3IgU1BESyBvZiBtb3JlIGZsYXNoIGZyaWVuZGx5IChzZXF1ZW50aWFsIHdyaXRlKSBibG9j ayBzdG9yZSB3aXRoIHNvbWUgYWRkaXRpb25hbCBmZWF0dXJlcywgZS5nLiwgY29tcHJlc3Npb24u PC9wPgo8cCBzdHlsZT0ibWFyZ2luLXRvcDowO21hcmdpbi1ib3R0b206MCI+PGJyPgo8L3A+Cjxw IHN0eWxlPSJtYXJnaW4tdG9wOjA7bWFyZ2luLWJvdHRvbTowIj5VdGlsaXppbmcgYm90aCBmcm9u dC1lbmQgYW5kIGJhY2stZW5kIG9mIFNQREsgYW5kIGltcGxlbWVudGluZyBjdXN0b21pemVkIGJk ZXYgbGF5ZXIgd2lsbDwvcD4KPHAgc3R5bGU9Im1hcmdpbi10b3A6MDttYXJnaW4tYm90dG9tOjAi PjwvcD4KPHAgc3R5bGU9Im1hcmdpbi10b3A6MDttYXJnaW4tYm90dG9tOjAiPnJlcXVpcmUgZGVl cCB1bmRlcnN0YW5kaW5nIG9mIFNQREsgdG8gdXMuPC9wPgo8cD48L3A+CjxwIHN0eWxlPSJtYXJn aW4tdG9wOjA7bWFyZ2luLWJvdHRvbTowIj5Bbnkgc2FtcGxlIGltcGxlbWVudGF0aW9uIG1heSBi ZSBoZWxwZnVsIG5vdCBvbmx5IGZvciB1cyBidXQgYWxzbyBmb3IgY29tbXVuaXR5LjwvcD4KPHAg c3R5bGU9Im1hcmdpbi10b3A6MDttYXJnaW4tYm90dG9tOjAiPjxicj4KPC9wPgo8cCBzdHlsZT0i bWFyZ2luLXRvcDowO21hcmdpbi1ib3R0b206MCI+QWN0aXZpdHkgZnJvbSBub3cgb24gd2lsbCBi ZSB2ZXJ5IGV4cGVyaW1lbnRhbCBhbmQKPHNwYW4+bm90IG9yZ2FuaXphdGlvbmFsIHlldDwvc3Bh bj4uIEhlbmNlIHBhY2UgbWF5IGJlIHZlcnkgc2xvdy48L3A+CjxwIHN0eWxlPSJtYXJnaW4tdG9w OjA7bWFyZ2luLWJvdHRvbTowIj48L3A+CjxwIHN0eWxlPSJtYXJnaW4tdG9wOjA7bWFyZ2luLWJv dHRvbTowIj48YnI+CjwvcD4KPHA+PC9wPgo8cCBzdHlsZT0ibWFyZ2luLXRvcDowO21hcmdpbi1i b3R0b206MCI+VGhlIGZpcnN0IGFjdGl2aXR5IG1heSBiZSBhIHBhdGNoIHdpdGggaW4gYSBjb3Vw bGUgb2YgbW9udGhzIGFib3V0IGluZGV4ZWQgYWxsb2NhdGlvbiwgZGlyZWN0IGJsb2Nrcywgc2lu Z2xlIGluZGlyZWN0LCBkb3VibGUgaW5kaXJlY3QsIC4uLjwvcD4KPGRpdj48YnI+CjwvZGl2Pgo8 ZGl2PkkgaG9wZSB0aGVzZSBtYWtlIHNlbnNlIHRvIHlvdSBhbmQgd2Ugd2lsbCBiZSBhYmxlIHRv IGhhdmUgbW9yZSBkaXNjdXNzaW9uIGluIG5lYXIgZnV0dXJlLjwvZGl2Pgo8ZGl2Pjxicj4KPC9k aXY+CjxkaXY+VGhhbmtzLDwvZGl2Pgo8ZGl2PlNIdWhlaTwvZGl2Pgo8cCBzdHlsZT0ibWFyZ2lu LXRvcDowO21hcmdpbi1ib3R0b206MCI+PGJyPgo8L3A+CjwvZGl2Pgo8aHIgc3R5bGU9ImRpc3Bs YXk6aW5saW5lLWJsb2NrO3dpZHRoOjk4JSIgdGFiaW5kZXg9Ii0xIj4KPGRpdiBpZD0iZGl2UnBs eUZ3ZE1zZyIgZGlyPSJsdHIiPjxmb250IGZhY2U9IkNhbGlicmksIHNhbnMtc2VyaWYiIHN0eWxl PSJmb250LXNpemU6MTFwdCIgY29sb3I9IiMwMDAwMDAiPjxiPuW3ruWHuuS6ujo8L2I+IFNQREsg Jmx0OzxhIGhyZWY9Im1haWx0bzpzcGRrLWJvdW5jZXNAbGlzdHMuMDEub3JnIj5zcGRrLWJvdW5j ZXNAbGlzdHMuMDEub3JnPC9hPiZndDsg44GMIEx1c2UsIFBhdWwgRSAmbHQ7PGEgaHJlZj0ibWFp bHRvOnBhdWwuZS5sdXNlQGludGVsLmNvbSI+cGF1bC5lLmx1c2VAaW50ZWwuY29tPC9hPiZndDsg 44Gu5Luj55CG44Gn6YCB5L+hPGJyPgo8Yj7pgIHkv6Hml6XmmYI6PC9iPiAyMDE45bm0NOaciDE3 5pelIDIzOjMxOjEwPGJyPgo8Yj7lrpvlhYg6PC9iPiBTdG9yYWdlIFBlcmZvcm1hbmNlIERldmVs b3BtZW50IEtpdDxicj4KPGI+5Lu25ZCNOjwvYj4gWyFdW1NQREtdIFRvcGljIGZyb20gbGFzdCB3 ZWVrJ3MgY29tbXVuaXR5IG1lZXRpbmc8L2ZvbnQ+CjxkaXY+Jm5ic3A7PC9kaXY+CjwvZGl2Pgo8 c3R5bGU+CjwhLS0KX2ZvbnQtZmFjZQoJe2ZvbnQtZmFtaWx5OiJDYW1icmlhIE1hdGgifQpfZm9u dC1mYWNlCgl7Zm9udC1mYW1pbHk6Q2FsaWJyaX0KcC54X01zb05vcm1hbCwgbGkueF9Nc29Ob3Jt YWwsIGRpdi54X01zb05vcm1hbAoJe21hcmdpbjowaW47CgltYXJnaW4tYm90dG9tOi4wMDAxcHQ7 Cglmb250LXNpemU6MTEuMHB0OwoJZm9udC1mYW1pbHk6IkNhbGlicmkiLHNhbnMtc2VyaWZ9CmE6 eF9saW5rLCBzcGFuLnhfTXNvSHlwZXJsaW5rCgl7Y29sb3I6IzA1NjNDMTsKCXRleHQtZGVjb3Jh dGlvbjp1bmRlcmxpbmV9CmE6eF92aXNpdGVkLCBzcGFuLnhfTXNvSHlwZXJsaW5rRm9sbG93ZWQK CXtjb2xvcjojOTU0RjcyOwoJdGV4dC1kZWNvcmF0aW9uOnVuZGVybGluZX0Kc3Bhbi54X0VtYWls U3R5bGUxNwoJe2ZvbnQtZmFtaWx5OiJDYWxpYnJpIixzYW5zLXNlcmlmOwoJY29sb3I6d2luZG93 dGV4dH0KLnhfTXNvQ2hwRGVmYXVsdAoJe2ZvbnQtZmFtaWx5OiJDYWxpYnJpIixzYW5zLXNlcmlm fQpfcGFnZSBXb3JkU2VjdGlvbjEKCXttYXJnaW46MS4waW4gMS4waW4gMS4waW4gMS4waW59CmRp di54X1dvcmRTZWN0aW9uMQoJe30KLS0+CgotLT48L3N0eWxlPgo8ZGl2IGxhbmc9IkVOLVVTIiBs aW5rPSIjMDU2M0MxIiB2bGluaz0iIzk1NEY3MiI+CjxkaXYgY2xhc3M9InhfV29yZFNlY3Rpb24x Ij4KPHAgY2xhc3M9InhfTXNvTm9ybWFsIj5IaSBTaHVoZWksPC9wPgo8cCBjbGFzcz0ieF9Nc29O b3JtYWwiPiZuYnNwOzwvcD4KPHAgY2xhc3M9InhfTXNvTm9ybWFsIj5JIHdhcyBvdXQgb2YgdG93 biBsYXN0IHdlZWsgYW5kIG1pc3NlZCB0aGUgbWVldGluZyBidXQgc2F3IG9uIFRyZWxsbyB5b3Ug aGFkIHRoZSB0b3BpYyBiZWxvdzo8L3A+CjxwIGNsYXNzPSJ4X01zb05vcm1hbCI+Jm5ic3A7PC9w Pgo8cCBjbGFzcz0ieF9Nc29Ob3JtYWwiPjxiPuKAnGEgZmV3IGlkZWE6IGxvZyBzdHJ1Y3R1cmVk IGRhdGEgc3RvcmUgLCBkYXRhIHN0b3JlIHdpdGggY29tcHJlc3Npb24sIGFuZCBtZXRhZGF0YSBy ZXBsaWNhdGlvbiBvZiBCbG9ic3RvcmXigJ08L2I+PC9wPgo8cCBjbGFzcz0ieF9Nc29Ob3JtYWwi PiZuYnNwOzwvcD4KPHAgY2xhc3M9InhfTXNvTm9ybWFsIj5XaGljaCBJ4oCZZCBiZSBwcmV0dHkg aW50ZXJlc3RlZCBpbiB3b3JraW5nIG9uIHdpdGggeW91IG9yIGF0IGxlYXN0IGhlYXJpbmcgbW9y ZSBhYm91dCBpdC4mbmJzcDsgV2hlbiB5b3UgZ2V0IGEgY2hhbmNlLCBubyBodXJyeSwgY2FuIHlv dSBwbGVhc2UgZXhwYW5kIGEgbGl0dGxlIG9uIGhvdyB0aGUgY29udmVyc2F0aW9uIHdlbnQgYW5k IHdoYXQgeW914oCZcmUgbG9va2luZyBhdCBzcGVjaWZpY2FsbHk/PC9wPgo8cCBjbGFzcz0ieF9N c29Ob3JtYWwiPiZuYnNwOzwvcD4KPHAgY2xhc3M9InhfTXNvTm9ybWFsIj5UaGFua3MhPC9wPgo8 cCBjbGFzcz0ieF9Nc29Ob3JtYWwiPlBhdWw8L3A+CjxwIGNsYXNzPSJ4X01zb05vcm1hbCI+Jm5i c3A7PC9wPgo8cCBjbGFzcz0ieF9Nc29Ob3JtYWwiPiZuYnNwOzwvcD4KPC9kaXY+CjwvZGl2Pjwv YmxvY2txdW90ZT48c3R5bGUgdHlwZT0idGV4dC9jc3MiPgogICAgICAgIGEjbnRlcy1wY21haWwt c2lnbmF0dXJlLWRlZmF1bHQ6aG92ZXIgewogICAgICAgICAgICB0ZXh0LWRlY29yYXRpb246IHVu ZGVybGluZTsKICAgICAgICAgICAgY29sb3I6ICMzNTkzZGI7CiAgICAgICAgICAgIGN1cnNvcjog cG9pbnRlcjsKICAgICAgICB9CiAgICA8L3N0eWxlPjwhLS3vv70tLT4KPC9kaXY+CjwvYm9keT4K PC9odG1sPg== --===============7961564328202523976==--