From mboxrd@z Thu Jan 1 00:00:00 1970 Content-Type: multipart/mixed; boundary="===============6390972022689799909==" MIME-Version: 1.0 From: Anand Subramanian Subject: Re: [SPDK] Testing out the compress/reduce flow Date: Tue, 13 Nov 2018 00:11:21 +0000 Message-ID: In-Reply-To: 4C1DA182-3CA0-4594-9411-3DF020398324@intel.com List-ID: To: spdk@lists.01.org --===============6390972022689799909== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Hi Jim, Paul, Thanks for letting me know. Sounds good. I think initially it would really = help to have the pmem interface calls abstracted in the sense that we shoul= d ideally be able to run the UTs without a pm device. And for the most part= , it would help to be able to test it out with a ramdisk or something (with= out a real pm device). = It would really help if you could put out some steps for a UT setup similar= to what you folks use, at least for starters before we try other configura= tions. Look fwd to the reviews. Cheers, Anand -----Original Message----- From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Harris, James R Sent: Monday, November 12, 2018 3:41 PM To: Storage Performance Development Kit Subject: Re: [SPDK] Testing out the compress/reduce flow Hi Anand, I think the main thing right now is just reviewing patches as they are post= ed. I have a series of patches I've been working on locally that I've been= trying to get out for review a few patches at a time. But after Paul and = I discussed some of the interfaces last week, we're going to change how the= pmem file is opened. libreduce is going to do that now rather than the us= er of the library. I'm reworking those interfaces now and will have 5 hour= s on planes tomorrow to wrap up those patches and get them out to GerritHub= for review. -Jim =EF=BB=BFOn 11/12/18, 4:07 PM, "SPDK on behalf of Luse, Paul E" wrote: Hi Anand, = Thanks for asking! Yes, there's always ways to help :) As you know Jim= is doing the SPDK reduce library so I'll let him comment on what might mak= e sense there. I'm doing the vbdev module and I'm probably just a few days= away from being able to use some help with unit test. Right now I'm in the= middle of getting the path app<-->vbdev<-->dpdk compressdev<-->bdev> coded= and there will likely be a little throw away work there because once it in= terfaces with the reduce lib a lot of things will change however we want to= make sure, since both compressdev API and reduclibe API are new, that we c= an test them individually through the vbdev first. With Jim's library we'l= l even be able to test the complete path without doing any real compression= , etc. = = Stay tuned and don't ever hesitate to hit us up on the mailing list. I= 'll send a note out later this week and let you know the best time to start= - initially it will be a patch based on the vbdev compress patch that sta= rt by adding the basic framework for UT and can cover the non-compression c= entric functions. Won't be long! = Thanks Paul = -----Original Message----- From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Anand Subr= amanian Sent: Monday, November 12, 2018 2:42 PM To: spdk(a)lists.01.org Subject: [SPDK] Testing out the compress/reduce flow = Hi Jim, Paul, = Is there any way to help test out the basic flows for the md or the dat= a for the compress/reduce work so far? = Is there an easy way to setup a testbed for this without pm (some steps= to maybe repro the compress lvol or to setup what you folks have would hel= p)? Maybe that will help w.r.t. some initial testing and/or fixing of some = of the initial low-hanging issues? = Thanks, Anand _______________________________________________ SPDK mailing list SPDK(a)lists.01.org https://urldefense.proofpoint.com/v2/url?u=3Dhttps-3A__lists.01.org_mai= lman_listinfo_spdk&d=3DDwIGaQ&c=3DJfeWlBa6VbDyTXraMENjy_b_0yKWuqQ4qY-FPhxK4= x8w-TfgRBDyeV4hVQQBEgL2&r=3DWDvM24o7tXcmRRL6eRTRZUTaIuukZ9NPcFO9eKhUBVs&m= =3Dd1rIGsz4g34kRr5kmRLZlJH1D9x9Kie2K6dEnORFiOw&s=3DmGa0QuxmhKd0govK6zdAej4A= HhKaw94vg_xiLYQTOYM&e=3D _______________________________________________ SPDK mailing list SPDK(a)lists.01.org https://urldefense.proofpoint.com/v2/url?u=3Dhttps-3A__lists.01.org_mai= lman_listinfo_spdk&d=3DDwIGaQ&c=3DJfeWlBa6VbDyTXraMENjy_b_0yKWuqQ4qY-FPhxK4= x8w-TfgRBDyeV4hVQQBEgL2&r=3DWDvM24o7tXcmRRL6eRTRZUTaIuukZ9NPcFO9eKhUBVs&m= =3Dd1rIGsz4g34kRr5kmRLZlJH1D9x9Kie2K6dEnORFiOw&s=3DmGa0QuxmhKd0govK6zdAej4A= HhKaw94vg_xiLYQTOYM&e=3D = _______________________________________________ SPDK mailing list SPDK(a)lists.01.org https://urldefense.proofpoint.com/v2/url?u=3Dhttps-3A__lists.01.org_mailman= _listinfo_spdk&d=3DDwIGaQ&c=3DJfeWlBa6VbDyTXraMENjy_b_0yKWuqQ4qY-FPhxK4x8w-= TfgRBDyeV4hVQQBEgL2&r=3DWDvM24o7tXcmRRL6eRTRZUTaIuukZ9NPcFO9eKhUBVs&m=3Dd1r= IGsz4g34kRr5kmRLZlJH1D9x9Kie2K6dEnORFiOw&s=3DmGa0QuxmhKd0govK6zdAej4AHhKaw9= 4vg_xiLYQTOYM&e=3D --===============6390972022689799909==--