Re: NFSoRDMA developers bi-weekly meeting minutes (5/28)

Re: NFSoRDMA developers bi-weekly meeting minutes (5/28)

[Chuck Lever]

On May 29, 2014, at 12:33 PM, Shirley Ma <shirley.ma@oracle.com> wrote:

> 2. NFSoRDMA support with soft RoCE and Soft iWARP
> 
> There were some discussions regarding whether removing RPCRDMA_REGISTER support (one of Chuck's patchset) would impact any other components in the stack. So far soft RoCE hasn't been upstreamed yet.There was a broad consensus not to support out-of-tree providers unless an issue also affects in-tree providers. NFSoRDMA will follow kernel development policy, all work should be based upon upstream kernel. However Chuck Level will check Soft RoCE plan, Steve Wise will check soft iWARP plan to make sure nothing will be broken in both kernel and OFED release.

I’ve confirmed OFED 3.12 does not have the soft RoCE provider, and it is also not in mainline. It’s sort of in the same limbo that the NFS/RDMA server-side code is.

I will pursue our technical questions with System Fabrics (authors of rxe).

--
Chuck Lever
chuck[dot]lever[at]oracle[dot]com

NFSoRDMA developers bi-weekly meeting minutes (5/28)

[Shirley Ma]

Attendees:

Jeff Beck (NASA)
Yan Burman (Mellanox)
Wendy Cheng (Intel)
Susan Coulter (LANL)
Rupert Dance (Soft Forge)
Chuck Lever (Oracle)
Doug Ledford (RedHat)
Shirley Ma (Oracle)
Devesh Sharma (Emulex)
Anna Schumaker (Net App)
Steve Wise (OpenGridComputing, Chelsio)

Moderator:
Shirley Ma (Oracle)

NFSoRDMA developers bi-weekly meeting is to help organizing NFSoRDMA development and test effort from different resources to speed up NFSoRDMA upstream kernel work and NFSoRDMA diagnosing/debugging tools development. Hopefully the quality of NFSoRDMA upstream patches can be improved by being tested by a quorum of HW vendors.

Today's meeting notes:
1. OFED release update from Rupert Dance through email:

a. OFED 3.12 was released yesterday without any patch from Chuck's git tree, one of the reason these patches haven't upstream yet. There were a number of new bugs filed on NFSRDMA (2489 and 2490).
http://bugs.openfabrics.org/bugzilla/show_bug.cgi?id=2489
http://bugs.openfabrics.org/bugzilla/show_bug.cgi?id=2490

b. Jeff Becker has pulled all of the patches from Chuck's git tree and made backports in his local branch of OFED 3.12. He has begun testing and is seeing good results so far.

c. OFED next release will be OFED 3.12-1 and it will be including all these updates along with support for RHEL 7.0 and Intel's OFED MIC.

2. NFSoRDMA support with soft RoCE and Soft iWARP

There were some discussions regarding whether removing RPCRDMA_REGISTER support (one of Chuck's patchset) would impact any other components in the stack. So far soft RoCE hasn't been upstreamed yet.There was a broad consensus not to support out-of-tree providers unless an issue also affects in-tree providers. NFSoRDMA will follow kernel development policy, all work should be based upon upstream kernel. However Chuck Level will check Soft RoCE plan, Steve Wise will check soft iWARP plan to make sure nothing will be broken in both kernel and OFED release. 

3. Update on testing NFSoRDMA client patches:

Devesh Sharma, Doug Ledford, Chuck Lever, Steve Wise all have tested Chuck git tree (up to last weeks patchsets) on different platforms with various vendor's HCAs. The test showed the stack pretty reliable for both NFSv3 and NFSv4. However NFSv4.1 hit server crash. (NFSv4.1 hasn't support yet).

Steve Wise's test covers iWARP Chelsio
Devesh Sharma's test covers Emulex
Chuck Lever/Shirley Ma's test covers Mellanox
Doug Ledford's test covers various platforms and combination of HCAs (Interoperability test).
Jeff Beck's test covers OFED release (backport)
Rupert Dance's (IOL) team test covers various platforms and combination of HCAs as well.

The test coverage should be good enough for NFSoRDMA client patchsets to be merged to upstream by Anna and Trond.

Devesh is looking for performance benchmark tools. IOzone is recommended. Anna is going to send more performance tools.

A place to save test results as scratch sheets has been discussed so it will be easy to track the test history for any regressions. Anna will help to figure it out.

A couple of new bugs have been filed to track existing issues. Devesh had hit a bug in dbench test, which Steve Wise already worked on it.

https://bugzilla.linux-nfs.org/show_bug.cgi?id=255

Klemens Senn has reported a soft lockup in unloading kernel module. Shirley has tried to reproduce this problem with Linux server, Solaris client, it didn't hit any issue. So it's a problem between Linux client and server.

https://bugzilla.linux-nfs.org/show_bug.cgi?id=252


4. Steve shared his findings on some bug he has bee working on -- refactoring patchset.

5. Followups update from last week
a. Linux server maintenance is still in unresolved status.

b. NFSoRDMA debugging and diagnosis tools?
Yan has made some progress on NFSoRDMA wireshark dissector. Selecting connection is not as simple as TCP, Yan has tried to use QP number/RDMA establish status to build the connection. Chuck suggested to try RPC XID field.

c. NFSoRDMA virtualization validation:
Shirley has set up KVM guest with Mellanox Connect2 SRIOV. A panic occurred right away during mount, the panic is different with XEN domU guest.

Next meeting topics proposal:
1. Follow up the work has been discussed from this meeting.

2. Walk through some of the stories on pivotal, link is as below:
https://www.pivotaltracker.com/s/projects/958376

3. Invite some of the developers to discuss some of their requirements and features.

Meeting time: one hour discussion every other Wed (next meeting will be
on 6/11). A reminder will be sent out to both linux-nfs and linux-rdma
mailing list:

6/11/2014
@8:00am PST
@9:00am MST
@10:00am CST
@11:00am EST
@Bangalore @9:00pm
@Israel @6:00pm

Duration: 1 hour

Call-in number:
Israel: +972 37219638
Bangalore: +91 8039890080 (180030109800)
US: 8666824770,  408-7744073
Conference Code: 2308833
Passcode: 63767362 (it's NFSoRDMA, in case you couldn't remember)

Thanks everyone for joining the call and providing valuable inputs/work to the community to make NFSoRDMA better.

Shirley



Attendees:

Jeff Beck (NASA)
Yan Burman (Mellanox)
Wendy Cheng (Intel)
Susan Coulter (LANL)
Rupert Dance (Soft Forge)
Chuck Lever (Oracle)
Doug Ledford (RedHat)
Shirley Ma (Oracle)
Devesh Sharma (Emulex)
Anna Schumaker (Net App)
Steve Wise (OpenGridComputing, Chelsio)

Moderator:
Shirley Ma (Oracle)

NFSoRDMA developers bi-weekly meeting is to help organizing NFSoRDMA development and test effort from different resources to speed up NFSoRDMA upstream kernel work and NFSoRDMA diagnosing/debugging tools development. Hopefully the quality of NFSoRDMA upstream patches can be improved by being tested by a quorum of HW vendors.

Today's meeting notes:
1. OFED release update from Rupert Dance through email:

a. OFED 3.12 was released yesterday without any patch from Chuck's git tree, one of the reason these patches haven't upstream yet. There were a number of new bugs filed on NFSRDMA (2489 and 2490).
http://bugs.openfabrics.org/bugzilla/show_bug.cgi?id=2489
http://bugs.openfabrics.org/bugzilla/show_bug.cgi?id=2490

b. Jeff Becker has pulled all of the patches from Chuck's git tree and made backports in his local branch of OFED 3.12. He has begun testing and is seeing good results so far.

c. OFED next release will be OFED 3.12-1 and it will be including all these updates along with support for RHEL 7.0 and Intel's OFED MIC.

2. NFSoRDMA support with soft RoCE and Soft iWARP

There were some discussions regarding whether removing RPCRDMA_REGISTER support (one of Chuck's patchset) would impact any other components in the stack. So far soft RoCE hasn't been upstreamed yet.There was a broad consensus not to support out-of-tree providers unless an issue also affects in-tree providers. NFSoRDMA will follow kernel development policy, all work should be based upon upstream kernel. However Chuck Level will check Soft RoCE plan, Steve Wise will check soft iWARP plan to make sure nothing will be broken in both kernel and OFED release. 

3. Update on testing NFSoRDMA client patches:

Devesh Sharma, Doug Ledford, Chuck Lever, Steve Wise all have tested Chuck git tree (up to last weeks patchsets) on different platforms with various vendor's HCAs. The test showed the stack pretty reliable for both NFSv3 and NFSv4. However NFSv4.1 hit server crash. (NFSv4.1 hasn't support yet).

Steve Wise's test covers iWARP Chelsio
Devesh Sharma's test covers Emulex
Chuck Lever/Shirley Ma's test covers Mellanox
Doug Ledford's test covers various platforms and combination of HCAs (Interoperability test).
Jeff Beck's test covers OFED release (backport)
Rupert Dance's (IOL) team test covers various platforms and combination of HCAs as well.

The test coverage should be good enough for NFSoRDMA client patchsets to be merged to upstream by Anna and Trond.

Devesh is looking for performance benchmark tools. IOzone is recommended. Anna is going to send more performance tools.

A place to save test results as scratch sheets has been discussed so it will be easy to track the test history for any regressions. Anna will help to figure it out.

A couple of new bugs have been filed to track existing issues. Devesh had hit a bug in dbench test, which Steve Wise already worked on it.

https://bugzilla.linux-nfs.org/show_bug.cgi?id=255

Klemens Senn has reported a soft lockup in unloading kernel module. Shirley has tried to reproduce this problem with Linux server, Solaris client, it didn't hit any issue. So it's a problem between Linux client and server.

https://bugzilla.linux-nfs.org/show_bug.cgi?id=252


4. Steve shared his findings on some bug he has bee working on -- refactoring patchset.

5. Followups update from last week
a. Linux server maintenance is still in unresolved status.

b. NFSoRDMA debugging and diagnosis tools?
Yan has made some progress on NFSoRDMA wireshark dissector. Selecting connection is not as simple as TCP, Yan has tried to use QP number/RDMA establish status to build the connection. Chuck suggested to try RPC XID field.

c. NFSoRDMA virtualization validation:
Shirley has set up KVM guest with Mellanox Connect2 SRIOV. A panic occurred right away during mount, the panic is different with XEN domU guest.

Next meeting topics proposal:
1. Follow up the work has been discussed from this meeting.

2. Walk through some of the stories on pivotal, link is as below:
https://www.pivotaltracker.com/s/projects/958376

3. Invite some of the developers to discuss some of their requirements and features.

Meeting time: one hour discussion every other Wed (next meeting will be
on 6/11). A reminder will be sent out to both linux-nfs and linux-rdma
mailing list:

6/11/2014
@8:00am PST
@9:00am MST
@10:00am CST
@11:00am EST
@Bangalore @9:00pm
@Israel @6:00pm

Duration: 1 hour

Call-in number:
Israel: +972 37219638
Bangalore: +91 8039890080 (180030109800)
US: 8666824770,  408-7744073
Conference Code: 2308833
Passcode: 63767362 (it's NFSoRDMA, in case you couldn't remember)

Thanks everyone for joining the call and providing valuable inputs/work to the community to make NFSoRDMA better.

Shirley

Re: NFSoRDMA developers bi-weekly meeting minutes (5/28)

[Anna Schumaker]

On 05/29/2014 01:07 PM, Shirley Ma wrote:
> Attendees:
> 
> Jeff Beck (NASA)
> Yan Burman (Mellanox)
> Wendy Cheng (Intel)
> Susan Coulter (LANL)
> Rupert Dance (Soft Forge)
> Chuck Lever (Oracle)
> Doug Ledford (RedHat)
> Shirley Ma (Oracle)
> Devesh Sharma (Emulex)
> Anna Schumaker (Net App)
> Steve Wise (OpenGridComputing, Chelsio)
> 
> Moderator:
> Shirley Ma (Oracle)
> 
> NFSoRDMA developers bi-weekly meeting is to help organizing NFSoRDMA development and test effort from different resources to speed up NFSoRDMA upstream kernel work and NFSoRDMA diagnosing/debugging tools development. Hopefully the quality of NFSoRDMA upstream patches can be improved by being tested by a quorum of HW vendors.
> 
> Today's meeting notes:
> 1. OFED release update from Rupert Dance through email:
> 
> a. OFED 3.12 was released yesterday without any patch from Chuck's git tree, one of the reason these patches haven't upstream yet. There were a number of new bugs filed on NFSRDMA (2489 and 2490).
> http://bugs.openfabrics.org/bugzilla/show_bug.cgi?id=2489
> http://bugs.openfabrics.org/bugzilla/show_bug.cgi?id=2490
> 
> b. Jeff Becker has pulled all of the patches from Chuck's git tree and made backports in his local branch of OFED 3.12. He has begun testing and is seeing good results so far.
> 
> c. OFED next release will be OFED 3.12-1 and it will be including all these updates along with support for RHEL 7.0 and Intel's OFED MIC.
> 
> 2. NFSoRDMA support with soft RoCE and Soft iWARP
> 
> There were some discussions regarding whether removing RPCRDMA_REGISTER support (one of Chuck's patchset) would impact any other components in the stack. So far soft RoCE hasn't been upstreamed yet.There was a broad consensus not to support out-of-tree providers unless an issue also affects in-tree providers. NFSoRDMA will follow kernel development policy, all work should be based upon upstream kernel. However Chuck Level will check Soft RoCE plan, Steve Wise will check soft iWARP plan to make sure nothing will be broken in both kernel and OFED release. 
> 
> 3. Update on testing NFSoRDMA client patches:
> 
> Devesh Sharma, Doug Ledford, Chuck Lever, Steve Wise all have tested Chuck git tree (up to last weeks patchsets) on different platforms with various vendor's HCAs. The test showed the stack pretty reliable for both NFSv3 and NFSv4. However NFSv4.1 hit server crash. (NFSv4.1 hasn't support yet).
> 
> Steve Wise's test covers iWARP Chelsio
> Devesh Sharma's test covers Emulex
> Chuck Lever/Shirley Ma's test covers Mellanox
> Doug Ledford's test covers various platforms and combination of HCAs (Interoperability test).
> Jeff Beck's test covers OFED release (backport)
> Rupert Dance's (IOL) team test covers various platforms and combination of HCAs as well.
> 
> The test coverage should be good enough for NFSoRDMA client patchsets to be merged to upstream by Anna and Trond.
> 
> Devesh is looking for performance benchmark tools. IOzone is recommended. Anna is going to send more performance tools.
> 
> A place to save test results as scratch sheets has been discussed so it will be easy to track the test history for any regressions. Anna will help to figure it out.
> 
> A couple of new bugs have been filed to track existing issues. Devesh had hit a bug in dbench test, which Steve Wise already worked on it.
> 
> https://bugzilla.linux-nfs.org/show_bug.cgi?id=255
> 
> Klemens Senn has reported a soft lockup in unloading kernel module. Shirley has tried to reproduce this problem with Linux server, Solaris client, it didn't hit any issue. So it's a problem between Linux client and server.
> 
> https://bugzilla.linux-nfs.org/show_bug.cgi?id=252
> 
> 
> 4. Steve shared his findings on some bug he has bee working on -- refactoring patchset.
> 
> 5. Followups update from last week
> a. Linux server maintenance is still in unresolved status.
> 
> b. NFSoRDMA debugging and diagnosis tools?
> Yan has made some progress on NFSoRDMA wireshark dissector. Selecting connection is not as simple as TCP, Yan has tried to use QP number/RDMA establish status to build the connection. Chuck suggested to try RPC XID field.
> 
> c. NFSoRDMA virtualization validation:
> Shirley has set up KVM guest with Mellanox Connect2 SRIOV. A panic occurred right away during mount, the panic is different with XEN domU guest.
> 
> Next meeting topics proposal:
> 1. Follow up the work has been discussed from this meeting.
> 
> 2. Walk through some of the stories on pivotal, link is as below:
> https://www.pivotaltracker.com/s/projects/958376
> 
> 3. Invite some of the developers to discuss some of their requirements and features.
> 
> Meeting time: one hour discussion every other Wed (next meeting will be
> on 6/11). A reminder will be sent out to both linux-nfs and linux-rdma
> mailing list:
> 
> 6/11/2014
> @8:00am PST
> @9:00am MST
> @10:00am CST
> @11:00am EST
> @Bangalore @9:00pm
> @Israel @6:00pm
> 
> Duration: 1 hour
> 
> Call-in number:
> Israel: +972 37219638
> Bangalore: +91 8039890080 (180030109800)
> US: 8666824770,  408-7744073
> Conference Code: 2308833
> Passcode: 63767362 (it's NFSoRDMA, in case you couldn't remember)
> 
> Thanks everyone for joining the call and providing valuable inputs/work to the community to make NFSoRDMA better.
> 
> Shirley
> 
> 
> 
> Attendees:
> 
> Jeff Beck (NASA)
> Yan Burman (Mellanox)
> Wendy Cheng (Intel)
> Susan Coulter (LANL)
> Rupert Dance (Soft Forge)
> Chuck Lever (Oracle)
> Doug Ledford (RedHat)
> Shirley Ma (Oracle)
> Devesh Sharma (Emulex)
> Anna Schumaker (Net App)
> Steve Wise (OpenGridComputing, Chelsio)
> 
> Moderator:
> Shirley Ma (Oracle)
> 
> NFSoRDMA developers bi-weekly meeting is to help organizing NFSoRDMA development and test effort from different resources to speed up NFSoRDMA upstream kernel work and NFSoRDMA diagnosing/debugging tools development. Hopefully the quality of NFSoRDMA upstream patches can be improved by being tested by a quorum of HW vendors.
> 
> Today's meeting notes:
> 1. OFED release update from Rupert Dance through email:
> 
> a. OFED 3.12 was released yesterday without any patch from Chuck's git tree, one of the reason these patches haven't upstream yet. There were a number of new bugs filed on NFSRDMA (2489 and 2490).
> http://bugs.openfabrics.org/bugzilla/show_bug.cgi?id=2489
> http://bugs.openfabrics.org/bugzilla/show_bug.cgi?id=2490
> 
> b. Jeff Becker has pulled all of the patches from Chuck's git tree and made backports in his local branch of OFED 3.12. He has begun testing and is seeing good results so far.
> 
> c. OFED next release will be OFED 3.12-1 and it will be including all these updates along with support for RHEL 7.0 and Intel's OFED MIC.
> 
> 2. NFSoRDMA support with soft RoCE and Soft iWARP
> 
> There were some discussions regarding whether removing RPCRDMA_REGISTER support (one of Chuck's patchset) would impact any other components in the stack. So far soft RoCE hasn't been upstreamed yet.There was a broad consensus not to support out-of-tree providers unless an issue also affects in-tree providers. NFSoRDMA will follow kernel development policy, all work should be based upon upstream kernel. However Chuck Level will check Soft RoCE plan, Steve Wise will check soft iWARP plan to make sure nothing will be broken in both kernel and OFED release. 
> 
> 3. Update on testing NFSoRDMA client patches:
> 
> Devesh Sharma, Doug Ledford, Chuck Lever, Steve Wise all have tested Chuck git tree (up to last weeks patchsets) on different platforms with various vendor's HCAs. The test showed the stack pretty reliable for both NFSv3 and NFSv4. However NFSv4.1 hit server crash. (NFSv4.1 hasn't support yet).
> 
> Steve Wise's test covers iWARP Chelsio
> Devesh Sharma's test covers Emulex
> Chuck Lever/Shirley Ma's test covers Mellanox
> Doug Ledford's test covers various platforms and combination of HCAs (Interoperability test).
> Jeff Beck's test covers OFED release (backport)
> Rupert Dance's (IOL) team test covers various platforms and combination of HCAs as well.
> 
> The test coverage should be good enough for NFSoRDMA client patchsets to be merged to upstream by Anna and Trond.
> 
> Devesh is looking for performance benchmark tools. IOzone is recommended. Anna is going to send more performance tools.
> 
> A place to save test results as scratch sheets has been discussed so it will be easy to track the test history for any regressions. Anna will help to figure it out.
> 
> A couple of new bugs have been filed to track existing issues. Devesh had hit a bug in dbench test, which Steve Wise already worked on it.
> 
> https://bugzilla.linux-nfs.org/show_bug.cgi?id=255
> 
> Klemens Senn has reported a soft lockup in unloading kernel module. Shirley has tried to reproduce this problem with Linux server, Solaris client, it didn't hit any issue. So it's a problem between Linux client and server.
> 
> https://bugzilla.linux-nfs.org/show_bug.cgi?id=252
> 
> 
> 4. Steve shared his findings on some bug he has bee working on -- refactoring patchset.
> 
> 5. Followups update from last week
> a. Linux server maintenance is still in unresolved status.
> 
> b. NFSoRDMA debugging and diagnosis tools?
> Yan has made some progress on NFSoRDMA wireshark dissector. Selecting connection is not as simple as TCP, Yan has tried to use QP number/RDMA establish status to build the connection. Chuck suggested to try RPC XID field.
> 
> c. NFSoRDMA virtualization validation:
> Shirley has set up KVM guest with Mellanox Connect2 SRIOV. A panic occurred right away during mount, the panic is different with XEN domU guest.
> 
> Next meeting topics proposal:
> 1. Follow up the work has been discussed from this meeting.

I mentioned nfsometer for performance testing during the last meeting.  Anybody interested can check out a copy here: git://git.linux-nfs.org/projects/dros/nfsometer.git

Anna
> 
> 2. Walk through some of the stories on pivotal, link is as below:
> https://www.pivotaltracker.com/s/projects/958376
> 
> 3. Invite some of the developers to discuss some of their requirements and features.
> 
> Meeting time: one hour discussion every other Wed (next meeting will be
> on 6/11). A reminder will be sent out to both linux-nfs and linux-rdma
> mailing list:
> 
> 6/11/2014
> @8:00am PST
> @9:00am MST
> @10:00am CST
> @11:00am EST
> @Bangalore @9:00pm
> @Israel @6:00pm
> 
> Duration: 1 hour
> 
> Call-in number:
> Israel: +972 37219638
> Bangalore: +91 8039890080 (180030109800)
> US: 8666824770,  408-7744073
> Conference Code: 2308833
> Passcode: 63767362 (it's NFSoRDMA, in case you couldn't remember)
> 
> Thanks everyone for joining the call and providing valuable inputs/work to the community to make NFSoRDMA better.
> 
> Shirley
> 

Re: NFSoRDMA developers bi-weekly meeting minutes (5/28)

[Chuck Lever]

On Jun 3, 2014, at 1:37 PM, Anna Schumaker <Anna.Schumaker@netapp.com> wrote:

> On 05/29/2014 01:07 PM, Shirley Ma wrote:
>> Attendees:
>> 
>> Jeff Beck (NASA)
>> Yan Burman (Mellanox)
>> Wendy Cheng (Intel)
>> Susan Coulter (LANL)
>> Rupert Dance (Soft Forge)
>> Chuck Lever (Oracle)
>> Doug Ledford (RedHat)
>> Shirley Ma (Oracle)
>> Devesh Sharma (Emulex)
>> Anna Schumaker (Net App)
>> Steve Wise (OpenGridComputing, Chelsio)
>> 
>> Moderator:
>> Shirley Ma (Oracle)
>> 
>> NFSoRDMA developers bi-weekly meeting is to help organizing NFSoRDMA development and test effort from different resources to speed up NFSoRDMA upstream kernel work and NFSoRDMA diagnosing/debugging tools development. Hopefully the quality of NFSoRDMA upstream patches can be improved by being tested by a quorum of HW vendors.
>> 
>> Today's meeting notes:
>> 1. OFED release update from Rupert Dance through email:
>> 
>> a. OFED 3.12 was released yesterday without any patch from Chuck's git tree, one of the reason these patches haven't upstream yet. There were a number of new bugs filed on NFSRDMA (2489 and 2490).
>> http://bugs.openfabrics.org/bugzilla/show_bug.cgi?id=2489
>> http://bugs.openfabrics.org/bugzilla/show_bug.cgi?id=2490
>> 
>> b. Jeff Becker has pulled all of the patches from Chuck's git tree and made backports in his local branch of OFED 3.12. He has begun testing and is seeing good results so far.
>> 
>> c. OFED next release will be OFED 3.12-1 and it will be including all these updates along with support for RHEL 7.0 and Intel's OFED MIC.
>> 
>> 2. NFSoRDMA support with soft RoCE and Soft iWARP
>> 
>> There were some discussions regarding whether removing RPCRDMA_REGISTER support (one of Chuck's patchset) would impact any other components in the stack. So far soft RoCE hasn't been upstreamed yet.There was a broad consensus not to support out-of-tree providers unless an issue also affects in-tree providers. NFSoRDMA will follow kernel development policy, all work should be based upon upstream kernel. However Chuck Level will check Soft RoCE plan, Steve Wise will check soft iWARP plan to make sure nothing will be broken in both kernel and OFED release. 
>> 
>> 3. Update on testing NFSoRDMA client patches:
>> 
>> Devesh Sharma, Doug Ledford, Chuck Lever, Steve Wise all have tested Chuck git tree (up to last weeks patchsets) on different platforms with various vendor's HCAs. The test showed the stack pretty reliable for both NFSv3 and NFSv4. However NFSv4.1 hit server crash. (NFSv4.1 hasn't support yet).
>> 
>> Steve Wise's test covers iWARP Chelsio
>> Devesh Sharma's test covers Emulex
>> Chuck Lever/Shirley Ma's test covers Mellanox
>> Doug Ledford's test covers various platforms and combination of HCAs (Interoperability test).
>> Jeff Beck's test covers OFED release (backport)
>> Rupert Dance's (IOL) team test covers various platforms and combination of HCAs as well.
>> 
>> The test coverage should be good enough for NFSoRDMA client patchsets to be merged to upstream by Anna and Trond.
>> 
>> Devesh is looking for performance benchmark tools. IOzone is recommended. Anna is going to send more performance tools.
>> 
>> A place to save test results as scratch sheets has been discussed so it will be easy to track the test history for any regressions. Anna will help to figure it out.
>> 
>> A couple of new bugs have been filed to track existing issues. Devesh had hit a bug in dbench test, which Steve Wise already worked on it.
>> 
>> https://bugzilla.linux-nfs.org/show_bug.cgi?id=255
>> 
>> Klemens Senn has reported a soft lockup in unloading kernel module. Shirley has tried to reproduce this problem with Linux server, Solaris client, it didn't hit any issue. So it's a problem between Linux client and server.
>> 
>> https://bugzilla.linux-nfs.org/show_bug.cgi?id=252
>> 
>> 
>> 4. Steve shared his findings on some bug he has bee working on -- refactoring patchset.
>> 
>> 5. Followups update from last week
>> a. Linux server maintenance is still in unresolved status.
>> 
>> b. NFSoRDMA debugging and diagnosis tools?
>> Yan has made some progress on NFSoRDMA wireshark dissector. Selecting connection is not as simple as TCP, Yan has tried to use QP number/RDMA establish status to build the connection. Chuck suggested to try RPC XID field.
>> 
>> c. NFSoRDMA virtualization validation:
>> Shirley has set up KVM guest with Mellanox Connect2 SRIOV. A panic occurred right away during mount, the panic is different with XEN domU guest.
>> 
>> Next meeting topics proposal:
>> 1. Follow up the work has been discussed from this meeting.
>> 
>> 2. Walk through some of the stories on pivotal, link is as below:
>> https://www.pivotaltracker.com/s/projects/958376
>> 
>> 3. Invite some of the developers to discuss some of their requirements and features.
>> 
>> Meeting time: one hour discussion every other Wed (next meeting will be
>> on 6/11). A reminder will be sent out to both linux-nfs and linux-rdma
>> mailing list:
>> 
>> 6/11/2014
>> @8:00am PST
>> @9:00am MST
>> @10:00am CST
>> @11:00am EST
>> @Bangalore @9:00pm
>> @Israel @6:00pm
>> 
>> Duration: 1 hour
>> 
>> Call-in number:
>> Israel: +972 37219638
>> Bangalore: +91 8039890080 (180030109800)
>> US: 8666824770,  408-7744073
>> Conference Code: 2308833
>> Passcode: 63767362 (it's NFSoRDMA, in case you couldn't remember)
>> 
>> Thanks everyone for joining the call and providing valuable inputs/work to the community to make NFSoRDMA better.
>> 
>> Shirley
>> 
>> 
>> 
>> Attendees:
>> 
>> Jeff Beck (NASA)
>> Yan Burman (Mellanox)
>> Wendy Cheng (Intel)
>> Susan Coulter (LANL)
>> Rupert Dance (Soft Forge)
>> Chuck Lever (Oracle)
>> Doug Ledford (RedHat)
>> Shirley Ma (Oracle)
>> Devesh Sharma (Emulex)
>> Anna Schumaker (Net App)
>> Steve Wise (OpenGridComputing, Chelsio)
>> 
>> Moderator:
>> Shirley Ma (Oracle)
>> 
>> NFSoRDMA developers bi-weekly meeting is to help organizing NFSoRDMA development and test effort from different resources to speed up NFSoRDMA upstream kernel work and NFSoRDMA diagnosing/debugging tools development. Hopefully the quality of NFSoRDMA upstream patches can be improved by being tested by a quorum of HW vendors.
>> 
>> Today's meeting notes:
>> 1. OFED release update from Rupert Dance through email:
>> 
>> a. OFED 3.12 was released yesterday without any patch from Chuck's git tree, one of the reason these patches haven't upstream yet. There were a number of new bugs filed on NFSRDMA (2489 and 2490).
>> http://bugs.openfabrics.org/bugzilla/show_bug.cgi?id=2489
>> http://bugs.openfabrics.org/bugzilla/show_bug.cgi?id=2490
>> 
>> b. Jeff Becker has pulled all of the patches from Chuck's git tree and made backports in his local branch of OFED 3.12. He has begun testing and is seeing good results so far.
>> 
>> c. OFED next release will be OFED 3.12-1 and it will be including all these updates along with support for RHEL 7.0 and Intel's OFED MIC.
>> 
>> 2. NFSoRDMA support with soft RoCE and Soft iWARP
>> 
>> There were some discussions regarding whether removing RPCRDMA_REGISTER support (one of Chuck's patchset) would impact any other components in the stack. So far soft RoCE hasn't been upstreamed yet.There was a broad consensus not to support out-of-tree providers unless an issue also affects in-tree providers. NFSoRDMA will follow kernel development policy, all work should be based upon upstream kernel. However Chuck Level will check Soft RoCE plan, Steve Wise will check soft iWARP plan to make sure nothing will be broken in both kernel and OFED release. 
>> 
>> 3. Update on testing NFSoRDMA client patches:
>> 
>> Devesh Sharma, Doug Ledford, Chuck Lever, Steve Wise all have tested Chuck git tree (up to last weeks patchsets) on different platforms with various vendor's HCAs. The test showed the stack pretty reliable for both NFSv3 and NFSv4. However NFSv4.1 hit server crash. (NFSv4.1 hasn't support yet).
>> 
>> Steve Wise's test covers iWARP Chelsio
>> Devesh Sharma's test covers Emulex
>> Chuck Lever/Shirley Ma's test covers Mellanox
>> Doug Ledford's test covers various platforms and combination of HCAs (Interoperability test).
>> Jeff Beck's test covers OFED release (backport)
>> Rupert Dance's (IOL) team test covers various platforms and combination of HCAs as well.
>> 
>> The test coverage should be good enough for NFSoRDMA client patchsets to be merged to upstream by Anna and Trond.
>> 
>> Devesh is looking for performance benchmark tools. IOzone is recommended. Anna is going to send more performance tools.
>> 
>> A place to save test results as scratch sheets has been discussed so it will be easy to track the test history for any regressions. Anna will help to figure it out.
>> 
>> A couple of new bugs have been filed to track existing issues. Devesh had hit a bug in dbench test, which Steve Wise already worked on it.
>> 
>> https://bugzilla.linux-nfs.org/show_bug.cgi?id=255
>> 
>> Klemens Senn has reported a soft lockup in unloading kernel module. Shirley has tried to reproduce this problem with Linux server, Solaris client, it didn't hit any issue. So it's a problem between Linux client and server.
>> 
>> https://bugzilla.linux-nfs.org/show_bug.cgi?id=252
>> 
>> 
>> 4. Steve shared his findings on some bug he has bee working on -- refactoring patchset.
>> 
>> 5. Followups update from last week
>> a. Linux server maintenance is still in unresolved status.
>> 
>> b. NFSoRDMA debugging and diagnosis tools?
>> Yan has made some progress on NFSoRDMA wireshark dissector. Selecting connection is not as simple as TCP, Yan has tried to use QP number/RDMA establish status to build the connection. Chuck suggested to try RPC XID field.
>> 
>> c. NFSoRDMA virtualization validation:
>> Shirley has set up KVM guest with Mellanox Connect2 SRIOV. A panic occurred right away during mount, the panic is different with XEN domU guest.
>> 
>> Next meeting topics proposal:
>> 1. Follow up the work has been discussed from this meeting.
> 
> I mentioned nfsometer for performance testing during the last meeting.  Anybody interested can check out a copy here: git://git.linux-nfs.org/projects/dros/nfsometer.git

I added this to the NFS/RDMA wiki home page:

 http://wiki.linux-nfs.org/wiki/index.php/NfsRdmaClient/Home

--
Chuck Lever
chuck[dot]lever[at]oracle[dot]com