From mboxrd@z Thu Jan 1 00:00:00 1970 Content-Type: multipart/mixed; boundary="===============5756074720200227544==" MIME-Version: 1.0 From: Kirubakaran Kaliannan Subject: [SPDK] NVMf target configuration issue Date: Tue, 05 Sep 2017 10:21:43 +0530 Message-ID: <36b639eb71882ba9cbcac3993cc942a5@mail.gmail.com> List-ID: To: spdk@lists.01.org --===============5756074720200227544== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Hi All, I am trying to get the nvmf configuration going with SPDK. I have the following configuration, *# ofed 2.4 on both target and initiator* *# SPDK + 3.18 kernel on target * *# 4.9 kernel on initiator* *# mellanox connect3X-Pro* */etc/spdk/nvmf.conf* [Global] [Rpc] Enable No Listen 127.0.0.1 [AIO] AIO /dev/sdd AIO0 [Nvmf] MaxQueuesPerSession 4 AcceptorPollRate 10000 [Subsystem1] NQN nqn.2016-06.io.spdk:cnode1 Core 0 Listen RDMA 10.3.7.2:4420 Host nqn.2016-06.io.spdk:init SN SPDK00000000000001 Namespace AIO0 *From initiator I tried discover and connect* *# nvme discover -t rdma -a 10.3.7.2 -s 4420* Discovery Log Number of Records 1, Generation counter 4 =3D=3D=3D=3D=3DDiscovery Log Entry 0=3D=3D=3D=3D=3D=3D trtype: rdma adrfam: ipv4 subtype: nvme subsystem treq: not specified portid: 0 trsvcid: 4420 subnqn: nqn.2016-06.io.spdk:cnode1 traddr: 10.3.7.2 rdma_prtype: not specified rdma_qptype: connected rdma_cms: rdma-cm rdma_pkey: 0x0000 *# nvme connect -t rdma -n "nqn.2016-06.io.spdk:cnode1" -a 10.3.7.2 -s 4420* Failed to write to /dev/nvme-fabrics: Input/output error [dmesg] [59909.541392] nvme nvme0: new ctrl: NQN "nqn.2014-08.org.nvmexpress.discovery", addr 10.3.7.2:4420 [59940.389952] nvme nvme0: Connect command failed, error wo/DNR bit: 388 *On target I get the following error* # app/nvmf_tgt/nvmf_tgt -c /etc/spdk/nvmf.conf > /tmp/1 EAL: Detected 20 lcore(s) reactor.c: 314:_spdk_reactor_run: *NOTICE*: Reactor started on core 0 on socket 0 copy_engine_ioat.c: 306:copy_engine_ioat_init: *NOTICE*: Ioat Copy Engine Offload Enabled nvmf_tgt.c: 215:nvmf_tgt_create_subsystem: *NOTICE*: allocated subsystem nqn.2014-08.org.nvmexpress.discovery on lcore 0 on socket 0 nvmf_tgt.c: 215:nvmf_tgt_create_subsystem: *NOTICE*: allocated subsystem nqn.2016-06.io.spdk:cnode1 on lcore 0 on socket 0 rdma.c: 955:spdk_nvmf_rdma_create: *NOTICE*: *** RDMA Transport Init *** rdma.c:1120:spdk_nvmf_rdma_listen: *NOTICE*: *** NVMf Target Listening on 10.3.7.2 port 4420 *** conf.c: 500:spdk_nvmf_construct_subsystem: *NOTICE*: Attaching block device AIO0 to subsystem nqn.2016-06.io.spdk:cnode1 nvmf_tgt.c: 290:spdk_nvmf_startup: *NOTICE*: Acceptor running on core 0 on socket 0 *request.c: 171:nvmf_process_connect: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:NVMf:uuid:5e5e0064-2ad6-4a43-9c26-063e3ef6cf14'* can you please help on why I am not able to connect in this configuration. Regards, -kiru --===============5756074720200227544== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGh0bWw+PGhlYWQ+PG1ldGEgaHR0cC1lcXVpdj0iQ29udGVudC1UeXBlIiBjb250ZW50PSJ0ZXh0 L2h0bWw7IGNoYXJzZXQ9dXMtYXNjaWkiPjxtZXRhIG5hbWU9IkdlbmVyYXRvciIgY29udGVudD0i TWljcm9zb2Z0IFdvcmQgMTIgKGZpbHRlcmVkIG1lZGl1bSkiPjxzdHlsZT48IS0tCi8qIEZvbnQg RGVmaW5pdGlvbnMgKi8KQGZvbnQtZmFjZQoJe2ZvbnQtZmFtaWx5OkxhdGhhOwoJcGFub3NlLTE6 MiAxMSA2IDQgMiAyIDIgMiAyIDQ7fQpAZm9udC1mYWNlCgl7Zm9udC1mYW1pbHk6IkNhbWJyaWEg TWF0aCI7CglwYW5vc2UtMToyIDQgNSAzIDUgNCA2IDMgMiA0O30KQGZvbnQtZmFjZQoJe2ZvbnQt ZmFtaWx5OkNhbGlicmk7CglwYW5vc2UtMToyIDE1IDUgMiAyIDIgNCAzIDIgNDt9Ci8qIFN0eWxl IERlZmluaXRpb25zICovCnAuTXNvTm9ybWFsLCBsaS5Nc29Ob3JtYWwsIGRpdi5Nc29Ob3JtYWwK CXttYXJnaW46MGNtOwoJbWFyZ2luLWJvdHRvbTouMDAwMXB0OwoJZm9udC1zaXplOjExLjBwdDsK CWZvbnQtZmFtaWx5OiJDYWxpYnJpIiwic2Fucy1zZXJpZiI7fQphOmxpbmssIHNwYW4uTXNvSHlw ZXJsaW5rCgl7bXNvLXN0eWxlLXByaW9yaXR5Ojk5OwoJY29sb3I6Ymx1ZTsKCXRleHQtZGVjb3Jh dGlvbjp1bmRlcmxpbmU7fQphOnZpc2l0ZWQsIHNwYW4uTXNvSHlwZXJsaW5rRm9sbG93ZWQKCXtt c28tc3R5bGUtcHJpb3JpdHk6OTk7Cgljb2xvcjpwdXJwbGU7Cgl0ZXh0LWRlY29yYXRpb246dW5k ZXJsaW5lO30Kc3Bhbi5FbWFpbFN0eWxlMTcKCXttc28tc3R5bGUtdHlwZTpwZXJzb25hbC1jb21w b3NlOwoJZm9udC1mYW1pbHk6IkNhbGlicmkiLCJzYW5zLXNlcmlmIjsKCWNvbG9yOndpbmRvd3Rl eHQ7fQouTXNvQ2hwRGVmYXVsdAoJe21zby1zdHlsZS10eXBlOmV4cG9ydC1vbmx5O30KQHBhZ2Ug V29yZFNlY3Rpb24xCgl7c2l6ZTo2MTIuMHB0IDc5Mi4wcHQ7CgltYXJnaW46NzIuMHB0IDcyLjBw dCA3Mi4wcHQgNzIuMHB0O30KZGl2LldvcmRTZWN0aW9uMQoJe3BhZ2U6V29yZFNlY3Rpb24xO30K LS0+PC9zdHlsZT48L2hlYWQ+PGJvZHkgbGFuZz0iRU4tVVMiIGxpbms9ImJsdWUiIHZsaW5rPSJw dXJwbGUiPjxkaXYgY2xhc3M9IldvcmRTZWN0aW9uMSI+PHAgY2xhc3M9Ik1zb05vcm1hbCI+wqA8 L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCI+wqA8L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCI+SGkgQWxs LDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj7CoDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj5JIGFt IHRyeWluZyB0byBnZXQgdGhlIG52bWYgY29uZmlndXJhdGlvbiBnb2luZyB3aXRoIFNQREsuPC9w PjxwIGNsYXNzPSJNc29Ob3JtYWwiPsKgPC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiPkkgaGF2ZSB0 aGUgZm9sbG93aW5nIGNvbmZpZ3VyYXRpb24sPC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiPsKgPC9w PjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtYXJnaW4tbGVmdDozNi4wcHQiPjxiPiMgb2Zl ZCAyLjQgb24gYm90aCB0YXJnZXQgYW5kIGluaXRpYXRvcjwvYj48L3A+PHAgY2xhc3M9Ik1zb05v cm1hbCIgc3R5bGU9Im1hcmdpbi1sZWZ0OjM2LjBwdCI+PGI+IyBTUERLICsgMy4xOCBrZXJuZWwg b24gdGFyZ2V0IDwvYj48L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1hcmdpbi1sZWZ0 OjM2LjBwdCI+PGI+IyA0Ljkga2VybmVsIG9uIGluaXRpYXRvcjwvYj48L3A+PHAgY2xhc3M9Ik1z b05vcm1hbCIgc3R5bGU9Im1hcmdpbi1sZWZ0OjM2LjBwdCI+PGI+IyBtZWxsYW5veCBjb25uZWN0 M1gtUHJvPC9iPjwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj7CoDwvcD48cCBjbGFzcz0iTXNvTm9y bWFsIj48Yj4vZXRjL3NwZGsvbnZtZi5jb25mPC9iPjwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj7C oDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibWFyZ2luLWxlZnQ6MzYuMHB0Ij5bR2xv YmFsXTwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibWFyZ2luLWxlZnQ6MzYuMHB0Ij5b UnBjXTwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibWFyZ2luLWxlZnQ6MzYuMHB0Ij7C oCBFbmFibGUgTm88L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1hcmdpbi1sZWZ0OjM2 LjBwdCI+wqAgTGlzdGVuIDEyNy4wLjAuMTwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0i bWFyZ2luLWxlZnQ6MzYuMHB0Ij5bQUlPXTwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0i bWFyZ2luLWxlZnQ6MzYuMHB0Ij7CoCBBSU8gL2Rldi9zZGQgQUlPMDwvcD48cCBjbGFzcz0iTXNv Tm9ybWFsIiBzdHlsZT0ibWFyZ2luLWxlZnQ6MzYuMHB0Ij7CoDwvcD48cCBjbGFzcz0iTXNvTm9y bWFsIiBzdHlsZT0ibWFyZ2luLWxlZnQ6MzYuMHB0Ij5bTnZtZl08L3A+PHAgY2xhc3M9Ik1zb05v cm1hbCIgc3R5bGU9Im1hcmdpbi1sZWZ0OjM2LjBwdCI+wqAgTWF4UXVldWVzUGVyU2Vzc2lvbiA0 PC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtYXJnaW4tbGVmdDozNi4wcHQiPsKgIEFj Y2VwdG9yUG9sbFJhdGUgMTAwMDA8L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1hcmdp bi1sZWZ0OjM2LjBwdCI+wqA8L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1hcmdpbi1s ZWZ0OjM2LjBwdCI+W1N1YnN5c3RlbTFdPC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJt YXJnaW4tbGVmdDozNi4wcHQiPsKgIE5RTiBucW4uMjAxNi0wNi5pby5zcGRrOmNub2RlMTwvcD48 cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibWFyZ2luLWxlZnQ6MzYuMHB0Ij7CoCBDb3JlIDA8 L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1hcmdpbi1sZWZ0OjM2LjBwdCI+wqAgTGlz dGVuIFJETUEgPGEgaHJlZj0iaHR0cDovLzEwLjMuNy4yOjQ0MjAiPjEwLjMuNy4yOjQ0MjA8L2E+ PC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtYXJnaW4tbGVmdDozNi4wcHQiPsKgIEhv c3QgbnFuLjIwMTYtMDYuaW8uc3Bkazppbml0PC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxl PSJtYXJnaW4tbGVmdDozNi4wcHQiPsKgIFNOIFNQREswMDAwMDAwMDAwMDAwMTwvcD48cCBjbGFz cz0iTXNvTm9ybWFsIiBzdHlsZT0ibWFyZ2luLWxlZnQ6MzYuMHB0Ij7CoCBOYW1lc3BhY2UgQUlP MDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj7CoDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj7CoDwv cD48cCBjbGFzcz0iTXNvTm9ybWFsIj48Yj48dT5Gcm9tIGluaXRpYXRvciBJIHRyaWVkIGRpc2Nv dmVyIGFuZCBjb25uZWN0PC91PjwvYj48L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCI+wqA8L3A+PHAg Y2xhc3M9Ik1zb05vcm1hbCI+PGI+IyBudm1lIGRpc2NvdmVyIC10IHJkbWEgLWEgMTAuMy43LjIg LXMgNDQyMDwvYj48L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCI+wqA8L3A+PHAgY2xhc3M9Ik1zb05v cm1hbCI+RGlzY292ZXJ5IExvZyBOdW1iZXIgb2YgUmVjb3JkcyAxLCBHZW5lcmF0aW9uIGNvdW50 ZXIgNDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj49PT09PURpc2NvdmVyeSBMb2cgRW50cnkgMD09 PT09PTwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj50cnR5cGU6wqAgcmRtYTwvcD48cCBjbGFzcz0i TXNvTm9ybWFsIj5hZHJmYW06wqAgaXB2NDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj5zdWJ0eXBl OiBudm1lIHN1YnN5c3RlbTwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj50cmVxOsKgwqDCoCBub3Qg c3BlY2lmaWVkPC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiPnBvcnRpZDrCoCAwPC9wPjxwIGNsYXNz PSJNc29Ob3JtYWwiPnRyc3ZjaWQ6IDQ0MjA8L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCI+c3VibnFu OsKgIG5xbi4yMDE2LTA2LmlvLnNwZGs6Y25vZGUxPC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiPnRy YWRkcjrCoCAxMC4zLjcuMjwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj5yZG1hX3BydHlwZTogbm90 IHNwZWNpZmllZDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj5yZG1hX3FwdHlwZTogY29ubmVjdGVk PC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiPnJkbWFfY21zOsKgwqDCoCByZG1hLWNtPC9wPjxwIGNs YXNzPSJNc29Ob3JtYWwiPnJkbWFfcGtleTogMHgwMDAwPC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwi PsKgPC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxiPiMgbnZtZSBjb25uZWN0IC10IHJkbWEgLW4g JnF1b3Q7bnFuLjIwMTYtMDYuaW8uc3Bkazpjbm9kZTEmcXVvdDsgLWEgMTAuMy43LjIgLXMgNDQy MDwvYj48L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCI+RmFpbGVkIHRvIHdyaXRlIHRvIC9kZXYvbnZt ZS1mYWJyaWNzOiBJbnB1dC9vdXRwdXQgZXJyb3I8L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCI+wqA8 L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCI+W2RtZXNnXTwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj5b NTk5MDkuNTQxMzkyXSBudm1lIG52bWUwOiBuZXcgY3RybDogTlFOICZxdW90O25xbi4yMDE0LTA4 Lm9yZy5udm1leHByZXNzLmRpc2NvdmVyeSZxdW90OywgYWRkciA8YSBocmVmPSJodHRwOi8vMTAu My43LjI6NDQyMCI+MTAuMy43LjI6NDQyMDwvYT48L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCI+WzU5 OTQwLjM4OTk1Ml0gbnZtZSBudm1lMDogQ29ubmVjdCBjb21tYW5kIGZhaWxlZCwgZXJyb3Igd28v RE5SIGJpdDogMzg4PC9wPjxwIGNsYXNzPSJNc29Ob3JtYWwiPsKgPC9wPjxwIGNsYXNzPSJNc29O b3JtYWwiPjxiPjx1Pk9uIHRhcmdldCBJIGdldCB0aGUgZm9sbG93aW5nIGVycm9yPC91PjwvYj48 L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCI+wqA8L3A+PHAgY2xhc3M9Ik1zb05vcm1hbCI+IyBhcHAv bnZtZl90Z3QvbnZtZl90Z3QgLWMgL2V0Yy9zcGRrL252bWYuY29uZsKgICZndDsgL3RtcC8xPC9w PjxwIGNsYXNzPSJNc29Ob3JtYWwiPkVBTDogRGV0ZWN0ZWQgMjAgbGNvcmUocyk8L3A+PHAgY2xh c3M9Ik1zb05vcm1hbCI+cmVhY3Rvci5jOiAzMTQ6X3NwZGtfcmVhY3Rvcl9ydW46ICpOT1RJQ0Uq OiBSZWFjdG9yIHN0YXJ0ZWQgb24gY29yZSAwIG9uIHNvY2tldCAwPC9wPjxwIGNsYXNzPSJNc29O b3JtYWwiPmNvcHlfZW5naW5lX2lvYXQuYzogMzA2OmNvcHlfZW5naW5lX2lvYXRfaW5pdDogKk5P VElDRSo6IElvYXQgQ29weSBFbmdpbmUgT2ZmbG9hZCBFbmFibGVkPC9wPjxwIGNsYXNzPSJNc29O b3JtYWwiPm52bWZfdGd0LmM6IDIxNTpudm1mX3RndF9jcmVhdGVfc3Vic3lzdGVtOiAqTk9USUNF KjogYWxsb2NhdGVkIHN1YnN5c3RlbSBucW4uMjAxNC0wOC5vcmcubnZtZXhwcmVzcy5kaXNjb3Zl cnkgb24gbGNvcmUgMCBvbiBzb2NrZXQgMDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj5udm1mX3Rn dC5jOiAyMTU6bnZtZl90Z3RfY3JlYXRlX3N1YnN5c3RlbTogKk5PVElDRSo6IGFsbG9jYXRlZCBz dWJzeXN0ZW0gbnFuLjIwMTYtMDYuaW8uc3Bkazpjbm9kZTEgb24gbGNvcmUgMCBvbiBzb2NrZXQg MDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj5yZG1hLmM6IDk1NTpzcGRrX252bWZfcmRtYV9jcmVh dGU6ICpOT1RJQ0UqOiAqKiogUkRNQSBUcmFuc3BvcnQgSW5pdCAqKio8L3A+PHAgY2xhc3M9Ik1z b05vcm1hbCI+cmRtYS5jOjExMjA6c3Bka19udm1mX3JkbWFfbGlzdGVuOiAqTk9USUNFKjogKioq IE5WTWYgVGFyZ2V0IExpc3RlbmluZyBvbiAxMC4zLjcuMiBwb3J0IDQ0MjAgKioqPC9wPjxwIGNs YXNzPSJNc29Ob3JtYWwiPmNvbmYuYzogNTAwOnNwZGtfbnZtZl9jb25zdHJ1Y3Rfc3Vic3lzdGVt OiAqTk9USUNFKjogQXR0YWNoaW5nIGJsb2NrIGRldmljZSBBSU8wIHRvIHN1YnN5c3RlbSBucW4u MjAxNi0wNi5pby5zcGRrOmNub2RlMTwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj5udm1mX3RndC5j OiAyOTA6c3Bka19udm1mX3N0YXJ0dXA6ICpOT1RJQ0UqOiBBY2NlcHRvciBydW5uaW5nIG9uIGNv cmUgMCBvbiBzb2NrZXQgMDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj48Yj5yZXF1ZXN0LmM6IDE3 MTpudm1mX3Byb2Nlc3NfY29ubmVjdDogKkVSUk9SKjogU3Vic3lzdGVtICYjMzk7bnFuLjIwMTYt MDYuaW8uc3Bkazpjbm9kZTEmIzM5OyBkb2VzIG5vdCBhbGxvdyBob3N0ICYjMzk7bnFuLjIwMTQt MDgub3JnLm52bWV4cHJlc3M6TlZNZjp1dWlkOjVlNWUwMDY0LTJhZDYtNGE0My05YzI2LTA2M2Uz ZWY2Y2YxNCYjMzk7PC9iPjwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj7CoDwvcD48cCBjbGFzcz0i TXNvTm9ybWFsIj7CoDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj5jYW4geW91IHBsZWFzZSBoZWxw IG9uIHdoeSBJIGFtIG5vdCBhYmxlIHRvIGNvbm5lY3QgaW4gdGhpcyBjb25maWd1cmF0aW9uLjwv cD48cCBjbGFzcz0iTXNvTm9ybWFsIj7CoDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj5SZWdhcmRz LDwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj4ta2lydTwvcD48cCBjbGFzcz0iTXNvTm9ybWFsIj7C oDwvcD48L2Rpdj48L2JvZHk+PC9odG1sPgo= --===============5756074720200227544==--