Thanks Wu. I thought it could be hardware problem with NVMe device. I do not understand why the nvme probe worked in perf application.

I agree with your investigation that it could be a hardware problem, am going to get a different SSD device and try the test with the latest SPDK code. How do I know intel version is P3700?

 

Sreeni

 

From: SPDK [mailto:spdk-bounces@lists.01.org] On Behalf Of Wu, WenzhongX
Sent: Tuesday, November 14, 2017 1:13 AM
To: Storage Performance Development Kit <spdk@lists.01.org>
Subject: Re: [SPDK] Helloworld program fails during device initialization.

 

Hi Sreeni,

 

Verify with newest spdk source code with intel P3700 ,run helloword everything is ok:

root@waikiki5-target:~/workspace/spdk1102/examples/nvme/hello_world# ./hello_world

Starting DPDK 17.08.0 initialization...

[ DPDK EAL parameters: hello_world -c 0x1 --file-prefix=spdk0 --base-virtaddr=0x1000000000 --proc-type=auto ]

EAL: Detected 36 lcore(s)

EAL: Auto-detected process type: PRIMARY

EAL: No free hugepages reported in hugepages-1048576kB

EAL: Probing VFIO support...

Initializing NVMe Controllers

EAL: PCI device 0000:81:00.0 on NUMA socket 1

EAL:   probe driver: 8086:953 spdk_nvme

Attaching to 0000:81:00.0

EAL: PCI device 0000:84:00.0 on NUMA socket 1

EAL:   probe driver: 8086:953 spdk_nvme

Attaching to 0000:84:00.0

EAL: PCI device 0000:85:00.0 on NUMA socket 1

EAL:   probe driver: 8086:953 spdk_nvme

Attaching to 0000:85:00.0

Attached to 0000:85:00.0

Using controller INTEL SSDPEDMD800G4  (PHFT6401011B800CGN  ) with 1 namespaces.

  Namespace ID: 1 size: 800GB

Attached to 0000:81:00.0

Using controller INTEL SSDPEDMD800G4  (PHFT5373002D800CGN  ) with 1 namespaces.

  Namespace ID: 1 size: 800GB

Attached to 0000:84:00.0

Using controller INTEL SSDPEDMD800G4  (PHFT53640003800CGN  ) with 1 namespaces.

  Namespace ID: 1 size: 800GB

Initialization complete.

Hello world!

Hello world!

Hello world!

 

Seem  it’s your hardware cause this issues.

 

Thanks

Wenzhong

 

From: SPDK [mailto:spdk-bounces@lists.01.org] On Behalf Of Sreeni (Sreenivasa) Busam (Stellus)
Sent: Tuesday, November 14, 2017 2:36 PM
To: spdk@lists.01.org
Subject: [SPDK] Helloworld program fails during device initialization.

 

I was testing the helloworld program on ubuntu with NVMe SSD and the probe() is failing. Please let me know if this is a known problem.

Let me know if there is workaround.

The perf program did not have any problem.

I have attached the output for both tests.

lspci| grep Non

ad:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller (rev 01)

ae:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller (rev 01)

uname -a

Linux sjca5radevct13 4.10.0-38-generic #42~16.04.1-Ubuntu SMP Tue Oct 10 16:32:20 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux

1. helloworld output:

---------------------------

Attached to 0000:ad:00.0

Using controller SAMSUNG MZQWV480HCGM (S1TRNYAFA00148      ) with 1 namespaces.

  Namespace ID: 1 size: 480GB

nvme_ctrlr.c:1475:nvme_ctrlr_process_init: *ERROR*: Initialization timed out in state 1

nvme_ctrlr.c: 523:nvme_ctrlr_shutdown: *ERROR*: did not shutdown within 5 seconds

spdk_nvme_probe() failed

 

2. perf output:

sudo ./perf -q 1 -s 4096 -t 10 -w read -r "trtype:PCIe traddr:0000:ad:00.0"

---------------

Starting DPDK 17.08.0 initialization...

[ DPDK EAL parameters: perf -c 0x1 --file-prefix=spdk_pid7647 ]

EAL: Detected 32 lcore(s)

EAL: No free hugepages reported in hugepages-1048576kB

Attached to NVMe Controller at 0000:ad:00.0 [144d:a802]

Associating SAMSUNG MZQWV480HCGM (S1TRNYAFA00148      ) with lcore 0

Initialization complete. Launching workers.

Starting thread on core 0

========================================================

                                                                                            Latency(us)

Device Information                                     :       IOPS       MB/s    Average        min        max

SAMSUNG MZQWV480HCGM (S1TRNYAFA00148      ) from core 0:   13773.50      53.80      72.59      60.20     243.82

========================================================

Total                                                  :   13773.50      53.80      72.59      60.20     243.82

 

Thanks for your help,

Sreeni