From mboxrd@z Thu Jan  1 00:00:00 1970
Content-Type: multipart/mixed; boundary="===============8824429295081858397=="
MIME-Version: 1.0
From: Harris, James R <james.r.harris at intel.com>
Subject: Re: [SPDK] nvme_ctrlr.c:1224:nvme_ctrlr_process_init: ***ERROR***
 Initialization timed out in state 3
Date: Mon, 03 Apr 2017 15:42:19 +0000
Message-ID: <C25445CA-EACE-4EB0-97E4-DF171A2C117D@intel.com>
In-Reply-To: f3737035de24f3610c2a851700cb2429@mail.gmail.com
List-ID: <spdk@lists.01.org>
To: spdk@lists.01.org

--===============8824429295081858397==
Content-Type: text/plain; charset="utf-8"
MIME-Version: 1.0
Content-Transfer-Encoding: quoted-printable

Hi Oza,

> On Apr 3, 2017, at 2:01 AM, Oza Oza <oza.oza(a)broadcom.com> wrote:
> =

> I have ported SPDK for ARMv8.

Great!  Do you have patches that you can share?

> And DPDK is compiled with version: 16.11.1
> =

> init controller is failing.

Does this mean that the previous issue you reported on April 1 has been res=
olved?  If so, can you share details?

> =

> root(a)ubuntu:/home/oza/SPDK/spdk#
> odepth=3D128 --size=3D4G --readwrite=3Dread --filename=3D0000.01.00.00/1 =
--bs=3D4096
> --i
> /home/oza/fio /home/oza/SPDK/spdk
> EAL: pci driver is being registered 0x1nreadtest: (g=3D0): rw=3Dread,
> bs=3D4096B-4096B,4096B-4096B,4096B-4096B, ioengine=3Dspdk_fio, iodepth=3D=
128
> fio-2.17-29-gf0ac1
> Starting 1 process
> Starting Intel(R) DPDK initialization ...
> [ DPDK EAL parameters: fio -c 1 --file-prefix=3Dspdk_pid6448
> --base-virtaddr=3D0x1000000000 --proc-type=3Dauto ]
> EAL: Detected 8 lcore(s)
> EAL: Auto-detected process type: PRIMARY
> EAL: Probing VFIO support...
> EAL: VFIO support initialized
> EAL: cannot open /proc/self/numa_maps, consider that all memory is in
> socket_id 0
> EAL: PCI device 0000:01:00.0 on NUMA socket 0
> EAL:   probe driver: 8086:953 spdk_nvme
> EAL:   using IOMMU type 1 (Type 1)
> EAL: vfio_group_fd=3D11 iommu_group_no=3D3 *vfio_dev_fd=3D13
> EAL: reg=3D0x2000 fd=3D13 cap_offset=3D0x50
> EAL: the msi-x bar number is 0 0x2000 0x200
> EAL: Hotplug doesn't support vfio yet
> spdk_fio_setup() is being called
> EAL: PCI device 0000:01:00.0 on NUMA socket 0
> EAL:   probe driver: 8086:953 spdk_nvme
> EAL: vfio_group_fd=3D11 iommu_group_no=3D3 *vfio_dev_fd=3D16
> EAL: reg=3D0x2000 fd=3D16 cap_offset=3D0x50
> EAL: the msi-x bar number is 0 0x2000 0x200
> EAL: inside pci_vfio_write_config offset=3D4
> nvme_ctrlr.c:1224:nvme_ctrlr_process_init: ***ERROR*** Initialization
> timed out in state 3
> nvme_ctrlr.c: 403:nvme_ctrlr_shutdown: ***ERROR*** did not shutdown within
> 5 seconds

I think this is where seeing your ARMv8 patches would help.  Then we could =
collaborate on if/how the ARMv8 changes you have made may be causing the in=
itialization error.

> EAL: Hotplug doesn't support vfio yet
> EAL: PCI device 0000:01:00.0 on NUMA socket 0
> EAL:   probe driver: 8086:953 spdk_nvme
> EAL: vfio_group_fd=3D11 iommu_group_no=3D3 *vfio_dev_fd=3D18
> EAL: reg=3D0x2000 fd=3D18 cap_offset=3D0x50
> EAL: the msi-x bar number is 0 0x2000 0x200
> EAL: Hotplug doesn't support vfio yet
> EAL: Requested device 0000:01:00.0 cannot be used
> spdk_nvme_probe() failed

Thanks,

-Jim


--===============8824429295081858397==--