From mboxrd@z Thu Jan  1 00:00:00 1970
Content-Type: multipart/mixed; boundary="===============8532328464411785419=="
MIME-Version: 1.0
From: Verkamp, Daniel <daniel.verkamp at intel.com>
Subject: Re: [SPDK] using nvmf target/initiator in spdk
Date: Tue, 09 Aug 2016 21:16:07 +0000
Message-ID: <1470777365.40000.38.camel@intel.com>
In-Reply-To: 149d3d0c6423c829f50a4cd48b3ea8c4@mail.gmail.com
List-ID: <spdk@lists.01.org>
To: spdk@lists.01.org

--===============8532328464411785419==
Content-Type: text/plain; charset="utf-8"
MIME-Version: 1.0
Content-Transfer-Encoding: quoted-printable

Hi,

Splitting off just the I/OAT question (see below).

On Tue, 2016-08-09 at 11:26 +0530, Kirubakaran Kaliannan wrote:
> Hi,
> =

> 1)
> After following the steps in the document to configure the SPDK, I
> verify it
> by running the command
> /examples/ioat/verify/verify, and I get the following message. Is this
> expected ?
> =

> ----------------------------------------------------------------------
> ---
> EAL: Requesting 512 pages of size 2MB from socket 0
> EAL: Requesting 512 pages of size 2MB from socket 1
> EAL: TSC frequency is ~2400080 KHz
> EAL: Master lcore 0 is ready (tid=3D2fc3c900;cpuset=3D[0])
> User configuration:
> Run time:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A010 seconds
> Core mask:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A00x1
> Queue depth:=C2=A0=C2=A0=C2=A0=C2=A032
> =

> Not enough ioat channels found. Check that ioatdma driver is unloaded.
> <=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
> =

> # lsmod | grep ioat
> ioatdma=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A052511=C2=A0=C2=A00
> dca=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A015130=C2=A0=C2=A01 ioatd=
ma

What CPU/chipset are you using for this test?

Can you verify that you see some I/OAT devices in lspci? If you use
`lspci -vn`, they should show up something like:

00:04.0 0880: 8086:2f20 (rev 02)
[...]
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0Kernel driver in use: uio_p=
ci_generic
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0Kernel modules: ioatdma

You can find them based on the ioatdma module or by checking against the
list in lib/ioat/ioat_pci.h.

Any DMA channels you want to use must be unbound from the Linux kernel
ioatdma driver, either by totally unloading it (rmmod ioatdma) or by
using something like scripts/setup.sh to selectively change the driver
for specific devices.

Thanks,
-- Daniel

--===============8532328464411785419==--