Re: [SPDK] using nvmf target/initiator in spdk

[Verkamp, Daniel <daniel.verkamp at intel.com>]

[-- Attachment #1: Type: text/plain, Size: 1666 bytes --]

Hi,

Splitting off just the I/OAT question (see below).

On Tue, 2016-08-09 at 11:26 +0530, Kirubakaran Kaliannan wrote:
> Hi,
> 
> 1)
> After following the steps in the document to configure the SPDK, I
> verify it
> by running the command
> /examples/ioat/verify/verify, and I get the following message. Is this
> expected ?
> 
> ----------------------------------------------------------------------
> ---
> EAL: Requesting 512 pages of size 2MB from socket 0
> EAL: Requesting 512 pages of size 2MB from socket 1
> EAL: TSC frequency is ~2400080 KHz
> EAL: Master lcore 0 is ready (tid=2fc3c900;cpuset=[0])
> User configuration:
> Run time:       10 seconds
> Core mask:      0x1
> Queue depth:    32
> 
> Not enough ioat channels found. Check that ioatdma driver is unloaded.
> <================
> 
> # lsmod | grep ioat
> ioatdma                52511  0
> dca                    15130  1 ioatdma

What CPU/chipset are you using for this test?

Can you verify that you see some I/OAT devices in lspci? If you use
`lspci -vn`, they should show up something like:

00:04.0 0880: 8086:2f20 (rev 02)
[...]
        Kernel driver in use: uio_pci_generic
        Kernel modules: ioatdma

You can find them based on the ioatdma module or by checking against the
list in lib/ioat/ioat_pci.h.

Any DMA channels you want to use must be unbound from the Linux kernel
ioatdma driver, either by totally unloading it (rmmod ioatdma) or by
using something like scripts/setup.sh to selectively change the driver
for specific devices.

Thanks,
-- Daniel