public inbox for linux-rdma@vger.kernel.org
 help / color / mirror / Atom feed
From: Vladislav Bolkhovitin <vst-d+Crzxg7Rs0@public.gmane.org>
To: Chris Worley <worleys-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
	scst-devel
	<scst-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org>,
	OpenIB
	<general-ZwoEplunGu1OwGhvXhtEPSCwEArCW2h5@public.gmane.org>
Subject: Re: [Scst-devel] [ofa-general] WinOF_2_0_5/SRP initiator: slow	reads and eventually hangs
Date: Tue, 15 Sep 2009 20:39:06 +0400	[thread overview]
Message-ID: <4AAFC32A.5050003@vlnb.net> (raw)
In-Reply-To: <f3177b9e0909141603j2dc61663j4c6bbcc0dda631d4-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>

Chris Worley, on 09/15/2009 03:03 AM wrote:
> On Mon, Sep 14, 2009 at 12:51 PM, Vladislav Bolkhovitin <vst-d+Crzxg7Rs0@public.gmane.org> wrote:
>> Chris Worley, on 09/11/2009 11:50 PM wrote:
>>> I've definitely removed the switch/firmware from being the cause.
>>>
>>> I'm thinking the reason you can't repeat the test may be latency
>>> related.  We get ~50usecs average latency (on small block sizes),
>>> which can't be achieved using regular SSD's (and rotating drives are
>>> nowhere close).  Maybe a ramdisk would help repeat the issue.
>> I think you should try to reproduce the problem with ramdisk or nullio. By
>> so you will eliminate possible influence of the SSD backend.
> 
> W/ 12GB RAM in the target, I created a 7GB ramdisk:
> 
> mount -t ramfs -o size=7g ramfs /mnt/
> dd if=/dev/zero of=/mnt/foo bs=1024k count=7000
> echo "open ramdisk /mnt/foo" > /proc/scsi_tgt/vdisk/vdisk
> echo "add ramdisk 2" >/proc/scsi_tgt/groups/Default/devices
> 
> Then, on the initiator, I tested it... and it hung during sequential
> 8KB block reads:
> 
> fio --rw=read --bs=8k --numjobs=64 --iodepth=64 --sync=0 --direct=1
> --randrepeat=0 \
>    --group_reporting --ioengine=libaio --filename=/dev/sde --name=test
> --loops=10000 --runtime=600
> 
> Note that I was running the SM on the target this time too.

Should you try then with iSCSI with IPoIB? It will eliminate the SRP stack.

> Thanks,
> 
> Chris
>> Vlad
>>
> 
> ------------------------------------------------------------------------------
> Come build with us! The BlackBerry&reg; Developer Conference in SF, CA
> is the only developer event you need to attend this year. Jumpstart your
> developing skills, take BlackBerry mobile applications to market and stay 
> ahead of the curve. Join us from November 9&#45;12, 2009. Register now&#33;
> http://p.sf.net/sfu/devconf
> _______________________________________________
> Scst-devel mailing list
> Scst-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org
> https://lists.sourceforge.net/lists/listinfo/scst-devel
> 

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

  parent reply	other threads:[~2009-09-15 16:39 UTC|newest]

Thread overview: 22+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <f3177b9e0908091009x23813cbdq4fbd9ebe6d8e174f@mail.gmail.com>
     [not found] ` <f3177b9e0909022108uc826c3ct3db0ae7bfa2c8128@mail.gmail.com>
     [not found]   ` <4A9FA945.4070408@vlnb.net>
     [not found]     ` <f3177b9e0909031038s22f0a1bg401629d4208fd82@mail.gmail.com>
     [not found]       ` <f3177b9e0909031620i10db945ep69ddc36a7044334a@mail.gmail.com>
     [not found]         ` <e2e108260909060617y13a1ded8jd6686d02521ecb4@mail.gmail.com>
     [not found]           ` <f3177b9e0909060636k6e293c06la3dfe9f929da4915@mail.gmail.com>
     [not found]             ` <f3177b9e0909060641i296c7aefp322712f52de9786a@mail.gmail.com>
     [not found]               ` <4AA4F561.504@vlnb.net>
     [not found]                 ` <f3177b9e0909081529i4dd74faq9a6c5a4783b5ded4@mail.gmail.com>
     [not found]                   ` <f3177b9e0909081529i4dd74faq9a6c5a4783b5ded4-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2009-09-09 16:38                     ` [Scst-devel] [ofa-general] WinOF_2_0_5/SRP initiator: slow reads and eventually hangs Bart Van Assche
     [not found]                       ` <e2e108260909090938x6b72c519teed7dfd280eac804-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2009-09-11 19:50                         ` Chris Worley
     [not found]                           ` <f3177b9e0909111250w159def51h9b720366e27fa3a7-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2009-09-12 15:24                             ` Bart Van Assche
2009-09-14 18:51                             ` Vladislav Bolkhovitin
     [not found]                               ` <4AAE909F.6030202-d+Crzxg7Rs0@public.gmane.org>
2009-09-14 23:03                                 ` Chris Worley
     [not found]                                   ` <f3177b9e0909141603j2dc61663j4c6bbcc0dda631d4-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2009-09-15  6:10                                     ` Bart Van Assche
     [not found]                                       ` <e2e108260909142310vb353718uea99d50ab638a865-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2009-09-15 15:50                                         ` Chris Worley
     [not found]                                           ` <f3177b9e0909150850r2d0f5e15id7f4e14b015f68ed-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2009-09-15 16:43                                             ` Vladislav Bolkhovitin
2009-09-15 16:53                                               ` Chris Worley
     [not found]                                                 ` <f3177b9e0909150953x11d19210mf07cbdcc57928d42-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2009-09-15 16:57                                                   ` Vladislav Bolkhovitin
2009-09-15 17:01                                                     ` Chris Worley
2009-09-15 17:10                                                       ` Vladislav Bolkhovitin
     [not found]                                                         ` <4AAFCA77.6050305-d+Crzxg7Rs0@public.gmane.org>
2009-09-15 20:51                                                           ` Chris Worley
     [not found]                                                             ` <f3177b9e0909151351p12173c78oe01cc8bcca957550-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2009-09-16  7:03                                                               ` Bart Van Assche
2009-09-16 15:11                                                                 ` Chris Worley
2009-09-16 18:15                                                               ` Vladislav Bolkhovitin
     [not found]                                                                 ` <4AB12B40.9050902-d+Crzxg7Rs0@public.gmane.org>
2009-09-16 19:41                                                                   ` Chris Worley
     [not found]                                                                     ` <f3177b9e0909161241h89dabdbybaf98edc5b10f735-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2009-09-17 10:22                                                                       ` Bart Van Assche
2009-09-16  6:38                                             ` Bart Van Assche
2009-09-16  6:42                                             ` Bart Van Assche
2009-09-15 16:39                                     ` Vladislav Bolkhovitin [this message]
2009-09-15 16:52                                       ` Chris Worley

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4AAFC32A.5050003@vlnb.net \
    --to=vst-d+crzxg7rs0@public.gmane.org \
    --cc=general-ZwoEplunGu1OwGhvXhtEPSCwEArCW2h5@public.gmane.org \
    --cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=scst-devel-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org \
    --cc=worleys-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox