From: Ming Zhang <blackmagic02881@gmail.com>
To: "BERTRAND Joël" <joel.bertrand@systella.fr>
Cc: iscsitarget-devel@lists.sourceforge.net, linux-raid@vger.kernel.org
Subject: Re: Abort Task ?
Date: Fri, 19 Oct 2007 10:37:39 -0400 [thread overview]
Message-ID: <1192804659.3593.7.camel@dhcp-117.ibrix.com> (raw)
In-Reply-To: <4718BF6A.6080905@systella.fr>
On Fri, 2007-10-19 at 16:30 +0200, BERTRAND Joël wrote:
> Ming Zhang wrote:
> > On Fri, 2007-10-19 at 09:48 +0200, BERTRAND Joël wrote:
> >> Ross S. W. Walker wrote:
> >>> BERTRAND Joël wrote:
> >>>> BERTRAND Joël wrote:
> >>>>> I can format serveral times (mkfs.ext3) a 1.5 TB volume
> >>>> over iSCSI
> >>>>> without any trouble. I can read and write on this virtual
> >>>> disk without
> >>>>> any trouble.
> >>>>>
> >>>>> Now, I have configured ietd with :
> >>>>>
> >>>>> Lun 0 Sectors=1464725758,Type=nullio
> >>>>>
> >>>>> and I run on initiator side :
> >>>>>
> >>>>> Root gershwin:[/dev] > dd if=/dev/zero of=/dev/sdj bs=8192
> >>>>> 479482+0 records in
> >>>>> 479482+0 records out
> >>>>> 3927916544 bytes (3.9 GB) copied, 153.222 seconds, 25.6 MB/s
> >>>>>
> >>>>> Root gershwin:[/dev] > dd if=/dev/zero of=/dev/sdj bs=8192
> >>>>>
> >>>>> I'm waitinfor a crash. No one when I write these lines.
> >>>> I suspect
> >>>>> an interaction between raid and iscsi.
> >>>> I simultanely run :
> >>>>
> >>>> Root gershwin:[/dev] > dd if=/dev/zero of=/dev/sdj bs=8192
> >>>> 8397210+0 records in
> >>>> 8397210+0 records out
> >>>> 68789944320 bytes (69 GB) copied, 2732.55 seconds, 25.2 MB/s
> >>>>
> >>>> and
> >>>>
> >>>> Root gershwin:[~] > dd if=/dev/sdj of=/dev/null bs=8192
> >>>> 739200+0 records in
> >>>> 739199+0 records out
> >>>> 6055518208 bytes (6.1 GB) copied, 447.178 seconds, 13.5 MB/s
> >>>>
> >>>> without any trouble.
> >>> The speed can definitely be improved. Look at your network setup
> >>> and use ping to try and get the network latency to a minimum.
> >>>
> >>> # ping -A -s 8192 172.16.24.140
> >>> ....
> >>> --- 172.16.24.140 ping statistics ---
> >>> 14058 packets transmitted, 14057 received, 0% packet loss, time 9988ms
> >>> rtt min/avg/max/mdev = 0.234/0.268/2.084/0.041 ms, ipg/ewma 0.710/0.260 ms
> >> gershwin:[~] > ping -A -s 8192 192.168.0.2
> >> PING 192.168.0.2 (192.168.0.2) 8192(8220) bytes of data.
> >> 8200 bytes from 192.168.0.2: icmp_seq=1 ttl=64 time=0.693 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=2 ttl=64 time=0.595 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=3 ttl=64 time=0.583 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=4 ttl=64 time=0.589 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=5 ttl=64 time=0.580 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=6 ttl=64 time=0.594 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=7 ttl=64 time=0.580 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=8 ttl=64 time=0.592 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=9 ttl=64 time=0.589 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=10 ttl=64 time=0.571 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=11 ttl=64 time=0.588 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=12 ttl=64 time=0.580 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=13 ttl=64 time=0.587 ms
> >>
> >> --- 192.168.0.2 ping statistics ---
> >> 13 packets transmitted, 13 received, 0% packet loss, time 2400ms
> >> rtt min/avg/max/mdev = 0.571/0.593/0.693/0.044 ms, ipg/ewma 200.022/0.607 ms
> >> gershwin:[~] >
> >>
> >> Both initiator and target are alone on a gigabit NIC (Tigon3). On
> >> target server, istd1 takes 100% of a CPU (and only one CPU, even my
> >> T1000 can simultaneous run 32 threads). I think the limitation comes
> >> from istd1.
> >
> > usually istdx will not take 100% cpu with 1G network, especially when
> > using disk as back storage, some kind of profiling work might be helpful
> > to tell what happened...
> >
> > forgot to ask, your sparc64 platform cpu spec.
>
> Root gershwin:[/mnt/solaris] > cat /proc/cpuinfo
> cpu : UltraSparc T1 (Niagara)
> fpu : UltraSparc T1 integrated FPU
> prom : OBP 4.23.4 2006/08/04 20:45
> type : sun4v
> ncpus probed : 24
> ncpus active : 24
> D$ parity tl1 : 0
> I$ parity tl1 : 0
>
> Both servers are built with 1 GHz T1 processors (6 cores, 24 threads).
>
as Ross pointed out, many io pattern only have 1 outstanding io at any
time, so there is only one work thread actively to serve it. so it can
not exploit the multiple core here.
you see 100% at nullio or fileio? with disk, most time should spend on
iowait and cpu utilization should not high at all.
> Regards,
>
> JKB
--
Ming Zhang
@#$%^ purging memory... (*!%
http://blackmagic02881.wordpress.com/
http://www.linkedin.com/in/blackmagic02881
--------------------------------------------
-------------------------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >> http://get.splunk.com/
_______________________________________________
Iscsitarget-devel mailing list
Iscsitarget-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/iscsitarget-devel
next prev parent reply other threads:[~2007-10-19 14:37 UTC|newest]
Thread overview: 13+ messages / expand[flat|nested] mbox.gz Atom feed top
[not found] <471720F1.40409@systella.fr>
[not found] ` <471727F3.2080500@systella.fr>
[not found] ` <471734C5.8090405@systella.fr>
[not found] ` <E2BB8074E5500C42984D980D4BD78EF9017A2958@MFG-NYC-EXCH2.mfg.prv>
[not found] ` <1192721909.3596.15.camel@dhcp-117.ibrix.com>
2007-10-18 16:33 ` Abort Task ? BERTRAND Joël
2007-10-18 17:14 ` BERTRAND Joël
2007-10-18 21:03 ` Ross S. W. Walker
2007-10-18 21:35 ` [Iscsitarget-devel] " Ming Zhang
2007-10-19 7:48 ` BERTRAND Joël
2007-10-19 13:55 ` Ming Zhang
2007-10-19 14:30 ` BERTRAND Joël
2007-10-19 14:37 ` Ming Zhang [this message]
2007-10-19 14:47 ` BERTRAND Joël
2007-10-19 14:53 ` Ming Zhang
2007-10-19 14:51 ` [Iscsitarget-devel] " Ross S. W. Walker
2007-10-18 17:30 ` Ming Zhang
2007-10-19 12:25 Ross S. W. Walker
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1192804659.3593.7.camel@dhcp-117.ibrix.com \
--to=blackmagic02881@gmail.com \
--cc=iscsitarget-devel@lists.sourceforge.net \
--cc=joel.bertrand@systella.fr \
--cc=linux-raid@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).