From: Ming Zhang <blackmagic02881@gmail.com>
To: "BERTRAND Joël" <joel.bertrand@systella.fr>
Cc: iscsitarget-devel@lists.sourceforge.net, linux-raid@vger.kernel.org
Subject: Re: Abort Task ?
Date: Fri, 19 Oct 2007 10:37:39 -0400 [thread overview]
Message-ID: <1192804659.3593.7.camel@dhcp-117.ibrix.com> (raw)
In-Reply-To: <4718BF6A.6080905@systella.fr>
On Fri, 2007-10-19 at 16:30 +0200, BERTRAND Joël wrote:
> Ming Zhang wrote:
> > On Fri, 2007-10-19 at 09:48 +0200, BERTRAND Joël wrote:
> >> Ross S. W. Walker wrote:
> >>> BERTRAND Joël wrote:
> >>>> BERTRAND Joël wrote:
> >>>>> I can format serveral times (mkfs.ext3) a 1.5 TB volume
> >>>> over iSCSI
> >>>>> without any trouble. I can read and write on this virtual
> >>>> disk without
> >>>>> any trouble.
> >>>>>
> >>>>> Now, I have configured ietd with :
> >>>>>
> >>>>> Lun 0 Sectors=1464725758,Type=nullio
> >>>>>
> >>>>> and I run on initiator side :
> >>>>>
> >>>>> Root gershwin:[/dev] > dd if=/dev/zero of=/dev/sdj bs=8192
> >>>>> 479482+0 records in
> >>>>> 479482+0 records out
> >>>>> 3927916544 bytes (3.9 GB) copied, 153.222 seconds, 25.6 MB/s
> >>>>>
> >>>>> Root gershwin:[/dev] > dd if=/dev/zero of=/dev/sdj bs=8192
> >>>>>
> >>>>> I'm waitinfor a crash. No one when I write these lines.
> >>>> I suspect
> >>>>> an interaction between raid and iscsi.
> >>>> I simultanely run :
> >>>>
> >>>> Root gershwin:[/dev] > dd if=/dev/zero of=/dev/sdj bs=8192
> >>>> 8397210+0 records in
> >>>> 8397210+0 records out
> >>>> 68789944320 bytes (69 GB) copied, 2732.55 seconds, 25.2 MB/s
> >>>>
> >>>> and
> >>>>
> >>>> Root gershwin:[~] > dd if=/dev/sdj of=/dev/null bs=8192
> >>>> 739200+0 records in
> >>>> 739199+0 records out
> >>>> 6055518208 bytes (6.1 GB) copied, 447.178 seconds, 13.5 MB/s
> >>>>
> >>>> without any trouble.
> >>> The speed can definitely be improved. Look at your network setup
> >>> and use ping to try and get the network latency to a minimum.
> >>>
> >>> # ping -A -s 8192 172.16.24.140
> >>> ....
> >>> --- 172.16.24.140 ping statistics ---
> >>> 14058 packets transmitted, 14057 received, 0% packet loss, time 9988ms
> >>> rtt min/avg/max/mdev = 0.234/0.268/2.084/0.041 ms, ipg/ewma 0.710/0.260 ms
> >> gershwin:[~] > ping -A -s 8192 192.168.0.2
> >> PING 192.168.0.2 (192.168.0.2) 8192(8220) bytes of data.
> >> 8200 bytes from 192.168.0.2: icmp_seq=1 ttl=64 time=0.693 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=2 ttl=64 time=0.595 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=3 ttl=64 time=0.583 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=4 ttl=64 time=0.589 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=5 ttl=64 time=0.580 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=6 ttl=64 time=0.594 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=7 ttl=64 time=0.580 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=8 ttl=64 time=0.592 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=9 ttl=64 time=0.589 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=10 ttl=64 time=0.571 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=11 ttl=64 time=0.588 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=12 ttl=64 time=0.580 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=13 ttl=64 time=0.587 ms
> >>
> >> --- 192.168.0.2 ping statistics ---
> >> 13 packets transmitted, 13 received, 0% packet loss, time 2400ms
> >> rtt min/avg/max/mdev = 0.571/0.593/0.693/0.044 ms, ipg/ewma 200.022/0.607 ms
> >> gershwin:[~] >
> >>
> >> Both initiator and target are alone on a gigabit NIC (Tigon3). On
> >> target server, istd1 takes 100% of a CPU (and only one CPU, even my
> >> T1000 can simultaneous run 32 threads). I think the limitation comes
> >> from istd1.
> >
> > usually istdx will not take 100% cpu with 1G network, especially when
> > using disk as back storage, some kind of profiling work might be helpful
> > to tell what happened...
> >
> > forgot to ask, your sparc64 platform cpu spec.
>
> Root gershwin:[/mnt/solaris] > cat /proc/cpuinfo
> cpu : UltraSparc T1 (Niagara)
> fpu : UltraSparc T1 integrated FPU
> prom : OBP 4.23.4 2006/08/04 20:45
> type : sun4v
> ncpus probed : 24
> ncpus active : 24
> D$ parity tl1 : 0
> I$ parity tl1 : 0
>
> Both servers are built with 1 GHz T1 processors (6 cores, 24 threads).
>
as Ross pointed out, many io pattern only have 1 outstanding io at any
time, so there is only one work thread actively to serve it. so it can
not exploit the multiple core here.
you see 100% at nullio or fileio? with disk, most time should spend on
iowait and cpu utilization should not high at all.
> Regards,
>
> JKB
--
Ming Zhang
@#$%^ purging memory... (*!%
http://blackmagic02881.wordpress.com/
http://www.linkedin.com/in/blackmagic02881
--------------------------------------------
-------------------------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems? Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >> http://get.splunk.com/
_______________________________________________
Iscsitarget-devel mailing list
Iscsitarget-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/iscsitarget-devel
next prev parent reply other threads:[~2007-10-19 14:37 UTC|newest]
Thread overview: 13+ messages / expand[flat|nested] mbox.gz Atom feed top
[not found] <471720F1.40409@systella.fr>
[not found] ` <471727F3.2080500@systella.fr>
[not found] ` <471734C5.8090405@systella.fr>
[not found] ` <E2BB8074E5500C42984D980D4BD78EF9017A2958@MFG-NYC-EXCH2.mfg.prv>
[not found] ` <1192721909.3596.15.camel@dhcp-117.ibrix.com>
2007-10-18 16:33 ` Abort Task ? BERTRAND Joël
2007-10-18 17:14 ` BERTRAND Joël
2007-10-18 21:03 ` Ross S. W. Walker
2007-10-18 21:35 ` [Iscsitarget-devel] " Ming Zhang
2007-10-19 7:48 ` BERTRAND Joël
2007-10-19 13:55 ` Ming Zhang
2007-10-19 14:30 ` BERTRAND Joël
2007-10-19 14:37 ` Ming Zhang [this message]
2007-10-19 14:47 ` BERTRAND Joël
2007-10-19 14:53 ` Ming Zhang
2007-10-19 14:51 ` [Iscsitarget-devel] " Ross S. W. Walker
2007-10-18 17:30 ` Ming Zhang
2007-10-19 12:25 Ross S. W. Walker
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1192804659.3593.7.camel@dhcp-117.ibrix.com \
--to=blackmagic02881@gmail.com \
--cc=iscsitarget-devel@lists.sourceforge.net \
--cc=joel.bertrand@systella.fr \
--cc=linux-raid@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.