linux-raid.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Ming Zhang <blackmagic02881@gmail.com>
To: "BERTRAND Joël" <joel.bertrand@systella.fr>
Cc: iscsitarget-devel@lists.sourceforge.net, linux-raid@vger.kernel.org
Subject: Re: Abort Task ?
Date: Fri, 19 Oct 2007 10:37:39 -0400	[thread overview]
Message-ID: <1192804659.3593.7.camel@dhcp-117.ibrix.com> (raw)
In-Reply-To: <4718BF6A.6080905@systella.fr>

On Fri, 2007-10-19 at 16:30 +0200, BERTRAND Joël wrote:
> Ming Zhang wrote:
> > On Fri, 2007-10-19 at 09:48 +0200, BERTRAND Joël wrote:
> >> Ross S. W. Walker wrote:
> >>> BERTRAND Joël wrote:
> >>>> BERTRAND Joël wrote:
> >>>>>     I can format serveral times (mkfs.ext3) a 1.5 TB volume 
> >>>> over iSCSI 
> >>>>> without any trouble. I can read and write on this virtual 
> >>>> disk without 
> >>>>> any trouble.
> >>>>>
> >>>>>     Now, I have configured ietd with :
> >>>>>
> >>>>> Lun 0 Sectors=1464725758,Type=nullio
> >>>>>
> >>>>> and I run on initiator side :
> >>>>>
> >>>>> Root gershwin:[/dev] > dd if=/dev/zero of=/dev/sdj bs=8192
> >>>>> 479482+0 records in
> >>>>> 479482+0 records out
> >>>>> 3927916544 bytes (3.9 GB) copied, 153.222 seconds, 25.6 MB/s
> >>>>>
> >>>>> Root gershwin:[/dev] > dd if=/dev/zero of=/dev/sdj bs=8192
> >>>>>
> >>>>>     I'm waitinfor a crash. No one when I write these lines. 
> >>>>    I suspect 
> >>>>> an interaction between raid and iscsi.
> >>>> 	I simultanely run :
> >>>>
> >>>> Root gershwin:[/dev] > dd if=/dev/zero of=/dev/sdj bs=8192
> >>>> 8397210+0 records in
> >>>> 8397210+0 records out
> >>>> 68789944320 bytes (69 GB) copied, 2732.55 seconds, 25.2 MB/s
> >>>>
> >>>> and
> >>>>
> >>>> Root gershwin:[~] > dd if=/dev/sdj of=/dev/null bs=8192
> >>>> 739200+0 records in
> >>>> 739199+0 records out
> >>>> 6055518208 bytes (6.1 GB) copied, 447.178 seconds, 13.5 MB/s
> >>>>
> >>>> 	without any trouble.
> >>> The speed can definitely be improved. Look at your network setup
> >>> and use ping to try and get the network latency to a minimum.
> >>>
> >>> # ping -A -s 8192 172.16.24.140
> >>> ....
> >>> --- 172.16.24.140 ping statistics ---
> >>> 14058 packets transmitted, 14057 received, 0% packet loss, time 9988ms
> >>> rtt min/avg/max/mdev = 0.234/0.268/2.084/0.041 ms, ipg/ewma 0.710/0.260 ms
> >> gershwin:[~] > ping -A -s 8192 192.168.0.2
> >> PING 192.168.0.2 (192.168.0.2) 8192(8220) bytes of data.
> >> 8200 bytes from 192.168.0.2: icmp_seq=1 ttl=64 time=0.693 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=2 ttl=64 time=0.595 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=3 ttl=64 time=0.583 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=4 ttl=64 time=0.589 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=5 ttl=64 time=0.580 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=6 ttl=64 time=0.594 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=7 ttl=64 time=0.580 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=8 ttl=64 time=0.592 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=9 ttl=64 time=0.589 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=10 ttl=64 time=0.571 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=11 ttl=64 time=0.588 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=12 ttl=64 time=0.580 ms
> >> 8200 bytes from 192.168.0.2: icmp_seq=13 ttl=64 time=0.587 ms
> >>
> >> --- 192.168.0.2 ping statistics ---
> >> 13 packets transmitted, 13 received, 0% packet loss, time 2400ms
> >> rtt min/avg/max/mdev = 0.571/0.593/0.693/0.044 ms, ipg/ewma 200.022/0.607 ms
> >> gershwin:[~] >
> >>
> >> 	Both initiator and target are alone on a gigabit NIC (Tigon3). On 
> >> target server, istd1 takes 100% of a CPU (and only one CPU, even my 
> >> T1000 can simultaneous run 32 threads). I think the limitation comes 
> >> from istd1.
> > 
> > usually istdx will not take 100% cpu with 1G network, especially when
> > using disk as back storage, some kind of profiling work might be helpful
> > to tell what happened...
> > 
> > forgot to ask, your sparc64 platform cpu spec.
> 
> Root gershwin:[/mnt/solaris] > cat /proc/cpuinfo
> cpu             : UltraSparc T1 (Niagara)
> fpu             : UltraSparc T1 integrated FPU
> prom            : OBP 4.23.4 2006/08/04 20:45
> type            : sun4v
> ncpus probed    : 24
> ncpus active    : 24
> D$ parity tl1   : 0
> I$ parity tl1   : 0
> 
> 	Both servers are built with 1 GHz T1 processors (6 cores, 24 threads).
> 

as Ross pointed out, many io pattern only have 1 outstanding io at any
time, so there is only one work thread actively to serve it. so it can
not exploit the multiple core here.


you see 100% at nullio or fileio? with disk, most time should spend on
iowait and cpu utilization should not high at all.


 
> 	Regards,
> 
> 	JKB
-- 
Ming Zhang


@#$%^ purging memory... (*!%
http://blackmagic02881.wordpress.com/
http://www.linkedin.com/in/blackmagic02881
--------------------------------------------


-------------------------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >> http://get.splunk.com/
_______________________________________________
Iscsitarget-devel mailing list
Iscsitarget-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/iscsitarget-devel

  reply	other threads:[~2007-10-19 14:37 UTC|newest]

Thread overview: 13+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <471720F1.40409@systella.fr>
     [not found] ` <471727F3.2080500@systella.fr>
     [not found]   ` <471734C5.8090405@systella.fr>
     [not found]     ` <E2BB8074E5500C42984D980D4BD78EF9017A2958@MFG-NYC-EXCH2.mfg.prv>
     [not found]       ` <1192721909.3596.15.camel@dhcp-117.ibrix.com>
2007-10-18 16:33         ` Abort Task ? BERTRAND Joël
2007-10-18 17:14           ` BERTRAND Joël
2007-10-18 21:03             ` Ross S. W. Walker
2007-10-18 21:35               ` [Iscsitarget-devel] " Ming Zhang
2007-10-19  7:48               ` BERTRAND Joël
2007-10-19 13:55                 ` Ming Zhang
2007-10-19 14:30                   ` BERTRAND Joël
2007-10-19 14:37                     ` Ming Zhang [this message]
2007-10-19 14:47                       ` BERTRAND Joël
2007-10-19 14:53                         ` Ming Zhang
2007-10-19 14:51                       ` [Iscsitarget-devel] " Ross S. W. Walker
2007-10-18 17:30           ` Ming Zhang
2007-10-19 12:25 Ross S. W. Walker

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1192804659.3593.7.camel@dhcp-117.ibrix.com \
    --to=blackmagic02881@gmail.com \
    --cc=iscsitarget-devel@lists.sourceforge.net \
    --cc=joel.bertrand@systella.fr \
    --cc=linux-raid@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).