From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mx1.redhat.com (ext-mx10.extmail.prod.ext.phx2.redhat.com [10.5.110.39]) by int-mx13.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id v1H11nLx005249 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Thu, 16 Feb 2017 20:01:49 -0500 Received: from Ishtar.sc.tlinx.org (ishtar.tlinx.org [173.164.175.65]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id 5AFDA61BA5 for ; Fri, 17 Feb 2017 01:01:48 +0000 (UTC) Received: from [192.168.3.12] (Athenae [192.168.3.12]) by Ishtar.sc.tlinx.org (8.14.7/8.14.4/SuSE Linux 0.8) with ESMTP id v1H0iaF6065364 for ; Thu, 16 Feb 2017 16:44:38 -0800 Message-ID: <58A64774.10004@tlinx.org> Date: Thu, 16 Feb 2017 16:44:36 -0800 From: L A Walsh MIME-Version: 1.0 References: <324484744.226.1486803542791.JavaMail.zimbra@karlsbakk.net> <1269016789.1015.1487269373950.JavaMail.zimbra@karlsbakk.net> In-Reply-To: <1269016789.1015.1487269373950.JavaMail.zimbra@karlsbakk.net> Content-Transfer-Encoding: 7bit Subject: Re: [linux-lvm] pvmove speed Reply-To: LVM general discussion and development List-Id: LVM general discussion and development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , List-Id: Content-Type: text/plain; charset="us-ascii"; format="flowed" To: LVM general discussion and development Roy Sigurd Karlsbakk wrote: >> I'm doing pvmove of some rather large volumes from a Dell Equallogic system to >> Dell Compellent. Both are connected on iSCSI .... ---- I've never had very great speeds over a network. I've gotten the impression that iSCSI is slower than some other network protocols. Locally (RAID=>RAID) I got about 400-500MB/s, but the best I've gotten, recently, over a 10Gb network card has been about 200MB/s. Oddly, when I first got the cards, I was getting up to 400-600MB/s, but after MS started pushing Win10 and "updates" to Win7 (my communication has been between Win7SP1<->linux server), my speed dropped to barely over 100MB/s which is about what I got with a 1Gb card. I wasn't able to get any better speeds using *windows* single-threaded SMB proto even using 2x10Gb (have a dedicated link tween workstation and server) -- but I did notice the cpu maxing out on either the windows or the Samba side depending on packet size and who was doing the sending. 50MB sounds awfully slow, but not out of the ballpark -- I had benched a few NAS solutions @ home, but could rarely get about 10MB/s (usually slower), so gave up on those and went w/a linux server -- but still alot slower than I'd like (100-200MB/s sustained, but those figures may change w/the next MS "update"). But gave up on commercial, out-of-the-box solutions, and the 4x1Gb connect you have may be costing you more cpu than its worth... Problem I noted on 2x10G was too many duplicate packets -- so running 1x10Gb now but still maxing out around 200MB/s over an unencrypted SMB/CIFS session. I'm not sure it could be an LVM problem given its local speed for pvmoves -- do you have some measurement of faster file I/O throughput using iSCSI over your connections?