From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mxintern.schlund.de (mxintern.schlund.de [212.227.126.205]) by mail.saout.de (Postfix) with ESMTP for ; Thu, 18 Nov 2010 00:46:43 +0100 (CET) Received: from [10.2.3.44] (helo=exnlb02.webde.local) by mxintern.schlund.de with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (envelope-from ) id 1PIrbU-0008Ox-2O for dm-crypt@saout.de; Thu, 18 Nov 2010 00:39:52 +0100 Message-ID: <4CE467C2.8010408@1und1.de> Date: Thu, 18 Nov 2010 00:39:46 +0100 From: Jakob-Tobias Winter MIME-Version: 1.0 References: <566573504.20101115153604@novg.net> <4CE142C3.1070408@redhat.com> In-Reply-To: <4CE142C3.1070408@redhat.com> Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig1D382A3CE17D5FF8F7D989DD" Subject: Re: [dm-crypt] AES-XTS performance List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: dm-crypt@saout.de --------------enig1D382A3CE17D5FF8F7D989DD Content-Type: multipart/mixed; boundary="------------050200040201000503050902" This is a multi-part message in MIME format. --------------050200040201000503050902 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hey Milan, thank you for spending time on the long awaited multi-core-crypto-support= ! On 11/15/2010 03:25 PM, Milan Broz wrote: > If you want to do some tests, try this patch > http://lkml.org/lkml/2010/11/12/344 I started out giving the patch a try on my desktop box but quickly ran into disk IO limitations of just one HDD and so decided to grab some spare metal and do this on a more performant system. The test results are included as text-file as I fear the syntax of the bonnie output will suffer if included directly in the mail, so please exuse using an attachement. I hope most MUAs will end up displaying it directly. > (but there is still some issues and it will not help much > if only one process generates IOs.) Are you sure about that? Actually I also observed quite some performance gain for single process IO. In case you would like me to do some other comparisons, feel free to point me in the right direction. So far I also did not take time to check if it ends up eating the data, but if it fails, I guess my desktop will let me know. Hooray for the backup and black-magic-kernel-patch-users. ;) By the way: As it seems, compiling the patched kernel breaks, if trying to compile the AES stuff as modules. Tobias --------------050200040201000503050902 Content-Type: text/plain; name="results.txt" Content-Transfer-Encoding: quoted-printable Content-Disposition: attachment; filename="results.txt" Dell PowerEdge 1950 Raid10 Hardware Raid 4x 72Gb 15k SAS 8G RAM model Int= el Xeon CPU E5405 @ 2.00GHz (Quadcore w/o hyperthreading) Linux testkiste 2.6.36-wintix-unpatched-crypto #1 SMP Wed Nov 17 17:08:56= CET 2010 x86_64 GNU/Linux testkiste:/mnt# bonnie++ -d ./ -c 4 -u root Using uid:0, gid:0. Writing a byte at a time...done Writing intelligently...done Rewriting...done Reading a byte at a time...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.96 ------Sequential Output------ --Sequential Input- --R= andom- Concurrency 4 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --S= eeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /s= ec %CP testkiste 16G 820 99 193744 20 95649 13 2449 95 191911 11 = 1049 10 Latency 9951us 3592ms 1178ms 45264us 24906us 533= 83us Version 1.96 ------Sequential Create------ --------Random Create--= ------ testkiste -Create-- --Read--- -Delete-- -Create-- --Read--- -De= lete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /s= ec %CP 16 25935 93 +++++ +++ 25837 94 25378 91 +++++ +++ 219= 93 81 Latency 8491us 128us 244us 1013us 12us 79= 94us 1.96,1.96,testkiste,4,1290012956,16G,,820,99,193744,20,95649,13,2449,95,1= 91911,11,1049,10,16,,,,,25935,93,+++++,+++,25837,94,25378,91,+++++,+++,21= 993,81,9951us,3592ms,1178ms,45264us,24906us,53383us,8491us,128us,244us,10= 13us,12us,7994us testkiste:/mnt#=20 testkiste:/mnt_crypt# bonnie++ -d ./ -c 4 -u root Using uid:0, gid:0. Writing a byte at a time...done Writing intelligently...done Rewriting...done Reading a byte at a time...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.96 ------Sequential Output------ --Sequential Input- --R= andom- Concurrency 4 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --S= eeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /s= ec %CP testkiste 16G 837 98 67741 6 36038 4 2571 98 101504 5 85= 2.2 8 Latency 9562us 14773ms 11487ms 14082us 511ms 573= 57us Version 1.96 ------Sequential Create------ --------Random Create--= ------ testkiste -Create-- --Read--- -Delete-- -Create-- --Read--- -De= lete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /s= ec %CP 16 4570 17 +++++ +++ 4281 15 4666 17 +++++ +++ 38= 90 15 Latency 13172us 133us 8949us 12061us 38us 414= 50us 1.96,1.96,testkiste,4,1290018063,16G,,837,98,67741,6,36038,4,2571,98,1015= 04,5,852.2,8,16,,,,,4570,17,+++++,+++,4281,15,4666,17,+++++,+++,3890,15,9= 562us,14773ms,11487ms,14082us,511ms,57357us,13172us,133us,8949us,12061us,= 38us,41450us testkiste:/mnt_crypt#=20 Linux testkiste 2.6.36-wintix-patched-crypto #2 SMP Wed Nov 17 23:21:41 C= ET 2010 x86_64 GNU/Linux testkiste:/mnt_crypt# bonnie++ -d ./ -c 4 -u root Using uid:0, gid:0. Writing a byte at a time...done Writing intelligently...done Rewriting...done Reading a byte at a time...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.96 ------Sequential Output------ --Sequential Input- --R= andom- Concurrency 4 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --S= eeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /s= ec %CP testkiste 16G 809 98 136538 14 49701 5 1958 76 107338 4 = 1040 10 Latency 9889us 6065ms 5466ms 363ms 530ms 472= 73us Version 1.96 ------Sequential Create------ --------Random Create--= ------ testkiste -Create-- --Read--- -Delete-- -Create-- --Read--- -De= lete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /s= ec %CP 16 5279 19 +++++ +++ 4669 16 5234 19 +++++ +++ 38= 99 14 Latency 13465us 136us 15558us 12742us 91us 308= 20us 1.96,1.96,testkiste,4,1290031937,16G,,809,98,136538,14,49701,5,1958,76,10= 7338,4,1040,10,16,,,,,5279,19,+++++,+++,4669,16,5234,19,+++++,+++,3899,14= ,9889us,6065ms,5466ms,363ms,530ms,47273us,13465us,136us,15558us,12742us,9= 1us,30820us testkiste:/mnt_crypt#=20 testkiste:/mnt_crypt# cryptsetup luksDump /dev/mapper/vg00-test=20 LUKS header information for /dev/mapper/vg00-test Version: 1 Cipher name: aes Cipher mode: cbc-essiv:sha256 Hash spec: sha1 Payload offset: 2056 MK bits: 256 MK digest: 94 20 85 7b fe a6 5e b3 e5 4c dc 11 36 e0 94 2c 63 2f e2 = 80=20 MK salt: 88 86 48 63 3c 6b 46 b7 dc 67 2f 89 02 df 78 cf=20 7e 50 f7 90 ef dd 8f 55 a6 7a 2b ea 0c d9 63 c4=20 MK iterations: 35625 UUID: 9b4e45b1-602b-4c1f-be36-10d0a98bbea5 Key Slot 0: ENABLED Iterations: 142950 Salt: ba b6 9b f4 34 e4 4e 30 37 27 6b 7c 2a c2= de 17=20 f0 90 36 ae ca ab ec c3 7a 2b b5 de ff ed= b2 15=20 Key material offset: 8 AF stripes: 4000 Key Slot 1: DISABLED Key Slot 2: DISABLED Key Slot 3: DISABLED Key Slot 4: DISABLED Key Slot 5: DISABLED Key Slot 6: DISABLED Key Slot 7: DISABLED testkiste:/mnt_crypt#=20 --------------050200040201000503050902-- --------------enig1D382A3CE17D5FF8F7D989DD Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAkzkZ8YACgkQ2CMMiSvcNgXEkwCePLAtpSEul9duzw9NiuU0O8mP P64AoIZ4EwAHOan8Qcs8pj0Y1j7XuhyT =7MB9 -----END PGP SIGNATURE----- --------------enig1D382A3CE17D5FF8F7D989DD--