Re: [dm-crypt] AES-XTS performance

[Jakob-Tobias Winter <jakob-tobias.winter@1und1.de>]

[-- Attachment #1.1: Type: text/plain, Size: 1274 bytes --]

Hey Milan,

thank you for spending time on the long awaited multi-core-crypto-support!

On 11/15/2010 03:25 PM, Milan Broz wrote:
> If you want to do some tests, try this patch
> http://lkml.org/lkml/2010/11/12/344

I started out giving the patch a try on my desktop box but quickly ran
into disk IO limitations of just one HDD and so decided to grab some
spare metal and do this on a more performant system.

The test results are included as text-file as I fear the syntax of the
bonnie output will suffer if included directly in the mail, so please
exuse using an attachement. I hope most MUAs will end up displaying it
directly.

> (but there is still some issues and it will not help much
> if only one process generates IOs.)
Are you sure about that? Actually I also observed quite some performance
gain for single process IO.

In case you would like me to do some other comparisons, feel free to
point me in the right direction.

So far I also did not take time to check if it ends up eating the data,
but if it fails, I guess my desktop will let me know. Hooray for the
backup and black-magic-kernel-patch-users. ;)

By the way: As it seems, compiling the patched kernel breaks, if trying
to compile the AES stuff as modules.

Tobias

[-- Attachment #1.2: results.txt --]
[-- Type: text/plain, Size: 6060 bytes --]

Dell PowerEdge 1950 Raid10 Hardware Raid 4x 72Gb 15k SAS 8G RAM model Intel Xeon CPU E5405 @ 2.00GHz (Quadcore w/o hyperthreading)

Linux testkiste 2.6.36-wintix-unpatched-crypto #1 SMP Wed Nov 17 17:08:56 CET 2010 x86_64 GNU/Linux

testkiste:/mnt#  bonnie++ -d ./ -c 4 -u root
Using uid:0, gid:0.
Writing a byte at a time...done
Writing intelligently...done
Rewriting...done
Reading a byte at a time...done
Reading intelligently...done
start 'em...done...done...done...done...done...
Create files in sequential order...done.
Stat files in sequential order...done.
Delete files in sequential order...done.
Create files in random order...done.
Stat files in random order...done.
Delete files in random order...done.
Version  1.96       ------Sequential Output------ --Sequential Input- --Random-
Concurrency   4     -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
testkiste       16G   820  99 193744  20 95649  13  2449  95 191911  11  1049  10
Latency              9951us    3592ms    1178ms   45264us   24906us   53383us
Version  1.96       ------Sequential Create------ --------Random Create--------
testkiste           -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16 25935  93 +++++ +++ 25837  94 25378  91 +++++ +++ 21993  81
Latency              8491us     128us     244us    1013us      12us    7994us
1.96,1.96,testkiste,4,1290012956,16G,,820,99,193744,20,95649,13,2449,95,191911,11,1049,10,16,,,,,25935,93,+++++,+++,25837,94,25378,91,+++++,+++,21993,81,9951us,3592ms,1178ms,45264us,24906us,53383us,8491us,128us,244us,1013us,12us,7994us
testkiste:/mnt# 

testkiste:/mnt_crypt#  bonnie++ -d ./ -c 4 -u root
Using uid:0, gid:0.
Writing a byte at a time...done
Writing intelligently...done
Rewriting...done
Reading a byte at a time...done
Reading intelligently...done
start 'em...done...done...done...done...done...
Create files in sequential order...done.
Stat files in sequential order...done.
Delete files in sequential order...done.
Create files in random order...done.
Stat files in random order...done.
Delete files in random order...done.
Version  1.96       ------Sequential Output------ --Sequential Input- --Random-
Concurrency   4     -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
testkiste       16G   837  98 67741   6 36038   4  2571  98 101504   5 852.2   8
Latency              9562us   14773ms   11487ms   14082us     511ms   57357us
Version  1.96       ------Sequential Create------ --------Random Create--------
testkiste           -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16  4570  17 +++++ +++  4281  15  4666  17 +++++ +++  3890  15
Latency             13172us     133us    8949us   12061us      38us   41450us
1.96,1.96,testkiste,4,1290018063,16G,,837,98,67741,6,36038,4,2571,98,101504,5,852.2,8,16,,,,,4570,17,+++++,+++,4281,15,4666,17,+++++,+++,3890,15,9562us,14773ms,11487ms,14082us,511ms,57357us,13172us,133us,8949us,12061us,38us,41450us
testkiste:/mnt_crypt# 

Linux testkiste 2.6.36-wintix-patched-crypto #2 SMP Wed Nov 17 23:21:41 CET 2010 x86_64 GNU/Linux

testkiste:/mnt_crypt#  bonnie++ -d ./ -c 4 -u root
Using uid:0, gid:0.
Writing a byte at a time...done
Writing intelligently...done
Rewriting...done
Reading a byte at a time...done
Reading intelligently...done
start 'em...done...done...done...done...done...
Create files in sequential order...done.
Stat files in sequential order...done.
Delete files in sequential order...done.
Create files in random order...done.
Stat files in random order...done.
Delete files in random order...done.
Version  1.96       ------Sequential Output------ --Sequential Input- --Random-
Concurrency   4     -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
testkiste       16G   809  98 136538  14 49701   5  1958  76 107338   4  1040  10
Latency              9889us    6065ms    5466ms     363ms     530ms   47273us
Version  1.96       ------Sequential Create------ --------Random Create--------
testkiste           -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16  5279  19 +++++ +++  4669  16  5234  19 +++++ +++  3899  14
Latency             13465us     136us   15558us   12742us      91us   30820us
1.96,1.96,testkiste,4,1290031937,16G,,809,98,136538,14,49701,5,1958,76,107338,4,1040,10,16,,,,,5279,19,+++++,+++,4669,16,5234,19,+++++,+++,3899,14,9889us,6065ms,5466ms,363ms,530ms,47273us,13465us,136us,15558us,12742us,91us,30820us
testkiste:/mnt_crypt# 

testkiste:/mnt_crypt# cryptsetup luksDump /dev/mapper/vg00-test 
LUKS header information for /dev/mapper/vg00-test

Version:        1
Cipher name:    aes
Cipher mode:    cbc-essiv:sha256
Hash spec:      sha1
Payload offset: 2056
MK bits:        256
MK digest:      94 20 85 7b fe a6 5e b3 e5 4c dc 11 36 e0 94 2c 63 2f e2 80 
MK salt:        88 86 48 63 3c 6b 46 b7 dc 67 2f 89 02 df 78 cf 
                7e 50 f7 90 ef dd 8f 55 a6 7a 2b ea 0c d9 63 c4 
MK iterations:  35625
UUID:           9b4e45b1-602b-4c1f-be36-10d0a98bbea5

Key Slot 0: ENABLED
        Iterations:             142950
        Salt:                   ba b6 9b f4 34 e4 4e 30 37 27 6b 7c 2a c2 de 17 
                                f0 90 36 ae ca ab ec c3 7a 2b b5 de ff ed b2 15 
        Key material offset:    8
        AF stripes:             4000
Key Slot 1: DISABLED
Key Slot 2: DISABLED
Key Slot 3: DISABLED
Key Slot 4: DISABLED
Key Slot 5: DISABLED
Key Slot 6: DISABLED
Key Slot 7: DISABLED
testkiste:/mnt_crypt# 


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 262 bytes --]