From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 3A4BFC07545 for ; Wed, 25 Oct 2023 18:38:18 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234866AbjJYSiQ (ORCPT ); Wed, 25 Oct 2023 14:38:16 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:55298 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S234995AbjJYSh5 (ORCPT ); Wed, 25 Oct 2023 14:37:57 -0400 Received: from mail-pg1-x532.google.com (mail-pg1-x532.google.com [IPv6:2607:f8b0:4864:20::532]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 053EBD4D for ; Wed, 25 Oct 2023 11:37:29 -0700 (PDT) Received: by mail-pg1-x532.google.com with SMTP id 41be03b00d2f7-5a9bc2ec556so92389a12.0 for ; Wed, 25 Oct 2023 11:37:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sifive.com; s=google; t=1698259048; x=1698863848; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=GFhsyXyqq7vflrUvLHWxOLv+JErs0KUA8a4MpjUfb6k=; b=Iy0i9U8iuY45MTcsowiH9w/BygERagIoWqpA3o/ALY9Wep+AvQCNMp0SLNyi4MVLIP Xs8TXaMoPvwDPfO5YM742+EIE6Nt1NqRAdnOq3/ErwBX3P0xg2WMQxeJg5p34nNRS3iI v3hMClCj3Y9ggxE0MItkOekJwBkhk9asIMMYQT8ciz57aos7PAMhBcINabBqoNi+ebYB nDXhSwSjn7sLDAMU3+1/Hu48wI+HC3m/AFRt6YiFmGGfitt0SiDB4pVbnS6zLCmD11ca VA47odCHTM+Gn5vMsDwN4UUyL4mvC2VjwLJE+dSa5pDrnhp/q79QjSLMR/4H2ACLR/ZS NhNA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1698259048; x=1698863848; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=GFhsyXyqq7vflrUvLHWxOLv+JErs0KUA8a4MpjUfb6k=; b=SX2zL5YnvEIAEbJCkjh14E+kIncRW4l76lSs6oa9ExCApa96umtadlpdIJgMZMYHGL H8P1gOIAG0vWJ0kLjlPjp6De6DuwX89eq/HldF+gKJaRj7bynqTaRuY4bj7cyi1f/UMu vo4VoRPkUe24sgXBjK2iSDIskuNg6LaPV7Sl3DAtHX3pacMJegyqNuvI18LmNRHODcod 1xAxXm2wbHxMRhz+dh1PrKIDW0mRC+0nB5whisnRmZ6e44AN8F8ogi0QELWcUHBxIJpX 6q/qpnDt0VhjI65Hkjh3xZoJ2/hNgkX2b08c0Q6Z4+6pB7kZJH7qS967Fn0DR/C472Gz pEbg== X-Gm-Message-State: AOJu0YyGOknftYUVV1VBrOO4LIUAVL9jIKMorguh7CkZp2keZHwh62hh Fu8j0jF8VvOY6Cuc6NgkH5jqcw== X-Google-Smtp-Source: AGHT+IEOlkCWlpWa0D8YyaNcxzwVuxyDQKs6Eh/An49WnNeVSvp6OxIlA5f8xkM1IDNcrtptMmj01g== X-Received: by 2002:a17:90a:1a15:b0:27d:b22b:fb89 with SMTP id 21-20020a17090a1a1500b0027db22bfb89mr12033741pjk.35.1698259048196; Wed, 25 Oct 2023 11:37:28 -0700 (PDT) Received: from localhost.localdomain ([49.216.222.119]) by smtp.gmail.com with ESMTPSA id g3-20020a17090adb0300b00278f1512dd9sm212367pjv.32.2023.10.25.11.37.24 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 25 Oct 2023 11:37:27 -0700 (PDT) From: Jerry Shih To: paul.walmsley@sifive.com, palmer@dabbelt.com, aou@eecs.berkeley.edu, herbert@gondor.apana.org.au, davem@davemloft.net Cc: andy.chiu@sifive.com, greentime.hu@sifive.com, conor.dooley@microchip.com, guoren@kernel.org, bjorn@rivosinc.com, heiko@sntech.de, ebiggers@kernel.org, ardb@kernel.org, phoebe.chen@sifive.com, hongrong.hsu@sifive.com, linux-riscv@lists.infradead.org, linux-kernel@vger.kernel.org, linux-crypto@vger.kernel.org Subject: [PATCH 08/12] RISC-V: crypto: add Zvknha/b accelerated SHA224/256 implementations Date: Thu, 26 Oct 2023 02:36:40 +0800 Message-Id: <20231025183644.8735-9-jerry.shih@sifive.com> X-Mailer: git-send-email 2.28.0 In-Reply-To: <20231025183644.8735-1-jerry.shih@sifive.com> References: <20231025183644.8735-1-jerry.shih@sifive.com> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-crypto@vger.kernel.org Add SHA224 and 256 implementations using Zvknha or Zvknhb vector crypto extensions from OpenSSL(openssl/openssl#21923). Co-developed-by: Charalampos Mitrodimas Signed-off-by: Charalampos Mitrodimas Co-developed-by: Heiko Stuebner Signed-off-by: Heiko Stuebner Co-developed-by: Phoebe Chen Signed-off-by: Phoebe Chen Signed-off-by: Jerry Shih --- arch/riscv/crypto/Kconfig | 13 + arch/riscv/crypto/Makefile | 7 + arch/riscv/crypto/sha256-riscv64-glue.c | 140 ++++++++ .../sha256-riscv64-zvkb-zvknha_or_zvknhb.pl | 318 ++++++++++++++++++ 4 files changed, 478 insertions(+) create mode 100644 arch/riscv/crypto/sha256-riscv64-glue.c create mode 100644 arch/riscv/crypto/sha256-riscv64-zvkb-zvknha_or_zvknhb.pl diff --git a/arch/riscv/crypto/Kconfig b/arch/riscv/crypto/Kconfig index 00be7177eb1e..dbc86592063a 100644 --- a/arch/riscv/crypto/Kconfig +++ b/arch/riscv/crypto/Kconfig @@ -49,4 +49,17 @@ config CRYPTO_GHASH_RISCV64 Architecture: riscv64 using: - Zvkg vector crypto extension +config CRYPTO_SHA256_RISCV64 + default y if RISCV_ISA_V + tristate "Hash functions: SHA-224 and SHA-256" + depends on 64BIT && RISCV_ISA_V + select CRYPTO_HASH + select CRYPTO_SHA256 + help + SHA-256 secure hash algorithm (FIPS 180) + + Architecture: riscv64 using: + - Zvkb vector crypto extension + - Zvknha or Zvknhb vector crypto extensions + endmenu diff --git a/arch/riscv/crypto/Makefile b/arch/riscv/crypto/Makefile index 532316cc1758..49577fb72cca 100644 --- a/arch/riscv/crypto/Makefile +++ b/arch/riscv/crypto/Makefile @@ -12,6 +12,9 @@ aes-block-riscv64-y := aes-riscv64-block-mode-glue.o aes-riscv64-zvbb-zvkg-zvkne obj-$(CONFIG_CRYPTO_GHASH_RISCV64) += ghash-riscv64.o ghash-riscv64-y := ghash-riscv64-glue.o ghash-riscv64-zvkg.o +obj-$(CONFIG_CRYPTO_SHA256_RISCV64) += sha256-riscv64.o +sha256-riscv64-y := sha256-riscv64-glue.o sha256-riscv64-zvkb-zvknha_or_zvknhb.o + quiet_cmd_perlasm = PERLASM $@ cmd_perlasm = $(PERL) $(<) void $(@) @@ -27,7 +30,11 @@ $(obj)/aes-riscv64-zvkb-zvkned.S: $(src)/aes-riscv64-zvkb-zvkned.pl $(obj)/ghash-riscv64-zvkg.S: $(src)/ghash-riscv64-zvkg.pl $(call cmd,perlasm) +$(obj)/sha256-riscv64-zvkb-zvknha_or_zvknhb.S: $(src)/sha256-riscv64-zvkb-zvknha_or_zvknhb.pl + $(call cmd,perlasm) + clean-files += aes-riscv64-zvkned.S clean-files += aes-riscv64-zvbb-zvkg-zvkned.S clean-files += aes-riscv64-zvkb-zvkned.S clean-files += ghash-riscv64-zvkg.S +clean-files += sha256-riscv64-zvkb-zvknha_or_zvknhb.S diff --git a/arch/riscv/crypto/sha256-riscv64-glue.c b/arch/riscv/crypto/sha256-riscv64-glue.c new file mode 100644 index 000000000000..35acfb6e4b2d --- /dev/null +++ b/arch/riscv/crypto/sha256-riscv64-glue.c @@ -0,0 +1,140 @@ +// SPDX-License-Identifier: GPL-2.0-or-later +/* + * Linux/riscv64 port of the OpenSSL SHA256 implementation for RISC-V 64 + * + * Copyright (C) 2022 VRULL GmbH + * Author: Heiko Stuebner + */ + +#include +#include +#include +#include +#include +#include +#include + +/* + * sha256 using zvkb and zvknha/b vector crypto extension + * + * This asm function will just take the first 256-bit as the sha256 state from + * the pointer to `struct sha256_state`. + */ +void sha256_block_data_order_zvkb_zvknha_or_zvknhb(struct sha256_state *digest, + const u8 *data, + int num_blks); + +static int riscv64_sha256_update(struct shash_desc *desc, const u8 *data, + unsigned int len) +{ + int ret = 0; + + /* + * Make sure struct sha256_state begins directly with the SHA256 + * 256-bit internal state, as this is what the asm function expect. + */ + BUILD_BUG_ON(offsetof(struct sha256_state, state) != 0); + + if (crypto_simd_usable()) { + kernel_vector_begin(); + ret = sha256_base_do_update( + desc, data, len, + sha256_block_data_order_zvkb_zvknha_or_zvknhb); + kernel_vector_end(); + } else { + ret = crypto_sha256_update(desc, data, len); + } + + return ret; +} + +static int riscv64_sha256_finup(struct shash_desc *desc, const u8 *data, + unsigned int len, u8 *out) +{ + if (crypto_simd_usable()) { + kernel_vector_begin(); + if (len) + sha256_base_do_update( + desc, data, len, + sha256_block_data_order_zvkb_zvknha_or_zvknhb); + sha256_base_do_finalize( + desc, sha256_block_data_order_zvkb_zvknha_or_zvknhb); + kernel_vector_end(); + + return sha256_base_finish(desc, out); + } + + return crypto_sha256_finup(desc, data, len, out); +} + +static int riscv64_sha256_final(struct shash_desc *desc, u8 *out) +{ + return riscv64_sha256_finup(desc, NULL, 0, out); +} + +static struct shash_alg sha256_alg[] = { + { + .digestsize = SHA256_DIGEST_SIZE, + .init = sha256_base_init, + .update = riscv64_sha256_update, + .final = riscv64_sha256_final, + .finup = riscv64_sha256_finup, + .descsize = sizeof(struct sha256_state), + .base.cra_name = "sha256", + .base.cra_driver_name = "sha256-riscv64-zvkb-zvknha_or_zvknhb", + .base.cra_priority = 150, + .base.cra_blocksize = SHA256_BLOCK_SIZE, + .base.cra_module = THIS_MODULE, + }, + { + .digestsize = SHA224_DIGEST_SIZE, + .init = sha224_base_init, + .update = riscv64_sha256_update, + .final = riscv64_sha256_final, + .finup = riscv64_sha256_finup, + .descsize = sizeof(struct sha256_state), + .base.cra_name = "sha224", + .base.cra_driver_name = "sha224-riscv64-zvkb-zvknha_or_zvknhb", + .base.cra_priority = 150, + .base.cra_blocksize = SHA224_BLOCK_SIZE, + .base.cra_module = THIS_MODULE, + } +}; + +static inline bool check_sha256_ext(void) +{ + /* + * From the spec: + * The Zvknhb ext supports both SHA-256 and SHA-512 and Zvknha only + * supports SHA-256. + */ + return (riscv_isa_extension_available(NULL, ZVKNHA) || + riscv_isa_extension_available(NULL, ZVKNHB)) && + riscv_isa_extension_available(NULL, ZVKB) && + riscv_vector_vlen() >= 128; +} + +static int __init riscv64_sha256_mod_init(void) +{ + if (check_sha256_ext()) + return crypto_register_shashes(sha256_alg, + ARRAY_SIZE(sha256_alg)); + + return -ENODEV; +} + +static void __exit riscv64_sha256_mod_fini(void) +{ + if (check_sha256_ext()) + crypto_unregister_shashes(sha256_alg, ARRAY_SIZE(sha256_alg)); +} + +module_init(riscv64_sha256_mod_init); +module_exit(riscv64_sha256_mod_fini); + +MODULE_DESCRIPTION("SHA-256 (RISC-V accelerated)"); +MODULE_AUTHOR("Andy Polyakov "); +MODULE_AUTHOR("Heiko Stuebner "); +MODULE_LICENSE("GPL"); +MODULE_ALIAS_CRYPTO("sha224"); +MODULE_ALIAS_CRYPTO("sha256"); diff --git a/arch/riscv/crypto/sha256-riscv64-zvkb-zvknha_or_zvknhb.pl b/arch/riscv/crypto/sha256-riscv64-zvkb-zvknha_or_zvknhb.pl new file mode 100644 index 000000000000..51b2d9d4f8f1 --- /dev/null +++ b/arch/riscv/crypto/sha256-riscv64-zvkb-zvknha_or_zvknhb.pl @@ -0,0 +1,318 @@ +#! /usr/bin/env perl +# SPDX-License-Identifier: Apache-2.0 OR BSD-2-Clause +# +# This file is dual-licensed, meaning that you can use it under your +# choice of either of the following two licenses: +# +# Copyright 2023 The OpenSSL Project Authors. All Rights Reserved. +# +# Licensed under the Apache License 2.0 (the "License"). You can obtain +# a copy in the file LICENSE in the source distribution or at +# https://www.openssl.org/source/license.html +# +# or +# +# Copyright (c) 2023, Christoph Müllner +# Copyright (c) 2023, Phoebe Chen +# All rights reserved. +# +# Redistribution and use in source and binary forms, with or without +# modification, are permitted provided that the following conditions +# are met: +# 1. Redistributions of source code must retain the above copyright +# notice, this list of conditions and the following disclaimer. +# 2. Redistributions in binary form must reproduce the above copyright +# notice, this list of conditions and the following disclaimer in the +# documentation and/or other materials provided with the distribution. +# +# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS +# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT +# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR +# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT +# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, +# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT +# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, +# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY +# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT +# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE +# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. + +# The generated code of this file depends on the following RISC-V extensions: +# - RV64I +# - RISC-V Vector ('V') with VLEN >= 128 +# - RISC-V Vector Cryptography Bit-manipulation extension ('Zvkb') +# - RISC-V Vector SHA-2 Secure Hash extension ('Zvknha' or 'Zvknhb') + +use strict; +use warnings; + +use FindBin qw($Bin); +use lib "$Bin"; +use lib "$Bin/../../perlasm"; +use riscv; + +# $output is the last argument if it looks like a file (it has an extension) +# $flavour is the first argument if it doesn't look like a file +my $output = $#ARGV >= 0 && $ARGV[$#ARGV] =~ m|\.\w+$| ? pop : undef; +my $flavour = $#ARGV >= 0 && $ARGV[0] !~ m|\.| ? shift : undef; + +$output and open STDOUT,">$output"; + +my $code=<<___; +.text +___ + +my ($V0, $V1, $V2, $V3, $V4, $V5, $V6, $V7, + $V8, $V9, $V10, $V11, $V12, $V13, $V14, $V15, + $V16, $V17, $V18, $V19, $V20, $V21, $V22, $V23, + $V24, $V25, $V26, $V27, $V28, $V29, $V30, $V31, +) = map("v$_",(0..31)); + +my $K256 = "K256"; + +# Function arguments +my ($H, $INP, $LEN, $KT, $H2, $INDEX_PATTERN) = ("a0", "a1", "a2", "a3", "t3", "t4"); + +sub sha_256_load_constant { + my $code=<<___; + la $KT, $K256 # Load round constants K256 + @{[vle32_v $V10, $KT]} + addi $KT, $KT, 16 + @{[vle32_v $V11, $KT]} + addi $KT, $KT, 16 + @{[vle32_v $V12, $KT]} + addi $KT, $KT, 16 + @{[vle32_v $V13, $KT]} + addi $KT, $KT, 16 + @{[vle32_v $V14, $KT]} + addi $KT, $KT, 16 + @{[vle32_v $V15, $KT]} + addi $KT, $KT, 16 + @{[vle32_v $V16, $KT]} + addi $KT, $KT, 16 + @{[vle32_v $V17, $KT]} + addi $KT, $KT, 16 + @{[vle32_v $V18, $KT]} + addi $KT, $KT, 16 + @{[vle32_v $V19, $KT]} + addi $KT, $KT, 16 + @{[vle32_v $V20, $KT]} + addi $KT, $KT, 16 + @{[vle32_v $V21, $KT]} + addi $KT, $KT, 16 + @{[vle32_v $V22, $KT]} + addi $KT, $KT, 16 + @{[vle32_v $V23, $KT]} + addi $KT, $KT, 16 + @{[vle32_v $V24, $KT]} + addi $KT, $KT, 16 + @{[vle32_v $V25, $KT]} +___ + + return $code; +} + +################################################################################ +# void sha256_block_data_order_zvkb_zvknha_or_zvknhb(void *c, const void *p, size_t len) +$code .= <<___; +.p2align 2 +.globl sha256_block_data_order_zvkb_zvknha_or_zvknhb +.type sha256_block_data_order_zvkb_zvknha_or_zvknhb,\@function +sha256_block_data_order_zvkb_zvknha_or_zvknhb: + @{[vsetivli "zero", 4, "e32", "m1", "ta", "ma"]} + + @{[sha_256_load_constant]} + + # H is stored as {a,b,c,d},{e,f,g,h}, but we need {f,e,b,a},{h,g,d,c} + # The dst vtype is e32m1 and the index vtype is e8mf4. + # We use index-load with the following index pattern at v26. + # i8 index: + # 20, 16, 4, 0 + # Instead of setting the i8 index, we could use a single 32bit + # little-endian value to cover the 4xi8 index. + # i32 value: + # 0x 00 04 10 14 + li $INDEX_PATTERN, 0x00041014 + @{[vsetivli "zero", 1, "e32", "m1", "ta", "ma"]} + @{[vmv_v_x $V26, $INDEX_PATTERN]} + + addi $H2, $H, 8 + + # Use index-load to get {f,e,b,a},{h,g,d,c} + @{[vsetivli "zero", 4, "e32", "m1", "ta", "ma"]} + @{[vluxei8_v $V6, $H, $V26]} + @{[vluxei8_v $V7, $H2, $V26]} + + # Setup v0 mask for the vmerge to replace the first word (idx==0) in key-scheduling. + # The AVL is 4 in SHA, so we could use a single e8(8 element masking) for masking. + @{[vsetivli "zero", 1, "e8", "m1", "ta", "ma"]} + @{[vmv_v_i $V0, 0x01]} + + @{[vsetivli "zero", 4, "e32", "m1", "ta", "ma"]} + +L_round_loop: + # Decrement length by 1 + add $LEN, $LEN, -1 + + # Keep the current state as we need it later: H' = H+{a',b',c',...,h'}. + @{[vmv_v_v $V30, $V6]} + @{[vmv_v_v $V31, $V7]} + + # Load the 512-bits of the message block in v1-v4 and perform + # an endian swap on each 4 bytes element. + @{[vle32_v $V1, $INP]} + @{[vrev8_v $V1, $V1]} + add $INP, $INP, 16 + @{[vle32_v $V2, $INP]} + @{[vrev8_v $V2, $V2]} + add $INP, $INP, 16 + @{[vle32_v $V3, $INP]} + @{[vrev8_v $V3, $V3]} + add $INP, $INP, 16 + @{[vle32_v $V4, $INP]} + @{[vrev8_v $V4, $V4]} + add $INP, $INP, 16 + + # Quad-round 0 (+0, Wt from oldest to newest in v1->v2->v3->v4) + @{[vadd_vv $V5, $V10, $V1]} + @{[vsha2cl_vv $V7, $V6, $V5]} + @{[vsha2ch_vv $V6, $V7, $V5]} + @{[vmerge_vvm $V5, $V3, $V2, $V0]} + @{[vsha2ms_vv $V1, $V5, $V4]} # Generate W[19:16] + + # Quad-round 1 (+1, v2->v3->v4->v1) + @{[vadd_vv $V5, $V11, $V2]} + @{[vsha2cl_vv $V7, $V6, $V5]} + @{[vsha2ch_vv $V6, $V7, $V5]} + @{[vmerge_vvm $V5, $V4, $V3, $V0]} + @{[vsha2ms_vv $V2, $V5, $V1]} # Generate W[23:20] + + # Quad-round 2 (+2, v3->v4->v1->v2) + @{[vadd_vv $V5, $V12, $V3]} + @{[vsha2cl_vv $V7, $V6, $V5]} + @{[vsha2ch_vv $V6, $V7, $V5]} + @{[vmerge_vvm $V5, $V1, $V4, $V0]} + @{[vsha2ms_vv $V3, $V5, $V2]} # Generate W[27:24] + + # Quad-round 3 (+3, v4->v1->v2->v3) + @{[vadd_vv $V5, $V13, $V4]} + @{[vsha2cl_vv $V7, $V6, $V5]} + @{[vsha2ch_vv $V6, $V7, $V5]} + @{[vmerge_vvm $V5, $V2, $V1, $V0]} + @{[vsha2ms_vv $V4, $V5, $V3]} # Generate W[31:28] + + # Quad-round 4 (+0, v1->v2->v3->v4) + @{[vadd_vv $V5, $V14, $V1]} + @{[vsha2cl_vv $V7, $V6, $V5]} + @{[vsha2ch_vv $V6, $V7, $V5]} + @{[vmerge_vvm $V5, $V3, $V2, $V0]} + @{[vsha2ms_vv $V1, $V5, $V4]} # Generate W[35:32] + + # Quad-round 5 (+1, v2->v3->v4->v1) + @{[vadd_vv $V5, $V15, $V2]} + @{[vsha2cl_vv $V7, $V6, $V5]} + @{[vsha2ch_vv $V6, $V7, $V5]} + @{[vmerge_vvm $V5, $V4, $V3, $V0]} + @{[vsha2ms_vv $V2, $V5, $V1]} # Generate W[39:36] + + # Quad-round 6 (+2, v3->v4->v1->v2) + @{[vadd_vv $V5, $V16, $V3]} + @{[vsha2cl_vv $V7, $V6, $V5]} + @{[vsha2ch_vv $V6, $V7, $V5]} + @{[vmerge_vvm $V5, $V1, $V4, $V0]} + @{[vsha2ms_vv $V3, $V5, $V2]} # Generate W[43:40] + + # Quad-round 7 (+3, v4->v1->v2->v3) + @{[vadd_vv $V5, $V17, $V4]} + @{[vsha2cl_vv $V7, $V6, $V5]} + @{[vsha2ch_vv $V6, $V7, $V5]} + @{[vmerge_vvm $V5, $V2, $V1, $V0]} + @{[vsha2ms_vv $V4, $V5, $V3]} # Generate W[47:44] + + # Quad-round 8 (+0, v1->v2->v3->v4) + @{[vadd_vv $V5, $V18, $V1]} + @{[vsha2cl_vv $V7, $V6, $V5]} + @{[vsha2ch_vv $V6, $V7, $V5]} + @{[vmerge_vvm $V5, $V3, $V2, $V0]} + @{[vsha2ms_vv $V1, $V5, $V4]} # Generate W[51:48] + + # Quad-round 9 (+1, v2->v3->v4->v1) + @{[vadd_vv $V5, $V19, $V2]} + @{[vsha2cl_vv $V7, $V6, $V5]} + @{[vsha2ch_vv $V6, $V7, $V5]} + @{[vmerge_vvm $V5, $V4, $V3, $V0]} + @{[vsha2ms_vv $V2, $V5, $V1]} # Generate W[55:52] + + # Quad-round 10 (+2, v3->v4->v1->v2) + @{[vadd_vv $V5, $V20, $V3]} + @{[vsha2cl_vv $V7, $V6, $V5]} + @{[vsha2ch_vv $V6, $V7, $V5]} + @{[vmerge_vvm $V5, $V1, $V4, $V0]} + @{[vsha2ms_vv $V3, $V5, $V2]} # Generate W[59:56] + + # Quad-round 11 (+3, v4->v1->v2->v3) + @{[vadd_vv $V5, $V21, $V4]} + @{[vsha2cl_vv $V7, $V6, $V5]} + @{[vsha2ch_vv $V6, $V7, $V5]} + @{[vmerge_vvm $V5, $V2, $V1, $V0]} + @{[vsha2ms_vv $V4, $V5, $V3]} # Generate W[63:60] + + # Quad-round 12 (+0, v1->v2->v3->v4) + # Note that we stop generating new message schedule words (Wt, v1-13) + # as we already generated all the words we end up consuming (i.e., W[63:60]). + @{[vadd_vv $V5, $V22, $V1]} + @{[vsha2cl_vv $V7, $V6, $V5]} + @{[vsha2ch_vv $V6, $V7, $V5]} + + # Quad-round 13 (+1, v2->v3->v4->v1) + @{[vadd_vv $V5, $V23, $V2]} + @{[vsha2cl_vv $V7, $V6, $V5]} + @{[vsha2ch_vv $V6, $V7, $V5]} + + # Quad-round 14 (+2, v3->v4->v1->v2) + @{[vadd_vv $V5, $V24, $V3]} + @{[vsha2cl_vv $V7, $V6, $V5]} + @{[vsha2ch_vv $V6, $V7, $V5]} + + # Quad-round 15 (+3, v4->v1->v2->v3) + @{[vadd_vv $V5, $V25, $V4]} + @{[vsha2cl_vv $V7, $V6, $V5]} + @{[vsha2ch_vv $V6, $V7, $V5]} + + # H' = H+{a',b',c',...,h'} + @{[vadd_vv $V6, $V30, $V6]} + @{[vadd_vv $V7, $V31, $V7]} + bnez $LEN, L_round_loop + + # Store {f,e,b,a},{h,g,d,c} back to {a,b,c,d},{e,f,g,h}. + @{[vsuxei8_v $V6, $H, $V26]} + @{[vsuxei8_v $V7, $H2, $V26]} + + ret +.size sha256_block_data_order_zvkb_zvknha_or_zvknhb,.-sha256_block_data_order_zvkb_zvknha_or_zvknhb + +.p2align 2 +.type $K256,\@object +$K256: + .word 0x428a2f98, 0x71374491, 0xb5c0fbcf, 0xe9b5dba5 + .word 0x3956c25b, 0x59f111f1, 0x923f82a4, 0xab1c5ed5 + .word 0xd807aa98, 0x12835b01, 0x243185be, 0x550c7dc3 + .word 0x72be5d74, 0x80deb1fe, 0x9bdc06a7, 0xc19bf174 + .word 0xe49b69c1, 0xefbe4786, 0x0fc19dc6, 0x240ca1cc + .word 0x2de92c6f, 0x4a7484aa, 0x5cb0a9dc, 0x76f988da + .word 0x983e5152, 0xa831c66d, 0xb00327c8, 0xbf597fc7 + .word 0xc6e00bf3, 0xd5a79147, 0x06ca6351, 0x14292967 + .word 0x27b70a85, 0x2e1b2138, 0x4d2c6dfc, 0x53380d13 + .word 0x650a7354, 0x766a0abb, 0x81c2c92e, 0x92722c85 + .word 0xa2bfe8a1, 0xa81a664b, 0xc24b8b70, 0xc76c51a3 + .word 0xd192e819, 0xd6990624, 0xf40e3585, 0x106aa070 + .word 0x19a4c116, 0x1e376c08, 0x2748774c, 0x34b0bcb5 + .word 0x391c0cb3, 0x4ed8aa4a, 0x5b9cca4f, 0x682e6ff3 + .word 0x748f82ee, 0x78a5636f, 0x84c87814, 0x8cc70208 + .word 0x90befffa, 0xa4506ceb, 0xbef9a3f7, 0xc67178f2 +.size $K256,.-$K256 +___ + +print $code; + +close STDOUT or die "error closing STDOUT: $!"; -- 2.28.0 From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id A9475C07545 for ; Wed, 25 Oct 2023 18:37:39 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:MIME-Version:References:In-Reply-To: Message-Id:Date:Subject:Cc:To:From:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=U6i2l9qnKDBpizTsunRobeSre8LdgFb3nJ06BezF89k=; b=w8siNEsHQUWRcZ ny59xNIy/3+Cu68FpZRBwzIQrpZEYnSDpxoF1rvkS0IgxWAK86Uq8zcxnhn2NbU9ceGCMxzhs7xVV eqJ+boLPmtz0zuIZF+qDNCdjAtUKUmZ7h2BX+1dClKbJ+Gbg9dbqEpEpiWk2mfEcqQh6DtjVCzxi9 aaHWGUZ+ryaNWGhhqowZNNhxd6tXxGllPFNjNJs4IVqOFhpHDcxr+DG3IJRwxSNHlQa0WrOCuIdR+ lyXGWoFEBq55LOjeGl97PFQSpUFOT6HDm/LJnMcPGhd9hPyKcWzQt6OnHPEQJ3P54fQbesZ4BNVsN s2OWs0pBkRcniWTA/ulg==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.96 #2 (Red Hat Linux)) id 1qvil4-00CsPb-2W; Wed, 25 Oct 2023 18:37:34 +0000 Received: from mail-pg1-x535.google.com ([2607:f8b0:4864:20::535]) by bombadil.infradead.org with esmtps (Exim 4.96 #2 (Red Hat Linux)) id 1qvil1-00CsMj-0z for linux-riscv@lists.infradead.org; Wed, 25 Oct 2023 18:37:34 +0000 Received: by mail-pg1-x535.google.com with SMTP id 41be03b00d2f7-5ab53b230f1so72140a12.3 for ; Wed, 25 Oct 2023 11:37:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sifive.com; s=google; t=1698259048; x=1698863848; darn=lists.infradead.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=GFhsyXyqq7vflrUvLHWxOLv+JErs0KUA8a4MpjUfb6k=; b=kuVMF7aPvbhcnRUvsrJONUMOAKiRUO5pLac1k0tn7e87RUG3ixyevyJigbgB5v9LUL Vc51a0nLu6JU7+pFN3GdDItgfQJhB4QXY9pFtmpg7pjJuCgfWJAbJ52ij4PxKfKioJKP qkf9clcOu4tDpTqsF8w1xIboB/SxckKRDnqK476HkyMjUfj3z8/h4fexGhKSKdrCMRiH nVyTdVmJu2260+RDfeev4FqC2gHEHJxFOczQ+1B/cRiRoJwaLF2qG3psLwDEi6InmS9k 9xgc62jCmd4YxWHxS6x465Tzn+OjRIEeecWMS9fivzUD96bNZj7JEsEPzS6i2Xrjc0T4 1j0Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1698259048; x=1698863848; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=GFhsyXyqq7vflrUvLHWxOLv+JErs0KUA8a4MpjUfb6k=; b=PshYN4JmaywmejsShIPrOsOPNS4agHcDb5r2Ko+xI16ZPAKEKgsfpVMz1kT+t81/l2 noO2EeVRN6F+XY8iy3LvWn77YPjLCHnAdXTQZUPw3/0lVPt961aYSHa3fBBSK0l+1yda 0kRmjU/FPRb9oPnA6YyNVVzwT7xQ/IsJfILsjQfhkwp6USdIgpoJHYbiAqdzvpKvBlxQ 3B3sOhHbN1xaw9sG1tbUJkEODOuJjXdQ/MAgrp6U3cCkaCjOE55EgcXmHXr8AZl8a5ro A1Hy0yELYpqks3TC44+nr7Ohj/NNKU4/4zaYtEbzD4TrQEeHjV5ElhrQ9paFKpyi/Ksr wqew== X-Gm-Message-State: AOJu0YyTAGuLU1kFTfmEtBRmBGiWvabeuXDAglSi7+6lMI+4OMHnw3px pqOliijJ3vw4DsiGeAJGr2Ptjg== X-Google-Smtp-Source: AGHT+IEOlkCWlpWa0D8YyaNcxzwVuxyDQKs6Eh/An49WnNeVSvp6OxIlA5f8xkM1IDNcrtptMmj01g== X-Received: by 2002:a17:90a:1a15:b0:27d:b22b:fb89 with SMTP id 21-20020a17090a1a1500b0027db22bfb89mr12033741pjk.35.1698259048196; Wed, 25 Oct 2023 11:37:28 -0700 (PDT) Received: from localhost.localdomain ([49.216.222.119]) by smtp.gmail.com with ESMTPSA id g3-20020a17090adb0300b00278f1512dd9sm212367pjv.32.2023.10.25.11.37.24 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 25 Oct 2023 11:37:27 -0700 (PDT) From: Jerry Shih To: paul.walmsley@sifive.com, palmer@dabbelt.com, aou@eecs.berkeley.edu, herbert@gondor.apana.org.au, davem@davemloft.net Cc: andy.chiu@sifive.com, greentime.hu@sifive.com, conor.dooley@microchip.com, guoren@kernel.org, bjorn@rivosinc.com, heiko@sntech.de, ebiggers@kernel.org, ardb@kernel.org, phoebe.chen@sifive.com, hongrong.hsu@sifive.com, linux-riscv@lists.infradead.org, linux-kernel@vger.kernel.org, linux-crypto@vger.kernel.org Subject: [PATCH 08/12] RISC-V: crypto: add Zvknha/b accelerated SHA224/256 implementations Date: Thu, 26 Oct 2023 02:36:40 +0800 Message-Id: <20231025183644.8735-9-jerry.shih@sifive.com> X-Mailer: git-send-email 2.28.0 In-Reply-To: <20231025183644.8735-1-jerry.shih@sifive.com> References: <20231025183644.8735-1-jerry.shih@sifive.com> MIME-Version: 1.0 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20231025_113731_361943_DA18FE66 X-CRM114-Status: GOOD ( 31.32 ) X-BeenThere: linux-riscv@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: "linux-riscv" Errors-To: linux-riscv-bounces+linux-riscv=archiver.kernel.org@lists.infradead.org QWRkIFNIQTIyNCBhbmQgMjU2IGltcGxlbWVudGF0aW9ucyB1c2luZyBadmtuaGEgb3IgWnZrbmhi IHZlY3RvciBjcnlwdG8KZXh0ZW5zaW9ucyBmcm9tIE9wZW5TU0wob3BlbnNzbC9vcGVuc3NsIzIx OTIzKS4KCkNvLWRldmVsb3BlZC1ieTogQ2hhcmFsYW1wb3MgTWl0cm9kaW1hcyA8Y2hhcmFsYW1w b3MubWl0cm9kaW1hc0B2cnVsbC5ldT4KU2lnbmVkLW9mZi1ieTogQ2hhcmFsYW1wb3MgTWl0cm9k aW1hcyA8Y2hhcmFsYW1wb3MubWl0cm9kaW1hc0B2cnVsbC5ldT4KQ28tZGV2ZWxvcGVkLWJ5OiBI ZWlrbyBTdHVlYm5lciA8aGVpa28uc3R1ZWJuZXJAdnJ1bGwuZXU+ClNpZ25lZC1vZmYtYnk6IEhl aWtvIFN0dWVibmVyIDxoZWlrby5zdHVlYm5lckB2cnVsbC5ldT4KQ28tZGV2ZWxvcGVkLWJ5OiBQ aG9lYmUgQ2hlbiA8cGhvZWJlLmNoZW5Ac2lmaXZlLmNvbT4KU2lnbmVkLW9mZi1ieTogUGhvZWJl IENoZW4gPHBob2ViZS5jaGVuQHNpZml2ZS5jb20+ClNpZ25lZC1vZmYtYnk6IEplcnJ5IFNoaWgg PGplcnJ5LnNoaWhAc2lmaXZlLmNvbT4KLS0tCiBhcmNoL3Jpc2N2L2NyeXB0by9LY29uZmlnICAg ICAgICAgICAgICAgICAgICAgfCAgMTMgKwogYXJjaC9yaXNjdi9jcnlwdG8vTWFrZWZpbGUgICAg ICAgICAgICAgICAgICAgIHwgICA3ICsKIGFyY2gvcmlzY3YvY3J5cHRvL3NoYTI1Ni1yaXNjdjY0 LWdsdWUuYyAgICAgICB8IDE0MCArKysrKysrKwogLi4uL3NoYTI1Ni1yaXNjdjY0LXp2a2ItenZr bmhhX29yX3p2a25oYi5wbCAgIHwgMzE4ICsrKysrKysrKysrKysrKysrKwogNCBmaWxlcyBjaGFu Z2VkLCA0NzggaW5zZXJ0aW9ucygrKQogY3JlYXRlIG1vZGUgMTAwNjQ0IGFyY2gvcmlzY3YvY3J5 cHRvL3NoYTI1Ni1yaXNjdjY0LWdsdWUuYwogY3JlYXRlIG1vZGUgMTAwNjQ0IGFyY2gvcmlzY3Yv Y3J5cHRvL3NoYTI1Ni1yaXNjdjY0LXp2a2ItenZrbmhhX29yX3p2a25oYi5wbAoKZGlmZiAtLWdp dCBhL2FyY2gvcmlzY3YvY3J5cHRvL0tjb25maWcgYi9hcmNoL3Jpc2N2L2NyeXB0by9LY29uZmln CmluZGV4IDAwYmU3MTc3ZWIxZS4uZGJjODY1OTIwNjNhIDEwMDY0NAotLS0gYS9hcmNoL3Jpc2N2 L2NyeXB0by9LY29uZmlnCisrKyBiL2FyY2gvcmlzY3YvY3J5cHRvL0tjb25maWcKQEAgLTQ5LDQg KzQ5LDE3IEBAIGNvbmZpZyBDUllQVE9fR0hBU0hfUklTQ1Y2NAogCSAgQXJjaGl0ZWN0dXJlOiBy aXNjdjY0IHVzaW5nOgogCSAgLSBadmtnIHZlY3RvciBjcnlwdG8gZXh0ZW5zaW9uCiAKK2NvbmZp ZyBDUllQVE9fU0hBMjU2X1JJU0NWNjQKKwlkZWZhdWx0IHkgaWYgUklTQ1ZfSVNBX1YKKwl0cmlz dGF0ZSAiSGFzaCBmdW5jdGlvbnM6IFNIQS0yMjQgYW5kIFNIQS0yNTYiCisJZGVwZW5kcyBvbiA2 NEJJVCAmJiBSSVNDVl9JU0FfVgorCXNlbGVjdCBDUllQVE9fSEFTSAorCXNlbGVjdCBDUllQVE9f U0hBMjU2CisJaGVscAorCSAgU0hBLTI1NiBzZWN1cmUgaGFzaCBhbGdvcml0aG0gKEZJUFMgMTgw KQorCisJICBBcmNoaXRlY3R1cmU6IHJpc2N2NjQgdXNpbmc6CisJICAtIFp2a2IgdmVjdG9yIGNy eXB0byBleHRlbnNpb24KKwkgIC0gWnZrbmhhIG9yIFp2a25oYiB2ZWN0b3IgY3J5cHRvIGV4dGVu c2lvbnMKKwogZW5kbWVudQpkaWZmIC0tZ2l0IGEvYXJjaC9yaXNjdi9jcnlwdG8vTWFrZWZpbGUg Yi9hcmNoL3Jpc2N2L2NyeXB0by9NYWtlZmlsZQppbmRleCA1MzIzMTZjYzE3NTguLjQ5NTc3ZmI3 MmNjYSAxMDA2NDQKLS0tIGEvYXJjaC9yaXNjdi9jcnlwdG8vTWFrZWZpbGUKKysrIGIvYXJjaC9y aXNjdi9jcnlwdG8vTWFrZWZpbGUKQEAgLTEyLDYgKzEyLDkgQEAgYWVzLWJsb2NrLXJpc2N2NjQt eSA6PSBhZXMtcmlzY3Y2NC1ibG9jay1tb2RlLWdsdWUubyBhZXMtcmlzY3Y2NC16dmJiLXp2a2ct enZrbmUKIG9iai0kKENPTkZJR19DUllQVE9fR0hBU0hfUklTQ1Y2NCkgKz0gZ2hhc2gtcmlzY3Y2 NC5vCiBnaGFzaC1yaXNjdjY0LXkgOj0gZ2hhc2gtcmlzY3Y2NC1nbHVlLm8gZ2hhc2gtcmlzY3Y2 NC16dmtnLm8KIAorb2JqLSQoQ09ORklHX0NSWVBUT19TSEEyNTZfUklTQ1Y2NCkgKz0gc2hhMjU2 LXJpc2N2NjQubworc2hhMjU2LXJpc2N2NjQteSA6PSBzaGEyNTYtcmlzY3Y2NC1nbHVlLm8gc2hh MjU2LXJpc2N2NjQtenZrYi16dmtuaGFfb3JfenZrbmhiLm8KKwogcXVpZXRfY21kX3Blcmxhc20g PSBQRVJMQVNNICRACiAgICAgICBjbWRfcGVybGFzbSA9ICQoUEVSTCkgJCg8KSB2b2lkICQoQCkK IApAQCAtMjcsNyArMzAsMTEgQEAgJChvYmopL2Flcy1yaXNjdjY0LXp2a2ItenZrbmVkLlM6ICQo c3JjKS9hZXMtcmlzY3Y2NC16dmtiLXp2a25lZC5wbAogJChvYmopL2doYXNoLXJpc2N2NjQtenZr Zy5TOiAkKHNyYykvZ2hhc2gtcmlzY3Y2NC16dmtnLnBsCiAJJChjYWxsIGNtZCxwZXJsYXNtKQog CiskKG9iaikvc2hhMjU2LXJpc2N2NjQtenZrYi16dmtuaGFfb3JfenZrbmhiLlM6ICQoc3JjKS9z aGEyNTYtcmlzY3Y2NC16dmtiLXp2a25oYV9vcl96dmtuaGIucGwKKwkkKGNhbGwgY21kLHBlcmxh c20pCisKIGNsZWFuLWZpbGVzICs9IGFlcy1yaXNjdjY0LXp2a25lZC5TCiBjbGVhbi1maWxlcyAr PSBhZXMtcmlzY3Y2NC16dmJiLXp2a2ctenZrbmVkLlMKIGNsZWFuLWZpbGVzICs9IGFlcy1yaXNj djY0LXp2a2ItenZrbmVkLlMKIGNsZWFuLWZpbGVzICs9IGdoYXNoLXJpc2N2NjQtenZrZy5TCitj bGVhbi1maWxlcyArPSBzaGEyNTYtcmlzY3Y2NC16dmtiLXp2a25oYV9vcl96dmtuaGIuUwpkaWZm IC0tZ2l0IGEvYXJjaC9yaXNjdi9jcnlwdG8vc2hhMjU2LXJpc2N2NjQtZ2x1ZS5jIGIvYXJjaC9y aXNjdi9jcnlwdG8vc2hhMjU2LXJpc2N2NjQtZ2x1ZS5jCm5ldyBmaWxlIG1vZGUgMTAwNjQ0Cmlu ZGV4IDAwMDAwMDAwMDAwMC4uMzVhY2ZiNmU0YjJkCi0tLSAvZGV2L251bGwKKysrIGIvYXJjaC9y aXNjdi9jcnlwdG8vc2hhMjU2LXJpc2N2NjQtZ2x1ZS5jCkBAIC0wLDAgKzEsMTQwIEBACisvLyBT UERYLUxpY2Vuc2UtSWRlbnRpZmllcjogR1BMLTIuMC1vci1sYXRlcgorLyoKKyAqIExpbnV4L3Jp c2N2NjQgcG9ydCBvZiB0aGUgT3BlblNTTCBTSEEyNTYgaW1wbGVtZW50YXRpb24gZm9yIFJJU0Mt ViA2NAorICoKKyAqIENvcHlyaWdodCAoQykgMjAyMiBWUlVMTCBHbWJICisgKiBBdXRob3I6IEhl aWtvIFN0dWVibmVyIDxoZWlrby5zdHVlYm5lckB2cnVsbC5ldT4KKyAqLworCisjaW5jbHVkZSA8 YXNtL3NpbWQuaD4KKyNpbmNsdWRlIDxhc20vdmVjdG9yLmg+CisjaW5jbHVkZSA8bGludXgvbW9k dWxlLmg+CisjaW5jbHVkZSA8bGludXgvdHlwZXMuaD4KKyNpbmNsdWRlIDxjcnlwdG8vaW50ZXJu YWwvaGFzaC5oPgorI2luY2x1ZGUgPGNyeXB0by9pbnRlcm5hbC9zaW1kLmg+CisjaW5jbHVkZSA8 Y3J5cHRvL3NoYTI1Nl9iYXNlLmg+CisKKy8qCisgKiBzaGEyNTYgdXNpbmcgenZrYiBhbmQgenZr bmhhL2IgdmVjdG9yIGNyeXB0byBleHRlbnNpb24KKyAqCisgKiBUaGlzIGFzbSBmdW5jdGlvbiB3 aWxsIGp1c3QgdGFrZSB0aGUgZmlyc3QgMjU2LWJpdCBhcyB0aGUgc2hhMjU2IHN0YXRlIGZyb20K KyAqIHRoZSBwb2ludGVyIHRvIGBzdHJ1Y3Qgc2hhMjU2X3N0YXRlYC4KKyAqLwordm9pZCBzaGEy NTZfYmxvY2tfZGF0YV9vcmRlcl96dmtiX3p2a25oYV9vcl96dmtuaGIoc3RydWN0IHNoYTI1Nl9z dGF0ZSAqZGlnZXN0LAorCQkJCQkJICAgY29uc3QgdTggKmRhdGEsCisJCQkJCQkgICBpbnQgbnVt X2Jsa3MpOworCitzdGF0aWMgaW50IHJpc2N2NjRfc2hhMjU2X3VwZGF0ZShzdHJ1Y3Qgc2hhc2hf ZGVzYyAqZGVzYywgY29uc3QgdTggKmRhdGEsCisJCQkJIHVuc2lnbmVkIGludCBsZW4pCit7CisJ aW50IHJldCA9IDA7CisKKwkvKgorCSAqIE1ha2Ugc3VyZSBzdHJ1Y3Qgc2hhMjU2X3N0YXRlIGJl Z2lucyBkaXJlY3RseSB3aXRoIHRoZSBTSEEyNTYKKwkgKiAyNTYtYml0IGludGVybmFsIHN0YXRl LCBhcyB0aGlzIGlzIHdoYXQgdGhlIGFzbSBmdW5jdGlvbiBleHBlY3QuCisJICovCisJQlVJTERf QlVHX09OKG9mZnNldG9mKHN0cnVjdCBzaGEyNTZfc3RhdGUsIHN0YXRlKSAhPSAwKTsKKworCWlm IChjcnlwdG9fc2ltZF91c2FibGUoKSkgeworCQlrZXJuZWxfdmVjdG9yX2JlZ2luKCk7CisJCXJl dCA9IHNoYTI1Nl9iYXNlX2RvX3VwZGF0ZSgKKwkJCWRlc2MsIGRhdGEsIGxlbiwKKwkJCXNoYTI1 Nl9ibG9ja19kYXRhX29yZGVyX3p2a2JfenZrbmhhX29yX3p2a25oYik7CisJCWtlcm5lbF92ZWN0 b3JfZW5kKCk7CisJfSBlbHNlIHsKKwkJcmV0ID0gY3J5cHRvX3NoYTI1Nl91cGRhdGUoZGVzYywg ZGF0YSwgbGVuKTsKKwl9CisKKwlyZXR1cm4gcmV0OworfQorCitzdGF0aWMgaW50IHJpc2N2NjRf c2hhMjU2X2ZpbnVwKHN0cnVjdCBzaGFzaF9kZXNjICpkZXNjLCBjb25zdCB1OCAqZGF0YSwKKwkJ CQl1bnNpZ25lZCBpbnQgbGVuLCB1OCAqb3V0KQoreworCWlmIChjcnlwdG9fc2ltZF91c2FibGUo KSkgeworCQlrZXJuZWxfdmVjdG9yX2JlZ2luKCk7CisJCWlmIChsZW4pCisJCQlzaGEyNTZfYmFz ZV9kb191cGRhdGUoCisJCQkJZGVzYywgZGF0YSwgbGVuLAorCQkJCXNoYTI1Nl9ibG9ja19kYXRh X29yZGVyX3p2a2JfenZrbmhhX29yX3p2a25oYik7CisJCXNoYTI1Nl9iYXNlX2RvX2ZpbmFsaXpl KAorCQkJZGVzYywgc2hhMjU2X2Jsb2NrX2RhdGFfb3JkZXJfenZrYl96dmtuaGFfb3JfenZrbmhi KTsKKwkJa2VybmVsX3ZlY3Rvcl9lbmQoKTsKKworCQlyZXR1cm4gc2hhMjU2X2Jhc2VfZmluaXNo KGRlc2MsIG91dCk7CisJfQorCisJcmV0dXJuIGNyeXB0b19zaGEyNTZfZmludXAoZGVzYywgZGF0 YSwgbGVuLCBvdXQpOworfQorCitzdGF0aWMgaW50IHJpc2N2NjRfc2hhMjU2X2ZpbmFsKHN0cnVj dCBzaGFzaF9kZXNjICpkZXNjLCB1OCAqb3V0KQoreworCXJldHVybiByaXNjdjY0X3NoYTI1Nl9m aW51cChkZXNjLCBOVUxMLCAwLCBvdXQpOworfQorCitzdGF0aWMgc3RydWN0IHNoYXNoX2FsZyBz aGEyNTZfYWxnW10gPSB7CisJeworCQkuZGlnZXN0c2l6ZSA9IFNIQTI1Nl9ESUdFU1RfU0laRSwK KwkJLmluaXQgPSBzaGEyNTZfYmFzZV9pbml0LAorCQkudXBkYXRlID0gcmlzY3Y2NF9zaGEyNTZf dXBkYXRlLAorCQkuZmluYWwgPSByaXNjdjY0X3NoYTI1Nl9maW5hbCwKKwkJLmZpbnVwID0gcmlz Y3Y2NF9zaGEyNTZfZmludXAsCisJCS5kZXNjc2l6ZSA9IHNpemVvZihzdHJ1Y3Qgc2hhMjU2X3N0 YXRlKSwKKwkJLmJhc2UuY3JhX25hbWUgPSAic2hhMjU2IiwKKwkJLmJhc2UuY3JhX2RyaXZlcl9u YW1lID0gInNoYTI1Ni1yaXNjdjY0LXp2a2ItenZrbmhhX29yX3p2a25oYiIsCisJCS5iYXNlLmNy YV9wcmlvcml0eSA9IDE1MCwKKwkJLmJhc2UuY3JhX2Jsb2Nrc2l6ZSA9IFNIQTI1Nl9CTE9DS19T SVpFLAorCQkuYmFzZS5jcmFfbW9kdWxlID0gVEhJU19NT0RVTEUsCisJfSwKKwl7CisJCS5kaWdl c3RzaXplID0gU0hBMjI0X0RJR0VTVF9TSVpFLAorCQkuaW5pdCA9IHNoYTIyNF9iYXNlX2luaXQs CisJCS51cGRhdGUgPSByaXNjdjY0X3NoYTI1Nl91cGRhdGUsCisJCS5maW5hbCA9IHJpc2N2NjRf c2hhMjU2X2ZpbmFsLAorCQkuZmludXAgPSByaXNjdjY0X3NoYTI1Nl9maW51cCwKKwkJLmRlc2Nz aXplID0gc2l6ZW9mKHN0cnVjdCBzaGEyNTZfc3RhdGUpLAorCQkuYmFzZS5jcmFfbmFtZSA9ICJz aGEyMjQiLAorCQkuYmFzZS5jcmFfZHJpdmVyX25hbWUgPSAic2hhMjI0LXJpc2N2NjQtenZrYi16 dmtuaGFfb3JfenZrbmhiIiwKKwkJLmJhc2UuY3JhX3ByaW9yaXR5ID0gMTUwLAorCQkuYmFzZS5j cmFfYmxvY2tzaXplID0gU0hBMjI0X0JMT0NLX1NJWkUsCisJCS5iYXNlLmNyYV9tb2R1bGUgPSBU SElTX01PRFVMRSwKKwl9Cit9OworCitzdGF0aWMgaW5saW5lIGJvb2wgY2hlY2tfc2hhMjU2X2V4 dCh2b2lkKQoreworCS8qCisJICogRnJvbSB0aGUgc3BlYzoKKwkgKiBUaGUgWnZrbmhiIGV4dCBz dXBwb3J0cyBib3RoIFNIQS0yNTYgYW5kIFNIQS01MTIgYW5kIFp2a25oYSBvbmx5CisJICogc3Vw cG9ydHMgU0hBLTI1Ni4KKwkgKi8KKwlyZXR1cm4gKHJpc2N2X2lzYV9leHRlbnNpb25fYXZhaWxh YmxlKE5VTEwsIFpWS05IQSkgfHwKKwkJcmlzY3ZfaXNhX2V4dGVuc2lvbl9hdmFpbGFibGUoTlVM TCwgWlZLTkhCKSkgJiYKKwkgICAgICAgcmlzY3ZfaXNhX2V4dGVuc2lvbl9hdmFpbGFibGUoTlVM TCwgWlZLQikgJiYKKwkgICAgICAgcmlzY3ZfdmVjdG9yX3ZsZW4oKSA+PSAxMjg7Cit9CisKK3N0 YXRpYyBpbnQgX19pbml0IHJpc2N2NjRfc2hhMjU2X21vZF9pbml0KHZvaWQpCit7CisJaWYgKGNo ZWNrX3NoYTI1Nl9leHQoKSkKKwkJcmV0dXJuIGNyeXB0b19yZWdpc3Rlcl9zaGFzaGVzKHNoYTI1 Nl9hbGcsCisJCQkJCSAgICAgICBBUlJBWV9TSVpFKHNoYTI1Nl9hbGcpKTsKKworCXJldHVybiAt RU5PREVWOworfQorCitzdGF0aWMgdm9pZCBfX2V4aXQgcmlzY3Y2NF9zaGEyNTZfbW9kX2Zpbmko dm9pZCkKK3sKKwlpZiAoY2hlY2tfc2hhMjU2X2V4dCgpKQorCQljcnlwdG9fdW5yZWdpc3Rlcl9z aGFzaGVzKHNoYTI1Nl9hbGcsIEFSUkFZX1NJWkUoc2hhMjU2X2FsZykpOworfQorCittb2R1bGVf aW5pdChyaXNjdjY0X3NoYTI1Nl9tb2RfaW5pdCk7Cittb2R1bGVfZXhpdChyaXNjdjY0X3NoYTI1 Nl9tb2RfZmluaSk7CisKK01PRFVMRV9ERVNDUklQVElPTigiU0hBLTI1NiAoUklTQy1WIGFjY2Vs ZXJhdGVkKSIpOworTU9EVUxFX0FVVEhPUigiQW5keSBQb2x5YWtvdiA8YXBwcm9Ab3BlbnNzbC5v cmc+Iik7CitNT0RVTEVfQVVUSE9SKCJIZWlrbyBTdHVlYm5lciA8aGVpa28uc3R1ZWJuZXJAdnJ1 bGwuZXU+Iik7CitNT0RVTEVfTElDRU5TRSgiR1BMIik7CitNT0RVTEVfQUxJQVNfQ1JZUFRPKCJz aGEyMjQiKTsKK01PRFVMRV9BTElBU19DUllQVE8oInNoYTI1NiIpOwpkaWZmIC0tZ2l0IGEvYXJj aC9yaXNjdi9jcnlwdG8vc2hhMjU2LXJpc2N2NjQtenZrYi16dmtuaGFfb3JfenZrbmhiLnBsIGIv YXJjaC9yaXNjdi9jcnlwdG8vc2hhMjU2LXJpc2N2NjQtenZrYi16dmtuaGFfb3JfenZrbmhiLnBs Cm5ldyBmaWxlIG1vZGUgMTAwNjQ0CmluZGV4IDAwMDAwMDAwMDAwMC4uNTFiMmQ5ZDRmOGYxCi0t LSAvZGV2L251bGwKKysrIGIvYXJjaC9yaXNjdi9jcnlwdG8vc2hhMjU2LXJpc2N2NjQtenZrYi16 dmtuaGFfb3JfenZrbmhiLnBsCkBAIC0wLDAgKzEsMzE4IEBACisjISAvdXNyL2Jpbi9lbnYgcGVy bAorIyBTUERYLUxpY2Vuc2UtSWRlbnRpZmllcjogQXBhY2hlLTIuMCBPUiBCU0QtMi1DbGF1c2UK KyMKKyMgVGhpcyBmaWxlIGlzIGR1YWwtbGljZW5zZWQsIG1lYW5pbmcgdGhhdCB5b3UgY2FuIHVz ZSBpdCB1bmRlciB5b3VyCisjIGNob2ljZSBvZiBlaXRoZXIgb2YgdGhlIGZvbGxvd2luZyB0d28g bGljZW5zZXM6CisjCisjIENvcHlyaWdodCAyMDIzIFRoZSBPcGVuU1NMIFByb2plY3QgQXV0aG9y cy4gQWxsIFJpZ2h0cyBSZXNlcnZlZC4KKyMKKyMgTGljZW5zZWQgdW5kZXIgdGhlIEFwYWNoZSBM aWNlbnNlIDIuMCAodGhlICJMaWNlbnNlIikuIFlvdSBjYW4gb2J0YWluCisjIGEgY29weSBpbiB0 aGUgZmlsZSBMSUNFTlNFIGluIHRoZSBzb3VyY2UgZGlzdHJpYnV0aW9uIG9yIGF0CisjIGh0dHBz Oi8vd3d3Lm9wZW5zc2wub3JnL3NvdXJjZS9saWNlbnNlLmh0bWwKKyMKKyMgb3IKKyMKKyMgQ29w eXJpZ2h0IChjKSAyMDIzLCBDaHJpc3RvcGggTcO8bGxuZXIgPGNocmlzdG9waC5tdWVsbG5lckB2 cnVsbC5ldT4KKyMgQ29weXJpZ2h0IChjKSAyMDIzLCBQaG9lYmUgQ2hlbiA8cGhvZWJlLmNoZW5A c2lmaXZlLmNvbT4KKyMgQWxsIHJpZ2h0cyByZXNlcnZlZC4KKyMKKyMgUmVkaXN0cmlidXRpb24g YW5kIHVzZSBpbiBzb3VyY2UgYW5kIGJpbmFyeSBmb3Jtcywgd2l0aCBvciB3aXRob3V0CisjIG1v ZGlmaWNhdGlvbiwgYXJlIHBlcm1pdHRlZCBwcm92aWRlZCB0aGF0IHRoZSBmb2xsb3dpbmcgY29u ZGl0aW9ucworIyBhcmUgbWV0OgorIyAxLiBSZWRpc3RyaWJ1dGlvbnMgb2Ygc291cmNlIGNvZGUg bXVzdCByZXRhaW4gdGhlIGFib3ZlIGNvcHlyaWdodAorIyAgICBub3RpY2UsIHRoaXMgbGlzdCBv ZiBjb25kaXRpb25zIGFuZCB0aGUgZm9sbG93aW5nIGRpc2NsYWltZXIuCisjIDIuIFJlZGlzdHJp YnV0aW9ucyBpbiBiaW5hcnkgZm9ybSBtdXN0IHJlcHJvZHVjZSB0aGUgYWJvdmUgY29weXJpZ2h0 CisjICAgIG5vdGljZSwgdGhpcyBsaXN0IG9mIGNvbmRpdGlvbnMgYW5kIHRoZSBmb2xsb3dpbmcg ZGlzY2xhaW1lciBpbiB0aGUKKyMgICAgZG9jdW1lbnRhdGlvbiBhbmQvb3Igb3RoZXIgbWF0ZXJp YWxzIHByb3ZpZGVkIHdpdGggdGhlIGRpc3RyaWJ1dGlvbi4KKyMKKyMgVEhJUyBTT0ZUV0FSRSBJ UyBQUk9WSURFRCBCWSBUSEUgQ09QWVJJR0hUIEhPTERFUlMgQU5EIENPTlRSSUJVVE9SUworIyAi QVMgSVMiIEFORCBBTlkgRVhQUkVTUyBPUiBJTVBMSUVEIFdBUlJBTlRJRVMsIElOQ0xVRElORywg QlVUIE5PVAorIyBMSU1JVEVEIFRPLCBUSEUgSU1QTElFRCBXQVJSQU5USUVTIE9GIE1FUkNIQU5U QUJJTElUWSBBTkQgRklUTkVTUyBGT1IKKyMgQSBQQVJUSUNVTEFSIFBVUlBPU0UgQVJFIERJU0NM QUlNRUQuIElOIE5PIEVWRU5UIFNIQUxMIFRIRSBDT1BZUklHSFQKKyMgT1dORVIgT1IgQ09OVFJJ QlVUT1JTIEJFIExJQUJMRSBGT1IgQU5ZIERJUkVDVCwgSU5ESVJFQ1QsIElOQ0lERU5UQUwsCisj IFNQRUNJQUwsIEVYRU1QTEFSWSwgT1IgQ09OU0VRVUVOVElBTCBEQU1BR0VTIChJTkNMVURJTkcs IEJVVCBOT1QKKyMgTElNSVRFRCBUTywgUFJPQ1VSRU1FTlQgT0YgU1VCU1RJVFVURSBHT09EUyBP UiBTRVJWSUNFUzsgTE9TUyBPRiBVU0UsCisjIERBVEEsIE9SIFBST0ZJVFM7IE9SIEJVU0lORVNT IElOVEVSUlVQVElPTikgSE9XRVZFUiBDQVVTRUQgQU5EIE9OIEFOWQorIyBUSEVPUlkgT0YgTElB QklMSVRZLCBXSEVUSEVSIElOIENPTlRSQUNULCBTVFJJQ1QgTElBQklMSVRZLCBPUiBUT1JUCisj IChJTkNMVURJTkcgTkVHTElHRU5DRSBPUiBPVEhFUldJU0UpIEFSSVNJTkcgSU4gQU5ZIFdBWSBP VVQgT0YgVEhFIFVTRQorIyBPRiBUSElTIFNPRlRXQVJFLCBFVkVOIElGIEFEVklTRUQgT0YgVEhF IFBPU1NJQklMSVRZIE9GIFNVQ0ggREFNQUdFLgorCisjIFRoZSBnZW5lcmF0ZWQgY29kZSBvZiB0 aGlzIGZpbGUgZGVwZW5kcyBvbiB0aGUgZm9sbG93aW5nIFJJU0MtViBleHRlbnNpb25zOgorIyAt IFJWNjRJCisjIC0gUklTQy1WIFZlY3RvciAoJ1YnKSB3aXRoIFZMRU4gPj0gMTI4CisjIC0gUklT Qy1WIFZlY3RvciBDcnlwdG9ncmFwaHkgQml0LW1hbmlwdWxhdGlvbiBleHRlbnNpb24gKCdadmti JykKKyMgLSBSSVNDLVYgVmVjdG9yIFNIQS0yIFNlY3VyZSBIYXNoIGV4dGVuc2lvbiAoJ1p2a25o YScgb3IgJ1p2a25oYicpCisKK3VzZSBzdHJpY3Q7Cit1c2Ugd2FybmluZ3M7CisKK3VzZSBGaW5k QmluIHF3KCRCaW4pOwordXNlIGxpYiAiJEJpbiI7Cit1c2UgbGliICIkQmluLy4uLy4uL3Blcmxh c20iOwordXNlIHJpc2N2OworCisjICRvdXRwdXQgaXMgdGhlIGxhc3QgYXJndW1lbnQgaWYgaXQg bG9va3MgbGlrZSBhIGZpbGUgKGl0IGhhcyBhbiBleHRlbnNpb24pCisjICRmbGF2b3VyIGlzIHRo ZSBmaXJzdCBhcmd1bWVudCBpZiBpdCBkb2Vzbid0IGxvb2sgbGlrZSBhIGZpbGUKK215ICRvdXRw dXQgPSAkI0FSR1YgPj0gMCAmJiAkQVJHVlskI0FSR1ZdID1+IG18XC5cdyskfCA/IHBvcCA6IHVu ZGVmOworbXkgJGZsYXZvdXIgPSAkI0FSR1YgPj0gMCAmJiAkQVJHVlswXSAhfiBtfFwufCA/IHNo aWZ0IDogdW5kZWY7CisKKyRvdXRwdXQgYW5kIG9wZW4gU1RET1VULCI+JG91dHB1dCI7CisKK215 ICRjb2RlPTw8X19fOworLnRleHQKK19fXworCitteSAoJFYwLCAkVjEsICRWMiwgJFYzLCAkVjQs ICRWNSwgJFY2LCAkVjcsCisgICAgJFY4LCAkVjksICRWMTAsICRWMTEsICRWMTIsICRWMTMsICRW MTQsICRWMTUsCisgICAgJFYxNiwgJFYxNywgJFYxOCwgJFYxOSwgJFYyMCwgJFYyMSwgJFYyMiwg JFYyMywKKyAgICAkVjI0LCAkVjI1LCAkVjI2LCAkVjI3LCAkVjI4LCAkVjI5LCAkVjMwLCAkVjMx LAorKSA9IG1hcCgidiRfIiwoMC4uMzEpKTsKKworbXkgJEsyNTYgPSAiSzI1NiI7CisKKyMgRnVu Y3Rpb24gYXJndW1lbnRzCitteSAoJEgsICRJTlAsICRMRU4sICRLVCwgJEgyLCAkSU5ERVhfUEFU VEVSTikgPSAoImEwIiwgImExIiwgImEyIiwgImEzIiwgInQzIiwgInQ0Iik7CisKK3N1YiBzaGFf MjU2X2xvYWRfY29uc3RhbnQgeworICAgIG15ICRjb2RlPTw8X19fOworICAgIGxhICRLVCwgJEsy NTYgIyBMb2FkIHJvdW5kIGNvbnN0YW50cyBLMjU2CisgICAgQHtbdmxlMzJfdiAkVjEwLCAkS1Rd fQorICAgIGFkZGkgJEtULCAkS1QsIDE2CisgICAgQHtbdmxlMzJfdiAkVjExLCAkS1RdfQorICAg IGFkZGkgJEtULCAkS1QsIDE2CisgICAgQHtbdmxlMzJfdiAkVjEyLCAkS1RdfQorICAgIGFkZGkg JEtULCAkS1QsIDE2CisgICAgQHtbdmxlMzJfdiAkVjEzLCAkS1RdfQorICAgIGFkZGkgJEtULCAk S1QsIDE2CisgICAgQHtbdmxlMzJfdiAkVjE0LCAkS1RdfQorICAgIGFkZGkgJEtULCAkS1QsIDE2 CisgICAgQHtbdmxlMzJfdiAkVjE1LCAkS1RdfQorICAgIGFkZGkgJEtULCAkS1QsIDE2CisgICAg QHtbdmxlMzJfdiAkVjE2LCAkS1RdfQorICAgIGFkZGkgJEtULCAkS1QsIDE2CisgICAgQHtbdmxl MzJfdiAkVjE3LCAkS1RdfQorICAgIGFkZGkgJEtULCAkS1QsIDE2CisgICAgQHtbdmxlMzJfdiAk VjE4LCAkS1RdfQorICAgIGFkZGkgJEtULCAkS1QsIDE2CisgICAgQHtbdmxlMzJfdiAkVjE5LCAk S1RdfQorICAgIGFkZGkgJEtULCAkS1QsIDE2CisgICAgQHtbdmxlMzJfdiAkVjIwLCAkS1RdfQor ICAgIGFkZGkgJEtULCAkS1QsIDE2CisgICAgQHtbdmxlMzJfdiAkVjIxLCAkS1RdfQorICAgIGFk ZGkgJEtULCAkS1QsIDE2CisgICAgQHtbdmxlMzJfdiAkVjIyLCAkS1RdfQorICAgIGFkZGkgJEtU LCAkS1QsIDE2CisgICAgQHtbdmxlMzJfdiAkVjIzLCAkS1RdfQorICAgIGFkZGkgJEtULCAkS1Qs IDE2CisgICAgQHtbdmxlMzJfdiAkVjI0LCAkS1RdfQorICAgIGFkZGkgJEtULCAkS1QsIDE2Cisg ICAgQHtbdmxlMzJfdiAkVjI1LCAkS1RdfQorX19fCisKKyAgICByZXR1cm4gJGNvZGU7Cit9CisK KyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMj IyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjCisjIHZvaWQgc2hhMjU2X2Jsb2NrX2RhdGFfb3JkZXJf enZrYl96dmtuaGFfb3JfenZrbmhiKHZvaWQgKmMsIGNvbnN0IHZvaWQgKnAsIHNpemVfdCBsZW4p CiskY29kZSAuPSA8PF9fXzsKKy5wMmFsaWduIDIKKy5nbG9ibCBzaGEyNTZfYmxvY2tfZGF0YV9v cmRlcl96dmtiX3p2a25oYV9vcl96dmtuaGIKKy50eXBlICAgc2hhMjU2X2Jsb2NrX2RhdGFfb3Jk ZXJfenZrYl96dmtuaGFfb3JfenZrbmhiLFxAZnVuY3Rpb24KK3NoYTI1Nl9ibG9ja19kYXRhX29y ZGVyX3p2a2JfenZrbmhhX29yX3p2a25oYjoKKyAgICBAe1t2c2V0aXZsaSAiemVybyIsIDQsICJl MzIiLCAibTEiLCAidGEiLCAibWEiXX0KKworICAgIEB7W3NoYV8yNTZfbG9hZF9jb25zdGFudF19 CisKKyAgICAjIEggaXMgc3RvcmVkIGFzIHthLGIsYyxkfSx7ZSxmLGcsaH0sIGJ1dCB3ZSBuZWVk IHtmLGUsYixhfSx7aCxnLGQsY30KKyAgICAjIFRoZSBkc3QgdnR5cGUgaXMgZTMybTEgYW5kIHRo ZSBpbmRleCB2dHlwZSBpcyBlOG1mNC4KKyAgICAjIFdlIHVzZSBpbmRleC1sb2FkIHdpdGggdGhl IGZvbGxvd2luZyBpbmRleCBwYXR0ZXJuIGF0IHYyNi4KKyAgICAjICAgaTggaW5kZXg6CisgICAg IyAgICAgMjAsIDE2LCA0LCAwCisgICAgIyBJbnN0ZWFkIG9mIHNldHRpbmcgdGhlIGk4IGluZGV4 LCB3ZSBjb3VsZCB1c2UgYSBzaW5nbGUgMzJiaXQKKyAgICAjIGxpdHRsZS1lbmRpYW4gdmFsdWUg dG8gY292ZXIgdGhlIDR4aTggaW5kZXguCisgICAgIyAgIGkzMiB2YWx1ZToKKyAgICAjICAgICAw eCAwMCAwNCAxMCAxNAorICAgIGxpICRJTkRFWF9QQVRURVJOLCAweDAwMDQxMDE0CisgICAgQHtb dnNldGl2bGkgInplcm8iLCAxLCAiZTMyIiwgIm0xIiwgInRhIiwgIm1hIl19CisgICAgQHtbdm12 X3ZfeCAkVjI2LCAkSU5ERVhfUEFUVEVSTl19CisKKyAgICBhZGRpICRIMiwgJEgsIDgKKworICAg ICMgVXNlIGluZGV4LWxvYWQgdG8gZ2V0IHtmLGUsYixhfSx7aCxnLGQsY30KKyAgICBAe1t2c2V0 aXZsaSAiemVybyIsIDQsICJlMzIiLCAibTEiLCAidGEiLCAibWEiXX0KKyAgICBAe1t2bHV4ZWk4 X3YgJFY2LCAkSCwgJFYyNl19CisgICAgQHtbdmx1eGVpOF92ICRWNywgJEgyLCAkVjI2XX0KKwor ICAgICMgU2V0dXAgdjAgbWFzayBmb3IgdGhlIHZtZXJnZSB0byByZXBsYWNlIHRoZSBmaXJzdCB3 b3JkIChpZHg9PTApIGluIGtleS1zY2hlZHVsaW5nLgorICAgICMgVGhlIEFWTCBpcyA0IGluIFNI QSwgc28gd2UgY291bGQgdXNlIGEgc2luZ2xlIGU4KDggZWxlbWVudCBtYXNraW5nKSBmb3IgbWFz a2luZy4KKyAgICBAe1t2c2V0aXZsaSAiemVybyIsIDEsICJlOCIsICJtMSIsICJ0YSIsICJtYSJd fQorICAgIEB7W3Ztdl92X2kgJFYwLCAweDAxXX0KKworICAgIEB7W3ZzZXRpdmxpICJ6ZXJvIiwg NCwgImUzMiIsICJtMSIsICJ0YSIsICJtYSJdfQorCitMX3JvdW5kX2xvb3A6CisgICAgIyBEZWNy ZW1lbnQgbGVuZ3RoIGJ5IDEKKyAgICBhZGQgJExFTiwgJExFTiwgLTEKKworICAgICMgS2VlcCB0 aGUgY3VycmVudCBzdGF0ZSBhcyB3ZSBuZWVkIGl0IGxhdGVyOiBIJyA9IEgre2EnLGInLGMnLC4u LixoJ30uCisgICAgQHtbdm12X3ZfdiAkVjMwLCAkVjZdfQorICAgIEB7W3Ztdl92X3YgJFYzMSwg JFY3XX0KKworICAgICMgTG9hZCB0aGUgNTEyLWJpdHMgb2YgdGhlIG1lc3NhZ2UgYmxvY2sgaW4g djEtdjQgYW5kIHBlcmZvcm0KKyAgICAjIGFuIGVuZGlhbiBzd2FwIG9uIGVhY2ggNCBieXRlcyBl bGVtZW50LgorICAgIEB7W3ZsZTMyX3YgJFYxLCAkSU5QXX0KKyAgICBAe1t2cmV2OF92ICRWMSwg JFYxXX0KKyAgICBhZGQgJElOUCwgJElOUCwgMTYKKyAgICBAe1t2bGUzMl92ICRWMiwgJElOUF19 CisgICAgQHtbdnJldjhfdiAkVjIsICRWMl19CisgICAgYWRkICRJTlAsICRJTlAsIDE2CisgICAg QHtbdmxlMzJfdiAkVjMsICRJTlBdfQorICAgIEB7W3ZyZXY4X3YgJFYzLCAkVjNdfQorICAgIGFk ZCAkSU5QLCAkSU5QLCAxNgorICAgIEB7W3ZsZTMyX3YgJFY0LCAkSU5QXX0KKyAgICBAe1t2cmV2 OF92ICRWNCwgJFY0XX0KKyAgICBhZGQgJElOUCwgJElOUCwgMTYKKworICAgICMgUXVhZC1yb3Vu ZCAwICgrMCwgV3QgZnJvbSBvbGRlc3QgdG8gbmV3ZXN0IGluIHYxLT52Mi0+djMtPnY0KQorICAg IEB7W3ZhZGRfdnYgJFY1LCAkVjEwLCAkVjFdfQorICAgIEB7W3ZzaGEyY2xfdnYgJFY3LCAkVjYs ICRWNV19CisgICAgQHtbdnNoYTJjaF92diAkVjYsICRWNywgJFY1XX0KKyAgICBAe1t2bWVyZ2Vf dnZtICRWNSwgJFYzLCAkVjIsICRWMF19CisgICAgQHtbdnNoYTJtc192diAkVjEsICRWNSwgJFY0 XX0gICMgR2VuZXJhdGUgV1sxOToxNl0KKworICAgICMgUXVhZC1yb3VuZCAxICgrMSwgdjItPnYz LT52NC0+djEpCisgICAgQHtbdmFkZF92diAkVjUsICRWMTEsICRWMl19CisgICAgQHtbdnNoYTJj bF92diAkVjcsICRWNiwgJFY1XX0KKyAgICBAe1t2c2hhMmNoX3Z2ICRWNiwgJFY3LCAkVjVdfQor ICAgIEB7W3ZtZXJnZV92dm0gJFY1LCAkVjQsICRWMywgJFYwXX0KKyAgICBAe1t2c2hhMm1zX3Z2 ICRWMiwgJFY1LCAkVjFdfSAgIyBHZW5lcmF0ZSBXWzIzOjIwXQorCisgICAgIyBRdWFkLXJvdW5k IDIgKCsyLCB2My0+djQtPnYxLT52MikKKyAgICBAe1t2YWRkX3Z2ICRWNSwgJFYxMiwgJFYzXX0K KyAgICBAe1t2c2hhMmNsX3Z2ICRWNywgJFY2LCAkVjVdfQorICAgIEB7W3ZzaGEyY2hfdnYgJFY2 LCAkVjcsICRWNV19CisgICAgQHtbdm1lcmdlX3Z2bSAkVjUsICRWMSwgJFY0LCAkVjBdfQorICAg IEB7W3ZzaGEybXNfdnYgJFYzLCAkVjUsICRWMl19ICAjIEdlbmVyYXRlIFdbMjc6MjRdCisKKyAg ICAjIFF1YWQtcm91bmQgMyAoKzMsIHY0LT52MS0+djItPnYzKQorICAgIEB7W3ZhZGRfdnYgJFY1 LCAkVjEzLCAkVjRdfQorICAgIEB7W3ZzaGEyY2xfdnYgJFY3LCAkVjYsICRWNV19CisgICAgQHtb dnNoYTJjaF92diAkVjYsICRWNywgJFY1XX0KKyAgICBAe1t2bWVyZ2VfdnZtICRWNSwgJFYyLCAk VjEsICRWMF19CisgICAgQHtbdnNoYTJtc192diAkVjQsICRWNSwgJFYzXX0gICMgR2VuZXJhdGUg V1szMToyOF0KKworICAgICMgUXVhZC1yb3VuZCA0ICgrMCwgdjEtPnYyLT52My0+djQpCisgICAg QHtbdmFkZF92diAkVjUsICRWMTQsICRWMV19CisgICAgQHtbdnNoYTJjbF92diAkVjcsICRWNiwg JFY1XX0KKyAgICBAe1t2c2hhMmNoX3Z2ICRWNiwgJFY3LCAkVjVdfQorICAgIEB7W3ZtZXJnZV92 dm0gJFY1LCAkVjMsICRWMiwgJFYwXX0KKyAgICBAe1t2c2hhMm1zX3Z2ICRWMSwgJFY1LCAkVjRd fSAgIyBHZW5lcmF0ZSBXWzM1OjMyXQorCisgICAgIyBRdWFkLXJvdW5kIDUgKCsxLCB2Mi0+djMt PnY0LT52MSkKKyAgICBAe1t2YWRkX3Z2ICRWNSwgJFYxNSwgJFYyXX0KKyAgICBAe1t2c2hhMmNs X3Z2ICRWNywgJFY2LCAkVjVdfQorICAgIEB7W3ZzaGEyY2hfdnYgJFY2LCAkVjcsICRWNV19Cisg ICAgQHtbdm1lcmdlX3Z2bSAkVjUsICRWNCwgJFYzLCAkVjBdfQorICAgIEB7W3ZzaGEybXNfdnYg JFYyLCAkVjUsICRWMV19ICAjIEdlbmVyYXRlIFdbMzk6MzZdCisKKyAgICAjIFF1YWQtcm91bmQg NiAoKzIsIHYzLT52NC0+djEtPnYyKQorICAgIEB7W3ZhZGRfdnYgJFY1LCAkVjE2LCAkVjNdfQor ICAgIEB7W3ZzaGEyY2xfdnYgJFY3LCAkVjYsICRWNV19CisgICAgQHtbdnNoYTJjaF92diAkVjYs ICRWNywgJFY1XX0KKyAgICBAe1t2bWVyZ2VfdnZtICRWNSwgJFYxLCAkVjQsICRWMF19CisgICAg QHtbdnNoYTJtc192diAkVjMsICRWNSwgJFYyXX0gICMgR2VuZXJhdGUgV1s0Mzo0MF0KKworICAg ICMgUXVhZC1yb3VuZCA3ICgrMywgdjQtPnYxLT52Mi0+djMpCisgICAgQHtbdmFkZF92diAkVjUs ICRWMTcsICRWNF19CisgICAgQHtbdnNoYTJjbF92diAkVjcsICRWNiwgJFY1XX0KKyAgICBAe1t2 c2hhMmNoX3Z2ICRWNiwgJFY3LCAkVjVdfQorICAgIEB7W3ZtZXJnZV92dm0gJFY1LCAkVjIsICRW MSwgJFYwXX0KKyAgICBAe1t2c2hhMm1zX3Z2ICRWNCwgJFY1LCAkVjNdfSAgIyBHZW5lcmF0ZSBX WzQ3OjQ0XQorCisgICAgIyBRdWFkLXJvdW5kIDggKCswLCB2MS0+djItPnYzLT52NCkKKyAgICBA e1t2YWRkX3Z2ICRWNSwgJFYxOCwgJFYxXX0KKyAgICBAe1t2c2hhMmNsX3Z2ICRWNywgJFY2LCAk VjVdfQorICAgIEB7W3ZzaGEyY2hfdnYgJFY2LCAkVjcsICRWNV19CisgICAgQHtbdm1lcmdlX3Z2 bSAkVjUsICRWMywgJFYyLCAkVjBdfQorICAgIEB7W3ZzaGEybXNfdnYgJFYxLCAkVjUsICRWNF19 ICAjIEdlbmVyYXRlIFdbNTE6NDhdCisKKyAgICAjIFF1YWQtcm91bmQgOSAoKzEsIHYyLT52My0+ djQtPnYxKQorICAgIEB7W3ZhZGRfdnYgJFY1LCAkVjE5LCAkVjJdfQorICAgIEB7W3ZzaGEyY2xf dnYgJFY3LCAkVjYsICRWNV19CisgICAgQHtbdnNoYTJjaF92diAkVjYsICRWNywgJFY1XX0KKyAg ICBAe1t2bWVyZ2VfdnZtICRWNSwgJFY0LCAkVjMsICRWMF19CisgICAgQHtbdnNoYTJtc192diAk VjIsICRWNSwgJFYxXX0gICMgR2VuZXJhdGUgV1s1NTo1Ml0KKworICAgICMgUXVhZC1yb3VuZCAx MCAoKzIsIHYzLT52NC0+djEtPnYyKQorICAgIEB7W3ZhZGRfdnYgJFY1LCAkVjIwLCAkVjNdfQor ICAgIEB7W3ZzaGEyY2xfdnYgJFY3LCAkVjYsICRWNV19CisgICAgQHtbdnNoYTJjaF92diAkVjYs ICRWNywgJFY1XX0KKyAgICBAe1t2bWVyZ2VfdnZtICRWNSwgJFYxLCAkVjQsICRWMF19CisgICAg QHtbdnNoYTJtc192diAkVjMsICRWNSwgJFYyXX0gICMgR2VuZXJhdGUgV1s1OTo1Nl0KKworICAg ICMgUXVhZC1yb3VuZCAxMSAoKzMsIHY0LT52MS0+djItPnYzKQorICAgIEB7W3ZhZGRfdnYgJFY1 LCAkVjIxLCAkVjRdfQorICAgIEB7W3ZzaGEyY2xfdnYgJFY3LCAkVjYsICRWNV19CisgICAgQHtb dnNoYTJjaF92diAkVjYsICRWNywgJFY1XX0KKyAgICBAe1t2bWVyZ2VfdnZtICRWNSwgJFYyLCAk VjEsICRWMF19CisgICAgQHtbdnNoYTJtc192diAkVjQsICRWNSwgJFYzXX0gICMgR2VuZXJhdGUg V1s2Mzo2MF0KKworICAgICMgUXVhZC1yb3VuZCAxMiAoKzAsIHYxLT52Mi0+djMtPnY0KQorICAg ICMgTm90ZSB0aGF0IHdlIHN0b3AgZ2VuZXJhdGluZyBuZXcgbWVzc2FnZSBzY2hlZHVsZSB3b3Jk cyAoV3QsIHYxLTEzKQorICAgICMgYXMgd2UgYWxyZWFkeSBnZW5lcmF0ZWQgYWxsIHRoZSB3b3Jk cyB3ZSBlbmQgdXAgY29uc3VtaW5nIChpLmUuLCBXWzYzOjYwXSkuCisgICAgQHtbdmFkZF92diAk VjUsICRWMjIsICRWMV19CisgICAgQHtbdnNoYTJjbF92diAkVjcsICRWNiwgJFY1XX0KKyAgICBA e1t2c2hhMmNoX3Z2ICRWNiwgJFY3LCAkVjVdfQorCisgICAgIyBRdWFkLXJvdW5kIDEzICgrMSwg djItPnYzLT52NC0+djEpCisgICAgQHtbdmFkZF92diAkVjUsICRWMjMsICRWMl19CisgICAgQHtb dnNoYTJjbF92diAkVjcsICRWNiwgJFY1XX0KKyAgICBAe1t2c2hhMmNoX3Z2ICRWNiwgJFY3LCAk VjVdfQorCisgICAgIyBRdWFkLXJvdW5kIDE0ICgrMiwgdjMtPnY0LT52MS0+djIpCisgICAgQHtb dmFkZF92diAkVjUsICRWMjQsICRWM119CisgICAgQHtbdnNoYTJjbF92diAkVjcsICRWNiwgJFY1 XX0KKyAgICBAe1t2c2hhMmNoX3Z2ICRWNiwgJFY3LCAkVjVdfQorCisgICAgIyBRdWFkLXJvdW5k IDE1ICgrMywgdjQtPnYxLT52Mi0+djMpCisgICAgQHtbdmFkZF92diAkVjUsICRWMjUsICRWNF19 CisgICAgQHtbdnNoYTJjbF92diAkVjcsICRWNiwgJFY1XX0KKyAgICBAe1t2c2hhMmNoX3Z2ICRW NiwgJFY3LCAkVjVdfQorCisgICAgIyBIJyA9IEgre2EnLGInLGMnLC4uLixoJ30KKyAgICBAe1t2 YWRkX3Z2ICRWNiwgJFYzMCwgJFY2XX0KKyAgICBAe1t2YWRkX3Z2ICRWNywgJFYzMSwgJFY3XX0K KyAgICBibmV6ICRMRU4sIExfcm91bmRfbG9vcAorCisgICAgIyBTdG9yZSB7ZixlLGIsYX0se2gs ZyxkLGN9IGJhY2sgdG8ge2EsYixjLGR9LHtlLGYsZyxofS4KKyAgICBAe1t2c3V4ZWk4X3YgJFY2 LCAkSCwgJFYyNl19CisgICAgQHtbdnN1eGVpOF92ICRWNywgJEgyLCAkVjI2XX0KKworICAgIHJl dAorLnNpemUgc2hhMjU2X2Jsb2NrX2RhdGFfb3JkZXJfenZrYl96dmtuaGFfb3JfenZrbmhiLC4t c2hhMjU2X2Jsb2NrX2RhdGFfb3JkZXJfenZrYl96dmtuaGFfb3JfenZrbmhiCisKKy5wMmFsaWdu IDIKKy50eXBlICRLMjU2LFxAb2JqZWN0CiskSzI1NjoKKyAgICAud29yZCAweDQyOGEyZjk4LCAw eDcxMzc0NDkxLCAweGI1YzBmYmNmLCAweGU5YjVkYmE1CisgICAgLndvcmQgMHgzOTU2YzI1Yiwg MHg1OWYxMTFmMSwgMHg5MjNmODJhNCwgMHhhYjFjNWVkNQorICAgIC53b3JkIDB4ZDgwN2FhOTgs IDB4MTI4MzViMDEsIDB4MjQzMTg1YmUsIDB4NTUwYzdkYzMKKyAgICAud29yZCAweDcyYmU1ZDc0 LCAweDgwZGViMWZlLCAweDliZGMwNmE3LCAweGMxOWJmMTc0CisgICAgLndvcmQgMHhlNDliNjlj MSwgMHhlZmJlNDc4NiwgMHgwZmMxOWRjNiwgMHgyNDBjYTFjYworICAgIC53b3JkIDB4MmRlOTJj NmYsIDB4NGE3NDg0YWEsIDB4NWNiMGE5ZGMsIDB4NzZmOTg4ZGEKKyAgICAud29yZCAweDk4M2U1 MTUyLCAweGE4MzFjNjZkLCAweGIwMDMyN2M4LCAweGJmNTk3ZmM3CisgICAgLndvcmQgMHhjNmUw MGJmMywgMHhkNWE3OTE0NywgMHgwNmNhNjM1MSwgMHgxNDI5Mjk2NworICAgIC53b3JkIDB4Mjdi NzBhODUsIDB4MmUxYjIxMzgsIDB4NGQyYzZkZmMsIDB4NTMzODBkMTMKKyAgICAud29yZCAweDY1 MGE3MzU0LCAweDc2NmEwYWJiLCAweDgxYzJjOTJlLCAweDkyNzIyYzg1CisgICAgLndvcmQgMHhh MmJmZThhMSwgMHhhODFhNjY0YiwgMHhjMjRiOGI3MCwgMHhjNzZjNTFhMworICAgIC53b3JkIDB4 ZDE5MmU4MTksIDB4ZDY5OTA2MjQsIDB4ZjQwZTM1ODUsIDB4MTA2YWEwNzAKKyAgICAud29yZCAw eDE5YTRjMTE2LCAweDFlMzc2YzA4LCAweDI3NDg3NzRjLCAweDM0YjBiY2I1CisgICAgLndvcmQg MHgzOTFjMGNiMywgMHg0ZWQ4YWE0YSwgMHg1YjljY2E0ZiwgMHg2ODJlNmZmMworICAgIC53b3Jk IDB4NzQ4ZjgyZWUsIDB4NzhhNTYzNmYsIDB4ODRjODc4MTQsIDB4OGNjNzAyMDgKKyAgICAud29y ZCAweDkwYmVmZmZhLCAweGE0NTA2Y2ViLCAweGJlZjlhM2Y3LCAweGM2NzE3OGYyCisuc2l6ZSAk SzI1NiwuLSRLMjU2CitfX18KKworcHJpbnQgJGNvZGU7CisKK2Nsb3NlIFNURE9VVCBvciBkaWUg ImVycm9yIGNsb3NpbmcgU1RET1VUOiAkISI7Ci0tIAoyLjI4LjAKCgpfX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwpsaW51eC1yaXNjdiBtYWlsaW5nIGxpc3QK bGludXgtcmlzY3ZAbGlzdHMuaW5mcmFkZWFkLm9yZwpodHRwOi8vbGlzdHMuaW5mcmFkZWFkLm9y Zy9tYWlsbWFuL2xpc3RpbmZvL2xpbnV4LXJpc2N2Cg==