From mboxrd@z Thu Jan 1 00:00:00 1970 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=sifive.com header.i=@sifive.com header.b="bOXzYwyB" Received: from mail-oo1-xc2d.google.com (mail-oo1-xc2d.google.com [IPv6:2607:f8b0:4864:20::c2d]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 592CF173D for ; Tue, 5 Dec 2023 01:28:51 -0800 (PST) Received: by mail-oo1-xc2d.google.com with SMTP id 006d021491bc7-58d3c5126e9so3303899eaf.1 for ; Tue, 05 Dec 2023 01:28:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sifive.com; s=google; t=1701768530; x=1702373330; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=UrD2FGOwoOZDuE5NlOXPwH6yjK7drVhBh94o1xKypaI=; b=bOXzYwyBELOoYAVRjQGwgE9CyCao25Sbz1BnHTwCjb5kHlveCYaDVmHgppZl/ejZu1 p9/a6ghaQeTFHyQKN67svefudVC8zg7XxmB33K8uGaEHBH/B4qvY7BOlVTqYivIOnw6q 0m8KIqsrVrOpg5PbUS+e0bThHxAWVMA68QzLfjAq1lu45k0j2gfU+KzjEAmy4C2bMzgE KeBHPYIYI19K9KcNX+Te9SbRQ8ApqOUdIjEYh0BzC9OtKCUIhHtTLSuUKOS0DbqaG/n7 dr1IRoVT8tJgnV5dpnLuPIH/17Y6KO8p0iFLKNyJUKws7zB03iuS6dhIHpaMESbW2KDg tnBw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1701768530; x=1702373330; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=UrD2FGOwoOZDuE5NlOXPwH6yjK7drVhBh94o1xKypaI=; b=LZFwUktxG9Z0/bX1CDzb8glA97aiVNW9tkYmLYlVH01ImK5E8/xrN+8eFu5LWhWhb4 CMAOOoH5Q9q7oIt/AtpRhP+rymNwK4euvDQ1Bsc+Tha5ixVf9nOi/HrF4h+eEbL6XOy4 BTVpD9tJaraH+GUxQmobZZIVMdPukkH9rxYddC1QoiQTvNBtdmPO8GT9/VTk1xHz3guU WH7VDg7dbzH6F2SY95lwHFCIIh5rkXC/xbj39+pTCH/V7RLXNBfMfKkECP3kaQa2DlPj WPpBiXtRxdSzTIcedhQ+si/e/HI0/sLu1IKoA/xwmZUvFmmRq/H7JS+ZNQKnc5m40fBz 0HIg== X-Gm-Message-State: AOJu0YzZoXEe/FKlDEEemUTzVYyNsCRwRoSMcboIaubYuEC2HWQaGJCs El8/jvFAedoObB4t0qyyh7rDpA== X-Google-Smtp-Source: AGHT+IFlw/eNWQfj1E9SO5ziBC4YcAjeADQV1vJQPokw/77J0tn0kdtl0+xtImh1bzSOK9d8sTqAdg== X-Received: by 2002:a05:6358:9486:b0:170:17eb:1de with SMTP id i6-20020a056358948600b0017017eb01demr2962408rwb.33.1701768530373; Tue, 05 Dec 2023 01:28:50 -0800 (PST) Received: from localhost.localdomain ([101.10.93.135]) by smtp.gmail.com with ESMTPSA id l6-20020a056a00140600b006cdd723bb6fsm8858788pfu.115.2023.12.05.01.28.47 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 05 Dec 2023 01:28:50 -0800 (PST) From: Jerry Shih To: paul.walmsley@sifive.com, palmer@dabbelt.com, aou@eecs.berkeley.edu, herbert@gondor.apana.org.au, davem@davemloft.net, conor.dooley@microchip.com, ebiggers@kernel.org, ardb@kernel.org, conor@kernel.org Cc: heiko@sntech.de, phoebe.chen@sifive.com, hongrong.hsu@sifive.com, linux-riscv@lists.infradead.org, linux-kernel@vger.kernel.org, linux-crypto@vger.kernel.org Subject: [PATCH v3 11/12] RISC-V: crypto: add Zvksh accelerated SM3 implementation Date: Tue, 5 Dec 2023 17:28:00 +0800 Message-Id: <20231205092801.1335-12-jerry.shih@sifive.com> X-Mailer: git-send-email 2.28.0 In-Reply-To: <20231205092801.1335-1-jerry.shih@sifive.com> References: <20231205092801.1335-1-jerry.shih@sifive.com> Precedence: bulk X-Mailing-List: linux-crypto@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Add SM3 implementation using Zvksh vector crypto extension from OpenSSL (openssl/openssl#21923). Co-developed-by: Christoph Müllner Signed-off-by: Christoph Müllner Co-developed-by: Heiko Stuebner Signed-off-by: Heiko Stuebner Signed-off-by: Jerry Shih --- Changelog v3: - Use `SYM_TYPED_FUNC_START` for sm3 indirect-call asm symbol. - Use asm mnemonics for the instructions in RVV 1.0 extension. Changelog v2: - Do not turn on kconfig `SM3_RISCV64` option by default. - Add `asmlinkage` qualifier for crypto asm function. - Rename sm3-riscv64-zvkb-zvksh to sm3-riscv64-zvksh-zvkb. - Reorder structure sm3_alg members initialization in the order declared. --- arch/riscv/crypto/Kconfig | 12 ++ arch/riscv/crypto/Makefile | 7 + arch/riscv/crypto/sm3-riscv64-glue.c | 124 ++++++++++++++ arch/riscv/crypto/sm3-riscv64-zvksh.pl | 227 +++++++++++++++++++++++++ 4 files changed, 370 insertions(+) create mode 100644 arch/riscv/crypto/sm3-riscv64-glue.c create mode 100644 arch/riscv/crypto/sm3-riscv64-zvksh.pl diff --git a/arch/riscv/crypto/Kconfig b/arch/riscv/crypto/Kconfig index b28cf1972250..7415fb303785 100644 --- a/arch/riscv/crypto/Kconfig +++ b/arch/riscv/crypto/Kconfig @@ -66,6 +66,18 @@ config CRYPTO_SHA512_RISCV64 - Zvknhb vector crypto extension - Zvkb vector crypto extension +config CRYPTO_SM3_RISCV64 + tristate "Hash functions: SM3 (ShangMi 3)" + depends on 64BIT && RISCV_ISA_V + select CRYPTO_HASH + select CRYPTO_SM3 + help + SM3 (ShangMi 3) secure hash function (OSCCA GM/T 0004-2012) + + Architecture: riscv64 using: + - Zvksh vector crypto extension + - Zvkb vector crypto extension + config CRYPTO_SM4_RISCV64 tristate "Ciphers: SM4 (ShangMi 4)" depends on 64BIT && RISCV_ISA_V diff --git a/arch/riscv/crypto/Makefile b/arch/riscv/crypto/Makefile index 8e34861bba34..b1f857695c1c 100644 --- a/arch/riscv/crypto/Makefile +++ b/arch/riscv/crypto/Makefile @@ -18,6 +18,9 @@ sha256-riscv64-y := sha256-riscv64-glue.o sha256-riscv64-zvknha_or_zvknhb-zvkb.o obj-$(CONFIG_CRYPTO_SHA512_RISCV64) += sha512-riscv64.o sha512-riscv64-y := sha512-riscv64-glue.o sha512-riscv64-zvknhb-zvkb.o +obj-$(CONFIG_CRYPTO_SM3_RISCV64) += sm3-riscv64.o +sm3-riscv64-y := sm3-riscv64-glue.o sm3-riscv64-zvksh.o + obj-$(CONFIG_CRYPTO_SM4_RISCV64) += sm4-riscv64.o sm4-riscv64-y := sm4-riscv64-glue.o sm4-riscv64-zvksed.o @@ -42,6 +45,9 @@ $(obj)/sha256-riscv64-zvknha_or_zvknhb-zvkb.S: $(src)/sha256-riscv64-zvknha_or_z $(obj)/sha512-riscv64-zvknhb-zvkb.S: $(src)/sha512-riscv64-zvknhb-zvkb.pl $(call cmd,perlasm) +$(obj)/sm3-riscv64-zvksh.S: $(src)/sm3-riscv64-zvksh.pl + $(call cmd,perlasm) + $(obj)/sm4-riscv64-zvksed.S: $(src)/sm4-riscv64-zvksed.pl $(call cmd,perlasm) @@ -51,4 +57,5 @@ clean-files += aes-riscv64-zvkned-zvkb.S clean-files += ghash-riscv64-zvkg.S clean-files += sha256-riscv64-zvknha_or_zvknhb-zvkb.S clean-files += sha512-riscv64-zvknhb-zvkb.S +clean-files += sm3-riscv64-zvksh.S clean-files += sm4-riscv64-zvksed.S diff --git a/arch/riscv/crypto/sm3-riscv64-glue.c b/arch/riscv/crypto/sm3-riscv64-glue.c new file mode 100644 index 000000000000..0e5a2b84c930 --- /dev/null +++ b/arch/riscv/crypto/sm3-riscv64-glue.c @@ -0,0 +1,124 @@ +// SPDX-License-Identifier: GPL-2.0-or-later +/* + * Linux/riscv64 port of the OpenSSL SM3 implementation for RISC-V 64 + * + * Copyright (C) 2023 VRULL GmbH + * Author: Heiko Stuebner + * + * Copyright (C) 2023 SiFive, Inc. + * Author: Jerry Shih + */ + +#include +#include +#include +#include +#include +#include +#include +#include + +/* + * sm3 using zvksh vector crypto extension + * + * This asm function will just take the first 256-bit as the sm3 state from + * the pointer to `struct sm3_state`. + */ +asmlinkage void ossl_hwsm3_block_data_order_zvksh(struct sm3_state *digest, + u8 const *o, int num); + +static int riscv64_sm3_update(struct shash_desc *desc, const u8 *data, + unsigned int len) +{ + int ret = 0; + + /* + * Make sure struct sm3_state begins directly with the SM3 256-bit internal + * state, as this is what the asm function expect. + */ + BUILD_BUG_ON(offsetof(struct sm3_state, state) != 0); + + if (crypto_simd_usable()) { + kernel_vector_begin(); + ret = sm3_base_do_update(desc, data, len, + ossl_hwsm3_block_data_order_zvksh); + kernel_vector_end(); + } else { + sm3_update(shash_desc_ctx(desc), data, len); + } + + return ret; +} + +static int riscv64_sm3_finup(struct shash_desc *desc, const u8 *data, + unsigned int len, u8 *out) +{ + struct sm3_state *ctx; + + if (crypto_simd_usable()) { + kernel_vector_begin(); + if (len) + sm3_base_do_update(desc, data, len, + ossl_hwsm3_block_data_order_zvksh); + sm3_base_do_finalize(desc, ossl_hwsm3_block_data_order_zvksh); + kernel_vector_end(); + + return sm3_base_finish(desc, out); + } + + ctx = shash_desc_ctx(desc); + if (len) + sm3_update(ctx, data, len); + sm3_final(ctx, out); + + return 0; +} + +static int riscv64_sm3_final(struct shash_desc *desc, u8 *out) +{ + return riscv64_sm3_finup(desc, NULL, 0, out); +} + +static struct shash_alg sm3_alg = { + .init = sm3_base_init, + .update = riscv64_sm3_update, + .final = riscv64_sm3_final, + .finup = riscv64_sm3_finup, + .descsize = sizeof(struct sm3_state), + .digestsize = SM3_DIGEST_SIZE, + .base = { + .cra_blocksize = SM3_BLOCK_SIZE, + .cra_priority = 150, + .cra_name = "sm3", + .cra_driver_name = "sm3-riscv64-zvksh-zvkb", + .cra_module = THIS_MODULE, + }, +}; + +static inline bool check_sm3_ext(void) +{ + return riscv_isa_extension_available(NULL, ZVKSH) && + riscv_isa_extension_available(NULL, ZVKB) && + riscv_vector_vlen() >= 128; +} + +static int __init riscv64_sm3_mod_init(void) +{ + if (check_sm3_ext()) + return crypto_register_shash(&sm3_alg); + + return -ENODEV; +} + +static void __exit riscv64_sm3_mod_fini(void) +{ + crypto_unregister_shash(&sm3_alg); +} + +module_init(riscv64_sm3_mod_init); +module_exit(riscv64_sm3_mod_fini); + +MODULE_DESCRIPTION("SM3 (RISC-V accelerated)"); +MODULE_AUTHOR("Heiko Stuebner "); +MODULE_LICENSE("GPL"); +MODULE_ALIAS_CRYPTO("sm3"); diff --git a/arch/riscv/crypto/sm3-riscv64-zvksh.pl b/arch/riscv/crypto/sm3-riscv64-zvksh.pl new file mode 100644 index 000000000000..6a2399d3a5cf --- /dev/null +++ b/arch/riscv/crypto/sm3-riscv64-zvksh.pl @@ -0,0 +1,227 @@ +#! /usr/bin/env perl +# SPDX-License-Identifier: Apache-2.0 OR BSD-2-Clause +# +# This file is dual-licensed, meaning that you can use it under your +# choice of either of the following two licenses: +# +# Copyright 2023 The OpenSSL Project Authors. All Rights Reserved. +# +# Licensed under the Apache License 2.0 (the "License"). You can obtain +# a copy in the file LICENSE in the source distribution or at +# https://www.openssl.org/source/license.html +# +# or +# +# Copyright (c) 2023, Christoph Müllner +# Copyright (c) 2023, Jerry Shih +# All rights reserved. +# +# Redistribution and use in source and binary forms, with or without +# modification, are permitted provided that the following conditions +# are met: +# 1. Redistributions of source code must retain the above copyright +# notice, this list of conditions and the following disclaimer. +# 2. Redistributions in binary form must reproduce the above copyright +# notice, this list of conditions and the following disclaimer in the +# documentation and/or other materials provided with the distribution. +# +# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS +# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT +# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR +# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT +# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, +# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT +# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, +# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY +# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT +# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE +# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. + +# The generated code of this file depends on the following RISC-V extensions: +# - RV64I +# - RISC-V Vector ('V') with VLEN >= 128 +# - RISC-V Vector Cryptography Bit-manipulation extension ('Zvkb') +# - RISC-V Vector SM3 Secure Hash extension ('Zvksh') + +use strict; +use warnings; + +use FindBin qw($Bin); +use lib "$Bin"; +use lib "$Bin/../../perlasm"; +use riscv; + +# $output is the last argument if it looks like a file (it has an extension) +# $flavour is the first argument if it doesn't look like a file +my $output = $#ARGV >= 0 && $ARGV[$#ARGV] =~ m|\.\w+$| ? pop : undef; +my $flavour = $#ARGV >= 0 && $ARGV[0] !~ m|\.| ? shift : undef; + +$output and open STDOUT,">$output"; + +my $code=<<___; +#include + +.text +___ + +################################################################################ +# ossl_hwsm3_block_data_order_zvksh(SM3_CTX *c, const void *p, size_t num); +{ +my ($CTX, $INPUT, $NUM) = ("a0", "a1", "a2"); +my ($V0, $V1, $V2, $V3, $V4, $V5, $V6, $V7, + $V8, $V9, $V10, $V11, $V12, $V13, $V14, $V15, + $V16, $V17, $V18, $V19, $V20, $V21, $V22, $V23, + $V24, $V25, $V26, $V27, $V28, $V29, $V30, $V31, +) = map("v$_",(0..31)); + +$code .= <<___; +SYM_TYPED_FUNC_START(ossl_hwsm3_block_data_order_zvksh) + vsetivli zero, 8, e32, m2, ta, ma + + # Load initial state of hash context (c->A-H). + vle32.v $V0, ($CTX) + @{[vrev8_v $V0, $V0]} + +L_sm3_loop: + # Copy the previous state to v2. + # It will be XOR'ed with the current state at the end of the round. + vmv.v.v $V2, $V0 + + # Load the 64B block in 2x32B chunks. + vle32.v $V6, ($INPUT) # v6 := {w7, ..., w0} + addi $INPUT, $INPUT, 32 + + vle32.v $V8, ($INPUT) # v8 := {w15, ..., w8} + addi $INPUT, $INPUT, 32 + + addi $NUM, $NUM, -1 + + # As vsm3c consumes only w0, w1, w4, w5 we need to slide the input + # 2 elements down so we process elements w2, w3, w6, w7 + # This will be repeated for each odd round. + vslidedown.vi $V4, $V6, 2 # v4 := {X, X, w7, ..., w2} + + @{[vsm3c_vi $V0, $V6, 0]} + @{[vsm3c_vi $V0, $V4, 1]} + + # Prepare a vector with {w11, ..., w4} + vslidedown.vi $V4, $V4, 2 # v4 := {X, X, X, X, w7, ..., w4} + vslideup.vi $V4, $V8, 4 # v4 := {w11, w10, w9, w8, w7, w6, w5, w4} + + @{[vsm3c_vi $V0, $V4, 2]} + vslidedown.vi $V4, $V4, 2 # v4 := {X, X, w11, w10, w9, w8, w7, w6} + @{[vsm3c_vi $V0, $V4, 3]} + + @{[vsm3c_vi $V0, $V8, 4]} + vslidedown.vi $V4, $V8, 2 # v4 := {X, X, w15, w14, w13, w12, w11, w10} + @{[vsm3c_vi $V0, $V4, 5]} + + @{[vsm3me_vv $V6, $V8, $V6]} # v6 := {w23, w22, w21, w20, w19, w18, w17, w16} + + # Prepare a register with {w19, w18, w17, w16, w15, w14, w13, w12} + vslidedown.vi $V4, $V4, 2 # v4 := {X, X, X, X, w15, w14, w13, w12} + vslideup.vi $V4, $V6, 4 # v4 := {w19, w18, w17, w16, w15, w14, w13, w12} + + @{[vsm3c_vi $V0, $V4, 6]} + vslidedown.vi $V4, $V4, 2 # v4 := {X, X, w19, w18, w17, w16, w15, w14} + @{[vsm3c_vi $V0, $V4, 7]} + + @{[vsm3c_vi $V0, $V6, 8]} + vslidedown.vi $V4, $V6, 2 # v4 := {X, X, w23, w22, w21, w20, w19, w18} + @{[vsm3c_vi $V0, $V4, 9]} + + @{[vsm3me_vv $V8, $V6, $V8]} # v8 := {w31, w30, w29, w28, w27, w26, w25, w24} + + # Prepare a register with {w27, w26, w25, w24, w23, w22, w21, w20} + vslidedown.vi $V4, $V4, 2 # v4 := {X, X, X, X, w23, w22, w21, w20} + vslideup.vi $V4, $V8, 4 # v4 := {w27, w26, w25, w24, w23, w22, w21, w20} + + @{[vsm3c_vi $V0, $V4, 10]} + vslidedown.vi $V4, $V4, 2 # v4 := {X, X, w27, w26, w25, w24, w23, w22} + @{[vsm3c_vi $V0, $V4, 11]} + + @{[vsm3c_vi $V0, $V8, 12]} + vslidedown.vi $V4, $V8, 2 # v4 := {x, X, w31, w30, w29, w28, w27, w26} + @{[vsm3c_vi $V0, $V4, 13]} + + @{[vsm3me_vv $V6, $V8, $V6]} # v6 := {w32, w33, w34, w35, w36, w37, w38, w39} + + # Prepare a register with {w35, w34, w33, w32, w31, w30, w29, w28} + vslidedown.vi $V4, $V4, 2 # v4 := {X, X, X, X, w31, w30, w29, w28} + vslideup.vi $V4, $V6, 4 # v4 := {w35, w34, w33, w32, w31, w30, w29, w28} + + @{[vsm3c_vi $V0, $V4, 14]} + vslidedown.vi $V4, $V4, 2 # v4 := {X, X, w35, w34, w33, w32, w31, w30} + @{[vsm3c_vi $V0, $V4, 15]} + + @{[vsm3c_vi $V0, $V6, 16]} + vslidedown.vi $V4, $V6, 2 # v4 := {X, X, w39, w38, w37, w36, w35, w34} + @{[vsm3c_vi $V0, $V4, 17]} + + @{[vsm3me_vv $V8, $V6, $V8]} # v8 := {w47, w46, w45, w44, w43, w42, w41, w40} + + # Prepare a register with {w43, w42, w41, w40, w39, w38, w37, w36} + vslidedown.vi $V4, $V4, 2 # v4 := {X, X, X, X, w39, w38, w37, w36} + vslideup.vi $V4, $V8, 4 # v4 := {w43, w42, w41, w40, w39, w38, w37, w36} + + @{[vsm3c_vi $V0, $V4, 18]} + vslidedown.vi $V4, $V4, 2 # v4 := {X, X, w43, w42, w41, w40, w39, w38} + @{[vsm3c_vi $V0, $V4, 19]} + + @{[vsm3c_vi $V0, $V8, 20]} + vslidedown.vi $V4, $V8, 2 # v4 := {X, X, w47, w46, w45, w44, w43, w42} + @{[vsm3c_vi $V0, $V4, 21]} + + @{[vsm3me_vv $V6, $V8, $V6]} # v6 := {w55, w54, w53, w52, w51, w50, w49, w48} + + # Prepare a register with {w51, w50, w49, w48, w47, w46, w45, w44} + vslidedown.vi $V4, $V4, 2 # v4 := {X, X, X, X, w47, w46, w45, w44} + vslideup.vi $V4, $V6, 4 # v4 := {w51, w50, w49, w48, w47, w46, w45, w44} + + @{[vsm3c_vi $V0, $V4, 22]} + vslidedown.vi $V4, $V4, 2 # v4 := {X, X, w51, w50, w49, w48, w47, w46} + @{[vsm3c_vi $V0, $V4, 23]} + + @{[vsm3c_vi $V0, $V6, 24]} + vslidedown.vi $V4, $V6, 2 # v4 := {X, X, w55, w54, w53, w52, w51, w50} + @{[vsm3c_vi $V0, $V4, 25]} + + @{[vsm3me_vv $V8, $V6, $V8]} # v8 := {w63, w62, w61, w60, w59, w58, w57, w56} + + # Prepare a register with {w59, w58, w57, w56, w55, w54, w53, w52} + vslidedown.vi $V4, $V4, 2 # v4 := {X, X, X, X, w55, w54, w53, w52} + vslideup.vi $V4, $V8, 4 # v4 := {w59, w58, w57, w56, w55, w54, w53, w52} + + @{[vsm3c_vi $V0, $V4, 26]} + vslidedown.vi $V4, $V4, 2 # v4 := {X, X, w59, w58, w57, w56, w55, w54} + @{[vsm3c_vi $V0, $V4, 27]} + + @{[vsm3c_vi $V0, $V8, 28]} + vslidedown.vi $V4, $V8, 2 # v4 := {X, X, w63, w62, w61, w60, w59, w58} + @{[vsm3c_vi $V0, $V4, 29]} + + @{[vsm3me_vv $V6, $V8, $V6]} # v6 := {w71, w70, w69, w68, w67, w66, w65, w64} + + # Prepare a register with {w67, w66, w65, w64, w63, w62, w61, w60} + vslidedown.vi $V4, $V4, 2 # v4 := {X, X, X, X, w63, w62, w61, w60} + vslideup.vi $V4, $V6, 4 # v4 := {w67, w66, w65, w64, w63, w62, w61, w60} + + @{[vsm3c_vi $V0, $V4, 30]} + vslidedown.vi $V4, $V4, 2 # v4 := {X, X, w67, w66, w65, w64, w63, w62} + @{[vsm3c_vi $V0, $V4, 31]} + + # XOR in the previous state. + vxor.vv $V0, $V0, $V2 + + bnez $NUM, L_sm3_loop # Check if there are any more block to process +L_sm3_end: + @{[vrev8_v $V0, $V0]} + vse32.v $V0, ($CTX) + ret +SYM_FUNC_END(ossl_hwsm3_block_data_order_zvksh) +___ +} + +print $code; + +close STDOUT or die "error closing STDOUT: $!"; -- 2.28.0 From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 18A0FC10DCE for ; Tue, 5 Dec 2023 09:29:06 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:MIME-Version:References:In-Reply-To: Message-Id:Date:Subject:Cc:To:From:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=w8mz09LDOINMQ9xkUeKMNBfe8RvMd0ElAyE482gWyJs=; b=d1DyKrGk7RjpGy lxvTcK1jABHLWAl+8AuAFZvER5rC+LC+qWddudciMGtpCSYpZX007dhSDFNfXMbgORUX3/I1s5ZoO terKhCMqNevPYa5ulW2jUFCeQerhzB+nUEph4464OA71RdhNwrAw94YLAYYyth5EpQmDGtP9no1Om PqIYjpIGtyjjCL2c/0sqrEO4M+/AfxL54cyCJDJ53y4d6wfPXpdmtPvphR33cR/WhhW3Mo0x1+bCp IdugYgWd8VCEL5n+uOaWj9ZpFRmBmA4wayM6SiXYame4E/BpEBHZ3r+409m+NxUTPwuRHajKtDr1V 9okIKgo9CrfiCrwCjzXQ==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.96 #2 (Red Hat Linux)) id 1rARjg-006o5g-2r; Tue, 05 Dec 2023 09:29:00 +0000 Received: from mail-oo1-xc35.google.com ([2607:f8b0:4864:20::c35]) by bombadil.infradead.org with esmtps (Exim 4.96 #2 (Red Hat Linux)) id 1rARjY-006nzG-0W for linux-riscv@lists.infradead.org; Tue, 05 Dec 2023 09:28:58 +0000 Received: by mail-oo1-xc35.google.com with SMTP id 006d021491bc7-58ceabd7cdeso3302443eaf.3 for ; Tue, 05 Dec 2023 01:28:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sifive.com; s=google; t=1701768530; x=1702373330; darn=lists.infradead.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=UrD2FGOwoOZDuE5NlOXPwH6yjK7drVhBh94o1xKypaI=; b=Td20o2VdlNy+2GuZwqswDOAxRIWwNQdJmJ1r8hm5pdOICsrQdCfL02w8V58Ujb9zJP BzqGB/tQA4e8Aawrn7hLMpo2dhqhUH8+pgC+PzxwSkJR1gxKXElDWCJZmfr3MHsSy+Ji ZXM0IRKc5VGDRJuNhFOE35/BbVSL0Kw3MaKNWsm3Pal0AC8aNOsJ+YXrmjGcCyyY7Z49 /BAGrdVo7bB15iHquSvzVouoYr5F+7Q63YkX8GnbXtukpWyuDyQyaTYyLPHTrMgmCTX4 XfFu0PFeGIc2tls3b/+rK93F9VE8FnA6o6YceoBsoUU6vlCLlb70tSOMQCtOxEW3LgrW M6Mw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1701768530; x=1702373330; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=UrD2FGOwoOZDuE5NlOXPwH6yjK7drVhBh94o1xKypaI=; b=J4rMF8VV5h4RQEbUuO2rH/QRy7o24bImkhw3Ymf0geTWxwtL9QmMelWjNMXzE73J3N Q6epIHl3/J4oxdxvZcIqIBdtsrjyNLRmRiCKtRkea1lh1tF17umq/JpNnntGv3FRrpb4 BWTCE+qwJnlrg8pVjHXxwAZnyJf+xRLyLndVR1ydB39Kv1NrCvJAVsGID9DPoUzbO7it Z7NapCWFlkVjrFbfIjrEMMcJwoFMNX3mZiGlpSf52qZBVUkEerTTbC05PJhx5TFgKTPY CSqAkovCKhQDZQjwyAv05vglUeWcGArzFHQ1UfEXBkqtT78Jpho9+ttzdy2nzPzbe6vh 984A== X-Gm-Message-State: AOJu0YxZkzLwuOqowiwbEB+U8BgT4UATT4DEimjWn4dUPF/bj9LQdn9j QkAgKsp9WbNQcppXz3V6EF2g2g== X-Google-Smtp-Source: AGHT+IFlw/eNWQfj1E9SO5ziBC4YcAjeADQV1vJQPokw/77J0tn0kdtl0+xtImh1bzSOK9d8sTqAdg== X-Received: by 2002:a05:6358:9486:b0:170:17eb:1de with SMTP id i6-20020a056358948600b0017017eb01demr2962408rwb.33.1701768530373; Tue, 05 Dec 2023 01:28:50 -0800 (PST) Received: from localhost.localdomain ([101.10.93.135]) by smtp.gmail.com with ESMTPSA id l6-20020a056a00140600b006cdd723bb6fsm8858788pfu.115.2023.12.05.01.28.47 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 05 Dec 2023 01:28:50 -0800 (PST) From: Jerry Shih To: paul.walmsley@sifive.com, palmer@dabbelt.com, aou@eecs.berkeley.edu, herbert@gondor.apana.org.au, davem@davemloft.net, conor.dooley@microchip.com, ebiggers@kernel.org, ardb@kernel.org, conor@kernel.org Cc: heiko@sntech.de, phoebe.chen@sifive.com, hongrong.hsu@sifive.com, linux-riscv@lists.infradead.org, linux-kernel@vger.kernel.org, linux-crypto@vger.kernel.org Subject: [PATCH v3 11/12] RISC-V: crypto: add Zvksh accelerated SM3 implementation Date: Tue, 5 Dec 2023 17:28:00 +0800 Message-Id: <20231205092801.1335-12-jerry.shih@sifive.com> X-Mailer: git-send-email 2.28.0 In-Reply-To: <20231205092801.1335-1-jerry.shih@sifive.com> References: <20231205092801.1335-1-jerry.shih@sifive.com> MIME-Version: 1.0 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20231205_012852_236904_250D1174 X-CRM114-Status: GOOD ( 31.99 ) X-BeenThere: linux-riscv@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: "linux-riscv" Errors-To: linux-riscv-bounces+linux-riscv=archiver.kernel.org@lists.infradead.org QWRkIFNNMyBpbXBsZW1lbnRhdGlvbiB1c2luZyBadmtzaCB2ZWN0b3IgY3J5cHRvIGV4dGVuc2lv biBmcm9tIE9wZW5TU0wKKG9wZW5zc2wvb3BlbnNzbCMyMTkyMykuCgpDby1kZXZlbG9wZWQtYnk6 IENocmlzdG9waCBNw7xsbG5lciA8Y2hyaXN0b3BoLm11ZWxsbmVyQHZydWxsLmV1PgpTaWduZWQt b2ZmLWJ5OiBDaHJpc3RvcGggTcO8bGxuZXIgPGNocmlzdG9waC5tdWVsbG5lckB2cnVsbC5ldT4K Q28tZGV2ZWxvcGVkLWJ5OiBIZWlrbyBTdHVlYm5lciA8aGVpa28uc3R1ZWJuZXJAdnJ1bGwuZXU+ ClNpZ25lZC1vZmYtYnk6IEhlaWtvIFN0dWVibmVyIDxoZWlrby5zdHVlYm5lckB2cnVsbC5ldT4K U2lnbmVkLW9mZi1ieTogSmVycnkgU2hpaCA8amVycnkuc2hpaEBzaWZpdmUuY29tPgotLS0KQ2hh bmdlbG9nIHYzOgogLSBVc2UgYFNZTV9UWVBFRF9GVU5DX1NUQVJUYCBmb3Igc20zIGluZGlyZWN0 LWNhbGwgYXNtIHN5bWJvbC4KIC0gVXNlIGFzbSBtbmVtb25pY3MgZm9yIHRoZSBpbnN0cnVjdGlv bnMgaW4gUlZWIDEuMCBleHRlbnNpb24uCgpDaGFuZ2Vsb2cgdjI6CiAtIERvIG5vdCB0dXJuIG9u IGtjb25maWcgYFNNM19SSVNDVjY0YCBvcHRpb24gYnkgZGVmYXVsdC4KIC0gQWRkIGBhc21saW5r YWdlYCBxdWFsaWZpZXIgZm9yIGNyeXB0byBhc20gZnVuY3Rpb24uCiAtIFJlbmFtZSBzbTMtcmlz Y3Y2NC16dmtiLXp2a3NoIHRvIHNtMy1yaXNjdjY0LXp2a3NoLXp2a2IuCiAtIFJlb3JkZXIgc3Ry dWN0dXJlIHNtM19hbGcgbWVtYmVycyBpbml0aWFsaXphdGlvbiBpbiB0aGUgb3JkZXIgZGVjbGFy ZWQuCi0tLQogYXJjaC9yaXNjdi9jcnlwdG8vS2NvbmZpZyAgICAgICAgICAgICAgfCAgMTIgKysK IGFyY2gvcmlzY3YvY3J5cHRvL01ha2VmaWxlICAgICAgICAgICAgIHwgICA3ICsKIGFyY2gvcmlz Y3YvY3J5cHRvL3NtMy1yaXNjdjY0LWdsdWUuYyAgIHwgMTI0ICsrKysrKysrKysrKysrCiBhcmNo L3Jpc2N2L2NyeXB0by9zbTMtcmlzY3Y2NC16dmtzaC5wbCB8IDIyNyArKysrKysrKysrKysrKysr KysrKysrKysrCiA0IGZpbGVzIGNoYW5nZWQsIDM3MCBpbnNlcnRpb25zKCspCiBjcmVhdGUgbW9k ZSAxMDA2NDQgYXJjaC9yaXNjdi9jcnlwdG8vc20zLXJpc2N2NjQtZ2x1ZS5jCiBjcmVhdGUgbW9k ZSAxMDA2NDQgYXJjaC9yaXNjdi9jcnlwdG8vc20zLXJpc2N2NjQtenZrc2gucGwKCmRpZmYgLS1n aXQgYS9hcmNoL3Jpc2N2L2NyeXB0by9LY29uZmlnIGIvYXJjaC9yaXNjdi9jcnlwdG8vS2NvbmZp ZwppbmRleCBiMjhjZjE5NzIyNTAuLjc0MTVmYjMwMzc4NSAxMDA2NDQKLS0tIGEvYXJjaC9yaXNj di9jcnlwdG8vS2NvbmZpZworKysgYi9hcmNoL3Jpc2N2L2NyeXB0by9LY29uZmlnCkBAIC02Niw2 ICs2NiwxOCBAQCBjb25maWcgQ1JZUFRPX1NIQTUxMl9SSVNDVjY0CiAJICAtIFp2a25oYiB2ZWN0 b3IgY3J5cHRvIGV4dGVuc2lvbgogCSAgLSBadmtiIHZlY3RvciBjcnlwdG8gZXh0ZW5zaW9uCiAK K2NvbmZpZyBDUllQVE9fU00zX1JJU0NWNjQKKwl0cmlzdGF0ZSAiSGFzaCBmdW5jdGlvbnM6IFNN MyAoU2hhbmdNaSAzKSIKKwlkZXBlbmRzIG9uIDY0QklUICYmIFJJU0NWX0lTQV9WCisJc2VsZWN0 IENSWVBUT19IQVNICisJc2VsZWN0IENSWVBUT19TTTMKKwloZWxwCisJICBTTTMgKFNoYW5nTWkg Mykgc2VjdXJlIGhhc2ggZnVuY3Rpb24gKE9TQ0NBIEdNL1QgMDAwNC0yMDEyKQorCisJICBBcmNo aXRlY3R1cmU6IHJpc2N2NjQgdXNpbmc6CisJICAtIFp2a3NoIHZlY3RvciBjcnlwdG8gZXh0ZW5z aW9uCisJICAtIFp2a2IgdmVjdG9yIGNyeXB0byBleHRlbnNpb24KKwogY29uZmlnIENSWVBUT19T TTRfUklTQ1Y2NAogCXRyaXN0YXRlICJDaXBoZXJzOiBTTTQgKFNoYW5nTWkgNCkiCiAJZGVwZW5k cyBvbiA2NEJJVCAmJiBSSVNDVl9JU0FfVgpkaWZmIC0tZ2l0IGEvYXJjaC9yaXNjdi9jcnlwdG8v TWFrZWZpbGUgYi9hcmNoL3Jpc2N2L2NyeXB0by9NYWtlZmlsZQppbmRleCA4ZTM0ODYxYmJhMzQu LmIxZjg1NzY5NWMxYyAxMDA2NDQKLS0tIGEvYXJjaC9yaXNjdi9jcnlwdG8vTWFrZWZpbGUKKysr IGIvYXJjaC9yaXNjdi9jcnlwdG8vTWFrZWZpbGUKQEAgLTE4LDYgKzE4LDkgQEAgc2hhMjU2LXJp c2N2NjQteSA6PSBzaGEyNTYtcmlzY3Y2NC1nbHVlLm8gc2hhMjU2LXJpc2N2NjQtenZrbmhhX29y X3p2a25oYi16dmtiLm8KIG9iai0kKENPTkZJR19DUllQVE9fU0hBNTEyX1JJU0NWNjQpICs9IHNo YTUxMi1yaXNjdjY0Lm8KIHNoYTUxMi1yaXNjdjY0LXkgOj0gc2hhNTEyLXJpc2N2NjQtZ2x1ZS5v IHNoYTUxMi1yaXNjdjY0LXp2a25oYi16dmtiLm8KIAorb2JqLSQoQ09ORklHX0NSWVBUT19TTTNf UklTQ1Y2NCkgKz0gc20zLXJpc2N2NjQubworc20zLXJpc2N2NjQteSA6PSBzbTMtcmlzY3Y2NC1n bHVlLm8gc20zLXJpc2N2NjQtenZrc2gubworCiBvYmotJChDT05GSUdfQ1JZUFRPX1NNNF9SSVND VjY0KSArPSBzbTQtcmlzY3Y2NC5vCiBzbTQtcmlzY3Y2NC15IDo9IHNtNC1yaXNjdjY0LWdsdWUu byBzbTQtcmlzY3Y2NC16dmtzZWQubwogCkBAIC00Miw2ICs0NSw5IEBAICQob2JqKS9zaGEyNTYt cmlzY3Y2NC16dmtuaGFfb3JfenZrbmhiLXp2a2IuUzogJChzcmMpL3NoYTI1Ni1yaXNjdjY0LXp2 a25oYV9vcl96CiAkKG9iaikvc2hhNTEyLXJpc2N2NjQtenZrbmhiLXp2a2IuUzogJChzcmMpL3No YTUxMi1yaXNjdjY0LXp2a25oYi16dmtiLnBsCiAJJChjYWxsIGNtZCxwZXJsYXNtKQogCiskKG9i aikvc20zLXJpc2N2NjQtenZrc2guUzogJChzcmMpL3NtMy1yaXNjdjY0LXp2a3NoLnBsCisJJChj YWxsIGNtZCxwZXJsYXNtKQorCiAkKG9iaikvc200LXJpc2N2NjQtenZrc2VkLlM6ICQoc3JjKS9z bTQtcmlzY3Y2NC16dmtzZWQucGwKIAkkKGNhbGwgY21kLHBlcmxhc20pCiAKQEAgLTUxLDQgKzU3 LDUgQEAgY2xlYW4tZmlsZXMgKz0gYWVzLXJpc2N2NjQtenZrbmVkLXp2a2IuUwogY2xlYW4tZmls ZXMgKz0gZ2hhc2gtcmlzY3Y2NC16dmtnLlMKIGNsZWFuLWZpbGVzICs9IHNoYTI1Ni1yaXNjdjY0 LXp2a25oYV9vcl96dmtuaGItenZrYi5TCiBjbGVhbi1maWxlcyArPSBzaGE1MTItcmlzY3Y2NC16 dmtuaGItenZrYi5TCitjbGVhbi1maWxlcyArPSBzbTMtcmlzY3Y2NC16dmtzaC5TCiBjbGVhbi1m aWxlcyArPSBzbTQtcmlzY3Y2NC16dmtzZWQuUwpkaWZmIC0tZ2l0IGEvYXJjaC9yaXNjdi9jcnlw dG8vc20zLXJpc2N2NjQtZ2x1ZS5jIGIvYXJjaC9yaXNjdi9jcnlwdG8vc20zLXJpc2N2NjQtZ2x1 ZS5jCm5ldyBmaWxlIG1vZGUgMTAwNjQ0CmluZGV4IDAwMDAwMDAwMDAwMC4uMGU1YTJiODRjOTMw Ci0tLSAvZGV2L251bGwKKysrIGIvYXJjaC9yaXNjdi9jcnlwdG8vc20zLXJpc2N2NjQtZ2x1ZS5j CkBAIC0wLDAgKzEsMTI0IEBACisvLyBTUERYLUxpY2Vuc2UtSWRlbnRpZmllcjogR1BMLTIuMC1v ci1sYXRlcgorLyoKKyAqIExpbnV4L3Jpc2N2NjQgcG9ydCBvZiB0aGUgT3BlblNTTCBTTTMgaW1w bGVtZW50YXRpb24gZm9yIFJJU0MtViA2NAorICoKKyAqIENvcHlyaWdodCAoQykgMjAyMyBWUlVM TCBHbWJICisgKiBBdXRob3I6IEhlaWtvIFN0dWVibmVyIDxoZWlrby5zdHVlYm5lckB2cnVsbC5l dT4KKyAqCisgKiBDb3B5cmlnaHQgKEMpIDIwMjMgU2lGaXZlLCBJbmMuCisgKiBBdXRob3I6IEpl cnJ5IFNoaWggPGplcnJ5LnNoaWhAc2lmaXZlLmNvbT4KKyAqLworCisjaW5jbHVkZSA8YXNtL3Np bWQuaD4KKyNpbmNsdWRlIDxhc20vdmVjdG9yLmg+CisjaW5jbHVkZSA8bGludXgvbGlua2FnZS5o PgorI2luY2x1ZGUgPGxpbnV4L21vZHVsZS5oPgorI2luY2x1ZGUgPGxpbnV4L3R5cGVzLmg+Cisj aW5jbHVkZSA8Y3J5cHRvL2ludGVybmFsL2hhc2guaD4KKyNpbmNsdWRlIDxjcnlwdG8vaW50ZXJu YWwvc2ltZC5oPgorI2luY2x1ZGUgPGNyeXB0by9zbTNfYmFzZS5oPgorCisvKgorICogc20zIHVz aW5nIHp2a3NoIHZlY3RvciBjcnlwdG8gZXh0ZW5zaW9uCisgKgorICogVGhpcyBhc20gZnVuY3Rp b24gd2lsbCBqdXN0IHRha2UgdGhlIGZpcnN0IDI1Ni1iaXQgYXMgdGhlIHNtMyBzdGF0ZSBmcm9t CisgKiB0aGUgcG9pbnRlciB0byBgc3RydWN0IHNtM19zdGF0ZWAuCisgKi8KK2FzbWxpbmthZ2Ug dm9pZCBvc3NsX2h3c20zX2Jsb2NrX2RhdGFfb3JkZXJfenZrc2goc3RydWN0IHNtM19zdGF0ZSAq ZGlnZXN0LAorCQkJCQkJICB1OCBjb25zdCAqbywgaW50IG51bSk7CisKK3N0YXRpYyBpbnQgcmlz Y3Y2NF9zbTNfdXBkYXRlKHN0cnVjdCBzaGFzaF9kZXNjICpkZXNjLCBjb25zdCB1OCAqZGF0YSwK KwkJCSAgICAgIHVuc2lnbmVkIGludCBsZW4pCit7CisJaW50IHJldCA9IDA7CisKKwkvKgorCSAq IE1ha2Ugc3VyZSBzdHJ1Y3Qgc20zX3N0YXRlIGJlZ2lucyBkaXJlY3RseSB3aXRoIHRoZSBTTTMg MjU2LWJpdCBpbnRlcm5hbAorCSAqIHN0YXRlLCBhcyB0aGlzIGlzIHdoYXQgdGhlIGFzbSBmdW5j dGlvbiBleHBlY3QuCisJICovCisJQlVJTERfQlVHX09OKG9mZnNldG9mKHN0cnVjdCBzbTNfc3Rh dGUsIHN0YXRlKSAhPSAwKTsKKworCWlmIChjcnlwdG9fc2ltZF91c2FibGUoKSkgeworCQlrZXJu ZWxfdmVjdG9yX2JlZ2luKCk7CisJCXJldCA9IHNtM19iYXNlX2RvX3VwZGF0ZShkZXNjLCBkYXRh LCBsZW4sCisJCQkJCSBvc3NsX2h3c20zX2Jsb2NrX2RhdGFfb3JkZXJfenZrc2gpOworCQlrZXJu ZWxfdmVjdG9yX2VuZCgpOworCX0gZWxzZSB7CisJCXNtM191cGRhdGUoc2hhc2hfZGVzY19jdHgo ZGVzYyksIGRhdGEsIGxlbik7CisJfQorCisJcmV0dXJuIHJldDsKK30KKworc3RhdGljIGludCBy aXNjdjY0X3NtM19maW51cChzdHJ1Y3Qgc2hhc2hfZGVzYyAqZGVzYywgY29uc3QgdTggKmRhdGEs CisJCQkgICAgIHVuc2lnbmVkIGludCBsZW4sIHU4ICpvdXQpCit7CisJc3RydWN0IHNtM19zdGF0 ZSAqY3R4OworCisJaWYgKGNyeXB0b19zaW1kX3VzYWJsZSgpKSB7CisJCWtlcm5lbF92ZWN0b3Jf YmVnaW4oKTsKKwkJaWYgKGxlbikKKwkJCXNtM19iYXNlX2RvX3VwZGF0ZShkZXNjLCBkYXRhLCBs ZW4sCisJCQkJCSAgIG9zc2xfaHdzbTNfYmxvY2tfZGF0YV9vcmRlcl96dmtzaCk7CisJCXNtM19i YXNlX2RvX2ZpbmFsaXplKGRlc2MsIG9zc2xfaHdzbTNfYmxvY2tfZGF0YV9vcmRlcl96dmtzaCk7 CisJCWtlcm5lbF92ZWN0b3JfZW5kKCk7CisKKwkJcmV0dXJuIHNtM19iYXNlX2ZpbmlzaChkZXNj LCBvdXQpOworCX0KKworCWN0eCA9IHNoYXNoX2Rlc2NfY3R4KGRlc2MpOworCWlmIChsZW4pCisJ CXNtM191cGRhdGUoY3R4LCBkYXRhLCBsZW4pOworCXNtM19maW5hbChjdHgsIG91dCk7CisKKwly ZXR1cm4gMDsKK30KKworc3RhdGljIGludCByaXNjdjY0X3NtM19maW5hbChzdHJ1Y3Qgc2hhc2hf ZGVzYyAqZGVzYywgdTggKm91dCkKK3sKKwlyZXR1cm4gcmlzY3Y2NF9zbTNfZmludXAoZGVzYywg TlVMTCwgMCwgb3V0KTsKK30KKworc3RhdGljIHN0cnVjdCBzaGFzaF9hbGcgc20zX2FsZyA9IHsK KwkuaW5pdCA9IHNtM19iYXNlX2luaXQsCisJLnVwZGF0ZSA9IHJpc2N2NjRfc20zX3VwZGF0ZSwK KwkuZmluYWwgPSByaXNjdjY0X3NtM19maW5hbCwKKwkuZmludXAgPSByaXNjdjY0X3NtM19maW51 cCwKKwkuZGVzY3NpemUgPSBzaXplb2Yoc3RydWN0IHNtM19zdGF0ZSksCisJLmRpZ2VzdHNpemUg PSBTTTNfRElHRVNUX1NJWkUsCisJLmJhc2UgPSB7CisJCS5jcmFfYmxvY2tzaXplID0gU00zX0JM T0NLX1NJWkUsCisJCS5jcmFfcHJpb3JpdHkgPSAxNTAsCisJCS5jcmFfbmFtZSA9ICJzbTMiLAor CQkuY3JhX2RyaXZlcl9uYW1lID0gInNtMy1yaXNjdjY0LXp2a3NoLXp2a2IiLAorCQkuY3JhX21v ZHVsZSA9IFRISVNfTU9EVUxFLAorCX0sCit9OworCitzdGF0aWMgaW5saW5lIGJvb2wgY2hlY2tf c20zX2V4dCh2b2lkKQoreworCXJldHVybiByaXNjdl9pc2FfZXh0ZW5zaW9uX2F2YWlsYWJsZShO VUxMLCBaVktTSCkgJiYKKwkgICAgICAgcmlzY3ZfaXNhX2V4dGVuc2lvbl9hdmFpbGFibGUoTlVM TCwgWlZLQikgJiYKKwkgICAgICAgcmlzY3ZfdmVjdG9yX3ZsZW4oKSA+PSAxMjg7Cit9CisKK3N0 YXRpYyBpbnQgX19pbml0IHJpc2N2NjRfc20zX21vZF9pbml0KHZvaWQpCit7CisJaWYgKGNoZWNr X3NtM19leHQoKSkKKwkJcmV0dXJuIGNyeXB0b19yZWdpc3Rlcl9zaGFzaCgmc20zX2FsZyk7CisK KwlyZXR1cm4gLUVOT0RFVjsKK30KKworc3RhdGljIHZvaWQgX19leGl0IHJpc2N2NjRfc20zX21v ZF9maW5pKHZvaWQpCit7CisJY3J5cHRvX3VucmVnaXN0ZXJfc2hhc2goJnNtM19hbGcpOworfQor Cittb2R1bGVfaW5pdChyaXNjdjY0X3NtM19tb2RfaW5pdCk7Cittb2R1bGVfZXhpdChyaXNjdjY0 X3NtM19tb2RfZmluaSk7CisKK01PRFVMRV9ERVNDUklQVElPTigiU00zIChSSVNDLVYgYWNjZWxl cmF0ZWQpIik7CitNT0RVTEVfQVVUSE9SKCJIZWlrbyBTdHVlYm5lciA8aGVpa28uc3R1ZWJuZXJA dnJ1bGwuZXU+Iik7CitNT0RVTEVfTElDRU5TRSgiR1BMIik7CitNT0RVTEVfQUxJQVNfQ1JZUFRP KCJzbTMiKTsKZGlmZiAtLWdpdCBhL2FyY2gvcmlzY3YvY3J5cHRvL3NtMy1yaXNjdjY0LXp2a3No LnBsIGIvYXJjaC9yaXNjdi9jcnlwdG8vc20zLXJpc2N2NjQtenZrc2gucGwKbmV3IGZpbGUgbW9k ZSAxMDA2NDQKaW5kZXggMDAwMDAwMDAwMDAwLi42YTIzOTlkM2E1Y2YKLS0tIC9kZXYvbnVsbAor KysgYi9hcmNoL3Jpc2N2L2NyeXB0by9zbTMtcmlzY3Y2NC16dmtzaC5wbApAQCAtMCwwICsxLDIy NyBAQAorIyEgL3Vzci9iaW4vZW52IHBlcmwKKyMgU1BEWC1MaWNlbnNlLUlkZW50aWZpZXI6IEFw YWNoZS0yLjAgT1IgQlNELTItQ2xhdXNlCisjCisjIFRoaXMgZmlsZSBpcyBkdWFsLWxpY2Vuc2Vk LCBtZWFuaW5nIHRoYXQgeW91IGNhbiB1c2UgaXQgdW5kZXIgeW91cgorIyBjaG9pY2Ugb2YgZWl0 aGVyIG9mIHRoZSBmb2xsb3dpbmcgdHdvIGxpY2Vuc2VzOgorIworIyBDb3B5cmlnaHQgMjAyMyBU aGUgT3BlblNTTCBQcm9qZWN0IEF1dGhvcnMuIEFsbCBSaWdodHMgUmVzZXJ2ZWQuCisjCisjIExp Y2Vuc2VkIHVuZGVyIHRoZSBBcGFjaGUgTGljZW5zZSAyLjAgKHRoZSAiTGljZW5zZSIpLiBZb3Ug Y2FuIG9idGFpbgorIyBhIGNvcHkgaW4gdGhlIGZpbGUgTElDRU5TRSBpbiB0aGUgc291cmNlIGRp c3RyaWJ1dGlvbiBvciBhdAorIyBodHRwczovL3d3dy5vcGVuc3NsLm9yZy9zb3VyY2UvbGljZW5z ZS5odG1sCisjCisjIG9yCisjCisjIENvcHlyaWdodCAoYykgMjAyMywgQ2hyaXN0b3BoIE3DvGxs bmVyIDxjaHJpc3RvcGgubXVlbGxuZXJAdnJ1bGwuZXU+CisjIENvcHlyaWdodCAoYykgMjAyMywg SmVycnkgU2hpaCA8amVycnkuc2hpaEBzaWZpdmUuY29tPgorIyBBbGwgcmlnaHRzIHJlc2VydmVk LgorIworIyBSZWRpc3RyaWJ1dGlvbiBhbmQgdXNlIGluIHNvdXJjZSBhbmQgYmluYXJ5IGZvcm1z LCB3aXRoIG9yIHdpdGhvdXQKKyMgbW9kaWZpY2F0aW9uLCBhcmUgcGVybWl0dGVkIHByb3ZpZGVk IHRoYXQgdGhlIGZvbGxvd2luZyBjb25kaXRpb25zCisjIGFyZSBtZXQ6CisjIDEuIFJlZGlzdHJp YnV0aW9ucyBvZiBzb3VyY2UgY29kZSBtdXN0IHJldGFpbiB0aGUgYWJvdmUgY29weXJpZ2h0Cisj ICAgIG5vdGljZSwgdGhpcyBsaXN0IG9mIGNvbmRpdGlvbnMgYW5kIHRoZSBmb2xsb3dpbmcgZGlz Y2xhaW1lci4KKyMgMi4gUmVkaXN0cmlidXRpb25zIGluIGJpbmFyeSBmb3JtIG11c3QgcmVwcm9k dWNlIHRoZSBhYm92ZSBjb3B5cmlnaHQKKyMgICAgbm90aWNlLCB0aGlzIGxpc3Qgb2YgY29uZGl0 aW9ucyBhbmQgdGhlIGZvbGxvd2luZyBkaXNjbGFpbWVyIGluIHRoZQorIyAgICBkb2N1bWVudGF0 aW9uIGFuZC9vciBvdGhlciBtYXRlcmlhbHMgcHJvdmlkZWQgd2l0aCB0aGUgZGlzdHJpYnV0aW9u LgorIworIyBUSElTIFNPRlRXQVJFIElTIFBST1ZJREVEIEJZIFRIRSBDT1BZUklHSFQgSE9MREVS UyBBTkQgQ09OVFJJQlVUT1JTCisjICJBUyBJUyIgQU5EIEFOWSBFWFBSRVNTIE9SIElNUExJRUQg V0FSUkFOVElFUywgSU5DTFVESU5HLCBCVVQgTk9UCisjIExJTUlURUQgVE8sIFRIRSBJTVBMSUVE IFdBUlJBTlRJRVMgT0YgTUVSQ0hBTlRBQklMSVRZIEFORCBGSVRORVNTIEZPUgorIyBBIFBBUlRJ Q1VMQVIgUFVSUE9TRSBBUkUgRElTQ0xBSU1FRC4gSU4gTk8gRVZFTlQgU0hBTEwgVEhFIENPUFlS SUdIVAorIyBPV05FUiBPUiBDT05UUklCVVRPUlMgQkUgTElBQkxFIEZPUiBBTlkgRElSRUNULCBJ TkRJUkVDVCwgSU5DSURFTlRBTCwKKyMgU1BFQ0lBTCwgRVhFTVBMQVJZLCBPUiBDT05TRVFVRU5U SUFMIERBTUFHRVMgKElOQ0xVRElORywgQlVUIE5PVAorIyBMSU1JVEVEIFRPLCBQUk9DVVJFTUVO VCBPRiBTVUJTVElUVVRFIEdPT0RTIE9SIFNFUlZJQ0VTOyBMT1NTIE9GIFVTRSwKKyMgREFUQSwg T1IgUFJPRklUUzsgT1IgQlVTSU5FU1MgSU5URVJSVVBUSU9OKSBIT1dFVkVSIENBVVNFRCBBTkQg T04gQU5ZCisjIFRIRU9SWSBPRiBMSUFCSUxJVFksIFdIRVRIRVIgSU4gQ09OVFJBQ1QsIFNUUklD VCBMSUFCSUxJVFksIE9SIFRPUlQKKyMgKElOQ0xVRElORyBORUdMSUdFTkNFIE9SIE9USEVSV0lT RSkgQVJJU0lORyBJTiBBTlkgV0FZIE9VVCBPRiBUSEUgVVNFCisjIE9GIFRISVMgU09GVFdBUkUs IEVWRU4gSUYgQURWSVNFRCBPRiBUSEUgUE9TU0lCSUxJVFkgT0YgU1VDSCBEQU1BR0UuCisKKyMg VGhlIGdlbmVyYXRlZCBjb2RlIG9mIHRoaXMgZmlsZSBkZXBlbmRzIG9uIHRoZSBmb2xsb3dpbmcg UklTQy1WIGV4dGVuc2lvbnM6CisjIC0gUlY2NEkKKyMgLSBSSVNDLVYgVmVjdG9yICgnVicpIHdp dGggVkxFTiA+PSAxMjgKKyMgLSBSSVNDLVYgVmVjdG9yIENyeXB0b2dyYXBoeSBCaXQtbWFuaXB1 bGF0aW9uIGV4dGVuc2lvbiAoJ1p2a2InKQorIyAtIFJJU0MtViBWZWN0b3IgU00zIFNlY3VyZSBI YXNoIGV4dGVuc2lvbiAoJ1p2a3NoJykKKwordXNlIHN0cmljdDsKK3VzZSB3YXJuaW5nczsKKwor dXNlIEZpbmRCaW4gcXcoJEJpbik7Cit1c2UgbGliICIkQmluIjsKK3VzZSBsaWIgIiRCaW4vLi4v Li4vcGVybGFzbSI7Cit1c2UgcmlzY3Y7CisKKyMgJG91dHB1dCBpcyB0aGUgbGFzdCBhcmd1bWVu dCBpZiBpdCBsb29rcyBsaWtlIGEgZmlsZSAoaXQgaGFzIGFuIGV4dGVuc2lvbikKKyMgJGZsYXZv dXIgaXMgdGhlIGZpcnN0IGFyZ3VtZW50IGlmIGl0IGRvZXNuJ3QgbG9vayBsaWtlIGEgZmlsZQor bXkgJG91dHB1dCA9ICQjQVJHViA+PSAwICYmICRBUkdWWyQjQVJHVl0gPX4gbXxcLlx3KyR8ID8g cG9wIDogdW5kZWY7CitteSAkZmxhdm91ciA9ICQjQVJHViA+PSAwICYmICRBUkdWWzBdICF+IG18 XC58ID8gc2hpZnQgOiB1bmRlZjsKKworJG91dHB1dCBhbmQgb3BlbiBTVERPVVQsIj4kb3V0cHV0 IjsKKworbXkgJGNvZGU9PDxfX187CisjaW5jbHVkZSA8bGludXgvY2ZpX3R5cGVzLmg+CisKKy50 ZXh0CitfX18KKworIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMj IyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMKKyMgb3NzbF9od3NtM19ibG9ja19k YXRhX29yZGVyX3p2a3NoKFNNM19DVFggKmMsIGNvbnN0IHZvaWQgKnAsIHNpemVfdCBudW0pOwor eworbXkgKCRDVFgsICRJTlBVVCwgJE5VTSkgPSAoImEwIiwgImExIiwgImEyIik7CitteSAoJFYw LCAkVjEsICRWMiwgJFYzLCAkVjQsICRWNSwgJFY2LCAkVjcsCisgICAgJFY4LCAkVjksICRWMTAs ICRWMTEsICRWMTIsICRWMTMsICRWMTQsICRWMTUsCisgICAgJFYxNiwgJFYxNywgJFYxOCwgJFYx OSwgJFYyMCwgJFYyMSwgJFYyMiwgJFYyMywKKyAgICAkVjI0LCAkVjI1LCAkVjI2LCAkVjI3LCAk VjI4LCAkVjI5LCAkVjMwLCAkVjMxLAorKSA9IG1hcCgidiRfIiwoMC4uMzEpKTsKKworJGNvZGUg Lj0gPDxfX187CitTWU1fVFlQRURfRlVOQ19TVEFSVChvc3NsX2h3c20zX2Jsb2NrX2RhdGFfb3Jk ZXJfenZrc2gpCisgICAgdnNldGl2bGkgemVybywgOCwgZTMyLCBtMiwgdGEsIG1hCisKKyAgICAj IExvYWQgaW5pdGlhbCBzdGF0ZSBvZiBoYXNoIGNvbnRleHQgKGMtPkEtSCkuCisgICAgdmxlMzIu diAkVjAsICgkQ1RYKQorICAgIEB7W3ZyZXY4X3YgJFYwLCAkVjBdfQorCitMX3NtM19sb29wOgor ICAgICMgQ29weSB0aGUgcHJldmlvdXMgc3RhdGUgdG8gdjIuCisgICAgIyBJdCB3aWxsIGJlIFhP UidlZCB3aXRoIHRoZSBjdXJyZW50IHN0YXRlIGF0IHRoZSBlbmQgb2YgdGhlIHJvdW5kLgorICAg IHZtdi52LnYgJFYyLCAkVjAKKworICAgICMgTG9hZCB0aGUgNjRCIGJsb2NrIGluIDJ4MzJCIGNo dW5rcy4KKyAgICB2bGUzMi52ICRWNiwgKCRJTlBVVCkgIyB2NiA6PSB7dzcsIC4uLiwgdzB9Cisg ICAgYWRkaSAkSU5QVVQsICRJTlBVVCwgMzIKKworICAgIHZsZTMyLnYgJFY4LCAoJElOUFVUKSAj IHY4IDo9IHt3MTUsIC4uLiwgdzh9CisgICAgYWRkaSAkSU5QVVQsICRJTlBVVCwgMzIKKworICAg IGFkZGkgJE5VTSwgJE5VTSwgLTEKKworICAgICMgQXMgdnNtM2MgY29uc3VtZXMgb25seSB3MCwg dzEsIHc0LCB3NSB3ZSBuZWVkIHRvIHNsaWRlIHRoZSBpbnB1dAorICAgICMgMiBlbGVtZW50cyBk b3duIHNvIHdlIHByb2Nlc3MgZWxlbWVudHMgdzIsIHczLCB3NiwgdzcKKyAgICAjIFRoaXMgd2ls bCBiZSByZXBlYXRlZCBmb3IgZWFjaCBvZGQgcm91bmQuCisgICAgdnNsaWRlZG93bi52aSAkVjQs ICRWNiwgMiAjIHY0IDo9IHtYLCBYLCB3NywgLi4uLCB3Mn0KKworICAgIEB7W3ZzbTNjX3ZpICRW MCwgJFY2LCAwXX0KKyAgICBAe1t2c20zY192aSAkVjAsICRWNCwgMV19CisKKyAgICAjIFByZXBh cmUgYSB2ZWN0b3Igd2l0aCB7dzExLCAuLi4sIHc0fQorICAgIHZzbGlkZWRvd24udmkgJFY0LCAk VjQsIDIgIyB2NCA6PSB7WCwgWCwgWCwgWCwgdzcsIC4uLiwgdzR9CisgICAgdnNsaWRldXAudmkg JFY0LCAkVjgsIDQgICAjIHY0IDo9IHt3MTEsIHcxMCwgdzksIHc4LCB3NywgdzYsIHc1LCB3NH0K KworICAgIEB7W3ZzbTNjX3ZpICRWMCwgJFY0LCAyXX0KKyAgICB2c2xpZGVkb3duLnZpICRWNCwg JFY0LCAyICMgdjQgOj0ge1gsIFgsIHcxMSwgdzEwLCB3OSwgdzgsIHc3LCB3Nn0KKyAgICBAe1t2 c20zY192aSAkVjAsICRWNCwgM119CisKKyAgICBAe1t2c20zY192aSAkVjAsICRWOCwgNF19Cisg ICAgdnNsaWRlZG93bi52aSAkVjQsICRWOCwgMiAjIHY0IDo9IHtYLCBYLCB3MTUsIHcxNCwgdzEz LCB3MTIsIHcxMSwgdzEwfQorICAgIEB7W3ZzbTNjX3ZpICRWMCwgJFY0LCA1XX0KKworICAgIEB7 W3ZzbTNtZV92diAkVjYsICRWOCwgJFY2XX0gICAjIHY2IDo9IHt3MjMsIHcyMiwgdzIxLCB3MjAs IHcxOSwgdzE4LCB3MTcsIHcxNn0KKworICAgICMgUHJlcGFyZSBhIHJlZ2lzdGVyIHdpdGgge3cx OSwgdzE4LCB3MTcsIHcxNiwgdzE1LCB3MTQsIHcxMywgdzEyfQorICAgIHZzbGlkZWRvd24udmkg JFY0LCAkVjQsIDIgIyB2NCA6PSB7WCwgWCwgWCwgWCwgdzE1LCB3MTQsIHcxMywgdzEyfQorICAg IHZzbGlkZXVwLnZpICRWNCwgJFY2LCA0ICAgIyB2NCA6PSB7dzE5LCB3MTgsIHcxNywgdzE2LCB3 MTUsIHcxNCwgdzEzLCB3MTJ9CisKKyAgICBAe1t2c20zY192aSAkVjAsICRWNCwgNl19CisgICAg dnNsaWRlZG93bi52aSAkVjQsICRWNCwgMiAjIHY0IDo9IHtYLCBYLCB3MTksIHcxOCwgdzE3LCB3 MTYsIHcxNSwgdzE0fQorICAgIEB7W3ZzbTNjX3ZpICRWMCwgJFY0LCA3XX0KKworICAgIEB7W3Zz bTNjX3ZpICRWMCwgJFY2LCA4XX0KKyAgICB2c2xpZGVkb3duLnZpICRWNCwgJFY2LCAyICMgdjQg Oj0ge1gsIFgsIHcyMywgdzIyLCB3MjEsIHcyMCwgdzE5LCB3MTh9CisgICAgQHtbdnNtM2Nfdmkg JFYwLCAkVjQsIDldfQorCisgICAgQHtbdnNtM21lX3Z2ICRWOCwgJFY2LCAkVjhdfSAgICMgdjgg Oj0ge3czMSwgdzMwLCB3MjksIHcyOCwgdzI3LCB3MjYsIHcyNSwgdzI0fQorCisgICAgIyBQcmVw YXJlIGEgcmVnaXN0ZXIgd2l0aCB7dzI3LCB3MjYsIHcyNSwgdzI0LCB3MjMsIHcyMiwgdzIxLCB3 MjB9CisgICAgdnNsaWRlZG93bi52aSAkVjQsICRWNCwgMiAjIHY0IDo9IHtYLCBYLCBYLCBYLCB3 MjMsIHcyMiwgdzIxLCB3MjB9CisgICAgdnNsaWRldXAudmkgJFY0LCAkVjgsIDQgICAjIHY0IDo9 IHt3MjcsIHcyNiwgdzI1LCB3MjQsIHcyMywgdzIyLCB3MjEsIHcyMH0KKworICAgIEB7W3ZzbTNj X3ZpICRWMCwgJFY0LCAxMF19CisgICAgdnNsaWRlZG93bi52aSAkVjQsICRWNCwgMiAjIHY0IDo9 IHtYLCBYLCB3MjcsIHcyNiwgdzI1LCB3MjQsIHcyMywgdzIyfQorICAgIEB7W3ZzbTNjX3ZpICRW MCwgJFY0LCAxMV19CisKKyAgICBAe1t2c20zY192aSAkVjAsICRWOCwgMTJdfQorICAgIHZzbGlk ZWRvd24udmkgJFY0LCAkVjgsIDIgIyB2NCA6PSB7eCwgWCwgdzMxLCB3MzAsIHcyOSwgdzI4LCB3 MjcsIHcyNn0KKyAgICBAe1t2c20zY192aSAkVjAsICRWNCwgMTNdfQorCisgICAgQHtbdnNtM21l X3Z2ICRWNiwgJFY4LCAkVjZdfSAgICMgdjYgOj0ge3czMiwgdzMzLCB3MzQsIHczNSwgdzM2LCB3 MzcsIHczOCwgdzM5fQorCisgICAgIyBQcmVwYXJlIGEgcmVnaXN0ZXIgd2l0aCB7dzM1LCB3MzQs IHczMywgdzMyLCB3MzEsIHczMCwgdzI5LCB3Mjh9CisgICAgdnNsaWRlZG93bi52aSAkVjQsICRW NCwgMiAjIHY0IDo9IHtYLCBYLCBYLCBYLCB3MzEsIHczMCwgdzI5LCB3Mjh9CisgICAgdnNsaWRl dXAudmkgJFY0LCAkVjYsIDQgICAjIHY0IDo9IHt3MzUsIHczNCwgdzMzLCB3MzIsIHczMSwgdzMw LCB3MjksIHcyOH0KKworICAgIEB7W3ZzbTNjX3ZpICRWMCwgJFY0LCAxNF19CisgICAgdnNsaWRl ZG93bi52aSAkVjQsICRWNCwgMiAjIHY0IDo9IHtYLCBYLCB3MzUsIHczNCwgdzMzLCB3MzIsIHcz MSwgdzMwfQorICAgIEB7W3ZzbTNjX3ZpICRWMCwgJFY0LCAxNV19CisKKyAgICBAe1t2c20zY192 aSAkVjAsICRWNiwgMTZdfQorICAgIHZzbGlkZWRvd24udmkgJFY0LCAkVjYsIDIgIyB2NCA6PSB7 WCwgWCwgdzM5LCB3MzgsIHczNywgdzM2LCB3MzUsIHczNH0KKyAgICBAe1t2c20zY192aSAkVjAs ICRWNCwgMTddfQorCisgICAgQHtbdnNtM21lX3Z2ICRWOCwgJFY2LCAkVjhdfSAgICMgdjggOj0g e3c0NywgdzQ2LCB3NDUsIHc0NCwgdzQzLCB3NDIsIHc0MSwgdzQwfQorCisgICAgIyBQcmVwYXJl IGEgcmVnaXN0ZXIgd2l0aCB7dzQzLCB3NDIsIHc0MSwgdzQwLCB3MzksIHczOCwgdzM3LCB3MzZ9 CisgICAgdnNsaWRlZG93bi52aSAkVjQsICRWNCwgMiAjIHY0IDo9IHtYLCBYLCBYLCBYLCB3Mzks IHczOCwgdzM3LCB3MzZ9CisgICAgdnNsaWRldXAudmkgJFY0LCAkVjgsIDQgICAjIHY0IDo9IHt3 NDMsIHc0MiwgdzQxLCB3NDAsIHczOSwgdzM4LCB3MzcsIHczNn0KKworICAgIEB7W3ZzbTNjX3Zp ICRWMCwgJFY0LCAxOF19CisgICAgdnNsaWRlZG93bi52aSAkVjQsICRWNCwgMiAjIHY0IDo9IHtY LCBYLCB3NDMsIHc0MiwgdzQxLCB3NDAsIHczOSwgdzM4fQorICAgIEB7W3ZzbTNjX3ZpICRWMCwg JFY0LCAxOV19CisKKyAgICBAe1t2c20zY192aSAkVjAsICRWOCwgMjBdfQorICAgIHZzbGlkZWRv d24udmkgJFY0LCAkVjgsIDIgIyB2NCA6PSB7WCwgWCwgdzQ3LCB3NDYsIHc0NSwgdzQ0LCB3NDMs IHc0Mn0KKyAgICBAe1t2c20zY192aSAkVjAsICRWNCwgMjFdfQorCisgICAgQHtbdnNtM21lX3Z2 ICRWNiwgJFY4LCAkVjZdfSAgICMgdjYgOj0ge3c1NSwgdzU0LCB3NTMsIHc1MiwgdzUxLCB3NTAs IHc0OSwgdzQ4fQorCisgICAgIyBQcmVwYXJlIGEgcmVnaXN0ZXIgd2l0aCB7dzUxLCB3NTAsIHc0 OSwgdzQ4LCB3NDcsIHc0NiwgdzQ1LCB3NDR9CisgICAgdnNsaWRlZG93bi52aSAkVjQsICRWNCwg MiAjIHY0IDo9IHtYLCBYLCBYLCBYLCB3NDcsIHc0NiwgdzQ1LCB3NDR9CisgICAgdnNsaWRldXAu dmkgJFY0LCAkVjYsIDQgICAjIHY0IDo9IHt3NTEsIHc1MCwgdzQ5LCB3NDgsIHc0NywgdzQ2LCB3 NDUsIHc0NH0KKworICAgIEB7W3ZzbTNjX3ZpICRWMCwgJFY0LCAyMl19CisgICAgdnNsaWRlZG93 bi52aSAkVjQsICRWNCwgMiAjIHY0IDo9IHtYLCBYLCB3NTEsIHc1MCwgdzQ5LCB3NDgsIHc0Nywg dzQ2fQorICAgIEB7W3ZzbTNjX3ZpICRWMCwgJFY0LCAyM119CisKKyAgICBAe1t2c20zY192aSAk VjAsICRWNiwgMjRdfQorICAgIHZzbGlkZWRvd24udmkgJFY0LCAkVjYsIDIgIyB2NCA6PSB7WCwg WCwgdzU1LCB3NTQsIHc1MywgdzUyLCB3NTEsIHc1MH0KKyAgICBAe1t2c20zY192aSAkVjAsICRW NCwgMjVdfQorCisgICAgQHtbdnNtM21lX3Z2ICRWOCwgJFY2LCAkVjhdfSAgICMgdjggOj0ge3c2 MywgdzYyLCB3NjEsIHc2MCwgdzU5LCB3NTgsIHc1NywgdzU2fQorCisgICAgIyBQcmVwYXJlIGEg cmVnaXN0ZXIgd2l0aCB7dzU5LCB3NTgsIHc1NywgdzU2LCB3NTUsIHc1NCwgdzUzLCB3NTJ9Cisg ICAgdnNsaWRlZG93bi52aSAkVjQsICRWNCwgMiAjIHY0IDo9IHtYLCBYLCBYLCBYLCB3NTUsIHc1 NCwgdzUzLCB3NTJ9CisgICAgdnNsaWRldXAudmkgJFY0LCAkVjgsIDQgICAjIHY0IDo9IHt3NTks IHc1OCwgdzU3LCB3NTYsIHc1NSwgdzU0LCB3NTMsIHc1Mn0KKworICAgIEB7W3ZzbTNjX3ZpICRW MCwgJFY0LCAyNl19CisgICAgdnNsaWRlZG93bi52aSAkVjQsICRWNCwgMiAjIHY0IDo9IHtYLCBY LCB3NTksIHc1OCwgdzU3LCB3NTYsIHc1NSwgdzU0fQorICAgIEB7W3ZzbTNjX3ZpICRWMCwgJFY0 LCAyN119CisKKyAgICBAe1t2c20zY192aSAkVjAsICRWOCwgMjhdfQorICAgIHZzbGlkZWRvd24u dmkgJFY0LCAkVjgsIDIgIyB2NCA6PSB7WCwgWCwgdzYzLCB3NjIsIHc2MSwgdzYwLCB3NTksIHc1 OH0KKyAgICBAe1t2c20zY192aSAkVjAsICRWNCwgMjldfQorCisgICAgQHtbdnNtM21lX3Z2ICRW NiwgJFY4LCAkVjZdfSAgICMgdjYgOj0ge3c3MSwgdzcwLCB3NjksIHc2OCwgdzY3LCB3NjYsIHc2 NSwgdzY0fQorCisgICAgIyBQcmVwYXJlIGEgcmVnaXN0ZXIgd2l0aCB7dzY3LCB3NjYsIHc2NSwg dzY0LCB3NjMsIHc2MiwgdzYxLCB3NjB9CisgICAgdnNsaWRlZG93bi52aSAkVjQsICRWNCwgMiAj IHY0IDo9IHtYLCBYLCBYLCBYLCB3NjMsIHc2MiwgdzYxLCB3NjB9CisgICAgdnNsaWRldXAudmkg JFY0LCAkVjYsIDQgICAjIHY0IDo9IHt3NjcsIHc2NiwgdzY1LCB3NjQsIHc2MywgdzYyLCB3NjEs IHc2MH0KKworICAgIEB7W3ZzbTNjX3ZpICRWMCwgJFY0LCAzMF19CisgICAgdnNsaWRlZG93bi52 aSAkVjQsICRWNCwgMiAjIHY0IDo9IHtYLCBYLCB3NjcsIHc2NiwgdzY1LCB3NjQsIHc2MywgdzYy fQorICAgIEB7W3ZzbTNjX3ZpICRWMCwgJFY0LCAzMV19CisKKyAgICAjIFhPUiBpbiB0aGUgcHJl dmlvdXMgc3RhdGUuCisgICAgdnhvci52diAkVjAsICRWMCwgJFYyCisKKyAgICBibmV6ICROVU0s IExfc20zX2xvb3AgICAgICMgQ2hlY2sgaWYgdGhlcmUgYXJlIGFueSBtb3JlIGJsb2NrIHRvIHBy b2Nlc3MKK0xfc20zX2VuZDoKKyAgICBAe1t2cmV2OF92ICRWMCwgJFYwXX0KKyAgICB2c2UzMi52 ICRWMCwgKCRDVFgpCisgICAgcmV0CitTWU1fRlVOQ19FTkQob3NzbF9od3NtM19ibG9ja19kYXRh X29yZGVyX3p2a3NoKQorX19fCit9CisKK3ByaW50ICRjb2RlOworCitjbG9zZSBTVERPVVQgb3Ig ZGllICJlcnJvciBjbG9zaW5nIFNURE9VVDogJCEiOwotLSAKMi4yOC4wCgoKX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KbGludXgtcmlzY3YgbWFpbGluZyBs aXN0CmxpbnV4LXJpc2N2QGxpc3RzLmluZnJhZGVhZC5vcmcKaHR0cDovL2xpc3RzLmluZnJhZGVh ZC5vcmcvbWFpbG1hbi9saXN0aW5mby9saW51eC1yaXNjdgo=