From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 6E2DA146A62; Fri, 26 Apr 2024 12:14:07 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1714133647; cv=none; b=k4Ym1dIewsUWy2KwJa9yzdnWLUS/3yJqm5kU4gzFj6bnDkcSI2qjFP39ijrmkOGPI5eb6zkhZWd0tZWSpkkTIUiwM59XQw/dvPN9ZPLDnfx9Z2HuiiwxIQsMjkZVi8qsML2FUwnrB0tL198D/zThi5SaQQj3rm4A/NB2KA50UVA= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1714133647; c=relaxed/simple; bh=wwOo7Qalbj5LGH+Uol2Kxq1QroiMAQbRn89m80qF1hk=; h=From:To:Cc:Subject:Date:Message-Id:In-Reply-To:References: MIME-Version:Content-Type; b=ddF5bfwhIrtO0dzrJkj1imacQJ+ZXzLZvVbTIUv1C/F0SECnUoN1Onm/cK4nE0CbYeq+dppYcIpqMI7z7LGo5Ha4rcqnVj+nDdMLOWlu5Lp2027rgaMWmqp+P8jvTfYr7Jfm6tg9RpqIF+x8fNpld12MWS91X6Ct/ijwbw70XDc= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=Wqf1Cp+L; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="Wqf1Cp+L" Received: by smtp.kernel.org (Postfix) with ESMTPSA id BBFA4C113CD; Fri, 26 Apr 2024 12:14:06 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1714133647; bh=wwOo7Qalbj5LGH+Uol2Kxq1QroiMAQbRn89m80qF1hk=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=Wqf1Cp+LfX9tULU0HyRGnDeMCjKen3b6QQDxRgGRuwAOuj5zbDCwVCKJhd6Auo08o B8pZrXZMAP5IDBLwE4CD69u9MCDX+5lGz3aytu4cFT6NezNCUyof9nt0CGFJ4LdqqH OSzFvR0EG1Jq5AwOg97W36gELTUZaDggc9TxZ+cniSes9RMNhAaYl/p/vr7t8VNKRL Fqm0tEbdObc+W3DUtSF7mCNOR3m/AvCsEvQSaA+VUlsTzIOzkO7SVTB/Ou4VK2ROF9 OQA1ipw7x+LCI+/G2ni7UaGuPcCUc9PlDEZil5BL3pGoMFnQuhkZ4yZSQNnkHzt9Df 1qa2PZ05giUcA== From: Puranjay Mohan To: Catalin Marinas , Will Deacon , Alexei Starovoitov , Daniel Borkmann , Andrii Nakryiko , Martin KaFai Lau , Eduard Zingerman , Song Liu , Yonghong Song , John Fastabend , KP Singh , Stanislav Fomichev , Hao Luo , Jiri Olsa , Zi Shen Lim , Xu Kuohai , Florent Revest , linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, bpf@vger.kernel.org Cc: puranjay12@gmail.com Subject: [PATCH bpf-next v3 2/2] bpf, arm64: inline bpf_get_smp_processor_id() helper Date: Fri, 26 Apr 2024 12:13:49 +0000 Message-Id: <20240426121349.97651-3-puranjay@kernel.org> X-Mailer: git-send-email 2.40.1 In-Reply-To: <20240426121349.97651-1-puranjay@kernel.org> References: <20240426121349.97651-1-puranjay@kernel.org> Precedence: bulk X-Mailing-List: bpf@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit As ARM64 JIT now implements BPF_MOV64_PERCPU_REG instruction, inline bpf_get_smp_processor_id(). ARM64 uses the per-cpu variable cpu_number to store the cpu id. Here is how the BPF and ARM64 JITed assembly changes after this commit: BPF ===== BEFORE AFTER -------- ------- int cpu = bpf_get_smp_processor_id(); int cpu = bpf_get_smp_processor_id(); (85) call bpf_get_smp_processor_id#229032 (18) r0 = 0xffff800082072008 (bf) r0 = &(void __percpu *)(r0) (61) r0 = *(u32 *)(r0 +0) ARM64 JIT =========== BEFORE AFTER -------- ------- int cpu = bpf_get_smp_processor_id(); int cpu = bpf_get_smp_processor_id(); mov x10, #0xfffffffffffff4d0 mov x7, #0xffff8000ffffffff movk x10, #0x802b, lsl #16 movk x7, #0x8207, lsl #16 movk x10, #0x8000, lsl #32 movk x7, #0x2008 blr x10 mrs x10, tpidr_el1 add x7, x0, #0x0 add x7, x7, x10 ldr w7, [x7] Performance improvement using benchmark[1] BEFORE AFTER -------- ------- glob-arr-inc : 23.817 ± 0.019M/s glob-arr-inc : 24.631 ± 0.027M/s arr-inc : 23.253 ± 0.019M/s arr-inc : 23.742 ± 0.023M/s hash-inc : 12.258 ± 0.010M/s hash-inc : 12.625 ± 0.004M/s [1] https://github.com/anakryiko/linux/commit/8dec900975ef Signed-off-by: Puranjay Mohan Acked-by: Andrii Nakryiko --- kernel/bpf/verifier.c | 24 +++++++++++++++++------- 1 file changed, 17 insertions(+), 7 deletions(-) diff --git a/kernel/bpf/verifier.c b/kernel/bpf/verifier.c index 4e474ef44e9c..6ff4e63b2ef2 100644 --- a/kernel/bpf/verifier.c +++ b/kernel/bpf/verifier.c @@ -20273,20 +20273,31 @@ static int do_misc_fixups(struct bpf_verifier_env *env) goto next_insn; } -#ifdef CONFIG_X86_64 /* Implement bpf_get_smp_processor_id() inline. */ if (insn->imm == BPF_FUNC_get_smp_processor_id && prog->jit_requested && bpf_jit_supports_percpu_insn()) { /* BPF_FUNC_get_smp_processor_id inlining is an - * optimization, so if pcpu_hot.cpu_number is ever + * optimization, so if cpu_number_addr is ever * changed in some incompatible and hard to support * way, it's fine to back out this inlining logic */ - insn_buf[0] = BPF_MOV32_IMM(BPF_REG_0, (u32)(unsigned long)&pcpu_hot.cpu_number); - insn_buf[1] = BPF_MOV64_PERCPU_REG(BPF_REG_0, BPF_REG_0); - insn_buf[2] = BPF_LDX_MEM(BPF_W, BPF_REG_0, BPF_REG_0, 0); - cnt = 3; + u64 cpu_number_addr; +#if defined(CONFIG_X86_64) + cpu_number_addr = (u64)&pcpu_hot.cpu_number; +#elif defined(CONFIG_ARM64) + cpu_number_addr = (u64)&cpu_number; +#else + goto next_insn; +#endif + struct bpf_insn ld_cpu_number_addr[2] = { + BPF_LD_IMM64(BPF_REG_0, cpu_number_addr) + }; + insn_buf[0] = ld_cpu_number_addr[0]; + insn_buf[1] = ld_cpu_number_addr[1]; + insn_buf[2] = BPF_MOV64_PERCPU_REG(BPF_REG_0, BPF_REG_0); + insn_buf[3] = BPF_LDX_MEM(BPF_W, BPF_REG_0, BPF_REG_0, 0); + cnt = 4; new_prog = bpf_patch_insn_data(env, i + delta, insn_buf, cnt); if (!new_prog) return -ENOMEM; @@ -20296,7 +20307,6 @@ static int do_misc_fixups(struct bpf_verifier_env *env) insn = new_prog->insnsi + i + delta; goto next_insn; } -#endif /* Implement bpf_get_func_arg inline. */ if (prog_type == BPF_PROG_TYPE_TRACING && insn->imm == BPF_FUNC_get_func_arg) { -- 2.40.1 From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id B4E4EC4345F for ; Fri, 26 Apr 2024 12:14:27 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:MIME-Version:References:In-Reply-To: Message-Id:Date:Subject:Cc:To:From:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=e9Dq+anMe644bZ99XkCrvajpU/c9OIjirelDt1hdUMQ=; b=YPBPeS+Q/WyMNL DWkEMfulcVbliKAJUpACtjN8jRl2H05LGsVkLKOCQm4MiA6LjUbH4hi7183tp7GiNgWwQJ8Tz2ERT jiX/ibcY0kWotUHkfanX0Kj6im0YUOuIb7pusnt9IxvsokUmmGJfBhFns5iD5JqWv3L+VNjKKRTsq zfJLysBpnee9ZIR1Yvbb0O7ZuvAujzld1hHTWjglay4lMhZ7oea9n1yW3sLRanSIQtbbyhtpRHcrq gq//3K2Ujf42EPNpzYkfxdqcaKzC2anR+w5aDCIiDyEEDEDldNbOe1a3jMtf98aQK3ztfyaDLT6+S XK/ypGTM8J86Y6NNOgfQ==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.97.1 #2 (Red Hat Linux)) id 1s0KT3-0000000CQs6-38gE; Fri, 26 Apr 2024 12:14:17 +0000 Received: from dfw.source.kernel.org ([2604:1380:4641:c500::1]) by bombadil.infradead.org with esmtps (Exim 4.97.1 #2 (Red Hat Linux)) id 1s0KSv-0000000CQop-07A4 for linux-arm-kernel@lists.infradead.org; Fri, 26 Apr 2024 12:14:11 +0000 Received: from smtp.kernel.org (transwarp.subspace.kernel.org [100.75.92.58]) by dfw.source.kernel.org (Postfix) with ESMTP id 5F2FB62068; Fri, 26 Apr 2024 12:14:08 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id BBFA4C113CD; Fri, 26 Apr 2024 12:14:06 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1714133647; bh=wwOo7Qalbj5LGH+Uol2Kxq1QroiMAQbRn89m80qF1hk=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=Wqf1Cp+LfX9tULU0HyRGnDeMCjKen3b6QQDxRgGRuwAOuj5zbDCwVCKJhd6Auo08o B8pZrXZMAP5IDBLwE4CD69u9MCDX+5lGz3aytu4cFT6NezNCUyof9nt0CGFJ4LdqqH OSzFvR0EG1Jq5AwOg97W36gELTUZaDggc9TxZ+cniSes9RMNhAaYl/p/vr7t8VNKRL Fqm0tEbdObc+W3DUtSF7mCNOR3m/AvCsEvQSaA+VUlsTzIOzkO7SVTB/Ou4VK2ROF9 OQA1ipw7x+LCI+/G2ni7UaGuPcCUc9PlDEZil5BL3pGoMFnQuhkZ4yZSQNnkHzt9Df 1qa2PZ05giUcA== From: Puranjay Mohan To: Catalin Marinas , Will Deacon , Alexei Starovoitov , Daniel Borkmann , Andrii Nakryiko , Martin KaFai Lau , Eduard Zingerman , Song Liu , Yonghong Song , John Fastabend , KP Singh , Stanislav Fomichev , Hao Luo , Jiri Olsa , Zi Shen Lim , Xu Kuohai , Florent Revest , linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, bpf@vger.kernel.org Cc: puranjay12@gmail.com Subject: [PATCH bpf-next v3 2/2] bpf, arm64: inline bpf_get_smp_processor_id() helper Date: Fri, 26 Apr 2024 12:13:49 +0000 Message-Id: <20240426121349.97651-3-puranjay@kernel.org> X-Mailer: git-send-email 2.40.1 In-Reply-To: <20240426121349.97651-1-puranjay@kernel.org> References: <20240426121349.97651-1-puranjay@kernel.org> MIME-Version: 1.0 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20240426_051409_179838_D6D0A690 X-CRM114-Status: GOOD ( 12.07 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org QXMgQVJNNjQgSklUIG5vdyBpbXBsZW1lbnRzIEJQRl9NT1Y2NF9QRVJDUFVfUkVHIGluc3RydWN0 aW9uLCBpbmxpbmUKYnBmX2dldF9zbXBfcHJvY2Vzc29yX2lkKCkuCgpBUk02NCB1c2VzIHRoZSBw ZXItY3B1IHZhcmlhYmxlIGNwdV9udW1iZXIgdG8gc3RvcmUgdGhlIGNwdSBpZC4KCkhlcmUgaXMg aG93IHRoZSBCUEYgYW5kIEFSTTY0IEpJVGVkIGFzc2VtYmx5IGNoYW5nZXMgYWZ0ZXIgdGhpcyBj b21taXQ6CgogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIEJQRgogICAg ICAgICAJCSAgICAgICAgICAgICAgICA9PT09PQogICAgICAgICAgICAgIEJFRk9SRSAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIEFGVEVSCiAgICAgICAgICAgICAtLS0tLS0t LSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtLS0tLS0tCgppbnQgY3B1ID0g YnBmX2dldF9zbXBfcHJvY2Vzc29yX2lkKCk7ICAgICAgICAgICBpbnQgY3B1ID0gYnBmX2dldF9z bXBfcHJvY2Vzc29yX2lkKCk7Cig4NSkgY2FsbCBicGZfZ2V0X3NtcF9wcm9jZXNzb3JfaWQjMjI5 MDMyICAgICAgICgxOCkgcjAgPSAweGZmZmY4MDAwODIwNzIwMDgKICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgKGJmKSByMCA9ICYodm9pZCBfX3BlcmNwdSAq KShyMCkKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgKDYx KSByMCA9ICoodTMyICopKHIwICswKQoKCQkJCSAgICAgIEFSTTY0IEpJVAoJCQkJICAgICA9PT09 PT09PT09PQoKICAgICAgICAgICAgICBCRUZPUkUgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICBBRlRFUgogICAgICAgICAgICAgLS0tLS0tLS0gICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgLS0tLS0tLQoKaW50IGNwdSA9IGJwZl9nZXRfc21wX3Byb2Nlc3Nv cl9pZCgpOyAgICAgICAgICAgaW50IGNwdSA9IGJwZl9nZXRfc21wX3Byb2Nlc3Nvcl9pZCgpOwpt b3YgICAgIHgxMCwgIzB4ZmZmZmZmZmZmZmZmZjRkMCAgICAgICAgICAgICAgICBtb3YgICAgIHg3 LCAjMHhmZmZmODAwMGZmZmZmZmZmCm1vdmsgICAgeDEwLCAjMHg4MDJiLCBsc2wgIzE2ICAgICAg ICAgICAgICAgICAgIG1vdmsgICAgeDcsICMweDgyMDcsIGxzbCAjMTYKbW92ayAgICB4MTAsICMw eDgwMDAsIGxzbCAjMzIgICAgICAgICAgICAgICAgICAgbW92ayAgICB4NywgIzB4MjAwOApibHIg ICAgIHgxMCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtcnMgICAgIHgxMCwg dHBpZHJfZWwxCmFkZCAgICAgeDcsIHgwLCAjMHgwICAgICAgICAgICAgICAgICAgICAgICAgICAg IGFkZCAgICAgeDcsIHg3LCB4MTAKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgbGRyICAgICB3NywgW3g3XQoKUGVyZm9ybWFuY2UgaW1wcm92ZW1lbnQgdXNp bmcgYmVuY2htYXJrWzFdCgogICAgICAgICAgICAgQkVGT1JFICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgQUZURVIKICAgICAgICAgICAgLS0tLS0tLS0gICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgLS0tLS0tLQoKZ2xvYi1hcnItaW5jICAgOiAgIDIzLjgx NyDCsSAwLjAxOU0vcyAgICAgIGdsb2ItYXJyLWluYyAgIDogICAyNC42MzEgwrEgMC4wMjdNL3MK YXJyLWluYyAgICAgICAgOiAgIDIzLjI1MyDCsSAwLjAxOU0vcyAgICAgIGFyci1pbmMgICAgICAg IDogICAyMy43NDIgwrEgMC4wMjNNL3MKaGFzaC1pbmMgICAgICAgOiAgIDEyLjI1OCDCsSAwLjAx ME0vcyAgICAgIGhhc2gtaW5jICAgICAgIDogICAxMi42MjUgwrEgMC4wMDRNL3MKClsxXSBodHRw czovL2dpdGh1Yi5jb20vYW5ha3J5aWtvL2xpbnV4L2NvbW1pdC84ZGVjOTAwOTc1ZWYKClNpZ25l ZC1vZmYtYnk6IFB1cmFuamF5IE1vaGFuIDxwdXJhbmpheUBrZXJuZWwub3JnPgpBY2tlZC1ieTog QW5kcmlpIE5ha3J5aWtvIDxhbmRyaWlAa2VybmVsLm9yZz4KLS0tCiBrZXJuZWwvYnBmL3Zlcmlm aWVyLmMgfCAyNCArKysrKysrKysrKysrKysrKy0tLS0tLS0KIDEgZmlsZSBjaGFuZ2VkLCAxNyBp bnNlcnRpb25zKCspLCA3IGRlbGV0aW9ucygtKQoKZGlmZiAtLWdpdCBhL2tlcm5lbC9icGYvdmVy aWZpZXIuYyBiL2tlcm5lbC9icGYvdmVyaWZpZXIuYwppbmRleCA0ZTQ3NGVmNDRlOWMuLjZmZjRl NjNiMmVmMiAxMDA2NDQKLS0tIGEva2VybmVsL2JwZi92ZXJpZmllci5jCisrKyBiL2tlcm5lbC9i cGYvdmVyaWZpZXIuYwpAQCAtMjAyNzMsMjAgKzIwMjczLDMxIEBAIHN0YXRpYyBpbnQgZG9fbWlz Y19maXh1cHMoc3RydWN0IGJwZl92ZXJpZmllcl9lbnYgKmVudikKIAkJCWdvdG8gbmV4dF9pbnNu OwogCQl9CiAKLSNpZmRlZiBDT05GSUdfWDg2XzY0CiAJCS8qIEltcGxlbWVudCBicGZfZ2V0X3Nt cF9wcm9jZXNzb3JfaWQoKSBpbmxpbmUuICovCiAJCWlmIChpbnNuLT5pbW0gPT0gQlBGX0ZVTkNf Z2V0X3NtcF9wcm9jZXNzb3JfaWQgJiYKIAkJICAgIHByb2ctPmppdF9yZXF1ZXN0ZWQgJiYgYnBm X2ppdF9zdXBwb3J0c19wZXJjcHVfaW5zbigpKSB7CiAJCQkvKiBCUEZfRlVOQ19nZXRfc21wX3By b2Nlc3Nvcl9pZCBpbmxpbmluZyBpcyBhbgotCQkJICogb3B0aW1pemF0aW9uLCBzbyBpZiBwY3B1 X2hvdC5jcHVfbnVtYmVyIGlzIGV2ZXIKKwkJCSAqIG9wdGltaXphdGlvbiwgc28gaWYgY3B1X251 bWJlcl9hZGRyIGlzIGV2ZXIKIAkJCSAqIGNoYW5nZWQgaW4gc29tZSBpbmNvbXBhdGlibGUgYW5k IGhhcmQgdG8gc3VwcG9ydAogCQkJICogd2F5LCBpdCdzIGZpbmUgdG8gYmFjayBvdXQgdGhpcyBp bmxpbmluZyBsb2dpYwogCQkJICovCi0JCQlpbnNuX2J1ZlswXSA9IEJQRl9NT1YzMl9JTU0oQlBG X1JFR18wLCAodTMyKSh1bnNpZ25lZCBsb25nKSZwY3B1X2hvdC5jcHVfbnVtYmVyKTsKLQkJCWlu c25fYnVmWzFdID0gQlBGX01PVjY0X1BFUkNQVV9SRUcoQlBGX1JFR18wLCBCUEZfUkVHXzApOwot CQkJaW5zbl9idWZbMl0gPSBCUEZfTERYX01FTShCUEZfVywgQlBGX1JFR18wLCBCUEZfUkVHXzAs IDApOwotCQkJY250ID0gMzsKKwkJCXU2NCBjcHVfbnVtYmVyX2FkZHI7CiAKKyNpZiBkZWZpbmVk KENPTkZJR19YODZfNjQpCisJCQljcHVfbnVtYmVyX2FkZHIgPSAodTY0KSZwY3B1X2hvdC5jcHVf bnVtYmVyOworI2VsaWYgZGVmaW5lZChDT05GSUdfQVJNNjQpCisJCQljcHVfbnVtYmVyX2FkZHIg PSAodTY0KSZjcHVfbnVtYmVyOworI2Vsc2UKKwkJCWdvdG8gbmV4dF9pbnNuOworI2VuZGlmCisJ CQlzdHJ1Y3QgYnBmX2luc24gbGRfY3B1X251bWJlcl9hZGRyWzJdID0geworCQkJCUJQRl9MRF9J TU02NChCUEZfUkVHXzAsIGNwdV9udW1iZXJfYWRkcikKKwkJCX07CisJCQlpbnNuX2J1ZlswXSA9 IGxkX2NwdV9udW1iZXJfYWRkclswXTsKKwkJCWluc25fYnVmWzFdID0gbGRfY3B1X251bWJlcl9h ZGRyWzFdOworCQkJaW5zbl9idWZbMl0gPSBCUEZfTU9WNjRfUEVSQ1BVX1JFRyhCUEZfUkVHXzAs IEJQRl9SRUdfMCk7CisJCQlpbnNuX2J1ZlszXSA9IEJQRl9MRFhfTUVNKEJQRl9XLCBCUEZfUkVH XzAsIEJQRl9SRUdfMCwgMCk7CisJCQljbnQgPSA0OwogCQkJbmV3X3Byb2cgPSBicGZfcGF0Y2hf aW5zbl9kYXRhKGVudiwgaSArIGRlbHRhLCBpbnNuX2J1ZiwgY250KTsKIAkJCWlmICghbmV3X3By b2cpCiAJCQkJcmV0dXJuIC1FTk9NRU07CkBAIC0yMDI5Niw3ICsyMDMwNyw2IEBAIHN0YXRpYyBp bnQgZG9fbWlzY19maXh1cHMoc3RydWN0IGJwZl92ZXJpZmllcl9lbnYgKmVudikKIAkJCWluc24g ICAgICA9IG5ld19wcm9nLT5pbnNuc2kgKyBpICsgZGVsdGE7CiAJCQlnb3RvIG5leHRfaW5zbjsK IAkJfQotI2VuZGlmCiAJCS8qIEltcGxlbWVudCBicGZfZ2V0X2Z1bmNfYXJnIGlubGluZS4gKi8K IAkJaWYgKHByb2dfdHlwZSA9PSBCUEZfUFJPR19UWVBFX1RSQUNJTkcgJiYKIAkJICAgIGluc24t PmltbSA9PSBCUEZfRlVOQ19nZXRfZnVuY19hcmcpIHsKLS0gCjIuNDAuMQoKCl9fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCmxpbnV4LWFybS1rZXJuZWwgbWFp bGluZyBsaXN0CmxpbnV4LWFybS1rZXJuZWxAbGlzdHMuaW5mcmFkZWFkLm9yZwpodHRwOi8vbGlz dHMuaW5mcmFkZWFkLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2xpbnV4LWFybS1rZXJuZWwK