From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-13.1 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,INCLUDES_PATCH,MAILING_LIST_MULTI, SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4F4EDC4727C for ; Thu, 1 Oct 2020 14:02:10 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 09FA221707 for ; Thu, 1 Oct 2020 14:02:10 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1601560930; bh=CXg8GARnAYJzF8cJO/XXT0xEjgPu0NLYuwXzqDgOSHE=; h=From:To:Cc:Subject:Date:In-Reply-To:References:List-ID:From; b=xEZfgEEo49DcSdhUBQfIP5z9mcarb/L4XHUv4s4mZ4o+/VAqP1SrAPFLbNMix3QIt zIucBqgf1NRYOHw6wFAnfpNhmS7YkPj/PESR5ItMJOcehAUcco7CT6ZvumPB4lk44z 3Kt1tkoyEz9rbpWOh2mcVrs8kTSj9OPPZnvG0FVg= Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1732722AbgJAOCI (ORCPT ); Thu, 1 Oct 2020 10:02:08 -0400 Received: from mail-ot1-f68.google.com ([209.85.210.68]:41559 "EHLO mail-ot1-f68.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1732622AbgJAOBY (ORCPT ); Thu, 1 Oct 2020 10:01:24 -0400 Received: by mail-ot1-f68.google.com with SMTP id q21so5460953ota.8 for ; Thu, 01 Oct 2020 07:01:23 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=vUUj1yA5C8gIyhmtCGBnAf4j9JtfhjGcWKZGvC9mD28=; b=LN2nR7Osh5fvDXFYUzv1H55evxhG4XmafnbunqYNIAC3t+61PyBRKoMmk4EGJhgfET isAJUG2S0v0W1NyU1vTgBLjU9FLhWZWd+qqaTHGBUYSFf6DUyaizy+Njy+dGh1MYefsT 4tXnc2DnQmxCzHG0JPK/mkSgi6E8dD1lTpHfP0TO4eJ8AMVImS0I2UPxsq5JvkD3F/BR PssUNmamSYMauALRyj1Nlr9isvqh9HIMk0GlQDt/JOnCPrunoRAXh2v72Vu2b/ZyhIZB diMAEKhNgYcvrvOkZ6rMOn2tTQBcquUuS8msOTJclmqPrWY9lJYtneVABBkXTLz1vyRK kgMQ== X-Gm-Message-State: AOAM533vJBGEw0+h/44scTDGtRcVsSlH1VVtiE+Xf4PIJWZt62S//lWi icUBE53jTf7dCzDe6Wpflg== X-Google-Smtp-Source: ABdhPJyg1JvQaYotnU/7phEZqWdeDo1S5maAeiGXs7DmbL855KYi9pKFoq9xE1N96F3Ceb0MdpLKng== X-Received: by 2002:a9d:12ab:: with SMTP id g40mr5197445otg.369.1601560883301; Thu, 01 Oct 2020 07:01:23 -0700 (PDT) Received: from xps15.herring.priv (24-155-109-49.dyn.grandenetworks.net. [24.155.109.49]) by smtp.googlemail.com with ESMTPSA id q81sm1032138oia.46.2020.10.01.07.01.21 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 01 Oct 2020 07:01:22 -0700 (PDT) From: Rob Herring To: Will Deacon , Catalin Marinas , Peter Zijlstra , Ingo Molnar , Arnaldo Carvalho de Melo , Jiri Olsa Cc: linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, Alexander Shishkin , Namhyung Kim , Raphael Gault , Mark Rutland , Jonathan Cameron , Ian Rogers , honnappa.nagarahalli@arm.com, Itaru Kitayama Subject: [PATCH v4 3/9] tools/include: Add an initial math64.h Date: Thu, 1 Oct 2020 09:01:10 -0500 Message-Id: <20201001140116.651970-4-robh@kernel.org> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20201001140116.651970-1-robh@kernel.org> References: <20201001140116.651970-1-robh@kernel.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Add an initial math64.h similar to linux/math64.h with functions mul_u64_u64_div64() and mul_u64_u32_shr(). This isn't a direct copy of include/linux/math64.h as that doesn't define mul_u64_u64_div64(). Implementation was written by Peter Zilkstra based on linux/math64.h and div64.h[1]. The original implementation was not optimal on arm64 as __int128 division is not optimal with a call out to __udivti3, so I dropped the __int128 variant of mul_u64_u64_div64(). [1] https://lore.kernel.org/lkml/20200322101848.GF2452@worktop.programming.kicks-ass.net/ Cc: Peter Zijlstra Signed-off-by: Rob Herring --- tools/include/linux/math64.h | 75 ++++++++++++++++++++++++++++++++++++ 1 file changed, 75 insertions(+) create mode 100644 tools/include/linux/math64.h diff --git a/tools/include/linux/math64.h b/tools/include/linux/math64.h new file mode 100644 index 000000000000..4ad45d5943dc --- /dev/null +++ b/tools/include/linux/math64.h @@ -0,0 +1,75 @@ +/* SPDX-License-Identifier: GPL-2.0 */ +#ifndef _LINUX_MATH64_H +#define _LINUX_MATH64_H + +#include + +#ifdef __x86_64__ +static inline u64 mul_u64_u64_div64(u64 a, u64 b, u64 c) +{ + u64 q; + + asm ("mulq %2; divq %3" : "=a" (q) + : "a" (a), "rm" (b), "rm" (c) + : "rdx"); + + return q; +} +#define mul_u64_u64_div64 mul_u64_u64_div64 +#endif + +#ifdef __SIZEOF_INT128__ +static inline u64 mul_u64_u32_shr(u64 a, u32 b, unsigned int shift) +{ + return (u64)(((unsigned __int128)a * b) >> shift); +} + +#else + +#ifdef __i386__ +static inline u64 mul_u32_u32(u32 a, u32 b) +{ + u32 high, low; + + asm ("mull %[b]" : "=a" (low), "=d" (high) + : [a] "a" (a), [b] "rm" (b) ); + + return low | ((u64)high) << 32; +} +#else +static inline u64 mul_u32_u32(u32 a, u32 b) +{ + return (u64)a * b; +} +#endif + +static inline u64 mul_u64_u32_shr(u64 a, u32 b, unsigned int shift) +{ + u32 ah, al; + u64 ret; + + al = a; + ah = a >> 32; + + ret = mul_u32_u32(al, b) >> shift; + if (ah) + ret += mul_u32_u32(ah, b) << (32 - shift); + + return ret; +} + +#endif /* __SIZEOF_INT128__ */ + +#ifndef mul_u64_u64_div64 +static inline u64 mul_u64_u64_div64(u64 a, u64 b, u64 c) +{ + u64 quot, rem; + + quot = a / c; + rem = a % c; + + return quot * b + (rem * b) / c; +} +#endif + +#endif /* _LINUX_MATH64_H */ -- 2.25.1