From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Google-Smtp-Source: AIpwx4/hKsZNRlO854es5lPyoHR3NOYBxhusAoFjSumJchnv50U6gAhxn+0zi8HAPdYbfEDQQh75 ARC-Seal: i=1; a=rsa-sha256; t=1523022255; cv=none; d=google.com; s=arc-20160816; b=XPQhrRaEd/xzY/tvoHXmsmnKuTDaGwHQhIsu0HKEbzRmXwQrtCLquTzwdegXa7PDOI EBlFA5UUtZVRIxtCKxTqs846LEs/BTW392qPmbMI+Sx3rt5axI6cMpsEXwOOgsRXrAdN ZmNhrh6uP7B52ATRtZRNUWS62lY6cfkRsl7BNzv1nGpjPpE9pD6D4up79Pe2VL3mvX9+ HZfzddykO5R5xLvZW2apTqy3NnQb8Ao9T0ckhLoQQ4eHA+FC+9oRmyY4IovZtrpibLx2 ZcsLLR0i5XCJ/xefEId//jpBrHHsEAFNp9JdXGBCYDxvQmgd8+Uo1phZoOQF7YmIh+QP qm6Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:user-agent:references:in-reply-to:message-id:date :subject:cc:to:from:arc-authentication-results; bh=l7ur/g8yvEMNKGXmGIW5nIhD2azby/m1FzGq97Dmh+s=; b=oHatDVf3yY2gNz0sHxacsfrl+RASvftwMCc1pBIM6SKFgKFPs6S8JaBo+WyMbGupsg gi6fBAUHt/HLr5oXiEcV4//LxzTH2DsYbSkn8ODVi8dK4Z/kKR248LOPMCw6x5irWv+P 7kdDLPiLd/I6R9LDjq8Bl1EeLzJeZJaeKa8cUegkYIr5pAunLLahyLKTrGlgnbU+pxux arPobhlXqLGetyg3xr/aliBy89JrFyenzbMqRmVtFtDpJ9mUAielMi/dasxd5NZj+kFX Fr/CuWSXSC3YvsFnGo9Hcurro0GxU+xutYM7D3eSB69ciIpP7BkDGzSQmwZ6NkPTecAb qvVg== ARC-Authentication-Results: i=1; mx.google.com; spf=softfail (google.com: domain of transitioning gregkh@linuxfoundation.org does not designate 90.92.61.202 as permitted sender) smtp.mailfrom=gregkh@linuxfoundation.org Authentication-Results: mx.google.com; spf=softfail (google.com: domain of transitioning gregkh@linuxfoundation.org does not designate 90.92.61.202 as permitted sender) smtp.mailfrom=gregkh@linuxfoundation.org From: Greg Kroah-Hartman To: linux-kernel@vger.kernel.org Cc: Greg Kroah-Hartman , stable@vger.kernel.org, stable@kernel.org, "Erhard F." , Matthew Wilcox , Rasmus Villemoes , Andrew Morton , Arnd Bergmann , Omar Sandoval , Linus Torvalds Subject: [PATCH 4.16 01/31] bitmap: fix memset optimization on big-endian systems Date: Fri, 6 Apr 2018 15:24:26 +0200 Message-Id: <20180406084341.141774205@linuxfoundation.org> X-Mailer: git-send-email 2.17.0 In-Reply-To: <20180406084340.999820380@linuxfoundation.org> References: <20180406084340.999820380@linuxfoundation.org> User-Agent: quilt/0.65 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-LABELS: =?utf-8?b?IlxcU2VudCI=?= X-GMAIL-THRID: =?utf-8?q?1597004345240253782?= X-GMAIL-MSGID: =?utf-8?q?1597004584465485156?= X-Mailing-List: linux-kernel@vger.kernel.org List-ID: 4.16-stable review patch. If anyone has any objections, please let me know. ------------------ From: Omar Sandoval commit 21035965f60b0502fc6537b232839389bb4ce664 upstream. Commit 2a98dc028f91 ("include/linux/bitmap.h: turn bitmap_set and bitmap_clear into memset when possible") introduced an optimization to bitmap_{set,clear}() which uses memset() when the start and length are constants aligned to a byte. This is wrong on big-endian systems; our bitmaps are arrays of unsigned long, so bit n is not at byte n / 8 in memory. This was caught by the Btrfs selftests, but the bitmap selftests also fail when run on a big-endian machine. We can still use memset if the start and length are aligned to an unsigned long, so do that on big-endian. The same problem applies to the memcmp in bitmap_equal(), so fix it there, too. Fixes: 2a98dc028f91 ("include/linux/bitmap.h: turn bitmap_set and bitmap_clear into memset when possible") Fixes: 2c6deb01525a ("bitmap: use memcmp optimisation in more situations") Cc: stable@kernel.org Reported-by: "Erhard F." Cc: Matthew Wilcox Cc: Rasmus Villemoes Cc: Andrew Morton Cc: Arnd Bergmann Signed-off-by: Omar Sandoval Signed-off-by: Linus Torvalds Signed-off-by: Greg Kroah-Hartman --- include/linux/bitmap.h | 22 +++++++++++++++++----- 1 file changed, 17 insertions(+), 5 deletions(-) --- a/include/linux/bitmap.h +++ b/include/linux/bitmap.h @@ -302,12 +302,20 @@ static inline void bitmap_complement(uns __bitmap_complement(dst, src, nbits); } +#ifdef __LITTLE_ENDIAN +#define BITMAP_MEM_ALIGNMENT 8 +#else +#define BITMAP_MEM_ALIGNMENT (8 * sizeof(unsigned long)) +#endif +#define BITMAP_MEM_MASK (BITMAP_MEM_ALIGNMENT - 1) + static inline int bitmap_equal(const unsigned long *src1, const unsigned long *src2, unsigned int nbits) { if (small_const_nbits(nbits)) return !((*src1 ^ *src2) & BITMAP_LAST_WORD_MASK(nbits)); - if (__builtin_constant_p(nbits & 7) && IS_ALIGNED(nbits, 8)) + if (__builtin_constant_p(nbits & BITMAP_MEM_MASK) && + IS_ALIGNED(nbits, BITMAP_MEM_ALIGNMENT)) return !memcmp(src1, src2, nbits / 8); return __bitmap_equal(src1, src2, nbits); } @@ -358,8 +366,10 @@ static __always_inline void bitmap_set(u { if (__builtin_constant_p(nbits) && nbits == 1) __set_bit(start, map); - else if (__builtin_constant_p(start & 7) && IS_ALIGNED(start, 8) && - __builtin_constant_p(nbits & 7) && IS_ALIGNED(nbits, 8)) + else if (__builtin_constant_p(start & BITMAP_MEM_MASK) && + IS_ALIGNED(start, BITMAP_MEM_ALIGNMENT) && + __builtin_constant_p(nbits & BITMAP_MEM_MASK) && + IS_ALIGNED(nbits, BITMAP_MEM_ALIGNMENT)) memset((char *)map + start / 8, 0xff, nbits / 8); else __bitmap_set(map, start, nbits); @@ -370,8 +380,10 @@ static __always_inline void bitmap_clear { if (__builtin_constant_p(nbits) && nbits == 1) __clear_bit(start, map); - else if (__builtin_constant_p(start & 7) && IS_ALIGNED(start, 8) && - __builtin_constant_p(nbits & 7) && IS_ALIGNED(nbits, 8)) + else if (__builtin_constant_p(start & BITMAP_MEM_MASK) && + IS_ALIGNED(start, BITMAP_MEM_ALIGNMENT) && + __builtin_constant_p(nbits & BITMAP_MEM_MASK) && + IS_ALIGNED(nbits, BITMAP_MEM_ALIGNMENT)) memset((char *)map + start / 8, 0, nbits / 8); else __bitmap_clear(map, start, nbits);