From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4DF07C433F5 for ; Wed, 8 Dec 2021 06:34:05 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 60D0E6B0074; Wed, 8 Dec 2021 01:28:32 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 5BD146B0081; Wed, 8 Dec 2021 01:28:32 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 484BC6B0082; Wed, 8 Dec 2021 01:28:32 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (relay028.a.hostedemail.com [64.99.140.28]) by kanga.kvack.org (Postfix) with ESMTP id 3897E6B0074 for ; Wed, 8 Dec 2021 01:28:32 -0500 (EST) Received: by unirelay02.hostedemail.com (Postfix, from userid 108) id CAB6720F65; Wed, 8 Dec 2021 05:33:01 +0000 (UTC) Received: from smtpin22.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id E7424212D5 for ; Wed, 8 Dec 2021 04:28:54 +0000 (UTC) X-FDA: 78893346588.22.8C54F0D Received: from forward.hostedemail.com (ofarelay.outbound [64.99.140.10]) by imf28.hostedemail.com (Postfix) with ESMTP id 8E0A490000A2 for ; Wed, 8 Dec 2021 04:28:54 +0000 (UTC) Received: from smtpin04.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay11.hostedemail.com (Postfix) with ESMTP id 4E0A6801B5 for ; Wed, 8 Dec 2021 04:23:14 +0000 (UTC) X-FDA: 78893332266.04.A9F8826 Received: from casper.infradead.org (casper.infradead.org [90.155.50.34]) by imf23.hostedemail.com (Postfix) with ESMTP id C8BC590000A0 for ; Wed, 8 Dec 2021 04:23:11 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=casper.20170209; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From:Sender:Reply-To: Content-Type:Content-ID:Content-Description; bh=DYYtBGhjj8cEREZ7h3ka1eCGfC7joF81SMsCjzMNVEU=; b=q76KeqFugBaLOBGAos+7cxdUoj OCg4sRWPuVIfOGIY9eII2Xc0HoUKM3cElnqNxLs7hfC0s+PbdVd6+3Mj3ca3X7YDmM2VoikhlSbDO TXWChAhXEWe9Hi2Qmdtu9YGRqQGDAmiAG751LLRunV1ID27E1Xkk36vD75c4MWBhn6cMtzeu/NomU pIayQ/cFmnvYLcxxDiuRYDTmzc6relojgK4ddwovztMvwf5e+E9N/Nve6LaPmlNHV1slIHPHadIQr keeBu95LYdAsTr97uxzUzeZTbTxnO7qDrzaw8MycGq/SZ5I+lTne7c/N0+uxpZk/feMaw96SXJAxv jjYn41JQ==; Received: from willy by casper.infradead.org with local (Exim 4.94.2 #2 (Red Hat Linux)) id 1muoU2-0084X8-6e; Wed, 08 Dec 2021 04:23:10 +0000 From: "Matthew Wilcox (Oracle)" To: linux-fsdevel@vger.kernel.org, linux-mm@kvack.org Cc: "Matthew Wilcox (Oracle)" Subject: [PATCH 07/48] iov_iter: Convert iter_xarray to use folios Date: Wed, 8 Dec 2021 04:22:15 +0000 Message-Id: <20211208042256.1923824-8-willy@infradead.org> X-Mailer: git-send-email 2.31.1 In-Reply-To: <20211208042256.1923824-1-willy@infradead.org> References: <20211208042256.1923824-1-willy@infradead.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Rspamd-Server: rspam01 X-Rspamd-Queue-Id: 8E0A490000A2 X-Stat-Signature: i4ixai9x6mkkufbtt3cqrybphhfxptst X-HE-Tag-Orig: 1638937391-488654 Authentication-Results: imf28.hostedemail.com; dkim=pass header.d=infradead.org header.s=casper.20170209 header.b=q76KeqFu; spf=none (imf28.hostedemail.com: domain of FILTER%willy@infradead.org has no SPF policy when checking 64.99.140.10) smtp.mailfrom=FILTER%willy@infradead.org; dmarc=none X-HE-Tag: 1638937734-366125 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Take advantage of how kmap_local_folio() works to simplify the loop. Signed-off-by: Matthew Wilcox (Oracle) --- lib/iov_iter.c | 29 +++++++++++++---------------- 1 file changed, 13 insertions(+), 16 deletions(-) diff --git a/lib/iov_iter.c b/lib/iov_iter.c index 66a740e6e153..03cf43b003a0 100644 --- a/lib/iov_iter.c +++ b/lib/iov_iter.c @@ -69,42 +69,39 @@ #define iterate_xarray(i, n, base, len, __off, STEP) { \ __label__ __out; \ size_t __off = 0; \ - struct page *head = NULL; \ + struct folio *folio; \ loff_t start = i->xarray_start + i->iov_offset; \ - unsigned offset = start % PAGE_SIZE; \ pgoff_t index = start / PAGE_SIZE; \ - int j; \ - \ XA_STATE(xas, i->xarray, index); \ \ + len = PAGE_SIZE - offset_in_page(start); \ rcu_read_lock(); \ - xas_for_each(&xas, head, ULONG_MAX) { \ + xas_for_each(&xas, folio, ULONG_MAX) { \ unsigned left; \ - if (xas_retry(&xas, head)) \ + size_t offset = offset_in_folio(folio, start + __off); \ + if (xas_retry(&xas, folio)) \ continue; \ - if (WARN_ON(xa_is_value(head))) \ + if (WARN_ON(xa_is_value(folio))) \ break; \ - if (WARN_ON(PageHuge(head))) \ + if (WARN_ON(folio_test_hugetlb(folio))) \ break; \ - for (j = (head->index < index) ? index - head->index : 0; \ - j < thp_nr_pages(head); j++) { \ - void *kaddr = kmap_local_page(head + j); \ - base = kaddr + offset; \ - len = PAGE_SIZE - offset; \ + while (offset < folio_size(folio)) { \ + base = kmap_local_folio(folio, offset); \ len = min(n, len); \ left = (STEP); \ - kunmap_local(kaddr); \ + kunmap_local(base); \ len -= left; \ __off += len; \ n -= len; \ if (left || n == 0) \ goto __out; \ - offset = 0; \ + offset += len; \ + len = PAGE_SIZE; \ } \ } \ __out: \ rcu_read_unlock(); \ - i->iov_offset += __off; \ + i->iov_offset += __off; \ n = __off; \ } -- 2.33.0