From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.2 required=3.0 tests=DKIM_ADSP_CUSTOM_MED, DKIM_SIGNED,DKIM_VALID,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH,MAILING_LIST_MULTI,SIGNED_OFF_BY, SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id B7EAFC7618B for ; Thu, 25 Jul 2019 16:49:44 +0000 (UTC) Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 7FF3421951 for ; Thu, 25 Jul 2019 16:49:44 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=lists.infradead.org header.i=@lists.infradead.org header.b="jspTEnUa"; dkim=fail reason="signature verification failed" (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="J199Kf3X" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 7FF3421951 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=gmail.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+infradead-linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20170209; h=Sender: Content-Transfer-Encoding:Content-Type:Cc:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:In-Reply-To:MIME-Version:References: Message-ID:Subject:To:From:Date:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=cdpzRwKzXTsgJtlrQVDF29DtKW5Pz1KxKfLRwUFcXSU=; b=jspTEnUaIqk/eI PNitgzS3yznYbKmOkIm3nmxVjDbc2MXPcmZY+iTlQjooUATkKW1AOWslCO9vutRmcRQh13eS+3gQE fsv8xfG27mWeS07rds+s1pO828/LqgMxs0fmt7rBE+LV15UB8FgDyFhHpXuUBYtjnt+Rdx6KOx8Ru Cxje6rGgPiOoFTbgN1NaF7ZQ5nV19PClWse86H5zkvzkPEWuTI2pgukdo6dZEygvVoLTDAMSbOFpC cuyWg4itw5Ak36vPZcslBfuVCIR9lEIfyWQYGl246Sbm5sVcp60cB8r5Bq5xWLcs2tbay/sKcUBlK l/rruwOlUv4V2Tx+MS7A==; Received: from localhost ([127.0.0.1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.92 #3 (Red Hat Linux)) id 1hqgvx-0001Be-7G; Thu, 25 Jul 2019 16:49:37 +0000 Received: from mail-pl1-x643.google.com ([2607:f8b0:4864:20::643]) by bombadil.infradead.org with esmtps (Exim 4.92 #3 (Red Hat Linux)) id 1hqgvu-0001B7-5u for linux-arm-kernel@lists.infradead.org; Thu, 25 Jul 2019 16:49:35 +0000 Received: by mail-pl1-x643.google.com with SMTP id 4so16644992pld.10 for ; Thu, 25 Jul 2019 09:49:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=jGAg9NbrZM4/REnf890+otF98/BlAirM2URndXQWC28=; b=J199Kf3X84tFgsqCefIPoNnYl8hkA6n/odyUSb9ydiH8DNHy8xGdJRB1sFlQu5Sw01 vKFepLLC8e7340FrTVX5BmanPQIzpH4Gonaq8d4qz7KPOEHCIbfCz4howJkkrxj6teXd Th65YJvcp5T+OU4B8dN9J1BK70WkDrKLyy1ClVk/L8NDn6q3jjrjMIcgdSNtC6crWcw0 juuuBl2fjvbLZNPM20KroT9zXspb+MM306NILvy5wi5LCQJfGGPvJXpRaBLbFaGfgD6N WqlXAql907zZGIHTHCjw53A/CkT0caxA8i2/9Hl3T0LPHHDEgsBKUxadCoO8IbF1IKUn dCGg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=jGAg9NbrZM4/REnf890+otF98/BlAirM2URndXQWC28=; b=eByjHAS7cC29uDz7t/HXL9unP6WfCJXOFhVFc51c7tHGCyBwAtAk1sB9wnkMiDxdXS Au1CAfCCWC5pWuGwL1GFxs77ECsxhFCONKwn2cQ02psKUs6+PKtSiOatsB1GXZQ3ACIS T3viwrcTBx0Nyv1/l52FqBHJbxI/Mw1nf2amz3nsWr65PoZF/grmYn4AEBZUM7BZa3Pb tlU33tii4ntLdrtysI8eyybLlkwiGdEe1On1z1XsEVKgOKeIOOYBmR5rbGsov0ESwfD9 EWkw2AHseniijFFG3mjQNBPl8pMW7lAn9Rp9BaVfjPIrWKxPnOP7BEPshqTiQ3aTPfQL u8SA== X-Gm-Message-State: APjAAAXwUTJ6U5ucUCqltRtXOAOzxY/pK345ocOWgHrkwGMVd73CD8Ll KJkaq7abHKSl38qNbsjo1KQ= X-Google-Smtp-Source: APXvYqzmmPddBdSnPsLfjKn5VPVQ4AR9d6elcmyE2RerzZgMmE19SHwGoyhhzcRPnATUPFAtzxXsiA== X-Received: by 2002:a17:902:6a2:: with SMTP id 31mr87214469plh.296.1564073373059; Thu, 25 Jul 2019 09:49:33 -0700 (PDT) Received: from Asurada-Nvidia.nvidia.com (thunderhill.nvidia.com. [216.228.112.22]) by smtp.gmail.com with ESMTPSA id l31sm88186182pgm.63.2019.07.25.09.49.32 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Thu, 25 Jul 2019 09:49:32 -0700 (PDT) Date: Thu, 25 Jul 2019 09:50:15 -0700 From: Nicolin Chen To: Ezequiel Garcia Subject: Re: [PATCH v3 1/2] dma-contiguous: Abstract dma_{alloc,free}_contiguous() Message-ID: <20190725165015.GA31961@Asurada-Nvidia.nvidia.com> References: <20190524040633.16854-1-nicoleotsuka@gmail.com> <20190524040633.16854-2-nicoleotsuka@gmail.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.9.4 (2018-02-28) X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20190725_094934_223488_6F5BD8FC X-CRM114-Status: GOOD ( 35.98 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: dafna.hirschfeld@collabora.com, Tony Lindgren , Catalin Marinas , Will Deacon , jcmvbkbc@gmail.com, hch@lst.de, Marek Szyprowski , sfr@canb.auug.org.au, dann.frazier@canonical.com, joro@8bytes.org, Russell King , treding@nvidia.com, linux-xtensa@linux-xtensa.org, keescook@chromium.org, Andrew Morton , linux-arm-kernel , chris@zankel.net, wsa+renesas@sang-engineering.com, robin.murphy@arm.com, Linux Kernel Mailing List , iommu@lists.linux-foundation.org, iamjoonsoo.kim@lge.com, David Woodhouse Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+infradead-linux-arm-kernel=archiver.kernel.org@lists.infradead.org On Thu, Jul 25, 2019 at 01:06:42PM -0300, Ezequiel Garcia wrote: > I can't find a way to forward-redirect from Gmail, so I'm Ccing Dafna > who found a regression caused by this commit. Dafna, can you give all > the details, including the log and how you are reproducing it? I saw the conversation there. Sorry for not replying yet. May we discuss there since there are full logs available? Thanks Nicolin > > > On Fri, 24 May 2019 at 01:08, Nicolin Chen wrote: > > > > Both dma_alloc_from_contiguous() and dma_release_from_contiguous() > > are very simply implemented, but requiring callers to pass certain > > parameters like count and align, and taking a boolean parameter to > > check __GFP_NOWARN in the allocation flags. So every function call > > duplicates similar work: > > /* A piece of example */ > > unsigned long order = get_order(size); > > size_t count = size >> PAGE_SHIFT; > > page = dma_alloc_from_contiguous(dev, count, order, gfp & __GFP_NOWARN); > > [...] > > dma_release_from_contiguous(dev, page, size >> PAGE_SHIFT); > > > > Additionally, as CMA can be used only in the context which permits > > sleeping, most of callers do a gfpflags_allow_blocking() check and > > a corresponding fallback allocation of normal pages upon any false > > result: > > /* A piece of example */ > > if (gfpflags_allow_blocking(flag)) > > page = dma_alloc_from_contiguous(); > > if (!page) > > page = alloc_pages(); > > [...] > > if (!dma_release_from_contiguous(dev, page, count)) > > __free_pages(page, get_order(size)); > > > > So this patch simplifies those function calls by abstracting these > > operations into the two new functions: dma_{alloc,free}_contiguous. > > > > As some callers of dma_{alloc,release}_from_contiguous() might be > > complicated, this patch just implements these two new functions to > > kernel/dma/direct.c only as an initial step. > > > > Suggested-by: Christoph Hellwig > > Signed-off-by: Nicolin Chen > > --- > > Changelog > > v2->v3: > > * Added missing "static inline" in header file to fix build error. > > v1->v2: > > * Added new functions beside the old ones so we can replace callers > > one by one later. > > * Applied new functions to dma/direct.c only, because it's the best > > example caller to apply and should be safe with the new functions. > > > > include/linux/dma-contiguous.h | 11 ++++++++ > > kernel/dma/contiguous.c | 48 ++++++++++++++++++++++++++++++++++ > > kernel/dma/direct.c | 24 +++-------------- > > 3 files changed, 63 insertions(+), 20 deletions(-) > > > > diff --git a/include/linux/dma-contiguous.h b/include/linux/dma-contiguous.h > > index f247e8aa5e3d..00a370c1c140 100644 > > --- a/include/linux/dma-contiguous.h > > +++ b/include/linux/dma-contiguous.h > > @@ -115,6 +115,8 @@ struct page *dma_alloc_from_contiguous(struct device *dev, size_t count, > > unsigned int order, bool no_warn); > > bool dma_release_from_contiguous(struct device *dev, struct page *pages, > > int count); > > +struct page *dma_alloc_contiguous(struct device *dev, size_t size, gfp_t gfp); > > +void dma_free_contiguous(struct device *dev, struct page *page, size_t size); > > > > #else > > > > @@ -157,6 +159,15 @@ bool dma_release_from_contiguous(struct device *dev, struct page *pages, > > return false; > > } > > > > +static inline > > +struct page *dma_alloc_contiguous(struct device *dev, size_t size, gfp_t gfp) > > +{ > > + return NULL; > > +} > > + > > +static inline > > +void dma_free_contiguous(struct device *dev, struct page *page, size_t size) { } > > + > > #endif > > > > #endif > > diff --git a/kernel/dma/contiguous.c b/kernel/dma/contiguous.c > > index b2a87905846d..21f39a6cb04f 100644 > > --- a/kernel/dma/contiguous.c > > +++ b/kernel/dma/contiguous.c > > @@ -214,6 +214,54 @@ bool dma_release_from_contiguous(struct device *dev, struct page *pages, > > return cma_release(dev_get_cma_area(dev), pages, count); > > } > > > > +/** > > + * dma_alloc_contiguous() - allocate contiguous pages > > + * @dev: Pointer to device for which the allocation is performed. > > + * @size: Requested allocation size. > > + * @gfp: Allocation flags. > > + * > > + * This function allocates contiguous memory buffer for specified device. It > > + * first tries to use device specific contiguous memory area if available or > > + * the default global one, then tries a fallback allocation of normal pages. > > + */ > > +struct page *dma_alloc_contiguous(struct device *dev, size_t size, gfp_t gfp) > > +{ > > + int node = dev ? dev_to_node(dev) : NUMA_NO_NODE; > > + size_t count = PAGE_ALIGN(size) >> PAGE_SHIFT; > > + size_t align = get_order(PAGE_ALIGN(size)); > > + struct cma *cma = dev_get_cma_area(dev); > > + struct page *page = NULL; > > + > > + /* CMA can be used only in the context which permits sleeping */ > > + if (cma && gfpflags_allow_blocking(gfp)) { > > + align = min_t(size_t, align, CONFIG_CMA_ALIGNMENT); > > + page = cma_alloc(cma, count, align, gfp & __GFP_NOWARN); > > + } > > + > > + /* Fallback allocation of normal pages */ > > + if (!page) > > + page = alloc_pages_node(node, gfp, align); > > + > > + return page; > > +} > > + > > +/** > > + * dma_free_contiguous() - release allocated pages > > + * @dev: Pointer to device for which the pages were allocated. > > + * @page: Pointer to the allocated pages. > > + * @size: Size of allocated pages. > > + * > > + * This function releases memory allocated by dma_alloc_contiguous(). As the > > + * cma_release returns false when provided pages do not belong to contiguous > > + * area and true otherwise, this function then does a fallback __free_pages() > > + * upon a false-return. > > + */ > > +void dma_free_contiguous(struct device *dev, struct page *page, size_t size) > > +{ > > + if (!cma_release(dev_get_cma_area(dev), page, size >> PAGE_SHIFT)) > > + __free_pages(page, get_order(size)); > > +} > > + > > /* > > * Support for reserved memory regions defined in device tree > > */ > > diff --git a/kernel/dma/direct.c b/kernel/dma/direct.c > > index 2c2772e9702a..0816c1e8b05a 100644 > > --- a/kernel/dma/direct.c > > +++ b/kernel/dma/direct.c > > @@ -96,8 +96,6 @@ static bool dma_coherent_ok(struct device *dev, phys_addr_t phys, size_t size) > > struct page *__dma_direct_alloc_pages(struct device *dev, size_t size, > > dma_addr_t *dma_handle, gfp_t gfp, unsigned long attrs) > > { > > - unsigned int count = PAGE_ALIGN(size) >> PAGE_SHIFT; > > - int page_order = get_order(size); > > struct page *page = NULL; > > u64 phys_mask; > > > > @@ -109,20 +107,9 @@ struct page *__dma_direct_alloc_pages(struct device *dev, size_t size, > > gfp |= __dma_direct_optimal_gfp_mask(dev, dev->coherent_dma_mask, > > &phys_mask); > > again: > > - /* CMA can be used only in the context which permits sleeping */ > > - if (gfpflags_allow_blocking(gfp)) { > > - page = dma_alloc_from_contiguous(dev, count, page_order, > > - gfp & __GFP_NOWARN); > > - if (page && !dma_coherent_ok(dev, page_to_phys(page), size)) { > > - dma_release_from_contiguous(dev, page, count); > > - page = NULL; > > - } > > - } > > - if (!page) > > - page = alloc_pages_node(dev_to_node(dev), gfp, page_order); > > - > > + page = dma_alloc_contiguous(dev, size, gfp); > > if (page && !dma_coherent_ok(dev, page_to_phys(page), size)) { > > - __free_pages(page, page_order); > > + dma_free_contiguous(dev, page, size); > > page = NULL; > > > > if (IS_ENABLED(CONFIG_ZONE_DMA32) && > > @@ -154,7 +141,7 @@ void *dma_direct_alloc_pages(struct device *dev, size_t size, > > if (PageHighMem(page)) { > > /* > > * Depending on the cma= arguments and per-arch setup > > - * dma_alloc_from_contiguous could return highmem pages. > > + * dma_alloc_contiguous could return highmem pages. > > * Without remapping there is no way to return them here, > > * so log an error and fail. > > */ > > @@ -176,10 +163,7 @@ void *dma_direct_alloc_pages(struct device *dev, size_t size, > > > > void __dma_direct_free_pages(struct device *dev, size_t size, struct page *page) > > { > > - unsigned int count = PAGE_ALIGN(size) >> PAGE_SHIFT; > > - > > - if (!dma_release_from_contiguous(dev, page, count)) > > - __free_pages(page, get_order(size)); > > + dma_free_contiguous(dev, page, size); > > } > > > > void dma_direct_free_pages(struct device *dev, size_t size, void *cpu_addr, > > -- > > 2.17.1 > > _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel