From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 80671C00140 for ; Fri, 5 Aug 2022 19:22:36 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id DB8126B0071; Fri, 5 Aug 2022 15:22:35 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id D67DF6B0072; Fri, 5 Aug 2022 15:22:35 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id C2EF38E0001; Fri, 5 Aug 2022 15:22:35 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id B0E8F6B0071 for ; Fri, 5 Aug 2022 15:22:35 -0400 (EDT) Received: from smtpin04.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id 811291205DC for ; Fri, 5 Aug 2022 19:22:35 +0000 (UTC) X-FDA: 79766510670.04.DB52B02 Received: from dfw.source.kernel.org (dfw.source.kernel.org [139.178.84.217]) by imf29.hostedemail.com (Postfix) with ESMTP id 84FF4120031 for ; Fri, 5 Aug 2022 19:22:34 +0000 (UTC) Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by dfw.source.kernel.org (Postfix) with ESMTPS id 1D6B3619E0; Fri, 5 Aug 2022 19:22:34 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id 92430C433D6; Fri, 5 Aug 2022 19:22:30 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1659727353; bh=6NiXLQm8OcoUZ8csmIKR/ARQpbG7nd98ZNzdAF0IdKc=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=hvRVdYrVCaYzMJdZQi7TucyGzVAt9jUJykVgus5XNs0aRvS2Sq6n8kzeLrPkZN4kc zdWykUkoZx6Ip1nCKjA2b4MOdGOhEJQWTPodJAjkIC2NggA5fpwOmIl6qy3v3dpD1A A9T2HAT+cOpXP/WF41x+4N1+jCVUmsDQRUFoqWAKWHe/lvqU4Gnyx4IiXVxM9Kdwug USFZWyRY8CHwk8jliYVI4v/jSKe+L0K7pgIf6Dmd840A4gVBzlSg9OIY335+yakyCK DvyCnxnD2WLw76hyAj9Mq9DPw3hn9lnriUY673qvzbWUCjASH/L12YrXB0+93ECG2i z9p6fx5K0hv8A== Date: Fri, 5 Aug 2022 21:22:25 +0200 From: Mike Rapoport To: Vijayanand Jitta Cc: Faiyaz Mohammed , karahmed@amazon.de, qperret@google.com, robh@kernel.org, akpm@linux-foundation.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org, robh+dt@kernel.org, frowand.list@gmail.com, devicetree@vger.kernel.org Subject: Re: [PATCH] mm: memblock: avoid to create memmap for memblock nomap regions Message-ID: References: <1649704172-13181-1-git-send-email-quic_faiyazm@quicinc.com> <7b18bea8-b996-601d-f490-cb8aadfffa1b@quicinc.com> <42f28e7b-c001-7d01-1eb6-fe963491898e@quicinc.com> <22aca197-8d18-2c9e-b3c4-f6fdc893ceb1@quicinc.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <22aca197-8d18-2c9e-b3c4-f6fdc893ceb1@quicinc.com> ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1659727355; a=rsa-sha256; cv=none; b=G3LjQfOauhusx/sfTtoGbGG9e3cW827GgRQXBRPOnmhgFXF69Vg3N6OWPnAhO49tlzuasT hG6sLQ7J0LuP59PsaSrGsawf6+IfdXF+T9C56/mzT1m3Vf5e+7DT7vnAISdp5gf2DChzAE 1zU9VEpxLy/B0kpiKv//agdzNmmOf48= ARC-Authentication-Results: i=1; imf29.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=hvRVdYrV; spf=pass (imf29.hostedemail.com: domain of rppt@kernel.org designates 139.178.84.217 as permitted sender) smtp.mailfrom=rppt@kernel.org; dmarc=pass (policy=none) header.from=kernel.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1659727355; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=hczEwY+MXCiFhnSxhaTH2PtG9wyUPR9A6fhXr9NNmsM=; b=BRfqrjJmudy7en0vKXik6d1JozIYWNz/TTpGnHmoJKb9w56B8IqEqt94QbGDYyI9B/oE8k mDEFVsjsbytlEptxnMnjFQBbXJfewu+BoGMzPmpQ662VlCsDv2+jFsjXobhuV4JFLMasCJ ASDAY4TMF5IHyHVSVmHbROQE/ImezGg= X-Stat-Signature: yrtt5tg96dagqesomh7fyobmy8g555mg X-Rspamd-Queue-Id: 84FF4120031 Authentication-Results: imf29.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=hvRVdYrV; spf=pass (imf29.hostedemail.com: domain of rppt@kernel.org designates 139.178.84.217 as permitted sender) smtp.mailfrom=rppt@kernel.org; dmarc=pass (policy=none) header.from=kernel.org X-Rspam-User: X-Rspamd-Server: rspam11 X-HE-Tag: 1659727354-105166 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Hi Vijay, On Wed, Aug 03, 2022 at 04:27:33PM +0530, Vijayanand Jitta wrote: > > On 5/9/2022 5:12 PM, Mike Rapoport wrote: > > On Mon, May 09, 2022 at 04:37:30PM +0530, Faiyaz Mohammed wrote: > >> > >> On 5/5/2022 10:24 PM, Mike Rapoport wrote: > >>> On Thu, May 05, 2022 at 08:46:15PM +0530, Faiyaz Mohammed wrote: > >>>> On 4/12/2022 10:56 PM, Mike Rapoport wrote: > >>>>> On Tue, Apr 12, 2022 at 12:39:32AM +0530, Faiyaz Mohammed wrote: > >>>>>> This 'commit 86588296acbf ("fdt: Properly handle "no-map" field in the > >>>>>> memory region")' is keeping the no-map regions in memblock.memory with > >>>>>> MEMBLOCK_NOMAP flag set to use no-map memory for EFI using memblock api's, > >>>>>> but during the initialization sparse_init mark all memblock.memory as > >>>>>> present using for_each_mem_pfn_range, which is creating the memmap for > >>>>>> no-map memblock regions. To avoid it skiping the memblock.memory regions > >>>>>> set with MEMBLOCK_NOMAP set and with this change we will be able to save > >>>>>> ~11MB memory for ~612MB carve out. > >>>>> The MEMBLOCK_NOMAP is very fragile and caused a lot of issues already. I > >>>>> really don't like the idea if adding more implicit assumptions about how > >>>>> NOMAP memory may or may not be used in a generic iterator function. > >>>> Sorry for delayed response. > >>>> Yes, it is possible that implicit assumption can create > >>>> misunderstanding. How about adding command line option and control the > >>>> no-map region in fdt.c driver, to decide whether to keep "no-map" region > >>>> with NOMAP flag or remove?. Something like below > >>> I really don't like memblock_remove() for such cases. > >>> Pretending there is a hole when there is an actual DRAM makes things really > >>> hairy when it comes to memory map and page allocator initialization. > >>> You wouldn't want to trade system stability and random memory corruptions > >>> for 11M of "saved" memory. > >> > >> Creating memory map for holes memory is adding 11MB overhead which is > >> huge on low memory target and same time 11MB memory saving is good enough > >> on low memory target. > >> > >> Or we can have separate list of NOMAP like reserved?. > >> > >> Any other suggestion to address this issue?. > > > > Make your firmware to report the memory that Linux cannot use as a hole, > > i.e. _not_ report it as memory. > > > > Thanks, Mike for the comments. > > Few concerns with this approach. > > 1) One concern is, even if firmware doesn't report these regions as > memory, we would need addresses for these to be part of device tree so > that the clients would be able to get these addresses. Otherwise there > is no way for client to know these addresses. > > 2) This would also add a dependency on firmware to be able to pass these > regions not as memory, though we know that these regions would be used > by the clients. Isn't it better to have such control within the kernel ? If it is memory that is used by the kernel it should be reported as memory and have the memory map. If this is a hole in the memory layout from the kernel perspective, then kernel should not bother with this memory. And I'm not buying "low memory target" argument if you have enough memory to carve out ~600M for some mysterious clients. > Let me know your comments on these. > > Thanks, > Vijay -- Sincerely yours, Mike.