From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 14DBA252915 for ; Mon, 3 Mar 2025 16:31:01 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=170.10.129.124 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1741019464; cv=none; b=DtQb1ldzjwZSxGju4QFQ5CEOUKhuncehNhDYhgkget1qqACAwar5i4pXX8CdNicS9a9Z6XBuCWnrWKP2iT/ldSy1ErpPmk/HeJCBqdOITUoY3GMiWlKvR44H/muxv6XO1Sj3ICNg+IOpacNQpCRNGaWf7vmRjNOdOU34jw2huKA= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1741019464; c=relaxed/simple; bh=67PK8pUQYPqYlMZHYSLo+XzRkAgj9tRIuRjTWNQ3VlA=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=Q1d/fscWzKwN47tfeWDXYA1mlnlGV08yfhSRJDlcWlmiH9NuJRlIkR+I+gfe8/03bMFgf/eoZUTFrtlnkyVdHaQ1asVSNK2lKIzOLxXdV/x5xLvL73BsiUJAilSIMgvL2y1/y1U3ZiL2+Cc5t0W/FzpGYJoWLXO807w7ul60HN4= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=redhat.com; spf=pass smtp.mailfrom=redhat.com; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b=YbIkNua/; arc=none smtp.client-ip=170.10.129.124 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=redhat.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=redhat.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b="YbIkNua/" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1741019460; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6Ha8UZDq7Lu61upXZpfKkXckZhfouMk5cB7+X6dnx8Y=; b=YbIkNua/OEO9Ms4ov4nRcWukoz2CYPnxSqEB5Xf60K3Z1luN0XZCDjH4Q9OigH4zJ7QTOL KcxTZ9MM2/3gTQ5nXov0b4x6G0Hx/UzUB7IKNp4T+OAvHO/81p5+HYG31TcByQ2grYPH3k ARU0KRYNbpJOUgeNadTHg7u4MI3bpVk= Received: from mail-wr1-f70.google.com (mail-wr1-f70.google.com [209.85.221.70]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-169-vqzkJhznOUCKO1dJi9zWUQ-1; Mon, 03 Mar 2025 11:30:58 -0500 X-MC-Unique: vqzkJhznOUCKO1dJi9zWUQ-1 X-Mimecast-MFC-AGG-ID: vqzkJhznOUCKO1dJi9zWUQ_1741019456 Received: by mail-wr1-f70.google.com with SMTP id ffacd0b85a97d-3910fcca0c7so352111f8f.0 for ; Mon, 03 Mar 2025 08:30:56 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741019456; x=1741624256; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=6Ha8UZDq7Lu61upXZpfKkXckZhfouMk5cB7+X6dnx8Y=; b=NdnFtE4W+UP8SKoRMM4CjD0nPC7OOjtl12DYwSlm7S/3jn0uKPJcD4jSnsPI5yzSku G7WqNlDSkqufW8IEh9/xPD22s9baUWsZ8OkdTh86Nsy/maW2gJI6H9iBauNotmWrpukE YnYUbFfAsHJXZ88jiZ7+fkjtnZnRmwY9FqyVWHu+ydJ1ollXO7A/jQEHQ/P3F3pmyvjk 4Ww00b/MzYgqpBr1ZpsBSSs7s6HEqd/cFojot6L2G24oAJQuezYrXOMvC3593xD8s/x3 LmyHDx9/VyYQuppfocWwN0DhQ3Gxtu6piN0WkI45kLezBrPh1WqiCg1MmZ5Rm9QnlaX3 Cr0A== X-Forwarded-Encrypted: i=1; AJvYcCVPTilco6hVo3L8gCh5lAZfIsKK4UTfPA0GpNuaQgwCRUlEb42shahEuN3SQaJzG/CCaw+iaX4v@vger.kernel.org X-Gm-Message-State: AOJu0Yy0wO9O/cPnKHyNcOSo9+sL28KaqI3HWb2oDfnv2FZbsYT2nDxj 8t3H8xuQntzR53noNr53IV8mTj6Pa/gWrKtycQv98Q/G4OlaaCmt/wTnaoC34en9SwSc0ImZXcb q1karfeNNVPs1IPzQ0UjqXeXwrhoNy72D4Zvx74oK7jTx9cqfw/MG5ic= X-Gm-Gg: ASbGnct4gcsKKkCMgMuV5FxOUVswdavJ5un1mSqT0gDk3kvjZUI9QzIBS0q+lEzdMQq Db+Qsi2ymCwaV3GsSM4IIGOXebxwjzdRoLcMbzk7K2tv5pbmoyyoaQuM6zfiJK0WywRFAY1Sjk9 p5GPs0TsNcKNjUw7j+NX5szhBMdYXfgXkhArKJZQbzeqIGvinQ3/zvuRxPN2I2pNrnVbuRfSGLb PjN1Z3+iX02/QcEK9UuyW1+1KjBgWqnXwVOZeXvG/JZdtRTjyYre+xESItRHGhR5thOaUn/jAt7 wX0c3cYqEZh7dKVoBhCYYsixHY/D5T29589eoteAICiExSvHdU0cRwXjtXlMz98Zg+DHV6+D5ML F X-Received: by 2002:a5d:64cf:0:b0:390:df6c:591f with SMTP id ffacd0b85a97d-390ec7cd2ddmr9512455f8f.17.1741019455906; Mon, 03 Mar 2025 08:30:55 -0800 (PST) X-Google-Smtp-Source: AGHT+IEU1cXWjWugfmabLrmr0XJAbs+GQI7107y37ij+zO9LNUtV9tqHS/ZXKWHCRmLlaLTb16eXbQ== X-Received: by 2002:a5d:64cf:0:b0:390:df6c:591f with SMTP id ffacd0b85a97d-390ec7cd2ddmr9512425f8f.17.1741019455528; Mon, 03 Mar 2025 08:30:55 -0800 (PST) Received: from localhost (p200300cbc7349600af274326a2162bfb.dip0.t-ipconnect.de. [2003:cb:c734:9600:af27:4326:a216:2bfb]) by smtp.gmail.com with UTF8SMTPSA id ffacd0b85a97d-390e485ddd1sm15052695f8f.94.2025.03.03.08.30.54 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 03 Mar 2025 08:30:55 -0800 (PST) From: David Hildenbrand To: linux-kernel@vger.kernel.org Cc: linux-doc@vger.kernel.org, cgroups@vger.kernel.org, linux-mm@kvack.org, linux-fsdevel@vger.kernel.org, linux-api@vger.kernel.org, David Hildenbrand , Andrew Morton , "Matthew Wilcox (Oracle)" , Tejun Heo , Zefan Li , Johannes Weiner , =?UTF-8?q?Michal=20Koutn=C3=BD?= , Jonathan Corbet , Andy Lutomirski , Thomas Gleixner , Ingo Molnar , Borislav Petkov , Dave Hansen , Muchun Song , "Liam R. Howlett" , Lorenzo Stoakes , Vlastimil Babka , Jann Horn Subject: [PATCH v3 17/20] fs/proc/task_mmu: remove per-page mapcount dependency for PM_MMAP_EXCLUSIVE (CONFIG_NO_PAGE_MAPCOUNT) Date: Mon, 3 Mar 2025 17:30:10 +0100 Message-ID: <20250303163014.1128035-18-david@redhat.com> X-Mailer: git-send-email 2.48.1 In-Reply-To: <20250303163014.1128035-1-david@redhat.com> References: <20250303163014.1128035-1-david@redhat.com> Precedence: bulk X-Mailing-List: cgroups@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Let's implement an alternative when per-page mapcounts in large folios are no longer maintained -- soon with CONFIG_NO_PAGE_MAPCOUNT. PM_MMAP_EXCLUSIVE will now be set if folio_likely_mapped_shared() is true -- when the folio is considered "mapped shared", including when it once was "mapped shared" but no longer is, as documented. This might result in and under-indication of "exclusively mapped", which is considered better than over-indicating it: under-estimating the USS (Unique Set Size) is better than over-estimating it. As an alternative, we could simply remove that flag with CONFIG_NO_PAGE_MAPCOUNT completely, but there might be value to it. So, let's keep it like that and document the behavior. Signed-off-by: David Hildenbrand --- Documentation/admin-guide/mm/pagemap.rst | 11 +++++++++++ fs/proc/task_mmu.c | 11 +++++++++-- 2 files changed, 20 insertions(+), 2 deletions(-) diff --git a/Documentation/admin-guide/mm/pagemap.rst b/Documentation/admin-guide/mm/pagemap.rst index d6647daca9122..afce291649dd6 100644 --- a/Documentation/admin-guide/mm/pagemap.rst +++ b/Documentation/admin-guide/mm/pagemap.rst @@ -38,6 +38,17 @@ There are four components to pagemap: precisely which pages are mapped (or in swap) and comparing mapped pages between processes. + Traditionally, bit 56 indicates that a page is mapped exactly once and bit + 56 is clear when a page is mapped multiple times, even when mapped in the + same process multiple times. In some kernel configurations, the semantics + for pages part of a larger allocation (e.g., THP) can differ: bit 56 is set + if all pages part of the corresponding large allocation are *certainly* + mapped in the same process, even if the page is mapped multiple times in that + process. Bit 56 is clear when any page page of the larger allocation + is *maybe* mapped in a different process. In some cases, a large allocation + might be treated as "maybe mapped by multiple processes" even though this + is no longer the case. + Efficient users of this interface will use ``/proc/pid/maps`` to determine which areas of memory are actually mapped and llseek to skip over unmapped regions. diff --git a/fs/proc/task_mmu.c b/fs/proc/task_mmu.c index 1162f0e72df2e..f937c2df7b3f4 100644 --- a/fs/proc/task_mmu.c +++ b/fs/proc/task_mmu.c @@ -1652,6 +1652,13 @@ static int add_to_pagemap(pagemap_entry_t *pme, struct pagemapread *pm) return 0; } +static bool __folio_page_mapped_exclusively(struct folio *folio, struct page *page) +{ + if (IS_ENABLED(CONFIG_PAGE_MAPCOUNT)) + return folio_precise_page_mapcount(folio, page) == 1; + return !folio_maybe_mapped_shared(folio); +} + static int pagemap_pte_hole(unsigned long start, unsigned long end, __always_unused int depth, struct mm_walk *walk) { @@ -1742,7 +1749,7 @@ static pagemap_entry_t pte_to_pagemap_entry(struct pagemapread *pm, if (!folio_test_anon(folio)) flags |= PM_FILE; if ((flags & PM_PRESENT) && - folio_precise_page_mapcount(folio, page) == 1) + __folio_page_mapped_exclusively(folio, page)) flags |= PM_MMAP_EXCLUSIVE; } if (vma->vm_flags & VM_SOFTDIRTY) @@ -1817,7 +1824,7 @@ static int pagemap_pmd_range(pmd_t *pmdp, unsigned long addr, unsigned long end, pagemap_entry_t pme; if (folio && (flags & PM_PRESENT) && - folio_precise_page_mapcount(folio, page + idx) == 1) + __folio_page_mapped_exclusively(folio, page)) cur_flags |= PM_MMAP_EXCLUSIVE; pme = make_pme(frame, cur_flags); -- 2.48.1