From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 31048C54E58 for ; Thu, 21 Mar 2024 21:08:52 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 3FADA6B0082; Thu, 21 Mar 2024 17:08:51 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 3AA0D6B0088; Thu, 21 Mar 2024 17:08:51 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 298AB6B0089; Thu, 21 Mar 2024 17:08:51 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id 1BA136B0082 for ; Thu, 21 Mar 2024 17:08:51 -0400 (EDT) Received: from smtpin16.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay10.hostedemail.com (Postfix) with ESMTP id 9D9C4C04E1 for ; Thu, 21 Mar 2024 21:08:50 +0000 (UTC) X-FDA: 81922285620.16.6E6203E Received: from mail-yb1-f176.google.com (mail-yb1-f176.google.com [209.85.219.176]) by imf17.hostedemail.com (Postfix) with ESMTP id CFA3D40002 for ; Thu, 21 Mar 2024 21:08:48 +0000 (UTC) Authentication-Results: imf17.hostedemail.com; dkim=pass header.d=google.com header.s=20230601 header.b=Z0afnmC3; dmarc=pass (policy=reject) header.from=google.com; spf=pass (imf17.hostedemail.com: domain of surenb@google.com designates 209.85.219.176 as permitted sender) smtp.mailfrom=surenb@google.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1711055328; a=rsa-sha256; cv=none; b=M9gGRTLOM7yPPcS8Pg5BI4T+5Vyt52UX7u+NI4fWe708CrxI/7eaA5QDImYecAp/YD3ncM lRUnIHYJQJt/6HRbBqiow8eAp7pkfXflupJ/4BLuA4S6lpblO8O5zr+fBH+tnJzUC5/bkL DwKKOlr9LkN/iqmT0qavAayBSECv7vo= ARC-Authentication-Results: i=1; imf17.hostedemail.com; dkim=pass header.d=google.com header.s=20230601 header.b=Z0afnmC3; dmarc=pass (policy=reject) header.from=google.com; spf=pass (imf17.hostedemail.com: domain of surenb@google.com designates 209.85.219.176 as permitted sender) smtp.mailfrom=surenb@google.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1711055328; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=NRNPrWHMxiQDcKwm3DA9WZxrfwYc+pk9Whir/OXbLVs=; b=4BeJnAnkBbpxhI/bvVR6dHdeALGmojWHfbLLUO4LB3AmnZu0OUM1P+HVo83IttGL84JtIh zzvLWvwnUVYSRuy0Ua8Pm3UXHRCejG8nhGCVclPKETlVbZgd5CaNyGltvrudh3LKT3gnn0 eaST4OB0CxGRjh9jDrCxGkhaWPo4XWY= Received: by mail-yb1-f176.google.com with SMTP id 3f1490d57ef6-dcc80d6004bso1440924276.0 for ; Thu, 21 Mar 2024 14:08:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20230601; t=1711055328; x=1711660128; darn=kvack.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=NRNPrWHMxiQDcKwm3DA9WZxrfwYc+pk9Whir/OXbLVs=; b=Z0afnmC3m7a2IEa4SrJ6f5X5YIq8irHnrC8qniwJIIdcuJR/jiHEqxq+h/au808RLO OjQ7fyqpIxpBVis15Ki5DiaIMGIZWnl1pF2x+lPdvB9jBekDtmMSs/ru1U71dn47Q8r+ cqqp4qA5bjJwPnVkyLZ56q/hMOfztl9Mz8qn1MJTsgTaaAIuOXeDr9O7opzpo3o3Psrl k6z1SRVBjHsLqNSkUkg0rHFKvInJBvXOQMPpIG7n6fGrBM1xt1mbkhhR2pUIEe5vgAqy HLcsdElyVhGj/5ApmlbZxvd15iHpeOO6j0dgNdKvIGZDp0717848+GFi4U9PHE5Qbc4W 61wg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1711055328; x=1711660128; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=NRNPrWHMxiQDcKwm3DA9WZxrfwYc+pk9Whir/OXbLVs=; b=EiVasRrQX9iw1uRHCaHhMNB3mEVG1JYHflaadtAase9o8ES7TI0mweFYsQwVgkq15X sv7GBM/fIeBh5epcU8gGucYs2Eq5k5TlSrydRRA3xpCvnvGI4Yz9/7mEQBHDPPcPD01e O4cZqDFdMTkCv0nHX1/ixwwK7JTy/XYGdiNHGllvfylC4J2LOFdKyDYkIaRWCc7FcfZ7 yIh6dUHh9NeN+X8Q1o4dRwmscrH8If1b9mZXzphvEKCGqP27VpfVUUvFyzd/VViVDaTi Yi2IsnwQ0/acLIEQ+JG0f8NGIPNUIYT/5DJEtcuyt7Y8+UR5ClYwsYzEF2W/ZWm4S6Be G8OA== X-Forwarded-Encrypted: i=1; AJvYcCVYgUX29lsm/tIlWvy8kXKU5zjg7s2vrQN7I5x3s8SXBD0lEDEdqXfpYvrCD2KEnVoLB7XCeFPjOOAq6vQsPmnZrzo= X-Gm-Message-State: AOJu0Yzxp9U/oBAMpfVPs/bc4sdtgnhZD+341GqOdYlCwLnYwBRc7PhL uhG4UoTGU/frFe+k7FOLwuR8PIR2VkKOJ687WbN4A0Gi8GaDRblEnqrefIBqUM+S09XeJreqBsw fkPNotUZRMhSonPx/Yr2DPc8old+8NUgRsTs7 X-Google-Smtp-Source: AGHT+IFQjWJqcUXxfuhd8any/MYD5BWIbsIOeqDcrZmmixvYhOq+BO7q8gQSEJbNPKfsdpWwwz0LdvkayxzWMZVyrx4= X-Received: by 2002:a25:6903:0:b0:dcf:f78f:a570 with SMTP id e3-20020a256903000000b00dcff78fa570mr390215ybc.7.1711055327530; Thu, 21 Mar 2024 14:08:47 -0700 (PDT) MIME-Version: 1.0 References: <20240321163705.3067592-1-surenb@google.com> <20240321134157.212f0fbe1c03479c01e8a69e@linux-foundation.org> In-Reply-To: <20240321134157.212f0fbe1c03479c01e8a69e@linux-foundation.org> From: Suren Baghdasaryan Date: Thu, 21 Mar 2024 14:08:34 -0700 Message-ID: Subject: Re: [PATCH v6 00/37] Memory allocation profiling To: Andrew Morton Cc: kent.overstreet@linux.dev, mhocko@suse.com, vbabka@suse.cz, hannes@cmpxchg.org, roman.gushchin@linux.dev, mgorman@suse.de, dave@stgolabs.net, willy@infradead.org, liam.howlett@oracle.com, penguin-kernel@i-love.sakura.ne.jp, corbet@lwn.net, void@manifault.com, peterz@infradead.org, juri.lelli@redhat.com, catalin.marinas@arm.com, will@kernel.org, arnd@arndb.de, tglx@linutronix.de, mingo@redhat.com, dave.hansen@linux.intel.com, x86@kernel.org, peterx@redhat.com, david@redhat.com, axboe@kernel.dk, mcgrof@kernel.org, masahiroy@kernel.org, nathan@kernel.org, dennis@kernel.org, jhubbard@nvidia.com, tj@kernel.org, muchun.song@linux.dev, rppt@kernel.org, paulmck@kernel.org, pasha.tatashin@soleen.com, yosryahmed@google.com, yuzhao@google.com, dhowells@redhat.com, hughd@google.com, andreyknvl@gmail.com, keescook@chromium.org, ndesaulniers@google.com, vvvvvv@google.com, gregkh@linuxfoundation.org, ebiggers@google.com, ytcoode@gmail.com, vincent.guittot@linaro.org, dietmar.eggemann@arm.com, rostedt@goodmis.org, bsegall@google.com, bristot@redhat.com, vschneid@redhat.com, cl@linux.com, penberg@kernel.org, iamjoonsoo.kim@lge.com, 42.hyeyoo@gmail.com, glider@google.com, elver@google.com, dvyukov@google.com, songmuchun@bytedance.com, jbaron@akamai.com, aliceryhl@google.com, rientjes@google.com, minchan@google.com, kaleshsingh@google.com, kernel-team@android.com, linux-doc@vger.kernel.org, linux-kernel@vger.kernel.org, iommu@lists.linux.dev, linux-arch@vger.kernel.org, linux-fsdevel@vger.kernel.org, linux-mm@kvack.org, linux-modules@vger.kernel.org, kasan-dev@googlegroups.com, cgroups@vger.kernel.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspam-User: X-Rspamd-Server: rspam06 X-Rspamd-Queue-Id: CFA3D40002 X-Stat-Signature: drcetm8uo6yth1cy3pqky3moqjjzb3ge X-HE-Tag: 1711055328-183346 X-HE-Meta: U2FsdGVkX1/AxvTOYmoozTlUTmm+VwwKXD6604fYuXNpJ/5+xtCoIdfZmGxUt66IWRSMoeAi+RhKrN9g31cTkHVS72QGzA/ijXusK2BlMbzFEVBYEvvVxKChXeiHNBAyPqDxVVs9xbqo1UO994ePdgtcmQbamlPLZ34kNYfHqddJ26NW3aFxyrxcrPh3kbKiTy4jQzMfzKdHJjFgHywKopE5evJPud4rK8EYwxM6SWztUNcvrWa2Vixz9Zy+7CTPSbiXOyVKOV5JiauMWpfLxq4pJBFFkN4xBgVlOhX/y0KBcna7G9lnr2EeohkdIPWVZayunDUZz1zmeoJ2F4X9kUfA7oMKvwMDADJpKkiU/HHMW+roxrTemJpz++2ivbBhqUlekmhbAhdX71N2amkIyPKuq5qBYwu9eVG1Fy+sur1BsqqT9EArRXgCVRbP/kaySZuEKrb7G7D/oppiX/1JhPadufnRwWHB8mRKC/UUCdwPeJiDSLKyw8UWgGNRO+8kCRYcoZEP+N3fs/GZR5aGdIXnxjLMUOJjWorOqSAPbyDNyk0SWAdoRtybgwDbM9rMg00ri52W6RRWNk2BOBKWR9OGs5Gvr/ygrx8CPXHRADDzVYVtOEdXioYLOyqEOUuR5v3vDZd2e1b9NPSPiwiMy2WrsB9s1tfhQ1IxRf8D/+5qahzGXq7EjdIDY+Be2jjcRr8p/YWJKnhL45nl3BAV/mMNfx2mLdlFeloEWHo+RnJ7AUh/3QCmHigbj1kFuy05GvWkJxqZPY0XhynmjWu9f29hnuFmDpgdIldhn2f7ibIbSJxdkmrW5D9WMdzuNk6nvJvG1uyFzl4zfkLDgzl9Ut50vXlhyNJxKLalV/oyC03ugkf+uiMgPZZz0t+Dnbkdgp5axVTiKMdPjkzztlEXd/UHA18si0j6jwXRoAgB2j4CmTvMNav0S2RhJQYDYiC5VP4eaEFUthMH5dTy/X0 2j1Mdfpf iv2QlXGA6esthzcnJ06sawvW0W1GMUzrSi2hUrwYM5af6HoBaL/7Z1CbdruQkNrcswNLcTpVtvvmqXuInOUBzufYfJnsHusZotyUxPeV/bpPL27k/u/PFdtaiuMndqt65xq60Rsduho/cZ+mOeLzb+I3n2g8qOqOwu/dFbxAAxQ4x8EwDNyvBG2YUhecO7UTFOLRHfAoTbRZrhk8MtIQpv9JUFeKkvAMt7sOgQ6P/3yWKbGjcwvtClnmrnUROx9KIqaUbNKPNTiIUhMGrDBe2jP29b4QPewzqNfpCfUnXyaTguCPWRPGLXQfnpVQf3Ml+a+pgReSm6dPA2WOxDqyvXqiIC9xL7P3Sku/OUDkzL7I1Z4aRCVPCwz1MIbsYnYdL67Hn X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Thu, Mar 21, 2024 at 1:42=E2=80=AFPM Andrew Morton wrote: > > On Thu, 21 Mar 2024 09:36:22 -0700 Suren Baghdasaryan = wrote: > > > Low overhead [1] per-callsite memory allocation profiling. Not just for > > debug kernels, overhead low enough to be deployed in production. > > > > Example output: > > root@moria-kvm:~# sort -rn /proc/allocinfo > > 127664128 31168 mm/page_ext.c:270 func:alloc_page_ext > > 56373248 4737 mm/slub.c:2259 func:alloc_slab_page > > 14880768 3633 mm/readahead.c:247 func:page_cache_ra_unbounded > > 14417920 3520 mm/mm_init.c:2530 func:alloc_large_system_hash > > 13377536 234 block/blk-mq.c:3421 func:blk_mq_alloc_rqs > > 11718656 2861 mm/filemap.c:1919 func:__filemap_get_folio > > 9192960 2800 kernel/fork.c:307 func:alloc_thread_stack_node > > 4206592 4 net/netfilter/nf_conntrack_core.c:2567 func:nf_ct= _alloc_hashtable > > 4136960 1010 drivers/staging/ctagmod/ctagmod.c:20 [ctagmod] fu= nc:ctagmod_start > > 3940352 962 mm/memory.c:4214 func:alloc_anon_folio > > 2894464 22613 fs/kernfs/dir.c:615 func:__kernfs_new_node > > Did you consider adding a knob to permit all the data to be wiped out? > So people can zap everything, run the chosen workload then go see what > happened? > > Of course, this can be done in userspace by taking a snapshot before > and after, then crunching on the two.... Yeah, that's exactly what I was envisioning. Don't think we need to complicate more by adding a reset functionality unless there are other reasons for it. Thanks!