From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id B157FC41513 for ; Sat, 14 Oct 2023 19:16:21 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229558AbjJNTKT (ORCPT ); Sat, 14 Oct 2023 15:10:19 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:38032 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229508AbjJNTKT (ORCPT ); Sat, 14 Oct 2023 15:10:19 -0400 Received: from out5-smtp.messagingengine.com (out5-smtp.messagingengine.com [66.111.4.29]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 84E7DBF for ; Sat, 14 Oct 2023 12:10:17 -0700 (PDT) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id E84065C0362; Sat, 14 Oct 2023 15:10:16 -0400 (EDT) Received: from imap50 ([10.202.2.100]) by compute4.internal (MEProxy); Sat, 14 Oct 2023 15:10:16 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= colorremedies.com; h=cc:cc:content-type:content-type:date:date :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:sender:subject:subject:to:to; s=fm3; t= 1697310616; x=1697397016; bh=CkWvhXp5v6J9f99NBw8IZBhISFO45zdBrhN rMkJqLV0=; b=G54YQLV7VObCkFwo+TPZqo+pkBPu/Q8lncdAuiifhwFXcOz1YJk JW27Q7lnfzz63YV1it5waiWhqzmG8/5gBbr0ITlcQLJgFxvS6ZapmOvCfEtNfdUP +ovVM9gpFCVledekAn6A5U9QVYmCLylItu1DWL7XRHxH0uuYQjp6cSBTDBuB4J6O yz9XzBUnd6IIt5iJTUURVCxyZ+CbLVGgaCGQsX+jGkh2lx/eymo8R0r1UBiXVCsB wSDgFiDtdm0k3wAPui57KbDTR2szsZTs8GU+zkvwTDr1DJ5TNHZxRsFOb6FvHUt5 c+geoVXDjzkuriMIpV0omRYk5DkXpfovBgA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm3; t=1697310616; x=1697397016; bh=CkWvhXp5v6J9f 99NBw8IZBhISFO45zdBrhNrMkJqLV0=; b=YKkl0RtOC3E2ZsKQ8wXD6XDt6jx75 CH0IMq21vguP3RODp/r0BqlC4ezXSIfYdOHIgxRwIEedRnWPl5RQyMYbXwdTJuGO jKviYlSxysPEJmQMS5Bwhdd/AK+qZ0aOp8VZNIbcAmCMylrIU1y0aC9Qy/5GU6o7 /jv/KYSlLBcuxBsWNolSsyPJbb3vqYjU6PfpiDAKQu+1GnzYzGqysJjRviKRC97R 3V+YhIT0Uf1gV4CoWxeiCEDb8Obh8CYe0xCWmocShnMjZD3TXiwcwaGhhnvvqu8s 834fegCn30hwlE6j9YD6Y+LyPf7LzLXr2iA2A8eHLFpLNYZ3rXTw+ZChA== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedrieehgddufedvucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepofgfggfkjghffffhvfevufgtsehttdertderredtnecuhfhrohhmpedfvehh rhhishcuofhurhhphhihfdcuoehlihhsthhssegtohhlohhrrhgvmhgvughivghsrdgtoh hmqeenucggtffrrghtthgvrhhnpefgvdeukedtfefgfefgtdelffdvieeltefgfedutdff leeuieevieevkeehtdehueenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmh grihhlfhhrohhmpehlihhsthhssegtohhlohhrrhgvmhgvughivghsrdgtohhm X-ME-Proxy: Feedback-ID: i06494636:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id 83F561700089; Sat, 14 Oct 2023 15:10:16 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.9.0-alpha0-1019-ged83ad8595-fm-20231002.001-ged83ad85 MIME-Version: 1.0 Message-Id: <7dd58d68-3daf-4dd5-b6b7-e3ee0e160f68@app.fastmail.com> In-Reply-To: <7bcaeca0-641a-43e8-8ffb-1f729e5e327d@gmx.com> References: <4b8a10e4-4df8-4d96-9c6f-fbbe85c64575@suse.com> <4cb27e5b-2903-4079-8e72-d9db2f19ced7@gmx.com> <7bcaeca0-641a-43e8-8ffb-1f729e5e327d@gmx.com> Date: Sat, 14 Oct 2023 15:09:56 -0400 From: "Chris Murphy" To: "Qu Wenruo" , fdavidl073rnovn@tutanota.com Cc: "Qu WenRuo" , "Btrfs BTRFS" Subject: Re: Deleting large amounts of data causes system freeze due to OOM. Content-Type: text/plain Precedence: bulk List-ID: X-Mailing-List: linux-btrfs@vger.kernel.org On Fri, Oct 13, 2023, at 6:32 PM, Qu Wenruo wrote: > On 2023/10/14 08:58, fdavidl073rnovn@tutanota.com wrote: >> Is there anything else I can do to make sure this is addressed at some point? I would like to eventually be able to re-enable compression as it was saving me several terabytes. > > I believe Filipe is working on improving the extent map code recently. > You may want to test his patchset when it comes out. > > Otherwise you may need to keep away from compression for now. Is the cost of tracking extents reduced at all by increasing leaf/node size? The number of extents is the same, so that cost wouldn't be reduced - and maybe that's the bulk of the problem. But if it's also related to the cost of having so many leaves, maybe it would help?