From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id BE789C64EC4 for ; Fri, 3 Mar 2023 05:22:49 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229520AbjCCFWq (ORCPT ); Fri, 3 Mar 2023 00:22:46 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:50634 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229445AbjCCFWp (ORCPT ); Fri, 3 Mar 2023 00:22:45 -0500 Received: from len.romanrm.net (len.romanrm.net [IPv6:2001:41d0:1:8b3b::1]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 5D05A14988 for ; Thu, 2 Mar 2023 21:22:44 -0800 (PST) Received: from nvm (nvm.home.romanrm.net [IPv6:fd39::101]) by len.romanrm.net (Postfix) with SMTP id CCC0340200; Fri, 3 Mar 2023 05:22:39 +0000 (UTC) Date: Fri, 3 Mar 2023 10:22:39 +0500 From: Roman Mamedov To: Matt Corallo Cc: Btrfs BTRFS Subject: Re: Salvaging the performance of a high-metadata filesystem Message-ID: <20230303102239.2ea867dd@nvm> In-Reply-To: <59b6326d-42d4-5269-72c1-9adcda4cf66c@bluematt.me> References: <59b6326d-42d4-5269-72c1-9adcda4cf66c@bluematt.me> MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Precedence: bulk List-ID: X-Mailing-List: linux-btrfs@vger.kernel.org On Thu, 2 Mar 2023 20:34:27 -0800 Matt Corallo wrote: > The problem is there's one folder that has backups of workstation, which were done by `cp > --reflink=always`ing the previous backup followed by rsync'ing over it. I believe this is what might cause the metadata inflation. Each time cp creates a whole another copy of all 3 million files in the metadata, just pointing to old extents for data. Could you instead make this backup destination a subvolume, so that during each backup you create a snapshot of it for historical storage, and then rsync over the current version? -- With respect, Roman