All of lore.kernel.org
 help / color / mirror / Atom feed
From: Adam Borowski <kilobyte@angband.pl>
To: Chris Murphy <lists@colorremedies.com>
Cc: "Darrick J. Wong" <darrick.wong@oracle.com>,
	Marc Joliet <marcec@gmx.de>,
	Btrfs BTRFS <linux-btrfs@vger.kernel.org>
Subject: Re: out-of-band dedup status?
Date: Fri, 9 Dec 2016 09:25:00 +0100	[thread overview]
Message-ID: <20161209082500.GA28652@angband.pl> (raw)
In-Reply-To: <CAJCQCtSRUmQarebB6rK_sCiVGpBZ-Xcptr17zu_XoJC8EF9BoQ@mail.gmail.com>

On Thu, Dec 08, 2016 at 07:54:39PM -0700, Chris Murphy wrote:
> On Thu, Dec 8, 2016 at 7:26 PM, Darrick J. Wong <darrick.wong@oracle.com> wrote:
> > Ew, it's deduping these two 1.4GB files 128K at a time, which results in
> > 12000 ioctl calls.  Each of those 12000 calls has to lock the two
> > inodes, read the file contents, remap the blocks, etc.  instead of
> > finding the maximal identical range and making a single call for the
> > whole range.
> >
> > That's probably why it's taking forever to dedupe.
> 
> Yes but it looks like it's also heavily fragmenting the files as a
> result as well.

Thus I think it's better to do whole-file dedupe only, other than in some
special cases (like VM images).  Much simpler, faster and doesn't cause
fragmentation.

-- 
u-boot problems can be solved with the help of your old SCSI manuals, the
parts that deal with goat termination.  You need a black-handled knife, and
an appropriate set of candles (number and color matters).  Or was it a
silver-handled knife?  Crap, need to look that up.

  reply	other threads:[~2016-12-09  8:25 UTC|newest]

Thread overview: 13+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2016-12-08 18:36 out-of-band dedup status? Christoph Anton Mitterer
2016-12-08 20:15 ` Jeff Mahoney
2016-12-08 20:41   ` Chris Murphy
2016-12-08 22:27     ` Christoph Anton Mitterer
2016-12-08 23:31     ` Marc Joliet
2016-12-09  0:45       ` Chris Murphy
2016-12-09  2:26         ` Darrick J. Wong
2016-12-09  2:54           ` Chris Murphy
2016-12-09  8:25             ` Adam Borowski [this message]
2016-12-09 12:29             ` Austin S. Hemmelgarn
2016-12-09 18:16               ` Darrick J. Wong
2016-12-09 19:18                 ` Chris Murphy
2016-12-09  8:43   ` Adam Borowski

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20161209082500.GA28652@angband.pl \
    --to=kilobyte@angband.pl \
    --cc=darrick.wong@oracle.com \
    --cc=linux-btrfs@vger.kernel.org \
    --cc=lists@colorremedies.com \
    --cc=marcec@gmx.de \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.