All of lore.kernel.org
 help / color / mirror / Atom feed
From: Joel Becker <Joel.Becker@oracle.com>
To: ocfs2-devel@oss.oracle.com
Subject: [Ocfs2-devel] [PATCH 3/5] ocfs2: use allocation reservations for directory data
Date: Mon, 22 Mar 2010 13:41:59 -0700	[thread overview]
Message-ID: <20100322204158.GB14285@mail.oracle.com> (raw)
In-Reply-To: <20100321232623.GN11402@wotan.suse.de>

On Sun, Mar 21, 2010 at 04:26:23PM -0700, Mark Fasheh wrote:
> On Fri, Mar 19, 2010 at 11:18:48PM -0700, Joel Becker wrote:

> Aside from cleaning up the license info, I remove the dir_resv/no_dir_resv
> options. I also added a flags field to struct ocfs2_alloc_reservation which
> saves us the 'tmpwindow' argument to ocfs2_resmap_resv_bits().

	I like the changes.

> > 	I was thinking about a kernel tree untar where the directories
> > are holding on to reservations as thousands of files are created under
> > them.  Wouldn't that lead to cannibalization and show us that pattern?
> > This is just a lay guess - you have a lot more familiarity with the
> > code.
> 
> I don't know how much a kernel build is going to make a difference. I took a
> couple images after kernel builds with various options but didn't see
> anything obvious. To be fair though, I only checked one or two files. I'll
> upload the images somewhere shortly.
> 
> As an interim compromise, I changed the code to get minimum (8 bits) sized
> windows on directories. That way, they'll get some amount of
> continguousness, but not as much as file data. We can easily adjust in any
> direction we want.

	I wonder how the varying reservation sizes will impact
ulilization of the localalloc.  May not matter, but there's a part of me
that wonders.  Does the new dir-resv code do as well on your tests as
the no-dir-resv code?
	Maybe something to see any help from dir reservations would be a
many-parallel-untar sort of thing?  Unpack 20 kernel trees at the same
time?  Some other package with a lot of files.  I have no idea if this
will mean anything, and I actually rather trust your observations of
previous untars.  I'm just casting about for something to show us how
dir reservations are behaving.

Joel

-- 

Life's Little Instruction Book #451

	"Don't be afraid to say, 'I'm sorry.'"

Joel Becker
Principal Software Developer
Oracle
E-mail: joel.becker at oracle.com
Phone: (650) 506-8127

  reply	other threads:[~2010-03-22 20:41 UTC|newest]

Thread overview: 16+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2010-03-17  6:59 [Ocfs2-devel] [PATCH 0/5] Ocfs2 allocation reservations Mark Fasheh
2010-03-17  6:59 ` [Ocfs2-devel] [PATCH 1/5] ocfs2: " Mark Fasheh
2010-03-19 22:40   ` Joel Becker
2010-03-19 23:56     ` Mark Fasheh
2010-03-17  6:59 ` [Ocfs2-devel] [PATCH 2/5] ocfs2: use allocation reservations during file write Mark Fasheh
2010-03-17  6:59 ` [Ocfs2-devel] [PATCH 3/5] ocfs2: use allocation reservations for directory data Mark Fasheh
2010-03-19 22:43   ` Joel Becker
2010-03-20  0:14     ` Mark Fasheh
2010-03-20  1:25       ` Joel Becker
2010-03-20  3:47         ` Mark Fasheh
2010-03-20  6:18           ` Joel Becker
2010-03-21 23:26             ` Mark Fasheh
2010-03-22 20:41               ` Joel Becker [this message]
2010-03-17  6:59 ` [Ocfs2-devel] [PATCH 4/5] ocfs2: allocate btree internal block groups from the global bitmap Mark Fasheh
2010-03-17  6:59 ` [Ocfs2-devel] [PATCH 5/5] ocfs2: remove ocfs2_local_alloc_in_range() Mark Fasheh
2010-03-17 20:17 ` [Ocfs2-devel] [PATCH 0/5] Ocfs2 allocation reservations Mark Fasheh

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20100322204158.GB14285@mail.oracle.com \
    --to=joel.becker@oracle.com \
    --cc=ocfs2-devel@oss.oracle.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.