From: Mikhail Pershin <Mikhail.Pershin@Sun.COM>
To: lustre-devel@lists.lustre.org
Subject: [Lustre-devel] Recovering opens by reconstruction
Date: Tue, 07 Jul 2009 20:42:52 +0400 [thread overview]
Message-ID: <op.uwph1qacatmt0c@garden> (raw)
In-Reply-To: <20090707152105.GM5073@webber.adilger.int>
On Tue, 07 Jul 2009 19:21:05 +0400, Andreas Dilger <adilger@sun.com> wrote:
> This actually has a second benefit in that we don't have to keep huge
> lists of open RPCs in the replay list that will be skipped each time we
> are trying to cancel committed RPCs. For HPCS we need to handle 100k
> opens on a single client, and cancelling RPCs from the replay list is
> an O(n^2) operation since it does a list walk to find just-committed
> RPCs.
Absolutely, all benefits are clear and I fully agree but all of them are
not in reply signature context. I was just afraid that inside replay
signature task such big changes will defer replay signature itself. But if
we have time to make it in right way then it is good.
> Actually, the need to have separate recovery stages in HEAD is no longer
> needed. The addition of extra replay stages was a result of fixing a bug
> in recovery where open file handles were not being replayed before
> another client unlinked the file. However, this has to be fixed for VBR
> delayed
> recovery anyways, so we may as well fix this with a single mechanism
> instead of adding a separate recovery stage that requires waiting for
> all clients to join or be evicted before any recovery can start.
>
> The proper solution, as also needed by delayed recovery, is to move A
> to the PENDING list during replay and remove it at the end of replay.
> With 1.x we would have to also remove the inode from PENDING if some
> other node reuses that inode number, but since this extra recovery
> stage is only present in 2.0 and we will not implement delayed recovery
> for 1.x we can simply remove all unreferenced inodes from PENDING at
> the end of recovery (until delayed recovery is completed).
Exactly, that is what I meant and that is why I don't like another strict
'stage'
>
> It would be possible to flag the unlink RPCs with a special flag (maybe
> just OBD_MD_FLEASIZE/OBD_MD_FLCOOKIE) to distinguish between unlinks
> that also destroy the objects, and unlinks that cause open-unlinked
> files.
> For replayed unlinks that cause objects to be destroyed we know that
> there are no other clients holding the file open after that point and
> we don't have to put the inode into PENDING at all.
I've just thought about the same, it is quite obvious solution here.
--
Mikhail Pershin
Staff Engineer
Lustre Group
Sun Microsystems, Inc.
next prev parent reply other threads:[~2009-07-07 16:42 UTC|newest]
Thread overview: 20+ messages / expand[flat|nested] mbox.gz Atom feed top
2009-07-02 22:39 [Lustre-devel] Recovering opens by reconstruction Nicolas Williams
2009-07-03 19:02 ` Mikhail Pershin
2009-07-03 21:55 ` Nicolas Williams
2009-07-04 0:48 ` Nicolas Williams
2009-07-04 7:14 ` Mikhail Pershin
2009-07-04 7:10 ` Mikhail Pershin
2009-07-06 17:34 ` Nicolas Williams
2009-07-06 22:42 ` Nicolas Williams
2009-07-07 9:56 ` Alex Zhuravlev
2009-07-07 14:38 ` Andreas Dilger
2009-07-08 6:46 ` Alex Zhuravlev
2009-07-07 16:03 ` Nicolas Williams
2009-07-07 13:56 ` Mikhail Pershin
2009-07-07 15:21 ` Andreas Dilger
2009-07-07 16:42 ` Mikhail Pershin [this message]
2009-07-07 16:50 ` Nicolas Williams
2009-07-07 16:14 ` Nicolas Williams
2009-07-08 17:15 ` Alex Zhuravlev
2009-07-06 17:20 ` Nicolas Williams
2009-07-06 22:37 ` Nicolas Williams
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=op.uwph1qacatmt0c@garden \
--to=mikhail.pershin@sun.com \
--cc=lustre-devel@lists.lustre.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.