From: Peter Braam <Peter.Braam@Sun.COM>
To: lustre-devel@lists.lustre.org
Subject: [Lustre-devel] How store HSM metadata in MDT ?
Date: Fri, 11 Jul 2008 15:57:30 -0600 [thread overview]
Message-ID: <C49D336A.63D9%peter.braam@sun.com> (raw)
In-Reply-To: <48776ECD.3000501@cea.fr>
A one time event to build a database or log is acceptable.
However, the proposal so far would require frequent scans because the
metadata would be in the wrong place, that is what I want to avoid.
Maintaining that metadata is very simple, and can solve some problems that
you cannot easily solve without maintaining a database in conjunction with
the HSM (such as cleaning partial, aborted copies into the HSM). You?d
simply ask the moving script to contact a database and make a record. The
database may not be able to keep up with all file creations in the FS but it
can probably keep up with the activities that one moving node does to/from
the HSM.
Peter
On 7/11/08 8:31 AM, "Jacques-Charles Lafoucriere" <jc.lafoucriere@cea.fr>
wrote:
>
>
> Peter Braam wrote:
>>
>>
>> There is a rule in Lustre - no scanning, ever. This rule will not be broken
>> by HSM.
>>
> If a site wants to connect an HSM to an existing file system (close to be
> full)
> how do we do without fast scanning ?
> We cannot restrict the use of HSM binding only on new file systems
>
> JC
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-devel-lustre.org/attachments/20080711/61dbfe02/attachment.htm>
next prev parent reply other threads:[~2008-07-11 21:57 UTC|newest]
Thread overview: 21+ messages / expand[flat|nested] mbox.gz Atom feed top
2008-07-03 11:43 [Lustre-devel] How store HSM metadata in MDT ? Aurelien Degremont
2008-07-03 21:10 ` Peter Braam
2008-07-04 14:37 ` Aurelien Degremont
2008-07-05 16:50 ` Andreas Dilger
2008-07-06 3:20 ` Peter Braam
2008-07-06 3:24 ` Peter Braam
2008-07-06 19:24 ` Lee Ward
2008-07-06 22:53 ` Peter Braam
2008-07-08 12:06 ` Rick Matthews
2008-07-08 8:52 ` Aurelien Degremont
2008-07-08 17:41 ` Peter Braam
2008-07-09 13:25 ` Aurelien Degremont
2008-07-09 13:49 ` Peter Braam
2008-07-11 14:32 ` Jacques-Charles Lafoucriere
2008-07-11 22:03 ` Peter Braam
2008-07-11 14:37 ` Jacques-Charles Lafoucriere
2008-07-11 22:12 ` Peter Braam
2008-07-11 14:31 ` Jacques-Charles Lafoucriere
2008-07-11 21:57 ` Peter Braam [this message]
2008-07-16 10:26 ` Jacques-Charles Lafoucriere
2008-07-16 19:00 ` Peter Braam
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=C49D336A.63D9%peter.braam@sun.com \
--to=peter.braam@sun.com \
--cc=lustre-devel@lists.lustre.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.