linux-ext4.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Jan Kara <jack-AlSwsSmVLrQ@public.gmane.org>
To: Dave Chinner <david-FqsqvQoI3Ljby3iVrkZq2A@public.gmane.org>
Cc: xfs-VZNHf3L845pBDgjK7y7TUQ@public.gmane.org,
	linux-ext4-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
	linux-fsdevel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
	linux-api-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
	tytso-3s7WtUTddSA@public.gmane.org
Subject: Re: lazytime implementation questions
Date: Tue, 5 Jan 2016 18:36:04 +0100	[thread overview]
Message-ID: <20160105173604.GE18604@quack.suse.cz> (raw)
In-Reply-To: <20160104062219.GB19802@dastard>

  Hi,

On Mon 04-01-16 17:22:19, Dave Chinner wrote:
> I've been looking at implementing the lazytime mount option for XFS,
> and I'm struggling to work out what it is supposed to mean.
> 
> AFAICT, on ext4, lazytime means that pure timestamp updates are not
> journalled and they are only ever written back when the inode is
> otherwise dirtied and written, or they are timestamp dirty for 24
> hours which triggers writeback.
> 
> This poses a couple of problems for XFS:
> 
> 	1. we log every timestamp change, so there is no mechanism
> 	   for delayed/deferred update.
> 
> 	2. we track dirty metadata in the journal, not via the VFS
> 	   dirty inode lists, so all the infrastructure written for
> 	   ext4 to do periodic flushing is useless to us.
> 
> These are solvable problems, but what I'm not sure about is exactly
> what the intended semantics of lazytime durability are. That is,
> exactly what guaranteed are we giving userspace about timestamp
> updates when lazytime is used? The guarantees we have to give will
> greatly influence the XFS implementation, so I really need to nail
> down what we are expected to provide userspace. Can we:
> 
> 	a) just ignore all durability concerns?
> 	b) if not, do we only need to care about the 24 hour
> 	   writeback and unmount?
> 	c) if not, are fsync/sync/syncfs/freeze/unmount supposed
> 	   to provide durability of all metadata changes?
> 	d) do we have to care about ordering - if we fsync one inode
> 	   with 1 hour old timestamps, do we also need to guarantee
> 	   that all the inodes with older dirty timestamps also get
> 	   made durable?

So the intended semantics is:
1) fsync / sync / freeze / unmount will write the timestamp updates even
   with lazytime. So unless crash happens, timestamps are guaranteed to be
   consistent. Also sync / fsync guarantees all changes to get to disk.
2) We periodically write back timestamps (once per 24 hours) to avoid too
   big timestamp inconsistencies in case of crash.

Otherwise there are no guarantees wrt durability. I've CCed Ted who
designed this just in case I missed something.

								Honza
-- 
Jan Kara <jack-IBi9RG/b67k@public.gmane.org>
SUSE Labs, CR

       reply	other threads:[~2016-01-05 17:36 UTC|newest]

Thread overview: 4+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <20160104062219.GB19802@dastard>
2016-01-05 17:36 ` Jan Kara [this message]
     [not found]   ` <20160105173604.GE18604-+0h/O2h83AeN3ZZ/Hiejyg@public.gmane.org>
2016-01-05 22:59     ` lazytime implementation questions Dave Chinner
2016-01-07  1:05       ` Theodore Ts'o
     [not found]         ` <20160107010506.GB2866-AKGzg7BKzIDYtjvyW6yDsg@public.gmane.org>
2016-01-07  2:21           ` Dave Chinner

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20160105173604.GE18604@quack.suse.cz \
    --to=jack-alswssmvlrq@public.gmane.org \
    --cc=david-FqsqvQoI3Ljby3iVrkZq2A@public.gmane.org \
    --cc=linux-api-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=linux-ext4-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=linux-fsdevel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=tytso-3s7WtUTddSA@public.gmane.org \
    --cc=xfs-VZNHf3L845pBDgjK7y7TUQ@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).