From: Amir Goldstein <amir73il@gmail.com>
To: lsf-pc@lists.linux-foundation.org
Cc: Jan Kara <jack@suse.cz>,
linux-fsdevel <linux-fsdevel@vger.kernel.org>,
linux-api@vger.kernel.org
Subject: [LSF/MM TOPIC ATTEND] thawing the fsnotify subsyetm
Date: Thu, 19 Jan 2017 16:28:09 +0200 [thread overview]
Message-ID: <CAOQ4uxh9ZbSfO-6V6cYNbNd2eBvVV6MxBCnpSzyp3-zKrYeWWw@mail.gmail.com> (raw)
My employer has a use case of watching file system changes
over millions of directories.
It so happens that the same product (cloud sync) also runs on
Windows and on MacOS. both OS have a scalable API to monitor
file systems changes over millions of directories.
Since the product requires being notified on filename events
(e.g. create/delete/rename), the only available option on Linux is
inotify, but inotify does not scale well to millions of directories
use case and not a the right tool for the job in general.
For that purpose, I implemented fanotify super block watch [1],
to be able to:
1. report filename events
2. watch over file system root (as opposed to mount point)
3. report event information using struct file_handle,
instead of keeping open file descriptor per event
Jan Kara has reviewed the high level design and did not
dismiss it.
I was trying to get some cleanup patches through to Al,
but changes to fsnotify that are not bug fixes are not very
popular these days.
I would like to present the suggested solution and make a
case for an API that is a super set of inotify and fanotify,
that will allow users to slowly move to the latter and eventually
to phase out the former.
I would like to discuss with the stake holders how we can
thaw the fsnotify subsystem, to the point that any improvement
can be at least considered.
[1] https://lkml.org/lkml/2016/12/20/312
next reply other threads:[~2017-01-19 14:36 UTC|newest]
Thread overview: 2+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-01-19 14:28 Amir Goldstein [this message]
2017-01-20 8:47 ` [LSF/MM TOPIC ATTEND] thawing the fsnotify subsyetm Jan Kara
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=CAOQ4uxh9ZbSfO-6V6cYNbNd2eBvVV6MxBCnpSzyp3-zKrYeWWw@mail.gmail.com \
--to=amir73il@gmail.com \
--cc=jack@suse.cz \
--cc=linux-api@vger.kernel.org \
--cc=linux-fsdevel@vger.kernel.org \
--cc=lsf-pc@lists.linux-foundation.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).