From: Nick Piggin <npiggin@kernel.dk>
To: linux-fsdevel@vger.kernel.org
Cc: linux-kernel@vger.kernel.org
Subject: [PATCH 00/46] rcu-walk and dcache scaling
Date: Sat, 27 Nov 2010 21:15:58 +1100 [thread overview]
Message-ID: <cover.1290852958.git.npiggin@kernel.dk> (raw)
git://git.kernel.org/pub/scm/linux/kernel/git/npiggin/linux-npiggin.git vfs-scale-working
Here is an new set of vfs patches for review, not that there was much interest
last time they were posted. It is structured like:
* preparation patches
* introduce new locks to take over dcache_lock, then remove it
* cleaning up and reworking things for new locks
* rcu-walk path walking
* start on some fine grained locking steps
Thanks,
Nick
Nick Piggin (46):
Revert "fs: use RCU read side protection in d_validate"
fs: d_validate fixes
kernel: kmem_ptr_validate considered harmful
fs: dcache documentation cleanup
fs: change d_delete semantics
cifs: dont overwrite dentry name in d_revalidate
jfs: dont overwrite dentry name in d_revalidate
fs: change d_compare for rcu-walk
fs: change d_hash for rcu-walk
hostfs: simplify locking
fs: dcache scale hash
fs: dcache scale lru
fs: dcache scale dentry refcount
fs: dcache scale d_unhashed
fs: dcache scale subdirs
fs: scale inode alias list
fs: Use rename lock and RCU for multi-step operations
fs: increase d_name lock coverage
fs: dcache remove dcache_lock
fs: dcache avoid starvation in dcache multi-step operations
fs: dcache reduce dput locking
fs: dcache reduce locking in d_alloc
fs: dcache reduce dcache_inode_lock
fs: dcache rationalise dget variants
fs: dcache reduce d_parent locking
fs: dcache reduce prune_one_dentry locking
fs: reduce dcache_inode_lock width in lru scanning
fs: use RCU in shrink_dentry_list to reduce lock nesting
fs: consolidate dentry kill sequence
fs: icache RCU free inodes
fs: avoid inode RCU freeing for pseudo fs
kernel: optimise seqlock
fs: rcu-walk for path lookup
fs: fs_struct use seqlock
fs: dcache remove d_mounted
fs: dcache reduce branches in lookup path
fs: cache optimise dentry and inode for rcu-walk
fs: prefetch inode data in dcache lookup
fs: d_revalidate_rcu for rcu-walk
fs: provide rcu-walk aware permission i_ops
fs: provide simple rcu-walk ACL implementation
kernel: add bl_list
bit_spinlock: add required includes
fs: dcache per-bucket dcache hash locking
fs: dcache per-inode inode alias locking
fs: improve scalability of pseudo filesystems
Documentation/filesystems/Locking | 23 +-
Documentation/filesystems/dentry-locking.txt | 174 ----
Documentation/filesystems/path-lookup.txt | 247 ++++++
Documentation/filesystems/porting | 45 +-
Documentation/filesystems/vfs.txt | 54 +-
arch/ia64/kernel/perfmon.c | 4 +-
arch/powerpc/platforms/cell/spufs/inode.c | 18 +-
drivers/infiniband/hw/ipath/ipath_fs.c | 8 +-
drivers/infiniband/hw/qib/qib_fs.c | 5 +-
drivers/staging/autofs/root.c | 2 +-
drivers/staging/pohmelfs/inode.c | 11 +-
drivers/staging/pohmelfs/path_entry.c | 17 +-
drivers/staging/smbfs/cache.c | 10 +-
drivers/usb/core/inode.c | 12 +-
fs/9p/vfs_dentry.c | 4 +-
fs/9p/vfs_inode.c | 39 +-
fs/adfs/dir.c | 13 +-
fs/adfs/super.c | 11 +-
fs/affs/amigaffs.c | 4 +-
fs/affs/namei.c | 66 +-
fs/affs/super.c | 11 +-
fs/afs/dir.c | 6 +-
fs/afs/super.c | 10 +-
fs/anon_inodes.c | 4 +-
fs/autofs4/autofs_i.h | 21 +-
fs/autofs4/expire.c | 143 ++--
fs/autofs4/inode.c | 2 +-
fs/autofs4/root.c | 78 +-
fs/autofs4/waitq.c | 23 +-
fs/befs/linuxvfs.c | 10 +-
fs/bfs/inode.c | 9 +-
fs/block_dev.c | 9 +-
fs/btrfs/acl.c | 19 +-
fs/btrfs/ctree.h | 4 +-
fs/btrfs/export.c | 4 +-
fs/btrfs/inode.c | 27 +-
fs/ceph/dir.c | 21 +-
fs/ceph/inode.c | 27 +-
fs/ceph/mds_client.c | 2 +-
fs/cifs/cifsfs.c | 9 +-
fs/cifs/dir.c | 75 +-
fs/cifs/inode.c | 14 +-
fs/cifs/link.c | 4 +-
fs/cifs/readdir.c | 6 +-
fs/coda/cache.c | 4 +-
fs/coda/dir.c | 8 +-
fs/coda/inode.c | 9 +-
fs/configfs/configfs_internal.h | 4 +-
fs/configfs/dir.c | 13 +-
fs/configfs/inode.c | 8 +-
fs/dcache.c | 1224 ++++++++++++++++++--------
fs/ecryptfs/dentry.c | 15 +-
fs/ecryptfs/inode.c | 8 +-
fs/ecryptfs/main.c | 4 +-
fs/ecryptfs/super.c | 12 +-
fs/efs/super.c | 9 +-
fs/exofs/super.c | 9 +-
fs/exportfs/expfs.c | 14 +-
fs/ext2/acl.c | 11 +-
fs/ext2/acl.h | 8 +-
fs/ext2/file.c | 2 +-
fs/ext2/namei.c | 4 +-
fs/ext2/super.c | 9 +-
fs/ext3/acl.c | 11 +-
fs/ext3/acl.h | 8 +-
fs/ext3/file.c | 2 +-
fs/ext3/namei.c | 4 +-
fs/ext3/super.c | 9 +-
fs/ext4/acl.c | 11 +-
fs/ext4/acl.h | 4 +-
fs/ext4/file.c | 2 +-
fs/ext4/namei.c | 4 +-
fs/ext4/super.c | 9 +-
fs/fat/inode.c | 13 +-
fs/fat/namei_msdos.c | 24 +-
fs/fat/namei_vfat.c | 69 +-
fs/filesystems.c | 3 +
fs/freevxfs/vxfs_inode.c | 9 +-
fs/fs_struct.c | 10 +
fs/fuse/dir.c | 9 +-
fs/fuse/inode.c | 13 +-
fs/generic_acl.c | 20 +
fs/gfs2/dentry.c | 5 +-
fs/gfs2/export.c | 4 +-
fs/gfs2/ops_fstype.c | 2 +-
fs/gfs2/ops_inode.c | 2 +-
fs/gfs2/super.c | 9 +-
fs/hfs/dir.c | 2 +-
fs/hfs/hfs_fs.h | 7 +-
fs/hfs/string.c | 17 +-
fs/hfs/super.c | 11 +-
fs/hfsplus/dir.c | 2 +-
fs/hfsplus/hfsplus_fs.h | 7 +-
fs/hfsplus/super.c | 12 +-
fs/hfsplus/unicode.c | 17 +-
fs/hostfs/hostfs_kern.c | 37 +-
fs/hpfs/dentry.c | 26 +-
fs/hpfs/super.c | 9 +-
fs/hppfs/hppfs.c | 9 +-
fs/hugetlbfs/inode.c | 9 +-
fs/inode.c | 16 +-
fs/isofs/inode.c | 127 ++--
fs/isofs/namei.c | 5 +-
fs/jffs2/super.c | 9 +-
fs/jfs/namei.c | 60 +-
fs/jfs/super.c | 12 +-
fs/libfs.c | 63 +-
fs/locks.c | 2 +-
fs/logfs/inode.c | 9 +-
fs/minix/inode.c | 9 +-
fs/minix/namei.c | 2 +-
fs/namei.c | 855 +++++++++++++++----
fs/namespace.c | 29 +-
fs/ncpfs/dir.c | 66 +-
fs/ncpfs/inode.c | 11 +-
fs/ncpfs/ncplib_kernel.h | 16 +-
fs/nfs/dir.c | 17 +-
fs/nfs/getroot.c | 10 +-
fs/nfs/inode.c | 9 +-
fs/nfs/namespace.c | 17 +-
fs/nfs/unlink.c | 2 +-
fs/nfsd/vfs.c | 5 +-
fs/nilfs2/super.c | 12 +-
fs/notify/fsnotify.c | 8 +-
fs/ntfs/inode.c | 9 +-
fs/ocfs2/dcache.c | 10 +-
fs/ocfs2/dlmfs/dlmfs.c | 9 +-
fs/ocfs2/export.c | 4 +-
fs/ocfs2/namei.c | 10 +-
fs/ocfs2/super.c | 9 +-
fs/openpromfs/inode.c | 9 +-
fs/pipe.c | 10 +-
fs/proc/base.c | 14 +-
fs/proc/generic.c | 4 +-
fs/proc/inode.c | 9 +-
fs/proc/proc_sysctl.c | 18 +-
fs/qnx4/inode.c | 9 +-
fs/reiserfs/super.c | 9 +-
fs/reiserfs/xattr.c | 2 +-
fs/romfs/super.c | 9 +-
fs/squashfs/super.c | 9 +-
fs/super.c | 3 +-
fs/sysfs/dir.c | 22 +-
fs/sysv/inode.c | 9 +-
fs/sysv/namei.c | 5 +-
fs/sysv/super.c | 2 +-
fs/ubifs/super.c | 10 +-
fs/udf/super.c | 9 +-
fs/ufs/super.c | 9 +-
fs/xfs/linux-2.6/xfs_acl.c | 8 +-
fs/xfs/linux-2.6/xfs_iops.c | 8 +-
fs/xfs/xfs_acl.h | 4 +-
fs/xfs/xfs_iget.c | 13 +-
include/linux/bit_spinlock.h | 4 +
include/linux/dcache.h | 183 ++--
include/linux/fs.h | 61 +-
include/linux/fs_struct.h | 3 +
include/linux/fsnotify.h | 2 -
include/linux/fsnotify_backend.h | 11 +-
include/linux/generic_acl.h | 1 +
include/linux/list_bl.h | 141 +++
include/linux/namei.h | 16 +-
include/linux/ncp_fs.h | 4 +-
include/linux/posix_acl.h | 19 +
include/linux/rculist_bl.h | 128 +++
include/linux/seqlock.h | 67 ++-
include/linux/slab.h | 2 -
ipc/mqueue.c | 9 +-
kernel/cgroup.c | 29 +-
mm/filemap.c | 3 -
mm/shmem.c | 15 +-
mm/slab.c | 32 +-
mm/slob.c | 5 -
mm/slub.c | 40 -
mm/util.c | 21 -
net/socket.c | 5 +-
net/sunrpc/rpc_pipe.c | 14 +-
security/selinux/selinuxfs.c | 16 +-
security/tomoyo/realpath.c | 1 +
179 files changed, 3848 insertions(+), 1711 deletions(-)
delete mode 100644 Documentation/filesystems/dentry-locking.txt
create mode 100644 Documentation/filesystems/path-lookup.txt
create mode 100644 include/linux/list_bl.h
create mode 100644 include/linux/rculist_bl.h
next reply other threads:[~2010-11-27 10:15 UTC|newest]
Thread overview: 96+ messages / expand[flat|nested] mbox.gz Atom feed top
2010-11-27 10:15 Nick Piggin [this message]
2010-11-27 9:44 ` [PATCH 02/46] fs: d_validate fixes Nick Piggin
2010-12-08 1:53 ` Dave Chinner
2010-12-08 6:59 ` Nick Piggin
2010-12-09 0:50 ` Dave Chinner
2010-12-09 4:50 ` Nick Piggin
2010-11-27 9:44 ` [PATCH 03/46] kernel: kmem_ptr_validate considered harmful Nick Piggin
2010-11-27 9:44 ` [PATCH 04/46] fs: dcache documentation cleanup Nick Piggin
2010-11-27 9:44 ` [PATCH 05/46] fs: change d_delete semantics Nick Piggin
2010-11-27 9:44 ` [PATCH 06/46] cifs: dont overwrite dentry name in d_revalidate Nick Piggin
2010-11-27 9:44 ` [PATCH 07/46] jfs: " Nick Piggin
2010-11-27 9:44 ` [PATCH 08/46] fs: change d_compare for rcu-walk Nick Piggin
2010-11-27 9:44 ` [PATCH 09/46] fs: change d_hash " Nick Piggin
2010-11-27 9:44 ` [PATCH 10/46] hostfs: simplify locking Nick Piggin
2010-11-27 9:44 ` [PATCH 11/46] fs: dcache scale hash Nick Piggin
2010-12-09 6:09 ` Dave Chinner
2010-12-09 6:28 ` Nick Piggin
2010-12-09 8:17 ` Dave Chinner
2010-12-09 12:53 ` Nick Piggin
2010-12-09 23:42 ` Dave Chinner
2010-12-10 2:35 ` Nick Piggin
2010-12-10 9:01 ` Dave Chinner
2010-12-13 4:48 ` Nick Piggin
2010-12-13 5:05 ` Nick Piggin
2010-11-27 9:44 ` [PATCH 12/46] fs: dcache scale lru Nick Piggin
2010-12-09 7:22 ` Dave Chinner
2010-12-09 12:34 ` Nick Piggin
2010-11-27 9:44 ` [PATCH 13/46] fs: dcache scale dentry refcount Nick Piggin
2010-11-27 9:44 ` [PATCH 14/46] fs: dcache scale d_unhashed Nick Piggin
2010-11-27 9:44 ` [PATCH 15/46] fs: dcache scale subdirs Nick Piggin
2010-11-27 9:44 ` [PATCH 16/46] fs: scale inode alias list Nick Piggin
2010-11-27 9:44 ` [PATCH 17/46] fs: Use rename lock and RCU for multi-step operations Nick Piggin
2011-01-18 22:32 ` Yehuda Sadeh Weinraub
2011-01-18 22:42 ` Nick Piggin
2011-01-19 22:27 ` Yehuda Sadeh Weinraub
2011-01-19 22:32 ` Nick Piggin
2011-01-25 22:10 ` Yehuda Sadeh Weinraub
2011-01-27 5:18 ` Nick Piggin
2011-02-07 18:52 ` Jim Schutt
2011-02-07 21:04 ` Yehuda Sadeh Weinraub
2011-02-07 21:31 ` Jim Schutt
2011-02-07 22:25 ` Jim Schutt
2011-02-14 17:57 ` Yehuda Sadeh Weinraub
2010-11-27 9:44 ` [PATCH 18/46] fs: increase d_name lock coverage Nick Piggin
2010-11-27 9:44 ` [PATCH 19/46] fs: dcache remove dcache_lock Nick Piggin
2010-11-27 9:44 ` [PATCH 20/46] fs: dcache avoid starvation in dcache multi-step operations Nick Piggin
2010-11-27 9:44 ` [PATCH 21/46] fs: dcache reduce dput locking Nick Piggin
2010-11-27 9:44 ` [PATCH 22/46] fs: dcache reduce locking in d_alloc Nick Piggin
2010-11-27 9:44 ` [PATCH 23/46] fs: dcache reduce dcache_inode_lock Nick Piggin
2010-11-27 9:44 ` [PATCH 24/46] fs: dcache rationalise dget variants Nick Piggin
2010-11-27 9:44 ` [PATCH 25/46] fs: dcache reduce d_parent locking Nick Piggin
2010-11-27 9:44 ` [PATCH 26/46] fs: dcache reduce prune_one_dentry locking Nick Piggin
2010-11-27 9:44 ` [PATCH 27/46] fs: reduce dcache_inode_lock width in lru scanning Nick Piggin
2010-11-27 9:44 ` [PATCH 28/46] fs: use RCU in shrink_dentry_list to reduce lock nesting Nick Piggin
2010-11-27 9:44 ` [PATCH 29/46] fs: consolidate dentry kill sequence Nick Piggin
2010-11-27 9:45 ` [PATCH 30/46] fs: icache RCU free inodes Nick Piggin
2010-11-27 9:45 ` [PATCH 31/46] fs: avoid inode RCU freeing for pseudo fs Nick Piggin
2010-11-27 9:45 ` [PATCH 32/46] kernel: optimise seqlock Nick Piggin
2010-11-27 9:45 ` [PATCH 33/46] fs: rcu-walk for path lookup Nick Piggin
2010-11-27 9:45 ` [PATCH 34/46] fs: fs_struct use seqlock Nick Piggin
2010-11-27 9:45 ` [PATCH 35/46] fs: dcache remove d_mounted Nick Piggin
2010-11-27 9:45 ` [PATCH 36/46] fs: dcache reduce branches in lookup path Nick Piggin
2010-11-27 9:45 ` [PATCH 37/46] fs: cache optimise dentry and inode for rcu-walk Nick Piggin
2010-11-27 9:45 ` [PATCH 38/46] fs: prefetch inode data in dcache lookup Nick Piggin
2010-11-27 9:45 ` [PATCH 39/46] fs: d_revalidate_rcu for rcu-walk Nick Piggin
2010-11-27 9:45 ` [PATCH 40/46] fs: provide rcu-walk aware permission i_ops Nick Piggin
2010-11-27 9:45 ` [PATCH 41/46] fs: provide simple rcu-walk ACL implementation Nick Piggin
2010-11-27 9:45 ` [PATCH 42/46] kernel: add bl_list Nick Piggin
2010-11-27 9:45 ` [PATCH 43/46] bit_spinlock: add required includes Nick Piggin
2010-11-27 9:45 ` [PATCH 44/46] fs: dcache per-bucket dcache hash locking Nick Piggin
2010-11-27 9:45 ` [PATCH 45/46] fs: dcache per-inode inode alias locking Nick Piggin
2010-11-27 9:45 ` [PATCH 46/46] fs: improve scalability of pseudo filesystems Nick Piggin
2010-11-27 9:56 ` [PATCH 01/46] Revert "fs: use RCU read side protection in d_validate" Nick Piggin
2010-12-08 1:16 ` Dave Chinner
2010-12-08 9:38 ` Nick Piggin
2010-12-09 0:44 ` Dave Chinner
2010-12-09 4:38 ` Nick Piggin
2010-12-09 5:16 ` Nick Piggin
2010-11-27 15:04 ` [PATCH 00/46] rcu-walk and dcache scaling Anca Emanuel
2010-11-28 3:28 ` Nick Piggin
2010-11-28 6:24 ` Sedat Dilek
2010-12-01 18:03 ` David Miller
2010-12-03 16:55 ` Nick Piggin
2010-12-07 11:25 ` Dave Chinner
2010-12-07 15:24 ` Nick Piggin
2010-12-07 15:49 ` Peter Zijlstra
2010-12-07 15:59 ` Nick Piggin
2010-12-07 16:23 ` Peter Zijlstra
2010-12-08 3:28 ` Nick Piggin
2010-12-07 21:56 ` Dave Chinner
2010-12-08 1:47 ` Nick Piggin
2010-12-08 3:32 ` Dave Chinner
2010-12-08 4:28 ` Dave Chinner
2010-12-08 7:09 ` Nick Piggin
2010-12-10 20:32 ` Paul E. McKenney
2010-12-12 14:54 ` Paul E. McKenney
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=cover.1290852958.git.npiggin@kernel.dk \
--to=npiggin@kernel.dk \
--cc=linux-fsdevel@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).