From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from cuda.sgi.com (cuda1.sgi.com [192.48.157.11]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id o475cup2148792 for ; Fri, 7 May 2010 00:38:56 -0500 Received: from mail.internode.on.net (localhost [127.0.0.1]) by cuda.sgi.com (Spam Firewall) with ESMTP id E95A89638FA for ; Thu, 6 May 2010 22:41:06 -0700 (PDT) Received: from mail.internode.on.net (bld-mail12.adl6.internode.on.net [150.101.137.97]) by cuda.sgi.com with ESMTP id MRZALpYbNeukYAkv for ; Thu, 06 May 2010 22:41:06 -0700 (PDT) Received: from dastard (unverified [121.45.169.108]) by mail.internode.on.net (SurgeMail 3.8f2) with ESMTP id 23442142-1927428 for ; Fri, 07 May 2010 15:11:03 +0930 (CST) Received: from disturbed ([192.168.1.9]) by dastard with esmtp (Exim 4.71) (envelope-from ) id 1OAGJ4-0006rA-4y for xfs@oss.sgi.com; Fri, 07 May 2010 15:41:02 +1000 Received: from dave by disturbed with local (Exim 4.71) (envelope-from ) id 1OAGJ2-00066D-F6 for xfs@oss.sgi.com; Fri, 07 May 2010 15:41:00 +1000 From: Dave Chinner Subject: [PATCH 0/12] xfs: delayed logging V5 Date: Fri, 7 May 2010 15:40:48 +1000 Message-Id: <1273210860-23414-1-git-send-email-david@fromorbit.com> List-Id: XFS Filesystem from SGI List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xfs-bounces@oss.sgi.com Errors-To: xfs-bounces@oss.sgi.com To: xfs@oss.sgi.com Hi Folks, This is version 5 of the delayed logging series. I won't repeat everything about what it is, just point you here: http://marc.info/?l=linux-xfs&m=126862777118946&w=2 for the description, and here: git://git.kernel.org/pub/scm/linux/kernel/git/dgc/xfs.git delayed-logging for the current code. Note that this is a rebased branch, so you'll need to pull it again into a new branch to review. This version includes a documentation updates and fixes to the busy extent tracking infrastructure. The patch series follows this mail to make it easier for people to respond to specific pieces of the code during review. I'm still making the entire patch set available through git, though. Changes the previous versions: Version 5: 27 files changed, 2457 insertions(+), 513 deletions(-) Version 4: 26 files changed, 2351 insertions(+), 510 deletions(-) Version 3: 28 files changed, 2366 insertions(+), 506 deletions(-) Version 2: 22 files changed, 2188 insertions(+), 377 deletions(-) Version 1: 19 files changed, 2594 insertions(+), 580 deletions(-) Changes for V5: o fixed many typos in the desgin documentation - thanks to Nathan Scott for proof reading it. :) o found another transaction assert failure - un-reverting the change to transaction ID matching as the reason it avoided the assert failures is now known. (new commit for exporting the ticket ID). o added transaction ID to busy extent tracing o added lots of comments explaining the reason for needing transaction ID matching w/ delayed logging. o added overlap detection in busy extent inserts Changes for V4: o fixes duplicate transaction IDs on rolling transactions (new commit) o folded in a busy extent freeing cleanup from Christoph Hellwig o made API prefix consistent (xfs_alloc_busy_*) o combined xfs_alloc_mark_busy and xfs_alloc_busy_insert o reverted back to tracking transaction pointers in busy extents o removed exporting of transaction ID for busy extents o fixed an off-by-one in the extent range match in the busy extent search code that has been triggering assert failures o use list_splice_init() when splicing busy extents from the transaction to the checkpoint context to ensure we don't get transactions thinking they have busy extents to free after we've already attached them to the checkpoint. Changes for V3: o changed buffer log item reference counted model to be consistent for both logging modes o cleaned up XFS_BLI flags usage (new commit) o separated out log ticket overrun printing cleanup (new commit) o made sure "delaylog" option shows up in /proc/mounts o collapsed many of the intermediate commits together to make it easier to review o fixed inode buffer tagging issue that was causing shutdowns in log recovery in test 087 and 121 Changes for V2: o 22 files changed, 2188 insertions(+), 377 deletions(-) o fixed some memory leaks o fixed ticket allocation for checkpoints to use KM_NOFS o minor code cleanups o performed stress and scalability testing The following changes since commit 6ff75b78182c314112c1173edaab6c164c95d775: Christoph Hellwig (1): xfs: mark xfs_iomap_write_ helpers static are available in the git repository at: git://git.kernel.org/pub/scm/linux/kernel/git/dgc/xfs.git delayed-logging Dave Chinner (12): xfs: Don't reuse the same transaction ID for duplicated transactions. xfs: allow log ticket allocation to take allocation flags xfs: modify buffer item reference counting xfs: Clean up XFS_BLI_* flag namespace xfs: clean up log ticket overrun debug output xfs: make the log ticket ID available outside the log infrastructure xfs: Improve scalability of busy extent tracking xfs: Delayed logging design documentation xfs: Introduce delayed logging core code xfs: forced unmounts need to push the CIL xfs: enable background pushing of the CIL xfs: Ensure inode allocation buffers are fully replayed .../filesystems/xfs-delayed-logging-design.txt | 819 ++++++++++++++++++++ fs/xfs/Makefile | 1 + fs/xfs/linux-2.6/xfs_buf.c | 11 +- fs/xfs/linux-2.6/xfs_quotaops.c | 1 + fs/xfs/linux-2.6/xfs_super.c | 12 +- fs/xfs/linux-2.6/xfs_trace.h | 83 ++- fs/xfs/quota/xfs_dquot.c | 6 +- fs/xfs/xfs_ag.h | 24 +- fs/xfs/xfs_alloc.c | 364 +++++++--- fs/xfs/xfs_alloc.h | 7 +- fs/xfs/xfs_alloc_btree.c | 2 +- fs/xfs/xfs_buf_item.c | 166 ++-- fs/xfs/xfs_buf_item.h | 18 +- fs/xfs/xfs_error.c | 2 +- fs/xfs/xfs_log.c | 123 +++- fs/xfs/xfs_log.h | 14 +- fs/xfs/xfs_log_cil.c | 733 ++++++++++++++++++ fs/xfs/xfs_log_priv.h | 118 +++- fs/xfs/xfs_log_recover.c | 46 +- fs/xfs/xfs_log_recover.h | 2 +- fs/xfs/xfs_mount.h | 1 + fs/xfs/xfs_trans.c | 195 ++++- fs/xfs/xfs_trans.h | 44 +- fs/xfs/xfs_trans_buf.c | 46 +- fs/xfs/xfs_trans_item.c | 114 +--- fs/xfs/xfs_trans_priv.h | 16 +- fs/xfs/xfs_types.h | 2 + 27 files changed, 2457 insertions(+), 513 deletions(-) create mode 100644 Documentation/filesystems/xfs-delayed-logging-design.txt create mode 100644 fs/xfs/xfs_log_cil.c _______________________________________________ xfs mailing list xfs@oss.sgi.com http://oss.sgi.com/mailman/listinfo/xfs