From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from relay.sgi.com (relay3.corp.sgi.com [198.149.34.15]) by oss.sgi.com (8.14.3/8.14.3/SuSE Linux 0.8) with ESMTP id oA5GZL1H209015 for ; Fri, 5 Nov 2010 11:35:21 -0500 Received: from estes.americas.sgi.com (estes.americas.sgi.com [128.162.236.10]) by relay3.corp.sgi.com (Postfix) with ESMTP id D2926AC011 for ; Fri, 5 Nov 2010 09:36:43 -0700 (PDT) Received: from augusta (augusta.americas.sgi.com [128.162.233.117]) by estes.americas.sgi.com (Postfix) with ESMTP id 7AE707003729 for ; Fri, 5 Nov 2010 11:36:43 -0500 (CDT) Message-Id: <20101105163500.747192954@sgi.com> Date: Fri, 05 Nov 2010 11:35:00 -0500 From: wkendall@sgi.com Subject: [PATCH v2 0/9] xfsrestore dirent limitations and scaling issues List-Id: XFS Filesystem from SGI List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xfs-bounces@oss.sgi.com Errors-To: xfs-bounces@oss.sgi.com To: xfs@oss.sgi.com The first two patches in this series remove dirent limitations that exist in the current xfsrestore, allowing restore to now handle 4 billion directory entries. Restore would map 200 GB of memory to do so, so don't go thinking this is a good idea. :) (These two patches were previously submitted to the list but I've made some changes to them as suggested by Alex Elder.) The remaining patches mostly deal with improving restore performance, most noticeably on dumps containing upwards of 10 million inodes/dirents. This resulted in a 50% improvement in the time required to build restore's node table (a mmap'd representation of the dump's directory structure), so for interactive restores and restoring sub-directories this is very helpful. For full restores with millions of files the overall restore time is dominated by creating inodes and laying down the data, so the improvements here would be less noticeable. For dumps with lots of hard links, these changes fix a bug that was causing xfsrestore to constantly have to map and unmap segments of the node table, leading to horrible performance. Several of these patches modify the on-disk state information that xfsrestore leaves around for resuming restores. The final patch adds versioning information to the on-disk state to detect cases where the user tries to resume a restore with an incompatible version of xfsrstore (or an incompatible system). Bill _______________________________________________ xfs mailing list xfs@oss.sgi.com http://oss.sgi.com/mailman/listinfo/xfs