From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mx1.redhat.com (mx1.redhat.com [172.16.48.31]) by int-mx1.corp.redhat.com (8.13.1/8.13.1) with ESMTP id n5AJUeTb019599 for ; Wed, 10 Jun 2009 15:30:40 -0400 Received: from mailmx.futuresource.com (mailmx.futuresource.com [208.10.26.74]) by mx1.redhat.com (8.13.8/8.13.8) with ESMTP id n5AJUR6O002733 for ; Wed, 10 Jun 2009 15:30:27 -0400 Received: from ns1.futuresource.com ([10.207.192.125]) by mailmx.futuresource.com (8.13.8/8.13.8) with ESMTP id n5AJURh8031114 for ; Wed, 10 Jun 2009 14:30:27 -0500 Received: from [10.207.193.131] (xplmikesell.esignalcorp.com [10.207.193.131]) by ns1.futuresource.com (8.11.6/8.11.6) with ESMTP id n5AJUPr32294 for ; Wed, 10 Jun 2009 14:30:26 -0500 Message-ID: <4A3009D1.4070409@gmail.com> Date: Wed, 10 Jun 2009 14:30:25 -0500 From: Les Mikesell MIME-Version: 1.0 Subject: Re: [linux-lvm] Data deduplication in LVM? References: <4855BFEA-C772-4B98-A18E-C406FD5737DD@karlsbakk.net> <4A30015D.1010409@gmail.com> <38673305-3BDC-49F8-A04A-F327034D9D59@karlsbakk.net> In-Reply-To: <38673305-3BDC-49F8-A04A-F327034D9D59@karlsbakk.net> Content-Transfer-Encoding: 7bit Reply-To: LVM general discussion and development List-Id: LVM general discussion and development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , List-Id: Content-Type: text/plain; charset="us-ascii"; format="flowed" To: LVM general discussion and development Roy Sigurd Karlsbakk wrote: > >> Roy Sigurd Karlsbakk wrote: >>> Hi all >>> I've been reading up a little about data deduplication, and have been >>> in search for an OSS filesystem with dedup without much luck. While >>> testing snapshots and so on in LVM, I started wondering if dedup >>> would be better off in LVM than in the filesystem. Would it be >>> possible/efficient to add dedup to the LVM layer, or perhaps a layer >>> above LVM? This could make dedup work for all or most of filesystems. >>> Make a hash table with 4k (or whatever) blocks, make virtual blocks >>> pointing to the physical blocks and run a remapping/deduping job at >>> night. If written to, copy-on-write could be used to increase speed. >>> Is this nonsense, or might it be an idea? >> >> This is "supposed" to be coming in the next OpenSolaris/ZFS release >> (per the roadmap with the just-released 2009.06 version). > > > What about Linux/LVM? Or did I misunderstand you? I thought the question was about OSS... I wouldn't hold my breath waiting for a Linux/LVM version - and for that matter I'll believe the ZFS release when I see it, but at least it is being planned and could be less than a year away. -- Les Mikesell lesmikesell@gmail.com