From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mailman by lists.gnu.org with tmda-scanned (Exim 4.43) id 1N0X8W-00053Q-So for qemu-devel@nongnu.org; Wed, 21 Oct 2009 05:05:40 -0400 Received: from exim by lists.gnu.org with spam-scanned (Exim 4.43) id 1N0X8V-000536-PQ for qemu-devel@nongnu.org; Wed, 21 Oct 2009 05:05:40 -0400 Received: from [199.232.76.173] (port=47936 helo=monty-python.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1N0X8V-000533-Gh for qemu-devel@nongnu.org; Wed, 21 Oct 2009 05:05:39 -0400 Received: from [83.148.126.71] (port=37008 helo=yellowwing.dodo.bg) by monty-python.gnu.org with esmtp (Exim 4.60) (envelope-from ) id 1N0X8U-0006YE-6o for qemu-devel@nongnu.org; Wed, 21 Oct 2009 05:05:39 -0400 Date: Wed, 21 Oct 2009 11:28:20 +0300 (EEST) From: "Nikolai K. Bochev" Message-ID: <2092998967.2171256113700360.JavaMail.root@yellowwing> In-Reply-To: <4ADE988B.2070303@lab.ntt.co.jp> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_53_2103398662.1256113700359" Subject: [Qemu-devel] Re: [ANNOUNCE] Sheepdog: Distributed Storage System for KVM List-Id: qemu-devel.nongnu.org List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: MORITA Kazutaka Cc: linux-fsdevel@vger.kernel.org, qemu-devel@nongnu.org, kvm@vger.kernel.org ------=_Part_53_2103398662.1256113700359 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hello,=20 when i try to compile, i'm getting the following error ( Using ubuntu 9.10,= x64 ) :=20 cd shepherd; make=20 make[1]: Entering directory `/home/shiny/Packages/sheepdog-2009102101/sheph= erd'=20 cc -c -g -O2 -Wall -Wstrict-prototypes -I../include -D_GNU_SOURCE shepherd.= c -o shepherd.o=20 shepherd.c: In function =E2=80=98main=E2=80=99:=20 shepherd.c:300: warning: dereferencing pointer =E2=80=98hdr.55=E2=80=99 doe= s break strict-aliasing rules=20 shepherd.c:300: note: initialized from here=20 cc -c -g -O2 -Wall -Wstrict-prototypes -I../include -D_GNU_SOURCE treeview.= c -o treeview.o=20 cc -c -g -O2 -Wall -Wstrict-prototypes -I../include -D_GNU_SOURCE ../lib/ev= ent.c -o ../lib/event.o=20 cc -c -g -O2 -Wall -Wstrict-prototypes -I../include -D_GNU_SOURCE ../lib/ne= t.c -o ../lib/net.o=20 ../lib/net.c: In function =E2=80=98write_object=E2=80=99:=20 ../lib/net.c:358: warning: =E2=80=98vosts=E2=80=99 may be used uninitialize= d in this function=20 cc -c -g -O2 -Wall -Wstrict-prototypes -I../include -D_GNU_SOURCE ../lib/lo= gger.c -o ../lib/logger.o=20 cc shepherd.o treeview.o ../lib/event.o ../lib/net.o ../lib/logger.o -o she= pherd -lncurses -lcrypto=20 make[1]: Leaving directory `/home/shiny/Packages/sheepdog-2009102101/shephe= rd'=20 cd sheep; make=20 make[1]: Entering directory `/home/shiny/Packages/sheepdog-2009102101/sheep= '=20 cc -c -g -O2 -Wall -Wstrict-prototypes -I../include -D_GNU_SOURCE sheep.c -= o sheep.o=20 cc -c -g -O2 -Wall -Wstrict-prototypes -I../include -D_GNU_SOURCE store.c -= o store.o=20 cc -c -g -O2 -Wall -Wstrict-prototypes -I../include -D_GNU_SOURCE net.c -o = net.o=20 cc -c -g -O2 -Wall -Wstrict-prototypes -I../include -D_GNU_SOURCE work.c -o= work.o=20 In file included from /usr/include/asm/fcntl.h:1,=20 from /usr/include/linux/fcntl.h:4,=20 from /usr/include/linux/signalfd.h:13,=20 from work.c:31:=20 /usr/include/asm-generic/fcntl.h:117: error: redefinition of =E2=80=98struc= t flock=E2=80=99=20 /usr/include/asm-generic/fcntl.h:140: error: redefinition of =E2=80=98struc= t flock64=E2=80=99=20 make[1]: *** [work.o] Error 1=20 make[1]: Leaving directory `/home/shiny/Packages/sheepdog-2009102101/sheep'= =20 make: *** [all] Error 2=20 The qemu-kvm source with patched support for sheepdog compiles fine.=20 ----- Original Message -----=20 From: "MORITA Kazutaka" =20 To: kvm@vger.kernel.org, qemu-devel@nongnu.org, linux-fsdevel@vger.kernel.o= rg=20 Sent: Wednesday, October 21, 2009 8:13:47 AM=20 Subject: [ANNOUNCE] Sheepdog: Distributed Storage System for KVM=20 Hi everyone,=20 Sheepdog is a distributed storage system for KVM/QEMU. It provides=20 highly available block level storage volumes to VMs like Amazon EBS.=20 Sheepdog supports advanced volume management features such as snapshot,=20 cloning, and thin provisioning. Sheepdog runs on several tens or hundreds= =20 of nodes, and the architecture is fully symmetric; there is no central=20 node such as a meta-data server.=20 The following list describes the features of Sheepdog.=20 * Linear scalability in performance and capacity=20 * No single point of failure=20 * Redundant architecture (data is written to multiple nodes)=20 - Tolerance against network failure=20 * Zero configuration (newly added machines will join the cluster automatica= lly)=20 - Autonomous load balancing=20 * Snapshot=20 - Online snapshot from qemu-monitor=20 * Clone from a snapshot volume=20 * Thin provisioning=20 - Amazon EBS API support (to use from a Eucalyptus instance)=20 (* =3D current features, - =3D on our todo list)=20 More details and download links are here:=20 http://www.osrg.net/sheepdog/=20 Note that the code is still in an early stage.=20 There are some critical TODO items:=20 - VM image deletion support=20 - Support architectures other than X86_64=20 - Data recoverys=20 - Free space management=20 - Guarantee reliability and availability under heavy load=20 - Performance improvement=20 - Reclaim unused blocks=20 - More documentation=20 We hope finding people interested in working together.=20 Enjoy!=20 Here are examples:=20 - create images=20 $ kvm-img create -f sheepdog "Alice's Disk" 256G=20 $ kvm-img create -f sheepdog "Bob's Disk" 256G=20 - list images=20 $ shepherd info -t vdi=20 40000 : Alice's Disk 256 GB (allocated: 0 MB, shared: 0 MB), 2009-10-15=20 16:17:18, tag: 0, current=20 80000 : Bob's Disk 256 GB (allocated: 0 MB, shared: 0 MB), 2009-10-15=20 16:29:20, tag: 0, current=20 - start up a virtual machine=20 $ kvm --drive format=3Dsheepdog,file=3D"Alice's Disk"=20 - create a snapshot=20 $ kvm-img snapshot -c name sheepdog:"Alice's Disk"=20 - clone from a snapshot=20 $ kvm-img create -b sheepdog:"Alice's Disk":0 -f sheepdog "Charlie's Disk"= =20 Thanks.=20 --=20 MORITA, Kazutaka=20 NTT Cyber Space Labs=20 OSS Computing Project=20 Kernel Group=20 E-mail: morita.kazutaka@lab.ntt.co.jp=20 --=20 To unsubscribe from this list: send the line "unsubscribe kvm" in=20 the body of a message to majordomo@vger.kernel.org=20 More majordomo info at http://vger.kernel.org/majordomo-info.html=20 ------=_Part_53_2103398662.1256113700359 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <= div style=3D'font-family: Times New Roman; font-size: 12pt; color: #000000'= >Hello,

when i try to compile, i'm getting the following error = ; ( Using ubuntu 9.10, x64 ) :

cd shepherd; make
make[1]: Enterin= g directory `/home/shiny/Packages/sheepdog-2009102101/shepherd'
cc -c -g= -O2 -Wall -Wstrict-prototypes -I../include -D_GNU_SOURCE shepherd.c -o she= pherd.o
shepherd.c: In function =E2=80=98main=E2=80=99:
shepherd.c:30= 0: warning: dereferencing pointer =E2=80=98hdr.55=E2=80=99 does break stric= t-aliasing rules
shepherd.c:300: note: initialized from here
cc -c -g= -O2 -Wall -Wstrict-prototypes -I../include -D_GNU_SOURCE treeview.c -o tre= eview.o
cc -c -g -O2 -Wall -Wstrict-prototypes -I../include -D_GNU_SOURC= E ../lib/event.c -o ../lib/event.o
cc -c -g -O2 -Wall -Wstrict-prototype= s -I../include -D_GNU_SOURCE ../lib/net.c -o ../lib/net.o
../lib/net.c: = In function =E2=80=98write_object=E2=80=99:
../lib/net.c:358: warning: = =E2=80=98vosts=E2=80=99 may be used uninitialized in this function
cc -c= -g -O2 -Wall -Wstrict-prototypes -I../include -D_GNU_SOURCE ../lib/logger.= c -o ../lib/logger.o
cc shepherd.o treeview.o ../lib/event.o ../lib/net.= o ../lib/logger.o -o shepherd -lncurses -lcrypto
make[1]: Leaving direct= ory `/home/shiny/Packages/sheepdog-2009102101/shepherd'
cd sheep; makemake[1]: Entering directory `/home/shiny/Packages/sheepdog-2009102101/she= ep'
cc -c -g -O2 -Wall -Wstrict-prototypes -I../include -D_GNU_SOURCE sh= eep.c -o sheep.o
cc -c -g -O2 -Wall -Wstrict-prototypes -I../include -D_= GNU_SOURCE store.c -o store.o
cc -c -g -O2 -Wall -Wstrict-prototypes -I.= ./include -D_GNU_SOURCE net.c -o net.o
cc -c -g -O2 -Wall -Wstrict-proto= types -I../include -D_GNU_SOURCE work.c -o work.o
In file included from = /usr/include/asm/fcntl.h:1,
       &n= bsp;         from /usr/include/linu= x/fcntl.h:4,
          = ;       from /usr/include/linux/signalfd.h:13= ,
           &nbs= p;     from work.c:31:
/usr/include/asm-generic/fcnt= l.h:117: error: redefinition of =E2=80=98struct flock=E2=80=99
/usr/incl= ude/asm-generic/fcntl.h:140: error: redefinition of =E2=80=98struct flock64= =E2=80=99
make[1]: *** [work.o] Error 1
make[1]: Leaving directory `/= home/shiny/Packages/sheepdog-2009102101/sheep'
make: *** [all] Error 2
The qemu-kvm source with patched support for sheepdog compiles fine.<= br>
----- Original Message -----
From: "MORITA Kazutaka" <morita.k= azutaka@lab.ntt.co.jp>
To: kvm@vger.kernel.org, qemu-devel@nongnu.org= , linux-fsdevel@vger.kernel.org
Sent: Wednesday, October 21, 2009 8:13:4= 7 AM
Subject: [ANNOUNCE] Sheepdog: Distributed Storage System for KVM
Hi everyone,

Sheepdog is a distributed storage system for KVM/Q= EMU. It provides
highly available block level storage volumes to VMs lik= e Amazon EBS.
Sheepdog supports advanced volume management features such= as snapshot,
cloning, and thin provisioning. Sheepdog runs on several t= ens or hundreds
of nodes, and the architecture is fully symmetric; there= is no central
node such as a meta-data server.

The following lis= t describes the features of Sheepdog.

     * Linear s= calability in performance and capacity
     * No single p= oint of failure
     * Redundant architecture (data is wr= itten to multiple nodes)
     - Tolerance against network= failure
     * Zero configuration (newly added machines = will join the cluster automatically)
     - Autonomous lo= ad balancing
     * Snapshot
     - Onl= ine snapshot from qemu-monitor
     * Clone from a snapsh= ot volume
     * Thin provisioning
    = - Amazon EBS API support (to use from a Eucalyptus instance)

(* =3D= current features, - =3D on our todo list)

More details and download= links are here:

http://www.osrg.net/sheepdog/

Note that the = code is still in an early stage.
There are some critical TODO items:
=
     - VM image deletion support
     = - Support architectures other than X86_64
     - Data rec= overys
     - Free space management
    = ; - Guarantee reliability and availability under heavy load
  =   - Performance improvement
     - Reclaim unused b= locks
     - More documentation

We hope finding pe= ople interested in working together.
Enjoy!


Here are examples= :

- create images

$ kvm-img create -f sheepdog "Alice's Disk"= 256G
$ kvm-img create -f sheepdog "Bob's Disk" 256G

- list image= s

$ shepherd info -t vdi
    40000 : Alice's Disk =  256 GB (allocated: 0 MB, shared: 0 MB), 2009-10-15
16:17:18, tag: =        0, current
    80000 : Bob's D= isk    256 GB (allocated: 0 MB, shared: 0 MB), 2009-10-15
16:2= 9:20, tag:        0, current

- start up a virtua= l machine

$ kvm --drive format=3Dsheepdog,file=3D"Alice's Disk"
<= br>- create a snapshot

$ kvm-img snapshot -c name sheepdog:"Alice's = Disk"

- clone from a snapshot

$ kvm-img create -b sheepdog:"A= lice's Disk":0 -f sheepdog "Charlie's Disk"


Thanks.

-- MORITA, Kazutaka

NTT Cyber Space Labs
OSS Computing Project
= Kernel Group
E-mail: morita.kazutaka@lab.ntt.co.jp

--
To unsub= scribe from this list: send the line "unsubscribe kvm" in
the body of a = message to majordomo@vger.kernel.org
More majordomo info at  http:/= /vger.kernel.org/majordomo-info.html
------=_Part_53_2103398662.1256113700359--