All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Stephen C. Tweedie" <sct@redhat.com>
To: Arjan van de Ven <arjanv@redhat.com>
Cc: Joe Thornber <thornber@fib011235813.fsnet.co.uk>,
	lvm-devel@sistina.com, Jim McDonald <Jim@mcdee.net>,
	Andreas Dilger <adilger@turbolabs.com>,
	linux-lvm@sistina.com, linux-kernel@vger.kernel.org,
	evms-devel@lists.sourceforge.net
Subject: [linux-lvm] Re: [Evms-devel] Re: [ANNOUNCE] LVM reimplementation ready for beta testing
Date: Fri Feb  1 05:06:02 2002	[thread overview]
Message-ID: <20020201110552.B2149@redhat.com> (raw)
In-Reply-To: <20020201051251.B10893@devserv.devel.redhat.com>; from arjanv@redhat.com on Fri, Feb 01, 2002 at 05:12:51AM -0500

Hi,

On Fri, Feb 01, 2002 at 05:12:51AM -0500, Arjan van de Ven wrote:
> On Thu, Jan 31, 2002 at 01:09:13PM +0000, Joe Thornber wrote:
> > 
> > Now our hero decides to PV move PV2 to PV4:
> > 
> > 1. Suspend our LV (254:3), this starts queueing all io, and flushes
> >    all pending io. 
> 
> But "flushes all pending io" is *far* from trivial. there's no current
> kernel functionality for this, so you'll have to do "weird shit" that will
> break easy and often.

I've been all through this with Joe.  He *does* track pending IO in
device_mapper, and he's got a layered device_mirror driver which can
be overlayed on top of the segments of the device that you want to
copy.  His design looks solid and the necessary infrastructure for
getting the locking right is all there.

> Also "suspending" is rather dangerous because it can deadlock the machine
> (think about the VM needing to write back dirty data on this LV in order to
>  make memory available for your move)...

There's a copy thread which preallocates a fully-populated kiobuf for
the data.  There's no VM pressure, and since it uses unbuffered IO,
there are no cache coherency problems like current LVM has.

Arjan, I *told* you they have thought this stuff through.  :-)

Cheers,
 Stephen

WARNING: multiple messages have this Message-ID (diff)
From: "Stephen C. Tweedie" <sct@redhat.com>
To: Arjan van de Ven <arjanv@redhat.com>
Cc: Joe Thornber <thornber@fib011235813.fsnet.co.uk>,
	lvm-devel@sistina.com, Jim McDonald <Jim@mcdee.net>,
	Andreas Dilger <adilger@turbolabs.com>,
	linux-lvm@sistina.com, linux-kernel@vger.kernel.org,
	evms-devel@lists.sourceforge.net
Subject: Re: [Evms-devel] Re: [ANNOUNCE] LVM reimplementation ready for beta testing
Date: Fri, 1 Feb 2002 11:05:52 +0000	[thread overview]
Message-ID: <20020201110552.B2149@redhat.com> (raw)
In-Reply-To: <OFBCE93B66.F7B9C14E-ON85256B52.006B8AB3@raleigh.ibm.com> <20020131125211.A8934@fib011235813.fsnet.co.uk> <20020201045518.A10893@devserv.devel.redhat.com> <20020131130913.A8997@fib011235813.fsnet.co.uk> <20020201051251.B10893@devserv.devel.redhat.com>
In-Reply-To: <20020201051251.B10893@devserv.devel.redhat.com>; from arjanv@redhat.com on Fri, Feb 01, 2002 at 05:12:51AM -0500

Hi,

On Fri, Feb 01, 2002 at 05:12:51AM -0500, Arjan van de Ven wrote:
> On Thu, Jan 31, 2002 at 01:09:13PM +0000, Joe Thornber wrote:
> > 
> > Now our hero decides to PV move PV2 to PV4:
> > 
> > 1. Suspend our LV (254:3), this starts queueing all io, and flushes
> >    all pending io. 
> 
> But "flushes all pending io" is *far* from trivial. there's no current
> kernel functionality for this, so you'll have to do "weird shit" that will
> break easy and often.

I've been all through this with Joe.  He *does* track pending IO in
device_mapper, and he's got a layered device_mirror driver which can
be overlayed on top of the segments of the device that you want to
copy.  His design looks solid and the necessary infrastructure for
getting the locking right is all there.

> Also "suspending" is rather dangerous because it can deadlock the machine
> (think about the VM needing to write back dirty data on this LV in order to
>  make memory available for your move)...

There's a copy thread which preallocates a fully-populated kiobuf for
the data.  There's no VM pressure, and since it uses unbuffered IO,
there are no cache coherency problems like current LVM has.

Arjan, I *told* you they have thought this stuff through.  :-)

Cheers,
 Stephen

  parent reply	other threads:[~2002-02-01  5:06 UTC|newest]

Thread overview: 66+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2002-01-31 13:54 [linux-lvm] Re: [lvm-devel] [ANNOUNCE] LVM reimplementation ready for beta testing Steve Pratt
2002-01-31 19:52 ` Steve Pratt
2002-01-31 12:52 ` Joe Thornber
2002-02-01  3:47   ` Joe Thornber
2002-02-01  3:55   ` [Evms-devel] " Arjan van de Ven
2002-02-01  9:55     ` Arjan van de Ven
2002-01-31 13:09     ` Joe Thornber
2002-02-01  4:04       ` Joe Thornber
2002-02-01  4:13       ` [linux-lvm] " Arjan van de Ven
2002-02-01 10:12         ` Arjan van de Ven
2002-01-31 13:35         ` Joe Thornber
2002-02-01  4:31           ` [linux-lvm] " Joe Thornber
2002-02-01  5:06         ` Stephen C. Tweedie [this message]
2002-02-01 11:05           ` [Evms-devel] " Stephen C. Tweedie
2002-02-01  8:32         ` [linux-lvm] " Alan Cox
2002-02-01 14:44           ` Alan Cox
2002-02-01  8:59           ` [linux-lvm] Re: [Evms-devel] " Stephen C. Tweedie
2002-02-01 14:58             ` Stephen C. Tweedie
2002-02-01 16:01   ` [evms-devel] [linux-lvm] " Kevin Corry
2002-02-01 21:59     ` Kevin Corry
2002-01-31 21:51     ` Joe Thornber
2002-02-03  6:22       ` Joe Thornber
2002-02-01 17:17     ` Alan Cox
2002-02-01 23:30       ` Alan Cox
2002-02-02  7:40     ` Andrew Clausen
2002-02-02 13:39       ` Andrew Clausen
2002-02-02 13:30       ` Alan Cox
2002-02-02 19:42         ` Alan Cox
2002-01-31 14:05 ` [linux-lvm] Re: [lvm-devel] [ANNOUNCE] LVM reimplementationre ady " Jeff Layton
2002-02-01  3:29   ` Heinz J . Mauelshagen
2002-02-01  9:43     ` Jeff Layton
2002-02-05  8:04     ` James Hawtin
2002-02-05  8:09       ` Patrick Caulfield
2002-02-05 11:13       ` Jesus Manuel NAVARRO LOPEZ
2002-02-05 12:28         ` [linux-lvm] (OT) Backups (was Re: LVM reimplementationre ady for beta testing...) Chad C. Walstrom
2002-02-06 13:13       ` [linux-lvm] Backup costs (was: LVM reimplementationre) Benjamin Scott
2002-02-06 13:39         ` Daniel Whicker
2002-02-06 13:46           ` James Mello
2002-02-06 14:35             ` Anders Widman
2002-02-07  3:01               ` Jesus Manuel NAVARRO LOPEZ
2002-02-07  3:17                 ` Petro
2002-02-07  4:34                   ` Jesus Manuel NAVARRO LOPEZ
2002-02-07  7:19                     ` Petro
2002-02-07  7:54                       ` Jesus Manuel NAVARRO LOPEZ
2002-02-07  3:55               ` Dieter Stueken
2002-02-06 13:46         ` Andreas Dilger
2002-02-06 13:48         ` Theo Van Dinter
2002-02-06 15:45           ` Austin Gonyou
2002-02-06 13:51         ` Petro
2002-02-06 13:52         ` Kirby C. Bohling
2002-02-06 13:55         ` Jeff Layton
2002-02-06 14:03           ` James Mello
2002-02-06 20:03             ` Jeff Layton
2002-02-06 20:08               ` James Mello
2002-02-06 20:11                 ` Jeff Layton
2002-02-07  3:10                   ` Jesus Manuel NAVARRO LOPEZ
2002-02-07  4:53                     ` Jeff Layton
2002-02-07  5:31                       ` James Hawtin
2002-02-07 17:05                         ` Wolfgang Weisselberg
2002-02-08 20:04                           ` James Hawtin
2002-02-07  3:03           ` Jesus Manuel NAVARRO LOPEZ
2002-02-07  3:17             ` Petro
2002-02-07  4:15               ` Jesus Manuel NAVARRO LOPEZ
2002-02-12  1:00             ` Marc MERLIN
2002-01-31 15:19 ` [Evms-devel] Re: [linux-lvm] Re: [lvm-devel] [ANNOUNCE] LVM reimplementation ready for beta testing Andrew Clausen
2002-01-31 21:18   ` Andrew Clausen

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20020201110552.B2149@redhat.com \
    --to=sct@redhat.com \
    --cc=Jim@mcdee.net \
    --cc=adilger@turbolabs.com \
    --cc=arjanv@redhat.com \
    --cc=evms-devel@lists.sourceforge.net \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-lvm@sistina.com \
    --cc=lvm-devel@sistina.com \
    --cc=thornber@fib011235813.fsnet.co.uk \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.