All of lore.kernel.org
 help / color / mirror / Atom feed
From: Dan Magenheimer <dan.magenheimer@oracle.com>
To: Andrea Arcangeli <aarcange@redhat.com>
Cc: Pekka Enberg <penberg@kernel.org>,
	Cyclonus J <cyclonusj@gmail.com>,
	Sasha Levin <levinsasha928@gmail.com>,
	Christoph Hellwig <hch@infradead.org>,
	David Rientjes <rientjes@google.com>,
	Linus Torvalds <torvalds@linux-foundation.org>,
	linux-mm@kvack.org, LKML <linux-kernel@vger.kernel.org>,
	Andrew Morton <akpm@linux-foundation.org>,
	Konrad Wilk <konrad.wilk@oracle.com>,
	Jeremy Fitzhardinge <jeremy@goop.org>,
	Seth Jennings <sjenning@linux.vnet.ibm.com>,
	ngupta@vflare.org, Chris Mason <chris.mason@oracle.com>,
	JBeulich@novell.com, Dave Hansen <dave@linux.vnet.ibm.com>,
	Jonathan Corbet <corbet@lwn.net>
Subject: RE: [GIT PULL] mm: frontswap (for 3.2 window)
Date: Thu, 3 Nov 2011 15:29:34 -0700 (PDT)	[thread overview]
Message-ID: <69ed0521-cda2-4fc2-b51b-7bcc39d65afd@default> (raw)
In-Reply-To: <20111103003254.GE18879@redhat.com>

> From: Andrea Arcangeli [mailto:aarcange@redhat.com]
> Subject: Re: [GIT PULL] mm: frontswap (for 3.2 window)

Hi Andrea --

Sorry for the delayed response... and for continuing this
thread further, but I want to ensure I answer your
points.

First, did you see my reply to Rik that suggested a design
as to how KVM could do batching with no change to the
hooks or frontswap_ops API?  (Basically a guest-side
cache and add a batching op to the KVM-tmem ABI.)  I think
it resolves your last remaining concern (too many vmexits),
so am eager to see if you agree.

> Like somebody already pointed out (and I agree) it'd be nice to get
> the patches posted to the mailing list (with git send-emails/hg

Frontswap v10 https://lkml.org/lkml/2011/9/15/367 as last posted
to linux-mm has identical code to the git commits... in response
to Konrad and Kame, the commit-set was slightly reorganized and
extended from 6 commits to 8, but absolutely no code differences.
Since no code was changed between v10 and v11, I didn't repost v11
to linux-mm.

Note, every version of frontswap was posted to linux-mm and
cc'ed to Andrew, Hugh, Nick and Rik and I was very diligent
in responding to all comments...  Wish I would have
cc'ed you all along as this has been a great discussion.

> email/quilt) and get them merged into -mm first.

Sorry, I'm still a newbie on this process, but just to clarify,
"into -mm" means Andrew merges the patches, right?  Andrew
said in the first snippet of https://lkml.org/lkml/2011/11/1/317 
that linux-next is fine, so I'm not sure whether to follow your
advice or not.

> Thanks. So this overall sounds fairly positive (or at least better
> than neutral) to me.

Excellent!

> On my side I hope it get improved over time to get the best out of
> it. I've not been hugely impressed so far because at this point in
> time it doesn't seem a vast improvement in runtime behavior compared
> to what zram could provide, like Rik said there's no iov/SG/vectored
> input to tmem_put (which I'd find more intuitive renamed to
> tmem_store), like Avi said ramster is synchronous and not good having
> to wait a long time. But if we can make these plugins stackable and we
> can put a storage backend at the end we could do
> storage+zcache+frontswap.

This thread has been so long, I don't even remember what I've
replied to who, so just to clarify on these several points,
in case you didn't see these elsewhere in the thread:

- Nitin Gupta, author of zram, thinks zcache is an improvement
  over zram because it is more flexible/dynamic
- KVM can do batching fairly easily with no changes to the
  hooks or frontswap_ops with the design I recently proposed
- RAMster is synchronous, but the requirement is _only_ on the
  "local" put... once the data is "in tmem", asynchronous threads
  can do other things with it (like RAMster moving the pages
  to a tmem pool on a remote system)
- the plugins as they exist today (Xen, zcache) aren't stackable,
  but the frontswap_ops registration already handles stacking,
  so it is certainly a good future enhancement... RAMster
  already does "stacking", but by incorporating a copy of
  the zcache code.  (I think that's just a code organization
  issue that can be resolved if/when RAMster goes into staging.)

With these in mind, I hope you will now be even a "lot more
happy now" with frontswap and MUCH better than neutral. :-) :-)

Dan

WARNING: multiple messages have this Message-ID (diff)
From: Dan Magenheimer <dan.magenheimer@oracle.com>
To: Andrea Arcangeli <aarcange@redhat.com>
Cc: Pekka Enberg <penberg@kernel.org>,
	Cyclonus J <cyclonusj@gmail.com>,
	Sasha Levin <levinsasha928@gmail.com>,
	Christoph Hellwig <hch@infradead.org>,
	David Rientjes <rientjes@google.com>,
	Linus Torvalds <torvalds@linux-foundation.org>,
	linux-mm@kvack.org, LKML <linux-kernel@vger.kernel.org>,
	Andrew Morton <akpm@linux-foundation.org>,
	Konrad Wilk <konrad.wilk@oracle.com>,
	Jeremy Fitzhardinge <jeremy@goop.org>,
	Seth Jennings <sjenning@linux.vnet.ibm.com>,
	ngupta@vflare.org, Chris Mason <chris.mason@oracle.com>,
	JBeulich@novell.com, Dave Hansen <dave@linux.vnet.ibm.com>,
	Jonathan Corbet <corbet@lwn.net>
Subject: RE: [GIT PULL] mm: frontswap (for 3.2 window)
Date: Thu, 3 Nov 2011 15:29:34 -0700 (PDT)	[thread overview]
Message-ID: <69ed0521-cda2-4fc2-b51b-7bcc39d65afd@default> (raw)
In-Reply-To: <20111103003254.GE18879@redhat.com>

> From: Andrea Arcangeli [mailto:aarcange@redhat.com]
> Subject: Re: [GIT PULL] mm: frontswap (for 3.2 window)

Hi Andrea --

Sorry for the delayed response... and for continuing this
thread further, but I want to ensure I answer your
points.

First, did you see my reply to Rik that suggested a design
as to how KVM could do batching with no change to the
hooks or frontswap_ops API?  (Basically a guest-side
cache and add a batching op to the KVM-tmem ABI.)  I think
it resolves your last remaining concern (too many vmexits),
so am eager to see if you agree.

> Like somebody already pointed out (and I agree) it'd be nice to get
> the patches posted to the mailing list (with git send-emails/hg

Frontswap v10 https://lkml.org/lkml/2011/9/15/367 as last posted
to linux-mm has identical code to the git commits... in response
to Konrad and Kame, the commit-set was slightly reorganized and
extended from 6 commits to 8, but absolutely no code differences.
Since no code was changed between v10 and v11, I didn't repost v11
to linux-mm.

Note, every version of frontswap was posted to linux-mm and
cc'ed to Andrew, Hugh, Nick and Rik and I was very diligent
in responding to all comments...  Wish I would have
cc'ed you all along as this has been a great discussion.

> email/quilt) and get them merged into -mm first.

Sorry, I'm still a newbie on this process, but just to clarify,
"into -mm" means Andrew merges the patches, right?  Andrew
said in the first snippet of https://lkml.org/lkml/2011/11/1/317 
that linux-next is fine, so I'm not sure whether to follow your
advice or not.

> Thanks. So this overall sounds fairly positive (or at least better
> than neutral) to me.

Excellent!

> On my side I hope it get improved over time to get the best out of
> it. I've not been hugely impressed so far because at this point in
> time it doesn't seem a vast improvement in runtime behavior compared
> to what zram could provide, like Rik said there's no iov/SG/vectored
> input to tmem_put (which I'd find more intuitive renamed to
> tmem_store), like Avi said ramster is synchronous and not good having
> to wait a long time. But if we can make these plugins stackable and we
> can put a storage backend at the end we could do
> storage+zcache+frontswap.

This thread has been so long, I don't even remember what I've
replied to who, so just to clarify on these several points,
in case you didn't see these elsewhere in the thread:

- Nitin Gupta, author of zram, thinks zcache is an improvement
  over zram because it is more flexible/dynamic
- KVM can do batching fairly easily with no changes to the
  hooks or frontswap_ops with the design I recently proposed
- RAMster is synchronous, but the requirement is _only_ on the
  "local" put... once the data is "in tmem", asynchronous threads
  can do other things with it (like RAMster moving the pages
  to a tmem pool on a remote system)
- the plugins as they exist today (Xen, zcache) aren't stackable,
  but the frontswap_ops registration already handles stacking,
  so it is certainly a good future enhancement... RAMster
  already does "stacking", but by incorporating a copy of
  the zcache code.  (I think that's just a code organization
  issue that can be resolved if/when RAMster goes into staging.)

With these in mind, I hope you will now be even a "lot more
happy now" with frontswap and MUCH better than neutral. :-) :-)

Dan

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Fight unfair telecom internet charges in Canada: sign http://stopthemeter.ca/
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  reply	other threads:[~2011-11-03 22:30 UTC|newest]

Thread overview: 175+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-10-27 18:52 [GIT PULL] mm: frontswap (for 3.2 window) Dan Magenheimer
2011-10-27 18:52 ` Dan Magenheimer
     [not found] ` <alpine.DEB.2.00.1110271318220.7639@chino.kir.corp.google.com20111027211157.GA1199@infradead.org>
2011-10-27 19:30 ` Kurt Hackel
2011-10-27 19:30   ` Kurt Hackel
2011-10-27 20:18 ` David Rientjes
2011-10-27 20:18   ` David Rientjes
2011-10-27 21:11   ` Christoph Hellwig
2011-10-27 21:11     ` Christoph Hellwig
2011-10-27 21:49     ` Dan Magenheimer
2011-10-27 21:49       ` Dan Magenheimer
2011-10-27 21:52       ` Christoph Hellwig
2011-10-27 21:52         ` Christoph Hellwig
2011-10-27 22:21         ` Dan Magenheimer
2011-10-27 22:21           ` Dan Magenheimer
2011-10-28  7:12         ` Sasha Levin
2011-10-28  7:12           ` Sasha Levin
     [not found]           ` <CAOzbF4fnD=CGR-nizZoBxmFSuAjFC3uAHf3wDj5RLneJvJhrOQ@mail.gmail.comCAOJsxLGOTw7rtFnqeHvzFxifA0QgPVDHZzrEo=-uB2Gkrvp=JQ@mail.gmail.com>
     [not found]             ` <552d2067-474d-4aef-a9a4-89e5fd8ef84f@default20111031181651.GF3466@redhat.com>
     [not found]               ` <60592afd-97aa-4eaf-b86b-f6695d31c7f1@default20111031223717.GI3466@redhat.com>
     [not found]                 ` <1b2e4f74-7058-4712-85a7-84198723e3ee@default20111101012017.GJ3466@redhat.com>
     [not found]                   ` <6a9db6d9-6f13-4855-b026-ba668c29ddfa@default20111101180702.GL3466@redhat.com>
     [not found]                     ` <b8a0ca71-a31b-488a-9a92-2502d4a6e9bf@default20111102013122.GA18879@redhat.com>
2011-10-28  7:30           ` Cyclonus J
2011-10-28  7:30             ` Cyclonus J
2011-10-28 14:26             ` Pekka Enberg
2011-10-28 14:26               ` Pekka Enberg
2011-10-28 15:21               ` Dan Magenheimer
2011-10-28 15:21                 ` Dan Magenheimer
     [not found]                 ` <CAOJsxLEE-qf9me1SAZLFiEVhHVnDh7BDrSx1+abe9R4mfkhD=g@mail.gmail.com20111028163053.GC1319@redhat.com>
2011-10-28 15:36                 ` Pekka Enberg
2011-10-28 15:36                   ` Pekka Enberg
2011-10-28 16:30                   ` Johannes Weiner
2011-10-28 16:30                     ` Johannes Weiner
2011-10-28 17:01                     ` Pekka Enberg
2011-10-28 17:01                       ` Pekka Enberg
2011-10-28 17:07                     ` Dan Magenheimer
2011-10-28 17:07                       ` Dan Magenheimer
2011-10-28 18:28                       ` John Stoffel
2011-10-28 18:28                         ` John Stoffel
2011-10-28 20:19                         ` Dan Magenheimer
2011-10-28 20:19                           ` Dan Magenheimer
2011-10-28 20:52                           ` John Stoffel
2011-10-28 20:52                             ` John Stoffel
2011-10-30 19:18                             ` Dan Magenheimer
2011-10-30 19:18                               ` Dan Magenheimer
2011-10-30 20:06                               ` Dave Hansen
2011-10-30 20:06                                 ` Dave Hansen
2011-10-30 21:50                                 ` Dan Magenheimer
2011-10-30 21:50                                   ` Dan Magenheimer
2011-11-02 19:45                                 ` Rik van Riel
2011-11-02 19:45                                   ` Rik van Riel
2011-11-02 20:45                                   ` Dan Magenheimer
2011-11-02 20:45                                     ` Dan Magenheimer
2011-11-06 22:32                             ` Valdis.Kletnieks
2011-11-08 12:15                               ` Ed Tomlinson
2011-11-08 12:15                                 ` Ed Tomlinson
2011-10-31  8:12                           ` James Bottomley
2011-10-31  8:12                             ` James Bottomley
2011-10-31 15:39                             ` Dan Magenheimer
2011-10-31 15:39                               ` Dan Magenheimer
2011-11-01 10:13                               ` James Bottomley
2011-11-01 10:13                                 ` James Bottomley
2011-11-01 18:10                                 ` Dan Magenheimer
2011-11-01 18:10                                   ` Dan Magenheimer
2011-11-01 18:48                                   ` Dave Hansen
2011-11-01 18:48                                     ` Dave Hansen
2011-11-01 21:32                                     ` Dan Magenheimer
2011-11-01 21:32                                       ` Dan Magenheimer
2011-11-02  7:44                                   ` James Bottomley
2011-11-02  7:44                                     ` James Bottomley
2011-11-02 19:39                                     ` Dan Magenheimer
2011-11-02 19:39                                       ` Dan Magenheimer
2011-10-31 18:44                         ` Andrea Arcangeli
2011-10-31 18:44                           ` Andrea Arcangeli
2011-10-30 21:47                       ` Johannes Weiner
2011-10-30 21:47                         ` Johannes Weiner
2011-10-30 23:19                         ` Dan Magenheimer
2011-10-30 23:19                           ` Dan Magenheimer
2011-10-31 18:34                       ` Andrea Arcangeli
2011-10-31 18:34                         ` Andrea Arcangeli
2011-10-31 21:45                         ` Dan Magenheimer
2011-10-31 21:45                           ` Dan Magenheimer
2011-10-28 16:37                   ` Dan Magenheimer
2011-10-28 16:37                     ` Dan Magenheimer
2011-10-28 16:59                     ` Pekka Enberg
2011-10-28 16:59                       ` Pekka Enberg
2011-10-28 17:20                       ` Dan Magenheimer
2011-10-28 17:20                         ` Dan Magenheimer
2011-10-31 18:16                 ` Andrea Arcangeli
2011-10-31 18:16                   ` Andrea Arcangeli
2011-10-31 20:58                   ` Dan Magenheimer
2011-10-31 20:58                     ` Dan Magenheimer
2011-10-31 22:37                     ` Andrea Arcangeli
2011-10-31 22:37                       ` Andrea Arcangeli
2011-10-31 23:36                       ` Dan Magenheimer
2011-10-31 23:36                         ` Dan Magenheimer
2011-11-01  1:20                         ` Andrea Arcangeli
2011-11-01  1:20                           ` Andrea Arcangeli
2011-11-01 16:41                           ` Dan Magenheimer
2011-11-01 16:41                             ` Dan Magenheimer
2011-11-01 18:07                             ` Andrea Arcangeli
2011-11-01 18:07                               ` Andrea Arcangeli
2011-11-01 21:00                               ` Dan Magenheimer
2011-11-01 21:00                                 ` Dan Magenheimer
2011-11-02  1:31                                 ` Andrea Arcangeli
2011-11-02  1:31                                   ` Andrea Arcangeli
2011-11-02 19:06                                   ` Dan Magenheimer
2011-11-02 19:06                                     ` Dan Magenheimer
2011-11-03  0:32                                     ` Andrea Arcangeli
2011-11-03  0:32                                       ` Andrea Arcangeli
2011-11-03 22:29                                       ` Dan Magenheimer [this message]
2011-11-03 22:29                                         ` Dan Magenheimer
2011-11-02 20:51                         ` Rik van Riel
2011-11-02 20:51                           ` Rik van Riel
2011-11-02 21:14                           ` Dan Magenheimer
2011-11-02 21:14                             ` Dan Magenheimer
2011-11-15 16:29                             ` Rik van Riel
2011-11-15 16:29                               ` Rik van Riel
2011-11-15 17:33                               ` Jeremy Fitzhardinge
2011-11-15 17:33                                 ` Jeremy Fitzhardinge
2011-11-16 14:49                                 ` Konrad Rzeszutek Wilk
2011-11-16 14:49                                   ` Konrad Rzeszutek Wilk
2011-11-01 10:16                   ` James Bottomley
2011-11-01 10:16                     ` James Bottomley
2011-11-01 18:21                     ` Dan Magenheimer
2011-11-01 18:21                       ` Dan Magenheimer
2011-11-02  8:14                       ` James Bottomley
2011-11-02  8:14                         ` James Bottomley
2011-11-02 20:08                         ` Dan Magenheimer
2011-11-02 20:08                           ` Dan Magenheimer
2011-11-03 10:30                           ` Theodore Tso
2011-11-03 10:30                             ` Theodore Tso
2011-11-03 14:59                             ` Dan Magenheimer
2011-11-03 14:59                               ` Dan Magenheimer
2011-11-02 15:44                     ` Avi Kivity
2011-11-02 15:44                       ` Avi Kivity
2011-11-02 16:02                       ` Andrea Arcangeli
2011-11-02 16:02                         ` Andrea Arcangeli
2011-11-02 16:13                         ` Avi Kivity
2011-11-02 16:13                           ` Avi Kivity
2011-11-02 20:27                           ` Dan Magenheimer
2011-11-02 20:27                             ` Dan Magenheimer
2011-11-02 20:19                       ` Dan Magenheimer
2011-11-02 20:19                         ` Dan Magenheimer
2011-10-27 21:44 ` Avi Miller
2011-10-27 21:44   ` Avi Miller
2011-10-27 22:33 ` Brian King
2011-10-27 22:33   ` Brian King
2011-10-28  5:17 ` Nitin Gupta
2011-10-28  5:17   ` Nitin Gupta
2011-10-29 13:43 ` Ed Tomlinson
2011-10-29 13:43   ` Ed Tomlinson
2011-10-31  8:13 ` KAMEZAWA Hiroyuki
2011-10-31  8:13   ` KAMEZAWA Hiroyuki
2011-10-31 16:38   ` Dan Magenheimer
2011-10-31 16:38     ` Dan Magenheimer
2011-11-01  0:50     ` KAMEZAWA Hiroyuki
2011-11-01  0:50       ` KAMEZAWA Hiroyuki
2011-11-01 15:25       ` Dan Magenheimer
2011-11-01 15:25         ` Dan Magenheimer
2011-11-01 21:43         ` Andrew Morton
2011-11-01 21:43           ` Andrew Morton
2011-11-01 22:25           ` Dan Magenheimer
2011-11-01 22:25             ` Dan Magenheimer
2011-11-02 21:03           ` Rik van Riel
2011-11-02 21:03             ` Rik van Riel
2011-11-02 21:42             ` Dan Magenheimer
2011-11-02 21:42               ` Dan Magenheimer
2011-11-02  1:14         ` KAMEZAWA Hiroyuki
2011-11-02  1:14           ` KAMEZAWA Hiroyuki
2011-11-02 15:12           ` Dan Magenheimer
2011-11-02 15:12             ` Dan Magenheimer
2011-11-04  4:19             ` KAMEZAWA Hiroyuki
2011-11-04  4:19               ` KAMEZAWA Hiroyuki
2011-11-03 16:49 ` Jan Beulich
2011-11-03 16:49   ` Jan Beulich
2011-11-04  0:54   ` Andrew Morton
2011-11-04  0:54     ` Andrew Morton
2011-11-04  8:49     ` Jan Beulich
2011-11-04  8:49       ` Jan Beulich
  -- strict thread matches above, loose matches on Subject: below --
2011-11-04 12:37 Clayton Weaver
2011-11-05 17:08 Clayton Weaver

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=69ed0521-cda2-4fc2-b51b-7bcc39d65afd@default \
    --to=dan.magenheimer@oracle.com \
    --cc=JBeulich@novell.com \
    --cc=aarcange@redhat.com \
    --cc=akpm@linux-foundation.org \
    --cc=chris.mason@oracle.com \
    --cc=corbet@lwn.net \
    --cc=cyclonusj@gmail.com \
    --cc=dave@linux.vnet.ibm.com \
    --cc=hch@infradead.org \
    --cc=jeremy@goop.org \
    --cc=konrad.wilk@oracle.com \
    --cc=levinsasha928@gmail.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=ngupta@vflare.org \
    --cc=penberg@kernel.org \
    --cc=rientjes@google.com \
    --cc=sjenning@linux.vnet.ibm.com \
    --cc=torvalds@linux-foundation.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.