From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([208.118.235.92]:48015) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UPjoc-0007wP-Cn for qemu-devel@nongnu.org; Tue, 09 Apr 2013 21:27:12 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1UPjoZ-0007A6-Dv for qemu-devel@nongnu.org; Tue, 09 Apr 2013 21:27:10 -0400 Received: from e8.ny.us.ibm.com ([32.97.182.138]:47001) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UPjoZ-00079G-AN for qemu-devel@nongnu.org; Tue, 09 Apr 2013 21:27:07 -0400 Received: from /spool/local by e8.ny.us.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Tue, 9 Apr 2013 21:27:04 -0400 Received: from d01relay04.pok.ibm.com (d01relay04.pok.ibm.com [9.56.227.236]) by d01dlp03.pok.ibm.com (Postfix) with ESMTP id 37146C90029 for ; Tue, 9 Apr 2013 21:27:02 -0400 (EDT) Received: from d03av03.boulder.ibm.com (d03av03.boulder.ibm.com [9.17.195.169]) by d01relay04.pok.ibm.com (8.13.8/8.13.8/NCO v10.0) with ESMTP id r3A1R1ku310522 for ; Tue, 9 Apr 2013 21:27:02 -0400 Received: from d03av03.boulder.ibm.com (loopback [127.0.0.1]) by d03av03.boulder.ibm.com (8.14.4/8.13.1/NCO v10.0 AVout) with ESMTP id r3A1R04C008591 for ; Tue, 9 Apr 2013 19:27:01 -0600 Message-ID: <5164BFE3.4040204@linux.vnet.ibm.com> Date: Tue, 09 Apr 2013 21:26:59 -0400 From: "Michael R. Hines" MIME-Version: 1.0 References: <20130324155153.GA8597@redhat.com> <515F3160.4020007@linux.vnet.ibm.com> <515F3948.40205@linux.vnet.ibm.com> <515F42EE.8060203@linux.vnet.ibm.com> <20130409190350.GB8212@redhat.com> In-Reply-To: <20130409190350.GB8212@redhat.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: [Qemu-devel] [PATCHv2] rdma: add a new IB_ACCESS_GIFT flag List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: "Michael S. Tsirkin" Cc: Roland Dreier , qemu-devel@nongnu.org, "linux-rdma@vger.kernel.org" , Yishai Hadas , LKML , Hal Rosenstock , Jason Gunthorpe , Sean Hefty , Christoph Lameter With respect, I'm going to offload testing this patch back to the author =) because I'm trying to address all of Paolo's other minor issues with the RDMA patch before we can merge. Since dynamic page registration (as you requested) is now fully implemented, this patch is less urgent since we now have a mechanism in place to avoid page pinning on both sides of the migration. - Michael On 04/09/2013 03:03 PM, Michael S. Tsirkin wrote: > presumably is_dup_page reads the page, so should not break COW ... > > I'm not sure about the cgroups swap limit - you might have > too many non COW pages so attempting to fault them all in > makes you exceed the limit. You really should look at > what is going on in the pagemap, to see if there's > measureable gain from the patch. > > > On Fri, Apr 05, 2013 at 05:32:30PM -0400, Michael R. Hines wrote: >> Well, I have the "is_dup_page()" commented out.......when RDMA is >> activated..... >> >> Is there something else in QEMU that could be touching the page that >> I don't know about? >> >> - Michael >> >> >> On 04/05/2013 05:03 PM, Roland Dreier wrote: >>> On Fri, Apr 5, 2013 at 1:51 PM, Michael R. Hines >>> wrote: >>>> Sorry, I was wrong. ignore the comments about cgroups. That's still broken. >>>> (i.e. trying to register RDMA memory while using a cgroup swap limit cause >>>> the process get killed). >>>> >>>> But the GIFT flag patch works (my understanding is that GIFT flag allows the >>>> adapter to transmit stale memory information, it does not have anything to >>>> do with cgroups specifically). >>> The point of the GIFT patch is to avoid triggering copy-on-write so >>> that memory doesn't blow up during migration. If that doesn't work >>> then there's no point to the patch. >>> >>> - R. >>>