From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:49710) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1VhNNi-00070v-KG for qemu-devel@nongnu.org; Fri, 15 Nov 2013 12:40:43 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1VhNNZ-0006Pj-LK for qemu-devel@nongnu.org; Fri, 15 Nov 2013 12:40:34 -0500 Received: from e9.ny.us.ibm.com ([32.97.182.139]:46691) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1VhNNZ-0006PE-GD for qemu-devel@nongnu.org; Fri, 15 Nov 2013 12:40:25 -0500 Received: from /spool/local by e9.ny.us.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Fri, 15 Nov 2013 12:40:23 -0500 Received: from b01cxnp23032.gho.pok.ibm.com (b01cxnp23032.gho.pok.ibm.com [9.57.198.27]) by d01dlp03.pok.ibm.com (Postfix) with ESMTP id 852FFC90050 for ; Fri, 15 Nov 2013 12:40:19 -0500 (EST) Received: from d01av02.pok.ibm.com (d01av02.pok.ibm.com [9.56.224.216]) by b01cxnp23032.gho.pok.ibm.com (8.13.8/8.13.8/NCO v10.0) with ESMTP id rAFHeKiB2621854 for ; Fri, 15 Nov 2013 17:40:20 GMT Received: from d01av02.pok.ibm.com (localhost [127.0.0.1]) by d01av02.pok.ibm.com (8.14.4/8.14.4/NCO v10.0 AVout) with ESMTP id rAFHeKPt005534 for ; Fri, 15 Nov 2013 12:40:20 -0500 Message-ID: <52865C83.10202@linux.vnet.ibm.com> Date: Fri, 15 Nov 2013 12:40:19 -0500 From: "Michael R. Hines" MIME-Version: 1.0 References: <1383764354-10588-1-git-send-email-mrhines@linux.vnet.ibm.com> <20131115170612.GO28794@redhat.com> In-Reply-To: <20131115170612.GO28794@redhat.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: [Qemu-devel] [PATCH v3 for-1.7] rdma: rename 'x-rdma' => 'rdma' List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: "Daniel P. Berrange" Cc: quintela@redhat.com, qemu-devel@nongnu.org, owasserm@redhat.com, onom@us.ibm.com, abali@us.ibm.com, mrhines@us.ibm.com, gokul@us.ibm.com, pbonzini@redhat.com, chegu_vinod@hp.com On 11/15/2013 12:06 PM, Daniel P. Berrange wrote: > On Wed, Nov 06, 2013 at 01:59:14PM -0500, mrhines@linux.vnet.ibm.com wrote: >> From: "Michael R. Hines" >> >> As far as we can tell, all known bugs have been fixed: > [snip] > >> 3. Libvirt patches are ready > [snip] > >> Objections? > There was a first round of patches posted to the libvirt list back > in July, but those were rejected since QEMU side was still in flux. Yes, I'm addressing all the reviews I received back in July, I just haven't posted them to the list yet - stay tuned. > More seriously though, from discussions at the KVM Forum it sounds > like there is a significant problem in actually using the RDMA > code. Unfortunately I can't remember who I was talking with about > it, but I was told that it requires the QEMU process to run as root > in order to talk to some of the kernel interfaces, and requires > manual updates to the cgroups device ACL to allow QEMU access to > some RMDA related device nodes. No, that was for Fault Tolerance, not for RDMA specifically. You were speaking to me =). The jog your memory, the issue was related to the need by Micro-Checkpointing to access netlink sockets to interact properly with netlink in the kernel. This is unrelated to RDMA - accessing the /dev/infiniband device nodes is already supported by libvirt my modifying the configuration file in /etc and that works just fine. - Michael