From mboxrd@z Thu Jan 1 00:00:00 1970 From: Dario Faggioli Subject: Re: PV-vNUMA issue: topology is misinterpreted by the guest Date: Tue, 28 Jul 2015 17:17:56 +0200 Message-ID: <1438096676.2889.108.camel@citrix.com> References: <55AF9F8F.7030200@suse.com> <55AFA16B.3070103@oracle.com> <55AFA41E.1080101@suse.com> <55AFAC34.1060606@oracle.com> <55B070ED.2040200@suse.com> <1437660433.5036.96.camel@citrix.com> <55B21364.5040906@suse.com> <1437749076.4682.47.camel@citrix.com> <55B25650.4030402@suse.com> <1437753959.4682.84.camel@citrix.com> <20150728100549.GE5111@zion.uk.xensource.com> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5480448088802887390==" Return-path: Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1ZK6e9-0008LC-MJ for xen-devel@lists.xenproject.org; Tue, 28 Jul 2015 15:18:25 +0000 In-Reply-To: <20150728100549.GE5111@zion.uk.xensource.com> List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xen.org Errors-To: xen-devel-bounces@lists.xen.org To: Wei Liu Cc: Juergen Gross , Elena Ufimtseva , Andrew Cooper , David Vrabel , Jan Beulich , "xen-devel@lists.xenproject.org" , Boris Ostrovsky List-Id: xen-devel@lists.xenproject.org --===============5480448088802887390== Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="=-OVexvW9KvjJl00as4CnN" --=-OVexvW9KvjJl00as4CnN Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Tue, 2015-07-28 at 11:05 +0100, Wei Liu wrote: > On Fri, Jul 24, 2015 at 06:05:59PM +0200, Dario Faggioli wrote: > > BTW, I've also been grepping, and I'm not seeing XENMEM_get_vnumainfo > > being called anywhere either... Well, no wonder, we're seeing vNUMA > > setup issues! If I did check for this before, I wouldn't even have > > tested PV-vNUMA in the first place!! :-O > >=20 > > I actually wonder how _some_ of the vNUMA info get through!?!? :-O > >=20 >=20 > Maybe you're using a custom built kernel with my PV vNUMA patch in? >=20 Yep, that must be the case... I only recalled about that after sending this email (no, I don't update Dom0/guest kernel for my testbox really often! :-/) > I sent that to you once because you wanted to test that. >=20 And I confirmed it. Booting the guest with Debian's stick 4.0.0, I get this from Xen: (XEN) Memory location of each domain: (XEN) Domain 0 (total: 129914): (XEN) Node 0: 56111 (XEN) Node 1: 73803 (XEN) Domain 2 (total: 262144): (XEN) Node 0: 131072 (XEN) Node 1: 131072 (XEN) 2 vnodes, 4 vcpus, guest physical layout: (XEN) 0: pnode 0, vcpus 0-1=20 (XEN) 0000000000000000 - 0000000020000000 (XEN) 1: pnode 1, vcpus 2-3 (XEN) 0000000020000000 - 0000000040000000 But the (PV) guest does not actually know anything about vNUMA: root@test:~# numactl --hardware available: 1 nodes (0) node 0 cpus: 0 1 2 3 node 0 size: 993 MB node 0 free: 918 MB node distances: node 0=20 0: 10=20 Dario --=20 <> (Raistlin Majere) ----------------------------------------------------------------- Dario Faggioli, Ph.D, http://about.me/dario.faggioli Senior Software Engineer, Citrix Systems R&D Ltd., Cambridge (UK) --=-OVexvW9KvjJl00as4CnN Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iEYEABECAAYFAlW3nSQACgkQk4XaBE3IOsS80QCeN70oJyHkEXG4UnPm86zLHLh/ N2MAn0DiklvEC1B1T0oCZdexNRyXyu6I =U0pt -----END PGP SIGNATURE----- --=-OVexvW9KvjJl00as4CnN-- --===============5480448088802887390== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel --===============5480448088802887390==--