From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754527AbbIOOci (ORCPT ); Tue, 15 Sep 2015 10:32:38 -0400 Received: from smtp.citrix.com ([66.165.176.89]:20368 "EHLO SMTP.CITRIX.COM" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1753485AbbIOOcg (ORCPT ); Tue, 15 Sep 2015 10:32:36 -0400 X-IronPort-AV: E=Sophos;i="5.17,536,1437436800"; d="asc'?scan'208";a="300139939" Message-ID: <1442327533.13162.11.camel@citrix.com> Subject: Re: [Xen-devel] [PATCH RFC] xen: if on Xen, "flatten" the scheduling domain hierarchy From: Dario Faggioli To: George Dunlap CC: "xen-devel@lists.xenproject.org" , "Juergen Gross" , Andrew Cooper , "Luis R. Rodriguez" , linux-kernel , David Vrabel , "Boris Ostrovsky" , Stefano Stabellini Date: Tue, 15 Sep 2015 16:32:13 +0200 In-Reply-To: <55DEE556.3010802@citrix.com> References: <1439913332.4239.134.camel@citrix.com> <55DEE556.3010802@citrix.com> Organization: Citrix Inc. Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="=-VAcuBhG6a5qvbfrIqxPp" X-Mailer: Evolution 3.12.11 (3.12.11-1.fc21) MIME-Version: 1.0 X-DLP: MIA2 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org --=-VAcuBhG6a5qvbfrIqxPp Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Thu, 2015-08-27 at 11:24 +0100, George Dunlap wrote: > On 08/18/2015 04:55 PM, Dario Faggioli wrote: > > *** Intel(R) Xeon(R) X5650 @ 2.67GHz > > *** pCPUs 48 DOM0 vCPUS 16 > > *** RAM 393138 MB DOM0 Memory 9955 MB > > *** NUMA nodes 2 > > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > > MAKE XEN (lower =3D=3D better) > > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > > # of build jobs -j1 -j20 = -j24 -j48** -j62 > > vanilla/patched vanilla patched vanilla patched = vanilla patched vanilla patched vanilla patched > > -----------------------------------------------------------------------= ---------------------------------------------------------------- > > 267.78 233.25 36.53 35.53 = 35.98 34.99 33.46 32.13 33.57 32.54 > > 268.42 233.92 36.82 35.56 = 36.12 35.2 34.24 32.24 33.64 32.56 > > 268.85 234.39 36.92 35.75 = 36.15 35.35 34.48 32.86 33.67 32.74 > > 268.98 235.11 36.96 36.01 = 36.25 35.46 34.73 32.89 33.97 32.83 > > 269.03 236.48 37.04 36.16 = 36.45 35.63 34.77 32.97 34.12 33.01 > > 269.54 237.05 40.33 36.59 = 36.57 36.15 34.97 33.09 34.18 33.52 > > 269.99 238.24 40.45 36.78 = 36.58 36.22 34.99 33.69 34.28 33.63 > > 270.11 238.48 41.13 39.98 = 40.22 36.24 38 33.92 34.35 33.87 > > 270.96 239.07 41.66 40.81 = 40.59 36.35 38.99 34.19 34.49 37.24 > > 271.84 240.89 42.07 41.24 = 40.63 40.06 39.07 36.04 34.69 37.59 > > -----------------------------------------------------------------------= ---------------------------------------------------------------- > > Avg. 269.55 236.688 38.991 37.441 = 37.554 36.165 35.77 33.402 34.096 33.953 > > -----------------------------------------------------------------------= ---------------------------------------------------------------- > > Std. Dev. 1.213 2.503 2.312 2.288 = 2.031 1.452 2.079 1.142 0.379 1.882 > > -----------------------------------------------------------------------= ---------------------------------------------------------------- > > % improvement 12.191 3.975 = 3.699 6.620 0.419 > > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >=20 > I'm a bit confused here as to why, if dom0 has 16 vcpus in all of your > tests, you change the -j number (apparently) based on the number of > pcpus available to Xen. Wouldn't it make more sense to stick with > 1/6/8/16/24? That would allow us to have actually comparable numbers. >=20 Bah, no, sorry, that was a mistake I made when I cut-&-past'ed the tables in the email... Dom0 always have as much vCPUs as the host has pCPUs. I know this is a rather critical piece of information, so sorry for messing it up! :-/ > But in any case, it seems to me that the numbers do show a uniform > improvement and no regressions -- I think this approach looks really > good, particularly as it is so small and well-contained. >=20 Yeah, that seems the case... But I really would like to try more configurations and more workloads. I'll do that ASAP. Thanks and Regards, Dario --=20 <> (Raistlin Majere) ----------------------------------------------------------------- Dario Faggioli, Ph.D, http://about.me/dario.faggioli Senior Software Engineer, Citrix Systems R&D Ltd., Cambridge (UK) --=-VAcuBhG6a5qvbfrIqxPp Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iEYEABECAAYFAlX4K/QACgkQk4XaBE3IOsT6CACeKGMFu1dDH8lM5g44FukEJXIN QW4AnR60cc7EpfuU3girBjHcjyAigV8l =1zK0 -----END PGP SIGNATURE----- --=-VAcuBhG6a5qvbfrIqxPp--