From mboxrd@z Thu Jan 1 00:00:00 1970 From: Andrew Theurer Subject: Re: Benchmarking Xen (results and questions) Date: Wed, 03 Aug 2005 20:43:23 -0500 Message-ID: <42F172BB.4040201@us.ibm.com> References: <9588F47251E5BE4A80A34030C4A34314060C37@ausx3mpc107.aus.amer.dell.com> Mime-Version: 1.0 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: quoted-printable Return-path: In-Reply-To: <9588F47251E5BE4A80A34030C4A34314060C37@ausx3mpc107.aus.amer.dell.com> List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xensource.com Errors-To: xen-devel-bounces@lists.xensource.com To: David_Wolinsky@Dell.com Cc: xen-devel@lists.xensource.com List-Id: xen-devel@lists.xenproject.org David_Wolinsky@Dell.com wrote: > Hi all, > > Here are some benchmarks that I've done using Xen. > > However, before I get started, let me explain some of configuration=20 > details=85 > > Xen Version SPECjbb > WebBench > Linux Distribution Debian 3.1 > HT disabled > Linux Kernel 2.6.12.2 > Host Patch CK3s > > Here are the initial benchmarks > > SPECJBB WebBench > 1 Thread 1 Client 2 Clients 4 Clients 8 Clients > BOPS TPS TPS TPS TPS > Host 32403.5 213.45 416.86 814.62 1523.78 > 1 VM 32057 205.4 380.91 569.24 733.8 > 2 VM 24909.25 NA 399.29 695.1 896.04 > 4 VM 17815.75 NA NA 742.78 950.63 > 8 VM 10216.25 NA NA NA 1002.81 > > (and some more notes=85. BOPS - business operations per second, TPS -=20 > transactions per second=85 > SPECjbb tests CPU and Memory > WebBench (the way we configured it) tests Network I/O and Disk I/O > > Values =3D AVG * VM count > Domain configurations > 1 VM - 1660 MB - SPECJBB 1500MB > 2 VM - 1280 MB - SPECJBB - 1024MB > 4 VM - 640 MB - SPECJBB - 512 MB > 8 VM - 320 MB - SPECJBB - 256 MB > > Seeing how the SPECjbb numbers declined so bizarrely, I did some=20 > scheduling tests and found this out=85 > > Test1: Examine Xen's scheduling to determine if context switching is=20 > causing the overhead > Period Slice BOPs > Modified 8 VM 1 ms 125 us 6858 > 8 VM 10 ms 1.25 ms 14287 > 8 VM 100 ms 12.5 ms 18912 > 8 VM 1 Sec .125 Sec 20695 > 8 VM 2 Sec .25 Sec 21072 > 8 VM 10 Sec 1.25 Sec 21797 > 8 VM 100 Sec 12.5 Sec 11402 > Did you run each JBB test config several times to ensure consistent=20 results? What JVM is this? Would it be possible to format these more appropriately for email? I am=20 having a little trouble reading this :) Thanks, -Andrew