From: "Benoît Canet" <benoit.canet@irqsave.net>
To: Richard Davies <richard@arachsys.com>
Cc: qemu-devel@nongnu.org, kvm@vger.kernel.org
Subject: Re: Windows slow boot: contractor wanted
Date: Thu, 16 Aug 2012 16:10:53 +0200 [thread overview]
Message-ID: <20120816141052.GB2080@irqsave.net> (raw)
In-Reply-To: <20120816104727.GA17166@alpha.arachsys.com>
Le Thursday 16 Aug 2012 à 11:47:27 (+0100), Richard Davies a écrit :
> Hi,
>
> We run a cloud hosting provider using qemu-kvm 1.1, and are keen to find a
> contractor to track down and fix problems we have with large memory Windows
> guests booting very slowly - they can take several hours.
>
> We previously reported these problems in July (copied below) and they are
> still present with Linux kernel 3.5.1 and qemu-kvm 1.1.1.
>
> This is a serious issue for us which is causing significant pain to our
> larger Windows VM customers when their servers are offline for many hours
> during boot.
>
> If anyone knowledgeable in the area would be interested in being paid to
> work on this, or if you know someone who might be, I would be delighted to
> hear from you.
>
> Cheers,
>
> Richard.
>
>
> ===== Previous bug report
>
> http://marc.info/?l=qemu-devel&m=134304194329745
>
>
> We have been experiencing this problem for a while now too, using qemu-kvm
> (currently at 1.1.1).
>
> Unfortunately, hv_relaxed doesn't seem to fix it. The following command line
> produces the issue:
>
> qemu-kvm -nodefaults -m 4096 -smp 8 -cpu host,hv_relaxed -vga cirrus -usbdevice tablet -vnc :99 -monitor stdio -hda test.img
>
> The hardware consists of dual AMD Opteron 6128 processors (16 cores in
> total) and 64GB of memory. This command line was tested on kernel 3.1.4.
>
> I've also tested with -no-hpet.
>
> What I have seen is much as described: the memory fills out slowly, and top
> on the host will show the process using 100% on all allocated CPU cores. The
> most extreme case was a machine which took something between 6 and 8 hours
> to boot.
>
> This seems to be related to the assigned memory, as described, but also the
> number of processor cores (which makes sense if we believe it's a timing
> issue?). I have seen slow-booting guests improved by switching down to a
> single or even two cores.
>
> Matthew, I agree that this seems to be linked to the number of VMs running -
> in fact, shutting down other VMs on a dedicated test host caused the machine
> to start booting at a normal speed (with no reboot required).
>
> However, the level of contention is never such that this could be explained
> by the host simply being overcommitted.
>
> If it helps anyone, there's an image of the hard drive I've been using to
> test at:
>
> http://46.20.114.253/
>
> It's 5G of gzip file containing a fairly standard Windows 2008 trial
> installation. Since it's in the trial period, anyone who wants to use it may
> have to re-arm the trial: http://support.microsoft.com/kb/948472
>
> Please let me know if I can provide any more information, or test anything.
For info the image boot pretty fast with qemu-kvm 1.1.1 and a 3.2.0-29 ubuntu kernel
on a core i7 with these parameters.
Benoît
>
> Best wishes,
>
> Owen Tuz
>
WARNING: multiple messages have this Message-ID (diff)
From: "Benoît Canet" <benoit.canet@irqsave.net>
To: Richard Davies <richard@arachsys.com>
Cc: qemu-devel@nongnu.org, kvm@vger.kernel.org
Subject: Re: [Qemu-devel] Windows slow boot: contractor wanted
Date: Thu, 16 Aug 2012 16:10:53 +0200 [thread overview]
Message-ID: <20120816141052.GB2080@irqsave.net> (raw)
In-Reply-To: <20120816104727.GA17166@alpha.arachsys.com>
Le Thursday 16 Aug 2012 à 11:47:27 (+0100), Richard Davies a écrit :
> Hi,
>
> We run a cloud hosting provider using qemu-kvm 1.1, and are keen to find a
> contractor to track down and fix problems we have with large memory Windows
> guests booting very slowly - they can take several hours.
>
> We previously reported these problems in July (copied below) and they are
> still present with Linux kernel 3.5.1 and qemu-kvm 1.1.1.
>
> This is a serious issue for us which is causing significant pain to our
> larger Windows VM customers when their servers are offline for many hours
> during boot.
>
> If anyone knowledgeable in the area would be interested in being paid to
> work on this, or if you know someone who might be, I would be delighted to
> hear from you.
>
> Cheers,
>
> Richard.
>
>
> ===== Previous bug report
>
> http://marc.info/?l=qemu-devel&m=134304194329745
>
>
> We have been experiencing this problem for a while now too, using qemu-kvm
> (currently at 1.1.1).
>
> Unfortunately, hv_relaxed doesn't seem to fix it. The following command line
> produces the issue:
>
> qemu-kvm -nodefaults -m 4096 -smp 8 -cpu host,hv_relaxed -vga cirrus -usbdevice tablet -vnc :99 -monitor stdio -hda test.img
>
> The hardware consists of dual AMD Opteron 6128 processors (16 cores in
> total) and 64GB of memory. This command line was tested on kernel 3.1.4.
>
> I've also tested with -no-hpet.
>
> What I have seen is much as described: the memory fills out slowly, and top
> on the host will show the process using 100% on all allocated CPU cores. The
> most extreme case was a machine which took something between 6 and 8 hours
> to boot.
>
> This seems to be related to the assigned memory, as described, but also the
> number of processor cores (which makes sense if we believe it's a timing
> issue?). I have seen slow-booting guests improved by switching down to a
> single or even two cores.
>
> Matthew, I agree that this seems to be linked to the number of VMs running -
> in fact, shutting down other VMs on a dedicated test host caused the machine
> to start booting at a normal speed (with no reboot required).
>
> However, the level of contention is never such that this could be explained
> by the host simply being overcommitted.
>
> If it helps anyone, there's an image of the hard drive I've been using to
> test at:
>
> http://46.20.114.253/
>
> It's 5G of gzip file containing a fairly standard Windows 2008 trial
> installation. Since it's in the trial period, anyone who wants to use it may
> have to re-arm the trial: http://support.microsoft.com/kb/948472
>
> Please let me know if I can provide any more information, or test anything.
For info the image boot pretty fast with qemu-kvm 1.1.1 and a 3.2.0-29 ubuntu kernel
on a core i7 with these parameters.
Benoît
>
> Best wishes,
>
> Owen Tuz
>
next prev parent reply other threads:[~2012-08-16 14:10 UTC|newest]
Thread overview: 101+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-08-16 10:47 Windows slow boot: contractor wanted Richard Davies
2012-08-16 10:47 ` [Qemu-devel] " Richard Davies
2012-08-16 11:39 ` Avi Kivity
2012-08-16 11:39 ` [Qemu-devel] " Avi Kivity
2012-08-17 12:36 ` Richard Davies
2012-08-17 12:36 ` [Qemu-devel] " Richard Davies
2012-08-17 13:02 ` Robert Vineyard
2012-08-17 13:02 ` [Qemu-devel] " Robert Vineyard
2012-08-18 14:44 ` Richard Davies
2012-08-18 14:44 ` [Qemu-devel] " Richard Davies
2012-08-19 5:02 ` Brian Jackson
2012-08-19 5:02 ` [Qemu-devel] " Brian Jackson
2012-08-20 8:16 ` Richard Davies
2012-08-20 8:16 ` [Qemu-devel] " Richard Davies
2012-08-19 8:40 ` Avi Kivity
2012-08-19 8:40 ` [Qemu-devel] " Avi Kivity
2012-08-19 8:51 ` Richard Davies
2012-08-19 8:51 ` [Qemu-devel] " Richard Davies
2012-08-19 14:04 ` Avi Kivity
2012-08-19 14:04 ` [Qemu-devel] " Avi Kivity
2012-08-20 13:56 ` Richard Davies
2012-08-20 13:56 ` [Qemu-devel] " Richard Davies
2012-08-21 9:00 ` Avi Kivity
2012-08-21 9:00 ` [Qemu-devel] " Avi Kivity
2012-08-21 15:21 ` Richard Davies
2012-08-21 15:21 ` [Qemu-devel] " Richard Davies
2012-08-21 15:39 ` Troy Benjegerdes
2012-08-21 15:39 ` Troy Benjegerdes
2012-08-22 9:08 ` Avi Kivity
2012-08-22 9:08 ` [Qemu-devel] " Avi Kivity
2012-08-22 12:40 ` Richard Davies
2012-08-22 12:40 ` [Qemu-devel] " Richard Davies
2012-08-22 12:44 ` Avi Kivity
2012-08-22 12:44 ` [Qemu-devel] " Avi Kivity
2012-08-22 14:41 ` Richard Davies
2012-08-22 14:41 ` [Qemu-devel] " Richard Davies
2012-08-22 14:53 ` Avi Kivity
2012-08-22 14:53 ` [Qemu-devel] " Avi Kivity
2012-08-22 15:26 ` Richard Davies
2012-08-22 15:26 ` [Qemu-devel] " Richard Davies
2012-08-22 17:22 ` Troy Benjegerdes
2012-08-22 17:22 ` Troy Benjegerdes
2012-08-25 17:51 ` Richard Davies
2012-08-25 17:51 ` Richard Davies
2012-08-22 15:21 ` Rik van Riel
2012-08-22 15:21 ` [Qemu-devel] " Rik van Riel
2012-08-22 15:34 ` Richard Davies
2012-08-22 15:34 ` [Qemu-devel] " Richard Davies
2012-08-25 17:45 ` Richard Davies
2012-08-25 17:45 ` [Qemu-devel] " Richard Davies
2012-08-25 18:11 ` Rik van Riel
2012-08-25 18:11 ` [Qemu-devel] " Rik van Riel
2012-08-26 10:58 ` Richard Davies
2012-08-26 10:58 ` [Qemu-devel] " Richard Davies
2012-09-06 9:20 ` Richard Davies
2012-09-06 9:20 ` [Qemu-devel] " Richard Davies
2012-09-12 10:56 ` Windows VM slow boot Richard Davies
2012-09-12 10:56 ` [Qemu-devel] " Richard Davies
2012-09-12 10:56 ` Richard Davies
2012-09-12 12:25 ` Mel Gorman
2012-09-12 12:25 ` [Qemu-devel] " Mel Gorman
2012-09-12 12:25 ` Mel Gorman
2012-09-12 16:46 ` Richard Davies
2012-09-12 16:46 ` [Qemu-devel] " Richard Davies
2012-09-12 16:46 ` Richard Davies
2012-09-13 9:50 ` Mel Gorman
2012-09-13 9:50 ` [Qemu-devel] " Mel Gorman
2012-09-13 9:50 ` Mel Gorman
2012-09-13 19:47 ` [PATCH 1/2] Revert "mm: have order > 0 compaction start near a pageblock with free pages" Rik van Riel
2012-09-13 19:47 ` [Qemu-devel] " Rik van Riel
2012-09-13 19:47 ` Rik van Riel
2012-09-13 19:48 ` [PATCH 2/2] make the compaction "skip ahead" logic robust Rik van Riel
2012-09-13 19:48 ` [Qemu-devel] " Rik van Riel
2012-09-13 19:48 ` Rik van Riel
2012-09-13 19:54 ` [PATCH -v2 " Rik van Riel
2012-09-13 19:54 ` [Qemu-devel] " Rik van Riel
2012-09-13 19:54 ` Rik van Riel
2012-09-15 15:55 ` Richard Davies
2012-09-15 15:55 ` [Qemu-devel] " Richard Davies
2012-09-15 15:55 ` Richard Davies
2012-09-16 19:12 ` Richard Davies
2012-09-16 19:12 ` [Qemu-devel] " Richard Davies
2012-09-17 12:26 ` Mel Gorman
2012-09-17 12:26 ` [Qemu-devel] " Mel Gorman
2012-09-18 8:14 ` Richard Davies
2012-09-18 8:14 ` [Qemu-devel] " Richard Davies
2012-09-18 11:21 ` Mel Gorman
2012-09-18 11:21 ` [Qemu-devel] " Mel Gorman
2012-09-18 11:21 ` Mel Gorman
2012-09-18 17:58 ` Richard Davies
2012-09-18 17:58 ` [Qemu-devel] " Richard Davies
2012-09-17 13:50 ` Rik van Riel
2012-09-17 13:50 ` [Qemu-devel] " Rik van Riel
2012-09-17 14:07 ` Mel Gorman
2012-09-17 14:07 ` [Qemu-devel] " Mel Gorman
2012-09-17 14:07 ` Mel Gorman
2012-08-16 14:10 ` Benoît Canet [this message]
2012-08-16 14:10 ` [Qemu-devel] Windows slow boot: contractor wanted Benoît Canet
2012-08-16 15:53 ` Troy Benjegerdes
2012-09-18 15:12 ` Windows slow boot Michael Tokarev
2012-09-18 15:12 ` [Qemu-devel] " Michael Tokarev
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20120816141052.GB2080@irqsave.net \
--to=benoit.canet@irqsave.net \
--cc=kvm@vger.kernel.org \
--cc=qemu-devel@nongnu.org \
--cc=richard@arachsys.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.