All of lore.kernel.org
 help / color / mirror / Atom feed
From: Eric Blake <eblake@redhat.com>
To: Alfred Bratterud <Alfred.Bratterud@hioa.no>
Cc: "libvirt-users@redhat.com" <libvirt-users@redhat.com>,
	"kvm@vger.kernel.org" <kvm@vger.kernel.org>
Subject: Re: [libvirt-users] Kernel unresponsive after booting 700+ vm's on a single host
Date: Mon, 10 Sep 2012 11:42:15 -0600	[thread overview]
Message-ID: <504E2677.9070006@redhat.com> (raw)
In-Reply-To: <827B80946D30E94D88703E3075B6FE7E13E5615D@ExMbx-02.ada.hioa.no>

[-- Attachment #1: Type: text/plain, Size: 869 bytes --]

On 09/10/2012 07:51 AM, Alfred Bratterud wrote:
> For a research project we are trying to boot a very large amount of tiny, custom built VM's on KVM/ubuntu. The maximum VM-count achieved was 1000, but with substantial slowness, and eventually kernel failure, while the cpu/memory loads were nowhere near limits. Where is the likely bottleneck? Any solutions, workarounds, hacks or dirty tricks?

Are you using cgroups?  There have been some known bottlenecks in the
kernel cgroup code, where it scales very miserably; and since libvirt
uses a different cgroup per VM by default when cgroups are enabled, that
might explain part of the problem.

Other than that, if you can profile the slowdowns, I'm sure people would
be interested in the results.

-- 
Eric Blake   eblake@redhat.com    +1-919-301-3266
Libvirt virtualization library http://libvirt.org


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 617 bytes --]

      reply	other threads:[~2012-09-10 17:42 UTC|newest]

Thread overview: 2+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2012-09-10 13:51 Kernel unresponsive after booting 700+ vm's on a single host Alfred Bratterud
2012-09-10 17:42 ` Eric Blake [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=504E2677.9070006@redhat.com \
    --to=eblake@redhat.com \
    --cc=Alfred.Bratterud@hioa.no \
    --cc=kvm@vger.kernel.org \
    --cc=libvirt-users@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.