From mboxrd@z Thu Jan  1 00:00:00 1970
From: Tim Post <echo@echoreply.us>
Subject: Re: increasing the number of guests (NR_DYNIRQS)
Date: Sat, 20 Feb 2010 19:54:41 +0800
Message-ID: <1266666881.6555.48.camel@tpost-desktop>
References: <m3pr40tbyd.fsf@luke.xen.prgmr.com>
Reply-To: echo@echoreply.us
Mime-Version: 1.0
Content-Type: text/plain
Content-Transfer-Encoding: 7bit
Return-path: <xen-devel-bounces@lists.xensource.com>
In-Reply-To: <m3pr40tbyd.fsf@luke.xen.prgmr.com>
List-Unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>,
	<mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
List-Post: <mailto:xen-devel@lists.xensource.com>
List-Help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-Subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>,
	<mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
Sender: xen-devel-bounces@lists.xensource.com
Errors-To: xen-devel-bounces@lists.xensource.com
To: Luke S Crawford <lsc@prgmr.com>
Cc: xen-devel@lists.xensource.com
List-Id: xen-devel@lists.xenproject.org

On Sat, 2010-02-20 at 05:53 -0500, Luke S Crawford wrote:
> So I'm setting up a server to host many very small domains, and I ran
> into a problem where after I create about 60 guests, any addtional guests
> start, but hang at 0 cpu usage-  they never do anything.  
> 
> grep Dynamic-irq /proc/interrupts | wc -l
> 256
> 
> 
> I did some digging and found some old discussion of the topic[1]
> and but the patches discussed there didn't work, I assume because the
> linux/xen codebase has evolved since then.  I dug around and made this 
> change:
> 
> xen-3.4-testing.hg/linux-2.6.18-xen.hg/include/asm-x86_64/mach-xen/irq_vectors.h
> 
> I changed:
> 
> #define NR_DYNIRQS           1024
> 
> (it defaults to 256)

I've done the same thing several times without breaking anything. What I
could not see is how much more expensive 1024 is than 256. Like you, I
had hosts with guests way north of 200 that did very little, so ...

Cheers,
--Tim