From mboxrd@z Thu Jan 1 00:00:00 1970 From: Pasi =?iso-8859-1?Q?K=E4rkk=E4inen?= Subject: Re: Xen Hypervisor start fail when system memory more than 64GB, and free xen memory over 32 GB Date: Mon, 16 Aug 2010 13:15:22 +0300 Message-ID: <20100816101522.GC2804@reaktio.net> References: <20100812113642.GO2804@reaktio.net> <20100816095555.GB2804@reaktio.net> Mime-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable Return-path: Content-Disposition: inline In-Reply-To: <20100816095555.GB2804@reaktio.net> List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xensource.com Errors-To: xen-devel-bounces@lists.xensource.com To: benian Cc: xen-devel@lists.xensource.com List-Id: xen-devel@lists.xenproject.org On Mon, Aug 16, 2010 at 12:55:55PM +0300, Pasi K=E4rkk=E4inen wrote: > On Mon, Aug 16, 2010 at 05:46:24PM +0800, benian wrote: > > Hi Pasi > > I finally boot up successfully by simply modified the kernel conf= ig > > item CONFIG_XEN_MAX_DOMAIN_MEMORY=3D32 to CONFIG_XEN_MAX_DOMAIN_M= EMORY=3D128 > > (just choose a random value >72 ), > > then rebuild the kernel-2.6.32 , and everything is ok. > > By the way, i 've done many test and i finally found that > > if unallocated memory(total - dom0 ) >32GB, boot up would be faile= d in my > > environment. > > for example, after I modified the kernel config, hypervisor boot n= ormally > > and dom0 get 72GB. > > If i add dom0_mem=3D 32G(unallocated 40G) to grub option, hypervis= or boot > > fail again, > > and if dom0_mem=3D 41G(unallocated 31G), hypervisor boot normally = again. > > So , might it be a problem of xen-4.0 that unable to handle unallo= cated > > memory >32GB? > > >=20 > Sounds like a bug yeah.. How does it fail in the dom0_mem=3D32G case? W= hat's the error?=20 >=20 > Can you please paste the full bootlog of the failing boot from a serial= console?=20 > http://wiki.xensource.com/xenwiki/XenSerialConsole >=20 Oh, one more thing, could you also try with Xen 4.0.1-rc6?=20 Thanks! -- Pasi >=20 >=20 > > Regards, > > Ben > > 2010/8/12 Pasi K=E4rkk=E4inen <[1]pasik@iki.fi> > >=20 > > On Thu, Aug 12, 2010 at 03:08:25PM +0800, benian wrote: > > > > > > > > > My environment is xen-4.0.0 + pvops2.6.32 kernel + fedora12 > > > > > > I can run xen hypervisor smoothly when system memory below = 64G > > > > > > But if I plug 4GB more memory to my server, XEN hypervisor = start > > fail then > > > crash and restart automatically. > > > > > > The final screen is some message about memory address which= will > > not be > > > displayed in normal process > > > > > > > > > > > > I read from XEN 4.0.0 features that Xen support 1 TB of RAM= per > > host, so I > > > am not sure what *s wrong with this situation. > > > > > > > > > > > > Any idea is appreciated and welcome > > > > > > > >=20 > > How much memory does your dom0 have? ie. what's your dom0_mem=3D= option > > for xen.gz in grub.conf. > > Have you tried different values? ie. 2GB, 4GB, 8GB? > >=20 > > Also setup a serial console so you can figure out if it's the Xe= n > > hypervisor or dom0 kernel crashing: > > [2]http://wiki.xensource.com/xenwiki/XenSerialConsole > >=20 > > and more info about troubleshooting pvops dom0 kernels (also an = example > > about serial console with pvops dom0): > > [3]http://wiki.xensource.com/xenwiki/XenParavirtOps > >=20 > > Those should help. > > -- Pasi > >=20 > > References > >=20 > > Visible links > > 1. mailto:pasik@iki.fi > > 2. http://wiki.xensource.com/xenwiki/XenSerialConsole > > 3. http://wiki.xensource.com/xenwiki/XenParavirtOps >=20 > _______________________________________________ > Xen-devel mailing list > Xen-devel@lists.xensource.com > http://lists.xensource.com/xen-devel