Unabe to create guest domain on PAE enabled SLES 9 SP2 box, 4GB RAM

[David F Barrera <dfbp@us.ibm.com>]

(XEN) System RAM: 4095MB (4193828kB)
(XEN) Xen heap: 10MB (10496kB)
(XEN) PAE enabled, limit: 16 GB



x335b:~ # xm list
Name              Id  Mem(MB)  CPU VCPU(s)  State  Time(s)
Domain-0           0      495    0      1   r----     34.1
x335b:~ #

x335b:/tmp/xen # xm create -c vm1.cfg
Using config file "vm1.cfg".
Error: Error creating domain: (0, 'Error')

x335b:/tmp/xen # xm list
Unexpected error: xen.xend.XendProtocol.XendError

Please report to xen-devel@lists.xensource.com
Traceback (most recent call last):
  File "/usr/sbin/xm", line 10, in ?
    main.main(sys.argv)
  File "/tmp/xen-
unstable.hg/dist/install/usr/lib/python/xen/xm/main.py", line 710, in
main
    rc = cmd(args)
  File "/tmp/xen-
unstable.hg/dist/install/usr/lib/python/xen/xm/main.py", line 226, in
xm_list
    doms = server.xend_domains()
  File "/tmp/xen-
unstable.hg/dist/install/usr/lib/python/xen/xend/XendClient.py", line
199, in xend_domains
    return self.xendGet(self.domainurl())
  File "/tmp/xen-
unstable.hg/dist/install/usr/lib/python/xen/xend/XendClient.py", line
152, in xendGet
    return self.client.xendGet(url, args)
  File "/tmp/xen-
unstable.hg/dist/install/usr/lib/python/xen/xend/XendProtocol.py", line
86, in xendGet
    return self.xendRequest(url, "GET", args)
  File "/tmp/xen-
unstable.hg/dist/install/usr/lib/python/xen/xend/XendProtocol.py", line
170, in xendRequest
    val = self.handleStatus(resp.version, resp.status, resp.reason)
  File "/tmp/xen-
unstable.hg/dist/install/usr/lib/python/xen/xend/XendProtocol.py", line
106, in handleStatus
    return self.handleException(XendError(message))
  File "/tmp/xen-
unstable.hg/dist/install/usr/lib/python/xen/xend/XendProtocol.py", line
132, in handleException
    raise err
xen.xend.XendProtocol.XendError: Internal server error


-------------------------------------------------------

Guest domain config file:
x335b:/tmp/xen # cat vm1.cfg
# Kernel image file.
kernel = "/boot/vmlinuz-2.6-xenU"
# Optional ramdisk.
# ramdisk = "/boot/initrd-2.6.11-xenU"
# The domain build function. Default is 'linux'.
builder='linux'
# Initial memory allocation (in megabytes) for the new domain.
memory = 512
# A name for your domain. All domains must have different names.
name = "vm1"
vcpus = 4
disk = [ 'phy:sdb5,0815,w','phy:sdb6,0816,w' ]
# Set if you want dhcp to allocate the IP address.
# vif = [ 'mac= AA:00:00:47:CB:34, bridge=xen-br0' ]
# Set if you want dhcp to allocate the IP address.
#dhcp="dhcp"
# Set netmask.
#netmask = '255.255.255.0'
# Set default gateway.
# gateway = '9.53.94.0'
# Set the hostname.
# hostname= "vm%d" % vmid


# Set root device.
root = "/dev/sdb6 ro"
# Sets runlevel 4.
# extra = "4"
#============================================================================
x335b:/tmp/xen #


----------

xm dmesg before attempting to create guest domain:

x335b:/tmp/xen # xm dmesg
 __  __            _____  ___         _                _
 \ \/ /___ _ __   |___ / / _ \     __| | _____   _____| |
  \  // _ \ '_ \    |_ \| | | |__ / _` |/ _ \ \ / / _ \ |
  /  \  __/ | | |  ___) | |_| |__| (_| |  __/\ V /  __/ |
 /_/\_\___|_| |_| |____(_)___/    \__,_|\___| \_/ \___|_|

 http://www.cl.cam.ac.uk/netos/xen
 University of Cambridge Computer Laboratory

 Xen version 3.0-devel (root@ltc.austin.ibm.com) (gcc version 3.3.3
(SuSE Linux)) Wed Sep 14 09:48:01 CDT 2005
 Latest ChangeSet: Wed Sep 14 08:37:50 2005
5959fae4722aa8f4638876deb05cbd7f5ae3b590

(XEN) Physical RAM map:
(XEN)  0000000000000000 - 000000000009d400 (usable)
(XEN)  000000000009d400 - 00000000000a0000 (reserved)
(XEN)  00000000000e0000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 00000000f7fec140 (usable)
(XEN)  00000000f7fec140 - 00000000f7ff0000 (ACPI data)
(XEN)  00000000f7ff0000 - 00000000f8000000 (reserved)
(XEN)  00000000fec00000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 0000000108000000 (usable)
(XEN) System RAM: 4095MB (4193828kB)
(XEN) Xen heap: 10MB (10496kB)
(XEN) PAE enabled, limit: 16 GB
(XEN) found SMP MP-table at 0009d540
(XEN) DMI 2.3 present.
(XEN) Using APIC driver default
(XEN) ACPI: RSDP (v000 IBM                                   ) @
0x000fdfc0
(XEN) ACPI: RSDT (v001 IBM    SERONYXP 0x00001000 IBM  0x45444f43) @
0xf7feff80
(XEN) ACPI: FADT (v001 IBM    SERONYXP 0x00001000 IBM  0x45444f43) @
0xf7feff00
(XEN) ACPI: MADT (v001 IBM    SERONYXP 0x00001000 IBM  0x45444f43) @
0xf7fefe40
(XEN) ACPI: ASF! (v016 IBM    SERONYXP 0x00000001 IBM  0x45444f43) @
0xf7fefd80
(XEN) ACPI: DSDT (v001 IBM    SERTURQU 0x00001000 MSFT 0x0100000b) @
0x00000000
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
(XEN) Processor #0 15:2 APIC version 20
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x06] enabled)
(XEN) Processor #6 15:2 APIC version 20
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled)
(XEN) Processor #1 15:2 APIC version 20
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x07] enabled)
(XEN) Processor #7 15:2 APIC version 20
(XEN) ACPI: LAPIC_NMI (acpi_id[0x00] dfl dfl lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x06] dfl dfl lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x01] dfl dfl lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x07] dfl dfl lint[0x1])
(XEN) ACPI: IOAPIC (id[0x0e] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 14, version 17, address 0xfec00000, GSI 0-15
(XEN) ACPI: IOAPIC (id[0x0d] address[0xfec01000] gsi_base[16])
(XEN) IOAPIC[1]: apic_id 13, version 17, address 0xfec01000, GSI 16-31
(XEN) ACPI: IOAPIC (id[0x0c] address[0xfec02000] gsi_base[32])
(XEN) IOAPIC[2]: apic_id 12, version 17, address 0xfec02000, GSI 32-47
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) Enabling APIC mode:  Flat.  Using 3 I/O APICs
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) Initializing CPU#0
(XEN) Detected 3189.456 MHz processor.
(XEN) Using scheduler: Simple EDF Scheduler (sedf)
(XEN) CPU: Trace cache: 12K uops, L1 D cache: 8K
(XEN) CPU: L2 cache: 512K
(XEN) CPU: L3 cache: 1024K
(XEN) CPU: Physical Processor ID: 0
(XEN) CPU0: Intel(R) Xeon(TM) CPU 3.20GHz stepping 05
(XEN) Booting processor 1/1 eip 90000
(XEN) Initializing CPU#1
(XEN) CPU: Trace cache: 12K uops, L1 D cache: 8K
(XEN) CPU: L2 cache: 512K
(XEN) CPU: L3 cache: 1024K
(XEN) CPU: Physical Processor ID: 0
(XEN) CPU1: Intel(R) Xeon(TM) CPU 3.20GHz stepping 05
(XEN) Booting processor 2/6 eip 90000
(XEN) Initializing CPU#2
(XEN) CPU: Trace cache: 12K uops, L1 D cache: 8K
(XEN) CPU: L2 cache: 512K
(XEN) CPU: L3 cache: 1024K
(XEN) CPU: Physical Processor ID: 3
(XEN) CPU2: Intel(R) Xeon(TM) CPU 3.20GHz stepping 05
(XEN) Booting processor 3/7 eip 90000
(XEN) Initializing CPU#3
(XEN) CPU: Trace cache: 12K uops, L1 D cache: 8K
(XEN) CPU: L2 cache: 512K
(XEN) CPU: L3 cache: 1024K
(XEN) CPU: Physical Processor ID: 3
(XEN) CPU3: Intel(R) Xeon(TM) CPU 3.20GHz stepping 05
(XEN) Total of 4 processors activated.
(XEN) ENABLING IO-APIC IRQs
(XEN) ..TIMER: vector=0x31 pin1=2 pin2=-1
(XEN) checking TSC synchronization across 4 CPUs: passed.
(XEN) Platform timer is 1.193MHz PIT
(XEN) Brought up 4 CPUs
(XEN) mtrr: v2.0 (20020519)
(XEN) *** LOADING DOMAIN 0 ***
(XEN) Xen-ELF header found:
'GUEST_OS=linux,GUEST_VER=2.6,XEN_VER=3.0,VIRT_BASE=0xC0000000,PAE=yes,LOADER=generic'
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   0000000003800000->0000000004000000 (125952 pages
to be allocated)
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: c0100000->c0639f24
(XEN)  Init. ramdisk: c063a000->c063a000
(XEN)  Phys-Mach map: c063a000->c06b7000
(XEN)  Start info:    c06b7000->c06b8000
(XEN)  Page tables:   c06b8000->c06c1000
(XEN)  Boot stack:    c06c1000->c06c2000
(XEN)  TOTAL:         c0000000->c0800000
(XEN)  ENTRY ADDRESS: c0100000
(XEN) Scrubbing Free
RAM: ...........................................done.
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch
input to Xen).
(XEN) microcode: CPU1 updated from revision 0x11 to 0x29, date =
08112004
(XEN) microcode: CPU2 updated from revision 0x11 to 0x29, date =
08112004
(XEN) microcode: CPU3 updated from revision 0x11 to 0x29, date =
08112004
(XEN) microcode: CPU0 updated from revision 0x11 to 0x29, date =
08112004
(XEN) mtrr: type mismatch for fd000000,800000 old: write-back new:
write-combining
(XEN) mtrr: type mismatch for fd000000,800000 old: write-back new:
write-combining

-------------------
xm dmesg lines after attempt at creating guest domain:

(XEN) (file=page_alloc.c, line=558) Over-allocation for domain 1: 131073
> 131072
(XEN) (file=page_alloc.c, line=560) ...or the domain is dying (0)
(XEN) (file=memory.c, line=57) Could not allocate order=0 extent: id=1
flags=0 (0 of 1)

-- 
Regards,

David F Barrera
Linux Technology Center
Systems and Technology Group, IBM

"The wisest men follow their own direction. "
                                                        Euripides