xen-4.3 port to illumos based platform

xen-4.3 port to illumos based platform

[Igor Kozhukhov]

Hi All,

i try to load PV guest by:

virt-install --debug --paravirt --name cos6x64 --ram 800 --network bridge  --disk path=/dev/zvol/dsk/rpool/xen/cos01,driver=phy --location http://merlin.fit.vutbr.cz/mirrors/centos/6.5/os/x86_64/ --nographics

could you please help me try to debug issues with PV creation:

POST operation failed: xend_post: error from xen daemon: (xend.err "Error creating domain: (1, 'Internal error', 'panic: xc_dom_boot.c:197: xc_dom_boot_domU_map: failed to mmap domU pages 0x1000+0x1040 [mmap, errno=6 (No such device or address)]')")

i want try to find what i have to check/update: Xen sources OR illumos sources.

--
Best regards,
Igor Kozhukhov

Re: xen-4.3 port to illumos based platform

[Ian Campbell]

On Fri, 2014-01-31 at 20:48 +0400, Igor Kozhukhov wrote:
> Hi All,
> 
> i try to load PV guest by:
> 
> virt-install --debug --paravirt --name cos6x64 --ram 800 --network bridge  --disk path=/dev/zvol/dsk/rpool/xen/cos01,driver=phy --location http://merlin.fit.vutbr.cz/mirrors/centos/6.5/os/x86_64/ --nographics
> 
> could you please help me try to debug issues with PV creation:
> 
> POST operation failed: xend_post: error from xen daemon: (xend.err
> "Error creating domain: (1, 'Internal error', 'panic:
> xc_dom_boot.c:197: xc_dom_boot_domU_map: failed to mmap domU pages
> 0x1000+0x1040 [mmap, errno=6 (No such device or address)]')")
> 
> i want try to find what i have to check/update: Xen sources OR illumos sources.

The error message comes from xc_dom_boot.c which is part of Xen. A call
to xc_map_foreign_ranges has failed. This is abstracted out for
different platforms via the xenctrlosdep.h interface.

Are you using xc_solaris.c or have you created a new xc_illumos.c? It is
a pretty good bet that xc_solaris has bitrotten over the years. In
either case my gut feeling is that the issue is either in that code or
on the kernel side in the "privcmd" driver which it calls into.

BTW -- I'd strongly recommend that you switch to using the "xl"
toolstack -- xend is obsolete and deprecated so using it for a new port
is not recommended, it will obscure some of the error messages etc.

For the initial debugging phases I would also suggest to avoid higher
level tools such as libvirt (again because they can obscure some of the
lower level debugging) and to use the "xl create" interface directly. A
simple config file would be something like:
	name = "test"
	kernel = "/path/to/vmlinuz"
	extra = "console=hvc"
Where:
        wget -O /path/to/vmlinuz http://merlin.fit.vutbr.cz/mirrors/centos/6.5/os/x86_64/isolinux/vmlinuz
is the kernel to use.

Launch with 
	xl -vvv create /path/to/cfg
and you'll get plenty of debug output.

Ian.

Re: xen-4.3 port to illumos based platform

[Igor Kozhukhov]

Hi Ian,

On Feb 3, 2014, at 2:08 PM, Ian Campbell wrote:

> On Fri, 2014-01-31 at 20:48 +0400, Igor Kozhukhov wrote:
>> Hi All,
>> 
>> i try to load PV guest by:
>> 
>> virt-install --debug --paravirt --name cos6x64 --ram 800 --network bridge  --disk path=/dev/zvol/dsk/rpool/xen/cos01,driver=phy --location http://merlin.fit.vutbr.cz/mirrors/centos/6.5/os/x86_64/ --nographics
>> 
>> could you please help me try to debug issues with PV creation:
>> 
>> POST operation failed: xend_post: error from xen daemon: (xend.err
>> "Error creating domain: (1, 'Internal error', 'panic:
>> xc_dom_boot.c:197: xc_dom_boot_domU_map: failed to mmap domU pages
>> 0x1000+0x1040 [mmap, errno=6 (No such device or address)]')")
>> 
>> i want try to find what i have to check/update: Xen sources OR illumos sources.
> 
> The error message comes from xc_dom_boot.c which is part of Xen. A call
> to xc_map_foreign_ranges has failed. This is abstracted out for
> different platforms via the xenctrlosdep.h interface.
> 
> Are you using xc_solaris.c or have you created a new xc_illumos.c? It is
> a pretty good bet that xc_solaris has bitrotten over the years. In
> either case my gut feeling is that the issue is either in that code or
> on the kernel side in the "privcmd" driver which it calls into.

i'm using xc_solaris.c - because illumos based on solaris and has open API.
for now - i have found and fixed my problems: i'm able to load PV guests: dilos PV on dilos-xen-4.3-dom0, Linux ContOS 6.4 and Debian 7.0 64bits.
I'll send info later with new ISO and instruction for testing.
'xl' now work well.
i'll work on provide my changes to Xen upstream.

> BTW -- I'd strongly recommend that you switch to using the "xl"
> toolstack -- xend is obsolete and deprecated so using it for a new port
> is not recommended, it will obscure some of the error messages etc.
> 
> For the initial debugging phases I would also suggest to avoid higher
> level tools such as libvirt (again because they can obscure some of the
> lower level debugging) and to use the "xl create" interface directly. A
> simple config file would be something like:
> 	name = "test"
> 	kernel = "/path/to/vmlinuz"
> 	extra = "console=hvc"
> Where:
>        wget -O /path/to/vmlinuz http://merlin.fit.vutbr.cz/mirrors/centos/6.5/os/x86_64/isolinux/vmlinuz
> is the kernel to use.
> 
> Launch with 
> 	xl -vvv create /path/to/cfg
> and you'll get plenty of debug output.
> 
> Ian.
> 

Re: xen-4.3 port to illumos based platform

[Ian Campbell]

On Mon, 2014-02-03 at 14:55 +0400, Igor Kozhukhov wrote:
> i'm using xc_solaris.c - because illumos based on solaris and has open API.

I suspect this was the case, thanks for confirming.

> for now - i have found and fixed my problems: i'm able to load PV guests: dilos PV on dilos-xen-4.3-dom0, Linux ContOS 6.4 and Debian 7.0 64bits.

Excellent!

Is Illumos usable as a domU on a Linux dom0 as well?

> I'll send info later with new ISO and instruction for testing.
> 'xl' now work well.
> i'll work on provide my changes to Xen upstream.

Thank you!

Ian.

Re: xen-4.3 port to illumos based platform

[Igor Kozhukhov]

On Feb 3, 2014, at 2:59 PM, Ian Campbell wrote:

> On Mon, 2014-02-03 at 14:55 +0400, Igor Kozhukhov wrote:
>> i'm using xc_solaris.c - because illumos based on solaris and has open API.
> 
> I suspect this was the case, thanks for confirming.
> 
>> for now - i have found and fixed my problems: i'm able to load PV guests: dilos PV on dilos-xen-4.3-dom0, Linux ContOS 6.4 and Debian 7.0 64bits.
> 
> Excellent!
> 
> Is Illumos usable as a domU on a Linux dom0 as well?

i didn't test it by myself, but i have info about works with Xen-4.2 based on CentOS.
i have tested dilos-xen-3.4-dom0 with Linux PV/HVM guests - work well, also Windows HVM work well too.
i have updated libfsimage by ZFS from illumos and now we can use pygrub for illumos based VMs.

>> I'll send info later with new ISO and instruction for testing.
>> 'xl' now work well.
>> i'll work on provide my changes to Xen upstream.

sent email with info about it - i hope on feedback about testing :)

> Thank you!
> 
> Ian.


-Igor

xen-4.3 port to illumos based platform

[Igor Kozhukhov]

Hello All,

I have published first dilos-xen-4.3-dom0 ISO.

you can find info about how to play with it here:
http://www.dilos.org/news/2014-02-03

2Dariao: you can post this info to Xen blogs site :)
or copy/past from DilOS site.

--
Best regards,
Igor Kozhukhov