xen-unstable & pvops on *Suse distro? successful howto?

xen-unstable & pvops on *Suse distro? successful howto?

[0bo0]

Starting with a well-updated Opensuse 11.2 distro, I'm attempting to
build/install a Xen4 + PVOPS kernel on it.

Following the various/disparate Wiki pages,

If I checkout xen-unstable.hg, and build all from there, Xen itself
builds OK, but the embedded xen.git linux kernel build fails.

If I checkout xen-unstable.hg, build only Xen, and then separately co
the xen.git tree, using a kernel config from Opensuse's Kernel:HEAD
repos, Xen builds, the kernel build, again, fails.

If I repeat the last step, but use the kernel config provided @
http://pasik.reaktio.net/xen/pv_ops-dom0-debug/config-2.6.31.4-pvops_dom0-x86_64,
Xen builds, and the kernel builds.  mkinitrd is OK as well.

But, @ boot to the new xen+kernel, boot hangs @ grub loading ... I
never get to any console output.

Clearly, people on this list are working with *Suse.  Could someone
share their specific steps, & .config, for getting this 'up' on *Suse?

Thanks.

Re: xen-unstable & pvops on *Suse distro? successful howto?

[Pasi Kärkkäinen]

On Wed, Feb 03, 2010 at 08:53:57AM -0800, 0bo0 wrote:
> Starting with a well-updated Opensuse 11.2 distro, I'm attempting to
> build/install a Xen4 + PVOPS kernel on it.
> 
> Following the various/disparate Wiki pages,
> 
> If I checkout xen-unstable.hg, and build all from there, Xen itself
> builds OK, but the embedded xen.git linux kernel build fails.
> 
> If I checkout xen-unstable.hg, build only Xen, and then separately co
> the xen.git tree, using a kernel config from Opensuse's Kernel:HEAD
> repos, Xen builds, the kernel build, again, fails.
> 

Opensuse's kernel is NOT pvops, it's based on forward-ported xenlinux 2.6.18 patches.
So that explains why opensuse's .config didn't work.

> If I repeat the last step, but use the kernel config provided @
> http://pasik.reaktio.net/xen/pv_ops-dom0-debug/config-2.6.31.4-pvops_dom0-x86_64,
> Xen builds, and the kernel builds.  mkinitrd is OK as well.
> 

That's my .config, and it builds/works for me ;)

> But, @ boot to the new xen+kernel, boot hangs @ grub loading ... I
> never get to any console output.
> 

Please paste your grub.conf.

Did you check the grub configuration examples in:
http://wiki.xensource.com/xenwiki/XenParavirtOps

Also check this wiki page for setting up a serial console for debugging boot problems:
http://wiki.xensource.com/xenwiki/XenSerialConsole


> Clearly, people on this list are working with *Suse.  Could someone
> share their specific steps, & .config, for getting this 'up' on *Suse?
> 

*Suse is currently shipping forward-ported xenlinux patches, not pv_ops,
so I assume that's why there aren't many pvops+suse stories out there.

I'm sure it can be done though. You'll figure it out :)

-- Pasi

Re: xen-unstable & pvops on *Suse distro? successful howto?

[0bo0]

On Wed, Feb 3, 2010 at 10:16 AM, Pasi Kärkkäinen <pasik@iki.fi> wrote:
> Opensuse's kernel is NOT pvops, it's based on forward-ported xenlinux 2.6.18 patches.
> So that explains why opensuse's .config didn't work.

perhaps so.  i'm simply documenting the steps i've taken.

a diff with your config is not null, but it's not huge ... yes, of
course, the details matter.

> That's my .config, and it builds/works for me ;)

if works for you building/installing on opensuse?  if not, hence my questions.

> Please paste your grub.conf.

...
title pvops1
	root (hd0,0)
	kernel /xen.gz dom0_mem=1024M loglvl=all guest_loglvl=all
	module /vmlinuz-xen root=/dev/VG0/ROOT rootfstype=ext4
rootflags=journal_checksum resume=/dev/VG0/SWAP nomodeset
	module /initrd-xen

title pvops2
	root (hd0,0)
	kernel /xen.gz dom0_mem=1024M loglvl=all guest_loglvl=all
sync_console console_to_ring com1=57600,8n1 console=vga,com1
	module /vmlinuz-xen root=/dev/VG0/ROOT rootfstype=ext4
rootflags=journal_checksum resume=/dev/VG0/SWAP console=hvc0
earlyprintk=xen
	module /initrd-xen
...
> Did you check the grub configuration examples in:
> http://wiki.xensource.com/xenwiki/XenParavirtOps
>
> Also check this wiki page for setting up a serial console for debugging boot problems:
> http://wiki.xensource.com/xenwiki/XenSerialConsole

again, yes, i'd followed both: " ... Following the various/disparate
Wiki pages, ..."

like i said, boot doesn't get past grub ... so there's no console output.


> *Suse is currently shipping forward-ported xenlinux patches, not pv_ops,

yes, i'm aware of what suse is shipping.  i've asked question on this
list based on it.  most recently i got a drive-by RTFM-ing that's
incorrectly & irrelevant to that case, and no further communications
...

> so I assume that's why there aren't many pvops+suse stories out there.
>
> I'm sure it can be done though. You'll figure it out :)

i don't need many, i need one.  after the n-th failure trying to
"figure it out", i thought the lists were for asking questions ...

there are active developers on this list who work @ *suse.  i'm hoping
that one of them will pipe up.

Re: xen-unstable & pvops on *Suse distro? successful howto?

[Pasi Kärkkäinen]

On Wed, Feb 03, 2010 at 10:40:03AM -0800, 0bo0 wrote:
> On Wed, Feb 3, 2010 at 10:16 AM, Pasi Kärkkäinen <pasik@iki.fi> wrote:
> > Opensuse's kernel is NOT pvops, it's based on forward-ported xenlinux 2.6.18 patches.
> > So that explains why opensuse's .config didn't work.
> 
> perhaps so.  i'm simply documenting the steps i've taken.
>

Yep. You should add the notes to the wiki when you get it working :)
 
> a diff with your config is not null, but it's not huge ... yes, of
> course, the details matter.
> 
> > That's my .config, and it builds/works for me ;)
> 
> if works for you building/installing on opensuse?  if not, hence my questions.
> 

I've been using mostly Fedora for testing pv_ops dom0.


> > Please paste your grub.conf.
> 
> ...
> title pvops1
> 	root (hd0,0)
> 	kernel /xen.gz dom0_mem=1024M loglvl=all guest_loglvl=all
> 	module /vmlinuz-xen root=/dev/VG0/ROOT rootfstype=ext4
> rootflags=journal_checksum resume=/dev/VG0/SWAP nomodeset
> 	module /initrd-xen
>

That looks ok.. it should set up a VGA text console.
 
> title pvops2
> 	root (hd0,0)
> 	kernel /xen.gz dom0_mem=1024M loglvl=all guest_loglvl=all
> sync_console console_to_ring com1=57600,8n1 console=vga,com1
> 	module /vmlinuz-xen root=/dev/VG0/ROOT rootfstype=ext4
> rootflags=journal_checksum resume=/dev/VG0/SWAP console=hvc0
> earlyprintk=xen
> 	module /initrd-xen
>

That looks OK aswell.


> ...
> > Did you check the grub configuration examples in:
> > http://wiki.xensource.com/xenwiki/XenParavirtOps
> >
> > Also check this wiki page for setting up a serial console for debugging boot problems:
> > http://wiki.xensource.com/xenwiki/XenSerialConsole
> 
> again, yes, i'd followed both: " ... Following the various/disparate
> Wiki pages, ..."
> 
> like i said, boot doesn't get past grub ... so there's no console output.
> 

Grub doesn't give any errors? 
No output from Xen, at all?

What version of grub is your distro using?

If there's nothing from Xen, then the problem is related to either grub or xen,
not to pv_ops dom0 kernel.


> 
> > so I assume that's why there aren't many pvops+suse stories out there.
> >
> > I'm sure it can be done though. You'll figure it out :)
> 
> i don't need many, i need one.  after the n-th failure trying to
> "figure it out", i thought the lists were for asking questions ...
> 

There shouldn't be anything *suse specific in running pv_ops dom0..


> there are active developers on this list who work @ *suse.  i'm hoping
> that one of them will pipe up.

Let's hope so.

-- Pasi

Re: xen-unstable & pvops on *Suse distro? successful howto?

[0bo0]

On Wed, Feb 3, 2010 at 10:48 AM, Pasi Kärkkäinen <pasik@iki.fi> wrote:
> Yep. You should add the notes to the wiki when you get it working :)

horse. cart. eventually ...

>> if works for you building/installing on opensuse?  if not, hence my questions.
>
> I've been using mostly Fedora for testing pv_ops dom0.

considering moving to it myself ... personally, much prefer the
opensuse distro -- not interested in a flamewar -- but my inability to
work on modern-xen may be a deciding factor.

> That looks ok.. it should set up a VGA text console.

with my 'normal' non-pvops kernel-default, kernel-desktop &
kernel-xen, my console setups works perfectly.

> Grub doesn't give any errors?

nope. output stops at "loading grub 1.5" (or some such thing -- not in
front of it, atm).  i never even get to the grub menu selector.

> No output from Xen, at all?

nope.

> What version of grub is your distro using?

grub --version
  grub (GNU GRUB 0.97)

> If there's nothing from Xen, then the problem is related to either grub or xen,
> not to pv_ops dom0 kernel.

ok, possible ...

> There shouldn't be anything *suse specific in running pv_ops dom0..

"shouldn't" .  not the first time that's been said re: *suse :-/

>> there are active developers on this list who work @ *suse.  i'm hoping
>> that one of them will pipe up.
>
> Let's hope so.

!!

Re: xen-unstable & pvops on *Suse distro? successful howto?

[Boris Derzhavets]

[-- Attachment #1.1: Type: text/plain, Size: 2736 bytes --]

Install 11.2 + Xen Host via original  DVD  and run "zypper update kernel-xen" or just "zypper update"

Jan's Beulich 2.6.31.8-01-xen would be installed.
Then take look  at /boot/grub/menu.lst.
You would probably realize  , that *Suse*  is not the best place to build any xen stuff from source, except maybe new xenified kernel via Novell's Repos.

Boris.

P.S. If you wonna build from source candidate 1 - F12, candidate 2 - Ubuntu
Karmic Koala Server, candidate 3 - Gentoo ( having problems with Internet connectivity)

--- On Wed, 2/3/10, Pasi Kärkkäinen <pasik@iki.fi> wrote:

From: Pasi Kärkkäinen <pasik@iki.fi>
Subject: Re: [Xen-devel] xen-unstable & pvops on *Suse distro? successful howto?
To: "0bo0" <0.bugs.only.0@gmail.com>
Cc: xen-devel@lists.xensource.com
Date: Wednesday, February 3, 2010, 1:16 PM

On Wed, Feb 03, 2010 at 08:53:57AM -0800, 0bo0 wrote:
> Starting with a well-updated Opensuse 11.2 distro, I'm attempting to
> build/install a Xen4 + PVOPS kernel on it.
> 
> Following the various/disparate Wiki pages,
> 
> If I checkout xen-unstable.hg, and build all from there, Xen itself
> builds OK, but the embedded xen.git linux kernel build fails.
> 
> If I checkout xen-unstable.hg, build only Xen, and then separately co
> the xen.git tree, using a kernel config from Opensuse's Kernel:HEAD
> repos, Xen builds, the kernel build, again, fails.
> 

Opensuse's kernel is NOT pvops, it's based on forward-ported xenlinux 2.6.18 patches.
So that explains why opensuse's .config didn't work.

> If I repeat the last step, but use the kernel config provided @
> http://pasik.reaktio.net/xen/pv_ops-dom0-debug/config-2.6.31.4-pvops_dom0-x86_64,
> Xen builds, and the kernel builds.  mkinitrd is OK as well.
> 

That's my .config, and it builds/works for me ;)

> But, @ boot to the new xen+kernel, boot hangs @ grub loading ... I
> never get to any console output.
> 

Please paste your grub.conf.

Did you check the grub configuration examples in:
http://wiki.xensource.com/xenwiki/XenParavirtOps

Also check this wiki page for setting up a serial console for debugging boot problems:
http://wiki.xensource.com/xenwiki/XenSerialConsole


> Clearly, people on this list are working with *Suse.  Could someone
> share their specific steps, & .config, for getting this 'up' on *Suse?
> 

*Suse is currently shipping forward-ported xenlinux patches, not pv_ops,
so I assume that's why there aren't many pvops+suse stories out there.

I'm sure it can be done though. You'll figure it out :)

-- Pasi


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel



      

[-- Attachment #1.2: Type: text/html, Size: 3726 bytes --]

[-- Attachment #2: Type: text/plain, Size: 138 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

Re: xen-unstable & pvops on *Suse distro? successful howto?

[Pasi Kärkkäinen]

On Wed, Feb 03, 2010 at 10:55:18AM -0800, 0bo0 wrote:
> 
> > That looks ok.. it should set up a VGA text console.
> 
> with my 'normal' non-pvops kernel-default, kernel-desktop &
> kernel-xen, my console setups works perfectly.
> 
> > Grub doesn't give any errors?
> 
> nope. output stops at "loading grub 1.5" (or some such thing -- not in
> front of it, atm).  i never even get to the grub menu selector.
> 

Ok.. so the problem is with grub.

> > No output from Xen, at all?
> 
> nope.
> 

Yeah, obviously grub needs to work for Xen to get started :)

> > What version of grub is your distro using?
> 
> grub --version
>   grub (GNU GRUB 0.97)
> 

So the question is why grub doesn't work after you edit /boot/grub/grub.conf ?
Sounds like grub.conf gets corrupted/broken.

-- Pasi

Re: xen-unstable & pvops on *Suse distro? successful howto?

[0bo0]

On Wed, Feb 3, 2010 at 11:00 AM, Boris Derzhavets <bderzhavets@yahoo.com> wrote:
> Install 11.2 + Xen Host via original  DVD  and run "zypper update kernel-xen" or just "zypper update"
>
> Jan's Beulich 2.6.31.8-01-xen would be installed.
> Then take look  at /boot/grub/menu.lst.

I've been running Opensuse's xenified kernels from 2.6.31.8-01-xen ->
2.6.33-rc5-5-xen with either their Xen 3.4 or Xen 4.0 for ages.  No
issues.

> You would probably realize  , that *Suse*  is not the best place to build any xen stuff from source, except maybe new xenified kernel via Novell's Repos.

i have my suspicions.  but it's not clearly stated anywhere i can
find.  so, specifically, why not?

> P.S. If you wonna build from source candidate 1 - F12, candidate 2 - Ubuntu
> Karmic Koala Server, candidate 3 - Gentoo ( having problems with Internet connectivity)

thanks.

Re: xen-unstable & pvops on *Suse distro? successful howto?

[0bo0]

On Wed, Feb 3, 2010 at 11:04 AM, Pasi Kärkkäinen <pasik@iki.fi> wrote:
> So the question is why grub doesn't work after you edit /boot/grub/grub.conf ?
> Sounds like grub.conf gets corrupted/broken.

if i have two configs in grub -- the PVOPS stanza, as above, and a
non-pvops stanza -- if i simply change the default to the non-pvops
stanza, then grub functions normally, the selection menu appears, and
i can boot with no problems to the non-pvops setup.

if i repeat, with default to non-pvops, but then *manually* select the
pvops config & boot it ... *nothing* happens.  the sysem simply stops
there.  no errors, no console output, no further response.

Re: xen-unstable & pvops on *Suse distro? successful howto?

[Pasi Kärkkäinen]

On Wed, Feb 03, 2010 at 11:19:02AM -0800, 0bo0 wrote:
> On Wed, Feb 3, 2010 at 11:04 AM, Pasi Kärkkäinen <pasik@iki.fi> wrote:
> > So the question is why grub doesn't work after you edit /boot/grub/grub.conf ?
> > Sounds like grub.conf gets corrupted/broken.
> 
> if i have two configs in grub -- the PVOPS stanza, as above, and a
> non-pvops stanza -- if i simply change the default to the non-pvops
> stanza, then grub functions normally, the selection menu appears, and
> i can boot with no problems to the non-pvops setup.
> 
> if i repeat, with default to non-pvops, but then *manually* select the
> pvops config & boot it ... *nothing* happens.  the sysem simply stops
> there.  no errors, no console output, no further response.
>

Weird.

Try with "kernel /xen.gz" in grub.conf, ie. no extra options for xen.
Does that change anything?

You should always get _something_ from Xen hypervisor..

-- Pasi

Re: xen-unstable & pvops on *Suse distro? successful howto?

[Konrad Rzeszutek Wilk]

> with my 'normal' non-pvops kernel-default, kernel-desktop &
> kernel-xen, my console setups works perfectly.

Can you try booting the pvops kernel without the Xen hypervisor in it?
That should eliminate it being a Xen issue.

Re: xen-unstable & pvops on *Suse distro? successful howto?

[0bo0]

On Wed, Feb 3, 2010 at 7:05 PM, Konrad Rzeszutek Wilk
<konrad.wilk@oracle.com> wrote:
> Can you try booting the pvops kernel without the Xen hypervisor in it?
> That should eliminate it being a Xen issue.

booting to,

title PVOPS
    root (hd0,0)
    kernel /vmlinuz-2.6.31.6 root=/dev/VG0/ROOT rootfstype=ext4
rootflags=journal_checksum resume=/dev/VG0/SWAP showopts splash=silent
selinux=0 SELINUX_INIT=NO elevator=cfq vga=0x31a console=tty0
console=ttyS0,57600n8 clocksource=acpi_pm
    initrd /initrd-2.6.31.6


completes with no problems,

  uname -a
    Linux test04 2.6.31.6 #1 SMP Wed Feb 3 14:41:23 PST 2010 x86_64
x86_64 x86_64 GNU/Linux

Re: xen-unstable & pvops on *Suse distro? successful howto?

[Keir Fraser]

On 03/02/2010 19:19, "0bo0" <0.bugs.only.0@gmail.com> wrote:

> On Wed, Feb 3, 2010 at 11:04 AM, Pasi Kärkkäinen <pasik@iki.fi> wrote:
>> So the question is why grub doesn't work after you edit /boot/grub/grub.conf
>> ?
>> Sounds like grub.conf gets corrupted/broken.
> 
> if i have two configs in grub -- the PVOPS stanza, as above, and a
> non-pvops stanza -- if i simply change the default to the non-pvops
> stanza, then grub functions normally, the selection menu appears, and
> i can boot with no problems to the non-pvops setup.
> 
> if i repeat, with default to non-pvops, but then *manually* select the
> pvops config & boot it ... *nothing* happens.  the sysem simply stops
> there.  no errors, no console output, no further response.

I haven't seen you post the non-pvops versus pvops grub stanzas for
comparison, but assuming the Xen line in each stanza is identical, it would
be really odd that one gets you Xen boot output and the other doesn't. Are
you setting up Xen to print to serial line in exactly the same way in both
cases?

The only thing I could think of, if the GRUB setup is okay, is that Xen is
messing up with the particular size of pvops kernel+initrd you pass to it.
I.e., a bug where Xen fails really early, before setting up serial line
even. That would make you very unlucky since I can't remember when we last
had such an early bug, but it is possible.

 -- Keir