testing 32bit PAE pv_ops dom0...

testing 32bit PAE pv_ops dom0...

[Marc - A. Dahlhaus]

Hello,

i had no luck in booting 32bit PAE pv_ops dom0 on xen-3.4-unstable so far...
Booting the bzImage on bare Metal works like a charm (it's even stable 
under high load), but booting the vmlinux over xen gives just a jump of 
the cursor to the top left corner after the last messages from the 
hypervisor. My Test-Box (Dell XPS-720) lacks a serial port so i can't 
check if it's just a vga issue.

I have most xen related options configured as modules maybe that might 
be the problem. I'll try to check that out over the next week.

Next thing i'll try is to use xen-3.3.1 hypervisor to check that it's 
not hypervisor related.
I also try to dig out some older Boxes on which 3.3.1 runs at the moment 
and try if it actually prints something to a serial console...

Marc

Re: testing 32bit PAE pv_ops dom0...

[Pasi Kärkkäinen]

On Sat, Jan 10, 2009 at 06:45:59PM +0100, Marc - A. Dahlhaus wrote:
> Hello,
> 
> i had no luck in booting 32bit PAE pv_ops dom0 on xen-3.4-unstable so far...
> Booting the bzImage on bare Metal works like a charm (it's even stable 
> under high load), but booting the vmlinux over xen gives just a jump of 
> the cursor to the top left corner after the last messages from the 
> hypervisor. My Test-Box (Dell XPS-720) lacks a serial port so i can't 
> check if it's just a vga issue.
> 
> I have most xen related options configured as modules maybe that might 
> be the problem. I'll try to check that out over the next week.
> 
> Next thing i'll try is to use xen-3.3.1 hypervisor to check that it's 
> not hypervisor related.
> I also try to dig out some older Boxes on which 3.3.1 runs at the moment 
> and try if it actually prints something to a serial console...
> 

VGA console is not currently working in pv_ops dom0 patches. At least I
haven't figured out how to make it work.

Serial console works for me. 

There seems to be some problems with IRQ routing (?).. and thus ahci and ata_piix
drivers don't seem to work currently. 

Hopefully next week we can get some debugging done when Jeremy is back.

-- Pasi

Re: testing 32bit PAE pv_ops dom0...

[Marc - A. Dahlhaus]

Pasi Kärkkäinen schrieb:
> On Sat, Jan 10, 2009 at 06:45:59PM +0100, Marc - A. Dahlhaus wrote:
>   
>> Hello,
>>
>> i had no luck in booting 32bit PAE pv_ops dom0 on xen-3.4-unstable so far...
>> Booting the bzImage on bare Metal works like a charm (it's even stable 
>> under high load), but booting the vmlinux over xen gives just a jump of 
>> the cursor to the top left corner after the last messages from the 
>> hypervisor. My Test-Box (Dell XPS-720) lacks a serial port so i can't 
>> check if it's just a vga issue.
>>
>> I have most xen related options configured as modules maybe that might 
>> be the problem. I'll try to check that out over the next week.
>>
>> Next thing i'll try is to use xen-3.3.1 hypervisor to check that it's 
>> not hypervisor related.
>> I also try to dig out some older Boxes on which 3.3.1 runs at the moment 
>> and try if it actually prints something to a serial console...
>>
>>     
>
> VGA console is not currently working in pv_ops dom0 patches. At least I
> haven't figured out how to make it work.
>
> Serial console works for me. 
>
> There seems to be some problems with IRQ routing (?).. and thus ahci and ata_piix
> drivers don't seem to work currently. 
>
> Hopefully next week we can get some debugging done when Jeremy is back.
>
> -- Pasi
>   
Hello Pasi,

followed the discussions about that and was sad to read that as my boxes 
here also use the ata_piix module to
get the root device. I'll try to build a x86_64 image tomorrow as is 
think it's a PAE problem.
Can you send me your working kernel config file?

I also got another hickup here. On 3 other Boxes i tested on i get an 
instant reboot after the dom0 builder executes
the pv_ops vmlinuz image... i think it panics pretty close after 
execution on 32bit PAE...
I have to dig out a serial cable to put some boxes together to capture 
some logs. I'll post them when i get there.

Re: testing 32bit PAE pv_ops dom0...

[Pasi Kärkkäinen]

On Sat, Jan 10, 2009 at 09:05:17PM +0100, Marc - A. Dahlhaus wrote:
> Pasi Kärkkäinen schrieb:
> >On Sat, Jan 10, 2009 at 06:45:59PM +0100, Marc - A. Dahlhaus wrote:
> >  
> >>Hello,
> >>
> >>i had no luck in booting 32bit PAE pv_ops dom0 on xen-3.4-unstable so 
> >>far...
> >>Booting the bzImage on bare Metal works like a charm (it's even stable 
> >>under high load), but booting the vmlinux over xen gives just a jump of 
> >>the cursor to the top left corner after the last messages from the 
> >>hypervisor. My Test-Box (Dell XPS-720) lacks a serial port so i can't 
> >>check if it's just a vga issue.
> >>
> >>I have most xen related options configured as modules maybe that might 
> >>be the problem. I'll try to check that out over the next week.
> >>
> >>Next thing i'll try is to use xen-3.3.1 hypervisor to check that it's 
> >>not hypervisor related.
> >>I also try to dig out some older Boxes on which 3.3.1 runs at the moment 
> >>and try if it actually prints something to a serial console...
> >>
> >>    
> >
> >VGA console is not currently working in pv_ops dom0 patches. At least I
> >haven't figured out how to make it work.
> >
> >Serial console works for me. 
> >
> >There seems to be some problems with IRQ routing (?).. and thus ahci and 
> >ata_piix
> >drivers don't seem to work currently. 
> >
> >Hopefully next week we can get some debugging done when Jeremy is back.
> >
> >-- Pasi
> >  
> Hello Pasi,
> 
> followed the discussions about that and was sad to read that as my boxes 
> here also use the ata_piix module to
> get the root device. I'll try to build a x86_64 image tomorrow as is 
> think it's a PAE problem.
> Can you send me your working kernel config file?
> 

My pv_ops dom0 kernel (32b PAE) config is here:
http://pasik.reaktio.net/xen/pv_ops-dom0-debug/config-2.6.28-rc8-tip-dom0

My grub config:

title pv_ops dom0-test (2.6.28-rc8-tip) / serial console
	root (hd0,0)
	kernel /xen-3.3.gz dom0_mem=1024M loglvl=all guest_loglvl=all com1=19200,8n1 console=com1
	module /vmlinuz-2.6.28-rc8-tip.gz ro root=/dev/vg00/lv01 console=hvc0 earlyprintk=xen pci=nomsi
	module /initrd-2.6.28-rc8-tip.img


vmlinuz-2.6.28-rc8-tip.gz is gzipped "vmlinux" file from the kernel build.

Initially I was using Xen 3.3.0, but I recently updated to Xen 3.3.1. Didn't
help. The problem is in the pv_ops dom0 kernel, not in the hypervisor, I think.


> I also got another hickup here. On 3 other Boxes i tested on i get an 
> instant reboot after the dom0 builder executes
> the pv_ops vmlinuz image... i think it panics pretty close after 
> execution on 32bit PAE...
> I have to dig out a serial cable to put some boxes together to capture 
> some logs. I'll post them when i get there.

-- Pasi

Re: testing 32bit PAE pv_ops dom0...

[Pasi Kärkkäinen]

On Sat, Jan 10, 2009 at 10:27:03PM +0200, Pasi Kärkkäinen wrote:
> On Sat, Jan 10, 2009 at 09:05:17PM +0100, Marc - A. Dahlhaus wrote:
> > Pasi Kärkkäinen schrieb:
> > >On Sat, Jan 10, 2009 at 06:45:59PM +0100, Marc - A. Dahlhaus wrote:
> > >  
> > >>Hello,
> > >>
> > >>i had no luck in booting 32bit PAE pv_ops dom0 on xen-3.4-unstable so 
> > >>far...
> > >>Booting the bzImage on bare Metal works like a charm (it's even stable 
> > >>under high load), but booting the vmlinux over xen gives just a jump of 
> > >>the cursor to the top left corner after the last messages from the 
> > >>hypervisor. My Test-Box (Dell XPS-720) lacks a serial port so i can't 
> > >>check if it's just a vga issue.
> > >>
> > >>I have most xen related options configured as modules maybe that might 
> > >>be the problem. I'll try to check that out over the next week.
> > >>
> > >>Next thing i'll try is to use xen-3.3.1 hypervisor to check that it's 
> > >>not hypervisor related.
> > >>I also try to dig out some older Boxes on which 3.3.1 runs at the moment 
> > >>and try if it actually prints something to a serial console...
> > >>
> > >>    
> > >
> > >VGA console is not currently working in pv_ops dom0 patches. At least I
> > >haven't figured out how to make it work.
> > >
> > >Serial console works for me. 
> > >
> > >There seems to be some problems with IRQ routing (?).. and thus ahci and 
> > >ata_piix
> > >drivers don't seem to work currently. 
> > >
> > >Hopefully next week we can get some debugging done when Jeremy is back.
> > >
> > >-- Pasi
> > >  
> > Hello Pasi,
> > 
> > followed the discussions about that and was sad to read that as my boxes 
> > here also use the ata_piix module to
> > get the root device. I'll try to build a x86_64 image tomorrow as is 
> > think it's a PAE problem.
> > Can you send me your working kernel config file?
> > 
> 
> My pv_ops dom0 kernel (32b PAE) config is here:
> http://pasik.reaktio.net/xen/pv_ops-dom0-debug/config-2.6.28-rc8-tip-dom0
> 

Oh, forgot to mention that I'm not sure if that config is totally
correct/OK, since I can't get my dom0 kernel to boot up because of the
ata_piix problems :) It _seems_ to be OK based on what I can see happening
before it fails because no root volume found. 

That config is made with "make oldconfig" from Fedora 10 default PAE kernel, and then
I added pv_ops dom0 options etc.

-- Pasi