kvm-65/66 bug with Solaris 10 U4 ?

kvm-65/66 bug with Solaris 10 U4 ?

[Ian Kirk]

Hi,

I was able to boot and install Soarlis 10 U4 but since upgraded the host,
I have issues.

Host:

Fedora 8 - 2.6.24.4-64.fc8PAE SMP
CPU AMD Athlon(tm) 64 X2 Dual Core Processor 3800+
32 bit

Previously:

2.6.24.4-64.fc8

Running the standard F8 KVM kernel drivers, with either 65 or 66 userland.

qemu-kvm bombs out with:

unhandled vm exit: 0x4020101 vcpu_id 0
rax 00000000fec35bf8 rbx 00000000fec35b08 rcx 00000000c0000000 rdx 0000000000288004
rsi 00000000fe800000 rdi 00000000fe888e6c rsp 00000000fec35aa0 rbp 00000000fec35aac
r8  0000000000000000 r9  0000000000000000 r10 0000000000000000 r11 0000000000000000
r12 0000000000000000 r13 0000000000000000 r14 0000000000000000 r15 0000000000000000
rip 00000000fe8003f5 rflags 00000202
cs 0158 (00000000/ffffffff p 1 dpl 0 db 1 s 1 type b l 0 g 0 avl 0)
ds 0160 (00000000/ffffffff p 1 dpl 0 db 1 s 1 type 3 l 0 g 1 avl 0)
es 0160 (00000000/ffffffff p 1 dpl 0 db 1 s 1 type 3 l 0 g 1 avl 0)
ss 0160 (00000000/ffffffff p 1 dpl 0 db 1 s 1 type 3 l 0 g 1 avl 0)
fs 0000 (00000000/000fffff p 0 dpl 0 db 0 s 0 type 0 l 0 g 0 avl 0)
gs 01b0 (fec20788/00000617 p 1 dpl 0 db 1 s 1 type 3 l 0 g 0 avl 0)
tr 0150 (fec21a50/00000067 p 1 dpl 0 db 0 s 0 type 9 l 0 g 0 avl 0)
ldt 0000 (00000000/0000ffff p 0 dpl 0 db 0 s 0 type 0 l 0 g 0 avl 0)
gdt fec01000/2cf
idt fec20da0/7ff
cr0 80050011 cr2 0 cr3 102000 cr4 98 cr8 0 efer 0
Aborted (core dumped)

dmesg:

kvm: 32763: cpu0 unhandled rdmsr: 0xc0000080
kvm: 32763: cpu0 task_switch_interception: task switch is unsupported

command line:

qemu-kvm -vnc :1 -m 256 -hda solaris.img -net nic,macaddr=de:ad:be:af:00:01,model=e1000 -net tap -cdrom sol-10-u4-ga-x86-dvd.iso -boot d

Having tried e1000 or not, no-acpi, or not, std-vga, or not, networks, or
not.

The solaris.img was installed using qemu-kvm from kvm-65/F8 kernel on the
same host, and booted several dozen times.

I have yet to try and reboot back to non-PAE and test that - but is it
likely that the PAE kernel is causing problems?

Or am I being crap?

Regards,
Ian

-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone

Re: kvm-65/66 bug with Solaris 10 U4 ?

[Alexey Eremenko]

KVM-65/66 has some bugs on AMD. I suggest you to degrade to KVM-64 for
stability.

Other than that, only Solaris-10 32-bit is supposed to work fine,
while Solaris 64-bit will need some patches to KVM to work at all.

For more info see:
http://kvm.qumranet.com/kvmwiki/Guest_Support_Status

-- 
-Alexey Eromenko "Technologov"

-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone

Re: kvm-65/66 bug with Solaris 10 U4 ?

[Ian Kirk]

Alexey Eremenko wrote:

> KVM-65/66 has some bugs on AMD. I suggest you to degrade to KVM-64 for
> stability.

Also crashes (userland kvm-64, kernel F8). It is Solaris 32bit.

Does the 32bit host running PAE cause any issues ?

-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone

Re: kvm-65/66 bug with Solaris 10 U4 ?

[Avi Kivity]

Alexey Eremenko wrote:
> KVM-65/66 has some bugs on AMD. I suggest you to degrade to KVM-64 for
> stability.
>   

What bugs?

Also note Ian (which you don't quote or copy) reports success with 
kvm-65 userspace on a non-pae kernel.

> Other than that, only Solaris-10 32-bit is supposed to work fine,
> while Solaris 64-bit will need some patches to KVM to work at all.
>   

He's not trying to run a 64-bit guest.

-- 
error compiling committee.c: too many arguments to function


-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone

Re: kvm-65/66 bug with Solaris 10 U4 ?

[Avi Kivity]

Ian Kirk wrote:
> Hi,
>
> I was able to boot and install Soarlis 10 U4 but since upgraded the host,
> I have issues.
>
> Host:
>
> Fedora 8 - 2.6.24.4-64.fc8PAE SMP
> CPU AMD Athlon(tm) 64 X2 Dual Core Processor 3800+
> 32 bit
>
>   

How much memory do you have?  If you are blessed with 4GB or more, this 
is likely a truncation issue.

Does running with mem=2000 work?

-- 
error compiling committee.c: too many arguments to function


-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone

Re: kvm-65/66 bug with Solaris 10 U4 ?

[Ian Kirk]

Avi Kivity wrote:

> How much memory do you have?  If you are blessed with 4GB or more, this
> is likely a truncation issue.

I have 4GB (just upgraded from 1GB), hence running PAE else Linux is only
enable to use ~3GB.

By mem=2000 I assume you mean on the Host?

If so, I might as well drop back to non-PAE and get to use 3GB.

Are these known issues? Can I do anything to help/test which might make it
work for other people?

I could provide shell access if need be.

Regards,
Ian.

-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone

Re: kvm-65/66 bug with Solaris 10 U4 ?

[Avi Kivity]

Ian Kirk wrote:
> Avi Kivity wrote:
>
>   
>> How much memory do you have?  If you are blessed with 4GB or more, this
>> is likely a truncation issue.
>>     
>
> I have 4GB (just upgraded from 1GB), hence running PAE else Linux is only
> enable to use ~3GB.
>
> By mem=2000 I assume you mean on the Host?
>
>   

Yes.

> If so, I might as well drop back to non-PAE and get to use 3GB.
>
>   

If it works, this provides a clue as to what goes wrong, and we can fix it.

> Are these known issues? Can I do anything to help/test which might make it
> work for other people?

Just let us know if it works or not.  If it does, I'll try to prepare a 
patch which fixes the problem with pae and the entire 4GB.  If it 
doesn't, we'll have to do some more searching.

-- 
error compiling committee.c: too many arguments to function


-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone

Re: kvm-65/66 bug with Solaris 10 U4 ?

[Ian Kirk]

Avi Kivity wrote:

> > If so, I might as well drop back to non-PAE and get to use 3GB.
>
> If it works, this provides a clue as to what goes wrong, and we can fix
> it.
>
> > Are these known issues? Can I do anything to help/test which might
> > make it work for other people?
>
> Just let us know if it works or not.  If it does, I'll try to prepare a
> patch which fixes the problem with pae and the entire 4GB.  If it
> doesn't, we'll have to do some more searching.

2.6.24.4-64.fc8PAE mem=2000:
Linux explodes (forgot the m!)

2.6.24.4-64.fc8PAE mem=2000m:
kvm solaris still dies as before, free(1) reports ~2GB.

2.6.24.4-64.fc8:
kvm solaris works, free(1) reports ~3GB.

Currently installed KVM-64 based on previous post, kernel module is stock
Fedora 8 from the above (not sure which version that is)

HTH,
Ian.

-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone

Re: kvm-65/66 bug with Solaris 10 U4 ?

[Avi Kivity]

Ian Kirk wrote:
> Avi Kivity wrote:
>
>   
>>> If so, I might as well drop back to non-PAE and get to use 3GB.
>>>       
>> If it works, this provides a clue as to what goes wrong, and we can fix
>> it.
>>
>>     
>>> Are these known issues? Can I do anything to help/test which might
>>> make it work for other people?
>>>       
>> Just let us know if it works or not.  If it does, I'll try to prepare a
>> patch which fixes the problem with pae and the entire 4GB.  If it
>> doesn't, we'll have to do some more searching.
>>     
>
> 2.6.24.4-64.fc8PAE mem=2000:
> Linux explodes (forgot the m!)
>
>   

Sorry.

> 2.6.24.4-64.fc8PAE mem=2000m:
> kvm solaris still dies as before, free(1) reports ~2GB.
>
>   

Not good.  kvm doesn't really care about the host page table layout, I 
don't see how this can matter.

> 2.6.24.4-64.fc8:
> kvm solaris works, free(1) reports ~3GB.
>
> Currently installed KVM-64 based on previous post, kernel module is stock
> Fedora 8 from the above (not sure which version that is)
>   

It's kvm-60-ish IIRC.

-- 
error compiling committee.c: too many arguments to function


-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone

Re: kvm-65/66 bug with Solaris 10 U4 ?

[Avi Kivity]

Avi Kivity wrote:
>
> Not good.  kvm doesn't really care about the host page table layout, I 
> don't see how this can matter.

Actually kvm is affected by pae: it enables nx support.  Please try 
(separately)

  1.  Boot with 'noexec=off' on the host kernel command line
  2.  Loading the kernel modules that come with kvm-66

-- 
Do not meddle in the internals of kernels, for they are subtle and quick to panic.


-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone

Re: kvm-65/66 bug with Solaris 10 U4 ?

[Ian Kirk]

Avi Kivity wrote:

>  1.  Boot with 'noexec=off' on the host kernel command line
>  2.  Loading the kernel modules that come with kvm-66

I'll have a go at no.2, I have not had much luck compiling the modules
within the constraints of a Fedora kernel.

No.1 I can do tomorrow when in the same building as the server (in case of
user error)

Ian.

-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone

Re: kvm-65/66 bug with Solaris 10 U4 ?

[Avi Kivity]

Ian Kirk wrote:
> Avi Kivity wrote:
>
>   
>>  1.  Boot with 'noexec=off' on the host kernel command line
>>  2.  Loading the kernel modules that come with kvm-66
>>     
>
> I'll have a go at no.2, I have not had much luck compiling the modules
> within the constraints of a Fedora kernel.
>
>   

I do this regularly, basically you need to install kernel-devel and 
that's it.


-- 
Do not meddle in the internals of kernels, for they are subtle and quick to panic.


-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone

Re: kvm-65/66 bug with Solaris 10 U4 ?

[Ian Kirk]

Avi Kivity wrote:

> I do this regularly, basically you need to install kernel-devel and
> that's it.

Yes, that is very easy isn't it. Oops to my stupidity. I've got it built
and will give it a go tomorrow and report back on each test case.

-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone

Re: kvm-65/66 bug with Solaris 10 U4 ?

[Avi Kivity]

Ian Kirk wrote:
> Avi Kivity wrote:
>
>   
>> I do this regularly, basically you need to install kernel-devel and
>> that's it.
>>     
>
> Yes, that is very easy isn't it. Oops to my stupidity. I've got it built
> and will give it a go tomorrow and report back on each test case.
>   

Please don't flame on kvm-devel, even if the flames are self-directed.

-- 
Do not meddle in the internals of kernels, for they are subtle and quick to panic.


-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone

Re: kvm-65/66 bug with Solaris 10 U4 ?

[Ian Kirk]

Avi Kivity wrote:

> > Yes, that is very easy isn't it. Oops to my stupidity. I've got it built
> > and will give it a go tomorrow and report back on each test case.
>
> Please don't flame on kvm-devel, even if the flames are self-directed.

Er, OK...

-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone

Re: kvm-65/66 bug with Solaris 10 U4 ?

[Ian Kirk]

Avi Kivity wrote:

> Actually kvm is affected by pae: it enables nx support.  Please try
> (separately)
>
>  1.  Boot with 'noexec=off' on the host kernel command line

2.6.24.4-64.fc8PAE noexec=off:

Using normal F8 modules
qemu-kvm dies in the same way

>  2.  Loading the kernel modules that come with kvm-66

Against 2.6.24.4-64.fc8 it works.

I can't compile them against 2.6.24.4-64.fc8PAE as the module magic name
mismatches, and I don't know how to change kernel-devel to know it's PAE.

Probably won't be able to do any more tests that require a reboot till
Tuesday now, but feel free to leave me some things to try.

Ian

-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone

Re: kvm-65/66 bug with Solaris 10 U4 ?

[Chris Lalancette]

Ian Kirk wrote:
> 
> I can't compile them against 2.6.24.4-64.fc8PAE as the module magic name
> mismatches, and I don't know how to change kernel-devel to know it's PAE.

You just need to install kernel-PAE-devel package, and then build against that.

Chris Lalancette

-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone

Re: kvm-65/66 bug with Solaris 10 U4 ?

[Ian Kirk]

Ian Kirk wrote:

> 2.6.24.4-64.fc8PAE noexec=off:
>
> Using normal F8 modules
> qemu-kvm dies in the same way
>
> >  2.  Loading the kernel modules that come with kvm-66
>
> Against 2.6.24.4-64.fc8 it works.

2.6.24.4-64.fc8PAE with kvm-66 module seems to work OK.

I guess that solves that little problem?

I intend to upgrade my other AMD machine to 4GB (which is at home, as
opposed to at work) so I can properly test the various combinations to
check it's "fixed" in kvm-66 (or somewhere after the bundled Fedora 8 one)

Ian.

-------------------------------------------------------------------------
This SF.net email is sponsored by the 2008 JavaOne(SM) Conference 
Don't miss this year's exciting event. There's still time to save $100. 
Use priority code J8TL2D2. 
http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone