From mboxrd@z Thu Jan  1 00:00:00 1970
From: Alex Jia <ajia@redhat.com>
Subject: Re: [libvirt-users] vm pxe fail
Date: Fri, 31 Aug 2012 10:37:23 -0400 (EDT)
Message-ID: <1291627989.24881461.1346423843165.JavaMail.root@redhat.com>
References: <6854DD41-51E5-4D1B-8D2D-FFABFC360D46@syseleven.de>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
Cc: kvm@vger.kernel.org
To: Andrew Holway <a.holway@syseleven.de>
Return-path: <kvm-owner@vger.kernel.org>
Received: from mx4-phx2.redhat.com ([209.132.183.25]:56998 "EHLO
	mx4-phx2.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org
	with ESMTP id S1753739Ab2HaOhc (ORCPT <rfc822;kvm@vger.kernel.org>);
	Fri, 31 Aug 2012 10:37:32 -0400
In-Reply-To: <6854DD41-51E5-4D1B-8D2D-FFABFC360D46@syseleven.de>
Sender: kvm-owner@vger.kernel.org
List-ID: <kvm.vger.kernel.org>

Hi Andrew,
Great, BTW, in fact, you may pxe boot via VF of Intel82576, however, Intel82576 SR-IOV network adapters 
don't provide a ROM BIOS for the cards virtual functions (VF), but an image of such a ROM is available, 
and with this ROM visible to the guest, it can PXE boot.

In libvirt's xml, you need to configure guest XML like this:

          <hostdev mode='subsystem' type='pci' managed='yes'>
            <source>
              <address bus='XX' slot='XX' function='XX'/>
            </source>         
            <boot order='1'/>         
           <rom bar='on' file='/xxxx/ipxe-808610ca.rom'/>
          </hostdev>

You need to build a ipxe-808610ca.rom by yourself, if you're interested in this,
please refer to http://ipxe.org/.
 

-- 
Regards,     
Alex


----- Original Message -----
From: "Andrew Holway" <a.holway@syseleven.de>
To: "Alex Jia" <ajia@redhat.com>
Cc: kvm@vger.kernel.org
Sent: Friday, August 31, 2012 9:32:24 PM
Subject: Re: [libvirt-users] vm pxe fail

Hi,

In the end the problem was SR-IOV enabled on the cards. I turned this off and everything worked ok.

Im using HP 10G cards which are rebranded emulex.

0a:00.0 Ethernet controller: Emulex Corporation OneConnect 10Gb NIC (be3) (rev 01)

Thanks,

Andrew

On Aug 17, 2012, at 4:34 AM, Alex Jia wrote:

> Hi Andrew,
> I can't confirm a root reason based on your information, perhaps you may
> try to find a reason by yourself via the following docs:
> 
> http://wiki.libvirt.org/page/PXE_boot_%28or_dhcp%29_on_guest_failed  (Troubleshooting)
> http://docs.fedoraproject.org/en-US/Fedora/13/html/Virtualization_Guide/sect-Virtualization-Virtualized_guest_installation_overview-Installing_guests_with_PXE.html  (User Guide)
> 
> If can't, please provide your version of kvm, libvirt, tftp, etc, and run 'virsh net-dumpxml br0' to dump your
> network bridge XML configuration, and run 'cat pxelinux.cfg' to show your pxelinux configuration, thanks.
> 
> -- 
> Regards,     
> Alex
> 
> 
> ----- Original Message -----
> From: "Andrew Holway" <a.holway@syseleven.de>
> To: kvm@vger.kernel.org
> Sent: Thursday, August 16, 2012 8:25:35 PM
> Subject: [libvirt-users] vm pxe fail
> 
> Hallo
> 
> I have a kvm vm that I am attempting to boot from pxe. The dhcp works perfectly and I can see the VM in the pxe server arp. but the tftp just times out. I don't see any tftp traffic on either the physical host or on the pie server. I am using a bridged interface. I have tried using several virtual nic drivers, several different mac addresses and several different ips.  on the physical host I can get the pxelinux.0 file from the pxe server via tftp and can clearly see that traffic with tcpdump.
> 
> Ive tried using various virtual interfaces.
> 
> I can pxe boot my physical hosts with no problems.
> 
> I can tftp fine from the physical host and see the traffic with ethdump
> 
> Here is the terminal output from the VM: https://dl.dropbox.com/u/98200887/Screen%20Shot%202012-08-15%20at%206.41.12%20PM.png
> 
> Thanks,
> 
> Andrew
> 
> [root@node002 ~]# yum list | grep qemu
> gpxe-roms-qemu.noarch                   0.9.7-6.9.el6               @base       
> qemu-img.x86_64                         2:0.12.1.2-2.295.el6_3.1    @updates    
> qemu-kvm.x86_64                         2:0.12.1.2-2.295.el6_3.1    @updates    
> qemu-guest-agent.x86_64                 2:0.12.1.2-2.295.el6_3.1    updates     
> qemu-kvm-tools.x86_64                   2:0.12.1.2-2.295.el6_3.1    updates 
> 
> [root@node002 ~]# ethtool eth0
> Settings for eth0:
> 	Supported ports: [ TP ]
> 	Supported link modes:   10000baseT/Full 
> 	Supports auto-negotiation: No
> 	Advertised link modes:  10000baseT/Full 
> 	Advertised pause frame use: No
> 	Advertised auto-negotiation: No
> 	Speed: Unknown!
> 	Duplex: Unknown! (255)
> 	Port: Twisted Pair
> 	PHYAD: 0
> 	Transceiver: internal
> 	Auto-negotiation: off
> 	MDI-X: Unknown
> 	Supports Wake-on: g
> 	Wake-on: g
> 	Current message level: 0x00000014 (20)
> 	Link detected: no
> 
> [root@node002 ~]# brctl show
> bridge name	bridge id		STP enabled	interfaces
> br0		8000.009c02241ae0	no		eth1
> 							vnet0
> virbr0		8000.525400a6d5aa	yes		virbr0-nic
> 
> [root@node002 ~]# ethtool vnet0
> Settings for vnet0:
> 	Supported ports: [ ]
> 	Supported link modes:   
> 	Supports auto-negotiation: No
> 	Advertised link modes:  Not reported
> 	Advertised pause frame use: No
> 	Advertised auto-negotiation: No
> 	Speed: 10Mb/s
> 	Duplex: Full
> 	Port: Twisted Pair
> 	PHYAD: 0
> 	Transceiver: internal
> 	Auto-negotiation: off
> 	MDI-X: Unknown
> 	Current message level: 0xffffffa1 (-95)
> 	Link detected: yes
> 
> <domain type='kvm'>
> <name>vm004</name>
> <uuid>4f03b09b-e834-bbf3-a6c2-1689f3156ef2</uuid>
> <memory unit='KiB'>2097152</memory>
> <currentMemory unit='KiB'>2097152</currentMemory>
> <vcpu placement='static'>2</vcpu>
> <os>
>   <type arch='x86_64' machine='rhel6.3.0'>hvm</type>
>   <boot dev='hd'/>
> </os>
> <features>
>   <acpi/>
>   <apic/>
>   <pae/>
> </features>
> <clock offset='utc'/>
> <on_poweroff>destroy</on_poweroff>
> <on_reboot>restart</on_reboot>
> <on_crash>restart</on_crash>
> <devices>
>   <emulator>/usr/libexec/qemu-kvm</emulator>
>   <disk type='file' device='disk'>
>     <driver name='qemu' type='raw' cache='none'/>
>     <source file='/cm/shared/vm/vm004.img'/>
>     <target dev='hda' bus='ide'/>
>     <address type='drive' controller='0' bus='0' target='0' unit='0'/>
>   </disk>
>   <disk type='block' device='cdrom'>
>     <driver name='qemu' type='raw'/>
>     <target dev='hdc' bus='ide'/>
>     <readonly/>
>     <address type='drive' controller='0' bus='1' target='0' unit='0'/>
>   </disk>
>   <controller type='usb' index='0'>
>     <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/>
>   </controller>
>   <controller type='ide' index='0'>
>     <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
>   </controller>
>   <interface type='bridge'>
>     <mac address='00:00:00:00:00:0d'/>
>     <source bridge='br0'/>
>     <model type='rtl8139'/>
>     <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
>   </interface>
>   <serial type='pty'>
>     <target port='0'/>
>   </serial>
>   <console type='pty'>
>     <target type='serial' port='0'/>
>   </console>
>   <input type='mouse' bus='ps2'/>
>   <graphics type='vnc' port='-1' autoport='yes'/>
>   <video>
>     <model type='cirrus' vram='9216' heads='1'/>
>     <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
>   </video>
>   <memballoon model='virtio'>
>     <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
>   </memballoon>
> </devices>
> </domain>
> 
> 
> 
> _______________________________________________
> libvirt-users mailing list
> libvirt-users@redhat.com
> https://www.redhat.com/mailman/listinfo/libvirt-users