From mboxrd@z Thu Jan 1 00:00:00 1970 From: "David S. Ahern" Subject: problems with pci passthrough of nic and a DL380G6 Date: Sun, 10 May 2009 20:09:53 -0600 Message-ID: <4A0788F1.5020704@cisco.com> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit To: kvm-devel Return-path: Received: from sj-iport-6.cisco.com ([171.71.176.117]:26169 "EHLO sj-iport-6.cisco.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1753237AbZEKCJx (ORCPT ); Sun, 10 May 2009 22:09:53 -0400 Received: from sj-core-5.cisco.com (sj-core-5.cisco.com [171.71.177.238]) by sj-dkim-4.cisco.com (8.12.11/8.12.11) with ESMTP id n4B29tSK002849 for ; Sun, 10 May 2009 19:09:55 -0700 Received: from xbh-sjc-231.amer.cisco.com (xbh-sjc-231.cisco.com [128.107.191.100]) by sj-core-5.cisco.com (8.13.8/8.13.8) with ESMTP id n4B29s9N028074 for ; Mon, 11 May 2009 02:09:54 GMT Sender: kvm-owner@vger.kernel.org List-ID: Are the instructions for passing a device at: http://www.linux-kvm.org/page/How_to_assign_devices_with_VT-d_in_KVM supposed to work for passing one of four onboard nics to a guest? I ask because not only did it not work, it made my server a very unhappy camper. Server: HP DL380 G6, 1 E5540, 6 GB RAM (3x2), latest BIOS SMT enabled, VT-d2 enabled Host OS: Fedora core 9 OS, kvm.git 66b0aed4a9e15..., pxe booted Device is last of the four on-board nics (the host is using the first one). Commands: modprobe pci-stub echo "14e4 1639" > /sys/bus/pci/drivers/pci-stub/new_id echo "0000:03:00.1" > '/sys/bus/pci/devices/0000:03:00.1/driver/unbind' echo "0000:03:00.1" > /sys/bus/pci/drivers/pci-stub/bind Those commands worked fine. At this point I tried to mount the 4th logical disk (host OS is run via pxe and automounting of drives is not setup) and it failed. Since that disk holds the guest I wanted to run, I decided to reboot and start fresh. During reboot the server hung after a few BIOS initialization screens but before the PXE attempt. There was a 1 line message on the screen about an unknown NMI. The IML for the server shows a couple of critical errors - description is "Unknown Event (Class 6, Code 4). A second reboot attempt hung at the same place. I had to disable VT-d2 in the BIOS to get it to come back. Any ideas? david