From mboxrd@z Thu Jan 1 00:00:00 1970 From: Fantu Subject: RE: Memory mapping for PEG/PCIe Graphics Passthrough to DomU Date: Mon, 11 Jan 2010 06:15:24 -0800 (PST) Message-ID: <27111077.post@talk.nabble.com> References: <14D9C9E2ED61ED41BC3B37ACDF4E8800029E434B9F07@heavy-vm03.heavy.org.uk> <27026626.post@talk.nabble.com> <20100107150555.GZ25902@reaktio.net> <27062451.post@talk.nabble.com> <20100107210753.GB25902@reaktio.net> <4B469C67.5000606@intel.com> <60E426D47DE8EA47AA104E65008A100D13476E6BC8@shzsmsx501.ccr.corp.intel.com> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Return-path: In-Reply-To: <60E426D47DE8EA47AA104E65008A100D13476E6BC8@shzsmsx501.ccr.corp.intel.com> List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xensource.com Errors-To: xen-devel-bounces@lists.xensource.com To: xen-devel@lists.xensource.com List-Id: xen-devel@lists.xenproject.org I have try with patch, the problem persist, under the output of xm info, xm dmesg and lspci -v: lspci -v 00:00.0 Host bridge: Intel Corporation QuickPath Architecture I/O Hub to ES= I Port (rev 13) Subsystem: ASUSTeK Computer Inc. Device 836b Flags: fast devsel Capabilities: [60] Message Signalled Interrupts: Mask+ 64bit- Queue=3D0/1 Enable- Capabilities: [90] Express Root Port (Slot-), MSI 00 Capabilities: [e0] Power Management version 3 Capabilities: [100] Advanced Error Reporting Capabilities: [150] Access Controls Capabilities: [160] Vendor Specific Information 00:01.0 PCI bridge: Intel Corporation QuickPath Architecture I/O Hub PCI Express Root Port 1 (rev 13) (prog-if 00 [Normal decode]) Flags: bus master, fast devsel, latency 0 Bus: primary=3D00, secondary=3D01, subordinate=3D01, sec-latency=3D= 0 Capabilities: [40] Subsystem: ASUSTeK Computer Inc. Device 836b Capabilities: [60] Message Signalled Interrupts: Mask+ 64bit- Queue=3D0/1 Enable+ Capabilities: [90] Express Root Port (Slot+), MSI 00 Capabilities: [e0] Power Management version 3 Capabilities: [100] Advanced Error Reporting Capabilities: [150] Access Controls Capabilities: [160] Vendor Specific Information Kernel driver in use: pcieport-driver 00:03.0 PCI bridge: Intel Corporation QuickPath Architecture I/O Hub PCI Express Root Port 3 (rev 13) (prog-if 00 [Normal decode]) Flags: bus master, fast devsel, latency 0 Bus: primary=3D00, secondary=3D02, subordinate=3D02, sec-latency=3D= 0 I/O behind bridge: 0000b000-0000bfff Memory behind bridge: f8000000-fbbfffff Prefetchable memory behind bridge: 00000000d0000000-00000000dffffff= f Capabilities: [40] Subsystem: ASUSTeK Computer Inc. Device 836b Capabilities: [60] Message Signalled Interrupts: Mask+ 64bit- Queue=3D0/1 Enable+ Capabilities: [90] Express Root Port (Slot+), MSI 00 Capabilities: [e0] Power Management version 3 Capabilities: [100] Advanced Error Reporting Capabilities: [150] Access Controls Capabilities: [160] Vendor Specific Information Kernel driver in use: pcieport-driver 00:07.0 PCI bridge: Intel Corporation QuickPath Architecture I/O Hub PCI Express Root Port 7 (rev 13) (prog-if 00 [Normal decode]) Flags: bus master, fast devsel, latency 0 Bus: primary=3D00, secondary=3D03, subordinate=3D03, sec-latency=3D= 0 Capabilities: [40] Subsystem: ASUSTeK Computer Inc. Device 836b Capabilities: [60] Message Signalled Interrupts: Mask+ 64bit- Queue=3D0/1 Enable+ Capabilities: [90] Express Root Port (Slot+), MSI 00 Capabilities: [e0] Power Management version 3 Capabilities: [100] Advanced Error Reporting Capabilities: [150] Access Controls Capabilities: [160] Vendor Specific Information Kernel driver in use: pcieport-driver 00:14.0 PIC: Intel Corporation QuickPath Architecture I/O Hub System Management Registers (rev 13) (prog-if 00 [8259]) Flags: fast devsel Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00 00:14.1 PIC: Intel Corporation QuickPath Architecture I/O Hub GPIO and Scratch Pad Registers (rev 13) (prog-if 00 [8259]) Flags: fast devsel Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00 00:14.2 PIC: Intel Corporation QuickPath Architecture I/O Hub Control Statu= s and RAS Registers (rev 13) (prog-if 00 [8259]) Flags: fast devsel Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00 00:14.3 PIC: Intel Corporation QuickPath Architecture I/O Hub Throttle Registers (rev 13) (prog-if 00 [8259]) Flags: fast devsel 00:1a.0 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #4 (prog-if 00 [UHCI]) Subsystem: ASUSTeK Computer Inc. Device 82d4 Flags: bus master, medium devsel, latency 0, IRQ 16 I/O ports at a800 [size=3D32] Capabilities: [50] PCIe advanced features Kernel driver in use: uhci_hcd 00:1a.1 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #5 (prog-if 00 [UHCI]) Subsystem: ASUSTeK Computer Inc. Device 82d4 Flags: bus master, medium devsel, latency 0, IRQ 21 I/O ports at a880 [size=3D32] Capabilities: [50] PCIe advanced features Kernel driver in use: uhci_hcd 00:1a.2 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #6 (prog-if 00 [UHCI]) Subsystem: ASUSTeK Computer Inc. Device 82d4 Flags: bus master, medium devsel, latency 0, IRQ 19 I/O ports at ac00 [size=3D32] Capabilities: [50] PCIe advanced features Kernel driver in use: uhci_hcd 00:1a.7 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #2 (prog-if 20 [EHCI]) Subsystem: ASUSTeK Computer Inc. Device 82d4 Flags: bus master, medium devsel, latency 0, IRQ 18 Memory at f7fff000 (32-bit, non-prefetchable) [size=3D1K] Capabilities: [50] Power Management version 2 Capabilities: [58] Debug port: BAR=3D1 offset=3D00a0 Capabilities: [98] PCIe advanced features Kernel driver in use: ehci_hcd 00:1b.0 Audio device: Intel Corporation 82801JI (ICH10 Family) HD Audio Controller Subsystem: ASUSTeK Computer Inc. Device 8357 Flags: bus master, fast devsel, latency 0, IRQ 22 Memory at f7ff8000 (64-bit, non-prefetchable) [size=3D16K] Capabilities: [50] Power Management version 2 Capabilities: [60] Message Signalled Interrupts: Mask- 64bit+ Queue=3D0/0 Enable- Capabilities: [70] Express Root Complex Integrated Endpoint, MSI 00 Capabilities: [100] Virtual Channel Capabilities: [130] Root Complex Link Kernel driver in use: HDA Intel 00:1c.0 PCI bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Port 1 (prog-if 00 [Normal decode]) Flags: bus master, fast devsel, latency 0 Bus: primary=3D00, secondary=3D07, subordinate=3D07, sec-latency=3D= 0 Prefetchable memory behind bridge: 00000000f6f00000-00000000f6fffff= f Capabilities: [40] Express Root Port (Slot+), MSI 00 Capabilities: [80] Message Signalled Interrupts: Mask- 64bit- Queue=3D0/0 Enable+ Capabilities: [90] Subsystem: ASUSTeK Computer Inc. Device 8357 Capabilities: [a0] Power Management version 2 Capabilities: [100] Virtual Channel Capabilities: [180] Root Complex Link Kernel driver in use: pcieport-driver 00:1c.2 PCI bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Port 3 (prog-if 00 [Normal decode]) Flags: bus master, fast devsel, latency 0 Bus: primary=3D00, secondary=3D06, subordinate=3D06, sec-latency=3D= 0 I/O behind bridge: 0000e000-0000efff Memory behind bridge: fbe00000-fbefffff Prefetchable memory behind bridge: 00000000f6e00000-00000000f6effff= f Capabilities: [40] Express Root Port (Slot+), MSI 00 Capabilities: [80] Message Signalled Interrupts: Mask- 64bit- Queue=3D0/0 Enable+ Capabilities: [90] Subsystem: ASUSTeK Computer Inc. Device 8357 Capabilities: [a0] Power Management version 2 Capabilities: [100] Virtual Channel Capabilities: [180] Root Complex Link Kernel driver in use: pcieport-driver 00:1c.3 PCI bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Port 4 (prog-if 00 [Normal decode]) Flags: bus master, fast devsel, latency 0 Bus: primary=3D00, secondary=3D05, subordinate=3D05, sec-latency=3D= 0 I/O behind bridge: 0000d000-0000dfff Memory behind bridge: fbd00000-fbdfffff Capabilities: [40] Express Root Port (Slot+), MSI 00 Capabilities: [80] Message Signalled Interrupts: Mask- 64bit- Queue=3D0/0 Enable+ Capabilities: [90] Subsystem: ASUSTeK Computer Inc. Device 8357 Capabilities: [a0] Power Management version 2 Capabilities: [100] Virtual Channel Capabilities: [180] Root Complex Link Kernel driver in use: pcieport-driver 00:1c.4 PCI bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Port 5 (prog-if 00 [Normal decode]) Flags: bus master, fast devsel, latency 0 Bus: primary=3D00, secondary=3D04, subordinate=3D04, sec-latency=3D= 0 I/O behind bridge: 0000c000-0000cfff Memory behind bridge: fbc00000-fbcfffff Capabilities: [40] Express Root Port (Slot+), MSI 00 Capabilities: [80] Message Signalled Interrupts: Mask- 64bit- Queue=3D0/0 Enable+ Capabilities: [90] Subsystem: ASUSTeK Computer Inc. Device 8357 Capabilities: [a0] Power Management version 2 Capabilities: [100] Virtual Channel Capabilities: [180] Root Complex Link Kernel driver in use: pcieport-driver 00:1d.0 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #1 (prog-if 00 [UHCI]) Subsystem: ASUSTeK Computer Inc. Device 82d4 Flags: bus master, medium devsel, latency 0, IRQ 23 I/O ports at a080 [size=3D32] Capabilities: [50] PCIe advanced features Kernel driver in use: uhci_hcd 00:1d.1 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #2 (prog-if 00 [UHCI]) Subsystem: ASUSTeK Computer Inc. Device 82d4 Flags: bus master, medium devsel, latency 0, IRQ 19 I/O ports at a400 [size=3D32] Capabilities: [50] PCIe advanced features Kernel driver in use: uhci_hcd 00:1d.2 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #3 (prog-if 00 [UHCI]) Subsystem: ASUSTeK Computer Inc. Device 82d4 Flags: bus master, medium devsel, latency 0, IRQ 18 I/O ports at a480 [size=3D32] Capabilities: [50] PCIe advanced features Kernel driver in use: uhci_hcd 00:1d.7 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #1 (prog-if 20 [EHCI]) Subsystem: ASUSTeK Computer Inc. Device 82d4 Flags: bus master, medium devsel, latency 0, IRQ 23 Memory at f7ffe000 (32-bit, non-prefetchable) [size=3D1K] Capabilities: [50] Power Management version 2 Capabilities: [58] Debug port: BAR=3D1 offset=3D00a0 Capabilities: [98] PCIe advanced features Kernel driver in use: ehci_hcd 00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev 90) (prog-if 01 [Subtractive decode]) Flags: bus master, fast devsel, latency 0 Bus: primary=3D00, secondary=3D08, subordinate=3D08, sec-latency=3D= 32 Capabilities: [50] Subsystem: ASUSTeK Computer Inc. Device 82d4 00:1f.0 ISA bridge: Intel Corporation 82801JIR (ICH10R) LPC Interface Controller Subsystem: ASUSTeK Computer Inc. Device 82d4 Flags: bus master, medium devsel, latency 0 Capabilities: [e0] Vendor Specific Information 00:1f.2 RAID bus controller: Intel Corporation 82801 SATA RAID Controller Subsystem: ASUSTeK Computer Inc. Device 82d4 Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 828 I/O ports at 9c00 [size=3D8] I/O ports at 9880 [size=3D4] I/O ports at 9800 [size=3D8] I/O ports at 9480 [size=3D4] I/O ports at 9400 [size=3D32] Memory at f7ffc000 (32-bit, non-prefetchable) [size=3D2K] Capabilities: [80] Message Signalled Interrupts: Mask- 64bit- Queue=3D0/4 Enable+ Capabilities: [70] Power Management version 3 Capabilities: [a8] SATA HBA Capabilities: [b0] PCIe advanced features Kernel driver in use: ahci 00:1f.3 SMBus: Intel Corporation 82801JI (ICH10 Family) SMBus Controller Subsystem: ASUSTeK Computer Inc. Device 82d4 Flags: medium devsel, IRQ 18 Memory at f7ffd000 (64-bit, non-prefetchable) [size=3D256] I/O ports at 0400 [size=3D32] 02:00.0 VGA compatible controller: nVidia Corporation Device 0640 (rev a1) (prog-if 00 [VGA controller]) Flags: bus master, fast devsel, latency 0, IRQ 15 Memory at fa000000 (32-bit, non-prefetchable) [size=3D16M] Memory at d0000000 (64-bit, prefetchable) [size=3D256M] Memory at f8000000 (64-bit, non-prefetchable) [size=3D32M] I/O ports at bc00 [size=3D128] Expansion ROM at fbb80000 [disabled] [size=3D512K] Capabilities: [60] Power Management version 3 Capabilities: [68] Message Signalled Interrupts: Mask- 64bit+ Queue=3D0/0 Enable- Capabilities: [78] Express Endpoint, MSI 00 Capabilities: [b4] Vendor Specific Information Capabilities: [100] Virtual Channel Capabilities: [128] Power Budgeting Capabilities: [600] Vendor Specific Information 04:00.0 SATA controller: JMicron Technologies, Inc. JMicron 20360/20363 AHC= I Controller (rev 03) (prog-if 01 [AHCI 1.0]) Subsystem: ASUSTeK Computer Inc. Device 824f Flags: bus master, fast devsel, latency 0, IRQ 16 Memory at fbcfe000 (32-bit, non-prefetchable) [size=3D8K] Expansion ROM at fbce0000 [disabled] [size=3D64K] Capabilities: [68] Power Management version 2 Capabilities: [50] Express Legacy Endpoint, MSI 01 Kernel driver in use: ahci 04:00.1 IDE interface: JMicron Technologies, Inc. JMicron 20360/20363 AHCI Controller (rev 03) (prog-if 85 [Master SecO PriO]) Subsystem: ASUSTeK Computer Inc. Device 824f Flags: bus master, fast devsel, latency 0 I/O ports at cc00 [size=3D8] I/O ports at c880 [size=3D4] I/O ports at c800 [size=3D8] I/O ports at c480 [size=3D4] I/O ports at c400 [size=3D16] Capabilities: [68] Power Management version 2 05:00.0 FireWire (IEEE 1394): VIA Technologies, Inc. Device 3403 (prog-if 1= 0 [OHCI]) Subsystem: ASUSTeK Computer Inc. Device 8384 Flags: bus master, fast devsel, latency 0, IRQ 10 Memory at fbdff000 (64-bit, non-prefetchable) [size=3D2K] I/O ports at d800 [size=3D256] Capabilities: [50] Power Management version 3 Capabilities: [80] Message Signalled Interrupts: Mask+ 64bit+ Queue=3D0/0 Enable- Capabilities: [98] Express Endpoint, MSI 00 Capabilities: [100] Advanced Error Reporting Capabilities: [130] Device Serial Number 12-90-bd-ff-ff-8c-1e-00 06:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168B PCI Express Gigabit Ethernet controller (rev 02) Subsystem: ASUSTeK Computer Inc. Device 82c6 Flags: bus master, fast devsel, latency 0, IRQ 827 I/O ports at e800 [size=3D256] Memory at fbeff000 (64-bit, non-prefetchable) [size=3D4K] Memory at f6ef0000 (64-bit, prefetchable) [size=3D64K] Expansion ROM at fbec0000 [disabled] [size=3D128K] Capabilities: [40] Power Management version 3 Capabilities: [50] Message Signalled Interrupts: Mask- 64bit+ Queue=3D0/0 Enable+ Capabilities: [70] Express Endpoint, MSI 01 Capabilities: [b0] MSI-X: Enable- Mask- TabSize=3D2 Capabilities: [d0] Vital Product Data Capabilities: [100] Advanced Error Reporting Capabilities: [140] Virtual Channel Capabilities: [160] Device Serial Number 00-e0-4c-68-00-00-00-03 Kernel driver in use: r8169 xm info host : vfarm release : 2.6.31.6-xen version : #2 SMP Mon Jan 11 14:33:17 CET 2010 machine : x86_64 nr_cpus : 8 nr_nodes : 1 cores_per_socket : 4 threads_per_core : 2 cpu_mhz : 2672 hw_caps : bfebfbff:28100800:00000000:00001b40:0098e3bd:00000000:00000001:00000000 virt_caps : hvm total_memory : 6108 free_memory : 5546 node_to_cpu : node0:0-7 node_to_memory : node0:5546 node_to_dma32_mem : node0:2996 xen_major : 4 xen_minor : 0 xen_extra : .0-rc1-pre xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64=20 xen_scheduler : credit xen_pagesize : 4096 platform_params : virt_start=3D0xffff800000000000 xen_changeset : Sat Jan 09 08:14:44 2010 +0000 20779:596f7893b5ac xen_commandline : dom0_mem=3D512M iommu=3D1 iommu_inclusive_mapping= =3D1 cc_compiler : gcc version 4.3.2 (Debian 4.3.2-1.1)=20 cc_compile_by : root cc_compile_domain :=20 cc_compile_date : Mon Jan 11 14:25:59 CET 2010 xend_config_format : 4 vfarm:~# xm dmesg 0x08] address[0xfec00000] gsi_base[0]) (XEN) IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23 (XEN) ACPI: IOAPIC (id[0x09] address[0xfec8a000] gsi_base[24]) (XEN) IOAPIC[1]: apic_id 9, version 32, address 0xfec8a000, GSI 24-47 (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) (XEN) ACPI: IRQ0 used by override. (XEN) ACPI: IRQ2 used by override. (XEN) ACPI: IRQ9 used by override. (XEN) Enabling APIC mode: Flat. Using 2 I/O APICs (XEN) ACPI: HPET id: 0x8086a301 base: 0xfed00000 (XEN) [VT-D]dmar.c:579: Host address width 39 (XEN) [VT-D]dmar.c:588: found ACPI_DMAR_DRHD: (XEN) [VT-D]dmar.c:374: dmaru->address =3D fbfff000 (XEN) [VT-D]dmar.c:326: endpoint: 0:1b.0 (XEN) [VT-D]dmar.c:588: found ACPI_DMAR_DRHD: (XEN) [VT-D]dmar.c:374: dmaru->address =3D fbffe000 (XEN) [VT-D]dmar.c:331: IOAPIC: f0:1f.7 (XEN) [VT-D]dmar.c:331: IOAPIC: 0:13.0 (XEN) [VT-D]dmar.c:386: flags: INCLUDE_ALL (XEN) [VT-D]dmar.c:592: found ACPI_DMAR_RMRR: (XEN) [VT-D]dmar.c:438: RMRR region: base_addr ec000 end_address effff (XEN) [VT-D]dmar.c:326: endpoint: 0:1d.0 (XEN) [VT-D]dmar.c:326: endpoint: 0:1d.1 (XEN) [VT-D]dmar.c:326: endpoint: 0:1d.2 (XEN) [VT-D]dmar.c:326: endpoint: 0:1d.7 (XEN) [VT-D]dmar.c:326: endpoint: 0:1a.0 (XEN) [VT-D]dmar.c:326: endpoint: 0:1a.1 (XEN) [VT-D]dmar.c:326: endpoint: 0:1a.2 (XEN) [VT-D]dmar.c:326: endpoint: 0:1a.7 (XEN) [VT-D]dmar.c:592: found ACPI_DMAR_RMRR: (XEN) [VT-D]dmar.c:425: RMRR address range not in reserved memory base = =3D bf7dc000 end =3D bf7dbfff; iommu_inclusive_mapping=3D1 parameter may be nee= ded. (XEN) [VT-D]dmar.c:438: RMRR region: base_addr bf7dc000 end_address bf7dbfff (XEN) [VT-D]dmar.c:326: endpoint: 0:1d.0 (XEN) [VT-D]dmar.c:326: endpoint: 0:1d.1 (XEN) [VT-D]dmar.c:326: endpoint: 0:1d.2 (XEN) [VT-D]dmar.c:326: endpoint: 0:1d.7 (XEN) [VT-D]dmar.c:326: endpoint: 0:1a.0 (XEN) [VT-D]dmar.c:326: endpoint: 0:1a.1 (XEN) [VT-D]dmar.c:326: endpoint: 0:1a.2 (XEN) [VT-D]dmar.c:326: endpoint: 0:1a.7 (XEN) [VT-D]dmar.c:479: The RMRR (bf7dc000, bf7dbfff) is incorrect! (XEN) Failed to parse ACPI DMAR. Disabling VT-d. (XEN) PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255 (XEN) PCI: Not using MMCONFIG. (XEN) Using ACPI (MADT) for SMP configuration information (XEN) Using scheduler: SMP Credit Scheduler (credit) (XEN) Initializing CPU#0 (XEN) Detected 2672.822 MHz processor. (XEN) Initing memory sharing. (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K (XEN) CPU: L2 cache: 256K (XEN) CPU: L3 cache: 8192K (XEN) CPU: Physical Processor ID: 0 (XEN) CPU: Processor Core ID: 0 (XEN) VMX: Supported advanced features: (XEN) - APIC MMIO access virtualisation (XEN) - APIC TPR shadow (XEN) - Extended Page Tables (EPT) (XEN) - Virtual-Processor Identifiers (VPID) (XEN) - Virtual NMI (XEN) - MSR direct-access bitmap (XEN) HVM: ASIDs enabled.=20 (XEN) HVM: VMX enabled (XEN) HVM: Hardware Assisted Paging detected. (XEN) Intel machine check reporting enabled on CPU#0. (XEN) CPU0: Thermal monitoring enabled (TM1) (XEN) I/O virtualisation disabled (XEN) CPU0: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz stepping 05 (XEN) Booting processor 1/2 eip 8c000 (XEN) Initializing CPU#1 (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K (XEN) CPU: L2 cache: 256K (XEN) CPU: L3 cache: 8192K (XEN) CPU: Physical Processor ID: 0 (XEN) CPU: Processor Core ID: 1 (XEN) HVM: ASIDs enabled.=20 (XEN) Intel machine check reporting enabled on CPU#1. (XEN) CPU1: Thermal monitoring enabled (TM1) (XEN) CPU1: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz stepping 05 (XEN) Booting processor 2/4 eip 8c000 (XEN) Initializing CPU#2 (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K (XEN) CPU: L2 cache: 256K (XEN) CPU: L3 cache: 8192K (XEN) CPU: Physical Processor ID: 0 (XEN) CPU: Processor Core ID: 2 (XEN) HVM: ASIDs enabled.=20 (XEN) Intel machine check reporting enabled on CPU#2. (XEN) CPU2: Thermal monitoring enabled (TM1) (XEN) CPU2: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz stepping 05 (XEN) Booting processor 3/6 eip 8c000 (XEN) Initializing CPU#3 (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K (XEN) CPU: L2 cache: 256K (XEN) CPU: L3 cache: 8192K (XEN) CPU: Physical Processor ID: 0 (XEN) CPU: Processor Core ID: 3 (XEN) HVM: ASIDs enabled.=20 (XEN) Intel machine check reporting enabled on CPU#3. (XEN) CPU3: Thermal monitoring enabled (TM1) (XEN) CPU3: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz stepping 05 (XEN) Booting processor 4/1 eip 8c000 (XEN) Initializing CPU#4 (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K (XEN) CPU: L2 cache: 256K (XEN) CPU: L3 cache: 8192K (XEN) CPU: Physical Processor ID: 0 (XEN) CPU: Processor Core ID: 0 (XEN) HVM: ASIDs enabled.=20 (XEN) Intel machine check reporting enabled on CPU#4. (XEN) CPU4: Thermal monitoring enabled (TM1) (XEN) CPU4: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz stepping 05 (XEN) Booting processor 5/3 eip 8c000 (XEN) Initializing CPU#5 (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K (XEN) CPU: L2 cache: 256K (XEN) CPU: L3 cache: 8192K (XEN) CPU: Physical Processor ID: 0 (XEN) CPU: Processor Core ID: 1 (XEN) HVM: ASIDs enabled.=20 (XEN) Intel machine check reporting enabled on CPU#5. (XEN) CPU5: Thermal monitoring enabled (TM1) (XEN) CPU5: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz stepping 05 (XEN) Booting processor 6/5 eip 8c000 (XEN) Initializing CPU#6 (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K (XEN) CPU: L2 cache: 256K (XEN) CPU: L3 cache: 8192K (XEN) CPU: Physical Processor ID: 0 (XEN) CPU: Processor Core ID: 2 (XEN) HVM: ASIDs enabled.=20 (XEN) Intel machine check reporting enabled on CPU#6. (XEN) CPU6: Thermal monitoring enabled (TM1) (XEN) CPU6: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz stepping 05 (XEN) Booting processor 7/7 eip 8c000 (XEN) Initializing CPU#7 (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K (XEN) CPU: L2 cache: 256K (XEN) CPU: L3 cache: 8192K (XEN) CPU: Physical Processor ID: 0 (XEN) CPU: Processor Core ID: 3 (XEN) HVM: ASIDs enabled.=20 (XEN) Intel machine check reporting enabled on CPU#7. (XEN) CPU7: Thermal monitoring enabled (TM1) (XEN) CPU7: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz stepping 05 (XEN) Total of 8 processors activated. (XEN) ENABLING IO-APIC IRQs (XEN) -> Using new ACK method (XEN) ..TIMER: vector=3D0xF0 apic1=3D0 pin1=3D2 apic2=3D-1 pin2=3D-1 (XEN) checking TSC synchronization across 8 CPUs: passed. (XEN) Platform timer is 14.318MHz HPET (XEN) microcode.c:73:d32767 microcode: CPU1 resumed (XEN) microcode.c:73:d32767 microcode: CPU6 resumed (XEN) Brought up 8 CPUs (XEN) microcode.c:73:d32767 microcode: CPU2 resumed (XEN) microcode.c:73:d32767 microcode: CPU7 resumed (XEN) microcode.c:73:d32767 microcode: CPU5 resumed (XEN) microcode.c:73:d32767 microcode: CPU4 resumed (XEN) microcode.c:73:d32767 microcode: CPU3 resumed (XEN) HPET: 4 timers in total, 0 timers will be used for broadcast (XEN) ACPI sleep modes: S3 (XEN) mcheck_poll: Machine check polling timer started. (XEN) *** LOADING DOMAIN 0 *** (XEN) elf_parse_binary: phdr: paddr=3D0x1000000 memsz=3D0x829000 (XEN) elf_parse_binary: phdr: paddr=3D0x1829000 memsz=3D0xe6108 (XEN) elf_parse_binary: phdr: paddr=3D0x1910000 memsz=3D0x888 (XEN) elf_parse_binary: phdr: paddr=3D0x1911000 memsz=3D0x15ca0 (XEN) elf_parse_binary: phdr: paddr=3D0x1926ca0 memsz=3D0x1a9360 (XEN) elf_parse_binary: memory: 0x1000000 -> 0x1ad0000 (XEN) elf_xen_parse_note: GUEST_OS =3D "linux" (XEN) elf_xen_parse_note: GUEST_VERSION =3D "2.6" (XEN) elf_xen_parse_note: XEN_VERSION =3D "xen-3.0" (XEN) elf_xen_parse_note: VIRT_BASE =3D 0xffffffff80000000 (XEN) elf_xen_parse_note: ENTRY =3D 0xffffffff81926ea0 (XEN) elf_xen_parse_note: HYPERCALL_PAGE =3D 0xffffffff81009000 (XEN) elf_xen_parse_note: FEATURES =3D "!writable_page_tables|pae_pgdir_above_4gb" (XEN) elf_xen_parse_note: PAE_MODE =3D "yes" (XEN) elf_xen_parse_note: LOADER =3D "generic" (XEN) elf_xen_parse_note: unknown xen elf note (0xd) (XEN) elf_xen_parse_note: SUSPEND_CANCEL =3D 0x1 (XEN) elf_xen_parse_note: HV_START_LOW =3D 0xffff800000000000 (XEN) elf_xen_parse_note: PADDR_OFFSET =3D 0x0 (XEN) elf_xen_addr_calc_check: addresses: (XEN) virt_base =3D 0xffffffff80000000 (XEN) elf_paddr_offset =3D 0x0 (XEN) virt_offset =3D 0xffffffff80000000 (XEN) virt_kstart =3D 0xffffffff81000000 (XEN) virt_kend =3D 0xffffffff81ad0000 (XEN) virt_entry =3D 0xffffffff81926ea0 (XEN) p2m_base =3D 0xffffffffffffffff (XEN) Xen kernel: 64-bit, lsb, compat32 (XEN) Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x1ad0000 (XEN) PHYSICAL MEMORY ARRANGEMENT: (XEN) Dom0 alloc.: 00000001b4000000->00000001b8000000 (114688 pages to b= e allocated) (XEN) VIRTUAL MEMORY ARRANGEMENT: (XEN) Loaded kernel: ffffffff81000000->ffffffff81ad0000 (XEN) Init. ramdisk: ffffffff81ad0000->ffffffff81ed7400 (XEN) Phys-Mach map: ffffffff81ed8000->ffffffff81fd8000 (XEN) Start info: ffffffff81fd8000->ffffffff81fd84b4 (XEN) Page tables: ffffffff81fd9000->ffffffff81fee000 (XEN) Boot stack: ffffffff81fee000->ffffffff81fef000 (XEN) TOTAL: ffffffff80000000->ffffffff82400000 (XEN) ENTRY ADDRESS: ffffffff81926ea0 (XEN) Dom0 has maximum 8 VCPUs (XEN) elf_load_binary: phdr 0 at 0xffffffff81000000 -> 0xffffffff81829000 (XEN) elf_load_binary: phdr 1 at 0xffffffff81829000 -> 0xffffffff8190f108 (XEN) elf_load_binary: phdr 2 at 0xffffffff81910000 -> 0xffffffff81910888 (XEN) elf_load_binary: phdr 3 at 0xffffffff81911000 -> 0xffffffff81926ca0 (XEN) elf_load_binary: phdr 4 at 0xffffffff81926ca0 -> 0xffffffff819a4000 (XEN) Scrubbing Free RAM: .......................................................done. (XEN) Xen trace buffers: disabled (XEN) tmem: initialized comp=3D0 global-lock=3D0 (XEN) Std. Loglevel: All (XEN) Guest Loglevel: All (XEN) Xen is relinquishing VGA console. (XEN) *** Serial input -> DOM0 (type \047CTRL-a\047 three times to switch input to Xen) (XEN) Freed 156kB init memory. (XEN) io_apic.c:2291:=20 (XEN) ioapic_guest_write: apic=3D0, pin=3D0, irq=3D0 (XEN) ioapic_guest_write: new_entry=3D00010900 (XEN) ioapic_guest_write: Attempt to modify IO-APIC pin for in-use IRQ! (XEN) io_apic.c:2291:=20 (XEN) ioapic_guest_write: apic=3D0, pin=3D2, irq=3D0 (XEN) ioapic_guest_write: new_entry=3D00010900 (XEN) ioapic_guest_write: Attempt to modify IO-APIC pin for in-use IRQ! (XEN) irq.c:1431: dom0: pirq 0 or irq 3 already mapped (XEN) irq.c:1431: dom0: pirq 0 or irq 4 already mapped (XEN) irq.c:1431: dom0: pirq 0 or irq 5 already mapped (XEN) irq.c:1431: dom0: pirq 0 or irq 6 already mapped (XEN) irq.c:1431: dom0: pirq 0 or irq 7 already mapped (XEN) irq.c:1431: dom0: pirq 0 or irq 8 already mapped (XEN) irq.c:1431: dom0: pirq 0 or irq 9 already mapped (XEN) irq.c:1431: dom0: pirq 0 or irq 10 already mapped (XEN) irq.c:1431: dom0: pirq 0 or irq 11 already mapped (XEN) irq.c:1431: dom0: pirq 0 or irq 12 already mapped (XEN) irq.c:1431: dom0: pirq 0 or irq 13 already mapped (XEN) irq.c:1431: dom0: pirq 0 or irq 14 already mapped (XEN) irq.c:1431: dom0: pirq 0 or irq 15 already mapped (XEN) allocated vector for irq:16 (XEN) irq.c:1431: dom0: pirq 0 or irq 16 already mapped (XEN) allocated vector for irq:17 (XEN) irq.c:1431: dom0: pirq 0 or irq 17 already mapped (XEN) allocated vector for irq:18 (XEN) irq.c:1431: dom0: pirq 0 or irq 18 already mapped (XEN) allocated vector for irq:19 (XEN) irq.c:1431: dom0: pirq 0 or irq 19 already mapped (XEN) allocated vector for irq:20 (XEN) irq.c:1431: dom0: pirq 0 or irq 20 already mapped (XEN) allocated vector for irq:21 (XEN) irq.c:1431: dom0: pirq 0 or irq 21 already mapped (XEN) allocated vector for irq:22 (XEN) irq.c:1431: dom0: pirq 0 or irq 22 already mapped (XEN) allocated vector for irq:23 (XEN) irq.c:1431: dom0: pirq 0 or irq 23 already mapped (XEN) allocated vector for irq:24 (XEN) irq.c:1431: dom0: pirq 0 or irq 24 already mapped (XEN) allocated vector for irq:25 (XEN) irq.c:1431: dom0: pirq 0 or irq 25 already mapped (XEN) allocated vector for irq:26 (XEN) irq.c:1431: dom0: pirq 0 or irq 26 already mapped (XEN) allocated vector for irq:27 (XEN) irq.c:1431: dom0: pirq 0 or irq 27 already mapped (XEN) allocated vector for irq:28 (XEN) irq.c:1431: dom0: pirq 0 or irq 28 already mapped (XEN) allocated vector for irq:29 (XEN) irq.c:1431: dom0: pirq 0 or irq 29 already mapped (XEN) allocated vector for irq:30 (XEN) irq.c:1431: dom0: pirq 0 or irq 30 already mapped (XEN) allocated vector for irq:31 (XEN) irq.c:1431: dom0: pirq 0 or irq 31 already mapped (XEN) allocated vector for irq:32 (XEN) irq.c:1431: dom0: pirq 0 or irq 32 already mapped (XEN) allocated vector for irq:33 (XEN) irq.c:1431: dom0: pirq 0 or irq 33 already mapped (XEN) allocated vector for irq:34 (XEN) irq.c:1431: dom0: pirq 0 or irq 34 already mapped (XEN) allocated vector for irq:35 (XEN) irq.c:1431: dom0: pirq 0 or irq 35 already mapped (XEN) allocated vector for irq:36 (XEN) irq.c:1431: dom0: pirq 0 or irq 36 already mapped (XEN) allocated vector for irq:37 (XEN) irq.c:1431: dom0: pirq 0 or irq 37 already mapped (XEN) allocated vector for irq:38 (XEN) irq.c:1431: dom0: pirq 0 or irq 38 already mapped (XEN) allocated vector for irq:39 (XEN) irq.c:1431: dom0: pirq 0 or irq 39 already mapped (XEN) allocated vector for irq:40 (XEN) irq.c:1431: dom0: pirq 0 or irq 40 already mapped (XEN) allocated vector for irq:41 (XEN) irq.c:1431: dom0: pirq 0 or irq 41 already mapped (XEN) allocated vector for irq:42 (XEN) irq.c:1431: dom0: pirq 0 or irq 42 already mapped (XEN) allocated vector for irq:43 (XEN) irq.c:1431: dom0: pirq 0 or irq 43 already mapped (XEN) allocated vector for irq:44 (XEN) irq.c:1431: dom0: pirq 0 or irq 44 already mapped (XEN) allocated vector for irq:45 (XEN) irq.c:1431: dom0: pirq 0 or irq 45 already mapped (XEN) allocated vector for irq:46 (XEN) irq.c:1431: dom0: pirq 0 or irq 46 already mapped (XEN) allocated vector for irq:47 (XEN) irq.c:1431: dom0: pirq 0 or irq 47 already mapped (XEN) io_apic.c:2291:=20 (XEN) ioapic_guest_write: apic=3D0, pin=3D0, irq=3D0 (XEN) ioapic_guest_write: new_entry=3D00000900 (XEN) ioapic_guest_write: Attempt to modify IO-APIC pin for in-use IRQ! (XEN) PCI add device 00:00.0 (XEN) PCI add device 00:01.0 (XEN) PCI add device 00:03.0 (XEN) PCI add device 00:07.0 (XEN) PCI add device 00:14.0 (XEN) PCI add device 00:14.1 (XEN) PCI add device 00:14.2 (XEN) PCI add device 00:14.3 (XEN) PCI add device 00:1a.0 (XEN) PCI add device 00:1a.1 (XEN) PCI add device 00:1a.2 (XEN) PCI add device 00:1a.7 (XEN) PCI add device 00:1b.0 (XEN) PCI add device 00:1c.0 (XEN) PCI add device 00:1c.2 (XEN) PCI add device 00:1c.3 (XEN) PCI add device 00:1c.4 (XEN) PCI add device 00:1d.0 (XEN) PCI add device 00:1d.1 (XEN) PCI add device 00:1d.2 (XEN) PCI add device 00:1d.7 (XEN) PCI add device 00:1e.0 (XEN) PCI add device 00:1f.0 (XEN) PCI add device 00:1f.2 (XEN) PCI add device 00:1f.3 (XEN) PCI add device 02:00.0 (XEN) PCI add device 06:00.0 (XEN) PCI add device 05:00.0 (XEN) PCI add device 04:00.0 (XEN) PCI add device 04:00.1 (XEN) Set CPU acpi_id(1) cpuid(0) Px State info: (XEN) _PPC: 0 (XEN) Set CPU acpi_id(2) cpuid(1) Px State info: (XEN) _PPC: 0 (XEN) Set CPU acpi_id(3) cpuid(2) Px State info: (XEN) _PPC: 0 (XEN) Set CPU acpi_id(4) cpuid(3) Px State info: (XEN) _PPC: 0 (XEN) Set CPU acpi_id(5) cpuid(4) Px State info: (XEN) _PPC: 0 (XEN) Set CPU acpi_id(6) cpuid(5) Px State info: (XEN) _PPC: 0 (XEN) Set CPU acpi_id(7) cpuid(6) Px State info: (XEN) _PPC: 0 (XEN) Set CPU acpi_id(8) cpuid(7) Px State info: (XEN) _PPC: 0 (XEN) io_apic.c:2291:=20 (XEN) ioapic_guest_write: apic=3D0, pin=3D16, irq=3D16 (XEN) ioapic_guest_write: new_entry=3D0001a910 (XEN) ioapic_guest_write: Attempt to modify IO-APIC pin for in-use IRQ! (XEN) io_apic.c:2291:=20 (XEN) ioapic_guest_write: apic=3D0, pin=3D23, irq=3D23 (XEN) ioapic_guest_write: new_entry=3D0001a917 (XEN) ioapic_guest_write: Attempt to modify IO-APIC pin for in-use IRQ! (XEN) io_apic.c:2291:=20 (XEN) ioapic_guest_write: apic=3D0, pin=3D19, irq=3D19 (XEN) ioapic_guest_write: new_entry=3D0001a913 (XEN) ioapic_guest_write: Attempt to modify IO-APIC pin for in-use IRQ! (XEN) io_apic.c:2291:=20 (XEN) ioapic_guest_write: apic=3D0, pin=3D18, irq=3D18 (XEN) ioapic_guest_write: new_entry=3D0001a912 (XEN) ioapic_guest_write: Attempt to modify IO-APIC pin for in-use IRQ! (XEN) io_apic.c:2291:=20 (XEN) ioapic_guest_write: apic=3D0, pin=3D18, irq=3D18 (XEN) ioapic_guest_write: new_entry=3D0001a912 (XEN) ioapic_guest_write: Attempt to modify IO-APIC pin for in-use IRQ! Han, Weidong wrote: >=20 > Fantu, >=20 > Can you try with the attached patch? and pls post the output of "lspci > -v"? >=20 > Regards, > Weidong >=20 > From: xen-devel-bounces@lists.xensource.com > [mailto:xen-devel-bounces@lists.xensource.com] On Behalf Of Weidong Han > Sent: Friday, January 08, 2010 10:46 AM > To: Pasi K=C3=A4rkk=C3=A4inen > Cc: xen-devel@lists.xensource.com; Fantu > Subject: Re: [Xen-devel] Memory mapping for PEG/PCIe Graphics Passthrough > to DomU >=20 > Pasi K=C3=A4rkk=C3=A4inen wrote: >=20 > On Thu, Jan 07, 2010 at 08:14:47AM -0800, Fantu wrote: >=20 >=20 >=20 > i have grub2 also here and i have add dummy=3Dfoo before root... >=20 >=20 >=20 > xm dmesg >=20 > ]) >=20 > (XEN) [VT-D]dmar.c:548: Host address width 39 >=20 > (XEN) [VT-D]dmar.c:557: found ACPI_DMAR_DRHD: >=20 > (XEN) [VT-D]dmar.c:374: dmaru->address =3D fbfff000 >=20 > (XEN) [VT-D]dmar.c:326: endpoint: 0:1b.0 >=20 > (XEN) [VT-D]dmar.c:557: found ACPI_DMAR_DRHD: >=20 > (XEN) [VT-D]dmar.c:374: dmaru->address =3D fbffe000 >=20 > (XEN) [VT-D]dmar.c:331: IOAPIC: f0:1f.7 >=20 > (XEN) [VT-D]dmar.c:331: IOAPIC: 0:13.0 >=20 > (XEN) [VT-D]dmar.c:386: flags: INCLUDE_ALL >=20 > (XEN) [VT-D]dmar.c:561: found ACPI_DMAR_RMRR: >=20 > (XEN) [VT-D]dmar.c:446: RMRR region: base_addr ec000 end_address effff >=20 > (XEN) [VT-D]dmar.c:326: endpoint: 0:1d.0 >=20 > (XEN) [VT-D]dmar.c:326: endpoint: 0:1d.1 >=20 > (XEN) [VT-D]dmar.c:326: endpoint: 0:1d.2 >=20 > (XEN) [VT-D]dmar.c:326: endpoint: 0:1d.7 >=20 > (XEN) [VT-D]dmar.c:326: endpoint: 0:1a.0 >=20 > (XEN) [VT-D]dmar.c:326: endpoint: 0:1a.1 >=20 > (XEN) [VT-D]dmar.c:326: endpoint: 0:1a.2 >=20 > (XEN) [VT-D]dmar.c:326: endpoint: 0:1a.7 >=20 > (XEN) [VT-D]dmar.c:561: found ACPI_DMAR_RMRR: >=20 > (XEN) [VT-D]dmar.c:417: RMRR error: base_addr bf7dc000 end_address > bf7dbfff >=20 > (XEN) Failed to parse ACPI DMAR. Disabling VT-d. >=20 >=20 >=20 >=20 >=20 >=20 >=20 > This looks like you have a buggy BIOS, it doesn't have correct DMAR RMRR > table.. >=20 >=20 >=20 > When RMRR address range is not in reserved memory (BIOS issue), can use >=20 > 'iommu_inclusive_mapping=3D1' to work around it. >=20 >=20 >=20 > So try that options for xen.gz in grub config. >=20 >=20 >=20 > http://wiki.xensource.com/xenwiki/VTdHowTo >=20 >=20 >=20 >=20 >=20 >=20 > yes, obviously the RMRR is setting incorrectly in BIOS. The base address > shouldn't be greater than end address. "iommu_inclusive_mapping=3D1" cann= ot > help here. You should report this issue to the vendor and ask for a > correct BIOS. >=20 > Regards, > Weidong >=20 >=20 >=20 >=20 >=20 >=20 > _______________________________________________ >=20 > Xen-devel mailing list >=20 > Xen-devel@lists.xensource.com >=20 > http://lists.xensource.com/xen-devel >=20 >=20 >=20 >=20 > =20 > _______________________________________________ > Xen-devel mailing list > Xen-devel@lists.xensource.com > http://lists.xensource.com/xen-devel >=20 >=20 --=20 View this message in context: http://old.nabble.com/Memory-mapping-for-PEG-= PCIe-Graphics-Passthrough-to-%3Cany%3E-DomU-tp22783371p27111077.html Sent from the Xen - Dev mailing list archive at Nabble.com.