Re: PCI passthrough issue

[Jean Baptiste Favre <xen-devel@jbfavre.org>]

[-- Attachment #1: Type: text/plain, Size: 3064 bytes --]

Hello Ian,

My domU config file:

# cat /cluster/xen/xps-106.cfg
kernel       = '/cluster/kernels/vmlinuz-2.6.37-trunk-686-bigmem'
ramdisk      = '/cluster/kernels/initrd.img-2.6.37-trunk-686-bigmem'
builder      = 'linux'
memory       = '398'
vcpus        = '1'
cpus         = '2'
localtime    = 0
serial       = 'pty'
boot         = 'cdn'
disk         = [ 'drbd:xps-106,xvda,w' ]
on_poweroff  = 'destroy'
on_reboot    = 'restart'
on_crash     = 'restart'
extra = "root=/dev/mapper/xps--106-root ro iommu=soft swiotlb=force
console=hvc0 xencons=tty"
pci = [ '04:00.0' ]
name         = 'xps-106'
hostname     = 'xps-106.clichy.jbfavre.org'


Le 02/02/2011 10:27, Ian Campbell a écrit :
> On Tue, 2011-02-01 at 22:04 +0000, Jean Baptiste Favre wrote:
> > Le 01/02/2011 17:23, Ian Campbell a écrit :
>
> >> I assume you are not seeing "rx mapping error" in your domU dmesg? Did
> >> you post a full guest console log at some point? Comparing the logs for
> >> the 256MB, 398MB and 512MB guest RAM case might be useful.
> > No sure I've ever posted that logs. But I can redo my tests :)
>
> yes, please do that.
Please find attached both console startup logs with 256M and 512M:
256M_domU_console_logs.txt
512M_domU_console_logs.txt

For 512M, I saw some kernel CallTrace I can not explain. There are not
present with 256M.

For 398M memory, I can't even start domU :
# xm create /cluster/xen/xps-106.cfg -c
Using config file "/cluster/xen/xps-106.cfg".
[215739.007871] pciback 0000:04:00.0: device has been assigned to
another domain! Over-writting the ownership, but beware.
Started domain xps-106 (id=23)
(XEN) mm.c:798:d23 Non-privileged (23) attempt to map I/O space 00000000
(XEN) mm.c:4644:d23 ptwr_emulate: could not get_page_from_l1e()

As I told you, I'm still using Debian 2.6.37 kernel because I've some
problem to compile 2.6.32.27 from Jeremy's git repository.
I hope I can get it compiled today so I'll be able to test with that
kernel as well.

>
> Please can you also collect and post the information from ifconfig and
> ethtool -S which I asked for earlier.
Attached as well:
256_domU_ifconfig_ping_ethtool.txt
512_domU_ifconfig_ping_ethtool.txt

> Can you confirm that on the domU tcpdump shows no incoming frames at
> all, including no corrupted or strange frames. It has been suggested
> that the frames could be being received ok but contain garbage (e.g. due
> to swiotlb not syncing the memory properly) and hence are not ICMP
> Responses but appear as some random frame type.
>
> Please can you use "tcpdump -w" on both the gateway/peer side and the
> affected domU to capture a short session while the failing ping is
> running and post (or link to if large) the resulting pcap files. On the
> peer side you can use "ether host <domU-MAC>" (plus optionally "or ether
> broadcast") on the tcpdump command line to limit the capture to just the
> one peer and reduce the size of the capture.
I'll update you as soon as I have tcpdump captures ready.

Regards,
JB

[-- Attachment #2: 512M_domU_ifconfig_ping_ethtool.txt --]
[-- Type: text/plain, Size: 2936 bytes --]

# ifconfig
eth0      Link encap:Ethernet  HWaddr 00:1f:c6:eb:71:43
          inet addr:10.0.0.106  Bcast:10.0.0.255  Mask:255.255.255.0
          inet6 addr: fe80::21f:c6ff:feeb:7143/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:2 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:120 (120.0 B)  TX bytes:468 (468.0 B)
          Interrupt:18

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

# ping -c5 10.0.0.1
PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data.
64 bytes from 10.0.0.1: icmp_req=1 ttl=64 time=0.823 ms
64 bytes from 10.0.0.1: icmp_req=2 ttl=64 time=0.856 ms
64 bytes from 10.0.0.1: icmp_req=3 ttl=64 time=0.831 ms
64 bytes from 10.0.0.1: icmp_req=4 ttl=64 time=0.824 ms
64 bytes from 10.0.0.1: icmp_req=5 ttl=64 time=0.830 ms

--- 10.0.0.1 ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 3998ms
rtt min/avg/max/mdev = 0.823/0.832/0.856/0.038 ms

# ping -c5 -s86 10.0.0.1
PING 10.0.0.1 (10.0.0.1) 86(114) bytes of data.
94 bytes from 10.0.0.1: icmp_req=1 ttl=64 time=1.25 ms
94 bytes from 10.0.0.1: icmp_req=2 ttl=64 time=0.861 ms
94 bytes from 10.0.0.1: icmp_req=3 ttl=64 time=0.895 ms
94 bytes from 10.0.0.1: icmp_req=4 ttl=64 time=0.868 ms
94 bytes from 10.0.0.1: icmp_req=5 ttl=64 time=0.864 ms

--- 10.0.0.1 ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 3998ms
rtt min/avg/max/mdev = 0.861/0.949/1.259/0.157 ms
# ethtool -S eth0
NIC statistics:
     tx_bytes: 5651
     rx_bytes: 78580
     tx_broadcast: 1
     rx_broadcast: 5
     tx_multicast: 6
     rx_multicast: 0
     tx_unicast: 60
     rx_unicast: 75
     tx_mac_pause: 0
     rx_mac_pause: 0
     collisions: 0
     late_collision: 0
     aborted: 0
     single_collisions: 0
     multi_collisions: 0
     rx_short: 0
     rx_runt: 0
     rx_64_byte_packets: 9
     rx_65_to_127_byte_packets: 12
     rx_128_to_255_byte_packets: 9
     rx_256_to_511_byte_packets: 0
     rx_512_to_1023_byte_packets: 0
     rx_1024_to_1518_byte_packets: 50
     rx_1518_to_max_byte_packets: 0
     rx_too_long: 0
     rx_fifo_overflow: 0
     rx_jabber: 0
     rx_fcs_error: 0
     tx_64_byte_packets: 4
     tx_65_to_127_byte_packets: 55
     tx_128_to_255_byte_packets: 8
     tx_256_to_511_byte_packets: 0
     tx_512_to_1023_byte_packets: 0
     tx_1024_to_1518_byte_packets: 0
     tx_1519_to_max_byte_packets: 0
     tx_fifo_underrun: 0

[-- Attachment #3: 256M_domU_console_logs.txt --]
[-- Type: text/plain, Size: 12426 bytes --]

# xm create /cluster/xen/xps-106.cfg -c
Using config file "/cluster/xen/xps-106.cfg".
[213362.865921] pciback 0000:04:00.0: device has been assigned to another domain! Over-writting the ownership, but beware.
Started domain xps-106 (id=16)
[    0.000000] Reserving virtual address space above 0xf5800000
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 2.6.37-trunk-686-bigmem (Debian 2.6.37-1~experimental.1) (ben@decadent.org.uk) (gcc version 4.4.5 (Debian 4.4.5-10)
 ) #1 SMP Thu Jan 6 15:21:44 UTC 2011
[    0.000000] ACPI in unprivileged domain disabled
[    0.000000] released 0 pages of unused memory
[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  (XEN) traps.c:2308:d16 Domain attempted WRMSR 00000000c0010004 from 0000c0b2:cbfa8461 to 00000000:0000abcd.
Xen: 0000000000000000 - 00000000000a0000 (usable)
[    0.000000]  Xen: 00000000000a0000 - 0000000000100000 (reserved)
[    0.000000]  Xen: 0000000000100000 - 0000000010800000 (usable)
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] DMI not present or invalid.
[    0.000000] last_pfn = 0x10800 max_arch_pfn = 0x1000000
[    0.000000] init_memory_mapping: 0000000000000000-0000000010800000
[    0.000000] RAMDISK: 01793000 - 02ecc000
[    0.000000] 0MB HIGHMEM available.
[    0.000000] 264MB LOWMEM available.
[    0.000000]   mapped low ram: 0 - 10800000
[    0.000000]   low ram: 0 - 10800000
[    0.000000] Zone PFN ranges:
[    0.000000]   DMA      0x00000010 -> 0x00001000
[    0.000000]   Normal   0x00001000 -> 0x00010800
[    0.000000]   HighMem  empty
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[2] active PFN ranges
[    0.000000]     0: 0x00000010 -> 0x000000a0
[    0.000000]     0: 0x00000100 -> 0x00010800
[    0.000000] Using APIC driver default
[    0.000000] SFI: Simple Firmware Interface v0.81 http://simplefirmware.org
[    0.000000] SMP: Allowing 1 CPUs, 0 hotplug CPUs
[    0.000000] Local APIC disabled by BIOS -- you can enable it with "lapic"
[    0.000000] APIC: disable apic facility
[    0.000000] APIC: switched to apic NOOP
[    0.000000] PM: Registered nosave memory: 00000000000a0000 - 0000000000100000
[    0.000000] Allocating PCI resources starting at 10800000 (gap: 10800000:ef800000)
[    0.000000] Booting paravirtualized kernel on Xen
[    0.000000] Xen version: 4.0.1 (preserve-AD)
[    0.000000] setup_percpu: NR_CPUS:32 nr_cpumask_bits:32 nr_cpu_ids:1 nr_node_ids:1
[    0.000000] PERCPU: Embedded 13 pages/cpu @cfddf000 s30336 r0 d22912 u53248
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 66944
[    0.000000] Kernel command line: root=/dev/mapper/xps--106-root ro iommu=soft swiotlb=force console=hvc0 xencons=tty
[    0.000000] PID hash table entries: 2048 (order: 1, 8192 bytes)
[    0.000000] Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
[    0.000000] Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
[    0.000000] Initializing CPU#0
[    0.000000] Placing 64MB software IO TLB between cbd7ee40 - cfd7ee40
[    0.000000] software IO TLB at phys 0xbd7ee40 - 0xfd7ee40
[    0.000000] Initializing HighMem for node 0 (00000000:00000000)
[    0.000000] Memory: 163268k/270336k available (2703k kernel code, 106620k reserved, 1410k data, 412k init, 0k highmem)
[    0.000000] virtual kernel memory layout:
[    0.000000]     fixmap  : 0xf5536000 - 0xf57ff000   (2852 kB)
[    0.000000]     pkmap   : 0xf5200000 - 0xf5400000   (2048 kB)
[    0.000000]     vmalloc : 0xd1000000 - 0xf51fe000   ( 577 MB)
[    0.000000]     lowmem  : 0xc0000000 - 0xd0800000   ( 264 MB)
[    0.000000]       .init : 0xc1405000 - 0xc146c000   ( 412 kB)
[    0.000000]       .data : 0xc12a3d40 - 0xc14046e0   (1410 kB)
[    0.000000]       .text : 0xc1000000 - 0xc12a3d40   (2703 kB)
[    0.000000] SLUB: Genslabs=15, HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000]  RCU dyntick-idle grace-period acceleration is enabled.
[    0.000000]  RCU-based detection of stalled CPUs is disabled.
[    0.000000] NR_IRQS:1280
[    0.000000] Console: colour dummy device 80x25
[    0.000000] console [tty0] enabled
[    0.000000] console [hvc0] enabled
[    0.000000] installing Xen timer for CPU 0
[    0.000000] Detected 2506.222 MHz processor.
[    0.004000] Calibrating delay loop (skipped), value calculated using timer frequency.. 5012.44 BogoMIPS (lpj=10024888)
[    0.004000] pid_max: default: 32768 minimum: 301
[    0.004000] Security Framework initialized
[    0.004000] SELinux:  Disabled at boot.
[    0.004000] Mount-cache hash table entries: 512
[    0.004000] Initializing cgroup subsys ns
[    0.004000] ns_cgroup deprecated: consider using the 'clone_children' flag without the ns_cgroup.
[    0.004000] Initializing cgroup subsys cpuacct
[    0.004000] Initializing cgroup subsys devices
[    0.004000] Initializing cgroup subsys freezer
[    0.004000] Initializing cgroup subsys net_cls
[    0.004000] Initializing cgroup subsys blkio
[    0.004000] CPU: Physical Processor ID: 0
[    0.004000] CPU: Processor Core ID: 0
[    0.004000] Performance Events:
[    0.004000] no APIC, boot with the "lapic" boot parameter to force-enable it.
[    0.004000] no hardware sampling interrupt available.
[    0.004000] Broken PMU hardware detected, software events only.
[    0.004000] SMP alternatives: switching to UP code
[    0.008000] Freeing SMP alternatives: 16k freed
[    0.008246] NMI watchdog disabled for cpu0: unable to create perf event: -2
[    0.008354] Brought up 1 CPUs
[    0.008444] devtmpfs: initialized
[    0.008790] Grant table initialized
[    0.008797] regulator: core version 0.5
[    0.008851] regulator: dummy:
[    0.008900] NET: Registered protocol family 16
[    0.009099] PCI: setting up Xen PCI frontend stub
[    0.009099] bio: create slab <bio-0> at 0
[    0.009099] ACPI: Interpreter disabled.
[    0.009099] xen_balloon: Initialising balloon driver.
[    0.009099] last_pfn = 0x10800 max_arch_pfn = 0x1000000
[    0.009099] vgaarb: loaded
[    0.009099] PCI: System does not support PCI
[    0.009099] PCI: System does not support PCI
[    0.009099] Switching to clocksource xen
[    0.009443] pnp: PnP ACPI: disabled
[    0.009452] PnPBIOS: Disabled
[    0.011710] NET: Registered protocol family 2
[    0.011757] IP route cache hash table entries: 4096 (order: 2, 16384 bytes)
[    0.011940] TCP established hash table entries: 16384 (order: 5, 131072 bytes)
[    0.012014] TCP bind hash table entries: 16384 (order: 5, 131072 bytes)
[    0.012075] TCP: Hash tables configured (established 16384 bind 16384)
[    0.012082] TCP reno registered
[    0.012088] UDP hash table entries: 256 (order: 1, 8192 bytes)
[    0.012098] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes)
[    0.012164] NET: Registered protocol family 1
[    0.012221] Unpacking initramfs...
[    0.068739] Freeing initrd memory: 23780k freed
[    0.076752] platform rtc_cmos: registered platform RTC device (no PNP device found)
[    0.076997] audit: initializing netlink socket (disabled)
[    0.077014] type=2000 audit(1296639642.987:1): initialized
[    0.085690] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    0.087728] VFS: Disk quotas dquot_6.5.2
[    0.087800] Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[    0.087899] msgmni has been set to 365
[    0.088100] alg: No test for stdrng (krng)
[    0.088169] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
[    0.088178] io scheduler noop registered
[    0.088183] io scheduler deadline registered
[    0.088199] io scheduler cfq registered (default)
[    0.088422] isapnp: Scanning for PnP cards...
[    0.804965] isapnp: No Plug & Play device found
[    0.810882] Linux agpgart interface v0.103
[    0.810978] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    0.811280] PNP: No PS/2 controller found. Probing ports directly.
[    0.812099] i8042.c: No controller found.
[    0.812196] mice: PS/2 mouse device common for all mice
[    0.812315] rtc_cmos rtc_cmos: rtc core: registered rtc_cmos as rtc0
[    0.812339] pcifront pci-0: Installing PCI frontend
[    0.812380] rtc_cmos: probe of rtc_cmos failed with error -38
[    0.812407] cpuidle: using governor ladder
[    0.812413] cpuidle: using governor menu
[    0.812690] pcifront pci-0: Creating PCI Frontend Bus 0000:00
[    0.816145] pcifront pci-0: claiming resource 0000:00:00.0/0
[    0.816145] pcifront pci-0: claiming resource 0000:00:00.0/2
[    0.818358] TCP cubic registered
[    0.818508] NET: Registered protocol family 10
[    0.818840] lo: Disabled Privacy Extensions
[    0.819043] Mobile IPv6
[    0.819050] NET: Registered protocol family 17
[    0.819058] Registering the dns_resolver key type
[    0.819084] Using IPI No-Shortcut mode
[    0.819211] registered taskstats version 1
[    0.916059] XENBUS: Device with no driver: device/vbd/51712
[    0.916074] XENBUS: Device with no driver: device/console/0
[    0.916101] /build/buildd-linux-2.6_2.6.37-1~experimental.1-i386-rePuD0/linux-2.6-2.6.37/debian/build/source_i386_none/drivers/rtc/hctosys.c: unable to open rtc device (rtc0)
[    0.916134] Initalizing network drop monitor service
[    0.916238] Freeing unused kernel memory: 412k freed
[    0.917011] Write protecting the kernel text: 2704k
[    0.917255] Write protecting the kernel read-only data: 1016k
Loading, please wait...
[    0.976345] udev[46]: starting version 164
[    1.105266] sky2: driver version 1.28
[    1.121166] sky2 0000:00:00.0: BAR 0: set to [mem 0xfeb00000-0xfeb03fff 64bit] (PCI address [0xfeb00000-0xfeb03fff])
[    1.121258] sky2 0000:00:00.0: BAR 2: set to [io  0xe800-0xe8ff] (PCI address [0xe800-0xe8ff])
[    1.121330] sky2 0000:00:00.0: enabling device (0000 -> 0003)
[    1.121454] sky2 0000:00:00.0: Xen PCI enabling IRQ: 18
[    1.121649] sky2 0000:00:00.0: Yukon-2 EC Ultra chip revision 3
[    1.122871] sky2 0000:00:00.0: eth0: addr 00:1f:c6:eb:71:43
[    1.133172] blkfront: xvda: barriers enabled
[    1.134906]  xvda: xvda1 xvda2
Begin: Loading essential drivers ... done.
Begin: Running /scripts/init-premount ... done.
Begin: Mounting root file system ... Begin: Running /scripts/local-top ... [    1.340290] device-mapper: uevent: version 1.0.3
[    1.340867] device-mapper: ioctl: 4.18.0-ioctl (2010-06-29) initialised: dm-devel@redhat.com
done.
Begin: Running /scripts/local-premount ... done.
[    1.579694] EXT3-fs: barriers not enabled
[    1.585025] kjournald starting.  Commit interval 5 seconds
[    1.585063] EXT3-fs (dm-0): mounted filesystem with ordered data mode
Begin: Running /scripts/local-bottom ... done.
done.
Begin: Running /scripts/init-bottom ... done.
INIT: version 2.88 booting
Using makefile-style concurrent boot in runlevel S.
Starting the hotplug events dispatcher: udevd[    2.575753] udev[167]: starting version 164
.
Synthesizing the initial hotplug events...done.
Waiting for /dev to be fully populated...[    2.904843] input: PC Speaker as /devices/platform/pcspkr/input/input0
done.
Activating swap...done.
[    6.253299] EXT3-fs (dm-0): warning: maximal mount count reached, running e2fsck is recommended
[    6.284848] EXT3-fs (dm-0): using internal journal
Loading kernel modules...done.
Cleaning up ifupdown....
Setting up networking....
Activating lvm and md swap...done.
Checking file systems...fsck from util-linux-ng 2.17.2
done.
Mounting local filesystems...done.
Activating swapfile swap...done.
Cleaning up temporary files....
Setting kernel variables ...done.
Configuring network interfaces...[    6.831911] sky2 0000:00:00.0: eth0: enabling interface
[    6.831997] ADDRCONF(NETDEV_UP): eth0: link is not ready
done.
Cleaning up temporary files....
INIT: Entering runlevel: 2
Using makefile-style concurrent boot in runlevel 2.
Starting enhanced syslogd: rsyslogd.
Starting periodic command scheduler: cron.

Debian GNU/Linux 6.0 xps-106 hvc0

xps-106 login: [    9.298080] sky2 0000:00:00.0: eth0: Link is up at 1000 Mbps, full duplex, flow control both
[    9.298150] ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready

[-- Attachment #4: 256M_domU_ifconfig_ping_ethtool.txt --]
[-- Type: text/plain, Size: 3787 bytes --]

# ifconfig
eth0      Link encap:Ethernet  HWaddr 00:1f:c6:eb:71:43
          inet addr:10.0.0.106  Bcast:10.0.0.255  Mask:255.255.255.0
          inet6 addr: fe80::21f:c6ff:feeb:7143/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 B)  TX bytes:468 (468.0 B)
          Interrupt:18

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

# ping -c5 10.0.0.1
PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data.
From 10.0.0.106 icmp_seq=1 Destination Host Unreachable
From 10.0.0.106 icmp_seq=2 Destination Host Unreachable
From 10.0.0.106 icmp_seq=3 Destination Host Unreachable
From 10.0.0.106 icmp_seq=4 Destination Host Unreachable
From 10.0.0.106 icmp_seq=5 Destination Host Unreachable

--- 10.0.0.1 ping statistics ---
5 packets transmitted, 0 received, +5 errors, 100% packet loss, time 4023ms
pipe 3
# ping -c5 -s86 10.0.0.1
PING 10.0.0.1 (10.0.0.1) 86(114) bytes of data.
From 10.0.0.106 icmp_seq=1 Destination Host Unreachable
From 10.0.0.106 icmp_seq=2 Destination Host Unreachable
From 10.0.0.106 icmp_seq=3 Destination Host Unreachable
From 10.0.0.106 icmp_seq=4 Destination Host Unreachable
From 10.0.0.106 icmp_seq=5 Destination Host Unreachable

--- 10.0.0.1 ping statistics ---
5 packets transmitted, 0 received, +5 errors, 100% packet loss, time 4024ms
pipe 3
# ifconfig
eth0      Link encap:Ethernet  HWaddr 00:1f:c6:eb:71:43
          inet addr:10.0.0.106  Bcast:10.0.0.255  Mask:255.255.255.0
          inet6 addr: fe80::21f:c6ff:feeb:7143/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:14 errors:0 dropped:14 overruns:0 frame:0
          TX packets:18 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:840 (840.0 B)  TX bytes:972 (972.0 B)
          Interrupt:18

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:10 errors:0 dropped:0 overruns:0 frame:0
          TX packets:10 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:1270 (1.2 KiB)  TX bytes:1270 (1.2 KiB)

# ethtool -S eth0
NIC statistics:
     tx_bytes: 1260
     rx_bytes: 896
     tx_broadcast: 12
     rx_broadcast: 2
     tx_multicast: 6
     rx_multicast: 0
     tx_unicast: 0
     rx_unicast: 12
     tx_mac_pause: 0
     rx_mac_pause: 0
     collisions: 0
     late_collision: 0
     aborted: 0
     single_collisions: 0
     multi_collisions: 0
     rx_short: 0
     rx_runt: 0
     rx_64_byte_packets: 14
     rx_65_to_127_byte_packets: 0
     rx_128_to_255_byte_packets: 0
     rx_256_to_511_byte_packets: 0
     rx_512_to_1023_byte_packets: 0
     rx_1024_to_1518_byte_packets: 0
     rx_1518_to_max_byte_packets: 0
     rx_too_long: 0
     rx_fifo_overflow: 0
     rx_jabber: 0
     rx_fcs_error: 0
     tx_64_byte_packets: 12
     tx_65_to_127_byte_packets: 6
     tx_128_to_255_byte_packets: 0
     tx_256_to_511_byte_packets: 0
     tx_512_to_1023_byte_packets: 0
     tx_1024_to_1518_byte_packets: 0
     tx_1519_to_max_byte_packets: 0
     tx_fifo_underrun: 0

[-- Attachment #5: 512M_domU_console_logs.txt --]
[-- Type: text/plain, Size: 16412 bytes --]

# xm create /cluster/xen/xps-106.cfg -c
Using config file "/cluster/xen/xps-106.cfg".
[214817.006300] pciback 0000:04:00.0: device has been assigned to another domain! Over-writting the ownership, but beware.
Started domain xps-106 (id=21)
(XEN) traps.c:2308:d21 Domain attempted WRMSR 00000000c0010004 from 0000c0b2:cbfa8461 to 00000000:0000abcd.
[    0.000000] Reserving virtual address space above 0xf5800000
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 2.6.37-trunk-686-bigmem (Debian 2.6.37-1~experimental.1) (ben@decadent.org.uk) (gcc version 4.4.5 (Debian 4.4.5-10) ) #1 SMP Thu Jan 6 15:21:44 UTC 2011
[    0.000000] ACPI in unprivileged domain disabled
[    0.000000] released 0 pages of unused memory
[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  Xen: 0000000000000000 - 00000000000a0000 (usable)
[    0.000000]  Xen: 00000000000a0000 - 0000000000100000 (reserved)
[    0.000000]  Xen: 0000000000100000 - 0000000020800000 (usable)
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] DMI not present or invalid.
[    0.000000] last_pfn = 0x20800 max_arch_pfn = 0x1000000
[    0.000000] init_memory_mapping: 0000000000000000-0000000020800000
[    0.000000] RAMDISK: 01793000 - 02ecc000
[    0.000000] 0MB HIGHMEM available.
[    0.000000] 520MB LOWMEM available.
[    0.000000]   mapped low ram: 0 - 20800000
[    0.000000]   low ram: 0 - 20800000
[    0.000000] Zone PFN ranges:
[    0.000000]   DMA      0x00000010 -> 0x00001000
[    0.000000]   Normal   0x00001000 -> 0x00020800
[    0.000000]   HighMem  empty
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[2] active PFN ranges
[    0.000000]     0: 0x00000010 -> 0x000000a0
[    0.000000]     0: 0x00000100 -> 0x00020800
[    0.000000] Using APIC driver default
[    0.000000] SFI: Simple Firmware Interface v0.81 http://simplefirmware.org
[    0.000000] SMP: Allowing 1 CPUs, 0 hotplug CPUs
[    0.000000] Local APIC disabled by BIOS -- you can enable it with "lapic"
[    0.000000] APIC: disable apic facility
[    0.000000] APIC: switched to apic NOOP
[    0.000000] PM: Registered nosave memory: 00000000000a0000 - 0000000000100000
[    0.000000] Allocating PCI resources starting at 20800000 (gap: 20800000:df800000)
[    0.000000] Booting paravirtualized kernel on Xen
[    0.000000] Xen version: 4.0.1 (preserve-AD)
[    0.000000] setup_percpu: NR_CPUS:32 nr_cpumask_bits:32 nr_cpu_ids:1 nr_node_ids:1
[    0.000000] PERCPU: Embedded 13 pages/cpu @dfbde000 s30336 r0 d22912 u53248
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 131968
[    0.000000] Kernel command line: root=/dev/mapper/xps--106-root ro iommu=soft swiotlb=force console=hvc0 xencons=tty
[    0.000000] PID hash table entries: 4096 (order: 2, 16384 bytes)
[    0.000000] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
[    0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
[    0.000000] Initializing CPU#0
[    0.000000] Placing 64MB software IO TLB between dbb1a000 - dfb1a000
[    0.000000] software IO TLB at phys 0x1bb1a000 - 0x1fb1a000
[    0.000000] Initializing HighMem for node 0 (00000000:00000000)
[    0.000000] Memory: 422200k/532480k available (2703k kernel code, 109832k reserved, 1410k data, 412k init, 0k highmem)
[    0.000000] virtual kernel memory layout:
[    0.000000]     fixmap  : 0xf5536000 - 0xf57ff000   (2852 kB)
[    0.000000]     pkmap   : 0xf5200000 - 0xf5400000   (2048 kB)
[    0.000000]     vmalloc : 0xe1000000 - 0xf51fe000   ( 321 MB)
[    0.000000]     lowmem  : 0xc0000000 - 0xe0800000   ( 520 MB)
[    0.000000]       .init : 0xc1405000 - 0xc146c000   ( 412 kB)
[    0.000000]       .data : 0xc12a3d40 - 0xc14046e0   (1410 kB)
[    0.000000]       .text : 0xc1000000 - 0xc12a3d40   (2703 kB)
[    0.000000] SLUB: Genslabs=15, HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000]  RCU dyntick-idle grace-period acceleration is enabled.
[    0.000000]  RCU-based detection of stalled CPUs is disabled.
[    0.000000] NR_IRQS:1280
[    0.000000] Console: colour dummy device 80x25
[    0.000000] console [tty0] enabled
[    0.000000] console [hvc0] enabled
[    0.000000] installing Xen timer for CPU 0
[    0.000000] Detected 2506.222 MHz processor.
[    0.004000] Calibrating delay loop (skipped), value calculated using timer frequency.. 5012.44 BogoMIPS (lpj=10024888)
[    0.004000] pid_max: default: 32768 minimum: 301
[    0.004000] Security Framework initialized
[    0.004000] SELinux:  Disabled at boot.
[    0.004000] Mount-cache hash table entries: 512
[    0.004000] Initializing cgroup subsys ns
[    0.004000] ns_cgroup deprecated: consider using the 'clone_children' flag without the ns_cgroup.
[    0.004000] Initializing cgroup subsys cpuacct
[    0.004000] Initializing cgroup subsys devices
[    0.004000] Initializing cgroup subsys freezer
[    0.004000] Initializing cgroup subsys net_cls
[    0.004000] Initializing cgroup subsys blkio
[    0.004000] CPU: Physical Processor ID: 0
[    0.004000] CPU: Processor Core ID: 0
[    0.004000] Performance Events:
[    0.004000] no APIC, boot with the "lapic" boot parameter to force-enable it.
[    0.004000] no hardware sampling interrupt available.
[    0.004000] Broken PMU hardware detected, software events only.
[    0.004000] SMP alternatives: switching to UP code
[    0.010317] Freeing SMP alternatives: 16k freed
[    0.010560] NMI watchdog disabled for cpu0: unable to create perf event: -2
[    0.010645] Brought up 1 CPUs
[    0.010735] devtmpfs: initialized
[    0.011056] Grant table initialized
[    0.011063] regulator: core version 0.5
[    0.011122] regulator: dummy:
[    0.011169] NET: Registered protocol family 16
[    0.011366] PCI: setting up Xen PCI frontend stub
[    0.012488] bio: create slab <bio-0> at 0
[    0.012557] ACPI: Interpreter disabled.
[    0.012582] xen_balloon: Initialising balloon driver.
[    0.012582] last_pfn = 0x20800 max_arch_pfn = 0x1000000
[    0.012582] vgaarb: loaded
[    0.012582] PCI: System does not support PCI
[    0.012582] PCI: System does not support PCI
[    0.012582] Switching to clocksource xen
[    0.013423] pnp: PnP ACPI: disabled
[    0.013430] PnPBIOS: Disabled
[    0.015641] NET: Registered protocol family 2
[    0.015690] IP route cache hash table entries: 8192 (order: 3, 32768 bytes)
[    0.015896] TCP established hash table entries: 32768 (order: 6, 262144 bytes)
[    0.016029] TCP bind hash table entries: 32768 (order: 6, 262144 bytes)
[    0.016148] TCP: Hash tables configured (established 32768 bind 32768)
[    0.016155] TCP reno registered
[    0.016161] UDP hash table entries: 512 (order: 2, 16384 bytes)
[    0.016176] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes)
[    0.016308] NET: Registered protocol family 1
[    0.016366] Unpacking initramfs...
[    0.072960] Freeing initrd memory: 23780k freed
[    0.080894] platform rtc_cmos: registered platform RTC device (no PNP device found)
[    0.081131] audit: initializing netlink socket (disabled)
[    0.081148] type=2000 audit(1296641097.317:1): initialized
[    0.089493] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    0.091528] VFS: Disk quotas dquot_6.5.2
[    0.091595] Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[    0.091696] msgmni has been set to 871
[    0.091893] alg: No test for stdrng (krng)
[    0.091961] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
[    0.091970] io scheduler noop registered
[    0.091976] io scheduler deadline registered
[    0.091992] io scheduler cfq registered (default)
[    0.152319] isapnp: Scanning for PnP cards...
[    0.856077] isapnp: No Plug & Play device found
[    0.861733] Linux agpgart interface v0.103
[    0.861829] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    0.862138] PNP: No PS/2 controller found. Probing ports directly.
[    0.862960] i8042.c: No controller found.
[    0.863034] mice: PS/2 mouse device common for all mice
[    0.863161] rtc_cmos rtc_cmos: rtc core: registered rtc_cmos as rtc0
[    0.863210] rtc_cmos: probe of rtc_cmos failed with error -38
[    0.863235] cpuidle: using governor ladder
[    0.863242] cpuidle: using governor menu
[    0.863432] pcifront pci-0: Installing PCI frontend
[    0.863498] TCP cubic registered
[    0.863646] pcifront pci-0: Creating PCI Frontend Bus 0000:00
[    0.881473] NET: Registered protocol family 10
[    0.881816] lo: Disabled Privacy Extensions
[    0.882024] Mobile IPv6
[    0.882031] NET: Registered protocol family 17
[    0.882039] Registering the dns_resolver key type
[    0.882058] Using IPI No-Shortcut mode
[    0.882190] registered taskstats version 1
[    0.884859] pcifront pci-0: claiming resource 0000:00:00.0/0
[    0.884868] pcifront pci-0: claiming resource 0000:00:00.0/2
[    0.980061] XENBUS: Device with no driver: device/vbd/51712
[    0.980075] XENBUS: Device with no driver: device/console/0
[    0.980100] /build/buildd-linux-2.6_2.6.37-1~experimental.1-i386-rePuD0/linux-2.6-2.6.37/debian/build/source_i386_none/drivers/rtc/hctosys.c: unable to open rtc device (rtc0)
[    0.980132] Initalizing network drop monitor service
[    0.980232] Freeing unused kernel memory: 412k freed
[    0.981036] Write protecting the kernel text: 2704k
[    0.981303] Write protecting the kernel read-only data: 1016k
Loading, please wait...
[    1.060454] udev[46]: starting version 164
[    1.183225] sky2: driver version 1.28
[    1.183333] sky2 0000:00:00.0: Xen PCI enabling IRQ: 18
[    1.183528] sky2 0000:00:00.0: Yukon-2 EC Ultra chip revision 3
[    1.184784] sky2 0000:00:00.0: eth0: addr 00:1f:c6:eb:71:43
[    1.193834] blkfront: xvda: barriers enabled
[    1.195628]  xvda: xvda1 xvda2
[    1.349422] ------------[ cut here ]------------
[    1.349443] WARNING: at /build/buildd-linux-2.6_2.6.37-1~experimental.1-i386-rePuD0/linux-2.6-2.6.37/debian/build/source_i386_none/block/blk-core.c:337 blk_start_queue+0x1d/0x31()
[    1.349457] Modules linked in: sky2 xen_blkfront
[    1.349471] Pid: 0, comm: swapper Not tainted 2.6.37-trunk-686-bigmem #1
[    1.349478] Call Trace:
[    1.349487]  [<c1036005>] ? warn_slowpath_common+0x6a/0x7b
[    1.349494]  [<c1139fd9>] ? blk_start_queue+0x1d/0x31
[    1.349502]  [<c1036023>] ? warn_slowpath_null+0xd/0x10
[    1.349509]  [<c1139fd9>] ? blk_start_queue+0x1d/0x31
[    1.349519]  [<e102a723>] ? kick_pending_request_queues+0x19/0x27 [xen_blkfront]
[    1.349529]  [<e102a925>] ? blkif_interrupt+0x1c8/0x1e3 [xen_blkfront]
[    1.349542]  [<c10753dc>] ? handle_IRQ_event+0x45/0xef
[    1.349550]  [<c1076c3d>] ? handle_fasteoi_irq+0x80/0xb1
[    1.349559]  [<c11a85d1>] ? __xen_evtchn_do_upcall+0xd0/0x155
[    1.349567]  [<c11a8cce>] ? xen_evtchn_do_upcall+0x18/0x26
[    1.349577]  [<c1009117>] ? xen_do_upcall+0x7/0xc
[    1.349584]  [<c10023a7>] ? hypercall_page+0x3a7/0x1001
[    1.349591]  [<c1006246>] ? xen_safe_halt+0xf/0x1b
[    1.349598]  [<c100e276>] ? default_idle+0x3f/0x5d
[    1.349605]  [<c1007dc4>] ? cpu_idle+0x98/0xdc
[    1.349613]  [<c14058a0>] ? start_kernel+0x320/0x325
[    1.349620]  [<c1407479>] ? xen_start_kernel+0x5a1/0x5a8
[    1.349627]  [<c1409046>] ? trap_init+0x1fe/0x367
[    1.349633] ---[ end trace c57c5a433d71a17e ]---
[    1.349638] ------------[ cut here ]------------
[    1.349645] WARNING: at /build/buildd-linux-2.6_2.6.37-1~experimental.1-i386-rePuD0/linux-2.6-2.6.37/debian/build/source_i386_none/block/blk-core.c:245 blk_remove_plug+0x1d/0x78()
[    1.349657] Modules linked in: sky2 xen_blkfront
[    1.349667] Pid: 0, comm: swapper Tainted: G        W   2.6.37-trunk-686-bigmem #1
[    1.349674] Call Trace:
[    1.349682]  [<c1036005>] ? warn_slowpath_common+0x6a/0x7b
[    1.349689]  [<c1139e6e>] ? blk_remove_plug+0x1d/0x78
[    1.349696]  [<c1036023>] ? warn_slowpath_null+0xd/0x10
[    1.349702]  [<c1139e6e>] ? blk_remove_plug+0x1d/0x78
[    1.349709]  [<c1139ed1>] ? __blk_run_queue+0x8/0x5b
[    1.349716]  [<e102a723>] ? kick_pending_request_queues+0x19/0x27 [xen_blkfront]
[    1.349725]  [<e102a925>] ? blkif_interrupt+0x1c8/0x1e3 [xen_blkfront]
[    1.349733]  [<c10753dc>] ? handle_IRQ_event+0x45/0xef
[    1.349743]  [<c1076c3d>] ? handle_fasteoi_irq+0x80/0xb1
[    1.349750]  [<c11a85d1>] ? __xen_evtchn_do_upcall+0xd0/0x155
[    1.349758]  [<c11a8cce>] ? xen_evtchn_do_upcall+0x18/0x26
[    1.349764]  [<c1009117>] ? xen_do_upcall+0x7/0xc
[    1.349773]  [<c10023a7>] ? hypercall_page+0x3a7/0x1001
[    1.349780]  [<c1006246>] ? xen_safe_halt+0xf/0x1b
[    1.349788]  [<c100e276>] ? default_idle+0x3f/0x5d
[    1.349795]  [<c1007dc4>] ? cpu_idle+0x98/0xdc
[    1.349801]  [<c14058a0>] ? start_kernel+0x320/0x325
[    1.349809]  [<c1407479>] ? xen_start_kernel+0x5a1/0x5a8
[    1.349816]  [<c1409046>] ? trap_init+0x1fe/0x367
[    1.349824] ---[ end trace c57c5a433d71a17f ]---
Begin: Loading essential drivers ... done.
Begin: Running /scripts/init-premount ... done.
Begin: Mounting root file system ... Begin: Running /scripts/local-top ... [    1.507113] device-mapper: uevent: version 1.0.3
[    1.507692] device-mapper: ioctl: 4.18.0-ioctl (2010-06-29) initialised: dm-devel@redhat.com
done.
Begin: Running /scripts/local-premount ... done.
[    1.644939] EXT3-fs: barriers not enabled
[    1.657461] kjournald starting.  Commit interval 5 seconds
[    1.657498] EXT3-fs (dm-0): mounted filesystem with ordered data mode
Begin: Running /scripts/local-bottom ... done.
done.
Begin: Running /scripts/init-bottom ... done.
INIT: version 2.88 booting
Using makefile-style concurrent boot in runlevel S.
Starting the hotplug events dispatcher: udevd[    2.746299] udev[156]: starting version 164
.
Synthesizing the initial hotplug events...done.
Waiting for /dev to be fully populated...[    3.080564] input: PC Speaker as /devices/platform/pcspkr/input/input0
done.
Activating swap...done.
[    6.062837] EXT3-fs (dm-0): warning: maximal mount count reached, running e2fsck is recommended
[    6.098388] EXT3-fs (dm-0): using internal journal
Loading kernel modules...done.
Cleaning up ifupdown....
Setting up networking....
Activating lvm and md swap...done.
Checking file systems...fsck from util-linux-ng 2.17.2
done.
Mounting local filesystems...done.
Activating swapfile swap...done.
Cleaning up temporary files....
Setting kernel variables ...done.
[    6.652343] sky2 0000:00:00.0: eth0: enabling interface
[    6.652423] ADDRCONF(NETDEV_UP): eth0: link is not ready
Configuring network interfaces...done.
Begin: Running /scripts/local-bottom ... done.
done.
Begin: Running /scripts/init-bottom ... done.
INIT: version 2.88 booting
Using makefile-style concurrent boot in runlevel S.
Starting the hotplug events dispatcher: udevd[    2.746299] udev[156]: starting version 164
.
Synthesizing the initial hotplug events...done.
Waiting for /dev to be fully populated...[    3.080564] input: PC Speaker as /devices/platform/pcspkr/input/input0
done.
Activating swap...done.
[    6.062837] EXT3-fs (dm-0): warning: maximal mount count reached, running e2fsck is recommended
[    6.098388] EXT3-fs (dm-0): using internal journal
Loading kernel modules...done.
Cleaning up ifupdown....
Setting up networking....
Activating lvm and md swap...done.
Checking file systems...fsck from util-linux-ng 2.17.2
done.
Mounting local filesystems...done.
Activating swapfile swap...done.
Cleaning up temporary files....
Setting kernel variables ...done.
[    6.652343] sky2 0000:00:00.0: eth0: enabling interface
[    6.652423] ADDRCONF(NETDEV_UP): eth0: link is not ready
Configuring network interfaces...done.
Cleaning up temporary files....
INIT: Entering runlevel: 2
Using makefile-style concurrent boot in runlevel 2.
Starting enhanced syslogd: rsyslogd.
Starting periodic command scheduler: cron.

Debian GNU/Linux 6.0 xps-106 hvc0

xps-106 login: [    9.148520] sky2 0000:00:00.0: eth0: Link is up at 1000 Mbps, full duplex, flow control both
[    9.148605] ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready

[-- Attachment #6: Type: text/plain, Size: 138 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel