* CPU enumeration in Xen @ 2007-08-22 10:34 Dominik Klein 2007-08-22 12:34 ` Keir Fraser 0 siblings, 1 reply; 9+ messages in thread From: Dominik Klein @ 2007-08-22 10:34 UTC (permalink / raw) To: xen-devel http://lists.xensource.com/archives/html/xen-users/2007-08/msg00507.html In this thread I posted some interesting experiment results which lead to the assumption that Xenified Linux does not enumerate CPUs the same way as a non-xen-Linux does. Can someone confirm this? Regards Dominik ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: CPU enumeration in Xen 2007-08-22 10:34 CPU enumeration in Xen Dominik Klein @ 2007-08-22 12:34 ` Keir Fraser 2007-08-22 13:39 ` Dominik Klein 2007-08-22 13:48 ` Daniel P. Berrange 0 siblings, 2 replies; 9+ messages in thread From: Keir Fraser @ 2007-08-22 12:34 UTC (permalink / raw) To: Dominik Klein, xen-devel It seems a bit unlikely, since the enumeration code is from Linux. Perhaps the enumeration order has changed in Linux? To my knowledge the enumeration order is determined by the order we find CPUs in the BIOS tables, and can hence vary across different systems, and even across BIOS upgrades. -- Keir On 22/8/07 11:34, "Dominik Klein" <dk@in-telegence.net> wrote: > http://lists.xensource.com/archives/html/xen-users/2007-08/msg00507.html > > In this thread I posted some interesting experiment results which lead > to the assumption that Xenified Linux does not enumerate CPUs the same > way as a non-xen-Linux does. > > Can someone confirm this? > > Regards > Dominik > > _______________________________________________ > Xen-devel mailing list > Xen-devel@lists.xensource.com > http://lists.xensource.com/xen-devel ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: CPU enumeration in Xen 2007-08-22 12:34 ` Keir Fraser @ 2007-08-22 13:39 ` Dominik Klein 2007-08-22 13:48 ` Daniel P. Berrange 1 sibling, 0 replies; 9+ messages in thread From: Dominik Klein @ 2007-08-22 13:39 UTC (permalink / raw) To: xen-devel Keir Fraser schrieb: > It seems a bit unlikely, since the enumeration code is from Linux. Perhaps > the enumeration order has changed in Linux? Here's what I see without Xen: # uname -r 2.6.18.2-34-default # grep -E "processor|physical" /proc/cpuinfo processor : 0 physical id : 0 processor : 1 physical id : 0 processor : 2 physical id : 3 processor : 3 physical id : 3 >> http://lists.xensource.com/archives/html/xen-users/2007-08/msg00507.html This was tested on the exact machine the output above is from. The described tests were made with 2.6.18 and xen 3.1.0 compiled from source. No redhat patches or something like that. From what I saw and described, it looks pretty clear that the numeration in Xen is different, but I cannot see the physical ID in /proc/cpuinfo to confirm that. Maybe there is another way to see that? Regards Dominik ps. i'll be on holiday for 3 days from now but i'll be happy to supply more information when i am back ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: CPU enumeration in Xen 2007-08-22 12:34 ` Keir Fraser 2007-08-22 13:39 ` Dominik Klein @ 2007-08-22 13:48 ` Daniel P. Berrange 2007-08-22 13:53 ` Keir Fraser 1 sibling, 1 reply; 9+ messages in thread From: Daniel P. Berrange @ 2007-08-22 13:48 UTC (permalink / raw) To: Keir Fraser; +Cc: xen-devel, Dominik Klein On Wed, Aug 22, 2007 at 01:34:47PM +0100, Keir Fraser wrote: > It seems a bit unlikely, since the enumeration code is from Linux. Perhaps > the enumeration order has changed in Linux? > > To my knowledge the enumeration order is determined by the order we find > CPUs in the BIOS tables, and can hence vary across different systems, and > even across BIOS upgrades. The HV may enumerate CPUs in the same way as Linux baremetal, but Dom0 sees VCPUs not physical CPUs. So /proc/cpuinfo in Dom0 will bear little resemblance to the same file on a bare metal machine. You'd need to compare the HV's view of physical CPUs to the Linux bare metal view, which isn't something you can do by merely comparing /proc/cpuinfo AFAICT. > On 22/8/07 11:34, "Dominik Klein" <dk@in-telegence.net> wrote: > > > http://lists.xensource.com/archives/html/xen-users/2007-08/msg00507.html > > > > In this thread I posted some interesting experiment results which lead > > to the assumption that Xenified Linux does not enumerate CPUs the same > > way as a non-xen-Linux does. > > > > Can someone confirm this? Also, the Dom0 sees no (NUMA) topology - all CPUs are considered equal, so Dom0 doesn't see any of the hyperthread, cores, sockets, nodes relationship that a baremetal kernel sees - the HV of course knows about this topology but doesn't expose it to the guest kernels when assigning them vCPUs. Dan. -- |=- Red Hat, Engineering, Emerging Technologies, Boston. +1 978 392 2496 -=| |=- Perl modules: http://search.cpan.org/~danberr/ -=| |=- Projects: http://freshmeat.net/~danielpb/ -=| |=- GnuPG: 7D3B9505 F3C9 553F A1DA 4AC2 5648 23C1 B3DF F742 7D3B 9505 -=| ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: CPU enumeration in Xen 2007-08-22 13:48 ` Daniel P. Berrange @ 2007-08-22 13:53 ` Keir Fraser 2007-08-22 14:04 ` Dominik Klein 0 siblings, 1 reply; 9+ messages in thread From: Keir Fraser @ 2007-08-22 13:53 UTC (permalink / raw) To: Daniel P. Berrange; +Cc: xen-devel, Dominik Klein On 22/8/07 14:48, "Daniel P. Berrange" <berrange@redhat.com> wrote: >> To my knowledge the enumeration order is determined by the order we find >> CPUs in the BIOS tables, and can hence vary across different systems, and >> even across BIOS upgrades. > > The HV may enumerate CPUs in the same way as Linux baremetal, but Dom0 sees > VCPUs not physical CPUs. So /proc/cpuinfo in Dom0 will bear little resemblance > to the same file on a bare metal machine. You'd need to compare the HV's view > of physical CPUs to the Linux bare metal view, which isn't something you can > do by merely comparing /proc/cpuinfo AFAICT. Oh yes, I missed this stunningly obvious point. :-) If you want to tie dom0 VCPUs 1:1 with physical CPUs then you can put dom0_vcpus_pin on your Xen command line. To see how Xen enumerates the CPUs: look at 'xm dmesg', or look at Xen boot output, to see APIC IDs of processors as they are booted. -- Keir ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: CPU enumeration in Xen 2007-08-22 13:53 ` Keir Fraser @ 2007-08-22 14:04 ` Dominik Klein 2007-08-22 14:15 ` Keir Fraser 0 siblings, 1 reply; 9+ messages in thread From: Dominik Klein @ 2007-08-22 14:04 UTC (permalink / raw) To: xen-devel > If you want to tie dom0 VCPUs 1:1 with physical CPUs then you can put > dom0_vcpus_pin on your Xen command line. So then, when I do "xm vcpu-pin my-domain 0 1", it will pin VCPU0 in my-domain to the second HT of physical CPU 1? That would be great as it would be straight forward. Regards Dominik ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: CPU enumeration in Xen 2007-08-22 14:04 ` Dominik Klein @ 2007-08-22 14:15 ` Keir Fraser 2007-08-27 6:09 ` Dominik Klein 0 siblings, 1 reply; 9+ messages in thread From: Keir Fraser @ 2007-08-22 14:15 UTC (permalink / raw) To: Dominik Klein, xen-devel On 22/8/07 15:04, "Dominik Klein" <dk@in-telegence.net> wrote: >> If you want to tie dom0 VCPUs 1:1 with physical CPUs then you can put >> dom0_vcpus_pin on your Xen command line. > > So then, when I do "xm vcpu-pin my-domain 0 1", it will pin VCPU0 in > my-domain to the second HT of physical CPU 1? > > That would be great as it would be straight forward. Enumeration order is not guaranteed across systems. This could be fixed by sorting the processor info records after we've found them in the BIOS tables. -- Keir ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: CPU enumeration in Xen 2007-08-22 14:15 ` Keir Fraser @ 2007-08-27 6:09 ` Dominik Klein 2007-08-27 6:35 ` Dominik Klein 0 siblings, 1 reply; 9+ messages in thread From: Dominik Klein @ 2007-08-27 6:09 UTC (permalink / raw) To: xen-devel >>> If you want to tie dom0 VCPUs 1:1 with physical CPUs then you can put >>> dom0_vcpus_pin on your Xen command line. >> So then, when I do "xm vcpu-pin my-domain 0 1", it will pin VCPU0 in >> my-domain to the second HT of physical CPU 1? >> >> That would be great as it would be straight forward. > > Enumeration order is not guaranteed across systems. This could be fixed by > sorting the processor info records after we've found them in the BIOS > tables. Well I meant on the system I mentioned, which showed CPU1=HT1+HT2 CPU2=HT3+HT4 without Xen. I'll give it a try today. Regards Dominik ^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: CPU enumeration in Xen 2007-08-27 6:09 ` Dominik Klein @ 2007-08-27 6:35 ` Dominik Klein 0 siblings, 0 replies; 9+ messages in thread From: Dominik Klein @ 2007-08-27 6:35 UTC (permalink / raw) To: xen-devel Dominik Klein schrieb: >>>> If you want to tie dom0 VCPUs 1:1 with physical CPUs then you can put >>>> dom0_vcpus_pin on your Xen command line. >>> So then, when I do "xm vcpu-pin my-domain 0 1", it will pin VCPU0 in >>> my-domain to the second HT of physical CPU 1? >>> >>> That would be great as it would be straight forward. >> >> Enumeration order is not guaranteed across systems. This could be >> fixed by >> sorting the processor info records after we've found them in the BIOS >> tables. > > Well I meant on the system I mentioned, which showed > CPU1=HT1+HT2 > CPU2=HT3+HT4 > without Xen. > > I'll give it a try today. Well, it doesn't do what I would have wanted it to. It just does something like xm vcpu-pin 0 0 0 xm vcpu-pin 0 1 1 xm vcpu-pin 0 2 2 xm vcpu-pin 0 3 3 So is there currently a way to see the processors in the same numeration as in Linux without Xen? Regards Dominik ^ permalink raw reply [flat|nested] 9+ messages in thread
end of thread, other threads:[~2007-08-27 6:35 UTC | newest] Thread overview: 9+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2007-08-22 10:34 CPU enumeration in Xen Dominik Klein 2007-08-22 12:34 ` Keir Fraser 2007-08-22 13:39 ` Dominik Klein 2007-08-22 13:48 ` Daniel P. Berrange 2007-08-22 13:53 ` Keir Fraser 2007-08-22 14:04 ` Dominik Klein 2007-08-22 14:15 ` Keir Fraser 2007-08-27 6:09 ` Dominik Klein 2007-08-27 6:35 ` Dominik Klein
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.