From mboxrd@z Thu Jan 1 00:00:00 1970 From: Dario Faggioli Subject: Re: [BUG] mistakenly wake in Xen's credit scheduler Date: Wed, 28 Oct 2015 06:54:32 +0100 Message-ID: <1446011672.2937.288.camel@citrix.com> References: Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5496930521323289751==" Return-path: In-Reply-To: List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xen.org Errors-To: xen-devel-bounces@lists.xen.org To: suokun , George Dunlap Cc: xen-devel@lists.xen.org List-Id: xen-devel@lists.xenproject.org --===============5496930521323289751== Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="=-qP7mQeG1Q85VGSkgIit3" --=-qP7mQeG1Q85VGSkgIit3 Content-Type: multipart/mixed; boundary="=-K7agWTjwAQzMFbnl9jk2" --=-K7agWTjwAQzMFbnl9jk2 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Tue, 2015-10-27 at 14:11 -0600, suokun wrote: > On Tue, Oct 27, 2015 at 3:44 AM, George Dunlap > wrote: > > On Tue, Oct 27, 2015 at 5:59 AM, suokun > > wrote: > Thank you for your reply. I have test credit2 this morning. The I/O > performance is correct, however, the CPU accounting seems not > correct. > Here is my experiment on credit2: >=20 > VM-IO: 1-vCPU pinned to a pCPU, running netperf > VM-CPU: 1-vCPU pinned the the same pCPU, running a while(1) loop > The throughput of netperf is the same(941Mbps) as VM-IO runs alone. >=20 > However, when I use xl top to show the VM CPU utilization, VM-IO > takes > 73% of CPU time and VM-CPU takes 99% CPU time. Their sum is more than > 100%. I doubt it is due to the CPU utilization accounting in credit2 > scheduler. >=20 Yeah, well, sorry, but even if we both (me and George) encouraged you to try Credit2, that wasn't a great idea. :-( In fact, you're using pinning for this test, and Credit2 does not have pinning (yet)! :-P That explains why utilizations are summing up to higher than 100%: vCPUs are just not being confined to one processor. Pinning for Credit2 is just around the corner. Let's try this again when it will be there, ok? :-D > > Also, do you have a patch to fix it in credit1? :-) > >=20 >=20 > For the patch to my problem in credit1. I have two ideas: >=20 > 1) if the vCPU cannot migrate(e.g. pinned, CPU affinity, even only > has > one physical CPU), do not set the _VPF_migrating flag. >=20 Yep, that's step 1. I hadn't seen this mail, so I produced a patch myself (see my other reply). Is it similar to your one? If you could test it, it would be great. Even after this is done, though, we still need to fix the fact that Credit1 boosts vCPUs upon migrations, which looks utterly crazy to me! I've got (drafted) patches for that too, but I want to stress test them a bit more before submitting them officially. I'm attaching them to this email, feel free to have a look and provide your views. > 2) let the BOOST state can preempt with each other. >=20 Yeah, but... > Actually I have tested both separately and they both work. But > personally I prefer the first option because it solved the problem > from the source. >=20 ... I don't like 2) that much either. Credit1 is, by design, round -robin within equal priority levels. There are already quite a few hacks in that code, and breaking even that rather basic assumption would scary an awful lot!! :-O Thanks a lot again fro your report and your analysis. Regards, Dario --=20 <> (Raistlin Majere) ----------------------------------------------------------------- Dario Faggioli, Ph.D, http://about.me/dario.faggioli Senior Software Engineer, Citrix Systems R&D Ltd., Cambridge (UK) --=-K7agWTjwAQzMFbnl9jk2 Content-Disposition: attachment; filename="xen-credit1-avoid-boosting-when-migrating.patch" Content-Transfer-Encoding: base64 Content-Type: text/x-patch; name="xen-credit1-avoid-boosting-when-migrating.patch"; charset="UTF-8" Y29tbWl0IDZkNjBiMWVjZjdkNzlkMDBkOTQ2YWUxOWE1MmYyNTZkNGJjMmE4MjMKQXV0aG9yOiBE YXJpbyBGYWdnaW9saSA8ZGFyaW8uZmFnZ2lvbGlAY2l0cml4LmNvbT4KRGF0ZTogICBXZWQgT2N0 IDI4IDAxOjE1OjM1IDIwMTUgKzAxMDAKCiAgICBTaWduZWQtb2ZmLWJ5OiBEYXJpbyBGYWdnaW9s aSA8ZGFyaW8uZmFnZ2lvbGlAY2l0cml4LmNvbT4KCmRpZmYgLS1naXQgYS94ZW4vY29tbW9uL3Nj aGVkX2NyZWRpdC5jIGIveGVuL2NvbW1vbi9zY2hlZF9jcmVkaXQuYwppbmRleCA2ODNmZWViLi4y OWE5MTc1IDEwMDY0NAotLS0gYS94ZW4vY29tbW9uL3NjaGVkX2NyZWRpdC5jCisrKyBiL3hlbi9j b21tb24vc2NoZWRfY3JlZGl0LmMKQEAgLTEwMDUsMTUgKzEwMDUsMTcgQEAgY3NjaGVkX3ZjcHVf d2FrZShjb25zdCBzdHJ1Y3Qgc2NoZWR1bGVyICpvcHMsIHN0cnVjdCB2Y3B1ICp2YywgdW5zaWdu ZWQgd2YpCiAgICAgICogbW9yZSBDUFUgcmVzb3VyY2UgaW50ZW5zaXZlIFZDUFVzIHdpdGhvdXQg aW1wYWN0aW5nIG92ZXJhbGwgCiAgICAgICogc3lzdGVtIGZhaXJuZXNzLgogICAgICAqCi0gICAg ICogVGhlIG9uZSBleGNlcHRpb24gaXMgZm9yIFZDUFVzIG9mIGNhcHBlZCBkb21haW5zIHVucGF1 c2luZwotICAgICAqIGFmdGVyIGVhcm5pbmcgY3JlZGl0cyB0aGV5IGhhZCBvdmVyc3BlbnQuIFdl IGRvbid0IGJvb3N0Ci0gICAgICogdGhvc2UuCisgICAgICogVGhlcmUgYXJlIGEgY291cGxlIG9m IGV4Y2VwdGlvbnM6CisgICAgICogIC0gVkNQVXMgb2YgY2FwcGVkIGRvbWFpbnMgdW5wYXVzaW5n IGFmdGVyIGVhcm5pbmcgY3JlZGl0cworICAgICAqICAgIHRoZXkgaGFkIG92ZXJzcGVudDsKKyAg ICAgKiAgLSBWQ1BVcyB0aGF0IGFyZSBiZWluZyBtaWdyYXRlZCB0byBhbm90aGVyIHBDUFUsIHJh dGhlcgorICAgICAqICAgIHRoYW4gYWN0dWFsbHkgd2FraW5nIHVwIGFmdGVyIGJlaW5nIGJsb2Nr ZWQuCisgICAgICogV2UgZG9uJ3QgYm9vc3QgdGhvc2UuCiAgICAgICovCiAgICAgaWYgKCBzdmMt PnByaSA9PSBDU0NIRURfUFJJX1RTX1VOREVSICYmCi0gICAgICAgICAhdGVzdF9iaXQoQ1NDSEVE X0ZMQUdfVkNQVV9QQVJLRUQsICZzdmMtPmZsYWdzKSApCi0gICAgeworICAgICAgICAgIXRlc3Rf Yml0KENTQ0hFRF9GTEFHX1ZDUFVfUEFSS0VELCAmc3ZjLT5mbGFncykgJiYKKyAgICAgICAgICEo d2YgJiBXRl9taWdyYXRpbmcpICkKICAgICAgICAgc3ZjLT5wcmkgPSBDU0NIRURfUFJJX1RTX0JP T1NUOwotICAgIH0KIAogICAgIC8qIFB1dCB0aGUgVkNQVSBvbiB0aGUgcnVucSBhbmQgdGlja2xl IENQVXMgKi8KICAgICBfX3J1bnFfaW5zZXJ0KGNwdSwgc3ZjKTsK --=-K7agWTjwAQzMFbnl9jk2 Content-Disposition: attachment; filename="xen-sched-introduce-wakeup-flags.patch" Content-Transfer-Encoding: base64 Content-Type: text/x-patch; name="xen-sched-introduce-wakeup-flags.patch"; charset="UTF-8" Y29tbWl0IGI3MWUzZjEwODk4YTZkMWM4NDliZDkxMzVmMTVhYTgzNjdkODk3ZDAKQXV0aG9yOiBE YXJpbyBGYWdnaW9saSA8ZGFyaW8uZmFnZ2lvbGlAY2l0cml4LmNvbT4KRGF0ZTogICBXZWQgT2N0 IDI4IDAwOjQ3OjE3IDIwMTUgKzAxMDAKCiAgICBTaWduZWQtb2ZmLWJ5OiBEYXJpbyBGYWdnaW9s aSA8ZGFyaW8uZmFnZ2lvbGlAY2l0cml4LmNvbT4KCmRpZmYgLS1naXQgYS94ZW4vY29tbW9uL3Nj aGVkX2FyaW5jNjUzLmMgYi94ZW4vY29tbW9uL3NjaGVkX2FyaW5jNjUzLmMKaW5kZXggZGJlMDJl ZC4uZGU2NWU5NiAxMDA2NDQKLS0tIGEveGVuL2NvbW1vbi9zY2hlZF9hcmluYzY1My5jCisrKyBi L3hlbi9jb21tb24vc2NoZWRfYXJpbmM2NTMuYwpAQCAtNTM3LDcgKzUzNyw3IEBAIGE2NTNzY2hl ZF92Y3B1X3NsZWVwKGNvbnN0IHN0cnVjdCBzY2hlZHVsZXIgKm9wcywgc3RydWN0IHZjcHUgKnZj KQogICogQHBhcmFtIHZjICAgICAgICBQb2ludGVyIHRvIHRoZSBWQ1BVIHN0cnVjdHVyZSBmb3Ig dGhlIGN1cnJlbnQgZG9tYWluCiAgKi8KIHN0YXRpYyB2b2lkCi1hNjUzc2NoZWRfdmNwdV93YWtl KGNvbnN0IHN0cnVjdCBzY2hlZHVsZXIgKm9wcywgc3RydWN0IHZjcHUgKnZjKQorYTY1M3NjaGVk X3ZjcHVfd2FrZShjb25zdCBzdHJ1Y3Qgc2NoZWR1bGVyICpvcHMsIHN0cnVjdCB2Y3B1ICp2Yywg dW5zaWduZWQgd2YpCiB7CiAgICAgaWYgKCBBVkNQVSh2YykgIT0gTlVMTCApCiAgICAgICAgIEFW Q1BVKHZjKS0+YXdha2UgPSAxOwpkaWZmIC0tZ2l0IGEveGVuL2NvbW1vbi9zY2hlZF9jcmVkaXQu YyBiL3hlbi9jb21tb24vc2NoZWRfY3JlZGl0LmMKaW5kZXggYjhmMjhmZS4uNjgzZmVlYiAxMDA2 NDQKLS0tIGEveGVuL2NvbW1vbi9zY2hlZF9jcmVkaXQuYworKysgYi94ZW4vY29tbW9uL3NjaGVk X2NyZWRpdC5jCkBAIC05NjYsNyArOTY2LDcgQEAgY3NjaGVkX3ZjcHVfc2xlZXAoY29uc3Qgc3Ry dWN0IHNjaGVkdWxlciAqb3BzLCBzdHJ1Y3QgdmNwdSAqdmMpCiB9CiAKIHN0YXRpYyB2b2lkCi1j c2NoZWRfdmNwdV93YWtlKGNvbnN0IHN0cnVjdCBzY2hlZHVsZXIgKm9wcywgc3RydWN0IHZjcHUg KnZjKQorY3NjaGVkX3ZjcHVfd2FrZShjb25zdCBzdHJ1Y3Qgc2NoZWR1bGVyICpvcHMsIHN0cnVj dCB2Y3B1ICp2YywgdW5zaWduZWQgd2YpCiB7CiAgICAgc3RydWN0IGNzY2hlZF92Y3B1ICogY29u c3Qgc3ZjID0gQ1NDSEVEX1ZDUFUodmMpOwogICAgIGNvbnN0IHVuc2lnbmVkIGludCBjcHUgPSB2 Yy0+cHJvY2Vzc29yOwpkaWZmIC0tZ2l0IGEveGVuL2NvbW1vbi9zY2hlZF9jcmVkaXQyLmMgYi94 ZW4vY29tbW9uL3NjaGVkX2NyZWRpdDIuYwppbmRleCA2Njk1NzI5Li42YjMyNzc4IDEwMDY0NAot LS0gYS94ZW4vY29tbW9uL3NjaGVkX2NyZWRpdDIuYworKysgYi94ZW4vY29tbW9uL3NjaGVkX2Ny ZWRpdDIuYwpAQCAtOTU3LDcgKzk1Nyw3IEBAIGNzY2hlZDJfdmNwdV9zbGVlcChjb25zdCBzdHJ1 Y3Qgc2NoZWR1bGVyICpvcHMsIHN0cnVjdCB2Y3B1ICp2YykKIH0KIAogc3RhdGljIHZvaWQKLWNz Y2hlZDJfdmNwdV93YWtlKGNvbnN0IHN0cnVjdCBzY2hlZHVsZXIgKm9wcywgc3RydWN0IHZjcHUg KnZjKQorY3NjaGVkMl92Y3B1X3dha2UoY29uc3Qgc3RydWN0IHNjaGVkdWxlciAqb3BzLCBzdHJ1 Y3QgdmNwdSAqdmMsIHVuc2lnbmVkIHdmKQogewogICAgIHN0cnVjdCBjc2NoZWQyX3ZjcHUgKiBj b25zdCBzdmMgPSBDU0NIRUQyX1ZDUFUodmMpOwogICAgIHNfdGltZV90IG5vdyA9IDA7CmRpZmYg LS1naXQgYS94ZW4vY29tbW9uL3NjaGVkX3J0LmMgYi94ZW4vY29tbW9uL3NjaGVkX3J0LmMKaW5k ZXggNmEzNDFiMS4uNjc3ZTNmNCAxMDA2NDQKLS0tIGEveGVuL2NvbW1vbi9zY2hlZF9ydC5jCisr KyBiL3hlbi9jb21tb24vc2NoZWRfcnQuYwpAQCAtMTAzMSw3ICsxMDMxLDcgQEAgb3V0OgogICog VE9ETzogd2hhdCBpZiB0aGVzZSB0d28gdmNwdXMgYmVsb25ncyB0byB0aGUgc2FtZSBkb21haW4/ CiAgKi8KIHN0YXRpYyB2b2lkCi1ydF92Y3B1X3dha2UoY29uc3Qgc3RydWN0IHNjaGVkdWxlciAq b3BzLCBzdHJ1Y3QgdmNwdSAqdmMpCitydF92Y3B1X3dha2UoY29uc3Qgc3RydWN0IHNjaGVkdWxl ciAqb3BzLCBzdHJ1Y3QgdmNwdSAqdmMsIHVuc2lnbmVkIHdmKQogewogICAgIHN0cnVjdCBydF92 Y3B1ICogY29uc3Qgc3ZjID0gcnRfdmNwdSh2Yyk7CiAgICAgc190aW1lX3Qgbm93ID0gTk9XKCk7 CmRpZmYgLS1naXQgYS94ZW4vY29tbW9uL3NjaGVkdWxlLmMgYi94ZW4vY29tbW9uL3NjaGVkdWxl LmMKaW5kZXggYzVmNjQwZi4uYmFjZWU3MyAxMDA2NDQKLS0tIGEveGVuL2NvbW1vbi9zY2hlZHVs ZS5jCisrKyBiL3hlbi9jb21tb24vc2NoZWR1bGUuYwpAQCAtNDA3LDcgKzQwNyw3IEBAIHZvaWQg dmNwdV9zbGVlcF9zeW5jKHN0cnVjdCB2Y3B1ICp2KQogICAgIHN5bmNfdmNwdV9leGVjc3RhdGUo dik7CiB9CiAKLXZvaWQgdmNwdV93YWtlKHN0cnVjdCB2Y3B1ICp2KQorc3RhdGljIHZvaWQgX3Zj cHVfd2FrZShzdHJ1Y3QgdmNwdSAqdiwgdW5zaWduZWQgd2FrZV9mbGFncykKIHsKICAgICB1bnNp Z25lZCBsb25nIGZsYWdzOwogICAgIHNwaW5sb2NrX3QgKmxvY2sgPSB2Y3B1X3NjaGVkdWxlX2xv Y2tfaXJxc2F2ZSh2LCAmZmxhZ3MpOwpAQCAtNDE2LDcgKzQxNiw3IEBAIHZvaWQgdmNwdV93YWtl KHN0cnVjdCB2Y3B1ICp2KQogICAgIHsKICAgICAgICAgaWYgKCB2LT5ydW5zdGF0ZS5zdGF0ZSA+ PSBSVU5TVEFURV9ibG9ja2VkICkKICAgICAgICAgICAgIHZjcHVfcnVuc3RhdGVfY2hhbmdlKHYs IFJVTlNUQVRFX3J1bm5hYmxlLCBOT1coKSk7Ci0gICAgICAgIFNDSEVEX09QKFZDUFUyT1Aodiks IHdha2UsIHYpOworICAgICAgICBTQ0hFRF9PUChWQ1BVMk9QKHYpLCB3YWtlLCB2LCB3YWtlX2Zs YWdzKTsKICAgICB9CiAgICAgZWxzZSBpZiAoICEodi0+cGF1c2VfZmxhZ3MgJiBWUEZfYmxvY2tl ZCkgKQogICAgIHsKQEAgLTQyOSw2ICs0MjksMTEgQEAgdm9pZCB2Y3B1X3dha2Uoc3RydWN0IHZj cHUgKnYpCiAgICAgVFJBQ0VfMkQoVFJDX1NDSEVEX1dBS0UsIHYtPmRvbWFpbi0+ZG9tYWluX2lk LCB2LT52Y3B1X2lkKTsKIH0KIAordm9pZCB2Y3B1X3dha2Uoc3RydWN0IHZjcHUgKnYpCit7Cisg ICAgcmV0dXJuIF92Y3B1X3dha2UodiwgV0Zfd2FrZXVwKTsKK30KKwogdm9pZCB2Y3B1X3VuYmxv Y2soc3RydWN0IHZjcHUgKnYpCiB7CiAgICAgaWYgKCAhdGVzdF9hbmRfY2xlYXJfYml0KF9WUEZf YmxvY2tlZCwgJnYtPnBhdXNlX2ZsYWdzKSApCkBAIC01NzcsOCArNTgyLDggQEAgc3RhdGljIHZv aWQgdmNwdV9taWdyYXRlKHN0cnVjdCB2Y3B1ICp2KQogICAgIGlmICggb2xkX2NwdSAhPSBuZXdf Y3B1ICkKICAgICAgICAgc2NoZWRfbW92ZV9pcnFzKHYpOwogCi0gICAgLyogV2FrZSBvbiBuZXcg Q1BVLiAqLwotICAgIHZjcHVfd2FrZSh2KTsKKyAgICAvKiBXYWtlIG9uIG5ldyBDUFUgKGFuZCBs ZXQgdGhlIHNjaGVkdWxlciBrbm93IGl0J3MgYSBtaWdyYXRpb24pLiAqLworICAgIF92Y3B1X3dh a2UodiwgV0ZfbWlncmF0aW5nKTsKIH0KIAogLyoKZGlmZiAtLWdpdCBhL3hlbi9pbmNsdWRlL3hl bi9zY2hlZC1pZi5oIGIveGVuL2luY2x1ZGUveGVuL3NjaGVkLWlmLmgKaW5kZXggNDkzZDQzZi4u YWYxZWQ2MCAxMDA2NDQKLS0tIGEveGVuL2luY2x1ZGUveGVuL3NjaGVkLWlmLmgKKysrIGIveGVu L2luY2x1ZGUveGVuL3NjaGVkLWlmLmgKQEAgLTE0NCw3ICsxNDQsOCBAQCBzdHJ1Y3Qgc2NoZWR1 bGVyIHsKICAgICB2b2lkICAgICAgICAgKCpyZW1vdmVfdmNwdSkgICAgKGNvbnN0IHN0cnVjdCBz Y2hlZHVsZXIgKiwgc3RydWN0IHZjcHUgKik7CiAKICAgICB2b2lkICAgICAgICAgKCpzbGVlcCkg ICAgICAgICAgKGNvbnN0IHN0cnVjdCBzY2hlZHVsZXIgKiwgc3RydWN0IHZjcHUgKik7Ci0gICAg dm9pZCAgICAgICAgICgqd2FrZSkgICAgICAgICAgIChjb25zdCBzdHJ1Y3Qgc2NoZWR1bGVyICos IHN0cnVjdCB2Y3B1ICopOworICAgIHZvaWQgICAgICAgICAoKndha2UpICAgICAgICAgICAoY29u c3Qgc3RydWN0IHNjaGVkdWxlciAqLCBzdHJ1Y3QgdmNwdSAqLAorICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgdW5zaWduZWQgaW50KTsKICAgICB2b2lkICAgICAgICAgKCp5aWVs ZCkgICAgICAgICAgKGNvbnN0IHN0cnVjdCBzY2hlZHVsZXIgKiwgc3RydWN0IHZjcHUgKik7CiAg ICAgdm9pZCAgICAgICAgICgqY29udGV4dF9zYXZlZCkgIChjb25zdCBzdHJ1Y3Qgc2NoZWR1bGVy ICosIHN0cnVjdCB2Y3B1ICopOwogCmRpZmYgLS1naXQgYS94ZW4vaW5jbHVkZS94ZW4vc2NoZWQu aCBiL3hlbi9pbmNsdWRlL3hlbi9zY2hlZC5oCmluZGV4IDM3MjliMGYuLjZlN2ExMDggMTAwNjQ0 Ci0tLSBhL3hlbi9pbmNsdWRlL3hlbi9zY2hlZC5oCisrKyBiL3hlbi9pbmNsdWRlL3hlbi9zY2hl ZC5oCkBAIC03NTMsNiArNzUzLDE2IEBAIHN0YXRpYyBpbmxpbmUgc3RydWN0IGRvbWFpbiAqbmV4 dF9kb21haW5faW5fY3B1cG9vbCgKICNkZWZpbmUgX1ZQRl9pbl9yZXNldCAgICAgICAgNwogI2Rl ZmluZSBWUEZfaW5fcmVzZXQgICAgICAgICAoMVVMPDxfVlBGX2luX3Jlc2V0KQogCisvKgorICog VkNQVSB3YWtlIHVwIGZsYWdzLgorICovCisvKiBWQ1BVIGJlaW5nIGFjdHVhbGx5IHdva2VuIHVw LiAqLworI2RlZmluZSBfV0Zfd2FrZXVwICAgICAgICAgICAwCisjZGVmaW5lIFdGX3dha2V1cCAg ICAgICAgICAgICgxVTw8X1dGX3dha2V1cCkKKy8qIFZDUFUgYmVpbmcgKHdva2VuIGp1c3QgYWZ0 ZXIgaGF2aW5nIGJlZW4pIG1pZ3JhdGVkLiAqLworI2RlZmluZSBfV0ZfbWlncmF0aW5nICAgICAg ICAxCisjZGVmaW5lIFdGX21pZ3JhdGluZyAgICAgICAgICgxVTw8X1dGX21pZ3JhdGluZykKKwog c3RhdGljIGlubGluZSBpbnQgdmNwdV9ydW5uYWJsZShzdHJ1Y3QgdmNwdSAqdikKIHsKICAgICBy ZXR1cm4gISh2LT5wYXVzZV9mbGFncyB8Cg== --=-K7agWTjwAQzMFbnl9jk2-- --=-qP7mQeG1Q85VGSkgIit3 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iEYEABECAAYFAlYwYxkACgkQk4XaBE3IOsQIkgCggZLqwZmUi2JDtMTM5RkSl584 IvYAoIHZW4cstA6gVmBHZh+woGLvpl2l =rzP0 -----END PGP SIGNATURE----- --=-qP7mQeG1Q85VGSkgIit3-- --===============5496930521323289751== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel --===============5496930521323289751==--