xen-devel.lists.xenproject.org archive mirror
 help / color / mirror / Atom feed
From: Dario Faggioli <dario.faggioli@citrix.com>
To: Pavlo Suikov <pavlo.suikov@globallogic.com>
Cc: xen-devel@lists.xen.org
Subject: Re: Delays on usleep calls
Date: Tue, 21 Jan 2014 18:56:45 +0100	[thread overview]
Message-ID: <1390327005.23576.219.camel@Solace> (raw)
In-Reply-To: <CAE4oM6y12tNYFihdKbWcBmHcy__2rL570viV7T=Esj4vxHALqg@mail.gmail.com>


[-- Attachment #1.1: Type: text/plain, Size: 2842 bytes --]

On mar, 2014-01-21 at 17:53 +0200, Pavlo Suikov wrote:

> It happened that we cannot start dom0 with one vCPU (investigation on
> this one is still ongoing), 
>
Oh, I see. Weird.

> but we succeded in giving one vCPU to domU and pinning it to one of
> the pCPUs. Interestingly enough, that fixed all the latency observed
> in domU.
> 
Can I ask how the numbers (for DomU, of course) looks like now?

> # xl vcpu-list 
> Name                                ID  VCPU   CPU State   Time(s) CPU
> Affinity
> Domain-0                             0     0    0   ---      38.6  0
> Domain-0                             0     1    0   r--      31.8  0
> android_4.3                          1     0    1   b     230.2  1
> 
> 
> In dom0 (which has two vCPUs, so Xen scheduling is actually used)
> latency is still present.
> 
Did you try reducing the scheduling timeslice to 1ms (or even something
bigger, but less than 30)? If yes, down to which value?

Another thing I'll try, if you haven't done that already, is as follows:
 - get rid of the DomU
 - pin the 2 Dom0's vCPUs each one to one pCPU
 - repeat the experiment

If that works, iterate, without the second step, i.e., basically, run
the experiment with no pinning, but only with Dom0.

What I'm after is, since you report DomU performance are starting to be
satisfying if pinning is used, trying to figure out whether that is the
case for Dom0 too, as it should be, or if there is something interfering
with that. I know, if the DomU is idle when running the load in Dom0,
having it or not should not make much difference, but still, I'd give
this a try.

> So without virtualization of CPUs for domU soft real time properties
> with regard to timers are met (and our RTP audio sync is doing much
> better). That's obviously not a solution, but it shows that Xen credit
> (and sEDF) scheduling is actually misbehaving on such tasks and there
> is an area to investigate.
> 
Yes. Well, I think it says that, at least for your usecase, the latency
introduced by virtualization per se (VMEXITs, or whatever is the ARM
equivalent for them, etc) are not showstoppers... Which is already
something! :-)

What we now need to figure out, is with what scheduler(s) and, for that
(each) scheduler(s), with what parameters, that property is preserved.
And, I agree, this is something to be investigated.

> I will keep you informed when more results are present, so stay
> tuned :)
> 
Thanks for all the updates so far... I definitely will stay tuned. :-)

Regards,
Dario

-- 
<<This happens because I choose it to happen!>> (Raistlin Majere)
-----------------------------------------------------------------
Dario Faggioli, Ph.D, http://about.me/dario.faggioli
Senior Software Engineer, Citrix Systems R&D Ltd., Cambridge (UK)


[-- Attachment #1.2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 181 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

  reply	other threads:[~2014-01-21 17:56 UTC|newest]

Thread overview: 13+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-01-20 14:10 Delays on usleep calls Pavlo Suikov
2014-01-20 15:05 ` Dario Faggioli
2014-01-20 16:05   ` Pavlo Suikov
2014-01-20 17:31     ` Pavlo Suikov
2014-01-21 10:56       ` Dario Faggioli
2014-01-21 11:46     ` Dario Faggioli
2014-01-21 15:53       ` Pavlo Suikov
2014-01-21 17:56         ` Dario Faggioli [this message]
2014-01-23 19:09           ` Pavlo Suikov
2014-01-24 17:08             ` Dario Faggioli
2014-02-05 21:30   ` Robbie VanVossen
2014-02-07  9:22     ` Dario Faggioli
2014-02-13 21:09       ` Robbie VanVossen

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1390327005.23576.219.camel@Solace \
    --to=dario.faggioli@citrix.com \
    --cc=pavlo.suikov@globallogic.com \
    --cc=xen-devel@lists.xen.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).