From: Dario Faggioli <dario.faggioli@citrix.com>
To: George Dunlap <george.dunlap@citrix.com>, xen-devel@lists.xenproject.org
Cc: George Dunlap <george.dunlap@eu.citrix.com>,
Andrew Cooper <andrew.cooper3@citrix.com>,
Meng Xu <mengxu@cis.upenn.edu>, Jan Beulich <JBeulich@suse.com>
Subject: Re: [PATCH 2/7] xen: sched: fix locking for insert_vcpu() in credit1 and RTDS
Date: Thu, 8 Oct 2015 17:49:34 +0200 [thread overview]
Message-ID: <1444319374.22254.42.camel@citrix.com> (raw)
In-Reply-To: <561688D9.30509@citrix.com>
[-- Attachment #1.1: Type: text/plain, Size: 2589 bytes --]
On Thu, 2015-10-08 at 16:16 +0100, George Dunlap wrote:
> On 08/10/15 13:52, Dario Faggioli wrote:
> > diff --git a/xen/common/schedule.c b/xen/common/schedule.c
> > index c5f640f..9aa209d 100644
> > --- a/xen/common/schedule.c
> > +++ b/xen/common/schedule.c
> > @@ -1488,9 +1488,7 @@ void __init scheduler_init(void)
> >
> > int schedule_cpu_switch(unsigned int cpu, struct cpupool *c)
> > {
> > - unsigned long flags;
> > struct vcpu *idle;
> > - spinlock_t *lock;
> > void *ppriv, *ppriv_old, *vpriv, *vpriv_old;
> > struct scheduler *old_ops = per_cpu(scheduler, cpu);
> > struct scheduler *new_ops = (c == NULL) ? &ops : c->sched;
> > @@ -1509,8 +1507,6 @@ int schedule_cpu_switch(unsigned int cpu,
> > struct cpupool *c)
> > return -ENOMEM;
> > }
> >
> > - lock = pcpu_schedule_lock_irqsave(cpu, &flags);
> > -
> > SCHED_OP(old_ops, tick_suspend, cpu);
> > vpriv_old = idle->sched_priv;
> > idle->sched_priv = vpriv;
> > @@ -1520,8 +1516,6 @@ int schedule_cpu_switch(unsigned int cpu,
> > struct cpupool *c)
> > SCHED_OP(new_ops, tick_resume, cpu);
> > SCHED_OP(new_ops, insert_vcpu, idle);
> >
> > - pcpu_schedule_unlock_irqrestore(lock, flags, cpu);
>
> It seems to me that the locking here wasn't to protect insert_vcpu,
> but
> to prevent any scheduling events from happening on cpu until all the
> expected infrastructure (ticks, idle vcpu, &c) were ready. I can't
> immediately convince myself that removing these is safe in that
> regard.
> Can you address this?
>
Scheduling can't happen on the cpu, until later than the end of this
function, when, in cpupool_assign_cpu_locked(), we set to 1 its
corresponding bit in the target cpupool's cpu_valid mask.
In fact, scheduling events happening before that, would basically mean
that a cpu outside of any cpupool is somehow being considered for
scheduling, which, as said, would be a bug. In fact, I sent patches
back in July to cure occurrences of that behavior.
We've been discussing, basically about the same issue, with Jan in
here:
https://www.choon.net/forum/read.php?22,3817262,3817489
And I'll add the promised ASSERT() and comment, when sending v2 of that
patch. :-)
Make sense?
Thanks and Regards,
Dario
--
<<This happens because I choose it to happen!>> (Raistlin Majere)
-----------------------------------------------------------------
Dario Faggioli, Ph.D, http://about.me/dario.faggioli
Senior Software Engineer, Citrix Systems R&D Ltd., Cambridge (UK)
[-- Attachment #1.2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 181 bytes --]
[-- Attachment #2: Type: text/plain, Size: 126 bytes --]
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel
next prev parent reply other threads:[~2015-10-08 15:49 UTC|newest]
Thread overview: 29+ messages / expand[flat|nested] mbox.gz Atom feed top
2015-10-08 12:52 [PATCH 0/7] xen: sched: fix locking of {insert, remove}_vcpu() Dario Faggioli
2015-10-08 12:52 ` [PATCH 1/7] xen: sched: fix locking of remove_vcpu() in credit1 Dario Faggioli
2015-10-08 13:16 ` Andrew Cooper
2015-10-08 12:52 ` [PATCH 2/7] xen: sched: fix locking for insert_vcpu() in credit1 and RTDS Dario Faggioli
2015-10-08 13:18 ` Andrew Cooper
2015-10-08 15:16 ` George Dunlap
2015-10-08 15:49 ` Dario Faggioli [this message]
2015-10-08 20:12 ` Dario Faggioli
2015-10-08 12:52 ` [PATCH 3/7] xen: sched: better handle (not) inserting idle vCPUs in runqueues Dario Faggioli
2015-10-08 15:27 ` George Dunlap
2015-10-08 15:39 ` Dario Faggioli
2015-10-09 5:31 ` Juergen Gross
2015-10-08 12:52 ` [PATCH 4/7] xen: sched: get rid of the per domain vCPU list in RTDS Dario Faggioli
2015-10-08 13:47 ` Andrew Cooper
2015-10-08 15:31 ` George Dunlap
2015-10-08 12:53 ` [PATCH 5/7] xen: sched: get rid of the per domain vCPU list in Credit2 Dario Faggioli
2015-10-08 13:10 ` Andrew Cooper
2015-10-08 13:17 ` Dario Faggioli
2015-10-08 13:56 ` Andrew Cooper
2015-10-08 15:32 ` Dario Faggioli
2015-10-08 15:39 ` Andrew Cooper
2015-10-08 15:40 ` George Dunlap
2015-10-08 12:53 ` [PATCH 6/7] xen: sched: fix an 'off by one \t' in credit2 debug dump Dario Faggioli
2015-10-08 15:42 ` George Dunlap
2015-10-08 15:59 ` Dario Faggioli
2015-10-08 12:53 ` [PATCH 7/7] xen: sched / cpupool: dump the actual value of NOW() Dario Faggioli
2015-10-08 13:12 ` Andrew Cooper
2015-10-08 15:37 ` Jan Beulich
2015-10-09 5:09 ` Juergen Gross
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1444319374.22254.42.camel@citrix.com \
--to=dario.faggioli@citrix.com \
--cc=JBeulich@suse.com \
--cc=andrew.cooper3@citrix.com \
--cc=george.dunlap@citrix.com \
--cc=george.dunlap@eu.citrix.com \
--cc=mengxu@cis.upenn.edu \
--cc=xen-devel@lists.xenproject.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).