Re: [PATCH 03/19] scheduler: implement workqueue scheduler class

Linus Torvalds
2009-10-01T19:13:00Z

On Thu, 1 Oct 2009, Avi Kivity wrote:
>
> Sure, but it would mean that we need a new notifier. sched_out, sched_in, and
> wakeup (and, return to userspace, with the new notifier).

Ok, see the email I just sent out.

And I don't think we want a new notifier - mainly because I don't think we
want to walk the list four times (prepare, out, in, final - we need to
make sure that these things nest properly, so even if "in" and "final"
happen with the same state, they aren't the same, because "in" only
happens if "out" was called, while "final" would happen if "prepare" was
called)

So it would be better to have separate lists, in order to avoid walking
the lists four times just because there was a single notifier that just
wanted to be called for the inner (or outer) cases.

> btw, I've been thinking we should extend concurrency managed workqueues to
> userspace. Right now userspace can spawn a massive amount of threads, hoping
> to hide any waiting by making more work available to the scheduler. That has
> the drawback of increasing latency due to involuntary preemption. Or
> userspace can use one thread per cpu, hope it's the only application on the
> machine, and go all-aio.

This is what the whole next-gen AIO was supposed to do with the
threadlets, ie avoid doing a new thread if it could do the IO all cached
and without being preempted.

Linus