netdev.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Jeremy Eder <jeder@redhat.com>
To: "Rafael J. Wysocki" <rjw@rjwysocki.net>
Cc: Amir Vadai <amirv@mellanox.com>,
	"David S. Miller" <davem@davemloft.net>,
	linux-pm@vger.kernel.org, netdev@vger.kernel.org,
	Pavel Machek <pavel@ucw.cz>, Len Brown <len.brown@intel.com>,
	yuvali@mellanox.com, Or Gerlitz <ogerlitz@mellanox.com>,
	Yevgeny Petrilin <yevgenyp@mellanox.com>,
	idos@mellanox.com
Subject: Re: [RFC 1/2] pm: Introduce QoS requests per CPU
Date: Wed, 26 Mar 2014 13:36:37 -0400	[thread overview]
Message-ID: <20140326173637.GB6656@jeder.rdu.redhat.com> (raw)
In-Reply-To: <2896374.SoOPVJXu9Q@vostro.rjw.lan>

On 140325 19:44:53, Rafael J. Wysocki wrote:
> On Tuesday, March 25, 2014 03:18:24 PM Amir Vadai wrote:
> > Extend the current pm_qos_request API - to have pm_qos_request per core.
> > When a global request is added, it is added under the global plist.
> > When a core specific request is added, it is added to the core specific
> > list.
> > core number is saved in the request and later modify/delete operations
> > are using it to access the right list.
> > 
> > When a cpu specific request is added/removed/updated, the target value
> > of the specific core is recalculated to be the min/max (according to the
> > constrain type) value of all the global and the cpu specific
> > constraints.
> > 
> > If a global request is added/removed/updated, the target values of all
> > the cpu's are recalculated.
> > 
> > During initialization, before the cpu specific data structures are
> > allocated and initialized, only global target value is begin used.
> 
> I have to review this in detail (which rather won't be possible before
> the next week), but in principle I don't really like it, because it
> assumes that its users will know what's going to run on which CPU cores
> and I'm not sure where that knowledge is going to come from.

Hi guys,

I think busy_poll can accomplish the basic goals of this patch
set.  Stop drops due to c-state transition latency.  Get into more performant
c-states only on active cores with SO_BUSY_POLL or the sysctl.

Whether it's system-wide or per-cpu, cpu_dma_latency wastes power and
worse, it's a static thing.  We need adaptable power management for the
general case.  I guess that might look like power-aware scheduling, or wiring
menu.c to incorporate hints from drivers/userspace.

cpu_dma_latency reduces TDP headroom because non-active cores are in
unnecessarily high c-states, reduces the amount of turbo boost you can have,
and thus reduces performance of (i.e.) low-thread-count workloads.

busy_poll has another positive side-effect; it's even more granular (thus
more power friendly) than the percpu idea:  it will only affect cores that
have active sockets on them.  When the sockets aren't active, the core can
settle into a deep c-state, and possibly the socket can settle into a deeper
package c-state.  There's some data in the blog post that Jesper sent.

I also want to mention that this "class" of issue is not particularly
related to networking.

  parent reply	other threads:[~2014-03-26 17:36 UTC|newest]

Thread overview: 11+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-03-25 13:18 [RFC 0/2] pm,net: Introduce QoS requests per CPU Amir Vadai
2014-03-25 13:18 ` [RFC 1/2] pm: " Amir Vadai
2014-03-25 18:44   ` Rafael J. Wysocki
2014-03-26 15:40     ` Amir Vadai
2014-03-26 17:36     ` Jeremy Eder [this message]
2014-03-27 19:41       ` Amir Vadai
2014-03-25 13:18 ` [RFC 2/2] net/mlx4_en: Use pm_qos API to avoid packet loss in high CPU c-states Amir Vadai
2014-03-25 15:14 ` [RFC 0/2] pm,net: Introduce QoS requests per CPU Eric Dumazet
2014-03-25 22:47   ` Ben Hutchings
2014-03-26  7:12     ` Yevgeny Petrilin
2014-03-26 15:42   ` Amir Vadai

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20140326173637.GB6656@jeder.rdu.redhat.com \
    --to=jeder@redhat.com \
    --cc=amirv@mellanox.com \
    --cc=davem@davemloft.net \
    --cc=idos@mellanox.com \
    --cc=len.brown@intel.com \
    --cc=linux-pm@vger.kernel.org \
    --cc=netdev@vger.kernel.org \
    --cc=ogerlitz@mellanox.com \
    --cc=pavel@ucw.cz \
    --cc=rjw@rjwysocki.net \
    --cc=yevgenyp@mellanox.com \
    --cc=yuvali@mellanox.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).