All of lore.kernel.org
 help / color / mirror / Atom feed
From: Arnaldo Carvalho de Melo <acme@kernel.org>
To: Muni Sekhar <munisekharrms@gmail.com>
Cc: linux-perf-users@vger.kernel.org, Greg KH <greg@kroah.com>,
	linux-kernel@vger.kernel.org,
	peter enderborg <peter.enderborg@sony.com>,
	kernelnewbies <kernelnewbies@kernelnewbies.org>
Subject: Re: Scheduler benchmarks
Date: Thu, 29 Apr 2021 18:32:06 -0300	[thread overview]
Message-ID: <YIsl1o19AoQwgelk@kernel.org> (raw)
In-Reply-To: <CAHhAz+iC_F5w5EoZP8-dBNm+DV0uNMva6Mr2uBdmZtejL1OH-w@mail.gmail.com>

Em Wed, Aug 19, 2020 at 03:46:06PM +0530, Muni Sekhar escreveu:
> On Tue, Aug 18, 2020 at 11:45 PM peter enderborg <peter.enderborg@sony.com> wrote:
> > On 8/18/20 7:53 PM, Muni Sekhar wrote:
> > > On Tue, Aug 18, 2020 at 11:06 PM Greg KH <greg@kroah.com> wrote:
> > >> On Tue, Aug 18, 2020 at 11:01:35PM +0530, Muni Sekhar wrote:
> > >>> On Tue, Aug 18, 2020 at 10:44 PM Greg KH <greg@kroah.com> wrote:
> > >> Those are _very_ different kernel versions, with many years and tens of
> > >> thousands of different changes between them.
> > >>
> > >> Hopefully the newer kernel is faster, so just stick with that :)
> > > But unfortunately the newer kernel is very slow, that is the reason
> > > for starting this investigation :)
> > > Any type of help,  and guidelines to dive deeper will be highly appreciated.
> >
> > On the 4.4 kernel you dont have
> >
> > +CONFIG_RETPOLINE=y
> > +CONFIG_INTEL_RDT=y
> Thanks! That is helpful. Yes, I see 4.4 kernel don't have the above
> two config options.
> What analysis can be done to narrow down the root cause?
> Any example of reference could be helpful to understand.

This made me remember Lisbon:

http://vger.kernel.org/~acme/perf/bpf-is-eating-the-world-dont-you-see-lpc-lisbon-2019/#/8/2

Greg was there when this slide was first shown... ;-)

Look at the icache misses when the kernel is entered (syscall entry).

Then add this to the kernel command line: "nospectre_v1 nospectre_v2"

And see what happens:

http://vger.kernel.org/~acme/perf/bpf-is-eating-the-world-dont-you-see-lpc-lisbon-2019/#/8/3

So using these (and any new ones related to disabling hardware flaw
mitigation) maybe a way to analyse this, if you haven't figured this out
yet, sorry for the huge delay in replying 8-)

- Arnaldo
 
> >
> > And your base is very different two.
> >
> > Try to use mainline on both system and see.
> >
> > You can also use the same base kernel version from ubuntu and
> >
> > run your test.
> >
> >
> > >> greg k-h
> > >
> > >
> >
> 
> 
> -- 
> Thanks,
> Sekhar

-- 

- Arnaldo

_______________________________________________
Kernelnewbies mailing list
Kernelnewbies@kernelnewbies.org
https://lists.kernelnewbies.org/mailman/listinfo/kernelnewbies

WARNING: multiple messages have this Message-ID (diff)
From: Arnaldo Carvalho de Melo <acme@kernel.org>
To: Muni Sekhar <munisekharrms@gmail.com>
Cc: peter enderborg <peter.enderborg@sony.com>,
	Greg KH <greg@kroah.com>,
	kernelnewbies <kernelnewbies@kernelnewbies.org>,
	linux-kernel@vger.kernel.org, linux-perf-users@vger.kernel.org
Subject: Re: Scheduler benchmarks
Date: Thu, 29 Apr 2021 18:32:06 -0300	[thread overview]
Message-ID: <YIsl1o19AoQwgelk@kernel.org> (raw)
In-Reply-To: <CAHhAz+iC_F5w5EoZP8-dBNm+DV0uNMva6Mr2uBdmZtejL1OH-w@mail.gmail.com>

Em Wed, Aug 19, 2020 at 03:46:06PM +0530, Muni Sekhar escreveu:
> On Tue, Aug 18, 2020 at 11:45 PM peter enderborg <peter.enderborg@sony.com> wrote:
> > On 8/18/20 7:53 PM, Muni Sekhar wrote:
> > > On Tue, Aug 18, 2020 at 11:06 PM Greg KH <greg@kroah.com> wrote:
> > >> On Tue, Aug 18, 2020 at 11:01:35PM +0530, Muni Sekhar wrote:
> > >>> On Tue, Aug 18, 2020 at 10:44 PM Greg KH <greg@kroah.com> wrote:
> > >> Those are _very_ different kernel versions, with many years and tens of
> > >> thousands of different changes between them.
> > >>
> > >> Hopefully the newer kernel is faster, so just stick with that :)
> > > But unfortunately the newer kernel is very slow, that is the reason
> > > for starting this investigation :)
> > > Any type of help,  and guidelines to dive deeper will be highly appreciated.
> >
> > On the 4.4 kernel you dont have
> >
> > +CONFIG_RETPOLINE=y
> > +CONFIG_INTEL_RDT=y
> Thanks! That is helpful. Yes, I see 4.4 kernel don't have the above
> two config options.
> What analysis can be done to narrow down the root cause?
> Any example of reference could be helpful to understand.

This made me remember Lisbon:

http://vger.kernel.org/~acme/perf/bpf-is-eating-the-world-dont-you-see-lpc-lisbon-2019/#/8/2

Greg was there when this slide was first shown... ;-)

Look at the icache misses when the kernel is entered (syscall entry).

Then add this to the kernel command line: "nospectre_v1 nospectre_v2"

And see what happens:

http://vger.kernel.org/~acme/perf/bpf-is-eating-the-world-dont-you-see-lpc-lisbon-2019/#/8/3

So using these (and any new ones related to disabling hardware flaw
mitigation) maybe a way to analyse this, if you haven't figured this out
yet, sorry for the huge delay in replying 8-)

- Arnaldo
 
> >
> > And your base is very different two.
> >
> > Try to use mainline on both system and see.
> >
> > You can also use the same base kernel version from ubuntu and
> >
> > run your test.
> >
> >
> > >> greg k-h
> > >
> > >
> >
> 
> 
> -- 
> Thanks,
> Sekhar

-- 

- Arnaldo

  parent reply	other threads:[~2021-04-30  2:26 UTC|newest]

Thread overview: 34+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2020-08-18 14:30 Scheduler benchmarks Muni Sekhar
2020-08-18 14:30 ` Muni Sekhar
2020-08-18 14:36 ` Greg KH
2020-08-18 14:36   ` Greg KH
2020-08-18 16:01   ` Muni Sekhar
2020-08-18 16:50   ` Muni Sekhar
2020-08-18 16:54   ` Muni Sekhar
2020-08-18 16:54     ` Muni Sekhar
2020-08-18 17:14     ` Greg KH
2020-08-18 17:14       ` Greg KH
2020-08-18 17:31       ` Muni Sekhar
2020-08-18 17:31         ` Muni Sekhar
2020-08-18 17:36         ` Greg KH
2020-08-18 17:36           ` Greg KH
2020-08-18 17:53           ` Muni Sekhar
2020-08-18 17:53             ` Muni Sekhar
2020-08-18 18:15             ` peter enderborg
2020-08-18 18:15               ` peter enderborg
2020-08-18 18:15               ` peter enderborg
2020-08-19 10:16               ` Muni Sekhar
2020-08-19 10:16                 ` Muni Sekhar
2020-08-19 10:21                 ` Bernd Petrovitsch
2020-08-19 10:21                   ` Bernd Petrovitsch
2020-08-19 14:36                   ` David Laight
2020-08-19 14:36                     ` David Laight
2020-08-19 10:42                 ` Greg KH
2020-08-19 10:42                   ` Greg KH
2020-08-19 16:43                   ` Valdis Klētnieks
2020-08-19 16:43                     ` Valdis Klētnieks
2020-08-19 16:47                     ` Greg KH
2020-08-19 16:47                       ` Greg KH
2021-04-29 21:32                 ` Arnaldo Carvalho de Melo [this message]
2021-04-29 21:32                   ` Arnaldo Carvalho de Melo
2020-08-25 17:06 ` Mulyadi Santosa

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=YIsl1o19AoQwgelk@kernel.org \
    --to=acme@kernel.org \
    --cc=greg@kroah.com \
    --cc=kernelnewbies@kernelnewbies.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-perf-users@vger.kernel.org \
    --cc=munisekharrms@gmail.com \
    --cc=peter.enderborg@sony.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body. 
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.