All of lore.kernel.org
 help / color / mirror / Atom feed
From: Joe Perches <joe@perches.com>
To: Michal Hocko <mhocko@kernel.org>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	Jann Horn <jann@thejh.net>,
	linux-mm@kvack.org, LKML <linux-kernel@vger.kernel.org>
Subject: Re: [PATCH 0/2] fs, proc: optimize smaps output formatting
Date: Sat, 20 Aug 2016 00:55:05 -0700	[thread overview]
Message-ID: <1471679705.4036.2.camel@perches.com> (raw)
In-Reply-To: <20160820072927.GA23645@dhcp22.suse.cz>

On Sat, 2016-08-20 at 09:29 +0200, Michal Hocko wrote:
> On Fri 19-08-16 10:43:15, Joe Perches wrote:
> > 
> > On Fri, 2016-08-19 at 12:12 +0200, Michal Hocko wrote:
> > > 
> > > Hi,
> > > this is rebased on top of next-20160818. Joe has pointed out that
> > > meminfo is using a similar trick so I have extracted guts of what we
> > > have already and made it more generic to be usable for smaps as well
> > > (patch 1). The second patch then replaces seq_printf with seq_write
> > > and show_val_kb which should have smaller overhead and my measuring (in
> > > kvm) shows quite a nice improvements. I hope kvm is not playing tricks
> > > on me but I didn't get to test on a real HW.
> > 
> > Hi Michal.
> > 
> > A few comments:
> > 
> > For the first patch:
> > 
> > I think this isn't worth the expansion in object size (x86-64 defconfig)
> > 
> > $ size fs/proc/meminfo.o*
> >    text	   data	    bss	    dec	    hex	filename
> >    2698	      8	      0	   2706	    a92	fs/proc/meminfo.o.new
> >    2142	      8	      0	   2150	    866	fs/proc/meminfo.o.old
> > 
> > Creating a new static in task_mmu would be smaller and faster code.
> Hmm, nasty...
> add/remove: 0/0 grow/shrink: 2/1 up/down: 1081/-24 (1057)
> function                                     old     new   delta
> meminfo_proc_show                           1134    1745    +611
> show_smap                                    560    1030    +470
> show_val_kb                                  140     116     -24
> Total: Before=91716, After=92773, chg +1.15%
> 
> it seems to be calls to seq_write which blown up the size. So I've tried
> to put seq_write back to show_val_kb and did only sizeof() inside those
> macros and that reduced the size but not fully back to the original code
> size. So it seems the value shifts consumed some portion of that as well.
> I've ended up with the following incremental diff which leads to
>    text    data     bss     dec     hex filename
>  100728    1443     400  102571   190ab fs/proc/built-in.o.next
>  101658    1443     400  103501   1944d fs/proc/built-in.o.patched
>  100951    1443     400  102794   1918a fs/proc/built-in.o.incremental
> 
> There is still some increase wrt. the baseline but I guess that can be
> explained by single seq_printf -> many show_name_val_kb calls.
> 
> If that looks acceptable I will respin both patches. I would really
> like to prefer to not duplicate show_val_kb into task_mmu as much as
> possible, though.

I think the patch set I'll send you in a few minutes
will speed up /proc/<pid>/smaps a whole lot more.

Please test it using your little test bench.

cheers, Joe

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

WARNING: multiple messages have this Message-ID (diff)
From: Joe Perches <joe@perches.com>
To: Michal Hocko <mhocko@kernel.org>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	Jann Horn <jann@thejh.net>,
	linux-mm@kvack.org, LKML <linux-kernel@vger.kernel.org>
Subject: Re: [PATCH 0/2] fs, proc: optimize smaps output formatting
Date: Sat, 20 Aug 2016 00:55:05 -0700	[thread overview]
Message-ID: <1471679705.4036.2.camel@perches.com> (raw)
In-Reply-To: <20160820072927.GA23645@dhcp22.suse.cz>

On Sat, 2016-08-20 at 09:29 +0200, Michal Hocko wrote:
> On Fri 19-08-16 10:43:15, Joe Perches wrote:
> > 
> > On Fri, 2016-08-19 at 12:12 +0200, Michal Hocko wrote:
> > > 
> > > Hi,
> > > this is rebased on top of next-20160818. Joe has pointed out that
> > > meminfo is using a similar trick so I have extracted guts of what we
> > > have already and made it more generic to be usable for smaps as well
> > > (patch 1). The second patch then replaces seq_printf with seq_write
> > > and show_val_kb which should have smaller overhead and my measuring (in
> > > kvm) shows quite a nice improvements. I hope kvm is not playing tricks
> > > on me but I didn't get to test on a real HW.
> > 
> > Hi Michal.
> > 
> > A few comments:
> > 
> > For the first patch:
> > 
> > I think this isn't worth the expansion in object size (x86-64 defconfig)
> > 
> > $ size fs/proc/meminfo.o*
> >    text	   data	    bss	    dec	    hex	filename
> >    2698	      8	      0	   2706	    a92	fs/proc/meminfo.o.new
> >    2142	      8	      0	   2150	    866	fs/proc/meminfo.o.old
> > 
> > Creating a new static in task_mmu would be smaller and faster code.
> Hmm, nasty...
> add/remove: 0/0 grow/shrink: 2/1 up/down: 1081/-24 (1057)
> function                                     old     new   delta
> meminfo_proc_show                           1134    1745    +611
> show_smap                                    560    1030    +470
> show_val_kb                                  140     116     -24
> Total: Before=91716, After=92773, chg +1.15%
> 
> it seems to be calls to seq_write which blown up the size. So I've tried
> to put seq_write back to show_val_kb and did only sizeof() inside those
> macros and that reduced the size but not fully back to the original code
> size. So it seems the value shifts consumed some portion of that as well.
> I've ended up with the following incremental diff which leads to
>    text    data     bss     dec     hex filename
>  100728    1443     400  102571   190ab fs/proc/built-in.o.next
>  101658    1443     400  103501   1944d fs/proc/built-in.o.patched
>  100951    1443     400  102794   1918a fs/proc/built-in.o.incremental
> 
> There is still some increase wrt. the baseline but I guess that can be
> explained by single seq_printf -> many show_name_val_kb calls.
> 
> If that looks acceptable I will respin both patches. I would really
> like to prefer to not duplicate show_val_kb into task_mmu as much as
> possible, though.

I think the patch set I'll send you in a few minutes
will speed up /proc/<pid>/smaps a whole lot more.

Please test it using your little test bench.

cheers, Joe

  reply	other threads:[~2016-08-20  7:55 UTC|newest]

Thread overview: 50+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2016-08-18 11:31 [PATCH] proc, smaps: reduce printing overhead Michal Hocko
2016-08-18 11:31 ` Michal Hocko
2016-08-18 13:26 ` Joe Perches
2016-08-18 13:26   ` Joe Perches
2016-08-18 14:26   ` Michal Hocko
2016-08-18 14:26     ` Michal Hocko
2016-08-18 14:41     ` Joe Perches
2016-08-18 14:41       ` Joe Perches
2016-08-18 14:41     ` Michal Hocko
2016-08-18 14:41       ` Michal Hocko
2016-08-18 14:46       ` Joe Perches
2016-08-18 14:46         ` Joe Perches
2016-08-18 14:58         ` Michal Hocko
2016-08-18 14:58           ` Michal Hocko
2016-08-18 15:23           ` Joe Perches
2016-08-18 15:23             ` Joe Perches
2016-08-18 16:42             ` Michal Hocko
2016-08-18 16:42               ` Michal Hocko
2016-08-19 10:12 ` [PATCH 0/2] fs, proc: optimize smaps output formatting Michal Hocko
2016-08-19 10:12   ` Michal Hocko
2016-08-19 10:12   ` [PATCH 1/2] proc, meminfo: abstract show_val_kb Michal Hocko
2016-08-19 10:12     ` Michal Hocko
2016-08-26  2:54     ` [proc, meminfo] dd3b422c11: stderr.Signal#(FPE)caught_by_ps(procps-ng_version#) kernel test robot
2016-08-26  2:54       ` [lkp] " kernel test robot
2016-08-19 10:13   ` [PATCH 2/2] proc, smaps: reduce printing overhead Michal Hocko
2016-08-19 10:13     ` Michal Hocko
2016-08-19 17:43   ` [PATCH 0/2] fs, proc: optimize smaps output formatting Joe Perches
2016-08-19 17:43     ` Joe Perches
2016-08-19 20:18     ` Joe Perches
2016-08-19 20:18       ` Joe Perches
2016-08-20  7:29     ` Michal Hocko
2016-08-20  7:29       ` Michal Hocko
2016-08-20  7:55       ` Joe Perches [this message]
2016-08-20  7:55         ` Joe Perches
2016-08-20  8:00       ` [PATCH 0/2] seq: Speed up /proc/<pid>/smaps Joe Perches
2016-08-20  8:00         ` Joe Perches
2016-08-20  8:00         ` [PATCH 1/2] seq_file: Add __seq_open_private_bufsize for seq file_operation sizes Joe Perches
2016-08-20  8:00           ` Joe Perches
2016-08-20  8:00         ` [PATCH 2/2] proc: task_mmu: Reduce output processing cpu time Joe Perches
2016-08-20  8:00           ` Joe Perches
2016-08-22  7:24           ` Michal Hocko
2016-08-22  7:24             ` Michal Hocko
2016-08-22  8:00             ` Joe Perches
2016-08-22  8:00               ` Joe Perches
2016-08-22  8:30               ` Joe Perches
2016-08-22  8:30                 ` Joe Perches
2016-08-22 12:09                 ` Michal Hocko
2016-08-22 12:09                   ` Michal Hocko
2016-08-23 15:14 ` [PATCH] proc, smaps: reduce printing overhead Michal Hocko
2016-08-23 15:14   ` Michal Hocko

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1471679705.4036.2.camel@perches.com \
    --to=joe@perches.com \
    --cc=akpm@linux-foundation.org \
    --cc=jann@thejh.net \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=mhocko@kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.