From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail144.messagelabs.com (mail144.messagelabs.com [216.82.254.51]) by kanga.kvack.org (Postfix) with ESMTP id E4D166B0082 for ; Wed, 15 Jun 2011 16:33:09 -0400 (EDT) Subject: Re: REGRESSION: Performance regressions from switching anon_vma->lock to mutex From: Peter Zijlstra In-Reply-To: <1308163398.17300.147.camel@schen9-DESK> References: <1308097798.17300.142.camel@schen9-DESK> <1308101214.15392.151.camel@sli10-conroe> <1308138750.15315.62.camel@twins> <20110615161827.GA11769@tassilo.jf.intel.com> <1308156337.2171.23.camel@laptop> <1308163398.17300.147.camel@schen9-DESK> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Date: Wed, 15 Jun 2011 22:32:17 +0200 Message-ID: <1308169937.15315.88.camel@twins> Mime-Version: 1.0 Sender: owner-linux-mm@kvack.org List-ID: To: Tim Chen Cc: Andi Kleen , Shaohua Li , Andrew Morton , Linus Torvalds , Hugh Dickins , KOSAKI Motohiro , Benjamin Herrenschmidt , David Miller , Martin Schwidefsky , Russell King , Paul Mundt , Jeff Dike , Richard Weinberger , "Luck, Tony" , KAMEZAWA Hiroyuki , Mel Gorman , Nick Piggin , Namhyung Kim , "Shi, Alex" , "linux-kernel@vger.kernel.org" , "linux-mm@kvack.org" , "Rafael J. Wysocki" On Wed, 2011-06-15 at 11:43 -0700, Tim Chen wrote: > Wonder if you can provide the profile on your run so I can compare with > what I got on 4 sockets?=20 Sure, so this is on an Westmere-EP (2 sockets, 6 cores/socket, 2 threads/core), what I did was: perf record -r2 -gf make bench perf report > foo.txt bzip2 -9 foo.txt Both files are about 0.5M, the tip one has the sirq-rcu patch and linus' patch applied (could do one without if wanted). http://programming.kicks-ass.net/sekrit/tip.txt.bz2 http://programming.kicks-ass.net/sekrit/39.txt.bz2 However, looking at them, the weird thing is, they're both dominated by (taken from 39.txt): 7.44% exim [kernel.kallsyms] [k] format_decode | --- format_decode | =20 |--93.07%-- vsnprintf | | =20 | |--98.83%-- seq_printf | | show_stat | | seq_read | | proc_reg_read | | vfs_read | | sys_read | | system_call | | __GI___libc_read | | | =20 | | |--99.47%-- (nil) | | --0.53%-- [...] | | =20 | --1.17%-- snprintf | proc_flush_task | release_task | wait_consider_task | do_wait | sys_wait4 | system_call | | =20 | |--93.15%-- __libc_wait | | =20 | --6.85%-- __waitpid | =20 |--6.84%-- seq_printf | show_stat | seq_read | proc_reg_read | vfs_read | sys_read | system_call | __GI___libc_read | | =20 | |--99.56%-- (nil) | --0.44%-- [...] --0.10%-- [...] I've no idea why its doing that, I've had massive trouble getting this MOSBENCH crap working in the first place since its all in python, but what I basically done was rip out everything !exim in config.py and put cores =3D [24]. In hosts.py I too ripped out everything !exim, cleared out the clients list and made 'tom' my localhost (removing that perflock thing). After that things more or less ran, I saw exim, and its giving me those msgs/sec/core numbers like: # perf record -r2 -gfo 39.perf.data make bench python config.py Starting results in: results/20110615-221914 *** Starting configuration 1/1 (benchmark-exim) *** Starting Host.host-westmere... sending westmere: /./ del.ing westmere: out/log/EximLoad.trial-2.host-westmere del.ing westmere: out/log/EximLoad.trial-1.host-westmere del.ing westmere: out/log/EximLoad.trial-0.host-westmere del.ing westmere: out/log/ del.ing westmere: out/EximDaemon.host-westmere.configure del.ing westmere: out/ sending westmere: /home/root/ sending westmere: /home/root/test/mosbench/ Starting Host.host-westmere... done Starting HostInfo.host-westmere... Starting HostInfo.host-westmere... done Starting FileSystem.host-westmere.fstype-tmpfs-separate... Starting FileSystem.host-westmere.fstype-tmpfs-separate... done Starting SetCPUs.host-westmere... FATAL: Module oprofile not found. FATAL: Module oprofile not found. Kernel doesn't support oprofile CPUs 0-23 are online CPUs 0-23 are online Starting SetCPUs.host-westmere... done Starting EximDaemon.host-westmere... Starting EximDaemon.host-westmere... done Waiting on EximLoad.trial-0.host-westmere... [EximLoad.trial-0.host-westmere] =3D> 86983 messages (15.0032 secs, 241.568= messages/sec/core) Waiting on EximLoad.trial-0.host-westmere... done Waiting on EximLoad.trial-1.host-westmere... [EximLoad.trial-1.host-westmere] =3D> 86770 messages (15.004 secs, 240.964 = messages/sec/core) Waiting on EximLoad.trial-1.host-westmere... done Waiting on EximLoad.trial-2.host-westmere... [EximLoad.trial-2.host-westmere] =3D> 86987 messages (15.0035 secs, 241.574= messages/sec/core) Waiting on EximLoad.trial-2.host-westmere... done Stopping EximDaemon.host-westmere... Stopping EximDaemon.host-westmere... done Stopping HostInfo.host-westmere... Stopping HostInfo.host-westmere... done Stopping Host.host-westmere... copying westmere: ./ copying westmere: EximDaemon.host-westmere.configure copying westmere: log/ copying westmere: log/EximLoad.trial-0.host-westmere copying westmere: log/EximLoad.trial-1.host-westmere copying westmere: log/EximLoad.trial-2.host-westmere Stopping Host.host-westmere... done Stopping ResultPath... Results in: results/20110615-221914/benchmark-exim Stopping ResultPath... done All results in: results/20110615-221914 [ perf record: Woken up 3774 times to write data ] [ perf record: Captured and wrote 979.494 MB 39.perf.data (~42794760 sample= s) ] CPUs 0-23 are online -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Fight unfair telecom internet charges in Canada: sign http://stopthemeter.ca/ Don't email: email@kvack.org