From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751316AbcEHDE2 (ORCPT ); Sat, 7 May 2016 23:04:28 -0400 Received: from mail-bn1bbn0102.outbound.protection.outlook.com ([157.56.111.102]:30604 "EHLO na01-bn1-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1751244AbcEHDE1 (ORCPT ); Sat, 7 May 2016 23:04:27 -0400 Authentication-Results: kernel.org; dkim=none (message not signed) header.d=none;kernel.org; dmarc=none action=none header.from=hpe.com; Message-ID: <572EACAC.9010405@hpe.com> Date: Sat, 7 May 2016 23:04:12 -0400 From: Waiman Long User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0.12) Gecko/20130109 Thunderbird/10.0.12 MIME-Version: 1.0 To: Ingo Molnar CC: Peter Zijlstra , Ingo Molnar , , Davidlohr Bueso , Jason Low , Dave Chinner , Scott J Norton , Douglas Hatch Subject: Re: [PATCH v2] locking/rwsem: Add reader-owned state to the owner field References: <1462580424-40333-1-git-send-email-Waiman.Long@hpe.com> <20160507045636.GC27659@gmail.com> In-Reply-To: <20160507045636.GC27659@gmail.com> Content-Type: multipart/mixed; boundary="------------060802070908080107030804" X-Originating-IP: [63.156.242.50] X-ClientProxiedBy: BLUPR02CA057.namprd02.prod.outlook.com (10.160.23.175) To TU4PR84MB0319.NAMPRD84.PROD.OUTLOOK.COM (10.162.186.29) X-MS-Office365-Filtering-Correlation-Id: 0a4cad5a-364c-451e-ca51-08d376ed71fd X-Microsoft-Exchange-Diagnostics: 1;TU4PR84MB0319;2:svrhl2H9pO0E5LgebU3pb5UKv2WVY6KMIIWzEjnJOs2QGbOfaVwKdItlXRJhxi8oyiYn8w14j8avIELMXQVivCEG+fh3doNkKXi/p06cZjfUf/CzLg3DOE9Z9ty04hqmUSmmFWTvTgLDlOvdfxXPpoJjN1HikF6MzKw+4vyGahlel9LLL/QFqqyiOJ3rKtf9;3:xhwVguKxIvoR3UTAUnEt0oBgsfEf9+3BiQaPdhEbs7IaDvmLR3Wrgk4eAX5Rhj89VKjjyKIFKUufsKo/0as8bhgqkjLI7faBpJgkQCE2PSepEhP9fE1fzmnGcUGJ3yTZ;25:BdaOVOxXfV9JqxkLxGYoKPI+s/m049eJesoNPsS/RrOYRo1ySTziU1HY6wUxznc51w8XswXQiooK6SxgXb1k4DSi3TNubxPoc+fQcNQSbLD5dpGOKNeimnkxabbocJ075Yu4QpIjWKi4aHmB6gibG4PDDQRIaGSgS9meF1g/zuXDoJ6w9r4XR/rTlREPpxyx3YobNRKa2MSKPAmS3uISSHIzGKxTq+PhsoDnxFEKvpODHTjUE4OTDeSvWRjIvkCIqDXcynLdFD9IowkqGC63KkGSh5/Kr/InYjrR2zGmBIq4EBbesC5m4mqfCU2ggf+1MbD2ra1KBDbJczwMyYCRZLIzcjS6wW+UWldt1oUwK4WN1RFWRbvae1XqVwthsP/VqWtG1MQUPJhPICqXFF7T+cQke+tyVgwAvx6ZxVpsg4ETTNVdRZ5ds4xX5Ctrm7WIa1rhhbJMLzxswYC5Q8rb+w== X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:TU4PR84MB0319; X-LD-Processed: 105b2061-b669-4b31-92ac-24d304d195dc,ExtAddr X-Microsoft-Exchange-Diagnostics: 1;TU4PR84MB0319;20:7zRaCw0EABhaXi2n+hcjqBKn5UeEkpe55BzlyTF8/83A8Yo+q4JzpY5igt6NU/eCjdvI7EdS3N95yUqrJ8f470OBmiw8NTLGbmKkjT5NkqSMccCyCdLh+8UBCmdmsRWUCXiobYJiZ1rK9qpqHYO0vXBEmi9Vwl3EG8xzpbBfFMf+5wSTwAj5CnZxzCvzihEpSs9FaD8gojjN++3e3m2fDg3SBSHCTAvnRQbKqAJVLKMPjfaufF7rFHuNlLCxWktJgmJ62bYPirNg9KfZQnRpTFZ2vPRp3fMJMEhDCjuIw6P6CUffQdyaurKRSj9F/yg9cygrXhz0fhIxpG9ecP0oNg==;4:2CGJ4XVix4swYUBOTK5BTIU9gB24UvP3GZyRhFXDHKYmblBiewPMlaMJ3hqmLDVYcPWMG6bm37uJoTtLTYXsfJJf9ThCJ89W+lnARcrZNW9FCYlP4rg5Emh7SdonP46/vCMYaHpGO9kt3Ift6sBqCah8mehjMEbpg3JKdwFj2V3w0HgSh/1N5O5DZKFT0MhKxkCeQHHG4+ZzuHv2gJfEk+RrfWaLwb2tKkbpmOEzZXhqQX4FtDN4y54B6qeRjq36CWSTjVu500QTM61yShKvZV4IViNz8cEZcZHmZbEROnRafy13xuCJ9GU1BFa0bI2Fuyb49/mGZMJZ3ACMI+8bfRbHKaHK8sq0thj6c+JgZhCgdJOCnP9OietY9ij9sUHneoPFZsKBCVwy+2j7krMNoU/KKrCPKpJ4VKHKALQCrp8= X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(102415293)(102615271)(601004)(2401047)(5005006)(8121501046)(3002001)(10201501046);SRVR:TU4PR84MB0319;BCL:0;PCL:0;RULEID:;SRVR:TU4PR84MB0319; X-Forefront-PRVS: 09368DB063 X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10019020)(4630300001)(6049001)(6009001)(377454003)(24454002)(9170700001)(81166005)(86362001)(65956001)(21480400002)(66066001)(270700001)(19580395003)(19580405001)(2950100001)(80316001)(5004730100002)(5008740100001)(33656002)(65816999)(87266999)(4326007)(54356999)(84326002)(50986999)(76176999)(64126003)(5890100001)(4810100001)(6116002)(3846002)(117156001)(586003)(36756003)(2476003)(2906002)(92566002)(77096005)(189998001)(5000100001)(110136002)(512934002)(4610100001)(42186005)(7059030);DIR:OUT;SFP:1102;SCL:1;SRVR:TU4PR84MB0319;H:[192.168.142.170];FPR:;SPF:None;MLV:sfv;LANG:en; X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1;TU4PR84MB0319;23:nrfRaCbUWhFvasDy1VMgN1TEbJSHdQctXH/HY1Trp?= =?us-ascii?Q?IS+T/eQJSgQmgitXlbYkjl6e6OvF+/z1lk79KHwwv1POlSTq3tCnNc+eUJRM?= =?us-ascii?Q?A7p3C+8IfhWCZTH//LfAlfASyrXQs3bz2cJF4xG6dJxUw+HfpoXlt9bIkLFK?= =?us-ascii?Q?0vo4FqjSVkOuxop3vYYnKTv03R5jf0P+E4LTQZCa4PK1lsG8bM5So+cH5urP?= =?us-ascii?Q?DAG9IyTtViitSay7DY2vJ83u+o8G2FemUbQZ0KsERwMUKrbd2GhkEdrIPTri?= =?us-ascii?Q?F3EsdmrzySkvTdMA3LTrl4HMMZJ9M2iRlK9iGu3fwFGIpOKl98CsQA9BCzCD?= =?us-ascii?Q?YKydALFEadZibA5k06GtBH9bPJFkdopWUVhp3HazXZBW5NH52JyPSST0XgKV?= =?us-ascii?Q?pieaIo06I21FVyMSUL06v3e3o26znsvjhFGQ8nCHAR77HNBT79ksseiepaGt?= =?us-ascii?Q?ginfypenwpfhsWcT1YL/MObP2f6iCIoL8kOFp2t/yXvz/uEo9JqwzEZrYHVu?= =?us-ascii?Q?KL9mKjVdE/jEmz74uXbWrQJpDWutvIy+Cm/5nl0LhHZTW402MPo84zosUBcP?= =?us-ascii?Q?OGcnlhpeas84f/6WTuA0nl8/AbVWw2R+Jr73RPzNLUls6krFurffAIQJtBrd?= =?us-ascii?Q?MEtek64yQ1qknm6eEwIeiuUICkVSqXdqHYKeH05WsWJcxMbJxcv4DMwL/EpV?= =?us-ascii?Q?8cSAipdKX9OLjy/kOG8UIJZkfqyzzKIgqc+wbMFJw4EMmzdVxpFKHbp24nb7?= =?us-ascii?Q?XTRB7a1jkdLRMJkbaSqit+AFjxlzXcSSa5hzDerwWJhst1to8+QcOSmLzvF4?= =?us-ascii?Q?86873rsXcJPa/X0AFNtDODdjWlIrh7YOYEBB7hMzVXGtHaU7bZaIEJzmSggB?= =?us-ascii?Q?2YBWZ027Rrt0uhey5/Fum2OiI5FawytTnyshOvUaXICLSlHfWC+z1ZDPucZ4?= =?us-ascii?Q?nNOrFH/L9rwU2b1yevOjCmB3fFsaOZQmgM1wDUmcdQjWFZ3DPHFLklyNR99i?= =?us-ascii?Q?BVE8+524+ZLI2I3m9b4s1hka9jZiCWrltPcqtfM7XCPdbLYXqFDPmBQxx431?= =?us-ascii?Q?StDgANI3s7E4PDgD7QLX3Ar0SN1bqT/AGHUYYL35pxIIyFLDN4CRg3uAUJdr?= =?us-ascii?Q?4kQhXCoirTScHPk9DOHua9Z2OoXSsLe7398RXxWOuiNg/3YuN3qIjm30uy4t?= =?us-ascii?Q?VayWzoimOghiBUszPWmOyi0soPbadISkb3c?= X-Microsoft-Exchange-Diagnostics: 1;TU4PR84MB0319;5:j5RZ3KLEYBddYIY5ChhoVzLcZcr2nXC3iAfVAiMzq3BNYDlABY+rljWqgVC3GRhAp0SdKvfK2StRs7to7AK6/iE4Sn2/8BFQ9W8S1NzwPtYcixTr1NOT3JuRdgZFFcUhMsUhaiasSiuH/c50KmYxyQ==;24:9VgTAozjoLpAOtStfZ5r3z7OC3jS9EhdpbMyXcKuf++90ibk/2CUiXCPsEWkbjvlWFLxqWYzLB08mDnC22w7d+oVreoXBL9MtNPBEPEvdyc=;7:dqY4NvrstsJ5577jHUUijE6ax80bW3psOLLMRP8gl2Q4zVtua0lCXY50j1GsXAhPDcmC6jRQr0DavneiyClvB/mDITj9Kh1HeoOX951Uh93kQHs9A43dEEgiH48Vcn2zuXF7RMoMqYzNecOzt2Gs7WufCycIjcVqvHr7CceU79qh+m033h9hj1Nm7dDOVS5V SpamDiagnosticOutput: 1:23 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: hpe.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 May 2016 03:04:17.5999 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: TU4PR84MB0319 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org --------------060802070908080107030804 Content-Type: text/plain; charset="ISO-8859-1"; format=flowed Content-Transfer-Encoding: 7bit On 05/07/2016 12:56 AM, Ingo Molnar wrote: > * Waiman Long wrote: > >> On a 4-socket Haswell machine running on a 4.6-rc1 based kernel, the >> fio test with multithreaded randrw and randwrite tests on the same >> file on a XFS partition on top of a NVDIMM were run, the aggregated >> bandwidths before and after the patch were as follows: >> >> Test BW before patch BW after patch % change >> ---- --------------- -------------- -------- >> randrw 988 MB/s 1192 MB/s +21% >> randwrite 1513 MB/s 1623 MB/s +7.3% > What testcase/suite is this? I'd like to run this on other machines as well. > > Thanks, > > Ingo I just used fio on a nvdimm based xfs filesystem. It is essentially like a ramfs filesystem in term of performance. Attached were config files that I used. Cheers, Longman --------------060802070908080107030804 Content-Type: text/plain; name="rw.fio" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="rw.fio" [global] direct=1 ioengine=libaio norandommap randrepeat=0 bs=4K size=1G iodepth=1 # pmem has no queue depth runtime=30 time_based=1 group_reporting thread=1 gtod_reduce=1 # reduce=1 except for latency test gtod_cpu=1 ## cross-CPU combinations numjobs=18 cpus_allowed=0-39 cpus_allowed_policy=split [drive_0] filename=/mnt/fio cpus_allowed=0-17 rw=randrw [drive_1] filename=/mnt/fio2 cpus_allowed=18-35 rw=randrw --------------060802070908080107030804 Content-Type: text/plain; name="wo.fio" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="wo.fio" [global] direct=1 ioengine=libaio norandommap randrepeat=0 bs=4K size=1G iodepth=1 # pmem has no queue depth runtime=30 time_based=1 group_reporting thread=1 gtod_reduce=1 # reduce=1 except for latency test gtod_cpu=1 ## cross-CPU combinations numjobs=18 cpus_allowed=0-39 cpus_allowed_policy=split [drive_0] filename=/mnt/fio cpus_allowed=0-17 rw=randwrite [drive_1] filename=/mnt/fio2 cpus_allowed=18-35 rw=randwrite --------------060802070908080107030804--