From mboxrd@z Thu Jan 1 00:00:00 1970 From: "hzwulibin" Subject: Re: RE: [performance] why rbd_aio_write latency increase from 4ms to 7.3ms after the same test Date: Tue, 03 Nov 2015 08:46:17 +0800 Message-ID: <563803D6.3080201@gmail.com> References: <5636F376.3090104@gmail.com> <6F3FA899187F0043BA1827A69DA2F7CC03639832@shsmsx102.ccr.corp.intel.com> Mime-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Return-path: Received: from mail-pa0-f65.google.com ([209.85.220.65]:36120 "EHLO mail-pa0-f65.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751112AbbKCAqS (ORCPT ); Mon, 2 Nov 2015 19:46:18 -0500 Received: by pabfh17 with SMTP id fh17so134864pab.3 for ; Mon, 02 Nov 2015 16:46:17 -0800 (PST) Received: from HSH-D-2405 ([43.230.90.81]) by smtp.gmail.com with ESMTPSA id ha3sm26191867pbb.28.2015.11.02.16.46.15 for (version=TLSv1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Mon, 02 Nov 2015 16:46:16 -0800 (PST) In-Reply-To: <6F3FA899187F0043BA1827A69DA2F7CC03639832@shsmsx102.ccr.corp.intel.com> Sender: ceph-devel-owner@vger.kernel.org List-ID: To: ceph-devel SGksDQoNClRoYW5rIHlvdSwgdGhhdCBtYWtlIHNlbnNlIGZvciB0ZXN0aW5nLCBidXQgaSdtIGFm cmFpZCBub3QgaW4gbXkgY2FzZS4NCkV2ZW4gaSB0ZXN0IG9uIHRoZSB2b2x1bWUgdGhhdCBhbHJl YWR5IHRlc3QgbWFueSB0aW1lcywgdGhlIElPUFMgd2lsbCBub3QgZ3Jvd2luZyB1cCANCmFnYWlu LiBZZWFoLCBpIG1lYW4sIHRoaXMgVk0gaXMgYnJva2VuLCBJT1BTIG9mIHRoZSBWTSB3aWxsIG5l dmVyIGdyb3dpbmcgdXAuLg0KDQpUaGFua3MhDQoNCi0tLS0tLS0tLS0tLS0tLS0tLQkJCQkgDQpo end1bGliaW4NCjIwMTUtMTEtMDMNCg0KLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQ0K5Y+R5Lu25Lq677yaIkNoZW4sIFhpYW94aSIg PHhpYW94aS5jaGVuQGludGVsLmNvbT4NCuWPkemAgeaXpeacn++8mjIwMTUtMTEtMDIgMTQ6MTEN CuaUtuS7tuS6uu+8mmh6d3VsaWJpbixjZXBoLWRldmVsLGNlcGgtdXNlcnMNCuaKhOmAge+8mg0K 5Li76aKY77yaUkU6IFtwZXJmb3JtYW5jZV0gd2h5IHJiZF9haW9fd3JpdGUgbGF0ZW5jeSBpbmNy ZWFzZSBmcm9tIDRtcyB0bw0KIDcuM21zIGFmdGVyIHRoZSBzYW1lIHRlc3QNCg0KUHJlLWFsbG9j YXRlZCB0aGUgdm9sdW1lIGJ5ICJERCIgYWNyb3NzIHRoZSBlbnRpcmUgUkJEIGJlZm9yZSB5b3Ug ZG8gYW55IHBlcmZvcm1hbmNlIHRlc3Q6KS4NCg0KSW4gdGhpcyBjYXNlLCB5b3UgbWF5IHdhbnQg dG8gcmUtY3JlYXRlIHRoZSBSQkQsIHByZS1hbGxvY2F0ZSBhbmQgdHJ5IGFnYWluLg0KDQo+IC0t LS0tT3JpZ2luYWwgTWVzc2FnZS0tLS0tDQo+IEZyb206IGNlcGgtZGV2ZWwtb3duZXJAdmdlci5r ZXJuZWwub3JnIFttYWlsdG86Y2VwaC1kZXZlbC0NCj4gb3duZXJAdmdlci5rZXJuZWwub3JnXSBP biBCZWhhbGYgT2YgaHp3dWxpYmluDQo+IFNlbnQ6IE1vbmRheSwgTm92ZW1iZXIgMiwgMjAxNSAx OjI0IFBNDQo+IFRvOiBjZXBoLWRldmVsOyBjZXBoLXVzZXJzDQo+IFN1YmplY3Q6IFtwZXJmb3Jt YW5jZV0gd2h5IHJiZF9haW9fd3JpdGUgbGF0ZW5jeSBpbmNyZWFzZSBmcm9tIDRtcyB0bw0KPiA3 LjNtcyBhZnRlciB0aGUgc2FtZSB0ZXN0DQo+IA0KPiBIaSwNCj4gc2FtZSBlbnZpcm9ubWVudCwg YWZ0ZXIgYSB0ZXN0IHNjcmlwdCwgdGhlIGlvIGxhdGVuY3koZ2V0IGZyb20gc3VkbyBjZXBoIC0t DQo+IGFkbWluLWRhZW1vbiAvcnVuL2NlcGgvZ3Vlc3RzL2NlcGgtY2xpZW50LiouYXNvayBwZXIg ZHVtcCkgaW5jcmVhc2UNCj4gZnJvbSBhYm91dCA0bXMgdG8gNy4zbXMNCj4gDQo+IHFlbXUgdmVy c2lvbjogZGViaWFuIDIuMS4yDQo+IGtlcm5lbDozLjEwLjQ1LW9wZW5zdGFjay1hbWQ2NA0KPiBz eXN0ZW06IGRlYmlhbiA3LjgNCj4gY2VwaDogMC45NC41DQo+IFZNIENQVSBudW1iZXI6IDQgIChj cHUgTUh6IDogMjU5OS45OTgpDQo+IFZNIG1lbW9yeSBzaXplOiAxNkdCDQo+IDkgT1NEIHN0b3Jh Z2Ugc2VydmVycywgd2l0aCA0IFNTRCBPU0Qgb24gZWFjaCwgdG90YWwgMzYgT1NEcy4NCj4gDQo+ IFRlc3Qgc2NyaXB0cyBpbiBWTToNCj4gIyBjYXQgcmVwcm9kdWNlLnNoDQo+ICMhL2Jpbi9iYXNo DQo+IA0KPiB0aW1lcz0yMA0KPiBmb3IoKGk9MTtpPD0kdGltZXM7aSsrKSkNCj4gZG8NCj4gICAg IHRtcGRhdGU9YGRhdGUgIislRi0lVCJgDQo+ICAgICBlY2hvDQo+ICI9PT09PT09PT09PT09PT09 PT09PT09PSR0bXBkYXRlKCRpLyR0aW1lcyk9PT09PT09PT09PT09PT09PT09DQo+ID09PT0iDQo+ ICAgICB0bXA9JCgoaSUyKSkNCj4gICAgIGlmIFtbICR0bXAgLWVxIDAgXV07dGhlbg0KPiAgICAg ICAgIGVjaG8gIiMjIyMjIyMjIyMjIyMjIyBmaW8gL3Jvb3QvdmRiLmNmZyAjIyMjIyMjIyMjIyMj IyMiDQo+ICAgICAgICAgZmlvIC9yb290L3ZkYi5jZmcNCj4gICAgIGVsc2UNCj4gICAgICAgICBl Y2hvICIjIyMjIyMjIyMjIyMjIyMgZmlvIC9yb290L3ZkYy5jZmcgIyMjIyMjIyMjIyMjIyMjIg0K PiAgICAgICAgIGZpbyAvcm9vdC92ZGMuY2ZnDQo+ICAgICBmaQ0KPiBkb25lDQo+IA0KPiANCj4g dG1wZGF0ZT1gZGF0ZSAiKyVGLSVUImANCj4gZWNobyAiIyMjIyMjIyMjIyMjIyMjIFskdG1wZGF0 ZV0gZmlvIC9yb290L3ZkZS5jZmcgIyMjIyMjIyMjIyMjIyMjIg0KPiBmaW8gL3Jvb3QvdmRlLmNm Zw0KPiANCj4gDQo+ICMgY2F0IHZkYi5jZmcNCj4gW2dsb2JhbF0NCj4gcnc9cmFuZHdyaXRlDQo+ IGRpcmVjdD0xDQo+IG51bWpvYnM9NjQNCj4gaW9lbmdpbmU9c3luYw0KPiBic3JhbmdlPTRrLTRr DQo+IHJ1bnRpbWU9MTgwDQo+IGdyb3VwX3JlcG9ydGluZw0KPiANCj4gW2Rpc2swMV0NCj4gZmls ZW5hbWU9L2Rldi92ZGINCj4gDQo+IA0KPiAjIGNhdCB2ZGMuY2ZnDQo+IFtnbG9iYWxdDQo+IHJ3 PXJhbmR3cml0ZQ0KPiBkaXJlY3Q9MQ0KPiBudW1qb2JzPTY0DQo+IGlvZW5naW5lPXN5bmMNCj4g YnNyYW5nZT00ay00aw0KPiBydW50aW1lPTE4MA0KPiBncm91cF9yZXBvcnRpbmcNCj4gDQo+IFtk aXNrMDFdDQo+IGZpbGVuYW1lPS9kZXYvdmRjDQo+IA0KPiAjIGNhdCB2ZGQuY2ZnDQo+IFtnbG9i YWxdDQo+IHJ3PXJhbmR3cml0ZQ0KPiBkaXJlY3Q9MQ0KPiBudW1qb2JzPTY0DQo+IGlvZW5naW5l PXN5bmMNCj4gYnNyYW5nZT00ay00aw0KPiBydW50aW1lPTE4MA0KPiBncm91cF9yZXBvcnRpbmcN Cj4gDQo+IFtkaXNrMDFdDQo+IGZpbGVuYW1lPS9kZXYvdmRkDQo+IA0KPiAjIGNhdCB2ZGUuY2Zn DQo+IFtnbG9iYWxdDQo+IHJ3PXJhbmR3cml0ZQ0KPiBkaXJlY3Q9MQ0KPiBudW1qb2JzPTY0DQo+ IGlvZW5naW5lPXN5bmMNCj4gYnNyYW5nZT00ay00aw0KPiBydW50aW1lPTE4MA0KPiBncm91cF9y ZXBvcnRpbmcNCj4gDQo+IFtkaXNrMDFdDQo+IGZpbGVuYW1lPS9kZXYvdmRlDQo+IA0KPiBBZnRl ciBydW4gdGhlIHNjcmlwdHMgcmVwcm9kdWNlLnNoLCB0aGUgZGlza3MgaW4gdGhlIFZNJ3MgSU9Q UyBjdXRkb3duIGZyb20NCj4gMTJrIHRvIDVrLCB0aGUgbGF0ZW5jeSBpbmNyZWFzZSBmcm9tIDRt cyB0byA3LjNtcy4NCj4gDQo+IHJ1biBzdGVwczoNCj4gMS4gY3JlYXRlIGEgVk0NCj4gMi4gY3Jl YXRlIGZvdXIgdm9sdW1lcyBhbmQgYXR0YXRjaCB0byB0aGUgVk0gMy4gc2ggcmVwcm9kdWNlLnNo IDQuIGluIHRoZQ0KPiBydW50aW1lIG9mICByZXByb2R1Y2Uuc2gsIHJ1biAiZmlvIHZkZC5jZmci IG9yICJmaW8gdmRlLmNmZyIgdG8gY2hlY2t0IHRoZQ0KPiBwZXJmb3JtYW5jZQ0KPiANCj4gQWZ0 ZXIgcmVwcm9kdWNlLnNoIGZpbmlzaGVkLCBwZXJmb3JtYW5jZSBkb3duLg0KPiANCj4gDQo+IEFu eW9uZSBoYXMgdGhlIHNhbWUgcHJvYmxlbSBvciBoYXMgc29tZSBpZGVhcyBhYm91dCB0aGlzPw0K PiANCj4gVGhhbmtzIQ0KPiAtLS0tLS0tLS0tLS0tLQ0KPiBoend1bGliaW4NCj4gMjAxNS0xMS0w Mg0KPiAEIHsubiArICAgICAgICslICBsendtICBiIOunsiAgciAgecepINevelggIBcgINyofSAg IMageiAmajordiAgICAgICAgelorICAremYgICBoICAgfiAgICBpICAgeiAeIHcgICA/DQo+ICYg Kd+iG2YNCg0K