From mboxrd@z Thu Jan 1 00:00:00 1970 From: Alexandre DERUMIER Subject: Re: ceph osd commit latency increase over time, until restart Date: Wed, 30 Jan 2019 14:45:09 +0100 (CET) Message-ID: <986643198.245013.1548855909082.JavaMail.zimbra@oxygem.tv> References: <395511117.2665.1548405853447.JavaMail.zimbra@oxygem.tv> <387140705.12275.1548407699184.JavaMail.zimbra@oxygem.tv> <1548181710.219518.1548833599717.JavaMail.zimbra@oxygem.tv> Mime-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Return-path: In-Reply-To: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: ceph-users-bounces-idqoXFIVOFJgJs9I8MT0rw@public.gmane.org Sender: "ceph-users" To: Sage Weil Cc: ceph-users , ceph-devel List-Id: ceph-devel.vger.kernel.org Pj5JIGRvbid0IHNlZSBhbnkgc21va2luZyBndW4gaGVyZS4uLiA6LyAKCkkgbmVlZCB0byB0ZXN0 IHRvIGNvbXBhcmUgd2hlbiBsYXRlbmN5IGFyZSBnb2luZyB2ZXJ5IGhpZ2gsIGJ1dCBJIG5lZWQg dG8gd2FpdCBtb3JlIGRheXMvd2Vla3MuCgoKPj5UaGUgbWFpbiBkaWZmZXJlbmNlIGJldHdlZW4g YSB3YXJtIE9TRCBhbmQgYSBjb2xkIG9uZSBpcyB0aGF0IG9uIHN0YXJ0dXAgCj4+dGhlIGJsdWVz dG9yZSBjYWNoZSBpcyBlbXB0eS4gWW91IG1pZ2h0IHRyeSBzZXR0aW5nIHRoZSBibHVlc3RvcmUg Y2FjaGUgCj4+c2l6ZSB0byBzb21ldGhpbmcgbXVjaCBzbWFsbGVyIGFuZCBzZWUgaWYgdGhhdCBo YXMgYW4gZWZmZWN0IG9uIHRoZSBDUFUgCj4+dXRpbGl6YXRpb24/IAoKSSB3aWxsIHRyeSB0byB0 ZXN0LiBJIGFsc28gd29uZGVyIGlmIHRoZSBuZXcgYXV0byBtZW1vcnkgdHVuaW5nIGZyb20gTWFy ayBjb3VsZCBoZWxwIHRvbyA/CihJJ20gc3RpbGwgb24gbWltaWMgMTMuMi4xLCBwbGFubmluZyB0 byB1cGRhdGUgdG8gMTMuMi41IG5leHQgbW9udGgpCgphbHNvLCBjb3VsZCBjaGVjayBzb21lIGJs dWVzdG9yZSByZWxhdGVkIGNvdW50ZXJzID8gKG9ub2Rlcywgcm9ja3NkYixibHVlc3RvcmUgY2Fj aGUuLi4uKQoKPj5Ob3RlIHRoYXQgdGhpcyBkb2Vzbid0IG5lY2Vzc2FyaWx5IG1lYW4gdGhhdCdz IHdoYXQgeW91IHdhbnQuIE1heWJlIHRoZSAKPj5yZWFzb24gd2h5IHRoZSBDUFUgdXRpbGl6YXRp b24gaXMgaGlnaGVyIGlzIGJlY2F1c2UgdGhlIGNhY2hlIGlzIHdhcm0gYW5kIAo+PnRoZSBPU0Qg aXMgc2VydmluZyBtb3JlIHJlcXVlc3RzIHBlciBzZWNvbmQuLi4gCgpXZWxsLCBjdXJyZW50bHks IHRoZSBzZXJ2ZXIgaXMgcmVhbGx5IHF1aWV0CgpEZXZpY2U6ICAgICAgICAgcnJxbS9zICAgd3Jx bS9zICAgICByL3MgICAgIHcvcyAgICBya0IvcyAgICB3a0IvcyBhdmdycS1zeiBhdmdxdS1zeiAg IGF3YWl0IHJfYXdhaXQgd19hd2FpdCAgc3ZjdG0gICV1dGlsCm52bWUwbjEgICAgICAgICAgIDIs MDAgICA1MTUsMDAgICA0OCwwMCAxMTgyLDAwICAgMzA0LDAwIDExMjE2LDAwICAgIDE4LDczICAg ICAwLDAxICAgIDAsMDAgICAgMCwwMCAgICAwLDAwICAgMCwwMSAgIDEsMjAKCiVDcHUocyk6ICAx LDUgdXMsICAxLDAgc3ksICAwLDAgbmksIDk3LDIgaWQsICAwLDIgd2EsICAwLDAgaGksICAwLDEg c2ksICAwLDAgc3QKCkFuZCB0aGlzIGlzIG9ubHkgd2l0aCB3cml0ZXMsIG5vdCByZWFkcwoKCgot LS0tLSBNYWlsIG9yaWdpbmFsIC0tLS0tCkRlOiAiU2FnZSBXZWlsIiA8c2FnZUBuZXdkcmVhbS5u ZXQ+CsOAOiAiYWRlcnVtaWVyIiA8YWRlcnVtaWVyQG9kaXNvLmNvbT4KQ2M6ICJjZXBoLXVzZXJz IiA8Y2VwaC11c2Vyc0BsaXN0cy5jZXBoLmNvbT4sICJjZXBoLWRldmVsIiA8Y2VwaC1kZXZlbEB2 Z2VyLmtlcm5lbC5vcmc+CkVudm95w6k6IE1lcmNyZWRpIDMwIEphbnZpZXIgMjAxOSAxNDozMzoy MwpPYmpldDogUmU6IGNlcGggb3NkIGNvbW1pdCBsYXRlbmN5IGluY3JlYXNlIG92ZXIgdGltZSwg dW50aWwgcmVzdGFydAoKT24gV2VkLCAzMCBKYW4gMjAxOSwgQWxleGFuZHJlIERFUlVNSUVSIHdy b3RlOiAKPiBIaSwgCj4gCj4gaGVyZSBzb21lIG5ldyByZXN1bHRzLCAKPiBkaWZmZXJlbnQgb3Nk LyBkaWZmZXJlbnQgY2x1c3RlciAKPiAKPiBiZWZvcmUgb3NkIHJlc3RhcnQgbGF0ZW5jeSB3YXMg YmV0d2VlbiAyLTVtcyAKPiBhZnRlciBvc2QgcmVzdGFydCBpcyBhcm91bmQgMS0xLjVtcyAKPiAK PiBodHRwOi8vb2Rpc293ZWIxLm9kaXNvLm5ldC9jZXBocGVyZjIvYmFkLnR4dCAoMi01bXMpIAo+ IGh0dHA6Ly9vZGlzb3dlYjEub2Rpc28ubmV0L2NlcGhwZXJmMi9vay50eHQgKDEtMS41bXMpIAo+ IGh0dHA6Ly9vZGlzb3dlYjEub2Rpc28ubmV0L2NlcGhwZXJmMi9kaWZmLnR4dCAKCkkgZG9uJ3Qg c2VlIGFueSBzbW9raW5nIGd1biBoZXJlLi4uIDovIAoKVGhlIG1haW4gZGlmZmVyZW5jZSBiZXR3 ZWVuIGEgd2FybSBPU0QgYW5kIGEgY29sZCBvbmUgaXMgdGhhdCBvbiBzdGFydHVwIAp0aGUgYmx1 ZXN0b3JlIGNhY2hlIGlzIGVtcHR5LiBZb3UgbWlnaHQgdHJ5IHNldHRpbmcgdGhlIGJsdWVzdG9y ZSBjYWNoZSAKc2l6ZSB0byBzb21ldGhpbmcgbXVjaCBzbWFsbGVyIGFuZCBzZWUgaWYgdGhhdCBo YXMgYW4gZWZmZWN0IG9uIHRoZSBDUFUgCnV0aWxpemF0aW9uPyAKCk5vdGUgdGhhdCB0aGlzIGRv ZXNuJ3QgbmVjZXNzYXJpbHkgbWVhbiB0aGF0J3Mgd2hhdCB5b3Ugd2FudC4gTWF5YmUgdGhlIApy ZWFzb24gd2h5IHRoZSBDUFUgdXRpbGl6YXRpb24gaXMgaGlnaGVyIGlzIGJlY2F1c2UgdGhlIGNh Y2hlIGlzIHdhcm0gYW5kIAp0aGUgT1NEIGlzIHNlcnZpbmcgbW9yZSByZXF1ZXN0cyBwZXIgc2Vj b25kLi4uIAoKc2FnZSAKCgoKPiAKPiA+RnJvbSB3aGF0IEkgc2VlIGluIGRpZmYsIHRoZSBiaWdn ZXN0IGRpZmZlcmVuY2UgaXMgaW4gdGNtYWxsb2MsIGJ1dCBtYXliZSBJJ20gd3JvbmcuIAo+IAo+ IChJJ20gdXNpbmcgdGNtYWxsb2MgMi41LTIuMikgCj4gCj4gCj4gLS0tLS0gTWFpbCBvcmlnaW5h bCAtLS0tLSAKPiBEZTogIlNhZ2UgV2VpbCIgPHNhZ2VAbmV3ZHJlYW0ubmV0PiAKPiDDgDogImFk ZXJ1bWllciIgPGFkZXJ1bWllckBvZGlzby5jb20+IAo+IENjOiAiY2VwaC11c2VycyIgPGNlcGgt dXNlcnNAbGlzdHMuY2VwaC5jb20+LCAiY2VwaC1kZXZlbCIgPGNlcGgtZGV2ZWxAdmdlci5rZXJu ZWwub3JnPiAKPiBFbnZvecOpOiBWZW5kcmVkaSAyNSBKYW52aWVyIDIwMTkgMTA6NDk6MDIgCj4g T2JqZXQ6IFJlOiBjZXBoIG9zZCBjb21taXQgbGF0ZW5jeSBpbmNyZWFzZSBvdmVyIHRpbWUsIHVu dGlsIHJlc3RhcnQgCj4gCj4gQ2FuIHlvdSBjYXB0dXJlIGEgcGVyZiB0b3Agb3IgcGVyZiByZWNv cmQgdG8gc2VlIHdoZXJlIHRlaCBDUFUgdGltZSBpcyAKPiBnb2luZyBvbiBvbmUgb2YgdGhlIE9T RHMgd3RoIGEgaGlnaCBsYXRlbmN5PyAKPiAKPiBUaGFua3MhIAo+IHNhZ2UgCj4gCj4gCj4gT24g RnJpLCAyNSBKYW4gMjAxOSwgQWxleGFuZHJlIERFUlVNSUVSIHdyb3RlOiAKPiAKPiA+IAo+ID4g SGksIAo+ID4gCj4gPiBJIGhhdmUgYSBzdHJhbmdlIGJlaGF2aW91ciBvZiBteSBvc2QsIG9uIG11 bHRpcGxlIGNsdXN0ZXJzLCAKPiA+IAo+ID4gQWxsIGNsdXN0ZXIgYXJlIHJ1bm5pbmcgbWltaWMg MTMuMi4xLGJsdWVzdG9yZSwgd2l0aCBzc2Qgb3IgbnZtZSBkcml2ZXJzLCAKPiA+IHdvcmtsb2Fk IGlzIHJiZCBvbmx5LCB3aXRoIHFlbXUta3ZtIHZtcyBydW5uaW5nIHdpdGggbGlicmJkICsgc25h cHNob3QvcmJkIGV4cG9ydC1kaWZmL3NuYXBzaG90ZGVsZXRlIGVhY2ggZGF5IGZvciBiYWNrdXAg Cj4gPiAKPiA+IFdoZW4gdGhlIG9zZCBhcmUgcmVmcmVzaGx5IHN0YXJ0ZWQsIHRoZSBjb21taXQg bGF0ZW5jeSBpcyBiZXR3ZWVuIDAsNS0xbXMuIAo+ID4gCj4gPiBCdXQgb3ZlcnRpbWUsIHRoaXMg bGF0ZW5jeSBpbmNyZWFzZSBzbG93bHkgKG1heWJlIGFyb3VuZCAxbXMgYnkgZGF5KSwgdW50aWwg cmVhY2hpbmcgY3JhenkgCj4gPiB2YWx1ZXMgbGlrZSAyMC0yMDBtcy4gCj4gPiAKPiA+IFNvbWUg ZXhhbXBsZSBncmFwaHM6IAo+ID4gCj4gPiBodHRwOi8vb2Rpc293ZWIxLm9kaXNvLm5ldC9vc2Rs YXRlbmN5MS5wbmcgCj4gPiBodHRwOi8vb2Rpc293ZWIxLm9kaXNvLm5ldC9vc2RsYXRlbmN5Mi5w bmcgCj4gPiAKPiA+IEFsbCBvc2RzIGhhdmUgdGhpcyBiZWhhdmlvdXIsIGluIGFsbCBjbHVzdGVy cy4gCj4gPiAKPiA+IFRoZSBsYXRlbmN5IG9mIHBoeXNpY2FsIGRpc2tzIGlzIG9rLiAoQ2x1c3Rl cnMgYXJlIGZhciB0byBiZSBmdWxsIGxvYWRlZCkgCj4gPiAKPiA+IEFuZCBpZiBJIHJlc3RhcnQg dGhlIG9zZCwgdGhlIGxhdGVuY3kgY29tZSBiYWNrIHRvIDAsNS0xbXMuIAo+ID4gCj4gPiBUaGF0 J3MgcmVtZW1iZXIgbWUgb2xkIHRjbWFsbG9jIGJ1ZywgYnV0IG1heWJlIGNvdWxkIGl0IGJlIGEg Ymx1ZXN0b3JlIG1lbW9yeSBidWcgPyAKPiA+IAo+ID4gQW55IEhpbnRzIGZvciBjb3VudGVycy9s b2dzIHRvIGNoZWNrID8gCj4gPiAKPiA+IAo+ID4gUmVnYXJkcywgCj4gPiAKPiA+IEFsZXhhbmRy ZSAKPiA+IAo+ID4gCj4gCj4gCj4gCgpfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fXwpjZXBoLXVzZXJzIG1haWxpbmcgbGlzdApjZXBoLXVzZXJzQGxpc3RzLmNl cGguY29tCmh0dHA6Ly9saXN0cy5jZXBoLmNvbS9saXN0aW5mby5jZ2kvY2VwaC11c2Vycy1jZXBo LmNvbQo=