From mboxrd@z Thu Jan 1 00:00:00 1970 From: Oliver Francke Subject: OSD memory leak when scrubbing [0.56.6] Date: Tue, 21 May 2013 17:24:06 +0200 Message-ID: <519B9196.5090402@filoo.de> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: QUOTED-PRINTABLE Return-path: Received: from mail-1.de-punkt.de ([93.190.64.237]:37320 "EHLO mail-1.de-punkt.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1754063Ab3EUPbO (ORCPT ); Tue, 21 May 2013 11:31:14 -0400 Received: from localhost (localhost [127.0.0.1]) by mail-1.de-punkt.de (Postfix) with ESMTP id 7B86E3A3B6 for ; Tue, 21 May 2013 17:24:06 +0200 (CEST) Received: from mail-1.de-punkt.de ([127.0.0.1]) by localhost (mail-10.de-punkt.de [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 1raTW0bv+-EN for ; Tue, 21 May 2013 17:24:06 +0200 (CEST) Received: from [192.168.1.152] (p4FECEC7E.dip0.t-ipconnect.de [79.236.236.126]) (Authenticated sender: oliver.francke@filoo.de) by mail-1.de-punkt.de (Postfix) with ESMTPSA id 54A5D3A249 for ; Tue, 21 May 2013 17:24:06 +0200 (CEST) Sender: ceph-devel-owner@vger.kernel.org List-ID: To: "ceph-devel@vger.kernel.org" Well, subject seems familiar, version was 0.48.3 in the last mail. Some more of the story. Before successful upgrade to latest bobtail=20 everything with regards to scrubbing was disabled. That is via: ceph osd tell \* injectargs '--osd-max-scrubs 0' We are running fine now since 9th of may. Fine means though, not have=20 ran any scrubbing for ages. This morning I re-started scrubbing. After a couple of hours I detected= =20 the first OSD's eating up memory. Top-scorer was running with 23GiB rss. After stopping scrubbing again=20 there was no regain of memory. Not anyone else with perhaps large pg's experiencing such behaviour? Any advice on how to proceed? Thnx in advance, Oliver. --=20 Oliver Francke filoo GmbH Moltkestra=DFe 25a 33330 G=FCtersloh HRB4355 AG G=FCtersloh Gesch=E4ftsf=FChrer: S.Grewing | J.Rehp=F6hler | C.Kunz =46olgen Sie uns auf Twitter: http://twitter.com/filoogmbh -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" i= n the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html