From mboxrd@z Thu Jan 1 00:00:00 1970 From: Mark Nelson Subject: Re: poor OSD performance using kernel 3.4 => problem found Date: Thu, 31 May 2012 10:32:15 -0500 Message-ID: <4FC78EFF.1090206@inktank.com> References: <4FBE415E.8030702@profihost.ag> <4FC54CDB.1000506@inktank.com> <4FC5BF27.5060704@profihost.ag> <4FC5C941.6010105@profihost.ag> <4FC5FEC1.90103@profihost.ag> <4FC60FC8.207@inktank.com> <4FC61596.3050703@profihost.ag> <4FC62BB0.1020003@inktank.com> <4FC66A1F.1080407@profihost.ag> <4FC68CAA.9030708@profihost.ag> <4FC7197D.5010406@profihost.ag> <4FC77045.6050907@univ-nantes.fr> <4FC77407.1050401@profihost.ag> <4FC775F3.8080109@univ-nantes.fr> <4FC78339.10900@univ-nantes.fr> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Return-path: Received: from mail-ob0-f174.google.com ([209.85.214.174]:50031 "EHLO mail-ob0-f174.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S932349Ab2EaPcW (ORCPT ); Thu, 31 May 2012 11:32:22 -0400 Received: by obbtb18 with SMTP id tb18so1484385obb.19 for ; Thu, 31 May 2012 08:32:22 -0700 (PDT) In-Reply-To: <4FC78339.10900@univ-nantes.fr> Sender: ceph-devel-owner@vger.kernel.org List-ID: To: Yann Dupont Cc: Stefan Priebe - Profihost AG , Yehuda Sadeh , Stefan Majer , ceph-devel@vger.kernel.org On 05/31/2012 09:42 AM, Yann Dupont wrote: > On 31/05/2012 15:45, Yann Dupont wrote: >> On 31/05/2012 15:37, Stefan Priebe - Profihost AG wrote: > >> what puzzles me is that this morning, with 3.4.0 it was rbd that was >> stable, and now I have the exact contrary. >> >> I'll begin to reboot with old 3.4.0 kernel to see if things are >> reproductible. >> >> Cheers, > > > I'd say my problem is probably not related. Freshly rebooting all osd > nodes with 3.4.0 kernel (the same kernel I used this morning) now > gives pool data stable & rbd unstable. As with current git, and the > exact opposite of results I had tuesday & this morning. > > Go figure. > > Could it have to do with previous usage in OSD ? or active mds ? or mon ? > > As I already said, as my osd are using btrfs with big medata features, > so going back in 3.0 kernel need a complete reformat of my OSD before. > > But I will do it if you judge it can bring some light on this case. > > Cheers, Hi Yann, Can you take a look at how many PGs are in each pool? ceph osd pool get pg_num Thanks, Mark