vstart.sh crashes MON with --paxos-propose-interval=0.01 and one MDS

vstart.sh crashes MON with --paxos-propose-interval=0.01 and one MDS

[Loic Dachary]

[-- Attachment #1: Type: text/plain, Size: 365 bytes --]

Hi John,

I would be gratefull if you could take a quick look at http://tracker.ceph.com/issues/9794 . It is bisected to the reduction of pg and I'm able to reproduce it in a ubuntu-14.04 docker fresh install. For some reason it does not happen in gitbuilder but I think you can reproduce it locally now.

Cheers

-- 
Loïc Dachary, Artisan Logiciel Libre


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 263 bytes --]

Re: vstart.sh crashes MON with --paxos-propose-interval=0.01 and one MDS

[David Zafman]

I have this change in my branch so that test/ceph_objectstore_tool.py works again after that change from John.  I wonder if this would fix your case too:

commit 18937cf49be616d32b4e2d0b6deef2882321fbe4
Author: David Zafman <dzafman@redhat.com>
Date:   Tue Oct 14 18:45:41 2014 -0700

    vstart.sh: Disable "mon pg warn min per osd" to get healthy

    Signed-off-by: David Zafman <dzafman@redhat.com>

diff --git a/src/vstart.sh b/src/vstart.sh
index febfa56..7a0ec1c 100755
--- a/src/vstart.sh
+++ b/src/vstart.sh
@@ -394,7 +394,7 @@ $COSDDEBUG
 $COSDMEMSTORE
 $extra_conf
 [mon]
-        mon pg warn min per osd = 10
+        mon pg warn min per osd = 0
         mon osd allow primary affinity = true
         mon reweight min pgs per osd = 4
 $DAEMONOPTS

David Zafman
Senior Developer
http://www.inktank.com




On Oct 16, 2014, at 3:52 PM, Loic Dachary <loic@dachary.org> wrote:

> Hi John,
> 
> I would be gratefull if you could take a quick look at http://tracker.ceph.com/issues/9794 . It is bisected to the reduction of pg and I'm able to reproduce it in a ubuntu-14.04 docker fresh install. For some reason it does not happen in gitbuilder but I think you can reproduce it locally now.
> 
> Cheers
> 
> -- 
> Loïc Dachary, Artisan Logiciel Libre
> 

--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: vstart.sh crashes MON with --paxos-propose-interval=0.01 and one MDS

[Joao Eduardo Luis]

On 10/17/2014 03:42 AM, David Zafman wrote:
>
> I have this change in my branch so that test/ceph_objectstore_tool.py works again after that change from John.  I wonder if this would fix your case too:
>
> commit 18937cf49be616d32b4e2d0b6deef2882321fbe4
> Author: David Zafman <dzafman@redhat.com>
> Date:   Tue Oct 14 18:45:41 2014 -0700
>
>      vstart.sh: Disable "mon pg warn min per osd" to get healthy
>
>      Signed-off-by: David Zafman <dzafman@redhat.com>
>
> diff --git a/src/vstart.sh b/src/vstart.sh
> index febfa56..7a0ec1c 100755
> --- a/src/vstart.sh
> +++ b/src/vstart.sh
> @@ -394,7 +394,7 @@ $COSDDEBUG
>   $COSDMEMSTORE
>   $extra_conf
>   [mon]
> -        mon pg warn min per osd = 10
> +        mon pg warn min per osd = 0
>           mon osd allow primary affinity = true
>           mon reweight min pgs per osd = 4
>   $DAEMONOPTS
>

Even if that fixes the issue you're seeing, that is nothing but a 
band-aid.  I've tracked down the issue Loic is seeing a few days ago and 
it is sitting in wip-9321.giant 
(c84a13ae87eed5550bafda394d983a8e843cc08c).  I though it was due to an 
earlier patch of mine on the same branch but now I see the issue can pop 
up regardless of my patch, which is a good thing as it as it doesn't 
mean we really have to wait until that branch clears up the suite to 
merge but simply current master with this patch applied.

I've updated #9794 with this information.

   -Joao



> David Zafman
> Senior Developer
> http://www.inktank.com
>
>
>
>
> On Oct 16, 2014, at 3:52 PM, Loic Dachary <loic@dachary.org> wrote:
>
>> Hi John,
>>
>> I would be gratefull if you could take a quick look at http://tracker.ceph.com/issues/9794 . It is bisected to the reduction of pg and I'm able to reproduce it in a ubuntu-14.04 docker fresh install. For some reason it does not happen in gitbuilder but I think you can reproduce it locally now.
>>
>> Cheers
>>
>> --
>> Loïc Dachary, Artisan Logiciel Libre
>>
>
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>


-- 
Joao Eduardo Luis
Software Engineer | http://inktank.com | http://ceph.com
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html