All of lore.kernel.org
 help / color / mirror / Atom feed
* New added OSD always down when full flag of osdmap is set
@ 2016-03-10  2:37 hzwulibin
       [not found] ` <56E0DDE6.1040807-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
  0 siblings, 1 reply; 5+ messages in thread
From: hzwulibin @ 2016-03-10  2:37 UTC (permalink / raw)
  To: ceph-devel, ceph-users

Hi, cephers

Recently, i found we could not add new osd in cluster when the full flag is set in osdmap.

Shortly describe the scene here:
1. Some osd are full, and the osdmap has full flag
2. Add new osd
3. New osd service is running, but it's state always down

Here is the issue:
http://tracker.ceph.com/issues/15025

Anyone know it's a normal way or a bug here?
 				
--------------
hzwulibin
2016-03-10

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: New added OSD always down when full flag of osdmap is set
       [not found] ` <56E0DDE6.1040807-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
@ 2016-03-10  2:49   ` Shinobu Kinjo
       [not found]     ` <CAFdRU70zv2_g3c5fjYQA1Q0xu1sL0hGsiO2jpt9BDHZfDgKqGg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 5+ messages in thread
From: Shinobu Kinjo @ 2016-03-10  2:49 UTC (permalink / raw)
  To: hzwulibin; +Cc: ceph-devel, ceph-users

On Thu, Mar 10, 2016 at 11:37 AM, hzwulibin <hzwulibin-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
> Hi, cephers
>
> Recently, i found we could not add new osd in cluster when the full flag is set in osdmap.
>
> Shortly describe the scene here:
> 1. Some osd are full, and the osdmap has full flag

Are those OSDs usage really 100% which is not expected?

> 2. Add new osd
> 3. New osd service is running, but it's state always down
>
> Here is the issue:
> http://tracker.ceph.com/issues/15025
>
> Anyone know it's a normal way or a bug here?
>
> --------------
> hzwulibin
> 2016-03-10
> _______________________________________________
> ceph-users mailing list
> ceph-users-idqoXFIVOFJgJs9I8MT0rw@public.gmane.org
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



-- 
Email:
shinobu-vYTEC60ixJUAvxtiuMwx3w@public.gmane.org
GitHub:
shinobu-x
Blog:
Life with Distributed Computational System based on OpenSource

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: New added OSD always down when full flag of osdmap is set
       [not found]     ` <CAFdRU70zv2_g3c5fjYQA1Q0xu1sL0hGsiO2jpt9BDHZfDgKqGg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2016-03-10  2:58       ` hzwulibin
       [not found]         ` <56E0E2EE.6030708-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
  0 siblings, 1 reply; 5+ messages in thread
From: hzwulibin @ 2016-03-10  2:58 UTC (permalink / raw)
  To: skinjo; +Cc: ceph-devel, ceph-users

No, just 98%.

Another scene, if backfill too full, also could not add the osd in and up.

------------------				 
hzwulibin
2016-03-10

-------------------------------------------------------------
发件人:Shinobu Kinjo <shinobu.kj@gmail.com>
发送日期:2016-03-10 10:49
收件人:hzwulibin
抄送:ceph-devel,ceph-users
主题:Re: [ceph-users] New added OSD always down when full flag of osdmap
 is set

On Thu, Mar 10, 2016 at 11:37 AM, hzwulibin <hzwulibin@gmail.com> wrote:
> Hi, cephers
>
> Recently, i found we could not add new osd in cluster when the full flag is set in osdmap.
>
> Shortly describe the scene here:
> 1. Some osd are full, and the osdmap has full flag

Are those OSDs usage really 100% which is not expected?

> 2. Add new osd
> 3. New osd service is running, but it's state always down
>
> Here is the issue:
> http://tracker.ceph.com/issues/15025
>
> Anyone know it's a normal way or a bug here?
>
> --------------
> hzwulibin
> 2016-03-10
> _______________________________________________
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



-- 
Email:
shinobu@linux.com
GitHub:
shinobu-x
Blog:
Life with Distributed Computational System based on OpenSource

_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: New added OSD always down when full flag of osdmap is set
       [not found]         ` <56E0E2EE.6030708-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
@ 2016-03-10  3:28           ` Shinobu Kinjo
  2016-03-10  3:44             ` Re: [ceph-users] " hzwulibin
  0 siblings, 1 reply; 5+ messages in thread
From: Shinobu Kinjo @ 2016-03-10  3:28 UTC (permalink / raw)
  To: hzwulibin; +Cc: ceph-devel, ceph-users

Can you provide us with:

 sudo ceph osd tree
 sudo ceph osd df
 sudo ceph df

Cheers,
S

On Thu, Mar 10, 2016 at 11:58 AM, hzwulibin <hzwulibin@gmail.com> wrote:
> No, just 98%.
>
> Another scene, if backfill too full, also could not add the osd in and up.
>
> ------------------
> hzwulibin
> 2016-03-10
>
> -------------------------------------------------------------
> 发件人:Shinobu Kinjo <shinobu.kj@gmail.com>
> 发送日期:2016-03-10 10:49
> 收件人:hzwulibin
> 抄送:ceph-devel,ceph-users
> 主题:Re: [ceph-users] New added OSD always down when full flag of osdmap
>  is set
>
> On Thu, Mar 10, 2016 at 11:37 AM, hzwulibin <hzwulibin@gmail.com> wrote:
>> Hi, cephers
>>
>> Recently, i found we could not add new osd in cluster when the full flag is set in osdmap.
>>
>> Shortly describe the scene here:
>> 1. Some osd are full, and the osdmap has full flag
>
> Are those OSDs usage really 100% which is not expected?
>
>> 2. Add new osd
>> 3. New osd service is running, but it's state always down
>>
>> Here is the issue:
>> http://tracker.ceph.com/issues/15025
>>
>> Anyone know it's a normal way or a bug here?
>>
>> --------------
>> hzwulibin
>> 2016-03-10
>> _______________________________________________
>> ceph-users mailing list
>> ceph-users@lists.ceph.com
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
>
> --
> Email:
> shinobu@linux.com
> GitHub:
> shinobu-x
> Blog:
> Life with Distributed Computational System based on OpenSource
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



-- 
Email:
shinobu@linux.com
GitHub:
shinobu-x
Blog:
Life with Distributed Computational System based on OpenSource
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re:  Re: [ceph-users] New added OSD always down when full flag of osdmap is set
  2016-03-10  3:28           ` Shinobu Kinjo
@ 2016-03-10  3:44             ` hzwulibin
  0 siblings, 0 replies; 5+ messages in thread
From: hzwulibin @ 2016-03-10  3:44 UTC (permalink / raw)
  To: skinjo; +Cc: ceph-devel, ceph-users

Sure, here it is:
# ceph osd tree
ID WEIGHT  TYPE NAME       UP/DOWN REWEIGHT PRIMARY-AFFINITY 
-1 0.04997 root default                                      
-2 0.04997     host ceph01                                   
 0 0.00999         osd.0        up  1.00000          1.00000 
 1 0.00999         osd.1      down        0          1.00000 
 3 0.00999         osd.3        up  1.00000          1.00000 
 4 0.00999         osd.4      down        0          1.00000 
 2 0.00999         osd.2      down        0          1.00000 


root@ceph01:~# ceph osd df
ID WEIGHT  REWEIGHT SIZE   USE    AVAIL %USE  VAR  
 0 0.00999  1.00000 15348M 14920M  428M 97.21 1.00 
 1 0.00999        0      0      0     0     0    0 
 3 0.00999  1.00000 15348M 14918M  430M 97.19 1.00 
 4 0.00999        0      0      0     0     0    0 
 2 0.00999        0      0      0     0     0    0 
              TOTAL 30697M 29839M  858M 97.20      
MIN/MAX VAR: 0/1.00  STDDEV: 0.01


root@ceph01:~# ceph df
GLOBAL:
    SIZE       AVAIL     RAW USED     %RAW USED 
    30697M      858M       29839M         97.20 
POOLS:
    NAME     ID     USED       %USED     MAX AVAIL     OBJECTS 
    rbd      0      15360M     50.04         1070M        3842 


And the size(replicas) of the pool is 2, min_size is 1
------------------				 
hzwulibin
2016-03-10

-------------------------------------------------------------
发件人:Shinobu Kinjo <shinobu.kj@gmail.com>
发送日期:2016-03-10 11:28
收件人:hzwulibin
抄送:ceph-devel,ceph-users
主题:Re: [ceph-users] New added OSD always down when full flag of osdmap
 is set

Can you provide us with:

 sudo ceph osd tree
 sudo ceph osd df
 sudo ceph df

Cheers,
S

On Thu, Mar 10, 2016 at 11:58 AM, hzwulibin <hzwulibin@gmail.com> wrote:
> No, just 98%.
>
> Another scene, if backfill too full, also could not add the osd in and up.
>
> ------------------
> hzwulibin
> 2016-03-10
>
> -------------------------------------------------------------
> 发件人:Shinobu Kinjo <shinobu.kj@gmail.com>
> 发送日期:2016-03-10 10:49
> 收件人:hzwulibin
> 抄送:ceph-devel,ceph-users
> 主题:Re: [ceph-users] New added OSD always down when full flag of osdmap
>  is set
>
> On Thu, Mar 10, 2016 at 11:37 AM, hzwulibin <hzwulibin@gmail.com> wrote:
>> Hi, cephers
>>
>> Recently, i found we could not add new osd in cluster when the full flag is set in osdmap.
>>
>> Shortly describe the scene here:
>> 1. Some osd are full, and the osdmap has full flag
>
> Are those OSDs usage really 100% which is not expected?
>
>> 2. Add new osd
>> 3. New osd service is running, but it's state always down
>>
>> Here is the issue:
>> http://tracker.ceph.com/issues/15025
>>
>> Anyone know it's a normal way or a bug here?
>>
>> --------------
>> hzwulibin
>> 2016-03-10
>> _______________________________________________
>> ceph-users mailing list
>> ceph-users@lists.ceph.com
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
>
> --
> Email:
> shinobu@linux.com
> GitHub:
> shinobu-x
> Blog:
> Life with Distributed Computational System based on OpenSource
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



-- 
Email:
shinobu@linux.com
GitHub:
shinobu-x
Blog:
Life with Distributed Computational System based on OpenSource


^ permalink raw reply	[flat|nested] 5+ messages in thread

end of thread, other threads:[~2016-03-10  3:44 UTC | newest]

Thread overview: 5+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2016-03-10  2:37 New added OSD always down when full flag of osdmap is set hzwulibin
     [not found] ` <56E0DDE6.1040807-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2016-03-10  2:49   ` Shinobu Kinjo
     [not found]     ` <CAFdRU70zv2_g3c5fjYQA1Q0xu1sL0hGsiO2jpt9BDHZfDgKqGg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2016-03-10  2:58       ` hzwulibin
     [not found]         ` <56E0E2EE.6030708-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2016-03-10  3:28           ` Shinobu Kinjo
2016-03-10  3:44             ` Re: [ceph-users] " hzwulibin

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.