All of lore.kernel.org
 help / color / mirror / Atom feed
* Issues dropping vm fs caches with kernel 3.5.2 + bcache master
@ 2012-08-20  7:03 Javier Marcet
       [not found] ` <CAAnFQG9JCMpZ7VSnuNxSGxXa4KrDWjdP4e3UJZj=W2Jbi30dZg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 6+ messages in thread
From: Javier Marcet @ 2012-08-20  7:03 UTC (permalink / raw)
  To: Linux BCache Mailing List

Hi,

I've recently set up a software RAID5 + bcache.

I'm using kernel 3.5.2 merged with bcache master branch. I'm quite
happy with the performance but
there is an important issue. I can't drop caches. Writing any number
to /proc/sys/vm/drop_caches
makes the system hungs.

Furthermore, so far I've been unable to curb bcache's memory
consumption using the available
sysctl knobs.

Is this problem known?


-- 
Javier Marcet <jmarcet-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: Issues dropping vm fs caches with kernel 3.5.2 + bcache master
       [not found] ` <CAAnFQG9JCMpZ7VSnuNxSGxXa4KrDWjdP4e3UJZj=W2Jbi30dZg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2012-08-20 20:29   ` Kent Overstreet
       [not found]     ` <20120820202921.GA21953-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org>
  0 siblings, 1 reply; 6+ messages in thread
From: Kent Overstreet @ 2012-08-20 20:29 UTC (permalink / raw)
  To: Javier Marcet; +Cc: Linux BCache Mailing List

On Mon, Aug 20, 2012 at 09:03:08AM +0200, Javier Marcet wrote:
> Hi,
> 
> I've recently set up a software RAID5 + bcache.
> 
> I'm using kernel 3.5.2 merged with bcache master branch. I'm quite
> happy with the performance but
> there is an important issue. I can't drop caches. Writing any number
> to /proc/sys/vm/drop_caches
> makes the system hungs.
> 
> Furthermore, so far I've been unable to curb bcache's memory
> consumption using the available
> sysctl knobs.
> 
> Is this problem known?

No I didn't know about that - thanks, I'll look into it.

Just out of curiousity, what are you doing? drop_caches isn't something
you want to use in normal operation...

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: Issues dropping vm fs caches with kernel 3.5.2 + bcache master
       [not found]     ` <20120820202921.GA21953-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org>
@ 2012-08-20 21:06       ` Javier Marcet
       [not found]         ` <CAAnFQG-aK4aR8J05oe=MygbzjkoW4furOSyEjrhw6Zp0vznhEw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 6+ messages in thread
From: Javier Marcet @ 2012-08-20 21:06 UTC (permalink / raw)
  To: Kent Overstreet; +Cc: Linux BCache Mailing List

>> I've recently set up a software RAID5 + bcache.
>>
>> I'm using kernel 3.5.2 merged with bcache master branch. I'm quite
>> happy with the performance but
>> there is an important issue. I can't drop caches. Writing any number
>> to /proc/sys/vm/drop_caches
>> makes the system hung.
>>
>> Furthermore, so far I've been unable to curb bcache's memory
>> consumption using the available
>> sysctl knobs.
>>
>> Is this problem known?
>
> No I didn't know about that - thanks, I'll look into it.

Thanks :)

> Just out of curiousity, what are you doing? drop_caches isn't something
> you want to use in normal operation...

Yeah, not normal operation, but this machine has 8 GB of ram and nearly 7
were being used by caches. I tried to launch a virtual machine and I couldn't.

Seeing the state the memory was in, I went off to drop the caches, and... hang.


-- 
Javier Marcet <jmarcet-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: Issues dropping vm fs caches with kernel 3.5.2 + bcache master
       [not found]         ` <CAAnFQG-aK4aR8J05oe=MygbzjkoW4furOSyEjrhw6Zp0vznhEw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2012-08-21  0:15           ` Kent Overstreet
       [not found]             ` <20120821001514.GB21953-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org>
  0 siblings, 1 reply; 6+ messages in thread
From: Kent Overstreet @ 2012-08-21  0:15 UTC (permalink / raw)
  To: Javier Marcet; +Cc: Linux BCache Mailing List

On Mon, Aug 20, 2012 at 11:06:30PM +0200, Javier Marcet wrote:
> >> I've recently set up a software RAID5 + bcache.
> >>
> >> I'm using kernel 3.5.2 merged with bcache master branch. I'm quite
> >> happy with the performance but
> >> there is an important issue. I can't drop caches. Writing any number
> >> to /proc/sys/vm/drop_caches
> >> makes the system hung.
> >>
> >> Furthermore, so far I've been unable to curb bcache's memory
> >> consumption using the available
> >> sysctl knobs.
> >>
> >> Is this problem known?
> >
> > No I didn't know about that - thanks, I'll look into it.

Just tried it - I can reproduce it, but it's gone in 3.6. Looks like a
3.5 bug, not a bcache bug.

I'm gonna reset the master branch to my current dev branch soon as I've
tested it a bit more, but I'd suggest the bcache-3.2 branch - that's the
best tested code.

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: Issues dropping vm fs caches with kernel 3.5.2 + bcache master
       [not found]             ` <20120821001514.GB21953-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org>
@ 2012-08-21  0:31               ` Javier Marcet
       [not found]                 ` <CAAnFQG_rE9f61Rgo+xH6uNujLwNx_QFaF-OpH_=pYro-+99AFQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 6+ messages in thread
From: Javier Marcet @ 2012-08-21  0:31 UTC (permalink / raw)
  To: Kent Overstreet; +Cc: Linux BCache Mailing List

>> >> I've recently set up a software RAID5 + bcache.
>> >>
>> >> I'm using kernel 3.5.2 merged with bcache master branch. I'm quite
>> >> happy with the performance but
>> >> there is an important issue. I can't drop caches. Writing any number
>> >> to /proc/sys/vm/drop_caches
>> >> makes the system hung.
>> >>
>> >> Furthermore, so far I've been unable to curb bcache's memory
>> >> consumption using the available
>> >> sysctl knobs.
>> >>
>> >> Is this problem known?
>> >
>> > No I didn't know about that - thanks, I'll look into it.
>
> Just tried it - I can reproduce it, but it's gone in 3.6. Looks like a
> 3.5 bug, not a bcache bug.

Oh, it was a coincidence then. I hadn't needed to use that for a long
time.

> I'm gonna reset the master branch to my current dev branch soon as I've
> tested it a bit more, but I'd suggest the bcache-3.2 branch - that's the
> best tested code.

I cannot use a 3.2 kernel. This an HTPC too, besides a NAS and host for
vm guests. The tuners I have are supported from 3.4 onwards.

Do you mean there might be more problems with the master branch?

By the way. I have read in the manual how to add new cache devices, but
can you remove completely the caches in a 'clean way'? Imagine to change
it to a different disk which for some reason you cannot use at the same time.


-- 
Javier Marcet <jmarcet-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: Issues dropping vm fs caches with kernel 3.5.2 + bcache master
       [not found]                 ` <CAAnFQG_rE9f61Rgo+xH6uNujLwNx_QFaF-OpH_=pYro-+99AFQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2012-08-21  0:37                   ` Kent Overstreet
  0 siblings, 0 replies; 6+ messages in thread
From: Kent Overstreet @ 2012-08-21  0:37 UTC (permalink / raw)
  To: Javier Marcet; +Cc: Linux BCache Mailing List

On Tue, Aug 21, 2012 at 02:31:18AM +0200, Javier Marcet wrote:
> >> >> I've recently set up a software RAID5 + bcache.
> >> >>
> >> >> I'm using kernel 3.5.2 merged with bcache master branch. I'm quite
> >> >> happy with the performance but
> >> >> there is an important issue. I can't drop caches. Writing any number
> >> >> to /proc/sys/vm/drop_caches
> >> >> makes the system hung.
> >> >>
> >> >> Furthermore, so far I've been unable to curb bcache's memory
> >> >> consumption using the available
> >> >> sysctl knobs.
> >> >>
> >> >> Is this problem known?
> >> >
> >> > No I didn't know about that - thanks, I'll look into it.
> >
> > Just tried it - I can reproduce it, but it's gone in 3.6. Looks like a
> > 3.5 bug, not a bcache bug.
> 
> Oh, it was a coincidence then. I hadn't needed to use that for a long
> time.

Yeah. Weird bug.

> > I'm gonna reset the master branch to my current dev branch soon as I've
> > tested it a bit more, but I'd suggest the bcache-3.2 branch - that's the
> > best tested code.
> 
> I cannot use a 3.2 kernel. This an HTPC too, besides a NAS and host for
> vm guests. The tuners I have are supported from 3.4 onwards.
> 
> Do you mean there might be more problems with the master branch?

Perhaps, but mainly it tracks mainline pretty closely. 

> By the way. I have read in the manual how to add new cache devices, but
> can you remove completely the caches in a 'clean way'? Imagine to change
> it to a different disk which for some reason you cannot use at the same time.

Yep. echo 1 > /sys/fs/bcache/<cache set>/unregister

^ permalink raw reply	[flat|nested] 6+ messages in thread

end of thread, other threads:[~2012-08-21  0:37 UTC | newest]

Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2012-08-20  7:03 Issues dropping vm fs caches with kernel 3.5.2 + bcache master Javier Marcet
     [not found] ` <CAAnFQG9JCMpZ7VSnuNxSGxXa4KrDWjdP4e3UJZj=W2Jbi30dZg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2012-08-20 20:29   ` Kent Overstreet
     [not found]     ` <20120820202921.GA21953-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org>
2012-08-20 21:06       ` Javier Marcet
     [not found]         ` <CAAnFQG-aK4aR8J05oe=MygbzjkoW4furOSyEjrhw6Zp0vznhEw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2012-08-21  0:15           ` Kent Overstreet
     [not found]             ` <20120821001514.GB21953-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org>
2012-08-21  0:31               ` Javier Marcet
     [not found]                 ` <CAAnFQG_rE9f61Rgo+xH6uNujLwNx_QFaF-OpH_=pYro-+99AFQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2012-08-21  0:37                   ` Kent Overstreet

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.