linux-fsdevel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
* Re: [fuse-devel] Horrible mmap write performance (kernel writeback issue?)
       [not found]   ` <56E7C009.3070008@gmail.com>
@ 2016-03-16  9:44     ` Miklos Szeredi
  2016-03-26 21:42       ` Jakob Unterwurzacher
  0 siblings, 1 reply; 17+ messages in thread
From: Miklos Szeredi @ 2016-03-16  9:44 UTC (permalink / raw)
  To: Jakob Unterwurzacher; +Cc: fuse-devel, Linux-Fsdevel, Kernel Mailing List

On Tue, Mar 15, 2016 at 8:55 AM, Jakob Unterwurzacher
<jakobunt@gmail.com> wrote:
> Just for anybody finding this thread: This still happens in v4.4, it
> just took longer to trigger.
>
> I have posted more details to linux-kernel (copy-pasted below),
> http://thread.gmane.org/gmane.linux.kernel/2132944

Okay, so you can reproduce this relatively quickly.   Can you try "git
bisect" to find exactly which commit is responsible?

Thanks,
Miklos

>
> -------- copy of the email to linux-kernel -------------------
>
> 2016-01-22 21:10:59
>
> I have noticed an annoying regression that was introduced in 4.2 and is
> still there in 4.4. mmap writes to FUSE filesystems are throttled down
> to basically zero.
>
> Reproducer: https://github.com/rfjakob/mmapwrite , testing against encfs:
>
> $ mmapwrite /tmp/encfs-mnt/foo
>   1 .................................................. 107.01 MB/s
>   2 .................................................. 101.98 MB/s
> [...]
>  68 .................................................. 106.79 MB/s
>  69 .................................................. 105.09 MB/s
>  70 ..................................................   2.02 MB/s
>  71 ..................................................   1.77 MB/s
>  72 ..................................................   0.42 MB/s
>  73 .................................... (hangs)
>
> I have tested kernels from 4.0 and this seems to have been introduced in
> 4.2:
>
> 4.0 ....... 140MB/s permanent
> 4.1 ....... 140MB/s permanent
> 4.2 ....... 100MB/s at the start, sudden slowdown to 1MB/s after ~5GB
> 4.3 ....... 100MB/s at the start, sudden slowdown to 1MB/s after ~1.5GB
> 4.4-rc4 ... 100MB/s at the start, slowly ramps down, 0.3MB/s after ~2GB
> 4.4 ....... 100MB/s at the start, sudden slowdown after ~3GB
>
> Is there a way to disable the throttling? Or at least exempt FUSE until
> there is a proper fix?
>
> Thanks,
> Jakob
>
>
>
>
> On 17.12.2015 00:26, Jakob Unterwurzacher wrote:
>> This seems to be fixed in v4.4-rc5-18-gedb42dc. mmap writes now proceed
>> at solid 100MB/s with full CPU saturation.
>>
>> Thanks,
>> Jakob
>>
>> On Mon, Dec 14, 2015 at 9:06 AM, Jakob Unterwurzacher
>> <jakobunt@gmail.com <mailto:jakobunt@gmail.com>> wrote:
>>
>>     I am the developer of https://github.com/rfjakob/gocryptfs (an
>>     encrypted overlay filesystem like EncFS)
>>     and have ported xfstests over for regression testing
>>     ( https://github.com/rfjakob/fuse-xfstests ).
>>
>>     xfstests generic/074 is how I noticed that mmap write performance
>>     plummeted when Fedora upgraded my kernel to 4.2.5.
>>     It used to complete in 10 minutes and now it will probably take days.
>>     I am on kernel 4.4-rc1 now and still seeing the same issue.
>>
>>     It looks like the kernel at some point the kernel writeback
>>     mechanism gets stuck (or throttles?)
>>
>>     Testing against encfs:
>>
>>     ./mmapwrite /tmp/e2/foo          #
>>     https://github.com/rfjakob/mmapwrite .
>>     ....................................................................................................
>>     98.91 MB/s
>>     ....................................................................................................
>>     93.74 MB/s
>>     ....................................................................................................
>>     103.89 MB/s
>>     ....................................................................................................
>>     100.20 MB/s
>>     ....................................................................................................
>>     104.03 MB/s
>>     ....................................................................................................
>>     98.06 MB/s
>>     ....................................................................................................
>>     10.17 MB/s
>>     ....................................................................................................
>>     9.50 MB/s
>>     .................................. (hangs)
>>
>>     At this point no write requests are submitted to encfs and the
>>     mmapwrite process is
>>     stuck in the kernel in balance_dirty_pages.isra.22.
>>
>>     Bisecting this will be a pain, I would appreciate any suggestions.
>>
>>     Note that this seems to affect every FUSE filesystem, also ntfs-3g.
>>
>>     Best regards,
>>     Jakob
>>
>>
>
>
> ------------------------------------------------------------------------------
> Transform Data into Opportunity.
> Accelerate data analysis in your applications with
> Intel Data Analytics Acceleration Library.
> Click to learn more.
> http://pubads.g.doubleclick.net/gampad/clk?id=278785231&iu=/4140
> --
> fuse-devel mailing list
> To unsubscribe or subscribe, visit https://lists.sourceforge.net/lists/listinfo/fuse-devel

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: [fuse-devel] Horrible mmap write performance (kernel writeback issue?)
  2016-03-16  9:44     ` [fuse-devel] Horrible mmap write performance (kernel writeback issue?) Miklos Szeredi
@ 2016-03-26 21:42       ` Jakob Unterwurzacher
  2016-03-28 19:45         ` Miklos Szeredi
  0 siblings, 1 reply; 17+ messages in thread
From: Jakob Unterwurzacher @ 2016-03-26 21:42 UTC (permalink / raw)
  To: Miklos Szeredi; +Cc: fuse-devel, Linux-Fsdevel, Kernel Mailing List

On 16.03.2016 10:44, Miklos Szeredi wrote:
> On Tue, Mar 15, 2016 at 8:55 AM, Jakob Unterwurzacher
> <jakobunt@gmail.com> wrote:
>> Just for anybody finding this thread: This still happens in v4.4, it
>> just took longer to trigger.
>>
>> I have posted more details to linux-kernel (copy-pasted below),
>> http://thread.gmane.org/gmane.linux.kernel/2132944
> 
> Okay, so you can reproduce this relatively quickly.   Can you try "git
> bisect" to find exactly which commit is responsible?
> 
> Thanks,
> Miklos

That took a while, but it looks like it got it:

> commit 947e9762a8ddefda38aa21e249e6a4fec215cd12
> Author: Tejun Heo <tj@kernel.org>
> Date:   Fri May 22 18:23:32 2015 -0400
> 
>     writeback: update wb_over_bg_thresh() to use wb_domain aware operations

Note that this commens seems to only activate changes that happened in the
commit before, aa661bb:

> commit aa661bbe1e61ce80ca4ae98804f673ede94b0827
> Author: Tejun Heo <tj@kernel.org>
> Date:   Fri May 22 18:23:31 2015 -0400
> 
>     writeback: move over_bground_thresh() to mm/page-writeback.c


Anyway, I can reliably reboot between aa661bb and 947e976 and always get the
same results:

aa661bb passes
947e976 fails

I you want to reproduce, clone https://github.com/rfjakob/mmapwrite.git and
run ./encfs-test.sh (needs encfs installed). On the bad kernel, it will hang
within a few seconds.

Thanks,
Jakob

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: [fuse-devel] Horrible mmap write performance (kernel writeback issue?)
  2016-03-26 21:42       ` Jakob Unterwurzacher
@ 2016-03-28 19:45         ` Miklos Szeredi
  2016-03-30 18:47           ` Tejun Heo
  0 siblings, 1 reply; 17+ messages in thread
From: Miklos Szeredi @ 2016-03-28 19:45 UTC (permalink / raw)
  To: Jakob Unterwurzacher
  Cc: fuse-devel, Linux-Fsdevel, Kernel Mailing List, Tejun Heo

On Sat, Mar 26, 2016 at 10:42 PM, Jakob Unterwurzacher
<jakobunt@gmail.com> wrote:
> On 16.03.2016 10:44, Miklos Szeredi wrote:
>> On Tue, Mar 15, 2016 at 8:55 AM, Jakob Unterwurzacher
>> <jakobunt@gmail.com> wrote:
>>> Just for anybody finding this thread: This still happens in v4.4, it
>>> just took longer to trigger.
>>>
>>> I have posted more details to linux-kernel (copy-pasted below),
>>> http://thread.gmane.org/gmane.linux.kernel/2132944
>>
>> Okay, so you can reproduce this relatively quickly.   Can you try "git
>> bisect" to find exactly which commit is responsible?
>>
>> Thanks,
>> Miklos
>
> That took a while, but it looks like it got it:
>
>> commit 947e9762a8ddefda38aa21e249e6a4fec215cd12
>> Author: Tejun Heo <tj@kernel.org>
>> Date:   Fri May 22 18:23:32 2015 -0400
>>
>>     writeback: update wb_over_bg_thresh() to use wb_domain aware operations
>

Tejun,

Any idea why this commit stalls fuse mmap writes?

Here's the start of the this thread:

  http://marc.info/?l=fuse-devel&m=145008058603261&w=2

Thanks,
Miklos


> Note that this commens seems to only activate changes that happened in the
> commit before, aa661bb:
>
>> commit aa661bbe1e61ce80ca4ae98804f673ede94b0827
>> Author: Tejun Heo <tj@kernel.org>
>> Date:   Fri May 22 18:23:31 2015 -0400
>>
>>     writeback: move over_bground_thresh() to mm/page-writeback.c
>
>
> Anyway, I can reliably reboot between aa661bb and 947e976 and always get the
> same results:
>
> aa661bb passes
> 947e976 fails
>
> I you want to reproduce, clone https://github.com/rfjakob/mmapwrite.git and
> run ./encfs-test.sh (needs encfs installed). On the bad kernel, it will hang
> within a few seconds.
>
> Thanks,
> Jakob

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: [fuse-devel] Horrible mmap write performance (kernel writeback issue?)
  2016-03-28 19:45         ` Miklos Szeredi
@ 2016-03-30 18:47           ` Tejun Heo
       [not found]             ` <20160330184732.GO7822-qYNAdHglDFBN0TnZuCh8vA@public.gmane.org>
                               ` (2 more replies)
  0 siblings, 3 replies; 17+ messages in thread
From: Tejun Heo @ 2016-03-30 18:47 UTC (permalink / raw)
  To: Miklos Szeredi
  Cc: Jakob Unterwurzacher, fuse-devel, Linux-Fsdevel,
	Kernel Mailing List

Hello,

On Mon, Mar 28, 2016 at 09:45:53PM +0200, Miklos Szeredi wrote:
> >> commit 947e9762a8ddefda38aa21e249e6a4fec215cd12
> >> Author: Tejun Heo <tj@kernel.org>
> >> Date:   Fri May 22 18:23:32 2015 -0400
> >>
> >>     writeback: update wb_over_bg_thresh() to use wb_domain aware operations
> >
> 
> Tejun,
> 
> Any idea why this commit stalls fuse mmap writes?
> 
> Here's the start of the this thread:
> 
>   http://marc.info/?l=fuse-devel&m=145008058603261&w=2

Hmmm... cgroup writeback support shouldn't affect fuse at all as the
backing device doesn't enable cgroup support.  I probably made some
silly mistake.  Is there a simple reproducer I can play with?

Thanks.

-- 
tejun

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: Horrible mmap write performance (kernel writeback issue?)
       [not found]             ` <20160330184732.GO7822-qYNAdHglDFBN0TnZuCh8vA@public.gmane.org>
@ 2016-03-31 16:58               ` Antonio SJ Musumeci
  0 siblings, 0 replies; 17+ messages in thread
From: Antonio SJ Musumeci @ 2016-03-31 16:58 UTC (permalink / raw)
  To: Tejun Heo; +Cc: fuse-devel, Linux-Fsdevel, Kernel Mailing List, Miklos Szeredi


[-- Attachment #1.1: Type: text/plain, Size: 1712 bytes --]

I had a user of mergerfs[0] use mmapwrite[1] and reproduce it immediately.

$ mkdir /tmp/test
$ mergerfs -odefaults /var/tmp /tmp/test
$ mmapwrite /tmp/test/foo

Perhaps of interest is that it affected the user's physical machines
running 4.2.0-34 (Ubuntu 15.10) but neither they or I could reproduce it in
a VM (Virtualbox).

[0] https://github.com/trapexit/mergerfs/releases
[1] https://github.com/rfjakob/mmapwrite

On Wed, Mar 30, 2016 at 2:47 PM, Tejun Heo <tj-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org> wrote:

> Hello,
>
> On Mon, Mar 28, 2016 at 09:45:53PM +0200, Miklos Szeredi wrote:
> > >> commit 947e9762a8ddefda38aa21e249e6a4fec215cd12
> > >> Author: Tejun Heo <tj-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
> > >> Date:   Fri May 22 18:23:32 2015 -0400
> > >>
> > >>     writeback: update wb_over_bg_thresh() to use wb_domain aware
> operations
> > >
> >
> > Tejun,
> >
> > Any idea why this commit stalls fuse mmap writes?
> >
> > Here's the start of the this thread:
> >
> >   http://marc.info/?l=fuse-devel&m=145008058603261&w=2
>
> Hmmm... cgroup writeback support shouldn't affect fuse at all as the
> backing device doesn't enable cgroup support.  I probably made some
> silly mistake.  Is there a simple reproducer I can play with?
>
> Thanks.
>
> --
> tejun
>
>
> ------------------------------------------------------------------------------
> Transform Data into Opportunity.
> Accelerate data analysis in your applications with
> Intel Data Analytics Acceleration Library.
> Click to learn more.
> http://pubads.g.doubleclick.net/gampad/clk?id=278785471&iu=/4140
> --
> fuse-devel mailing list
> To unsubscribe or subscribe, visit
> https://lists.sourceforge.net/lists/listinfo/fuse-devel
>

[-- Attachment #1.2: Type: text/html, Size: 2952 bytes --]

[-- Attachment #2: Type: text/plain, Size: 291 bytes --]

------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785471&iu=/4140

[-- Attachment #3: Type: text/plain, Size: 119 bytes --]

-- 
fuse-devel mailing list
To unsubscribe or subscribe, visit https://lists.sourceforge.net/lists/listinfo/fuse-devel

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: [fuse-devel] Horrible mmap write performance (kernel writeback issue?)
  2016-03-30 18:47           ` Tejun Heo
       [not found]             ` <20160330184732.GO7822-qYNAdHglDFBN0TnZuCh8vA@public.gmane.org>
@ 2016-04-02  6:34             ` Sedat Dilek
  2016-04-11  8:04             ` Jakob Unterwurzacher
  2 siblings, 0 replies; 17+ messages in thread
From: Sedat Dilek @ 2016-04-02  6:34 UTC (permalink / raw)
  To: Tejun Heo
  Cc: Miklos Szeredi, Jakob Unterwurzacher, fuse-devel, Linux-Fsdevel,
	Kernel Mailing List

On Wed, Mar 30, 2016 at 8:47 PM, Tejun Heo <tj@kernel.org> wrote:
> Hello,
>
> On Mon, Mar 28, 2016 at 09:45:53PM +0200, Miklos Szeredi wrote:
>> >> commit 947e9762a8ddefda38aa21e249e6a4fec215cd12
>> >> Author: Tejun Heo <tj@kernel.org>
>> >> Date:   Fri May 22 18:23:32 2015 -0400
>> >>
>> >>     writeback: update wb_over_bg_thresh() to use wb_domain aware operations
>> >
>>
>> Tejun,
>>
>> Any idea why this commit stalls fuse mmap writes?
>>
>> Here's the start of the this thread:
>>
>>   http://marc.info/?l=fuse-devel&m=145008058603261&w=2
>
> Hmmm... cgroup writeback support shouldn't affect fuse at all as the
> backing device doesn't enable cgroup support.  I probably made some
> silly mistake.  Is there a simple reproducer I can play with?
>
> Thanks.
>

To quote Jakob from a previous email:

"I you want to reproduce, clone https://github.com/rfjakob/mmapwrite.git and
run ./encfs-test.sh (needs encfs installed). On the bad kernel, it will hang
within a few seconds."

Hope this helps.

- Sedat -

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: [fuse-devel] Horrible mmap write performance (kernel writeback issue?)
  2016-03-30 18:47           ` Tejun Heo
       [not found]             ` <20160330184732.GO7822-qYNAdHglDFBN0TnZuCh8vA@public.gmane.org>
  2016-04-02  6:34             ` [fuse-devel] " Sedat Dilek
@ 2016-04-11  8:04             ` Jakob Unterwurzacher
  2016-04-12  0:24               ` Tejun Heo
  2 siblings, 1 reply; 17+ messages in thread
From: Jakob Unterwurzacher @ 2016-04-11  8:04 UTC (permalink / raw)
  To: Tejun Heo, Miklos Szeredi; +Cc: fuse-devel, Linux-Fsdevel, Kernel Mailing List

On 30.03.2016 20:47, Tejun Heo wrote:
> Hmmm... cgroup writeback support shouldn't affect fuse at all as the
> backing device doesn't enable cgroup support.  I probably made some
> silly mistake.  Is there a simple reproducer I can play with?

Hi Tejun! A simple reproducer is at https://github.com/rfjakob/mmapwrite .

What seems to be happening in the kernel is that the estimated device bandwith
drops to zero. I'm not even sure how this works for FUSE, but that's what I
gathered from some printk debugging.

What I also found is that once mmapwrite is hung, you can unblock it for some
time by running something like

    cat /dev/zero > /var/tmp/foo

mmapwrite will then steam ahead as long as cat is writing, even though encfs
writes to /tmp (tmpfs) and /var is on the ext4 disk.

Note that the hang happens regardless of the backing device, on both tmpfs and
ext4.

Best regards,
Jakob

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: [fuse-devel] Horrible mmap write performance (kernel writeback issue?)
  2016-04-11  8:04             ` Jakob Unterwurzacher
@ 2016-04-12  0:24               ` Tejun Heo
  2016-04-12  9:24                 ` Ashish Sangwan
  0 siblings, 1 reply; 17+ messages in thread
From: Tejun Heo @ 2016-04-12  0:24 UTC (permalink / raw)
  To: Jakob Unterwurzacher
  Cc: Miklos Szeredi, fuse-devel, Linux-Fsdevel, Kernel Mailing List

Hello,

On Mon, Apr 11, 2016 at 10:04:42AM +0200, Jakob Unterwurzacher wrote:
> What seems to be happening in the kernel is that the estimated device bandwith
> drops to zero. I'm not even sure how this works for FUSE, but that's what I
> gathered from some printk debugging.

Yeah, writeback bw getting messed up is the most likely cause.  Prolly
some silly bug.  I can reproduce the problem.  Looking into it.

Thanks.

-- 
tejun

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: [fuse-devel] Horrible mmap write performance (kernel writeback issue?)
  2016-04-12  0:24               ` Tejun Heo
@ 2016-04-12  9:24                 ` Ashish Sangwan
  2016-04-12 11:09                   ` Tejun Heo
  0 siblings, 1 reply; 17+ messages in thread
From: Ashish Sangwan @ 2016-04-12  9:24 UTC (permalink / raw)
  To: Tejun Heo
  Cc: Jakob Unterwurzacher, Miklos Szeredi, fuse-devel, Linux-Fsdevel,
	Kernel Mailing List

On Tue, Apr 12, 2016 at 5:54 AM, Tejun Heo <tj@kernel.org> wrote:
> Hello,
>
> On Mon, Apr 11, 2016 at 10:04:42AM +0200, Jakob Unterwurzacher wrote:
>> What seems to be happening in the kernel is that the estimated device bandwith
>> drops to zero. I'm not even sure how this works for FUSE, but that's what I
>> gathered from some printk debugging.
>
> Yeah, writeback bw getting messed up is the most likely cause.  Prolly
> some silly bug.  I can reproduce the problem.  Looking into it.

Probably you want to look into:
https://lkml.org/lkml/2016/3/10/21

The patch mentioned above solves the issue for me.

Thanks,
Ashish
>
> Thanks.
>
> --
> tejun

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: [fuse-devel] Horrible mmap write performance (kernel writeback issue?)
  2016-04-12  9:24                 ` Ashish Sangwan
@ 2016-04-12 11:09                   ` Tejun Heo
  2016-04-13  7:20                     ` Sedat Dilek
  2016-04-18 21:06                     ` Jakob Unterwurzacher
  0 siblings, 2 replies; 17+ messages in thread
From: Tejun Heo @ 2016-04-12 11:09 UTC (permalink / raw)
  To: Ashish Sangwan
  Cc: Jakob Unterwurzacher, Miklos Szeredi, fuse-devel, Linux-Fsdevel,
	Kernel Mailing List

Hello,

On Tue, Apr 12, 2016 at 02:54:08PM +0530, Ashish Sangwan wrote:
> On Tue, Apr 12, 2016 at 5:54 AM, Tejun Heo <tj@kernel.org> wrote:
> > Hello,
> >
> > On Mon, Apr 11, 2016 at 10:04:42AM +0200, Jakob Unterwurzacher wrote:
> >> What seems to be happening in the kernel is that the estimated device bandwith
> >> drops to zero. I'm not even sure how this works for FUSE, but that's what I
> >> gathered from some printk debugging.
> >
> > Yeah, writeback bw getting messed up is the most likely cause.  Prolly
> > some silly bug.  I can reproduce the problem.  Looking into it.
> 
> Probably you want to look into:
> https://lkml.org/lkml/2016/3/10/21
> 
> The patch mentioned above solves the issue for me.

Heh, I tracked it down to wb_over_bg_thresh() and fell asleep.  Yeah,
that is the right fix.

Thanks.

-- 
tejun

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: [fuse-devel] Horrible mmap write performance (kernel writeback issue?)
  2016-04-12 11:09                   ` Tejun Heo
@ 2016-04-13  7:20                     ` Sedat Dilek
  2016-04-18 21:06                     ` Jakob Unterwurzacher
  1 sibling, 0 replies; 17+ messages in thread
From: Sedat Dilek @ 2016-04-13  7:20 UTC (permalink / raw)
  To: Tejun Heo
  Cc: Ashish Sangwan, Jakob Unterwurzacher, Miklos Szeredi, fuse-devel,
	Linux-Fsdevel, Kernel Mailing List

On Tue, Apr 12, 2016 at 1:09 PM, Tejun Heo <tj@kernel.org> wrote:
> Hello,
>
> On Tue, Apr 12, 2016 at 02:54:08PM +0530, Ashish Sangwan wrote:
>> On Tue, Apr 12, 2016 at 5:54 AM, Tejun Heo <tj@kernel.org> wrote:
>> > Hello,
>> >
>> > On Mon, Apr 11, 2016 at 10:04:42AM +0200, Jakob Unterwurzacher wrote:
>> >> What seems to be happening in the kernel is that the estimated device bandwith
>> >> drops to zero. I'm not even sure how this works for FUSE, but that's what I
>> >> gathered from some printk debugging.
>> >
>> > Yeah, writeback bw getting messed up is the most likely cause.  Prolly
>> > some silly bug.  I can reproduce the problem.  Looking into it.
>>
>> Probably you want to look into:
>> https://lkml.org/lkml/2016/3/10/21
>>
>> The patch mentioned above solves the issue for me.
>
> Heh, I tracked it down to wb_over_bg_thresh() and fell asleep.  Yeah,
> that is the right fix.
>

Feel free to add my...

     Tested-by: Sedat Dilek <sedat.dilek@gmail.com>

Patch available from [1].

- sed@ -

[1] https://patchwork.kernel.org/patch/8554181/

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: [fuse-devel] Horrible mmap write performance (kernel writeback issue?)
  2016-04-12 11:09                   ` Tejun Heo
  2016-04-13  7:20                     ` Sedat Dilek
@ 2016-04-18 21:06                     ` Jakob Unterwurzacher
  2016-04-20  1:35                       ` Howard Cochran
  1 sibling, 1 reply; 17+ messages in thread
From: Jakob Unterwurzacher @ 2016-04-18 21:06 UTC (permalink / raw)
  To: Tejun Heo, Ashish Sangwan
  Cc: Miklos Szeredi, fuse-devel, Linux-Fsdevel, Kernel Mailing List,
	Howard Cochran

On 12.04.2016 13:09, Tejun Heo wrote:
>>
>> Probably you want to look into:
>> https://lkml.org/lkml/2016/3/10/21
>>
>> The patch mentioned above solves the issue for me.
> 
> Heh, I tracked it down to wb_over_bg_thresh() and fell asleep.  Yeah,
> that is the right fix.

Works wonderfully now, thanks to everybody involved. Is it too late for 4.6?

Best regards,
Jakob

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: [fuse-devel] Horrible mmap write performance (kernel writeback issue?)
  2016-04-18 21:06                     ` Jakob Unterwurzacher
@ 2016-04-20  1:35                       ` Howard Cochran
  2016-04-25  8:07                         ` Sedat Dilek
  0 siblings, 1 reply; 17+ messages in thread
From: Howard Cochran @ 2016-04-20  1:35 UTC (permalink / raw)
  To: Jakob Unterwurzacher
  Cc: Tejun Heo, Ashish Sangwan, Miklos Szeredi, fuse-devel,
	Linux-Fsdevel, Kernel Mailing List

On Mon, Apr 18, 2016 at 5:06 PM, Jakob Unterwurzacher
<jakobunt@gmail.com> wrote:
> On 12.04.2016 13:09, Tejun Heo wrote:
>>>
>>> Probably you want to look into:
>>> https://lkml.org/lkml/2016/3/10/21
>>>
>>> The patch mentioned above solves the issue for me.
>>
>> Heh, I tracked it down to wb_over_bg_thresh() and fell asleep.  Yeah,
>> that is the right fix.
>
> Works wonderfully now, thanks to everybody involved. Is it too late for 4.6?
>
> Best regards,
> Jakob
>
Jakob, et. al.

You're welcome.  That performance problem stumped me for a couple of
weeks until tracked it down and submitted the fix.

Howard

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: [fuse-devel] Horrible mmap write performance (kernel writeback issue?)
  2016-04-20  1:35                       ` Howard Cochran
@ 2016-04-25  8:07                         ` Sedat Dilek
  2016-05-02  9:39                           ` Sedat Dilek
  0 siblings, 1 reply; 17+ messages in thread
From: Sedat Dilek @ 2016-04-25  8:07 UTC (permalink / raw)
  To: Howard Cochran
  Cc: Jakob Unterwurzacher, Tejun Heo, Ashish Sangwan, Miklos Szeredi,
	fuse-devel, Linux-Fsdevel, Kernel Mailing List

On Wed, Apr 20, 2016 at 3:35 AM, Howard Cochran
<hcochran@kernelspring.com> wrote:
> On Mon, Apr 18, 2016 at 5:06 PM, Jakob Unterwurzacher
> <jakobunt@gmail.com> wrote:
>> On 12.04.2016 13:09, Tejun Heo wrote:
>>>>
>>>> Probably you want to look into:
>>>> https://lkml.org/lkml/2016/3/10/21
>>>>
>>>> The patch mentioned above solves the issue for me.
>>>
>>> Heh, I tracked it down to wb_over_bg_thresh() and fell asleep.  Yeah,
>>> that is the right fix.
>>
>> Works wonderfully now, thanks to everybody involved. Is it too late for 4.6?
>>
>> Best regards,
>> Jakob
>>
> Jakob, et. al.
>
> You're welcome.  That performance problem stumped me for a couple of
> weeks until tracked it down and submitted the fix.
>

What has happened to "writeback: Fix performance regression in
wb_over_bg_thresh()"?
I checked Linux v4.6-rc5, it is not included.
Is it in another Git tree? If yes, where?

- sed@ -

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: [fuse-devel] Horrible mmap write performance (kernel writeback issue?)
  2016-04-25  8:07                         ` Sedat Dilek
@ 2016-05-02  9:39                           ` Sedat Dilek
       [not found]                             ` <CA+icZUXjBim3cNhTLK3V0ko_iRsYAKV9Nhavg4pm24bNKTnp-A-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 17+ messages in thread
From: Sedat Dilek @ 2016-05-02  9:39 UTC (permalink / raw)
  To: Howard Cochran
  Cc: Jakob Unterwurzacher, Tejun Heo, Ashish Sangwan, Miklos Szeredi,
	fuse-devel, Linux-Fsdevel, Kernel Mailing List

On 4/25/16, Sedat Dilek <sedat.dilek@gmail.com> wrote:
> On Wed, Apr 20, 2016 at 3:35 AM, Howard Cochran
> <hcochran@kernelspring.com> wrote:
>> On Mon, Apr 18, 2016 at 5:06 PM, Jakob Unterwurzacher
>> <jakobunt@gmail.com> wrote:
>>> On 12.04.2016 13:09, Tejun Heo wrote:
>>>>>
>>>>> Probably you want to look into:
>>>>> https://lkml.org/lkml/2016/3/10/21
>>>>>
>>>>> The patch mentioned above solves the issue for me.
>>>>
>>>> Heh, I tracked it down to wb_over_bg_thresh() and fell asleep.  Yeah,
>>>> that is the right fix.
>>>
>>> Works wonderfully now, thanks to everybody involved. Is it too late for
>>> 4.6?
>>>
>>> Best regards,
>>> Jakob
>>>
>> Jakob, et. al.
>>
>> You're welcome.  That performance problem stumped me for a couple of
>> weeks until tracked it down and submitted the fix.
>>
>
> What has happened to "writeback: Fix performance regression in
> wb_over_bg_thresh()"?
> I checked Linux v4.6-rc5, it is not included.
> Is it in another Git tree? If yes, where?
>

Ping!

Patch from Howard ist still not in Linus upstream aka Linux v4.6-rc6.
Comments, please.

- sed@ -

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: Horrible mmap write performance (kernel writeback issue?)
       [not found]                             ` <CA+icZUXjBim3cNhTLK3V0ko_iRsYAKV9Nhavg4pm24bNKTnp-A-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2016-05-10 22:55                               ` Jakob Unterwurzacher
  2016-05-11  7:07                                 ` [fuse-devel] " Sedat Dilek
  0 siblings, 1 reply; 17+ messages in thread
From: Jakob Unterwurzacher @ 2016-05-10 22:55 UTC (permalink / raw)
  To: sedat.dilek-Re5JQEeQqe8AvxtiuMwx3w
  Cc: fuse-devel, Linux-Fsdevel, Kernel Mailing List


[-- Attachment #1.1: Type: text/plain, Size: 1497 bytes --]

Landed in 4.6-rc7:
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/commit/?id=74d369443325063a5f0260e63971decb950fd8fa

On Mon, May 2, 2016 at 11:39 AM, Sedat Dilek <sedat.dilek-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:

> On 4/25/16, Sedat Dilek <sedat.dilek-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
> > On Wed, Apr 20, 2016 at 3:35 AM, Howard Cochran
> > <hcochran-UM4yVSfgXfh5+dc36SJeWg@public.gmane.org> wrote:
> >> On Mon, Apr 18, 2016 at 5:06 PM, Jakob Unterwurzacher
> >> <jakobunt-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
> >>> On 12.04.2016 13:09, Tejun Heo wrote:
> >>>>>
> >>>>> Probably you want to look into:
> >>>>> https://lkml.org/lkml/2016/3/10/21
> >>>>>
> >>>>> The patch mentioned above solves the issue for me.
> >>>>
> >>>> Heh, I tracked it down to wb_over_bg_thresh() and fell asleep.  Yeah,
> >>>> that is the right fix.
> >>>
> >>> Works wonderfully now, thanks to everybody involved. Is it too late for
> >>> 4.6?
> >>>
> >>> Best regards,
> >>> Jakob
> >>>
> >> Jakob, et. al.
> >>
> >> You're welcome.  That performance problem stumped me for a couple of
> >> weeks until tracked it down and submitted the fix.
> >>
> >
> > What has happened to "writeback: Fix performance regression in
> > wb_over_bg_thresh()"?
> > I checked Linux v4.6-rc5, it is not included.
> > Is it in another Git tree? If yes, where?
> >
>
> Ping!
>
> Patch from Howard ist still not in Linus upstream aka Linux v4.6-rc6.
> Comments, please.
>
> - sed@ -
>

[-- Attachment #1.2: Type: text/html, Size: 2618 bytes --]

[-- Attachment #2: Type: text/plain, Size: 429 bytes --]

------------------------------------------------------------------------------
Mobile security can be enabling, not merely restricting. Employees who
bring their own devices (BYOD) to work are irked by the imposition of MDM
restrictions. Mobile Device Manager Plus allows you to control only the
apps on BYO-devices by containerizing them, leaving personal data untouched!
https://ad.doubleclick.net/ddm/clk/304595813;131938128;j

[-- Attachment #3: Type: text/plain, Size: 119 bytes --]

-- 
fuse-devel mailing list
To unsubscribe or subscribe, visit https://lists.sourceforge.net/lists/listinfo/fuse-devel

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: [fuse-devel] Horrible mmap write performance (kernel writeback issue?)
  2016-05-10 22:55                               ` Jakob Unterwurzacher
@ 2016-05-11  7:07                                 ` Sedat Dilek
  0 siblings, 0 replies; 17+ messages in thread
From: Sedat Dilek @ 2016-05-11  7:07 UTC (permalink / raw)
  To: Jakob Unterwurzacher; +Cc: fuse-devel, Linux-Fsdevel, Kernel Mailing List

On 5/11/16, Jakob Unterwurzacher <jakobunt@gmail.com> wrote:
> Landed in 4.6-rc7:
> https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/commit/?id=74d369443325063a5f0260e63971decb950fd8fa
>

Top-posting :-(.

Linux v4.4.10 and v4.5.4 final (currently in review as
4.4.10-rc1/4.5.4-rc1) will have it, too.

- Sedat -

> On Mon, May 2, 2016 at 11:39 AM, Sedat Dilek <sedat.dilek@gmail.com> wrote:
>
>> On 4/25/16, Sedat Dilek <sedat.dilek@gmail.com> wrote:
>> > On Wed, Apr 20, 2016 at 3:35 AM, Howard Cochran
>> > <hcochran@kernelspring.com> wrote:
>> >> On Mon, Apr 18, 2016 at 5:06 PM, Jakob Unterwurzacher
>> >> <jakobunt@gmail.com> wrote:
>> >>> On 12.04.2016 13:09, Tejun Heo wrote:
>> >>>>>
>> >>>>> Probably you want to look into:
>> >>>>> https://lkml.org/lkml/2016/3/10/21
>> >>>>>
>> >>>>> The patch mentioned above solves the issue for me.
>> >>>>
>> >>>> Heh, I tracked it down to wb_over_bg_thresh() and fell asleep.
>> >>>> Yeah,
>> >>>> that is the right fix.
>> >>>
>> >>> Works wonderfully now, thanks to everybody involved. Is it too late
>> >>> for
>> >>> 4.6?
>> >>>
>> >>> Best regards,
>> >>> Jakob
>> >>>
>> >> Jakob, et. al.
>> >>
>> >> You're welcome.  That performance problem stumped me for a couple of
>> >> weeks until tracked it down and submitted the fix.
>> >>
>> >
>> > What has happened to "writeback: Fix performance regression in
>> > wb_over_bg_thresh()"?
>> > I checked Linux v4.6-rc5, it is not included.
>> > Is it in another Git tree? If yes, where?
>> >
>>
>> Ping!
>>
>> Patch from Howard ist still not in Linus upstream aka Linux v4.6-rc6.
>> Comments, please.
>>
>> - sed@ -
>>
>

^ permalink raw reply	[flat|nested] 17+ messages in thread

end of thread, other threads:[~2016-05-11  7:07 UTC | newest]

Thread overview: 17+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
     [not found] <CAPv9Zmm7WOQvMTTJjvxgXfRXzF7nes5zmJvnAo7GKqY7muWwhA@mail.gmail.com>
     [not found] ` <CAPv9ZmkXnzkTAv+60GzVizjB9mrc_LwdSQ7-iimEFpeoV0Opug@mail.gmail.com>
     [not found]   ` <56E7C009.3070008@gmail.com>
2016-03-16  9:44     ` [fuse-devel] Horrible mmap write performance (kernel writeback issue?) Miklos Szeredi
2016-03-26 21:42       ` Jakob Unterwurzacher
2016-03-28 19:45         ` Miklos Szeredi
2016-03-30 18:47           ` Tejun Heo
     [not found]             ` <20160330184732.GO7822-qYNAdHglDFBN0TnZuCh8vA@public.gmane.org>
2016-03-31 16:58               ` Antonio SJ Musumeci
2016-04-02  6:34             ` [fuse-devel] " Sedat Dilek
2016-04-11  8:04             ` Jakob Unterwurzacher
2016-04-12  0:24               ` Tejun Heo
2016-04-12  9:24                 ` Ashish Sangwan
2016-04-12 11:09                   ` Tejun Heo
2016-04-13  7:20                     ` Sedat Dilek
2016-04-18 21:06                     ` Jakob Unterwurzacher
2016-04-20  1:35                       ` Howard Cochran
2016-04-25  8:07                         ` Sedat Dilek
2016-05-02  9:39                           ` Sedat Dilek
     [not found]                             ` <CA+icZUXjBim3cNhTLK3V0ko_iRsYAKV9Nhavg4pm24bNKTnp-A-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2016-05-10 22:55                               ` Jakob Unterwurzacher
2016-05-11  7:07                                 ` [fuse-devel] " Sedat Dilek

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).