[bug] writes hanging

[bug] writes hanging

[John Grub]

[-- Attachment #1.1: Type: text/plain, Size: 1723 bytes --]

Hello,

I can't seem to write larger files on my f2fs mount.
My hardware is an embedded arm platform with an 8GB eMMC nand flash
chip: Golbalscale
D2Plug <http://www.globalscaletechnologies.com/t-d2plugdetails.aspx>
I have two of these pieces of hardware and I see this issue on both of
them. There is no issue when I use ext4.
I am running kernel version 3.13.0-rc4
I've compiled  f2fs-tools from here
http://git.kernel.org/cgit/linux/kernel/git/jaegeuk/f2fs-tools.git @
11d187cdfa2dcf504aa25b5a1aab4228f19f22ff

I've followed the installation and usage instructions in
linux/Documentation/filesystems/f2fs.txt to format my 8GB eMMC nand flash
as f2fs.

I'm getting freezes when writing larger files to my f2fs partition. Here is
an experiment I've done to show this.
First create 3 test files of different sizes:
# cat /dev/urandom | head -c 50k > /tmp/50k
# cat /dev/urandom | head -c 100k > /tmp/100k
# cat /dev/urandom | head -c 150k > /tmp/150k

Test case #1: Repeatedly copy the same 50k file to j2fs:
# cp /tmp/50k /mnt/j2fs/ <-- this copy always works fine
# cp /tmp/50k /mnt/j2fs/ <-- this copy always works fine
# cp /tmp/50k /mnt/j2fs/ <-- this copy always hangs forever
For the failing copy, I've seen 4k, 8k and 12k copied correctly before it
stops.

Test case #2: Repeatedly copy the same 100k file to f2fs:
# cp /tmp/100k /mnt/f2fs/ <-- this copy works fine
# cp /tmp/100k /mnt/f2fs/ <-- this copy hangs forever
For the failing copy, I've seen 4k, 8k and 12k copied correctly before it
stops.

Test case #3: Copy a 150k file to f2fs:
# cp /tmp/150k /mnt/f2fs/
This never completes and will hang forever if I don't kill it. It always
seems to fail at 120k.

Any help would be appreciated.

Thanks,
John Grub

[-- Attachment #1.2: Type: text/html, Size: 2344 bytes --]

[-- Attachment #2: Type: text/plain, Size: 455 bytes --]

------------------------------------------------------------------------------
Rapidly troubleshoot problems before they affect your business. Most IT 
organizations don't have a clear picture of how application performance 
affects their revenue. With AppDynamics, you get 100% visibility into your 
Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk

[-- Attachment #3: Type: text/plain, Size: 179 bytes --]

_______________________________________________
Linux-f2fs-devel mailing list
Linux-f2fs-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel

Re: [bug] writes hanging

[John Grub]

[-- Attachment #1.1: Type: text/plain, Size: 1931 bytes --]

Note: this is on a M8G2FA Samsung flash chip.


On Fri, Dec 20, 2013 at 12:29 PM, John Grub <john.f.grub@gmail.com> wrote:

> Hello,
>
> I can't seem to write larger files on my f2fs mount.
> My hardware is an embedded arm platform with an 8GB eMMC nand flash chip: Golbalscale
> D2Plug <http://www.globalscaletechnologies.com/t-d2plugdetails.aspx>
> I have two of these pieces of hardware and I see this issue on both of
> them. There is no issue when I use ext4.
> I am running kernel version 3.13.0-rc4
> I've compiled  f2fs-tools from here
> http://git.kernel.org/cgit/linux/kernel/git/jaegeuk/f2fs-tools.git @
> 11d187cdfa2dcf504aa25b5a1aab4228f19f22ff
>
> I've followed the installation and usage instructions in
> linux/Documentation/filesystems/f2fs.txt to format my 8GB eMMC nand flash
> as f2fs.
>
> I'm getting freezes when writing larger files to my f2fs partition. Here
> is an experiment I've done to show this.
> First create 3 test files of different sizes:
> # cat /dev/urandom | head -c 50k > /tmp/50k
> # cat /dev/urandom | head -c 100k > /tmp/100k
> # cat /dev/urandom | head -c 150k > /tmp/150k
>
> Test case #1: Repeatedly copy the same 50k file to j2fs:
> # cp /tmp/50k /mnt/j2fs/ <-- this copy always works fine
> # cp /tmp/50k /mnt/j2fs/ <-- this copy always works fine
> # cp /tmp/50k /mnt/j2fs/ <-- this copy always hangs forever
> For the failing copy, I've seen 4k, 8k and 12k copied correctly before it
> stops.
>
> Test case #2: Repeatedly copy the same 100k file to f2fs:
> # cp /tmp/100k /mnt/f2fs/ <-- this copy works fine
> # cp /tmp/100k /mnt/f2fs/ <-- this copy hangs forever
> For the failing copy, I've seen 4k, 8k and 12k copied correctly before it
> stops.
>
> Test case #3: Copy a 150k file to f2fs:
> # cp /tmp/150k /mnt/f2fs/
> This never completes and will hang forever if I don't kill it. It always
> seems to fail at 120k.
>
> Any help would be appreciated.
>
> Thanks,
> John Grub
>

[-- Attachment #1.2: Type: text/html, Size: 2823 bytes --]

[-- Attachment #2: Type: text/plain, Size: 455 bytes --]

------------------------------------------------------------------------------
Rapidly troubleshoot problems before they affect your business. Most IT 
organizations don't have a clear picture of how application performance 
affects their revenue. With AppDynamics, you get 100% visibility into your 
Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk

[-- Attachment #3: Type: text/plain, Size: 179 bytes --]

_______________________________________________
Linux-f2fs-devel mailing list
Linux-f2fs-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel

Re: [bug] writes hanging

[Chris Fries]

[-- Attachment #1.1: Type: text/plain, Size: 2830 bytes --]

Anything show up in the kernel log from the block device?  You might try
turning off discard, see if that helps.
On Dec 21, 2013 2:16 PM, "John Grub" <john.f.grub@gmail.com> wrote:

> Note: this is on a M8G2FA Samsung flash chip.
>
>
> On Fri, Dec 20, 2013 at 12:29 PM, John Grub <john.f.grub@gmail.com> wrote:
>
>> Hello,
>>
>> I can't seem to write larger files on my f2fs mount.
>> My hardware is an embedded arm platform with an 8GB eMMC nand flash chip: Golbalscale
>> D2Plug <http://www.globalscaletechnologies.com/t-d2plugdetails.aspx>
>> I have two of these pieces of hardware and I see this issue on both of
>> them. There is no issue when I use ext4.
>> I am running kernel version 3.13.0-rc4
>> I've compiled  f2fs-tools from here
>> http://git.kernel.org/cgit/linux/kernel/git/jaegeuk/f2fs-tools.git @
>> 11d187cdfa2dcf504aa25b5a1aab4228f19f22ff
>>
>> I've followed the installation and usage instructions in
>> linux/Documentation/filesystems/f2fs.txt to format my 8GB eMMC nand flash
>> as f2fs.
>>
>> I'm getting freezes when writing larger files to my f2fs partition. Here
>> is an experiment I've done to show this.
>> First create 3 test files of different sizes:
>> # cat /dev/urandom | head -c 50k > /tmp/50k
>> # cat /dev/urandom | head -c 100k > /tmp/100k
>> # cat /dev/urandom | head -c 150k > /tmp/150k
>>
>> Test case #1: Repeatedly copy the same 50k file to j2fs:
>> # cp /tmp/50k /mnt/j2fs/ <-- this copy always works fine
>> # cp /tmp/50k /mnt/j2fs/ <-- this copy always works fine
>> # cp /tmp/50k /mnt/j2fs/ <-- this copy always hangs forever
>> For the failing copy, I've seen 4k, 8k and 12k copied correctly before it
>> stops.
>>
>> Test case #2: Repeatedly copy the same 100k file to f2fs:
>> # cp /tmp/100k /mnt/f2fs/ <-- this copy works fine
>> # cp /tmp/100k /mnt/f2fs/ <-- this copy hangs forever
>> For the failing copy, I've seen 4k, 8k and 12k copied correctly before it
>> stops.
>>
>> Test case #3: Copy a 150k file to f2fs:
>> # cp /tmp/150k /mnt/f2fs/
>> This never completes and will hang forever if I don't kill it. It always
>> seems to fail at 120k.
>>
>> Any help would be appreciated.
>>
>> Thanks,
>> John Grub
>>
>
>
>
> ------------------------------------------------------------------------------
> Rapidly troubleshoot problems before they affect your business. Most IT
> organizations don't have a clear picture of how application performance
> affects their revenue. With AppDynamics, you get 100% visibility into your
> Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics
> Pro!
> http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk
> _______________________________________________
> Linux-f2fs-devel mailing list
> Linux-f2fs-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel
>
>

[-- Attachment #1.2: Type: text/html, Size: 4235 bytes --]

[-- Attachment #2: Type: text/plain, Size: 455 bytes --]

------------------------------------------------------------------------------
Rapidly troubleshoot problems before they affect your business. Most IT 
organizations don't have a clear picture of how application performance 
affects their revenue. With AppDynamics, you get 100% visibility into your 
Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk

[-- Attachment #3: Type: text/plain, Size: 179 bytes --]

_______________________________________________
Linux-f2fs-devel mailing list
Linux-f2fs-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel

Re: [bug] writes hanging

[John Grub]

[-- Attachment #1.1: Type: text/plain, Size: 3061 bytes --]

Nothing in the kernel log. Disabling discard when formatting the partition
doesn't help.
On Dec 21, 2013 1:06 PM, "Chris Fries" <ccfries@gmail.com> wrote:

> Anything show up in the kernel log from the block device?  You might try
> turning off discard, see if that helps.
> On Dec 21, 2013 2:16 PM, "John Grub" <john.f.grub@gmail.com> wrote:
>
>> Note: this is on a M8G2FA Samsung flash chip.
>>
>>
>> On Fri, Dec 20, 2013 at 12:29 PM, John Grub <john.f.grub@gmail.com>wrote:
>>
>>> Hello,
>>>
>>> I can't seem to write larger files on my f2fs mount.
>>> My hardware is an embedded arm platform with an 8GB eMMC nand flash
>>> chip: Golbalscale D2Plug<http://www.globalscaletechnologies.com/t-d2plugdetails.aspx>
>>> I have two of these pieces of hardware and I see this issue on both of
>>> them. There is no issue when I use ext4.
>>> I am running kernel version 3.13.0-rc4
>>> I've compiled  f2fs-tools from here
>>> http://git.kernel.org/cgit/linux/kernel/git/jaegeuk/f2fs-tools.git @
>>> 11d187cdfa2dcf504aa25b5a1aab4228f19f22ff
>>>
>>> I've followed the installation and usage instructions in
>>> linux/Documentation/filesystems/f2fs.txt to format my 8GB eMMC nand flash
>>> as f2fs.
>>>
>>> I'm getting freezes when writing larger files to my f2fs partition. Here
>>> is an experiment I've done to show this.
>>> First create 3 test files of different sizes:
>>> # cat /dev/urandom | head -c 50k > /tmp/50k
>>> # cat /dev/urandom | head -c 100k > /tmp/100k
>>> # cat /dev/urandom | head -c 150k > /tmp/150k
>>>
>>> Test case #1: Repeatedly copy the same 50k file to j2fs:
>>> # cp /tmp/50k /mnt/j2fs/ <-- this copy always works fine
>>> # cp /tmp/50k /mnt/j2fs/ <-- this copy always works fine
>>> # cp /tmp/50k /mnt/j2fs/ <-- this copy always hangs forever
>>> For the failing copy, I've seen 4k, 8k and 12k copied correctly before
>>> it stops.
>>>
>>> Test case #2: Repeatedly copy the same 100k file to f2fs:
>>> # cp /tmp/100k /mnt/f2fs/ <-- this copy works fine
>>> # cp /tmp/100k /mnt/f2fs/ <-- this copy hangs forever
>>> For the failing copy, I've seen 4k, 8k and 12k copied correctly before
>>> it stops.
>>>
>>> Test case #3: Copy a 150k file to f2fs:
>>> # cp /tmp/150k /mnt/f2fs/
>>> This never completes and will hang forever if I don't kill it. It always
>>> seems to fail at 120k.
>>>
>>> Any help would be appreciated.
>>>
>>> Thanks,
>>> John Grub
>>>
>>
>>
>>
>> ------------------------------------------------------------------------------
>> Rapidly troubleshoot problems before they affect your business. Most IT
>> organizations don't have a clear picture of how application performance
>> affects their revenue. With AppDynamics, you get 100% visibility into your
>> Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics
>> Pro!
>>
>> http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk
>> _______________________________________________
>> Linux-f2fs-devel mailing list
>> Linux-f2fs-devel@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel
>>
>>

[-- Attachment #1.2: Type: text/html, Size: 4693 bytes --]

[-- Attachment #2: Type: text/plain, Size: 455 bytes --]

------------------------------------------------------------------------------
Rapidly troubleshoot problems before they affect your business. Most IT 
organizations don't have a clear picture of how application performance 
affects their revenue. With AppDynamics, you get 100% visibility into your 
Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk

[-- Attachment #3: Type: text/plain, Size: 179 bytes --]

_______________________________________________
Linux-f2fs-devel mailing list
Linux-f2fs-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel

Re: [bug] writes hanging

[Jaegeuk Kim]

Hi,

I couldn't get any error when replaying your scenario on my arm board.
So, could you send the backtrace of any hanged process?

# cat /proc/[pid]/stack

Thanks,

2013-12-20 (금), 12:29 -0800, John Grub:
> Hello,
> 
> I can't seem to write larger files on my f2fs mount.
> My hardware is an embedded arm platform with an 8GB eMMC nand flash
> chip: Golbalscale D2Plug
> I have two of these pieces of hardware and I see this issue on both of
> them. There is no issue when I use ext4.
> I am running kernel version 3.13.0-rc4
> I've compiled  f2fs-tools from here
> http://git.kernel.org/cgit/linux/kernel/git/jaegeuk/f2fs-tools.git @
> 11d187cdfa2dcf504aa25b5a1aab4228f19f22ff
> 
> 
> I've followed the installation and usage instructions in
> linux/Documentation/filesystems/f2fs.txt to format my 8GB eMMC nand
> flash as f2fs.
> 
> 
> I'm getting freezes when writing larger files to my f2fs partition.
> Here is an experiment I've done to show this.
> First create 3 test files of different sizes:
> # cat /dev/urandom | head -c 50k > /tmp/50k
> # cat /dev/urandom | head -c 100k > /tmp/100k
> 
> # cat /dev/urandom | head -c 150k > /tmp/150k
> 
> 
> 
> Test case #1: Repeatedly copy the same 50k file to j2fs:
> # cp /tmp/50k /mnt/j2fs/ <-- this copy always works fine
> # cp /tmp/50k /mnt/j2fs/ <-- this copy always works fine
> # cp /tmp/50k /mnt/j2fs/ <-- this copy always hangs forever
> For the failing copy, I've seen 4k, 8k and 12k copied correctly before
> it stops.
> 
> 
> Test case #2: Repeatedly copy the same 100k file to f2fs:
> # cp /tmp/100k /mnt/f2fs/ <-- this copy works fine
> # cp /tmp/100k /mnt/f2fs/ <-- this copy hangs forever
> 
> For the failing copy, I've seen 4k, 8k and 12k copied correctly before
> it stops.
> 
> 
> 
> Test case #3: Copy a 150k file to f2fs:
> # cp /tmp/150k /mnt/f2fs/
> 
> This never completes and will hang forever if I don't kill it. It
> always seems to fail at 120k.
> 
> 
> 
> Any help would be appreciated.
> 
> 
> Thanks,
> John Grub
> ------------------------------------------------------------------------------
> Rapidly troubleshoot problems before they affect your business. Most IT 
> organizations don't have a clear picture of how application performance 
> affects their revenue. With AppDynamics, you get 100% visibility into your 
> Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
> http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk
> _______________________________________________ Linux-f2fs-devel mailing list Linux-f2fs-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel

-- 
Jaegeuk Kim
Samsung



------------------------------------------------------------------------------
Rapidly troubleshoot problems before they affect your business. Most IT 
organizations don't have a clear picture of how application performance 
affects their revenue. With AppDynamics, you get 100% visibility into your 
Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk
_______________________________________________
Linux-f2fs-devel mailing list
Linux-f2fs-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel

Re: [bug] writes hanging

[John Grub]

[-- Attachment #1.1: Type: text/plain, Size: 3284 bytes --]

Today I updated my kernel to 3.13.0-rc5 with a minimal set of config flags
and the problem has disappeared. So it's either been fixed by rc5 or I had
some kernel config conflict that caused the issue (probably the latter). In
any case, the problem is solved. Thank you for looking into it.



On Sun, Dec 22, 2013 at 5:13 PM, Jaegeuk Kim <jaegeuk.kim@samsung.com>wrote:

> Hi,
>
> I couldn't get any error when replaying your scenario on my arm board.
> So, could you send the backtrace of any hanged process?
>
> # cat /proc/[pid]/stack
>
> Thanks,
>
> 2013-12-20 (금), 12:29 -0800, John Grub:
> > Hello,
> >
> > I can't seem to write larger files on my f2fs mount.
> > My hardware is an embedded arm platform with an 8GB eMMC nand flash
> > chip: Golbalscale D2Plug
> > I have two of these pieces of hardware and I see this issue on both of
> > them. There is no issue when I use ext4.
> > I am running kernel version 3.13.0-rc4
> > I've compiled  f2fs-tools from here
> > http://git.kernel.org/cgit/linux/kernel/git/jaegeuk/f2fs-tools.git @
> > 11d187cdfa2dcf504aa25b5a1aab4228f19f22ff
> >
> >
> > I've followed the installation and usage instructions in
> > linux/Documentation/filesystems/f2fs.txt to format my 8GB eMMC nand
> > flash as f2fs.
> >
> >
> > I'm getting freezes when writing larger files to my f2fs partition.
> > Here is an experiment I've done to show this.
> > First create 3 test files of different sizes:
> > # cat /dev/urandom | head -c 50k > /tmp/50k
> > # cat /dev/urandom | head -c 100k > /tmp/100k
> >
> > # cat /dev/urandom | head -c 150k > /tmp/150k
> >
> >
> >
> > Test case #1: Repeatedly copy the same 50k file to j2fs:
> > # cp /tmp/50k /mnt/j2fs/ <-- this copy always works fine
> > # cp /tmp/50k /mnt/j2fs/ <-- this copy always works fine
> > # cp /tmp/50k /mnt/j2fs/ <-- this copy always hangs forever
> > For the failing copy, I've seen 4k, 8k and 12k copied correctly before
> > it stops.
> >
> >
> > Test case #2: Repeatedly copy the same 100k file to f2fs:
> > # cp /tmp/100k /mnt/f2fs/ <-- this copy works fine
> > # cp /tmp/100k /mnt/f2fs/ <-- this copy hangs forever
> >
> > For the failing copy, I've seen 4k, 8k and 12k copied correctly before
> > it stops.
> >
> >
> >
> > Test case #3: Copy a 150k file to f2fs:
> > # cp /tmp/150k /mnt/f2fs/
> >
> > This never completes and will hang forever if I don't kill it. It
> > always seems to fail at 120k.
> >
> >
> >
> > Any help would be appreciated.
> >
> >
> > Thanks,
> > John Grub
> >
> ------------------------------------------------------------------------------
> > Rapidly troubleshoot problems before they affect your business. Most IT
> > organizations don't have a clear picture of how application performance
> > affects their revenue. With AppDynamics, you get 100% visibility into
> your
> > Java,.NET, & PHP application. Start your 15-day FREE TRIAL of
> AppDynamics Pro!
> >
> http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk
> > _______________________________________________ Linux-f2fs-devel mailing
> list Linux-f2fs-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel
>
> --
> Jaegeuk Kim
> Samsung
>
>

[-- Attachment #1.2: Type: text/html, Size: 4610 bytes --]

[-- Attachment #2: Type: text/plain, Size: 455 bytes --]

------------------------------------------------------------------------------
Rapidly troubleshoot problems before they affect your business. Most IT 
organizations don't have a clear picture of how application performance 
affects their revenue. With AppDynamics, you get 100% visibility into your 
Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk

[-- Attachment #3: Type: text/plain, Size: 179 bytes --]

_______________________________________________
Linux-f2fs-devel mailing list
Linux-f2fs-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel