* Out of memory mounting 8 TB volume with 3.5 GiB of memory
@ 2016-07-24 19:46 Rask Ingemann Lambertsen
2016-07-25 18:01 ` Jaegeuk Kim
0 siblings, 1 reply; 3+ messages in thread
From: Rask Ingemann Lambertsen @ 2016-07-24 19:46 UTC (permalink / raw)
To: linux-f2fs-devel
Hello,
I have one of those 8 TB shingled magnetic recording hard disk drives and
thought F2FS would be a good choice of file system because of the need to
write sequentially to the HDD. I passed -s 128 to mkfs.f2fs to hopefully
match the F2FS section size to the zone size of the HDD. When trying to mount
the volume on a system with 3.5 GiB of memory, the system runs out of memory
with a stream of oom-killer messages like the one below. Is it expected
behaviour of F2FS to require this much memory?
[50885.725754] mount invoked oom-killer: gfp_mask=0x26000c0(GFP_KERNEL|__GFP_NOTRACK), order=0, oom_score_adj=0
[50885.735755] CPU: 0 PID: 8301 Comm: mount Not tainted 4.7.0-rc5-01511-g19f4af3-dirty #24
[50885.743837] Hardware name: Allwinner sun9i Family
[50885.748635] [<c011089c>] (unwind_backtrace) from [<c010c7e0>] (show_stack+0x20/0x24)
[50885.756474] [<c010c7e0>] (show_stack) from [<c042bef8>] (dump_stack+0x94/0xa8)
[50885.763790] [<c042bef8>] (dump_stack) from [<c0230b7c>] (dump_header+0x60/0x180)
[50885.771280] [<c0230b7c>] (dump_header) from [<c01e62dc>] (oom_kill_process+0x37c/0x4f4)
[50885.779379] [<c01e62dc>] (oom_kill_process) from [<c01e66b4>] (out_of_memory+0x1e8/0x334)
[50885.787654] [<c01e66b4>] (out_of_memory) from [<c01eb12c>] (__alloc_pages_nodemask+0xcb8/0xcf4)
[50885.796453] [<c01eb12c>] (__alloc_pages_nodemask) from [<c022a9c0>] (new_slab+0x334/0x378)
[50885.804815] [<c022a9c0>] (new_slab) from [<c022c184>] (___slab_alloc.constprop.9+0x24c/0x2e0)
[50885.813440] [<c022c184>] (___slab_alloc.constprop.9) from [<c022c708>] (kmem_cache_alloc_trace+0x194/0x1cc)
[50885.823292] [<c022c708>] (kmem_cache_alloc_trace) from [<c03cd2c4>] (build_sit_info+0x134/0x324)
[50885.832182] [<c03cd2c4>] (build_sit_info) from [<c03d1c44>] (build_segment_manager+0x108/0xcac)
[50885.840988] [<c03d1c44>] (build_segment_manager) from [<c03b7330>] (f2fs_fill_super+0x710/0xf94)
[50885.849877] [<c03b7330>] (f2fs_fill_super) from [<c0237238>] (mount_bdev+0x174/0x19c)
[50885.857803] [<c0237238>] (mount_bdev) from [<c03b5850>] (f2fs_mount+0x28/0x30)
[50885.865114] [<c03b5850>] (f2fs_mount) from [<c0238040>] (mount_fs+0x24/0xb4)
[50885.872250] [<c0238040>] (mount_fs) from [<c025496c>] (vfs_kern_mount+0x58/0x110)
[50885.879826] [<c025496c>] (vfs_kern_mount) from [<c0257ae4>] (do_mount+0x1b8/0xcb4)
[50885.887489] [<c0257ae4>] (do_mount) from [<c02589a4>] (SyS_mount+0xa4/0xcc)
[50885.894541] [<c02589a4>] (SyS_mount) from [<c0107fc0>] (ret_fast_syscall+0x0/0x3c)
[50885.902261] Mem-Info:
[50885.904598] active_anon:15340 inactive_anon:24606 isolated_anon:0
active_file:4533 inactive_file:4907 isolated_file:0
unevictable:0 dirty:512 writeback:0 unstable:0
slab_reclaimable:2157 slab_unreclaimable:152930
mapped:5677 shmem:37585 pagetables:126 bounce:0
free:678464 free_pcp:294 free_cma:0
[50885.938521] Normal free:3328kB min:3448kB low:4308kB high:5168kB active_anon:9424kB inactive_anon:13976kB active_file:844kB inactive_file:2016kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:786432kB managed:745120kB mlocked:0kB dirty:2040kB writeback:0kB mapped:1072kB shmem:22752kB slab_reclaimable:8628kB slab_unreclaimable:611720kB kernel_stack:1120kB pagetables:52kB unstable:0kB bounce:0kB free_pcp:504kB local_pcp:504kB free_cma:0kB writeback_tmp:0kB pages_scanned:19160 all_unreclaimable? yes
[50885.984181] lowmem_reserve[]: 0 22527 22527
[50885.988563] HighMem free:2710528kB min:512kB low:3852kB high:7192kB active_anon:51936kB inactive_anon:84448kB active_file:17288kB inactive_file:17612kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:2883580kB managed:2883580kB mlocked:0kB dirty:8kB writeback:0kB mapped:21636kB shmem:127588kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:452kB unstable:0kB bounce:0kB free_pcp:672kB local_pcp:672kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[50886.033619] lowmem_reserve[]: 0 0 0
[50886.037251] Normal: 104*4kB (ME) 62*8kB (ME) 71*16kB (ME) 20*32kB (UME) 6*64kB (UME) 2*128kB (UE) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3328kB
[50886.051120] HighMem: 316*4kB (UM) 1330*8kB (UM) 2174*16kB (UM) 1057*32kB (UM) 846*64kB (UM) 336*128kB (UM) 148*256kB (UM) 43*512kB (M) 11*1024kB (M) 4*2048kB (M) 599*4096kB (UM) = 2710528kB
[50886.068617] 47030 total pagecache pages
[50886.072498] 0 pages in swap cache
[50886.075890] Swap cache stats: add 0, delete 0, find 0/0
[50886.081170] Free swap = 0kB
[50886.084084] Total swap = 0kB
[50886.087035] 917503 pages RAM
[50886.089950] 720895 pages HighMem/MovableOnly
[50886.094264] 10328 pages reserved
[50886.097564] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name
[50886.097618] [ 162] 101 162 1311 713 7 0 0 -900 dbus-daemon
[50886.097646] [ 169] 0 169 2073 997 7 0 0 -1000 sshd
[50886.097673] [ 209] 0 209 502 315 4 0 0 0 agetty
[50886.097702] [ 3473] 0 3473 2665 574 6 0 0 -1000 systemd-udevd
[50886.097734] [ 8177] 0 8177 3432 1435 9 0 0 0 systemd-journal
[50886.097761] [ 8180] 0 8180 1430 808 5 0 0 0 systemd-logind
[50886.097789] [ 8182] 0 8182 1058 309 5 0 0 0 cgmanager
[50886.097815] [ 8183] 0 8183 1249 584 6 0 0 0 login
[50886.097842] [ 8197] 0 8197 1397 653 5 0 0 0 rpcbind
[50886.097869] [ 8204] 0 8204 19011 3076 18 0 0 0 NetworkManager
[50886.097896] [ 8205] 0 8205 646 47 4 0 0 0 rpc.idmapd
[50886.097922] [ 8208] 0 8208 1069 181 5 0 0 0 rpc.mountd
[50886.097952] [ 8239] 0 8239 8485 1105 10 0 0 0 polkitd
[50886.097978] [ 8282] 0 8282 1820 1000 8 0 0 0 systemd
[50886.098004] [ 8286] 0 8286 6605 361 9 0 0 0 (sd-pam)
[50886.098030] [ 8292] 0 8292 740 570 4 0 0 0 bash
[50886.098057] [ 8301] 0 8301 700 411 5 0 0 0 mount
[50886.098078] Out of memory: Kill process 8204 (NetworkManager) score 3 or sacrifice child
[50886.106341] Killed process 8204 (NetworkManager) total-vm:76044kB, anon-rss:1760kB, file-rss:10544kB, shmem-rss:0kB
[...]
[50898.530822] SLUB: Unable to allocate memory on node -1, gfp=0x24080c0(GFP_KERNEL|__GFP_ZERO)
[50898.539344] cache: kmalloc-64, object size: 64, buffer size: 64, default order: 0, min order: 0
[50898.548302] node 0: slabs: 152849, objs: 9782336, free: 0
[50898.553969] F2FS-fs (sdb2): Failed to initialize F2FS segment manager
--
Rask Ingemann Lambertsen
------------------------------------------------------------------------------
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are
consuming the most bandwidth. Provides multi-vendor support for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using capacity planning
reports.http://sdm.link/zohodev2dev
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: Out of memory mounting 8 TB volume with 3.5 GiB of memory
2016-07-24 19:46 Out of memory mounting 8 TB volume with 3.5 GiB of memory Rask Ingemann Lambertsen
@ 2016-07-25 18:01 ` Jaegeuk Kim
2016-08-01 18:33 ` Out of memory mounting 8 TB volume with 3.5 GiB of memory - solved Rask Ingemann Lambertsen
0 siblings, 1 reply; 3+ messages in thread
From: Jaegeuk Kim @ 2016-07-25 18:01 UTC (permalink / raw)
To: Rask Ingemann Lambertsen; +Cc: linux-f2fs-devel
Hi,
On Sun, Jul 24, 2016 at 09:46:32PM +0200, Rask Ingemann Lambertsen wrote:
> Hello,
>
> I have one of those 8 TB shingled magnetic recording hard disk drives and
> thought F2FS would be a good choice of file system because of the need to
> write sequentially to the HDD. I passed -s 128 to mkfs.f2fs to hopefully
> match the F2FS section size to the zone size of the HDD. When trying to mount
> the volume on a system with 3.5 GiB of memory, the system runs out of memory
> with a stream of oom-killer messages like the one below. Is it expected
> behaviour of F2FS to require this much memory?
Yes, I've double-checked that f2fs needs about 100 MB/TB to manage some data
structures for space management in main memory. I just found out there is
30MB/TB which is unnecessary memory consumption for SMR device tho.
Let me think how to mitigate this further.
Thanks,
>
> [50885.725754] mount invoked oom-killer: gfp_mask=0x26000c0(GFP_KERNEL|__GFP_NOTRACK), order=0, oom_score_adj=0
> [50885.735755] CPU: 0 PID: 8301 Comm: mount Not tainted 4.7.0-rc5-01511-g19f4af3-dirty #24
> [50885.743837] Hardware name: Allwinner sun9i Family
> [50885.748635] [<c011089c>] (unwind_backtrace) from [<c010c7e0>] (show_stack+0x20/0x24)
> [50885.756474] [<c010c7e0>] (show_stack) from [<c042bef8>] (dump_stack+0x94/0xa8)
> [50885.763790] [<c042bef8>] (dump_stack) from [<c0230b7c>] (dump_header+0x60/0x180)
> [50885.771280] [<c0230b7c>] (dump_header) from [<c01e62dc>] (oom_kill_process+0x37c/0x4f4)
> [50885.779379] [<c01e62dc>] (oom_kill_process) from [<c01e66b4>] (out_of_memory+0x1e8/0x334)
> [50885.787654] [<c01e66b4>] (out_of_memory) from [<c01eb12c>] (__alloc_pages_nodemask+0xcb8/0xcf4)
> [50885.796453] [<c01eb12c>] (__alloc_pages_nodemask) from [<c022a9c0>] (new_slab+0x334/0x378)
> [50885.804815] [<c022a9c0>] (new_slab) from [<c022c184>] (___slab_alloc.constprop.9+0x24c/0x2e0)
> [50885.813440] [<c022c184>] (___slab_alloc.constprop.9) from [<c022c708>] (kmem_cache_alloc_trace+0x194/0x1cc)
> [50885.823292] [<c022c708>] (kmem_cache_alloc_trace) from [<c03cd2c4>] (build_sit_info+0x134/0x324)
> [50885.832182] [<c03cd2c4>] (build_sit_info) from [<c03d1c44>] (build_segment_manager+0x108/0xcac)
> [50885.840988] [<c03d1c44>] (build_segment_manager) from [<c03b7330>] (f2fs_fill_super+0x710/0xf94)
> [50885.849877] [<c03b7330>] (f2fs_fill_super) from [<c0237238>] (mount_bdev+0x174/0x19c)
> [50885.857803] [<c0237238>] (mount_bdev) from [<c03b5850>] (f2fs_mount+0x28/0x30)
> [50885.865114] [<c03b5850>] (f2fs_mount) from [<c0238040>] (mount_fs+0x24/0xb4)
> [50885.872250] [<c0238040>] (mount_fs) from [<c025496c>] (vfs_kern_mount+0x58/0x110)
> [50885.879826] [<c025496c>] (vfs_kern_mount) from [<c0257ae4>] (do_mount+0x1b8/0xcb4)
> [50885.887489] [<c0257ae4>] (do_mount) from [<c02589a4>] (SyS_mount+0xa4/0xcc)
> [50885.894541] [<c02589a4>] (SyS_mount) from [<c0107fc0>] (ret_fast_syscall+0x0/0x3c)
> [50885.902261] Mem-Info:
> [50885.904598] active_anon:15340 inactive_anon:24606 isolated_anon:0
> active_file:4533 inactive_file:4907 isolated_file:0
> unevictable:0 dirty:512 writeback:0 unstable:0
> slab_reclaimable:2157 slab_unreclaimable:152930
> mapped:5677 shmem:37585 pagetables:126 bounce:0
> free:678464 free_pcp:294 free_cma:0
> [50885.938521] Normal free:3328kB min:3448kB low:4308kB high:5168kB active_anon:9424kB inactive_anon:13976kB active_file:844kB inactive_file:2016kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:786432kB managed:745120kB mlocked:0kB dirty:2040kB writeback:0kB mapped:1072kB shmem:22752kB slab_reclaimable:8628kB slab_unreclaimable:611720kB kernel_stack:1120kB pagetables:52kB unstable:0kB bounce:0kB free_pcp:504kB local_pcp:504kB free_cma:0kB writeback_tmp:0kB pages_scanned:19160 all_unreclaimable? yes
> [50885.984181] lowmem_reserve[]: 0 22527 22527
> [50885.988563] HighMem free:2710528kB min:512kB low:3852kB high:7192kB active_anon:51936kB inactive_anon:84448kB active_file:17288kB inactive_file:17612kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:2883580kB managed:2883580kB mlocked:0kB dirty:8kB writeback:0kB mapped:21636kB shmem:127588kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:452kB unstable:0kB bounce:0kB free_pcp:672kB local_pcp:672kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
> [50886.033619] lowmem_reserve[]: 0 0 0
> [50886.037251] Normal: 104*4kB (ME) 62*8kB (ME) 71*16kB (ME) 20*32kB (UME) 6*64kB (UME) 2*128kB (UE) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3328kB
> [50886.051120] HighMem: 316*4kB (UM) 1330*8kB (UM) 2174*16kB (UM) 1057*32kB (UM) 846*64kB (UM) 336*128kB (UM) 148*256kB (UM) 43*512kB (M) 11*1024kB (M) 4*2048kB (M) 599*4096kB (UM) = 2710528kB
> [50886.068617] 47030 total pagecache pages
> [50886.072498] 0 pages in swap cache
> [50886.075890] Swap cache stats: add 0, delete 0, find 0/0
> [50886.081170] Free swap = 0kB
> [50886.084084] Total swap = 0kB
> [50886.087035] 917503 pages RAM
> [50886.089950] 720895 pages HighMem/MovableOnly
> [50886.094264] 10328 pages reserved
> [50886.097564] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name
> [50886.097618] [ 162] 101 162 1311 713 7 0 0 -900 dbus-daemon
> [50886.097646] [ 169] 0 169 2073 997 7 0 0 -1000 sshd
> [50886.097673] [ 209] 0 209 502 315 4 0 0 0 agetty
> [50886.097702] [ 3473] 0 3473 2665 574 6 0 0 -1000 systemd-udevd
> [50886.097734] [ 8177] 0 8177 3432 1435 9 0 0 0 systemd-journal
> [50886.097761] [ 8180] 0 8180 1430 808 5 0 0 0 systemd-logind
> [50886.097789] [ 8182] 0 8182 1058 309 5 0 0 0 cgmanager
> [50886.097815] [ 8183] 0 8183 1249 584 6 0 0 0 login
> [50886.097842] [ 8197] 0 8197 1397 653 5 0 0 0 rpcbind
> [50886.097869] [ 8204] 0 8204 19011 3076 18 0 0 0 NetworkManager
> [50886.097896] [ 8205] 0 8205 646 47 4 0 0 0 rpc.idmapd
> [50886.097922] [ 8208] 0 8208 1069 181 5 0 0 0 rpc.mountd
> [50886.097952] [ 8239] 0 8239 8485 1105 10 0 0 0 polkitd
> [50886.097978] [ 8282] 0 8282 1820 1000 8 0 0 0 systemd
> [50886.098004] [ 8286] 0 8286 6605 361 9 0 0 0 (sd-pam)
> [50886.098030] [ 8292] 0 8292 740 570 4 0 0 0 bash
> [50886.098057] [ 8301] 0 8301 700 411 5 0 0 0 mount
> [50886.098078] Out of memory: Kill process 8204 (NetworkManager) score 3 or sacrifice child
> [50886.106341] Killed process 8204 (NetworkManager) total-vm:76044kB, anon-rss:1760kB, file-rss:10544kB, shmem-rss:0kB
>
> [...]
>
> [50898.530822] SLUB: Unable to allocate memory on node -1, gfp=0x24080c0(GFP_KERNEL|__GFP_ZERO)
> [50898.539344] cache: kmalloc-64, object size: 64, buffer size: 64, default order: 0, min order: 0
> [50898.548302] node 0: slabs: 152849, objs: 9782336, free: 0
> [50898.553969] F2FS-fs (sdb2): Failed to initialize F2FS segment manager
>
> --
> Rask Ingemann Lambertsen
>
> ------------------------------------------------------------------------------
> What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
> patterns at an interface-level. Reveals which users, apps, and protocols are
> consuming the most bandwidth. Provides multi-vendor support for NetFlow,
> J-Flow, sFlow and other flows. Make informed decisions using capacity planning
> reports.http://sdm.link/zohodev2dev
> _______________________________________________
> Linux-f2fs-devel mailing list
> Linux-f2fs-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel
------------------------------------------------------------------------------
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are
consuming the most bandwidth. Provides multi-vendor support for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using capacity planning
reports.http://sdm.link/zohodev2dev
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: Out of memory mounting 8 TB volume with 3.5 GiB of memory - solved
2016-07-25 18:01 ` Jaegeuk Kim
@ 2016-08-01 18:33 ` Rask Ingemann Lambertsen
0 siblings, 0 replies; 3+ messages in thread
From: Rask Ingemann Lambertsen @ 2016-08-01 18:33 UTC (permalink / raw)
To: linux-f2fs-devel
On Mon, Jul 25, 2016 at 11:01:40AM -0700, Jaegeuk Kim wrote:
> Hi,
>
> Yes, I've double-checked that f2fs needs about 100 MB/TB to manage some data
> structures for space management in main memory.
OK, so with a 3G/1G user/kernel memory split, it becomes too tight. I
recompiled the kernel with a 2G/2G memory split instead, and then it works.
Not mounted:
# free
total used free shared buff/cache available
Mem: 3627916 21616 3551088 8576 55212 3514812
Swap: 0 0 0
Mounted:
# free
total used free shared buff/cache available
Mem: 3627916 829840 2465744 8576 332332 2706456
Swap: 0 0 0
# df --block-size=G /home
Filesystem 1G-blocks Used Available Use% Mounted on
/dev/sda2 7448G 124G 7309G 2% /home
That comes out to 108.515 kiB/GiB, or 108.515 MiB/TiB, confirming your
estimate above.
--
Rask Ingemann Lambertsen
------------------------------------------------------------------------------
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2016-08-01 18:34 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2016-07-24 19:46 Out of memory mounting 8 TB volume with 3.5 GiB of memory Rask Ingemann Lambertsen
2016-07-25 18:01 ` Jaegeuk Kim
2016-08-01 18:33 ` Out of memory mounting 8 TB volume with 3.5 GiB of memory - solved Rask Ingemann Lambertsen
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).