* Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory @ 2014-11-02 8:38 Dušan Čolić 2014-11-02 9:55 ` Dušan Čolić ` (2 more replies) 0 siblings, 3 replies; 33+ messages in thread From: Dušan Čolić @ 2014-11-02 8:38 UTC (permalink / raw) To: reiserfs-devel, Edward Shishkin, Ivan Shapovalov When I try to mount a cc reiser4 partition (reiser4-for-3.16.2.patch) I get: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory Uptime is almost 7 days and mounting of this partition worked every day untill last night (I get automated messages on mail when something goes wrong). Now I tried on kernel 3.10 and everything works OK krshina3 goran # uname -a Linux krshina3 3.10.6-gentoo #2 SMP Wed Aug 14 17:33:45 CEST 2013 x86_64 Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz GenuineIntel GNU/Linux krshina3 goran# free -m total used free shared buffers cached Mem: 7681 6794 887 30 0 2933 -/+ buffers/cache: 3860 3821 Swap: 580 325 254 krshina3 goran# cat /etc/fstab | grep -v "#" /dev/sda1 /boot ext2 noauto,noatime 1 2 /dev/md123 none swap sw 0 0 /dev/sda2 / reiser4 noatime,onerror=remount-ro 0 0 /dev/md125 /mnt/backup reiser4 noatime,noauto,onerror=remount-ro 0 0 /dev/md126 /mnt/media reiser4 noatime,users,onerror=remount-ro 0 0 /dev/md127 /usr/portage reiser4 noatime,onerror=remount-ro 0 0 shm /dev/shm tmpfs nodev,nosuid,noexec 0 0 krshina3 goran # df Filesystem 1K-blocks Used Available Use% Mounted on /dev/sda2 37017728 24870384 12147344 68% / tmpfs 786872 832 786040 1% /run udev 10240 0 10240 0% /dev shm 3934340 80 3934260 1% /dev/shm /dev/md126 383034100 298007740 85026360 78% /mnt/media /dev/md127 6113484 5427288 686196 89% /usr/portage /dev/md125 64959612 57618884 7340728 89% /mnt/backup I get these in logs: Nov 2 03:30:01 krshina3 kernel: [562035.221513] reiser4: md125: found disk format 4.0.0. Nov 2 03:30:01 krshina3 kernel: [562035.221749] mount: page allocation failure: order:4, mode:0x2040d0 Nov 2 03:30:01 krshina3 kernel: [562035.221752] CPU: 0 PID: 517 Comm: mount Not tainted 3.16.5-gentoo #1 Nov 2 03:30:01 krshina3 kernel: [562035.221753] Hardware name: Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 07/04/2012 Nov 2 03:30:01 krshina3 kernel: [562035.221754] 0000000000000000 ffff88020ece7968 ffffffff816a31b4 0000000000000007 Nov 2 03:30:01 krshina3 kernel: [562035.221757] 00000000002040d0 ffff88020ece79f8 ffffffff810e609a ffffffff00000040 Nov 2 03:30:01 krshina3 kernel: [562035.221758] 0000000000000286 ffffffff819a8a78 fffffff00000000f ffff88020ece79c8 Nov 2 03:30:01 krshina3 kernel: [562035.221760] Call Trace: Nov 2 03:30:01 krshina3 kernel: [562035.221765] [<ffffffff816a31b4>] dump_stack+0x46/0x58 Nov 2 03:30:01 krshina3 kernel: [562035.221768] [<ffffffff810e609a>] warn_alloc_failed+0xda/0x130 Nov 2 03:30:01 krshina3 kernel: [562035.221770] [<ffffffff810e86c9>] __alloc_pages_nodemask+0x5d9/0x7a0 Nov 2 03:30:01 krshina3 kernel: [562035.221774] [<ffffffff8111f16a>] cache_alloc_refill+0x31a/0x550 Nov 2 03:30:01 krshina3 kernel: [562035.221776] [<ffffffff8111ee23>] kmem_cache_alloc+0xb3/0xe0 Nov 2 03:30:01 krshina3 kernel: [562035.221778] [<ffffffff81186529>] znodes_tree_init+0xc9/0x120 Nov 2 03:30:01 krshina3 kernel: [562035.221781] [<ffffffff8118e7b4>] reiser4_init_tree+0x44/0xd0 Nov 2 03:30:01 krshina3 kernel: [562035.221784] [<ffffffff811cb905>] init_format_format40+0x265/0x5b0 Nov 2 03:30:01 krshina3 kernel: [562035.221787] [<ffffffff8119e8b1>] fill_super+0x101/0x200 Nov 2 03:30:01 krshina3 kernel: [562035.221789] [<ffffffff81126be4>] mount_bdev+0x194/0x1d0 Nov 2 03:30:01 krshina3 kernel: [562035.221792] [<ffffffff8119e7b0>] ? reiser4_mount+0x20/0x20 Nov 2 03:30:01 krshina3 kernel: [562035.221794] [<ffffffff8119e7a0>] reiser4_mount+0x10/0x20 Nov 2 03:30:01 krshina3 kernel: [562035.221796] [<ffffffff81126e2b>] mount_fs+0x1b/0xd0 Nov 2 03:30:01 krshina3 kernel: [562035.221799] [<ffffffff8114042f>] vfs_kern_mount+0x6f/0x130 Nov 2 03:30:01 krshina3 kernel: [562035.221801] [<ffffffff81141f68>] do_mount+0x218/0xab0 Nov 2 03:30:01 krshina3 kernel: [562035.221803] [<ffffffff810e88a2>] ? __get_free_pages+0x12/0x60 Nov 2 03:30:01 krshina3 kernel: [562035.221805] [<ffffffff81141bf5>] ? copy_mount_options+0x35/0x150 Nov 2 03:30:01 krshina3 kernel: [562035.221808] [<ffffffff81142ad9>] SyS_mount+0x89/0xd0 Nov 2 03:30:01 krshina3 kernel: [562035.221811] [<ffffffff816ab1d2>] system_call_fastpath+0x16/0x1b Nov 2 03:30:01 krshina3 kernel: [562035.221812] Mem-Info: Nov 2 03:30:01 krshina3 kernel: [562035.221813] DMA per-cpu: Nov 2 03:30:01 krshina3 kernel: [562035.221814] CPU 0: hi: 0, btch: 1 usd: 0 Nov 2 03:30:01 krshina3 kernel: [562035.221815] CPU 1: hi: 0, btch: 1 usd: 0 Nov 2 03:30:01 krshina3 kernel: [562035.221816] CPU 2: hi: 0, btch: 1 usd: 0 Nov 2 03:30:01 krshina3 kernel: [562035.221817] CPU 3: hi: 0, btch: 1 usd: 0 Nov 2 03:30:01 krshina3 kernel: [562035.221817] DMA32 per-cpu: Nov 2 03:30:01 krshina3 kernel: [562035.221819] CPU 0: hi: 186, btch: 31 usd: 0 Nov 2 03:30:01 krshina3 kernel: [562035.221819] CPU 1: hi: 186, btch: 31 usd: 0 Nov 2 03:30:01 krshina3 kernel: [562035.221820] CPU 2: hi: 186, btch: 31 usd: 0 Nov 2 03:30:01 krshina3 kernel: [562035.221821] CPU 3: hi: 186, btch: 31 usd: 0 Nov 2 03:30:01 krshina3 kernel: [562035.221822] Normal per-cpu: Nov 2 03:30:01 krshina3 kernel: [562035.221823] CPU 0: hi: 186, btch: 31 usd: 0 Nov 2 03:30:01 krshina3 kernel: [562035.221824] CPU 1: hi: 186, btch: 31 usd: 0 Nov 2 03:30:01 krshina3 kernel: [562035.221825] CPU 2: hi: 186, btch: 31 usd: 56 Nov 2 03:30:01 krshina3 kernel: [562035.221826] CPU 3: hi: 186, btch: 31 usd: 0 Nov 2 03:30:01 krshina3 kernel: [562035.221828] active_anon:701641 inactive_anon:138699 isolated_anon:0 Nov 2 03:30:01 krshina3 kernel: [562035.221828] active_file:399519 inactive_file:396920 isolated_file:0 Nov 2 03:30:01 krshina3 kernel: [562035.221828] unevictable:0 dirty:204 writeback:0 unstable:0 Nov 2 03:30:01 krshina3 kernel: [562035.221828] free:155878 slab_reclaimable:126123 slab_unreclaimable:9074 Nov 2 03:30:01 krshina3 kernel: [562035.221828] mapped:21535 shmem:5701 pagetables:10162 bounce:0 Nov 2 03:30:01 krshina3 kernel: [562035.221828] free_cma:0 Nov 2 03:30:01 krshina3 kernel: [562035.221833] DMA free:15900kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes Nov 2 03:30:01 krshina3 kernel: [562035.221834] lowmem_reserve[]: 0 2950 7665 7665 Nov 2 03:30:01 krshina3 kernel: [562035.221839] DMA32 free:250180kB min:4308kB low:5384kB high:6460kB active_anon:1026572kB inactive_anon:257356kB active_file:616152kB inactive_file:612572kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3098560kB managed:3022260kB mlocked:0kB dirty:4kB writeback:0kB mapped:33232kB shmem:9336kB slab_reclaimable:180492kB slab_unreclaimable:12176kB kernel_stack:2496kB pagetables:16872kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no Nov 2 03:30:01 krshina3 kernel: [562035.221840] lowmem_reserve[]: 0 0 4714 4714 Nov 2 03:30:01 krshina3 kernel: [562035.221844] Normal free:357432kB min:6884kB low:8604kB high:10324kB active_anon:1779992kB inactive_anon:297440kB active_file:981924kB inactive_file:975108kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:4954112kB managed:4828124kB mlocked:0kB dirty:812kB writeback:0kB mapped:52908kB shmem:13468kB slab_reclaimable:324000kB slab_unreclaimable:24120kB kernel_stack:4160kB pagetables:23776kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:24 all_unreclaimable? no Nov 2 03:30:01 krshina3 kernel: [562035.221845] lowmem_reserve[]: 0 0 0 0 Nov 2 03:30:01 krshina3 kernel: [562035.221847] DMA: 1*4kB (U) 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB Nov 2 03:30:01 krshina3 kernel: [562035.221855] DMA32: 52520*4kB (UEM) 5030*8kB (UE) 3*16kB (UR) 0*32kB 1*64kB (R) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 250432kB Nov 2 03:30:01 krshina3 kernel: [562035.221861] Normal: 62961*4kB (UEM) 11874*8kB (UEM) 640*16kB (UEMR) 17*32kB (UEMR) 1*64kB (E) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 357684kB Nov 2 03:30:01 krshina3 kernel: [562035.221867] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Nov 2 03:30:01 krshina3 kernel: [562035.221868] 804788 total pagecache pages Nov 2 03:30:01 krshina3 kernel: [562035.221869] 2600 pages in swap cache Nov 2 03:30:01 krshina3 kernel: [562035.221870] Swap cache stats: add 91111, delete 88511, find 38599/41340 Nov 2 03:30:01 krshina3 kernel: [562035.221871] Free swap = 277028kB Nov 2 03:30:01 krshina3 kernel: [562035.221872] Total swap = 594300kB Nov 2 03:30:01 krshina3 kernel: [562035.221873] 2017164 pages RAM Nov 2 03:30:01 krshina3 kernel: [562035.221873] 0 pages HighMem/MovableOnly Nov 2 03:30:01 krshina3 kernel: [562035.221874] 31497 pages reserved Nov 2 09:13:48 krshina3 kernel: [582660.900521] reiser4: md125: found disk format 4.0.0. Nov 2 09:13:48 krshina3 kernel: [582660.900907] mount: page allocation failure: order:4, mode:0x2040d0 Nov 2 09:13:48 krshina3 kernel: [582660.900910] CPU: 1 PID: 1414 Comm: mount Not tainted 3.16.5-gentoo #1 Nov 2 09:13:48 krshina3 kernel: [582660.900912] Hardware name: Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 07/04/2012 Nov 2 09:13:48 krshina3 kernel: [582660.900914] 0000000000000000 ffff880148093968 ffffffff816a31b4 0000000000000007 Nov 2 09:13:48 krshina3 kernel: [582660.900917] 00000000002040d0 ffff8801480939f8 ffffffff810e609a ffffffff00000040 Nov 2 09:13:48 krshina3 kernel: [582660.900919] 0000000000000286 ffffffff819a8a78 fffffff00000000f ffff8801480939c8 Nov 2 09:13:48 krshina3 kernel: [582660.900922] Call Trace: Nov 2 09:13:48 krshina3 kernel: [582660.900929] [<ffffffff816a31b4>] dump_stack+0x46/0x58 Nov 2 09:13:48 krshina3 kernel: [582660.900933] [<ffffffff810e609a>] warn_alloc_failed+0xda/0x130 Nov 2 09:13:48 krshina3 kernel: [582660.900937] [<ffffffff810e86c9>] __alloc_pages_nodemask+0x5d9/0x7a0 Nov 2 09:13:48 krshina3 kernel: [582660.900941] [<ffffffff8111f16a>] cache_alloc_refill+0x31a/0x550 Nov 2 09:13:48 krshina3 kernel: [582660.900945] [<ffffffff8111ee23>] kmem_cache_alloc+0xb3/0xe0 Nov 2 09:13:48 krshina3 kernel: [582660.900948] [<ffffffff81186529>] znodes_tree_init+0xc9/0x120 Nov 2 09:13:48 krshina3 kernel: [582660.900951] [<ffffffff8118e7b4>] reiser4_init_tree+0x44/0xd0 Nov 2 09:13:48 krshina3 kernel: [582660.900955] [<ffffffff811cb905>] init_format_format40+0x265/0x5b0 Nov 2 09:13:48 krshina3 kernel: [582660.900959] [<ffffffff8119e8b1>] fill_super+0x101/0x200 Nov 2 09:13:48 krshina3 kernel: [582660.900963] [<ffffffff81126be4>] mount_bdev+0x194/0x1d0 Nov 2 09:13:48 krshina3 kernel: [582660.900966] [<ffffffff8119e7b0>] ? reiser4_mount+0x20/0x20 Nov 2 09:13:48 krshina3 kernel: [582660.900969] [<ffffffff8119e7a0>] reiser4_mount+0x10/0x20 Nov 2 09:13:48 krshina3 kernel: [582660.900972] [<ffffffff81126e2b>] mount_fs+0x1b/0xd0 Nov 2 09:13:48 krshina3 kernel: [582660.900976] [<ffffffff8114042f>] vfs_kern_mount+0x6f/0x130 Nov 2 09:13:48 krshina3 kernel: [582660.900979] [<ffffffff81141f68>] do_mount+0x218/0xab0 Nov 2 09:13:48 krshina3 kernel: [582660.900982] [<ffffffff810e88a2>] ? __get_free_pages+0x12/0x60 Nov 2 09:13:48 krshina3 kernel: [582660.900986] [<ffffffff81141bf5>] ? copy_mount_options+0x35/0x150 Nov 2 09:13:48 krshina3 kernel: [582660.900989] [<ffffffff81142ad9>] SyS_mount+0x89/0xd0 Nov 2 09:13:48 krshina3 kernel: [582660.900993] [<ffffffff816ab1d2>] system_call_fastpath+0x16/0x1b Nov 2 09:13:48 krshina3 kernel: [582660.900994] Mem-Info: Nov 2 09:13:48 krshina3 kernel: [582660.900996] DMA per-cpu: Nov 2 09:13:48 krshina3 kernel: [582660.900997] CPU 0: hi: 0, btch: 1 usd: 0 Nov 2 09:13:48 krshina3 kernel: [582660.900999] CPU 1: hi: 0, btch: 1 usd: 0 Nov 2 09:13:48 krshina3 kernel: [582660.901000] CPU 2: hi: 0, btch: 1 usd: 0 Nov 2 09:13:48 krshina3 kernel: [582660.901001] CPU 3: hi: 0, btch: 1 usd: 0 Nov 2 09:13:48 krshina3 kernel: [582660.901002] DMA32 per-cpu: Nov 2 09:13:48 krshina3 kernel: [582660.901004] CPU 0: hi: 186, btch: 31 usd: 0 Nov 2 09:13:48 krshina3 kernel: [582660.901005] CPU 1: hi: 186, btch: 31 usd: 0 Nov 2 09:13:48 krshina3 kernel: [582660.901006] CPU 2: hi: 186, btch: 31 usd: 0 Nov 2 09:13:48 krshina3 kernel: [582660.901008] CPU 3: hi: 186, btch: 31 usd: 0 Nov 2 09:13:48 krshina3 kernel: [582660.901009] Normal per-cpu: Nov 2 09:13:48 krshina3 kernel: [582660.901010] CPU 0: hi: 186, btch: 31 usd: 0 Nov 2 09:13:48 krshina3 kernel: [582660.901011] CPU 1: hi: 186, btch: 31 usd: 0 Nov 2 09:13:48 krshina3 kernel: [582660.901013] CPU 2: hi: 186, btch: 31 usd: 21 Nov 2 09:13:48 krshina3 kernel: [582660.901014] CPU 3: hi: 186, btch: 31 usd: 0 Nov 2 09:13:48 krshina3 kernel: [582660.901017] active_anon:719713 inactive_anon:145280 isolated_anon:0 Nov 2 09:13:48 krshina3 kernel: [582660.901017] active_file:390035 inactive_file:389999 isolated_file:0 Nov 2 09:13:48 krshina3 kernel: [582660.901017] unevictable:0 dirty:1180 writeback:0 unstable:0 Nov 2 09:13:48 krshina3 kernel: [582660.901017] free:161223 slab_reclaimable:112227 slab_unreclaimable:9155 Nov 2 09:13:48 krshina3 kernel: [582660.901017] mapped:35966 shmem:7263 pagetables:10549 bounce:0 Nov 2 09:13:48 krshina3 kernel: [582660.901017] free_cma:0 Nov 2 09:13:48 krshina3 kernel: [582660.901024] DMA free:15900kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes Nov 2 09:13:48 krshina3 kernel: [582660.901026] lowmem_reserve[]: 0 2950 7665 7665 Nov 2 09:13:48 krshina3 kernel: [582660.901033] DMA32 free:243456kB min:4308kB low:5384kB high:6460kB active_anon:1055312kB inactive_anon:268364kB active_file:605480kB inactive_file:605344kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3098560kB managed:3022260kB mlocked:0kB dirty:1728kB writeback:0kB mapped:55944kB shmem:11860kB slab_reclaimable:164900kB slab_unreclaimable:12340kB kernel_stack:2496kB pagetables:17284kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no Nov 2 09:13:48 krshina3 kernel: [582660.901034] lowmem_reserve[]: 0 0 4714 4714 Nov 2 09:13:48 krshina3 kernel: [582660.901040] Normal free:385536kB min:6884kB low:8604kB high:10324kB active_anon:1823540kB inactive_anon:312756kB active_file:954660kB inactive_file:954652kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:4954112kB managed:4828124kB mlocked:0kB dirty:2992kB writeback:0kB mapped:87920kB shmem:17192kB slab_reclaimable:284008kB slab_unreclaimable:24280kB kernel_stack:4368kB pagetables:24912kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:21 all_unreclaimable? no Nov 2 09:13:48 krshina3 kernel: [582660.901041] lowmem_reserve[]: 0 0 0 0 Nov 2 09:13:48 krshina3 kernel: [582660.901044] DMA: 1*4kB (U) 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB Nov 2 09:13:48 krshina3 kernel: [582660.901054] DMA32: 46552*4kB (UE) 7159*8kB (U) 2*16kB (R) 0*32kB 1*64kB (R) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 243576kB Nov 2 09:13:48 krshina3 kernel: [582660.901063] Normal: 40881*4kB (UEM) 27461*8kB (UEM) 151*16kB (UR) 2*32kB (R) 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 385692kB Nov 2 09:13:48 krshina3 kernel: [582660.901072] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Nov 2 09:13:48 krshina3 kernel: [582660.901073] 789766 total pagecache pages Nov 2 09:13:48 krshina3 kernel: [582660.901075] 2404 pages in swap cache Nov 2 09:13:48 krshina3 kernel: [582660.901076] Swap cache stats: add 94924, delete 92520, find 40323/43073 Nov 2 09:13:48 krshina3 kernel: [582660.901077] Free swap = 261888kB Nov 2 09:13:48 krshina3 kernel: [582660.901078] Total swap = 594300kB Nov 2 09:13:48 krshina3 kernel: [582660.901079] 2017164 pages RAM Nov 2 09:13:48 krshina3 kernel: [582660.901080] 0 pages HighMem/MovableOnly Nov 2 09:13:48 krshina3 kernel: [582660.901081] 31497 pages reserved Now I'm gonna fsck all partitions and report if anything comes up. Ask if you need more info Thanks in advance Dushan ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-11-02 8:38 Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory Dušan Čolić @ 2014-11-02 9:55 ` Dušan Čolić 2014-11-02 12:08 ` Dušan Čolić [not found] ` <CADW=+3ms6zaqzpkRBEgApi=gkMNPLCzzex8ShK4CkCFD-WNk8Q@mail.gmail.com> [not found] ` <CADW=+3nzK0rLpQR-+rhn_siKCYr5mSSbfkyyw5NXgagZWEPLvA@mail.gmail.com> 2 siblings, 1 reply; 33+ messages in thread From: Dušan Čolić @ 2014-11-02 9:55 UTC (permalink / raw) To: reiserfs-devel, Edward Shishkin, Ivan Shapovalov fsck reported no problems on partition, only it lasted pretty long for 60GB FS: krshina3 goran # fsck.reiser4 /dev/md125 ******************************************************************* This is an EXPERIMENTAL version of fsck.reiser4. Read README first. ******************************************************************* Fscking the /dev/md125 block device. Will check the consistency of the Reiser4 SuperBlock. Will check the consistency of the Reiser4 FileSystem. Continue? (Yes/No): y ***** fsck.reiser4 started at Sun Nov 2 09:47:29 2014 Reiser4 fs was detected on /dev/md125. Master super block (16): magic: ReIsEr4 blksize: 4096 format: 0x0 (format40) uuid: 184e9560-bdf9-42b0-896c-0af2a0c84066 label: <none> Format super block (17): plugin: format40 description: Disk-format plugin. version: 0 magic: ReIsEr40FoRmAt mkfs id: 0x2a685787 flushes: 0 blocks: 17091120 free blocks: 2686399 root block: 13259826 tail policy: 0x2 (smart) next oid: 0xbbbe1d file count: 863269 tree height: 5 key policy: LARGE CHECKING THE STORAGE TREE Read nodes 10040995 Nodes left in the tree 10040995 Leaves of them 9923653, Twigs of them 115902 Time interval: Sun Nov 2 09:47:33 2014 - Sun Nov 2 09:58:30 2014 CHECKING EXTENT REGIONS. Read twigs 115902 Time interval: Sun Nov 2 09:58:30 2014 - Sun Nov 2 10:05:43 2014 CHECKING THE SEMANTIC TREE Found 2579213 objects (some could be encountered more then once). Time interval: Sun Nov 2 10:05:43 2014 - Sun Nov 2 10:53:42 2014 ***** fsck.reiser4 finished at Sun Nov 2 10:53:42 2014 Closing fs...done FS is consistent. On Sun, Nov 2, 2014 at 9:38 AM, Dušan Čolić <dusanc@gmail.com> wrote: > When I try to mount a cc reiser4 partition (reiser4-for-3.16.2.patch) > I get: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate > memory > Uptime is almost 7 days and mounting of this partition worked every > day untill last night (I get automated messages on mail when something > goes wrong). > > Now I tried on kernel 3.10 and everything works OK > > krshina3 goran # uname -a > Linux krshina3 3.10.6-gentoo #2 SMP Wed Aug 14 17:33:45 CEST 2013 > x86_64 Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz GenuineIntel GNU/Linux > > krshina3 goran# free -m > total used free shared buffers cached > Mem: 7681 6794 887 30 0 2933 > -/+ buffers/cache: 3860 3821 > Swap: 580 325 254 > > krshina3 goran# cat /etc/fstab | grep -v "#" > > /dev/sda1 /boot ext2 noauto,noatime 1 2 > /dev/md123 none swap sw 0 0 > /dev/sda2 / reiser4 > noatime,onerror=remount-ro 0 0 > /dev/md125 /mnt/backup reiser4 > noatime,noauto,onerror=remount-ro 0 0 > /dev/md126 /mnt/media reiser4 > noatime,users,onerror=remount-ro 0 0 > /dev/md127 /usr/portage reiser4 > noatime,onerror=remount-ro 0 0 > shm /dev/shm tmpfs > nodev,nosuid,noexec 0 0 > > > krshina3 goran # df > Filesystem 1K-blocks Used Available Use% Mounted on > /dev/sda2 37017728 24870384 12147344 68% / > tmpfs 786872 832 786040 1% /run > udev 10240 0 10240 0% /dev > shm 3934340 80 3934260 1% /dev/shm > /dev/md126 383034100 298007740 85026360 78% /mnt/media > /dev/md127 6113484 5427288 686196 89% /usr/portage > /dev/md125 64959612 57618884 7340728 89% /mnt/backup > > I get these in logs: > > Nov 2 03:30:01 krshina3 kernel: [562035.221513] reiser4: md125: found > disk format 4.0.0. > Nov 2 03:30:01 krshina3 kernel: [562035.221749] mount: page > allocation failure: order:4, mode:0x2040d0 > Nov 2 03:30:01 krshina3 kernel: [562035.221752] CPU: 0 PID: 517 Comm: > mount Not tainted 3.16.5-gentoo #1 > Nov 2 03:30:01 krshina3 kernel: [562035.221753] Hardware name: > Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 > 07/04/2012 > Nov 2 03:30:01 krshina3 kernel: [562035.221754] 0000000000000000 > ffff88020ece7968 ffffffff816a31b4 0000000000000007 > Nov 2 03:30:01 krshina3 kernel: [562035.221757] 00000000002040d0 > ffff88020ece79f8 ffffffff810e609a ffffffff00000040 > Nov 2 03:30:01 krshina3 kernel: [562035.221758] 0000000000000286 > ffffffff819a8a78 fffffff00000000f ffff88020ece79c8 > Nov 2 03:30:01 krshina3 kernel: [562035.221760] Call Trace: > Nov 2 03:30:01 krshina3 kernel: [562035.221765] [<ffffffff816a31b4>] > dump_stack+0x46/0x58 > Nov 2 03:30:01 krshina3 kernel: [562035.221768] [<ffffffff810e609a>] > warn_alloc_failed+0xda/0x130 > Nov 2 03:30:01 krshina3 kernel: [562035.221770] [<ffffffff810e86c9>] > __alloc_pages_nodemask+0x5d9/0x7a0 > Nov 2 03:30:01 krshina3 kernel: [562035.221774] [<ffffffff8111f16a>] > cache_alloc_refill+0x31a/0x550 > Nov 2 03:30:01 krshina3 kernel: [562035.221776] [<ffffffff8111ee23>] > kmem_cache_alloc+0xb3/0xe0 > Nov 2 03:30:01 krshina3 kernel: [562035.221778] [<ffffffff81186529>] > znodes_tree_init+0xc9/0x120 > Nov 2 03:30:01 krshina3 kernel: [562035.221781] [<ffffffff8118e7b4>] > reiser4_init_tree+0x44/0xd0 > Nov 2 03:30:01 krshina3 kernel: [562035.221784] [<ffffffff811cb905>] > init_format_format40+0x265/0x5b0 > Nov 2 03:30:01 krshina3 kernel: [562035.221787] [<ffffffff8119e8b1>] > fill_super+0x101/0x200 > Nov 2 03:30:01 krshina3 kernel: [562035.221789] [<ffffffff81126be4>] > mount_bdev+0x194/0x1d0 > Nov 2 03:30:01 krshina3 kernel: [562035.221792] [<ffffffff8119e7b0>] > ? reiser4_mount+0x20/0x20 > Nov 2 03:30:01 krshina3 kernel: [562035.221794] [<ffffffff8119e7a0>] > reiser4_mount+0x10/0x20 > Nov 2 03:30:01 krshina3 kernel: [562035.221796] [<ffffffff81126e2b>] > mount_fs+0x1b/0xd0 > Nov 2 03:30:01 krshina3 kernel: [562035.221799] [<ffffffff8114042f>] > vfs_kern_mount+0x6f/0x130 > Nov 2 03:30:01 krshina3 kernel: [562035.221801] [<ffffffff81141f68>] > do_mount+0x218/0xab0 > Nov 2 03:30:01 krshina3 kernel: [562035.221803] [<ffffffff810e88a2>] > ? __get_free_pages+0x12/0x60 > Nov 2 03:30:01 krshina3 kernel: [562035.221805] [<ffffffff81141bf5>] > ? copy_mount_options+0x35/0x150 > Nov 2 03:30:01 krshina3 kernel: [562035.221808] [<ffffffff81142ad9>] > SyS_mount+0x89/0xd0 > Nov 2 03:30:01 krshina3 kernel: [562035.221811] [<ffffffff816ab1d2>] > system_call_fastpath+0x16/0x1b > Nov 2 03:30:01 krshina3 kernel: [562035.221812] Mem-Info: > Nov 2 03:30:01 krshina3 kernel: [562035.221813] DMA per-cpu: > Nov 2 03:30:01 krshina3 kernel: [562035.221814] CPU 0: hi: 0, > btch: 1 usd: 0 > Nov 2 03:30:01 krshina3 kernel: [562035.221815] CPU 1: hi: 0, > btch: 1 usd: 0 > Nov 2 03:30:01 krshina3 kernel: [562035.221816] CPU 2: hi: 0, > btch: 1 usd: 0 > Nov 2 03:30:01 krshina3 kernel: [562035.221817] CPU 3: hi: 0, > btch: 1 usd: 0 > Nov 2 03:30:01 krshina3 kernel: [562035.221817] DMA32 per-cpu: > Nov 2 03:30:01 krshina3 kernel: [562035.221819] CPU 0: hi: 186, > btch: 31 usd: 0 > Nov 2 03:30:01 krshina3 kernel: [562035.221819] CPU 1: hi: 186, > btch: 31 usd: 0 > Nov 2 03:30:01 krshina3 kernel: [562035.221820] CPU 2: hi: 186, > btch: 31 usd: 0 > Nov 2 03:30:01 krshina3 kernel: [562035.221821] CPU 3: hi: 186, > btch: 31 usd: 0 > Nov 2 03:30:01 krshina3 kernel: [562035.221822] Normal per-cpu: > Nov 2 03:30:01 krshina3 kernel: [562035.221823] CPU 0: hi: 186, > btch: 31 usd: 0 > Nov 2 03:30:01 krshina3 kernel: [562035.221824] CPU 1: hi: 186, > btch: 31 usd: 0 > Nov 2 03:30:01 krshina3 kernel: [562035.221825] CPU 2: hi: 186, > btch: 31 usd: 56 > Nov 2 03:30:01 krshina3 kernel: [562035.221826] CPU 3: hi: 186, > btch: 31 usd: 0 > Nov 2 03:30:01 krshina3 kernel: [562035.221828] active_anon:701641 > inactive_anon:138699 isolated_anon:0 > Nov 2 03:30:01 krshina3 kernel: [562035.221828] active_file:399519 > inactive_file:396920 isolated_file:0 > Nov 2 03:30:01 krshina3 kernel: [562035.221828] unevictable:0 > dirty:204 writeback:0 unstable:0 > Nov 2 03:30:01 krshina3 kernel: [562035.221828] free:155878 > slab_reclaimable:126123 slab_unreclaimable:9074 > Nov 2 03:30:01 krshina3 kernel: [562035.221828] mapped:21535 > shmem:5701 pagetables:10162 bounce:0 > Nov 2 03:30:01 krshina3 kernel: [562035.221828] free_cma:0 > Nov 2 03:30:01 krshina3 kernel: [562035.221833] DMA free:15900kB > min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB > active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB > isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB > dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB > slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB > bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 > all_unreclaimable? yes > Nov 2 03:30:01 krshina3 kernel: [562035.221834] lowmem_reserve[]: 0 > 2950 7665 7665 > Nov 2 03:30:01 krshina3 kernel: [562035.221839] DMA32 free:250180kB > min:4308kB low:5384kB high:6460kB active_anon:1026572kB > inactive_anon:257356kB active_file:616152kB inactive_file:612572kB > unevictable:0kB isolated(anon):0kB isolated(file):0kB > present:3098560kB managed:3022260kB mlocked:0kB dirty:4kB > writeback:0kB mapped:33232kB shmem:9336kB slab_reclaimable:180492kB > slab_unreclaimable:12176kB kernel_stack:2496kB pagetables:16872kB > unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 > all_unreclaimable? no > Nov 2 03:30:01 krshina3 kernel: [562035.221840] lowmem_reserve[]: 0 0 4714 4714 > Nov 2 03:30:01 krshina3 kernel: [562035.221844] Normal free:357432kB > min:6884kB low:8604kB high:10324kB active_anon:1779992kB > inactive_anon:297440kB active_file:981924kB inactive_file:975108kB > unevictable:0kB isolated(anon):0kB isolated(file):0kB > present:4954112kB managed:4828124kB mlocked:0kB dirty:812kB > writeback:0kB mapped:52908kB shmem:13468kB slab_reclaimable:324000kB > slab_unreclaimable:24120kB kernel_stack:4160kB pagetables:23776kB > unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB > pages_scanned:24 all_unreclaimable? no > Nov 2 03:30:01 krshina3 kernel: [562035.221845] lowmem_reserve[]: 0 0 0 0 > Nov 2 03:30:01 krshina3 kernel: [562035.221847] DMA: 1*4kB (U) 1*8kB > (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB > 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB > Nov 2 03:30:01 krshina3 kernel: [562035.221855] DMA32: 52520*4kB > (UEM) 5030*8kB (UE) 3*16kB (UR) 0*32kB 1*64kB (R) 0*128kB 0*256kB > 0*512kB 0*1024kB 0*2048kB 0*4096kB = 250432kB > Nov 2 03:30:01 krshina3 kernel: [562035.221861] Normal: 62961*4kB > (UEM) 11874*8kB (UEM) 640*16kB (UEMR) 17*32kB (UEMR) 1*64kB (E) > 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 357684kB > Nov 2 03:30:01 krshina3 kernel: [562035.221867] Node 0 > hugepages_total=0 hugepages_free=0 hugepages_surp=0 > hugepages_size=2048kB > Nov 2 03:30:01 krshina3 kernel: [562035.221868] 804788 total pagecache pages > Nov 2 03:30:01 krshina3 kernel: [562035.221869] 2600 pages in swap cache > Nov 2 03:30:01 krshina3 kernel: [562035.221870] Swap cache stats: add > 91111, delete 88511, find 38599/41340 > Nov 2 03:30:01 krshina3 kernel: [562035.221871] Free swap = 277028kB > Nov 2 03:30:01 krshina3 kernel: [562035.221872] Total swap = 594300kB > Nov 2 03:30:01 krshina3 kernel: [562035.221873] 2017164 pages RAM > Nov 2 03:30:01 krshina3 kernel: [562035.221873] 0 pages HighMem/MovableOnly > Nov 2 03:30:01 krshina3 kernel: [562035.221874] 31497 pages reserved > > > > > Nov 2 09:13:48 krshina3 kernel: [582660.900521] reiser4: md125: found > disk format 4.0.0. > Nov 2 09:13:48 krshina3 kernel: [582660.900907] mount: page > allocation failure: order:4, mode:0x2040d0 > Nov 2 09:13:48 krshina3 kernel: [582660.900910] CPU: 1 PID: 1414 > Comm: mount Not tainted 3.16.5-gentoo #1 > Nov 2 09:13:48 krshina3 kernel: [582660.900912] Hardware name: > Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 > 07/04/2012 > Nov 2 09:13:48 krshina3 kernel: [582660.900914] 0000000000000000 > ffff880148093968 ffffffff816a31b4 0000000000000007 > Nov 2 09:13:48 krshina3 kernel: [582660.900917] 00000000002040d0 > ffff8801480939f8 ffffffff810e609a ffffffff00000040 > Nov 2 09:13:48 krshina3 kernel: [582660.900919] 0000000000000286 > ffffffff819a8a78 fffffff00000000f ffff8801480939c8 > Nov 2 09:13:48 krshina3 kernel: [582660.900922] Call Trace: > Nov 2 09:13:48 krshina3 kernel: [582660.900929] [<ffffffff816a31b4>] > dump_stack+0x46/0x58 > Nov 2 09:13:48 krshina3 kernel: [582660.900933] [<ffffffff810e609a>] > warn_alloc_failed+0xda/0x130 > Nov 2 09:13:48 krshina3 kernel: [582660.900937] [<ffffffff810e86c9>] > __alloc_pages_nodemask+0x5d9/0x7a0 > Nov 2 09:13:48 krshina3 kernel: [582660.900941] [<ffffffff8111f16a>] > cache_alloc_refill+0x31a/0x550 > Nov 2 09:13:48 krshina3 kernel: [582660.900945] [<ffffffff8111ee23>] > kmem_cache_alloc+0xb3/0xe0 > Nov 2 09:13:48 krshina3 kernel: [582660.900948] [<ffffffff81186529>] > znodes_tree_init+0xc9/0x120 > Nov 2 09:13:48 krshina3 kernel: [582660.900951] [<ffffffff8118e7b4>] > reiser4_init_tree+0x44/0xd0 > Nov 2 09:13:48 krshina3 kernel: [582660.900955] [<ffffffff811cb905>] > init_format_format40+0x265/0x5b0 > Nov 2 09:13:48 krshina3 kernel: [582660.900959] [<ffffffff8119e8b1>] > fill_super+0x101/0x200 > Nov 2 09:13:48 krshina3 kernel: [582660.900963] [<ffffffff81126be4>] > mount_bdev+0x194/0x1d0 > Nov 2 09:13:48 krshina3 kernel: [582660.900966] [<ffffffff8119e7b0>] > ? reiser4_mount+0x20/0x20 > Nov 2 09:13:48 krshina3 kernel: [582660.900969] [<ffffffff8119e7a0>] > reiser4_mount+0x10/0x20 > Nov 2 09:13:48 krshina3 kernel: [582660.900972] [<ffffffff81126e2b>] > mount_fs+0x1b/0xd0 > Nov 2 09:13:48 krshina3 kernel: [582660.900976] [<ffffffff8114042f>] > vfs_kern_mount+0x6f/0x130 > Nov 2 09:13:48 krshina3 kernel: [582660.900979] [<ffffffff81141f68>] > do_mount+0x218/0xab0 > Nov 2 09:13:48 krshina3 kernel: [582660.900982] [<ffffffff810e88a2>] > ? __get_free_pages+0x12/0x60 > Nov 2 09:13:48 krshina3 kernel: [582660.900986] [<ffffffff81141bf5>] > ? copy_mount_options+0x35/0x150 > Nov 2 09:13:48 krshina3 kernel: [582660.900989] [<ffffffff81142ad9>] > SyS_mount+0x89/0xd0 > Nov 2 09:13:48 krshina3 kernel: [582660.900993] [<ffffffff816ab1d2>] > system_call_fastpath+0x16/0x1b > Nov 2 09:13:48 krshina3 kernel: [582660.900994] Mem-Info: > Nov 2 09:13:48 krshina3 kernel: [582660.900996] DMA per-cpu: > Nov 2 09:13:48 krshina3 kernel: [582660.900997] CPU 0: hi: 0, > btch: 1 usd: 0 > Nov 2 09:13:48 krshina3 kernel: [582660.900999] CPU 1: hi: 0, > btch: 1 usd: 0 > Nov 2 09:13:48 krshina3 kernel: [582660.901000] CPU 2: hi: 0, > btch: 1 usd: 0 > Nov 2 09:13:48 krshina3 kernel: [582660.901001] CPU 3: hi: 0, > btch: 1 usd: 0 > Nov 2 09:13:48 krshina3 kernel: [582660.901002] DMA32 per-cpu: > Nov 2 09:13:48 krshina3 kernel: [582660.901004] CPU 0: hi: 186, > btch: 31 usd: 0 > Nov 2 09:13:48 krshina3 kernel: [582660.901005] CPU 1: hi: 186, > btch: 31 usd: 0 > Nov 2 09:13:48 krshina3 kernel: [582660.901006] CPU 2: hi: 186, > btch: 31 usd: 0 > Nov 2 09:13:48 krshina3 kernel: [582660.901008] CPU 3: hi: 186, > btch: 31 usd: 0 > Nov 2 09:13:48 krshina3 kernel: [582660.901009] Normal per-cpu: > Nov 2 09:13:48 krshina3 kernel: [582660.901010] CPU 0: hi: 186, > btch: 31 usd: 0 > Nov 2 09:13:48 krshina3 kernel: [582660.901011] CPU 1: hi: 186, > btch: 31 usd: 0 > Nov 2 09:13:48 krshina3 kernel: [582660.901013] CPU 2: hi: 186, > btch: 31 usd: 21 > Nov 2 09:13:48 krshina3 kernel: [582660.901014] CPU 3: hi: 186, > btch: 31 usd: 0 > Nov 2 09:13:48 krshina3 kernel: [582660.901017] active_anon:719713 > inactive_anon:145280 isolated_anon:0 > Nov 2 09:13:48 krshina3 kernel: [582660.901017] active_file:390035 > inactive_file:389999 isolated_file:0 > Nov 2 09:13:48 krshina3 kernel: [582660.901017] unevictable:0 > dirty:1180 writeback:0 unstable:0 > Nov 2 09:13:48 krshina3 kernel: [582660.901017] free:161223 > slab_reclaimable:112227 slab_unreclaimable:9155 > Nov 2 09:13:48 krshina3 kernel: [582660.901017] mapped:35966 > shmem:7263 pagetables:10549 bounce:0 > Nov 2 09:13:48 krshina3 kernel: [582660.901017] free_cma:0 > Nov 2 09:13:48 krshina3 kernel: [582660.901024] DMA free:15900kB > min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB > active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB > isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB > dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB > slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB > bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 > all_unreclaimable? yes > Nov 2 09:13:48 krshina3 kernel: [582660.901026] lowmem_reserve[]: 0 > 2950 7665 7665 > Nov 2 09:13:48 krshina3 kernel: [582660.901033] DMA32 free:243456kB > min:4308kB low:5384kB high:6460kB active_anon:1055312kB > inactive_anon:268364kB active_file:605480kB inactive_file:605344kB > unevictable:0kB isolated(anon):0kB isolated(file):0kB > present:3098560kB managed:3022260kB mlocked:0kB dirty:1728kB > writeback:0kB mapped:55944kB shmem:11860kB slab_reclaimable:164900kB > slab_unreclaimable:12340kB kernel_stack:2496kB pagetables:17284kB > unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 > all_unreclaimable? no > Nov 2 09:13:48 krshina3 kernel: [582660.901034] lowmem_reserve[]: 0 0 4714 4714 > Nov 2 09:13:48 krshina3 kernel: [582660.901040] Normal free:385536kB > min:6884kB low:8604kB high:10324kB active_anon:1823540kB > inactive_anon:312756kB active_file:954660kB inactive_file:954652kB > unevictable:0kB isolated(anon):0kB isolated(file):0kB > present:4954112kB managed:4828124kB mlocked:0kB dirty:2992kB > writeback:0kB mapped:87920kB shmem:17192kB slab_reclaimable:284008kB > slab_unreclaimable:24280kB kernel_stack:4368kB pagetables:24912kB > unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB > pages_scanned:21 all_unreclaimable? no > Nov 2 09:13:48 krshina3 kernel: [582660.901041] lowmem_reserve[]: 0 0 0 0 > Nov 2 09:13:48 krshina3 kernel: [582660.901044] DMA: 1*4kB (U) 1*8kB > (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB > 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB > Nov 2 09:13:48 krshina3 kernel: [582660.901054] DMA32: 46552*4kB (UE) > 7159*8kB (U) 2*16kB (R) 0*32kB 1*64kB (R) 0*128kB 0*256kB 0*512kB > 0*1024kB 0*2048kB 0*4096kB = 243576kB > Nov 2 09:13:48 krshina3 kernel: [582660.901063] Normal: 40881*4kB > (UEM) 27461*8kB (UEM) 151*16kB (UR) 2*32kB (R) 0*64kB 0*128kB 0*256kB > 0*512kB 0*1024kB 0*2048kB 0*4096kB = 385692kB > Nov 2 09:13:48 krshina3 kernel: [582660.901072] Node 0 > hugepages_total=0 hugepages_free=0 hugepages_surp=0 > hugepages_size=2048kB > Nov 2 09:13:48 krshina3 kernel: [582660.901073] 789766 total pagecache pages > Nov 2 09:13:48 krshina3 kernel: [582660.901075] 2404 pages in swap cache > Nov 2 09:13:48 krshina3 kernel: [582660.901076] Swap cache stats: add > 94924, delete 92520, find 40323/43073 > Nov 2 09:13:48 krshina3 kernel: [582660.901077] Free swap = 261888kB > Nov 2 09:13:48 krshina3 kernel: [582660.901078] Total swap = 594300kB > Nov 2 09:13:48 krshina3 kernel: [582660.901079] 2017164 pages RAM > Nov 2 09:13:48 krshina3 kernel: [582660.901080] 0 pages HighMem/MovableOnly > Nov 2 09:13:48 krshina3 kernel: [582660.901081] 31497 pages reserved > > > Now I'm gonna fsck all partitions and report if anything comes up. > > Ask if you need more info > > Thanks in advance > Dushan -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-11-02 9:55 ` Dušan Čolić @ 2014-11-02 12:08 ` Dušan Čolić 0 siblings, 0 replies; 33+ messages in thread From: Dušan Čolić @ 2014-11-02 12:08 UTC (permalink / raw) To: reiserfs-devel, Edward Shishkin, Ivan Shapovalov Just for nothing I rebooted back to the same 3.16 kernel and remounted 10 times /mnt/backup partition just fine without any problems. Dunno what happens :) On Sun, Nov 2, 2014 at 10:55 AM, Dušan Čolić <dusanc@gmail.com> wrote: > fsck reported no problems on partition, only it lasted pretty long for 60GB FS: > > krshina3 goran # fsck.reiser4 /dev/md125 > ******************************************************************* > This is an EXPERIMENTAL version of fsck.reiser4. Read README first. > ******************************************************************* > > Fscking the /dev/md125 block device. > Will check the consistency of the Reiser4 SuperBlock. > Will check the consistency of the Reiser4 FileSystem. > Continue? > (Yes/No): y > ***** fsck.reiser4 started at Sun Nov 2 09:47:29 2014 > Reiser4 fs was detected on /dev/md125. > Master super block (16): > magic: ReIsEr4 > blksize: 4096 > format: 0x0 (format40) > uuid: 184e9560-bdf9-42b0-896c-0af2a0c84066 > label: <none> > > Format super block (17): > plugin: format40 > description: Disk-format plugin. > version: 0 > magic: ReIsEr40FoRmAt > mkfs id: 0x2a685787 > flushes: 0 > blocks: 17091120 > free blocks: 2686399 > root block: 13259826 > tail policy: 0x2 (smart) > next oid: 0xbbbe1d > file count: 863269 > tree height: 5 > key policy: LARGE > > > CHECKING THE STORAGE TREE > Read nodes 10040995 > Nodes left in the tree 10040995 > Leaves of them 9923653, Twigs of them 115902 > Time interval: Sun Nov 2 09:47:33 2014 - Sun Nov 2 09:58:30 2014 > CHECKING EXTENT REGIONS. > Read twigs 115902 > Time interval: Sun Nov 2 09:58:30 2014 - Sun Nov 2 10:05:43 2014 > CHECKING THE SEMANTIC TREE > Found 2579213 objects (some could be encountered more then > once). > Time interval: Sun Nov 2 10:05:43 2014 - Sun Nov 2 10:53:42 2014 > ***** fsck.reiser4 finished at Sun Nov 2 10:53:42 2014 > Closing fs...done > > FS is consistent. > > On Sun, Nov 2, 2014 at 9:38 AM, Dušan Čolić <dusanc@gmail.com> wrote: >> When I try to mount a cc reiser4 partition (reiser4-for-3.16.2.patch) >> I get: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate >> memory >> Uptime is almost 7 days and mounting of this partition worked every >> day untill last night (I get automated messages on mail when something >> goes wrong). >> >> Now I tried on kernel 3.10 and everything works OK >> >> krshina3 goran # uname -a >> Linux krshina3 3.10.6-gentoo #2 SMP Wed Aug 14 17:33:45 CEST 2013 >> x86_64 Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz GenuineIntel GNU/Linux >> >> krshina3 goran# free -m >> total used free shared buffers cached >> Mem: 7681 6794 887 30 0 2933 >> -/+ buffers/cache: 3860 3821 >> Swap: 580 325 254 >> >> krshina3 goran# cat /etc/fstab | grep -v "#" >> >> /dev/sda1 /boot ext2 noauto,noatime 1 2 >> /dev/md123 none swap sw 0 0 >> /dev/sda2 / reiser4 >> noatime,onerror=remount-ro 0 0 >> /dev/md125 /mnt/backup reiser4 >> noatime,noauto,onerror=remount-ro 0 0 >> /dev/md126 /mnt/media reiser4 >> noatime,users,onerror=remount-ro 0 0 >> /dev/md127 /usr/portage reiser4 >> noatime,onerror=remount-ro 0 0 >> shm /dev/shm tmpfs >> nodev,nosuid,noexec 0 0 >> >> >> krshina3 goran # df >> Filesystem 1K-blocks Used Available Use% Mounted on >> /dev/sda2 37017728 24870384 12147344 68% / >> tmpfs 786872 832 786040 1% /run >> udev 10240 0 10240 0% /dev >> shm 3934340 80 3934260 1% /dev/shm >> /dev/md126 383034100 298007740 85026360 78% /mnt/media >> /dev/md127 6113484 5427288 686196 89% /usr/portage >> /dev/md125 64959612 57618884 7340728 89% /mnt/backup >> >> I get these in logs: >> >> Nov 2 03:30:01 krshina3 kernel: [562035.221513] reiser4: md125: found >> disk format 4.0.0. >> Nov 2 03:30:01 krshina3 kernel: [562035.221749] mount: page >> allocation failure: order:4, mode:0x2040d0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221752] CPU: 0 PID: 517 Comm: >> mount Not tainted 3.16.5-gentoo #1 >> Nov 2 03:30:01 krshina3 kernel: [562035.221753] Hardware name: >> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >> 07/04/2012 >> Nov 2 03:30:01 krshina3 kernel: [562035.221754] 0000000000000000 >> ffff88020ece7968 ffffffff816a31b4 0000000000000007 >> Nov 2 03:30:01 krshina3 kernel: [562035.221757] 00000000002040d0 >> ffff88020ece79f8 ffffffff810e609a ffffffff00000040 >> Nov 2 03:30:01 krshina3 kernel: [562035.221758] 0000000000000286 >> ffffffff819a8a78 fffffff00000000f ffff88020ece79c8 >> Nov 2 03:30:01 krshina3 kernel: [562035.221760] Call Trace: >> Nov 2 03:30:01 krshina3 kernel: [562035.221765] [<ffffffff816a31b4>] >> dump_stack+0x46/0x58 >> Nov 2 03:30:01 krshina3 kernel: [562035.221768] [<ffffffff810e609a>] >> warn_alloc_failed+0xda/0x130 >> Nov 2 03:30:01 krshina3 kernel: [562035.221770] [<ffffffff810e86c9>] >> __alloc_pages_nodemask+0x5d9/0x7a0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221774] [<ffffffff8111f16a>] >> cache_alloc_refill+0x31a/0x550 >> Nov 2 03:30:01 krshina3 kernel: [562035.221776] [<ffffffff8111ee23>] >> kmem_cache_alloc+0xb3/0xe0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221778] [<ffffffff81186529>] >> znodes_tree_init+0xc9/0x120 >> Nov 2 03:30:01 krshina3 kernel: [562035.221781] [<ffffffff8118e7b4>] >> reiser4_init_tree+0x44/0xd0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221784] [<ffffffff811cb905>] >> init_format_format40+0x265/0x5b0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221787] [<ffffffff8119e8b1>] >> fill_super+0x101/0x200 >> Nov 2 03:30:01 krshina3 kernel: [562035.221789] [<ffffffff81126be4>] >> mount_bdev+0x194/0x1d0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221792] [<ffffffff8119e7b0>] >> ? reiser4_mount+0x20/0x20 >> Nov 2 03:30:01 krshina3 kernel: [562035.221794] [<ffffffff8119e7a0>] >> reiser4_mount+0x10/0x20 >> Nov 2 03:30:01 krshina3 kernel: [562035.221796] [<ffffffff81126e2b>] >> mount_fs+0x1b/0xd0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221799] [<ffffffff8114042f>] >> vfs_kern_mount+0x6f/0x130 >> Nov 2 03:30:01 krshina3 kernel: [562035.221801] [<ffffffff81141f68>] >> do_mount+0x218/0xab0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221803] [<ffffffff810e88a2>] >> ? __get_free_pages+0x12/0x60 >> Nov 2 03:30:01 krshina3 kernel: [562035.221805] [<ffffffff81141bf5>] >> ? copy_mount_options+0x35/0x150 >> Nov 2 03:30:01 krshina3 kernel: [562035.221808] [<ffffffff81142ad9>] >> SyS_mount+0x89/0xd0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221811] [<ffffffff816ab1d2>] >> system_call_fastpath+0x16/0x1b >> Nov 2 03:30:01 krshina3 kernel: [562035.221812] Mem-Info: >> Nov 2 03:30:01 krshina3 kernel: [562035.221813] DMA per-cpu: >> Nov 2 03:30:01 krshina3 kernel: [562035.221814] CPU 0: hi: 0, >> btch: 1 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221815] CPU 1: hi: 0, >> btch: 1 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221816] CPU 2: hi: 0, >> btch: 1 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221817] CPU 3: hi: 0, >> btch: 1 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221817] DMA32 per-cpu: >> Nov 2 03:30:01 krshina3 kernel: [562035.221819] CPU 0: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221819] CPU 1: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221820] CPU 2: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221821] CPU 3: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221822] Normal per-cpu: >> Nov 2 03:30:01 krshina3 kernel: [562035.221823] CPU 0: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221824] CPU 1: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221825] CPU 2: hi: 186, >> btch: 31 usd: 56 >> Nov 2 03:30:01 krshina3 kernel: [562035.221826] CPU 3: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221828] active_anon:701641 >> inactive_anon:138699 isolated_anon:0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221828] active_file:399519 >> inactive_file:396920 isolated_file:0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221828] unevictable:0 >> dirty:204 writeback:0 unstable:0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221828] free:155878 >> slab_reclaimable:126123 slab_unreclaimable:9074 >> Nov 2 03:30:01 krshina3 kernel: [562035.221828] mapped:21535 >> shmem:5701 pagetables:10162 bounce:0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221828] free_cma:0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221833] DMA free:15900kB >> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >> all_unreclaimable? yes >> Nov 2 03:30:01 krshina3 kernel: [562035.221834] lowmem_reserve[]: 0 >> 2950 7665 7665 >> Nov 2 03:30:01 krshina3 kernel: [562035.221839] DMA32 free:250180kB >> min:4308kB low:5384kB high:6460kB active_anon:1026572kB >> inactive_anon:257356kB active_file:616152kB inactive_file:612572kB >> unevictable:0kB isolated(anon):0kB isolated(file):0kB >> present:3098560kB managed:3022260kB mlocked:0kB dirty:4kB >> writeback:0kB mapped:33232kB shmem:9336kB slab_reclaimable:180492kB >> slab_unreclaimable:12176kB kernel_stack:2496kB pagetables:16872kB >> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >> all_unreclaimable? no >> Nov 2 03:30:01 krshina3 kernel: [562035.221840] lowmem_reserve[]: 0 0 4714 4714 >> Nov 2 03:30:01 krshina3 kernel: [562035.221844] Normal free:357432kB >> min:6884kB low:8604kB high:10324kB active_anon:1779992kB >> inactive_anon:297440kB active_file:981924kB inactive_file:975108kB >> unevictable:0kB isolated(anon):0kB isolated(file):0kB >> present:4954112kB managed:4828124kB mlocked:0kB dirty:812kB >> writeback:0kB mapped:52908kB shmem:13468kB slab_reclaimable:324000kB >> slab_unreclaimable:24120kB kernel_stack:4160kB pagetables:23776kB >> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB >> pages_scanned:24 all_unreclaimable? no >> Nov 2 03:30:01 krshina3 kernel: [562035.221845] lowmem_reserve[]: 0 0 0 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221847] DMA: 1*4kB (U) 1*8kB >> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >> Nov 2 03:30:01 krshina3 kernel: [562035.221855] DMA32: 52520*4kB >> (UEM) 5030*8kB (UE) 3*16kB (UR) 0*32kB 1*64kB (R) 0*128kB 0*256kB >> 0*512kB 0*1024kB 0*2048kB 0*4096kB = 250432kB >> Nov 2 03:30:01 krshina3 kernel: [562035.221861] Normal: 62961*4kB >> (UEM) 11874*8kB (UEM) 640*16kB (UEMR) 17*32kB (UEMR) 1*64kB (E) >> 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 357684kB >> Nov 2 03:30:01 krshina3 kernel: [562035.221867] Node 0 >> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >> hugepages_size=2048kB >> Nov 2 03:30:01 krshina3 kernel: [562035.221868] 804788 total pagecache pages >> Nov 2 03:30:01 krshina3 kernel: [562035.221869] 2600 pages in swap cache >> Nov 2 03:30:01 krshina3 kernel: [562035.221870] Swap cache stats: add >> 91111, delete 88511, find 38599/41340 >> Nov 2 03:30:01 krshina3 kernel: [562035.221871] Free swap = 277028kB >> Nov 2 03:30:01 krshina3 kernel: [562035.221872] Total swap = 594300kB >> Nov 2 03:30:01 krshina3 kernel: [562035.221873] 2017164 pages RAM >> Nov 2 03:30:01 krshina3 kernel: [562035.221873] 0 pages HighMem/MovableOnly >> Nov 2 03:30:01 krshina3 kernel: [562035.221874] 31497 pages reserved >> >> >> >> >> Nov 2 09:13:48 krshina3 kernel: [582660.900521] reiser4: md125: found >> disk format 4.0.0. >> Nov 2 09:13:48 krshina3 kernel: [582660.900907] mount: page >> allocation failure: order:4, mode:0x2040d0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900910] CPU: 1 PID: 1414 >> Comm: mount Not tainted 3.16.5-gentoo #1 >> Nov 2 09:13:48 krshina3 kernel: [582660.900912] Hardware name: >> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >> 07/04/2012 >> Nov 2 09:13:48 krshina3 kernel: [582660.900914] 0000000000000000 >> ffff880148093968 ffffffff816a31b4 0000000000000007 >> Nov 2 09:13:48 krshina3 kernel: [582660.900917] 00000000002040d0 >> ffff8801480939f8 ffffffff810e609a ffffffff00000040 >> Nov 2 09:13:48 krshina3 kernel: [582660.900919] 0000000000000286 >> ffffffff819a8a78 fffffff00000000f ffff8801480939c8 >> Nov 2 09:13:48 krshina3 kernel: [582660.900922] Call Trace: >> Nov 2 09:13:48 krshina3 kernel: [582660.900929] [<ffffffff816a31b4>] >> dump_stack+0x46/0x58 >> Nov 2 09:13:48 krshina3 kernel: [582660.900933] [<ffffffff810e609a>] >> warn_alloc_failed+0xda/0x130 >> Nov 2 09:13:48 krshina3 kernel: [582660.900937] [<ffffffff810e86c9>] >> __alloc_pages_nodemask+0x5d9/0x7a0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900941] [<ffffffff8111f16a>] >> cache_alloc_refill+0x31a/0x550 >> Nov 2 09:13:48 krshina3 kernel: [582660.900945] [<ffffffff8111ee23>] >> kmem_cache_alloc+0xb3/0xe0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900948] [<ffffffff81186529>] >> znodes_tree_init+0xc9/0x120 >> Nov 2 09:13:48 krshina3 kernel: [582660.900951] [<ffffffff8118e7b4>] >> reiser4_init_tree+0x44/0xd0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900955] [<ffffffff811cb905>] >> init_format_format40+0x265/0x5b0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900959] [<ffffffff8119e8b1>] >> fill_super+0x101/0x200 >> Nov 2 09:13:48 krshina3 kernel: [582660.900963] [<ffffffff81126be4>] >> mount_bdev+0x194/0x1d0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900966] [<ffffffff8119e7b0>] >> ? reiser4_mount+0x20/0x20 >> Nov 2 09:13:48 krshina3 kernel: [582660.900969] [<ffffffff8119e7a0>] >> reiser4_mount+0x10/0x20 >> Nov 2 09:13:48 krshina3 kernel: [582660.900972] [<ffffffff81126e2b>] >> mount_fs+0x1b/0xd0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900976] [<ffffffff8114042f>] >> vfs_kern_mount+0x6f/0x130 >> Nov 2 09:13:48 krshina3 kernel: [582660.900979] [<ffffffff81141f68>] >> do_mount+0x218/0xab0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900982] [<ffffffff810e88a2>] >> ? __get_free_pages+0x12/0x60 >> Nov 2 09:13:48 krshina3 kernel: [582660.900986] [<ffffffff81141bf5>] >> ? copy_mount_options+0x35/0x150 >> Nov 2 09:13:48 krshina3 kernel: [582660.900989] [<ffffffff81142ad9>] >> SyS_mount+0x89/0xd0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900993] [<ffffffff816ab1d2>] >> system_call_fastpath+0x16/0x1b >> Nov 2 09:13:48 krshina3 kernel: [582660.900994] Mem-Info: >> Nov 2 09:13:48 krshina3 kernel: [582660.900996] DMA per-cpu: >> Nov 2 09:13:48 krshina3 kernel: [582660.900997] CPU 0: hi: 0, >> btch: 1 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900999] CPU 1: hi: 0, >> btch: 1 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901000] CPU 2: hi: 0, >> btch: 1 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901001] CPU 3: hi: 0, >> btch: 1 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901002] DMA32 per-cpu: >> Nov 2 09:13:48 krshina3 kernel: [582660.901004] CPU 0: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901005] CPU 1: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901006] CPU 2: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901008] CPU 3: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901009] Normal per-cpu: >> Nov 2 09:13:48 krshina3 kernel: [582660.901010] CPU 0: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901011] CPU 1: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901013] CPU 2: hi: 186, >> btch: 31 usd: 21 >> Nov 2 09:13:48 krshina3 kernel: [582660.901014] CPU 3: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901017] active_anon:719713 >> inactive_anon:145280 isolated_anon:0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901017] active_file:390035 >> inactive_file:389999 isolated_file:0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901017] unevictable:0 >> dirty:1180 writeback:0 unstable:0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901017] free:161223 >> slab_reclaimable:112227 slab_unreclaimable:9155 >> Nov 2 09:13:48 krshina3 kernel: [582660.901017] mapped:35966 >> shmem:7263 pagetables:10549 bounce:0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901017] free_cma:0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901024] DMA free:15900kB >> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >> all_unreclaimable? yes >> Nov 2 09:13:48 krshina3 kernel: [582660.901026] lowmem_reserve[]: 0 >> 2950 7665 7665 >> Nov 2 09:13:48 krshina3 kernel: [582660.901033] DMA32 free:243456kB >> min:4308kB low:5384kB high:6460kB active_anon:1055312kB >> inactive_anon:268364kB active_file:605480kB inactive_file:605344kB >> unevictable:0kB isolated(anon):0kB isolated(file):0kB >> present:3098560kB managed:3022260kB mlocked:0kB dirty:1728kB >> writeback:0kB mapped:55944kB shmem:11860kB slab_reclaimable:164900kB >> slab_unreclaimable:12340kB kernel_stack:2496kB pagetables:17284kB >> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >> all_unreclaimable? no >> Nov 2 09:13:48 krshina3 kernel: [582660.901034] lowmem_reserve[]: 0 0 4714 4714 >> Nov 2 09:13:48 krshina3 kernel: [582660.901040] Normal free:385536kB >> min:6884kB low:8604kB high:10324kB active_anon:1823540kB >> inactive_anon:312756kB active_file:954660kB inactive_file:954652kB >> unevictable:0kB isolated(anon):0kB isolated(file):0kB >> present:4954112kB managed:4828124kB mlocked:0kB dirty:2992kB >> writeback:0kB mapped:87920kB shmem:17192kB slab_reclaimable:284008kB >> slab_unreclaimable:24280kB kernel_stack:4368kB pagetables:24912kB >> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB >> pages_scanned:21 all_unreclaimable? no >> Nov 2 09:13:48 krshina3 kernel: [582660.901041] lowmem_reserve[]: 0 0 0 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901044] DMA: 1*4kB (U) 1*8kB >> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >> Nov 2 09:13:48 krshina3 kernel: [582660.901054] DMA32: 46552*4kB (UE) >> 7159*8kB (U) 2*16kB (R) 0*32kB 1*64kB (R) 0*128kB 0*256kB 0*512kB >> 0*1024kB 0*2048kB 0*4096kB = 243576kB >> Nov 2 09:13:48 krshina3 kernel: [582660.901063] Normal: 40881*4kB >> (UEM) 27461*8kB (UEM) 151*16kB (UR) 2*32kB (R) 0*64kB 0*128kB 0*256kB >> 0*512kB 0*1024kB 0*2048kB 0*4096kB = 385692kB >> Nov 2 09:13:48 krshina3 kernel: [582660.901072] Node 0 >> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >> hugepages_size=2048kB >> Nov 2 09:13:48 krshina3 kernel: [582660.901073] 789766 total pagecache pages >> Nov 2 09:13:48 krshina3 kernel: [582660.901075] 2404 pages in swap cache >> Nov 2 09:13:48 krshina3 kernel: [582660.901076] Swap cache stats: add >> 94924, delete 92520, find 40323/43073 >> Nov 2 09:13:48 krshina3 kernel: [582660.901077] Free swap = 261888kB >> Nov 2 09:13:48 krshina3 kernel: [582660.901078] Total swap = 594300kB >> Nov 2 09:13:48 krshina3 kernel: [582660.901079] 2017164 pages RAM >> Nov 2 09:13:48 krshina3 kernel: [582660.901080] 0 pages HighMem/MovableOnly >> Nov 2 09:13:48 krshina3 kernel: [582660.901081] 31497 pages reserved >> >> >> Now I'm gonna fsck all partitions and report if anything comes up. >> >> Ask if you need more info >> >> Thanks in advance >> Dushan -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
[parent not found: <CADW=+3ms6zaqzpkRBEgApi=gkMNPLCzzex8ShK4CkCFD-WNk8Q@mail.gmail.com>]
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory [not found] ` <CADW=+3ms6zaqzpkRBEgApi=gkMNPLCzzex8ShK4CkCFD-WNk8Q@mail.gmail.com> @ 2014-11-03 11:11 ` Dušan Čolić [not found] ` <5457629C.8040906@gmail.com> 1 sibling, 0 replies; 33+ messages in thread From: Dušan Čolić @ 2014-11-03 11:11 UTC (permalink / raw) To: reiserfs-devel, Edward Shishkin, Ivan Shapovalov And just now I saw in logs that machine crashed some after starting that rsync job at 3:30AM All I have in logs is: Nov 3 03:30:01 krshina3 cron[32611]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons ) Nov 3 03:30:01 krshina3 run-crons[32620]: (root) CMD (/etc/cron.daily/logrotate) Nov 3 06:33:08 krshina3 syslog-ng[2482]: syslog-ng starting up; version='3.4.8' Nov 3 06:33:08 kernel: [ 0.000000] Initializing cgroup subsys cpu That's the user restarting the crashed machine in 06:33 in the morning. Log should look like this: Oct 31 03:30:01 krshina3 cron[25344]: (root) CMD (test -x /usr/sbin/run-crons && /usr/sbin/run-crons ) Oct 31 03:30:01 krshina3 run-crons[25353]: (root) CMD (/etc/cron.daily/logrotate) Oct 31 03:30:01 krshina3 run-crons[25357]: (root) CMD (/etc/cron.daily/makewhatis) Oct 31 03:30:01 krshina3 run-crons[25412]: (root) CMD (/etc/cron.daily/prelink) Oct 31 03:30:11 krshina3 run-crons[27772]: (root) CMD (/etc/cron.daily/rsnapshot.daily) Oct 31 03:30:11 krshina3 kernel: [389256.309611] reiser4: md125: found disk format 4.0.0. Oct 31 03:30:14 krshina3 kernel: [389259.561553] reiser4: md125: using Hybrid Transaction Model. Oct 31 03:31:26 krshina3 logger: ### RSNAPSHOT DAILY OK### Oct 31 03:31:27 krshina3 sSMTP[27777]: Sent mail for ********** (221 ***********) uid=0 username=root outbytes=669 On Mon, Nov 3, 2014 at 11:58 AM, Dušan Čolić <dusanc@gmail.com> wrote: > Now a Bug happened to me on this same ccreg40 partition with > Reiser4-for-3.16.2.patch and I don't know if it's related. > I have a partition that I use for daily, weekly and monthly snapshots - > /dev/md125 with rsnapshot. > I fsck-ed it yesterday. After mounting rsync starts and snapshots my /home > directory. This Bug happened on rsync start. > > > rsnapshot log: > fsck.reiser4 /dev/md125 > rsync: writefd_unbuffered failed to write 5 bytes to socket [generator]: > Broken pipe (32) > rsync error: error in rsync protocol data stream (code 12) at io.c(1532) > [generator=3.0.9] > ------------------------------ > ---------------------------------------------- > rsnapshot encountered an error! The program was invoked with these options: > /usr/bin/rsnapshot -c /etc/rsnapshot.d/daily.conf daily > ---------------------------------------------------------------------------- > ERROR: /usr/bin/rsync returned 0.04296875 while processing /home/ > WARNING: Rolling back "localhost/" > Backup failure > > daily.conf: > include_conf /etc/rsnapshot.d/base.conf > > # Daily (30 increments) > interval daily 30 > backup /home/ localhost/ > exclude /home/windows.qcow2 > > base.conf: > > # Default config version > config_version 1.2 > > # So the hard disk is not polluted in case the backup filesystem is not > available > no_create_root 1 > > # Standard settings > cmd_cp /bin/cp > cmd_rm /bin/rm > cmd_rsync /usr/bin/rsync > link_dest 1 > cmd_rsnapshot_diff /usr/bin/rsnapshot-diff > > # For convenience, so that mount points can be taken as backup starting > points > one_fs 1 > > # Store all backups in one directory per machine > # A useful alternative may be to create a separate directory for each > interval > snapshot_root /mnt/backup/ > > Logs: > Nov 3 07:00:10 krshina3 kernel: [ 1650.974059] reiser4: md125: found disk > format 4.0.0. > Nov 3 07:00:13 krshina3 kernel: [ 1654.207021] reiser4: md125: using Hybrid > Transaction Model. > Nov 3 07:00:52 krshina3 kernel: [ 1692.914414] ------------[ cut here > ]------------ > Nov 3 07:00:52 krshina3 kernel: [ 1692.914682] kernel BUG at > fs/reiser4/plugin/item/ctail.c:669! > Nov 3 07:00:52 krshina3 kernel: [ 1692.915010] invalid opcode: 0000 [#1] > SMP > Nov 3 07:00:52 krshina3 kernel: [ 1692.915259] CPU: 0 PID: 4950 Comm: rsync > Not tainted 3.16.5-gentoo #1 > Nov 3 07:00:52 krshina3 kernel: [ 1692.915625] Hardware name: Gigabyte > Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 07/04/2012 > Nov 3 07:00:52 krshina3 kernel: [ 1692.916183] task: ffff88022d3f17d0 ti: > ffff880100004000 task.ti: ffff880100004000 > Nov 3 07:00:52 krshina3 kernel: [ 1692.916610] RIP: > 0010:[<ffffffff811c3a70>] [<ffffffff811c3a70>] > do_readpage_ctail+0x2c0/0x420 > Nov 3 07:00:52 krshina3 kernel: [ 1692.917111] RSP: 0018:ffff880100007978 > EFLAGS: 00010246 > Nov 3 07:00:52 krshina3 kernel: [ 1692.917412] RAX: 8000000000000025 RBX: > ffffea0004570218 RCX: ffff8800b94f0800 > Nov 3 07:00:52 krshina3 kernel: [ 1692.917819] RDX: 0000000000000035 RSI: > 0000000000000000 RDI: ffff8800b94f0000 > Nov 3 07:00:52 krshina3 kernel: [ 1692.918226] RBP: ffff8801000079b8 R08: > 0000000000001000 R09: 0000000000000001 > Nov 3 07:00:52 krshina3 kernel: [ 1692.918632] R10: ffffffff811b3fc0 R11: > ffffea00023f1330 R12: 0000000000000002 > Nov 3 07:00:52 krshina3 kernel: [ 1692.919039] R13: ffff8801ebb78d20 R14: > ffff880100007a88 R15: 0000000000000001 > Nov 3 07:00:52 krshina3 kernel: [ 1692.919450] FS: 00007f4d6b27c700(0000) > GS:ffff88022e200000(0000) knlGS:0000000000000000 > Nov 3 07:00:52 krshina3 kernel: [ 1692.919912] CS: 0010 DS: 0000 ES: 0000 > CR0: 0000000080050033 > Nov 3 07:00:52 krshina3 kernel: [ 1692.920239] CR2: 0000000003035ddf CR3: > 0000000008a76000 CR4: 00000000001427e0 > Nov 3 07:00:52 krshina3 kernel: [ 1692.920645] Stack: > Nov 3 07:00:52 krshina3 kernel: [ 1692.920756] ffff8801000079b8 > ffffffff811b5c4f ffffea0004570218 ffff880100007a88 > Nov 3 07:00:52 krshina3 kernel: [ 1692.921200] ffffea0004570218 > 0000000000000000 ffff8801ebb78d20 ffffffff811c3bd0 > Nov 3 07:00:52 krshina3 kernel: [ 1692.921643] ffff880100007a08 > ffffffff811c3cea ffff880100007a08 00000000810e1785 > Nov 3 07:00:52 krshina3 kernel: [ 1692.922087] Call Trace: > Nov 3 07:00:52 krshina3 kernel: [ 1692.922226] [<ffffffff811b5c4f>] ? > prepare_page_cluster+0xff/0x1f0 > Nov 3 07:00:52 krshina3 kernel: [ 1692.922583] [<ffffffff811c3bd0>] ? > do_readpage_ctail+0x420/0x420 > Nov 3 07:00:52 krshina3 kernel: [ 1692.922931] [<ffffffff811c3cea>] > ctail_readpages_filler+0x11a/0x220 > Nov 3 07:00:52 krshina3 kernel: [ 1692.923299] [<ffffffff811c3bd0>] ? > do_readpage_ctail+0x420/0x420 > Nov 3 07:00:52 krshina3 kernel: [ 1692.923646] [<ffffffff810ebdfa>] > read_cache_pages+0xba/0x120 > Nov 3 07:00:52 krshina3 kernel: [ 1692.923973] [<ffffffff811c4073>] > readpages_ctail+0x133/0x360 > Nov 3 07:00:52 krshina3 kernel: [ 1692.924299] [<ffffffff811b7e76>] > readpages_cryptcompress+0x46/0x80 > Nov 3 07:00:52 krshina3 kernel: [ 1692.924656] [<ffffffff811a2b8e>] > reiser4_readpages_dispatch+0x3e/0x50 > Nov 3 07:00:52 krshina3 kernel: [ 1692.925029] [<ffffffff810ec009>] > __do_page_cache_readahead+0x1a9/0x240 > Nov 3 07:00:52 krshina3 kernel: [ 1692.925407] [<ffffffff810ec1f7>] > ondemand_readahead+0x157/0x290 > Nov 3 07:00:52 krshina3 kernel: [ 1692.925749] [<ffffffff810e2326>] ? > pagecache_get_page+0x36/0x1e0 > Nov 3 07:00:52 krshina3 kernel: [ 1692.926097] [<ffffffff810ec41e>] > page_cache_sync_readahead+0x2e/0x50 > Nov 3 07:00:52 krshina3 kernel: [ 1692.926464] [<ffffffff810e33e9>] > generic_file_read_iter+0x409/0x5f0 > Nov 3 07:00:52 krshina3 kernel: [ 1692.926827] [<ffffffff8112da8e>] ? > link_path_walk+0x26e/0x880 > Nov 3 07:00:52 krshina3 kernel: [ 1692.927160] [<ffffffff81122b49>] > new_sync_read+0x79/0xb0 > Nov 3 07:00:52 krshina3 kernel: [ 1692.927470] [<ffffffff811b7f23>] > read_cryptcompress+0x73/0xb0 > Nov 3 07:00:52 krshina3 kernel: [ 1692.927803] [<ffffffff811b21c2>] > reiser4_read_dispatch+0x72/0x160 > Nov 3 07:00:52 krshina3 kernel: [ 1692.928156] [<ffffffff81123abb>] > vfs_read+0x9b/0x190 > Nov 3 07:00:52 krshina3 kernel: [ 1692.928443] [<ffffffff8112408a>] > SyS_read+0x4a/0xc0 > Nov 3 07:00:52 krshina3 kernel: [ 1692.928726] [<ffffffff816ab1d2>] > system_call_fastpath+0x16/0x1b > Nov 3 07:00:52 krshina3 kernel: [ 1692.929068] Code: fe ff ff 0f 1f 84 00 > 00 00 00 00 48 89 df e8 a8 e4 f1 ff e9 3c fe ff ff 0f 1f 00 48 89 df e8 98 > e4 f1 ff e9 73 fe ff ff 0f 1f 00 <0f> 0b 48 8b 03 a8 08 0f 84 a1 00 00 00 49 > 8b be 80 00 00 00 e8 > Nov 3 07:00:52 krshina3 kernel: [ 1692.930505] RIP [<ffffffff811c3a70>] > do_readpage_ctail+0x2c0/0x420 > Nov 3 07:00:52 krshina3 kernel: [ 1692.930868] RSP <ffff880100007978> > Nov 3 07:00:52 krshina3 kernel: [ 1693.043372] ---[ end trace > 36e8590f8aa347d3 ]--- > > On Sun, Nov 2, 2014 at 9:38 AM, Dušan Čolić <dusanc@gmail.com> wrote: >> >> When I try to mount a cc reiser4 partition (reiser4-for-3.16.2.patch) >> I get: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate >> memory >> Uptime is almost 7 days and mounting of this partition worked every >> day untill last night (I get automated messages on mail when something >> goes wrong). >> >> Now I tried on kernel 3.10 and everything works OK >> >> krshina3 goran # uname -a >> Linux krshina3 3.10.6-gentoo #2 SMP Wed Aug 14 17:33:45 CEST 2013 >> x86_64 Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz GenuineIntel GNU/Linux >> >> krshina3 goran# free -m >> total used free shared buffers cached >> Mem: 7681 6794 887 30 0 2933 >> -/+ buffers/cache: 3860 3821 >> Swap: 580 325 254 >> >> krshina3 goran# cat /etc/fstab | grep -v "#" >> >> /dev/sda1 /boot ext2 noauto,noatime 1 >> 2 >> /dev/md123 none swap sw 0 >> 0 >> /dev/sda2 / reiser4 >> noatime,onerror=remount-ro 0 0 >> /dev/md125 /mnt/backup reiser4 >> noatime,noauto,onerror=remount-ro 0 0 >> /dev/md126 /mnt/media reiser4 >> noatime,users,onerror=remount-ro 0 0 >> /dev/md127 /usr/portage reiser4 >> noatime,onerror=remount-ro 0 0 >> shm /dev/shm tmpfs >> nodev,nosuid,noexec 0 0 >> >> >> krshina3 goran # df >> Filesystem 1K-blocks Used Available Use% Mounted on >> /dev/sda2 37017728 24870384 12147344 68% / >> tmpfs 786872 832 786040 1% /run >> udev 10240 0 10240 0% /dev >> shm 3934340 80 3934260 1% /dev/shm >> /dev/md126 383034100 298007740 85026360 78% /mnt/media >> /dev/md127 6113484 5427288 686196 89% /usr/portage >> /dev/md125 64959612 57618884 7340728 89% /mnt/backup >> >> I get these in logs: >> >> Nov 2 03:30:01 krshina3 kernel: [562035.221513] reiser4: md125: found >> disk format 4.0.0. >> Nov 2 03:30:01 krshina3 kernel: [562035.221749] mount: page >> allocation failure: order:4, mode:0x2040d0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221752] CPU: 0 PID: 517 Comm: >> mount Not tainted 3.16.5-gentoo #1 >> Nov 2 03:30:01 krshina3 kernel: [562035.221753] Hardware name: >> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >> 07/04/2012 >> Nov 2 03:30:01 krshina3 kernel: [562035.221754] 0000000000000000 >> ffff88020ece7968 ffffffff816a31b4 0000000000000007 >> Nov 2 03:30:01 krshina3 kernel: [562035.221757] 00000000002040d0 >> ffff88020ece79f8 ffffffff810e609a ffffffff00000040 >> Nov 2 03:30:01 krshina3 kernel: [562035.221758] 0000000000000286 >> ffffffff819a8a78 fffffff00000000f ffff88020ece79c8 >> Nov 2 03:30:01 krshina3 kernel: [562035.221760] Call Trace: >> Nov 2 03:30:01 krshina3 kernel: [562035.221765] [<ffffffff816a31b4>] >> dump_stack+0x46/0x58 >> Nov 2 03:30:01 krshina3 kernel: [562035.221768] [<ffffffff810e609a>] >> warn_alloc_failed+0xda/0x130 >> Nov 2 03:30:01 krshina3 kernel: [562035.221770] [<ffffffff810e86c9>] >> __alloc_pages_nodemask+0x5d9/0x7a0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221774] [<ffffffff8111f16a>] >> cache_alloc_refill+0x31a/0x550 >> Nov 2 03:30:01 krshina3 kernel: [562035.221776] [<ffffffff8111ee23>] >> kmem_cache_alloc+0xb3/0xe0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221778] [<ffffffff81186529>] >> znodes_tree_init+0xc9/0x120 >> Nov 2 03:30:01 krshina3 kernel: [562035.221781] [<ffffffff8118e7b4>] >> reiser4_init_tree+0x44/0xd0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221784] [<ffffffff811cb905>] >> init_format_format40+0x265/0x5b0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221787] [<ffffffff8119e8b1>] >> fill_super+0x101/0x200 >> Nov 2 03:30:01 krshina3 kernel: [562035.221789] [<ffffffff81126be4>] >> mount_bdev+0x194/0x1d0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221792] [<ffffffff8119e7b0>] >> ? reiser4_mount+0x20/0x20 >> Nov 2 03:30:01 krshina3 kernel: [562035.221794] [<ffffffff8119e7a0>] >> reiser4_mount+0x10/0x20 >> Nov 2 03:30:01 krshina3 kernel: [562035.221796] [<ffffffff81126e2b>] >> mount_fs+0x1b/0xd0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221799] [<ffffffff8114042f>] >> vfs_kern_mount+0x6f/0x130 >> Nov 2 03:30:01 krshina3 kernel: [562035.221801] [<ffffffff81141f68>] >> do_mount+0x218/0xab0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221803] [<ffffffff810e88a2>] >> ? __get_free_pages+0x12/0x60 >> Nov 2 03:30:01 krshina3 kernel: [562035.221805] [<ffffffff81141bf5>] >> ? copy_mount_options+0x35/0x150 >> Nov 2 03:30:01 krshina3 kernel: [562035.221808] [<ffffffff81142ad9>] >> SyS_mount+0x89/0xd0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221811] [<ffffffff816ab1d2>] >> system_call_fastpath+0x16/0x1b >> Nov 2 03:30:01 krshina3 kernel: [562035.221812] Mem-Info: >> Nov 2 03:30:01 krshina3 kernel: [562035.221813] DMA per-cpu: >> Nov 2 03:30:01 krshina3 kernel: [562035.221814] CPU 0: hi: 0, >> btch: 1 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221815] CPU 1: hi: 0, >> btch: 1 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221816] CPU 2: hi: 0, >> btch: 1 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221817] CPU 3: hi: 0, >> btch: 1 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221817] DMA32 per-cpu: >> Nov 2 03:30:01 krshina3 kernel: [562035.221819] CPU 0: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221819] CPU 1: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221820] CPU 2: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221821] CPU 3: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221822] Normal per-cpu: >> Nov 2 03:30:01 krshina3 kernel: [562035.221823] CPU 0: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221824] CPU 1: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221825] CPU 2: hi: 186, >> btch: 31 usd: 56 >> Nov 2 03:30:01 krshina3 kernel: [562035.221826] CPU 3: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221828] active_anon:701641 >> inactive_anon:138699 isolated_anon:0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221828] active_file:399519 >> inactive_file:396920 isolated_file:0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221828] unevictable:0 >> dirty:204 writeback:0 unstable:0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221828] free:155878 >> slab_reclaimable:126123 slab_unreclaimable:9074 >> Nov 2 03:30:01 krshina3 kernel: [562035.221828] mapped:21535 >> shmem:5701 pagetables:10162 bounce:0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221828] free_cma:0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221833] DMA free:15900kB >> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >> all_unreclaimable? yes >> Nov 2 03:30:01 krshina3 kernel: [562035.221834] lowmem_reserve[]: 0 >> 2950 7665 7665 >> Nov 2 03:30:01 krshina3 kernel: [562035.221839] DMA32 free:250180kB >> min:4308kB low:5384kB high:6460kB active_anon:1026572kB >> inactive_anon:257356kB active_file:616152kB inactive_file:612572kB >> unevictable:0kB isolated(anon):0kB isolated(file):0kB >> present:3098560kB managed:3022260kB mlocked:0kB dirty:4kB >> writeback:0kB mapped:33232kB shmem:9336kB slab_reclaimable:180492kB >> slab_unreclaimable:12176kB kernel_stack:2496kB pagetables:16872kB >> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >> all_unreclaimable? no >> Nov 2 03:30:01 krshina3 kernel: [562035.221840] lowmem_reserve[]: 0 0 >> 4714 4714 >> Nov 2 03:30:01 krshina3 kernel: [562035.221844] Normal free:357432kB >> min:6884kB low:8604kB high:10324kB active_anon:1779992kB >> inactive_anon:297440kB active_file:981924kB inactive_file:975108kB >> unevictable:0kB isolated(anon):0kB isolated(file):0kB >> present:4954112kB managed:4828124kB mlocked:0kB dirty:812kB >> writeback:0kB mapped:52908kB shmem:13468kB slab_reclaimable:324000kB >> slab_unreclaimable:24120kB kernel_stack:4160kB pagetables:23776kB >> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB >> pages_scanned:24 all_unreclaimable? no >> Nov 2 03:30:01 krshina3 kernel: [562035.221845] lowmem_reserve[]: 0 0 0 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221847] DMA: 1*4kB (U) 1*8kB >> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >> Nov 2 03:30:01 krshina3 kernel: [562035.221855] DMA32: 52520*4kB >> (UEM) 5030*8kB (UE) 3*16kB (UR) 0*32kB 1*64kB (R) 0*128kB 0*256kB >> 0*512kB 0*1024kB 0*2048kB 0*4096kB = 250432kB >> Nov 2 03:30:01 krshina3 kernel: [562035.221861] Normal: 62961*4kB >> (UEM) 11874*8kB (UEM) 640*16kB (UEMR) 17*32kB (UEMR) 1*64kB (E) >> 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 357684kB >> Nov 2 03:30:01 krshina3 kernel: [562035.221867] Node 0 >> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >> hugepages_size=2048kB >> Nov 2 03:30:01 krshina3 kernel: [562035.221868] 804788 total pagecache >> pages >> Nov 2 03:30:01 krshina3 kernel: [562035.221869] 2600 pages in swap cache >> Nov 2 03:30:01 krshina3 kernel: [562035.221870] Swap cache stats: add >> 91111, delete 88511, find 38599/41340 >> Nov 2 03:30:01 krshina3 kernel: [562035.221871] Free swap = 277028kB >> Nov 2 03:30:01 krshina3 kernel: [562035.221872] Total swap = 594300kB >> Nov 2 03:30:01 krshina3 kernel: [562035.221873] 2017164 pages RAM >> Nov 2 03:30:01 krshina3 kernel: [562035.221873] 0 pages >> HighMem/MovableOnly >> Nov 2 03:30:01 krshina3 kernel: [562035.221874] 31497 pages reserved >> >> >> >> >> Nov 2 09:13:48 krshina3 kernel: [582660.900521] reiser4: md125: found >> disk format 4.0.0. >> Nov 2 09:13:48 krshina3 kernel: [582660.900907] mount: page >> allocation failure: order:4, mode:0x2040d0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900910] CPU: 1 PID: 1414 >> Comm: mount Not tainted 3.16.5-gentoo #1 >> Nov 2 09:13:48 krshina3 kernel: [582660.900912] Hardware name: >> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >> 07/04/2012 >> Nov 2 09:13:48 krshina3 kernel: [582660.900914] 0000000000000000 >> ffff880148093968 ffffffff816a31b4 0000000000000007 >> Nov 2 09:13:48 krshina3 kernel: [582660.900917] 00000000002040d0 >> ffff8801480939f8 ffffffff810e609a ffffffff00000040 >> Nov 2 09:13:48 krshina3 kernel: [582660.900919] 0000000000000286 >> ffffffff819a8a78 fffffff00000000f ffff8801480939c8 >> Nov 2 09:13:48 krshina3 kernel: [582660.900922] Call Trace: >> Nov 2 09:13:48 krshina3 kernel: [582660.900929] [<ffffffff816a31b4>] >> dump_stack+0x46/0x58 >> Nov 2 09:13:48 krshina3 kernel: [582660.900933] [<ffffffff810e609a>] >> warn_alloc_failed+0xda/0x130 >> Nov 2 09:13:48 krshina3 kernel: [582660.900937] [<ffffffff810e86c9>] >> __alloc_pages_nodemask+0x5d9/0x7a0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900941] [<ffffffff8111f16a>] >> cache_alloc_refill+0x31a/0x550 >> Nov 2 09:13:48 krshina3 kernel: [582660.900945] [<ffffffff8111ee23>] >> kmem_cache_alloc+0xb3/0xe0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900948] [<ffffffff81186529>] >> znodes_tree_init+0xc9/0x120 >> Nov 2 09:13:48 krshina3 kernel: [582660.900951] [<ffffffff8118e7b4>] >> reiser4_init_tree+0x44/0xd0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900955] [<ffffffff811cb905>] >> init_format_format40+0x265/0x5b0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900959] [<ffffffff8119e8b1>] >> fill_super+0x101/0x200 >> Nov 2 09:13:48 krshina3 kernel: [582660.900963] [<ffffffff81126be4>] >> mount_bdev+0x194/0x1d0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900966] [<ffffffff8119e7b0>] >> ? reiser4_mount+0x20/0x20 >> Nov 2 09:13:48 krshina3 kernel: [582660.900969] [<ffffffff8119e7a0>] >> reiser4_mount+0x10/0x20 >> Nov 2 09:13:48 krshina3 kernel: [582660.900972] [<ffffffff81126e2b>] >> mount_fs+0x1b/0xd0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900976] [<ffffffff8114042f>] >> vfs_kern_mount+0x6f/0x130 >> Nov 2 09:13:48 krshina3 kernel: [582660.900979] [<ffffffff81141f68>] >> do_mount+0x218/0xab0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900982] [<ffffffff810e88a2>] >> ? __get_free_pages+0x12/0x60 >> Nov 2 09:13:48 krshina3 kernel: [582660.900986] [<ffffffff81141bf5>] >> ? copy_mount_options+0x35/0x150 >> Nov 2 09:13:48 krshina3 kernel: [582660.900989] [<ffffffff81142ad9>] >> SyS_mount+0x89/0xd0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900993] [<ffffffff816ab1d2>] >> system_call_fastpath+0x16/0x1b >> Nov 2 09:13:48 krshina3 kernel: [582660.900994] Mem-Info: >> Nov 2 09:13:48 krshina3 kernel: [582660.900996] DMA per-cpu: >> Nov 2 09:13:48 krshina3 kernel: [582660.900997] CPU 0: hi: 0, >> btch: 1 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900999] CPU 1: hi: 0, >> btch: 1 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901000] CPU 2: hi: 0, >> btch: 1 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901001] CPU 3: hi: 0, >> btch: 1 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901002] DMA32 per-cpu: >> Nov 2 09:13:48 krshina3 kernel: [582660.901004] CPU 0: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901005] CPU 1: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901006] CPU 2: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901008] CPU 3: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901009] Normal per-cpu: >> Nov 2 09:13:48 krshina3 kernel: [582660.901010] CPU 0: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901011] CPU 1: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901013] CPU 2: hi: 186, >> btch: 31 usd: 21 >> Nov 2 09:13:48 krshina3 kernel: [582660.901014] CPU 3: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901017] active_anon:719713 >> inactive_anon:145280 isolated_anon:0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901017] active_file:390035 >> inactive_file:389999 isolated_file:0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901017] unevictable:0 >> dirty:1180 writeback:0 unstable:0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901017] free:161223 >> slab_reclaimable:112227 slab_unreclaimable:9155 >> Nov 2 09:13:48 krshina3 kernel: [582660.901017] mapped:35966 >> shmem:7263 pagetables:10549 bounce:0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901017] free_cma:0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901024] DMA free:15900kB >> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >> all_unreclaimable? yes >> Nov 2 09:13:48 krshina3 kernel: [582660.901026] lowmem_reserve[]: 0 >> 2950 7665 7665 >> Nov 2 09:13:48 krshina3 kernel: [582660.901033] DMA32 free:243456kB >> min:4308kB low:5384kB high:6460kB active_anon:1055312kB >> inactive_anon:268364kB active_file:605480kB inactive_file:605344kB >> unevictable:0kB isolated(anon):0kB isolated(file):0kB >> present:3098560kB managed:3022260kB mlocked:0kB dirty:1728kB >> writeback:0kB mapped:55944kB shmem:11860kB slab_reclaimable:164900kB >> slab_unreclaimable:12340kB kernel_stack:2496kB pagetables:17284kB >> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >> all_unreclaimable? no >> Nov 2 09:13:48 krshina3 kernel: [582660.901034] lowmem_reserve[]: 0 0 >> 4714 4714 >> Nov 2 09:13:48 krshina3 kernel: [582660.901040] Normal free:385536kB >> min:6884kB low:8604kB high:10324kB active_anon:1823540kB >> inactive_anon:312756kB active_file:954660kB inactive_file:954652kB >> unevictable:0kB isolated(anon):0kB isolated(file):0kB >> present:4954112kB managed:4828124kB mlocked:0kB dirty:2992kB >> writeback:0kB mapped:87920kB shmem:17192kB slab_reclaimable:284008kB >> slab_unreclaimable:24280kB kernel_stack:4368kB pagetables:24912kB >> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB >> pages_scanned:21 all_unreclaimable? no >> Nov 2 09:13:48 krshina3 kernel: [582660.901041] lowmem_reserve[]: 0 0 0 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901044] DMA: 1*4kB (U) 1*8kB >> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >> Nov 2 09:13:48 krshina3 kernel: [582660.901054] DMA32: 46552*4kB (UE) >> 7159*8kB (U) 2*16kB (R) 0*32kB 1*64kB (R) 0*128kB 0*256kB 0*512kB >> 0*1024kB 0*2048kB 0*4096kB = 243576kB >> Nov 2 09:13:48 krshina3 kernel: [582660.901063] Normal: 40881*4kB >> (UEM) 27461*8kB (UEM) 151*16kB (UR) 2*32kB (R) 0*64kB 0*128kB 0*256kB >> 0*512kB 0*1024kB 0*2048kB 0*4096kB = 385692kB >> Nov 2 09:13:48 krshina3 kernel: [582660.901072] Node 0 >> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >> hugepages_size=2048kB >> Nov 2 09:13:48 krshina3 kernel: [582660.901073] 789766 total pagecache >> pages >> Nov 2 09:13:48 krshina3 kernel: [582660.901075] 2404 pages in swap cache >> Nov 2 09:13:48 krshina3 kernel: [582660.901076] Swap cache stats: add >> 94924, delete 92520, find 40323/43073 >> Nov 2 09:13:48 krshina3 kernel: [582660.901077] Free swap = 261888kB >> Nov 2 09:13:48 krshina3 kernel: [582660.901078] Total swap = 594300kB >> Nov 2 09:13:48 krshina3 kernel: [582660.901079] 2017164 pages RAM >> Nov 2 09:13:48 krshina3 kernel: [582660.901080] 0 pages >> HighMem/MovableOnly >> Nov 2 09:13:48 krshina3 kernel: [582660.901081] 31497 pages reserved >> >> >> Now I'm gonna fsck all partitions and report if anything comes up. >> >> Ask if you need more info >> >> Thanks in advance >> Dushan > > -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
[parent not found: <5457629C.8040906@gmail.com>]
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory [not found] ` <5457629C.8040906@gmail.com> @ 2014-11-03 11:12 ` Dušan Čolić 2014-11-03 11:42 ` Edward Shishkin 0 siblings, 1 reply; 33+ messages in thread From: Dušan Čolić @ 2014-11-03 11:12 UTC (permalink / raw) To: Edward Shishkin; +Cc: reiserfs-devel, Ivan Shapovalov I fscked it yesterday before crash and now I'm fsck-ing it again but as you remember it lasts 1hr+ for some reason. On Mon, Nov 3, 2014 at 12:10 PM, Edward Shishkin <edward.shishkin@gmail.com> wrote: > > On 11/03/2014 11:58 AM, Dušan Čolić wrote: > > Now a Bug happened to me on this same ccreg40 partition with > Reiser4-for-3.16.2.patch and I don't know if it's related. > > > > It can not be related to inability to allocate memory at mount time. > > > I have a partition that I use for daily, weekly and monthly snapshots - > /dev/md125 with rsnapshot. > I fsck-ed it yesterday. > > > > Did you fsck-ed it before, or after crash? > > Edward. > > > > After mounting rsync starts and snapshots my /home directory. This Bug > happened on rsync start. > > > rsnapshot log: > fsck.reiser4 /dev/md125 > rsync: writefd_unbuffered failed to write 5 bytes to socket [generator]: > Broken pipe (32) > rsync error: error in rsync protocol data stream (code 12) at io.c(1532) > [generator=3.0.9] > ------------------------------ > ---------------------------------------------- > rsnapshot encountered an error! The program was invoked with these options: > /usr/bin/rsnapshot -c /etc/rsnapshot.d/daily.conf daily > ---------------------------------------------------------------------------- > ERROR: /usr/bin/rsync returned 0.04296875 while processing /home/ > WARNING: Rolling back "localhost/" > Backup failure > > daily.conf: > include_conf /etc/rsnapshot.d/base.conf > > # Daily (30 increments) > interval daily 30 > backup /home/ localhost/ > exclude /home/windows.qcow2 > > base.conf: > > # Default config version > config_version 1.2 > > # So the hard disk is not polluted in case the backup filesystem is not > available > no_create_root 1 > > # Standard settings > cmd_cp /bin/cp > cmd_rm /bin/rm > cmd_rsync /usr/bin/rsync > link_dest 1 > cmd_rsnapshot_diff /usr/bin/rsnapshot-diff > > # For convenience, so that mount points can be taken as backup starting > points > one_fs 1 > > # Store all backups in one directory per machine > # A useful alternative may be to create a separate directory for each > interval > snapshot_root /mnt/backup/ > > Logs: > Nov 3 07:00:10 krshina3 kernel: [ 1650.974059] reiser4: md125: found disk > format 4.0.0. > Nov 3 07:00:13 krshina3 kernel: [ 1654.207021] reiser4: md125: using Hybrid > Transaction Model. > Nov 3 07:00:52 krshina3 kernel: [ 1692.914414] ------------[ cut here > ]------------ > Nov 3 07:00:52 krshina3 kernel: [ 1692.914682] kernel BUG at > fs/reiser4/plugin/item/ctail.c:669! > Nov 3 07:00:52 krshina3 kernel: [ 1692.915010] invalid opcode: 0000 [#1] > SMP > Nov 3 07:00:52 krshina3 kernel: [ 1692.915259] CPU: 0 PID: 4950 Comm: rsync > Not tainted 3.16.5-gentoo #1 > Nov 3 07:00:52 krshina3 kernel: [ 1692.915625] Hardware name: Gigabyte > Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 07/04/2012 > Nov 3 07:00:52 krshina3 kernel: [ 1692.916183] task: ffff88022d3f17d0 ti: > ffff880100004000 task.ti: ffff880100004000 > Nov 3 07:00:52 krshina3 kernel: [ 1692.916610] RIP: > 0010:[<ffffffff811c3a70>] [<ffffffff811c3a70>] > do_readpage_ctail+0x2c0/0x420 > Nov 3 07:00:52 krshina3 kernel: [ 1692.917111] RSP: 0018:ffff880100007978 > EFLAGS: 00010246 > Nov 3 07:00:52 krshina3 kernel: [ 1692.917412] RAX: 8000000000000025 RBX: > ffffea0004570218 RCX: ffff8800b94f0800 > Nov 3 07:00:52 krshina3 kernel: [ 1692.917819] RDX: 0000000000000035 RSI: > 0000000000000000 RDI: ffff8800b94f0000 > Nov 3 07:00:52 krshina3 kernel: [ 1692.918226] RBP: ffff8801000079b8 R08: > 0000000000001000 R09: 0000000000000001 > Nov 3 07:00:52 krshina3 kernel: [ 1692.918632] R10: ffffffff811b3fc0 R11: > ffffea00023f1330 R12: 0000000000000002 > Nov 3 07:00:52 krshina3 kernel: [ 1692.919039] R13: ffff8801ebb78d20 R14: > ffff880100007a88 R15: 0000000000000001 > Nov 3 07:00:52 krshina3 kernel: [ 1692.919450] FS: 00007f4d6b27c700(0000) > GS:ffff88022e200000(0000) knlGS:0000000000000000 > Nov 3 07:00:52 krshina3 kernel: [ 1692.919912] CS: 0010 DS: 0000 ES: 0000 > CR0: 0000000080050033 > Nov 3 07:00:52 krshina3 kernel: [ 1692.920239] CR2: 0000000003035ddf CR3: > 0000000008a76000 CR4: 00000000001427e0 > Nov 3 07:00:52 krshina3 kernel: [ 1692.920645] Stack: > Nov 3 07:00:52 krshina3 kernel: [ 1692.920756] ffff8801000079b8 > ffffffff811b5c4f ffffea0004570218 ffff880100007a88 > Nov 3 07:00:52 krshina3 kernel: [ 1692.921200] ffffea0004570218 > 0000000000000000 ffff8801ebb78d20 ffffffff811c3bd0 > Nov 3 07:00:52 krshina3 kernel: [ 1692.921643] ffff880100007a08 > ffffffff811c3cea ffff880100007a08 00000000810e1785 > Nov 3 07:00:52 krshina3 kernel: [ 1692.922087] Call Trace: > Nov 3 07:00:52 krshina3 kernel: [ 1692.922226] [<ffffffff811b5c4f>] ? > prepare_page_cluster+0xff/0x1f0 > Nov 3 07:00:52 krshina3 kernel: [ 1692.922583] [<ffffffff811c3bd0>] ? > do_readpage_ctail+0x420/0x420 > Nov 3 07:00:52 krshina3 kernel: [ 1692.922931] [<ffffffff811c3cea>] > ctail_readpages_filler+0x11a/0x220 > Nov 3 07:00:52 krshina3 kernel: [ 1692.923299] [<ffffffff811c3bd0>] ? > do_readpage_ctail+0x420/0x420 > Nov 3 07:00:52 krshina3 kernel: [ 1692.923646] [<ffffffff810ebdfa>] > read_cache_pages+0xba/0x120 > Nov 3 07:00:52 krshina3 kernel: [ 1692.923973] [<ffffffff811c4073>] > readpages_ctail+0x133/0x360 > Nov 3 07:00:52 krshina3 kernel: [ 1692.924299] [<ffffffff811b7e76>] > readpages_cryptcompress+0x46/0x80 > Nov 3 07:00:52 krshina3 kernel: [ 1692.924656] [<ffffffff811a2b8e>] > reiser4_readpages_dispatch+0x3e/0x50 > Nov 3 07:00:52 krshina3 kernel: [ 1692.925029] [<ffffffff810ec009>] > __do_page_cache_readahead+0x1a9/0x240 > Nov 3 07:00:52 krshina3 kernel: [ 1692.925407] [<ffffffff810ec1f7>] > ondemand_readahead+0x157/0x290 > Nov 3 07:00:52 krshina3 kernel: [ 1692.925749] [<ffffffff810e2326>] ? > pagecache_get_page+0x36/0x1e0 > Nov 3 07:00:52 krshina3 kernel: [ 1692.926097] [<ffffffff810ec41e>] > page_cache_sync_readahead+0x2e/0x50 > Nov 3 07:00:52 krshina3 kernel: [ 1692.926464] [<ffffffff810e33e9>] > generic_file_read_iter+0x409/0x5f0 > Nov 3 07:00:52 krshina3 kernel: [ 1692.926827] [<ffffffff8112da8e>] ? > link_path_walk+0x26e/0x880 > Nov 3 07:00:52 krshina3 kernel: [ 1692.927160] [<ffffffff81122b49>] > new_sync_read+0x79/0xb0 > Nov 3 07:00:52 krshina3 kernel: [ 1692.927470] [<ffffffff811b7f23>] > read_cryptcompress+0x73/0xb0 > Nov 3 07:00:52 krshina3 kernel: [ 1692.927803] [<ffffffff811b21c2>] > reiser4_read_dispatch+0x72/0x160 > Nov 3 07:00:52 krshina3 kernel: [ 1692.928156] [<ffffffff81123abb>] > vfs_read+0x9b/0x190 > Nov 3 07:00:52 krshina3 kernel: [ 1692.928443] [<ffffffff8112408a>] > SyS_read+0x4a/0xc0 > Nov 3 07:00:52 krshina3 kernel: [ 1692.928726] [<ffffffff816ab1d2>] > system_call_fastpath+0x16/0x1b > Nov 3 07:00:52 krshina3 kernel: [ 1692.929068] Code: fe ff ff 0f 1f 84 00 > 00 00 00 00 48 89 df e8 a8 e4 f1 ff e9 3c fe ff ff 0f 1f 00 48 89 df e8 98 > e4 f1 ff e9 73 fe ff ff 0f 1f 00 <0f> 0b 48 8b 03 a8 08 0f 84 a1 00 00 00 49 > 8b be 80 00 00 00 e8 > Nov 3 07:00:52 krshina3 kernel: [ 1692.930505] RIP [<ffffffff811c3a70>] > do_readpage_ctail+0x2c0/0x420 > Nov 3 07:00:52 krshina3 kernel: [ 1692.930868] RSP <ffff880100007978> > Nov 3 07:00:52 krshina3 kernel: [ 1693.043372] ---[ end trace > 36e8590f8aa347d3 ]--- > > On Sun, Nov 2, 2014 at 9:38 AM, Dušan Čolić <dusanc@gmail.com> wrote: >> >> When I try to mount a cc reiser4 partition (reiser4-for-3.16.2.patch) >> I get: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate >> memory >> Uptime is almost 7 days and mounting of this partition worked every >> day untill last night (I get automated messages on mail when something >> goes wrong). >> >> Now I tried on kernel 3.10 and everything works OK >> >> krshina3 goran # uname -a >> Linux krshina3 3.10.6-gentoo #2 SMP Wed Aug 14 17:33:45 CEST 2013 >> x86_64 Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz GenuineIntel GNU/Linux >> >> krshina3 goran# free -m >> total used free shared buffers cached >> Mem: 7681 6794 887 30 0 2933 >> -/+ buffers/cache: 3860 3821 >> Swap: 580 325 254 >> >> krshina3 goran# cat /etc/fstab | grep -v "#" >> >> /dev/sda1 /boot ext2 noauto,noatime 1 >> 2 >> /dev/md123 none swap sw 0 >> 0 >> /dev/sda2 / reiser4 >> noatime,onerror=remount-ro 0 0 >> /dev/md125 /mnt/backup reiser4 >> noatime,noauto,onerror=remount-ro 0 0 >> /dev/md126 /mnt/media reiser4 >> noatime,users,onerror=remount-ro 0 0 >> /dev/md127 /usr/portage reiser4 >> noatime,onerror=remount-ro 0 0 >> shm /dev/shm tmpfs >> nodev,nosuid,noexec 0 0 >> >> >> krshina3 goran # df >> Filesystem 1K-blocks Used Available Use% Mounted on >> /dev/sda2 37017728 24870384 12147344 68% / >> tmpfs 786872 832 786040 1% /run >> udev 10240 0 10240 0% /dev >> shm 3934340 80 3934260 1% /dev/shm >> /dev/md126 383034100 298007740 85026360 78% /mnt/media >> /dev/md127 6113484 5427288 686196 89% /usr/portage >> /dev/md125 64959612 57618884 7340728 89% /mnt/backup >> >> I get these in logs: >> >> Nov 2 03:30:01 krshina3 kernel: [562035.221513] reiser4: md125: found >> disk format 4.0.0. >> Nov 2 03:30:01 krshina3 kernel: [562035.221749] mount: page >> allocation failure: order:4, mode:0x2040d0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221752] CPU: 0 PID: 517 Comm: >> mount Not tainted 3.16.5-gentoo #1 >> Nov 2 03:30:01 krshina3 kernel: [562035.221753] Hardware name: >> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >> 07/04/2012 >> Nov 2 03:30:01 krshina3 kernel: [562035.221754] 0000000000000000 >> ffff88020ece7968 ffffffff816a31b4 0000000000000007 >> Nov 2 03:30:01 krshina3 kernel: [562035.221757] 00000000002040d0 >> ffff88020ece79f8 ffffffff810e609a ffffffff00000040 >> Nov 2 03:30:01 krshina3 kernel: [562035.221758] 0000000000000286 >> ffffffff819a8a78 fffffff00000000f ffff88020ece79c8 >> Nov 2 03:30:01 krshina3 kernel: [562035.221760] Call Trace: >> Nov 2 03:30:01 krshina3 kernel: [562035.221765] [<ffffffff816a31b4>] >> dump_stack+0x46/0x58 >> Nov 2 03:30:01 krshina3 kernel: [562035.221768] [<ffffffff810e609a>] >> warn_alloc_failed+0xda/0x130 >> Nov 2 03:30:01 krshina3 kernel: [562035.221770] [<ffffffff810e86c9>] >> __alloc_pages_nodemask+0x5d9/0x7a0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221774] [<ffffffff8111f16a>] >> cache_alloc_refill+0x31a/0x550 >> Nov 2 03:30:01 krshina3 kernel: [562035.221776] [<ffffffff8111ee23>] >> kmem_cache_alloc+0xb3/0xe0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221778] [<ffffffff81186529>] >> znodes_tree_init+0xc9/0x120 >> Nov 2 03:30:01 krshina3 kernel: [562035.221781] [<ffffffff8118e7b4>] >> reiser4_init_tree+0x44/0xd0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221784] [<ffffffff811cb905>] >> init_format_format40+0x265/0x5b0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221787] [<ffffffff8119e8b1>] >> fill_super+0x101/0x200 >> Nov 2 03:30:01 krshina3 kernel: [562035.221789] [<ffffffff81126be4>] >> mount_bdev+0x194/0x1d0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221792] [<ffffffff8119e7b0>] >> ? reiser4_mount+0x20/0x20 >> Nov 2 03:30:01 krshina3 kernel: [562035.221794] [<ffffffff8119e7a0>] >> reiser4_mount+0x10/0x20 >> Nov 2 03:30:01 krshina3 kernel: [562035.221796] [<ffffffff81126e2b>] >> mount_fs+0x1b/0xd0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221799] [<ffffffff8114042f>] >> vfs_kern_mount+0x6f/0x130 >> Nov 2 03:30:01 krshina3 kernel: [562035.221801] [<ffffffff81141f68>] >> do_mount+0x218/0xab0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221803] [<ffffffff810e88a2>] >> ? __get_free_pages+0x12/0x60 >> Nov 2 03:30:01 krshina3 kernel: [562035.221805] [<ffffffff81141bf5>] >> ? copy_mount_options+0x35/0x150 >> Nov 2 03:30:01 krshina3 kernel: [562035.221808] [<ffffffff81142ad9>] >> SyS_mount+0x89/0xd0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221811] [<ffffffff816ab1d2>] >> system_call_fastpath+0x16/0x1b >> Nov 2 03:30:01 krshina3 kernel: [562035.221812] Mem-Info: >> Nov 2 03:30:01 krshina3 kernel: [562035.221813] DMA per-cpu: >> Nov 2 03:30:01 krshina3 kernel: [562035.221814] CPU 0: hi: 0, >> btch: 1 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221815] CPU 1: hi: 0, >> btch: 1 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221816] CPU 2: hi: 0, >> btch: 1 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221817] CPU 3: hi: 0, >> btch: 1 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221817] DMA32 per-cpu: >> Nov 2 03:30:01 krshina3 kernel: [562035.221819] CPU 0: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221819] CPU 1: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221820] CPU 2: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221821] CPU 3: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221822] Normal per-cpu: >> Nov 2 03:30:01 krshina3 kernel: [562035.221823] CPU 0: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221824] CPU 1: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221825] CPU 2: hi: 186, >> btch: 31 usd: 56 >> Nov 2 03:30:01 krshina3 kernel: [562035.221826] CPU 3: hi: 186, >> btch: 31 usd: 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221828] active_anon:701641 >> inactive_anon:138699 isolated_anon:0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221828] active_file:399519 >> inactive_file:396920 isolated_file:0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221828] unevictable:0 >> dirty:204 writeback:0 unstable:0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221828] free:155878 >> slab_reclaimable:126123 slab_unreclaimable:9074 >> Nov 2 03:30:01 krshina3 kernel: [562035.221828] mapped:21535 >> shmem:5701 pagetables:10162 bounce:0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221828] free_cma:0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221833] DMA free:15900kB >> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >> all_unreclaimable? yes >> Nov 2 03:30:01 krshina3 kernel: [562035.221834] lowmem_reserve[]: 0 >> 2950 7665 7665 >> Nov 2 03:30:01 krshina3 kernel: [562035.221839] DMA32 free:250180kB >> min:4308kB low:5384kB high:6460kB active_anon:1026572kB >> inactive_anon:257356kB active_file:616152kB inactive_file:612572kB >> unevictable:0kB isolated(anon):0kB isolated(file):0kB >> present:3098560kB managed:3022260kB mlocked:0kB dirty:4kB >> writeback:0kB mapped:33232kB shmem:9336kB slab_reclaimable:180492kB >> slab_unreclaimable:12176kB kernel_stack:2496kB pagetables:16872kB >> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >> all_unreclaimable? no >> Nov 2 03:30:01 krshina3 kernel: [562035.221840] lowmem_reserve[]: 0 0 >> 4714 4714 >> Nov 2 03:30:01 krshina3 kernel: [562035.221844] Normal free:357432kB >> min:6884kB low:8604kB high:10324kB active_anon:1779992kB >> inactive_anon:297440kB active_file:981924kB inactive_file:975108kB >> unevictable:0kB isolated(anon):0kB isolated(file):0kB >> present:4954112kB managed:4828124kB mlocked:0kB dirty:812kB >> writeback:0kB mapped:52908kB shmem:13468kB slab_reclaimable:324000kB >> slab_unreclaimable:24120kB kernel_stack:4160kB pagetables:23776kB >> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB >> pages_scanned:24 all_unreclaimable? no >> Nov 2 03:30:01 krshina3 kernel: [562035.221845] lowmem_reserve[]: 0 0 0 0 >> Nov 2 03:30:01 krshina3 kernel: [562035.221847] DMA: 1*4kB (U) 1*8kB >> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >> Nov 2 03:30:01 krshina3 kernel: [562035.221855] DMA32: 52520*4kB >> (UEM) 5030*8kB (UE) 3*16kB (UR) 0*32kB 1*64kB (R) 0*128kB 0*256kB >> 0*512kB 0*1024kB 0*2048kB 0*4096kB = 250432kB >> Nov 2 03:30:01 krshina3 kernel: [562035.221861] Normal: 62961*4kB >> (UEM) 11874*8kB (UEM) 640*16kB (UEMR) 17*32kB (UEMR) 1*64kB (E) >> 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 357684kB >> Nov 2 03:30:01 krshina3 kernel: [562035.221867] Node 0 >> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >> hugepages_size=2048kB >> Nov 2 03:30:01 krshina3 kernel: [562035.221868] 804788 total pagecache >> pages >> Nov 2 03:30:01 krshina3 kernel: [562035.221869] 2600 pages in swap cache >> Nov 2 03:30:01 krshina3 kernel: [562035.221870] Swap cache stats: add >> 91111, delete 88511, find 38599/41340 >> Nov 2 03:30:01 krshina3 kernel: [562035.221871] Free swap = 277028kB >> Nov 2 03:30:01 krshina3 kernel: [562035.221872] Total swap = 594300kB >> Nov 2 03:30:01 krshina3 kernel: [562035.221873] 2017164 pages RAM >> Nov 2 03:30:01 krshina3 kernel: [562035.221873] 0 pages >> HighMem/MovableOnly >> Nov 2 03:30:01 krshina3 kernel: [562035.221874] 31497 pages reserved >> >> >> >> >> Nov 2 09:13:48 krshina3 kernel: [582660.900521] reiser4: md125: found >> disk format 4.0.0. >> Nov 2 09:13:48 krshina3 kernel: [582660.900907] mount: page >> allocation failure: order:4, mode:0x2040d0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900910] CPU: 1 PID: 1414 >> Comm: mount Not tainted 3.16.5-gentoo #1 >> Nov 2 09:13:48 krshina3 kernel: [582660.900912] Hardware name: >> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >> 07/04/2012 >> Nov 2 09:13:48 krshina3 kernel: [582660.900914] 0000000000000000 >> ffff880148093968 ffffffff816a31b4 0000000000000007 >> Nov 2 09:13:48 krshina3 kernel: [582660.900917] 00000000002040d0 >> ffff8801480939f8 ffffffff810e609a ffffffff00000040 >> Nov 2 09:13:48 krshina3 kernel: [582660.900919] 0000000000000286 >> ffffffff819a8a78 fffffff00000000f ffff8801480939c8 >> Nov 2 09:13:48 krshina3 kernel: [582660.900922] Call Trace: >> Nov 2 09:13:48 krshina3 kernel: [582660.900929] [<ffffffff816a31b4>] >> dump_stack+0x46/0x58 >> Nov 2 09:13:48 krshina3 kernel: [582660.900933] [<ffffffff810e609a>] >> warn_alloc_failed+0xda/0x130 >> Nov 2 09:13:48 krshina3 kernel: [582660.900937] [<ffffffff810e86c9>] >> __alloc_pages_nodemask+0x5d9/0x7a0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900941] [<ffffffff8111f16a>] >> cache_alloc_refill+0x31a/0x550 >> Nov 2 09:13:48 krshina3 kernel: [582660.900945] [<ffffffff8111ee23>] >> kmem_cache_alloc+0xb3/0xe0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900948] [<ffffffff81186529>] >> znodes_tree_init+0xc9/0x120 >> Nov 2 09:13:48 krshina3 kernel: [582660.900951] [<ffffffff8118e7b4>] >> reiser4_init_tree+0x44/0xd0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900955] [<ffffffff811cb905>] >> init_format_format40+0x265/0x5b0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900959] [<ffffffff8119e8b1>] >> fill_super+0x101/0x200 >> Nov 2 09:13:48 krshina3 kernel: [582660.900963] [<ffffffff81126be4>] >> mount_bdev+0x194/0x1d0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900966] [<ffffffff8119e7b0>] >> ? reiser4_mount+0x20/0x20 >> Nov 2 09:13:48 krshina3 kernel: [582660.900969] [<ffffffff8119e7a0>] >> reiser4_mount+0x10/0x20 >> Nov 2 09:13:48 krshina3 kernel: [582660.900972] [<ffffffff81126e2b>] >> mount_fs+0x1b/0xd0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900976] [<ffffffff8114042f>] >> vfs_kern_mount+0x6f/0x130 >> Nov 2 09:13:48 krshina3 kernel: [582660.900979] [<ffffffff81141f68>] >> do_mount+0x218/0xab0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900982] [<ffffffff810e88a2>] >> ? __get_free_pages+0x12/0x60 >> Nov 2 09:13:48 krshina3 kernel: [582660.900986] [<ffffffff81141bf5>] >> ? copy_mount_options+0x35/0x150 >> Nov 2 09:13:48 krshina3 kernel: [582660.900989] [<ffffffff81142ad9>] >> SyS_mount+0x89/0xd0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900993] [<ffffffff816ab1d2>] >> system_call_fastpath+0x16/0x1b >> Nov 2 09:13:48 krshina3 kernel: [582660.900994] Mem-Info: >> Nov 2 09:13:48 krshina3 kernel: [582660.900996] DMA per-cpu: >> Nov 2 09:13:48 krshina3 kernel: [582660.900997] CPU 0: hi: 0, >> btch: 1 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.900999] CPU 1: hi: 0, >> btch: 1 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901000] CPU 2: hi: 0, >> btch: 1 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901001] CPU 3: hi: 0, >> btch: 1 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901002] DMA32 per-cpu: >> Nov 2 09:13:48 krshina3 kernel: [582660.901004] CPU 0: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901005] CPU 1: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901006] CPU 2: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901008] CPU 3: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901009] Normal per-cpu: >> Nov 2 09:13:48 krshina3 kernel: [582660.901010] CPU 0: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901011] CPU 1: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901013] CPU 2: hi: 186, >> btch: 31 usd: 21 >> Nov 2 09:13:48 krshina3 kernel: [582660.901014] CPU 3: hi: 186, >> btch: 31 usd: 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901017] active_anon:719713 >> inactive_anon:145280 isolated_anon:0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901017] active_file:390035 >> inactive_file:389999 isolated_file:0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901017] unevictable:0 >> dirty:1180 writeback:0 unstable:0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901017] free:161223 >> slab_reclaimable:112227 slab_unreclaimable:9155 >> Nov 2 09:13:48 krshina3 kernel: [582660.901017] mapped:35966 >> shmem:7263 pagetables:10549 bounce:0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901017] free_cma:0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901024] DMA free:15900kB >> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >> all_unreclaimable? yes >> Nov 2 09:13:48 krshina3 kernel: [582660.901026] lowmem_reserve[]: 0 >> 2950 7665 7665 >> Nov 2 09:13:48 krshina3 kernel: [582660.901033] DMA32 free:243456kB >> min:4308kB low:5384kB high:6460kB active_anon:1055312kB >> inactive_anon:268364kB active_file:605480kB inactive_file:605344kB >> unevictable:0kB isolated(anon):0kB isolated(file):0kB >> present:3098560kB managed:3022260kB mlocked:0kB dirty:1728kB >> writeback:0kB mapped:55944kB shmem:11860kB slab_reclaimable:164900kB >> slab_unreclaimable:12340kB kernel_stack:2496kB pagetables:17284kB >> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >> all_unreclaimable? no >> Nov 2 09:13:48 krshina3 kernel: [582660.901034] lowmem_reserve[]: 0 0 >> 4714 4714 >> Nov 2 09:13:48 krshina3 kernel: [582660.901040] Normal free:385536kB >> min:6884kB low:8604kB high:10324kB active_anon:1823540kB >> inactive_anon:312756kB active_file:954660kB inactive_file:954652kB >> unevictable:0kB isolated(anon):0kB isolated(file):0kB >> present:4954112kB managed:4828124kB mlocked:0kB dirty:2992kB >> writeback:0kB mapped:87920kB shmem:17192kB slab_reclaimable:284008kB >> slab_unreclaimable:24280kB kernel_stack:4368kB pagetables:24912kB >> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB >> pages_scanned:21 all_unreclaimable? no >> Nov 2 09:13:48 krshina3 kernel: [582660.901041] lowmem_reserve[]: 0 0 0 0 >> Nov 2 09:13:48 krshina3 kernel: [582660.901044] DMA: 1*4kB (U) 1*8kB >> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >> Nov 2 09:13:48 krshina3 kernel: [582660.901054] DMA32: 46552*4kB (UE) >> 7159*8kB (U) 2*16kB (R) 0*32kB 1*64kB (R) 0*128kB 0*256kB 0*512kB >> 0*1024kB 0*2048kB 0*4096kB = 243576kB >> Nov 2 09:13:48 krshina3 kernel: [582660.901063] Normal: 40881*4kB >> (UEM) 27461*8kB (UEM) 151*16kB (UR) 2*32kB (R) 0*64kB 0*128kB 0*256kB >> 0*512kB 0*1024kB 0*2048kB 0*4096kB = 385692kB >> Nov 2 09:13:48 krshina3 kernel: [582660.901072] Node 0 >> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >> hugepages_size=2048kB >> Nov 2 09:13:48 krshina3 kernel: [582660.901073] 789766 total pagecache >> pages >> Nov 2 09:13:48 krshina3 kernel: [582660.901075] 2404 pages in swap cache >> Nov 2 09:13:48 krshina3 kernel: [582660.901076] Swap cache stats: add >> 94924, delete 92520, find 40323/43073 >> Nov 2 09:13:48 krshina3 kernel: [582660.901077] Free swap = 261888kB >> Nov 2 09:13:48 krshina3 kernel: [582660.901078] Total swap = 594300kB >> Nov 2 09:13:48 krshina3 kernel: [582660.901079] 2017164 pages RAM >> Nov 2 09:13:48 krshina3 kernel: [582660.901080] 0 pages >> HighMem/MovableOnly >> Nov 2 09:13:48 krshina3 kernel: [582660.901081] 31497 pages reserved >> >> >> Now I'm gonna fsck all partitions and report if anything comes up. >> >> Ask if you need more info >> >> Thanks in advance >> Dushan > > > -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-11-03 11:12 ` Dušan Čolić @ 2014-11-03 11:42 ` Edward Shishkin 2014-11-03 12:25 ` Dušan Čolić 0 siblings, 1 reply; 33+ messages in thread From: Edward Shishkin @ 2014-11-03 11:42 UTC (permalink / raw) To: Dušan Čolić; +Cc: reiserfs-devel, Ivan Shapovalov On 11/03/2014 12:12 PM, Dušan Čolić wrote: > I fscked it yesterday before crash and now I'm fsck-ing it again but > as you remember it lasts 1hr+ for some reason. For the full 70G partition it looks normal. OK, if you can reproduce this BUG at fs/reiser4/plugin/item/ctail.c:669 after fsck, then please let me know: it will essentially speed up things.. Edward. > > On Mon, Nov 3, 2014 at 12:10 PM, Edward Shishkin > <edward.shishkin@gmail.com> wrote: >> On 11/03/2014 11:58 AM, Dušan Čolić wrote: >> >> Now a Bug happened to me on this same ccreg40 partition with >> Reiser4-for-3.16.2.patch and I don't know if it's related. >> >> >> >> It can not be related to inability to allocate memory at mount time. >> >> >> I have a partition that I use for daily, weekly and monthly snapshots - >> /dev/md125 with rsnapshot. >> I fsck-ed it yesterday. >> >> >> >> Did you fsck-ed it before, or after crash? >> >> Edward. >> >> >> >> After mounting rsync starts and snapshots my /home directory. This Bug >> happened on rsync start. >> >> >> rsnapshot log: >> fsck.reiser4 /dev/md125 >> rsync: writefd_unbuffered failed to write 5 bytes to socket [generator]: >> Broken pipe (32) >> rsync error: error in rsync protocol data stream (code 12) at io.c(1532) >> [generator=3.0.9] >> ------------------------------ >> ---------------------------------------------- >> rsnapshot encountered an error! The program was invoked with these options: >> /usr/bin/rsnapshot -c /etc/rsnapshot.d/daily.conf daily >> ---------------------------------------------------------------------------- >> ERROR: /usr/bin/rsync returned 0.04296875 while processing /home/ >> WARNING: Rolling back "localhost/" >> Backup failure >> >> daily.conf: >> include_conf /etc/rsnapshot.d/base.conf >> >> # Daily (30 increments) >> interval daily 30 >> backup /home/ localhost/ >> exclude /home/windows.qcow2 >> >> base.conf: >> >> # Default config version >> config_version 1.2 >> >> # So the hard disk is not polluted in case the backup filesystem is not >> available >> no_create_root 1 >> >> # Standard settings >> cmd_cp /bin/cp >> cmd_rm /bin/rm >> cmd_rsync /usr/bin/rsync >> link_dest 1 >> cmd_rsnapshot_diff /usr/bin/rsnapshot-diff >> >> # For convenience, so that mount points can be taken as backup starting >> points >> one_fs 1 >> >> # Store all backups in one directory per machine >> # A useful alternative may be to create a separate directory for each >> interval >> snapshot_root /mnt/backup/ >> >> Logs: >> Nov 3 07:00:10 krshina3 kernel: [ 1650.974059] reiser4: md125: found disk >> format 4.0.0. >> Nov 3 07:00:13 krshina3 kernel: [ 1654.207021] reiser4: md125: using Hybrid >> Transaction Model. >> Nov 3 07:00:52 krshina3 kernel: [ 1692.914414] ------------[ cut here >> ]------------ >> Nov 3 07:00:52 krshina3 kernel: [ 1692.914682] kernel BUG at >> fs/reiser4/plugin/item/ctail.c:669! >> Nov 3 07:00:52 krshina3 kernel: [ 1692.915010] invalid opcode: 0000 [#1] >> SMP >> Nov 3 07:00:52 krshina3 kernel: [ 1692.915259] CPU: 0 PID: 4950 Comm: rsync >> Not tainted 3.16.5-gentoo #1 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.915625] Hardware name: Gigabyte >> Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 07/04/2012 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.916183] task: ffff88022d3f17d0 ti: >> ffff880100004000 task.ti: ffff880100004000 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.916610] RIP: >> 0010:[<ffffffff811c3a70>] [<ffffffff811c3a70>] >> do_readpage_ctail+0x2c0/0x420 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.917111] RSP: 0018:ffff880100007978 >> EFLAGS: 00010246 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.917412] RAX: 8000000000000025 RBX: >> ffffea0004570218 RCX: ffff8800b94f0800 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.917819] RDX: 0000000000000035 RSI: >> 0000000000000000 RDI: ffff8800b94f0000 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.918226] RBP: ffff8801000079b8 R08: >> 0000000000001000 R09: 0000000000000001 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.918632] R10: ffffffff811b3fc0 R11: >> ffffea00023f1330 R12: 0000000000000002 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.919039] R13: ffff8801ebb78d20 R14: >> ffff880100007a88 R15: 0000000000000001 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.919450] FS: 00007f4d6b27c700(0000) >> GS:ffff88022e200000(0000) knlGS:0000000000000000 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.919912] CS: 0010 DS: 0000 ES: 0000 >> CR0: 0000000080050033 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.920239] CR2: 0000000003035ddf CR3: >> 0000000008a76000 CR4: 00000000001427e0 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.920645] Stack: >> Nov 3 07:00:52 krshina3 kernel: [ 1692.920756] ffff8801000079b8 >> ffffffff811b5c4f ffffea0004570218 ffff880100007a88 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.921200] ffffea0004570218 >> 0000000000000000 ffff8801ebb78d20 ffffffff811c3bd0 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.921643] ffff880100007a08 >> ffffffff811c3cea ffff880100007a08 00000000810e1785 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.922087] Call Trace: >> Nov 3 07:00:52 krshina3 kernel: [ 1692.922226] [<ffffffff811b5c4f>] ? >> prepare_page_cluster+0xff/0x1f0 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.922583] [<ffffffff811c3bd0>] ? >> do_readpage_ctail+0x420/0x420 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.922931] [<ffffffff811c3cea>] >> ctail_readpages_filler+0x11a/0x220 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.923299] [<ffffffff811c3bd0>] ? >> do_readpage_ctail+0x420/0x420 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.923646] [<ffffffff810ebdfa>] >> read_cache_pages+0xba/0x120 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.923973] [<ffffffff811c4073>] >> readpages_ctail+0x133/0x360 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.924299] [<ffffffff811b7e76>] >> readpages_cryptcompress+0x46/0x80 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.924656] [<ffffffff811a2b8e>] >> reiser4_readpages_dispatch+0x3e/0x50 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.925029] [<ffffffff810ec009>] >> __do_page_cache_readahead+0x1a9/0x240 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.925407] [<ffffffff810ec1f7>] >> ondemand_readahead+0x157/0x290 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.925749] [<ffffffff810e2326>] ? >> pagecache_get_page+0x36/0x1e0 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.926097] [<ffffffff810ec41e>] >> page_cache_sync_readahead+0x2e/0x50 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.926464] [<ffffffff810e33e9>] >> generic_file_read_iter+0x409/0x5f0 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.926827] [<ffffffff8112da8e>] ? >> link_path_walk+0x26e/0x880 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.927160] [<ffffffff81122b49>] >> new_sync_read+0x79/0xb0 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.927470] [<ffffffff811b7f23>] >> read_cryptcompress+0x73/0xb0 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.927803] [<ffffffff811b21c2>] >> reiser4_read_dispatch+0x72/0x160 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.928156] [<ffffffff81123abb>] >> vfs_read+0x9b/0x190 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.928443] [<ffffffff8112408a>] >> SyS_read+0x4a/0xc0 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.928726] [<ffffffff816ab1d2>] >> system_call_fastpath+0x16/0x1b >> Nov 3 07:00:52 krshina3 kernel: [ 1692.929068] Code: fe ff ff 0f 1f 84 00 >> 00 00 00 00 48 89 df e8 a8 e4 f1 ff e9 3c fe ff ff 0f 1f 00 48 89 df e8 98 >> e4 f1 ff e9 73 fe ff ff 0f 1f 00 <0f> 0b 48 8b 03 a8 08 0f 84 a1 00 00 00 49 >> 8b be 80 00 00 00 e8 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.930505] RIP [<ffffffff811c3a70>] >> do_readpage_ctail+0x2c0/0x420 >> Nov 3 07:00:52 krshina3 kernel: [ 1692.930868] RSP <ffff880100007978> >> Nov 3 07:00:52 krshina3 kernel: [ 1693.043372] ---[ end trace >> 36e8590f8aa347d3 ]--- >> >> On Sun, Nov 2, 2014 at 9:38 AM, Dušan Čolić <dusanc@gmail.com> wrote: >>> When I try to mount a cc reiser4 partition (reiser4-for-3.16.2.patch) >>> I get: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate >>> memory >>> Uptime is almost 7 days and mounting of this partition worked every >>> day untill last night (I get automated messages on mail when something >>> goes wrong). >>> >>> Now I tried on kernel 3.10 and everything works OK >>> >>> krshina3 goran # uname -a >>> Linux krshina3 3.10.6-gentoo #2 SMP Wed Aug 14 17:33:45 CEST 2013 >>> x86_64 Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz GenuineIntel GNU/Linux >>> >>> krshina3 goran# free -m >>> total used free shared buffers cached >>> Mem: 7681 6794 887 30 0 2933 >>> -/+ buffers/cache: 3860 3821 >>> Swap: 580 325 254 >>> >>> krshina3 goran# cat /etc/fstab | grep -v "#" >>> >>> /dev/sda1 /boot ext2 noauto,noatime 1 >>> 2 >>> /dev/md123 none swap sw 0 >>> 0 >>> /dev/sda2 / reiser4 >>> noatime,onerror=remount-ro 0 0 >>> /dev/md125 /mnt/backup reiser4 >>> noatime,noauto,onerror=remount-ro 0 0 >>> /dev/md126 /mnt/media reiser4 >>> noatime,users,onerror=remount-ro 0 0 >>> /dev/md127 /usr/portage reiser4 >>> noatime,onerror=remount-ro 0 0 >>> shm /dev/shm tmpfs >>> nodev,nosuid,noexec 0 0 >>> >>> >>> krshina3 goran # df >>> Filesystem 1K-blocks Used Available Use% Mounted on >>> /dev/sda2 37017728 24870384 12147344 68% / >>> tmpfs 786872 832 786040 1% /run >>> udev 10240 0 10240 0% /dev >>> shm 3934340 80 3934260 1% /dev/shm >>> /dev/md126 383034100 298007740 85026360 78% /mnt/media >>> /dev/md127 6113484 5427288 686196 89% /usr/portage >>> /dev/md125 64959612 57618884 7340728 89% /mnt/backup >>> >>> I get these in logs: >>> >>> Nov 2 03:30:01 krshina3 kernel: [562035.221513] reiser4: md125: found >>> disk format 4.0.0. >>> Nov 2 03:30:01 krshina3 kernel: [562035.221749] mount: page >>> allocation failure: order:4, mode:0x2040d0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221752] CPU: 0 PID: 517 Comm: >>> mount Not tainted 3.16.5-gentoo #1 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221753] Hardware name: >>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>> 07/04/2012 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221754] 0000000000000000 >>> ffff88020ece7968 ffffffff816a31b4 0000000000000007 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221757] 00000000002040d0 >>> ffff88020ece79f8 ffffffff810e609a ffffffff00000040 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221758] 0000000000000286 >>> ffffffff819a8a78 fffffff00000000f ffff88020ece79c8 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221760] Call Trace: >>> Nov 2 03:30:01 krshina3 kernel: [562035.221765] [<ffffffff816a31b4>] >>> dump_stack+0x46/0x58 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221768] [<ffffffff810e609a>] >>> warn_alloc_failed+0xda/0x130 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221770] [<ffffffff810e86c9>] >>> __alloc_pages_nodemask+0x5d9/0x7a0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221774] [<ffffffff8111f16a>] >>> cache_alloc_refill+0x31a/0x550 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221776] [<ffffffff8111ee23>] >>> kmem_cache_alloc+0xb3/0xe0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221778] [<ffffffff81186529>] >>> znodes_tree_init+0xc9/0x120 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221781] [<ffffffff8118e7b4>] >>> reiser4_init_tree+0x44/0xd0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221784] [<ffffffff811cb905>] >>> init_format_format40+0x265/0x5b0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221787] [<ffffffff8119e8b1>] >>> fill_super+0x101/0x200 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221789] [<ffffffff81126be4>] >>> mount_bdev+0x194/0x1d0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221792] [<ffffffff8119e7b0>] >>> ? reiser4_mount+0x20/0x20 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221794] [<ffffffff8119e7a0>] >>> reiser4_mount+0x10/0x20 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221796] [<ffffffff81126e2b>] >>> mount_fs+0x1b/0xd0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221799] [<ffffffff8114042f>] >>> vfs_kern_mount+0x6f/0x130 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221801] [<ffffffff81141f68>] >>> do_mount+0x218/0xab0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221803] [<ffffffff810e88a2>] >>> ? __get_free_pages+0x12/0x60 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221805] [<ffffffff81141bf5>] >>> ? copy_mount_options+0x35/0x150 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221808] [<ffffffff81142ad9>] >>> SyS_mount+0x89/0xd0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221811] [<ffffffff816ab1d2>] >>> system_call_fastpath+0x16/0x1b >>> Nov 2 03:30:01 krshina3 kernel: [562035.221812] Mem-Info: >>> Nov 2 03:30:01 krshina3 kernel: [562035.221813] DMA per-cpu: >>> Nov 2 03:30:01 krshina3 kernel: [562035.221814] CPU 0: hi: 0, >>> btch: 1 usd: 0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221815] CPU 1: hi: 0, >>> btch: 1 usd: 0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221816] CPU 2: hi: 0, >>> btch: 1 usd: 0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221817] CPU 3: hi: 0, >>> btch: 1 usd: 0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221817] DMA32 per-cpu: >>> Nov 2 03:30:01 krshina3 kernel: [562035.221819] CPU 0: hi: 186, >>> btch: 31 usd: 0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221819] CPU 1: hi: 186, >>> btch: 31 usd: 0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221820] CPU 2: hi: 186, >>> btch: 31 usd: 0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221821] CPU 3: hi: 186, >>> btch: 31 usd: 0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221822] Normal per-cpu: >>> Nov 2 03:30:01 krshina3 kernel: [562035.221823] CPU 0: hi: 186, >>> btch: 31 usd: 0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221824] CPU 1: hi: 186, >>> btch: 31 usd: 0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221825] CPU 2: hi: 186, >>> btch: 31 usd: 56 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221826] CPU 3: hi: 186, >>> btch: 31 usd: 0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] active_anon:701641 >>> inactive_anon:138699 isolated_anon:0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] active_file:399519 >>> inactive_file:396920 isolated_file:0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] unevictable:0 >>> dirty:204 writeback:0 unstable:0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] free:155878 >>> slab_reclaimable:126123 slab_unreclaimable:9074 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] mapped:21535 >>> shmem:5701 pagetables:10162 bounce:0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] free_cma:0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221833] DMA free:15900kB >>> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >>> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >>> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >>> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >>> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >>> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>> all_unreclaimable? yes >>> Nov 2 03:30:01 krshina3 kernel: [562035.221834] lowmem_reserve[]: 0 >>> 2950 7665 7665 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221839] DMA32 free:250180kB >>> min:4308kB low:5384kB high:6460kB active_anon:1026572kB >>> inactive_anon:257356kB active_file:616152kB inactive_file:612572kB >>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>> present:3098560kB managed:3022260kB mlocked:0kB dirty:4kB >>> writeback:0kB mapped:33232kB shmem:9336kB slab_reclaimable:180492kB >>> slab_unreclaimable:12176kB kernel_stack:2496kB pagetables:16872kB >>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>> all_unreclaimable? no >>> Nov 2 03:30:01 krshina3 kernel: [562035.221840] lowmem_reserve[]: 0 0 >>> 4714 4714 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221844] Normal free:357432kB >>> min:6884kB low:8604kB high:10324kB active_anon:1779992kB >>> inactive_anon:297440kB active_file:981924kB inactive_file:975108kB >>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>> present:4954112kB managed:4828124kB mlocked:0kB dirty:812kB >>> writeback:0kB mapped:52908kB shmem:13468kB slab_reclaimable:324000kB >>> slab_unreclaimable:24120kB kernel_stack:4160kB pagetables:23776kB >>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB >>> pages_scanned:24 all_unreclaimable? no >>> Nov 2 03:30:01 krshina3 kernel: [562035.221845] lowmem_reserve[]: 0 0 0 0 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221847] DMA: 1*4kB (U) 1*8kB >>> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >>> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >>> Nov 2 03:30:01 krshina3 kernel: [562035.221855] DMA32: 52520*4kB >>> (UEM) 5030*8kB (UE) 3*16kB (UR) 0*32kB 1*64kB (R) 0*128kB 0*256kB >>> 0*512kB 0*1024kB 0*2048kB 0*4096kB = 250432kB >>> Nov 2 03:30:01 krshina3 kernel: [562035.221861] Normal: 62961*4kB >>> (UEM) 11874*8kB (UEM) 640*16kB (UEMR) 17*32kB (UEMR) 1*64kB (E) >>> 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 357684kB >>> Nov 2 03:30:01 krshina3 kernel: [562035.221867] Node 0 >>> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >>> hugepages_size=2048kB >>> Nov 2 03:30:01 krshina3 kernel: [562035.221868] 804788 total pagecache >>> pages >>> Nov 2 03:30:01 krshina3 kernel: [562035.221869] 2600 pages in swap cache >>> Nov 2 03:30:01 krshina3 kernel: [562035.221870] Swap cache stats: add >>> 91111, delete 88511, find 38599/41340 >>> Nov 2 03:30:01 krshina3 kernel: [562035.221871] Free swap = 277028kB >>> Nov 2 03:30:01 krshina3 kernel: [562035.221872] Total swap = 594300kB >>> Nov 2 03:30:01 krshina3 kernel: [562035.221873] 2017164 pages RAM >>> Nov 2 03:30:01 krshina3 kernel: [562035.221873] 0 pages >>> HighMem/MovableOnly >>> Nov 2 03:30:01 krshina3 kernel: [562035.221874] 31497 pages reserved >>> >>> >>> >>> >>> Nov 2 09:13:48 krshina3 kernel: [582660.900521] reiser4: md125: found >>> disk format 4.0.0. >>> Nov 2 09:13:48 krshina3 kernel: [582660.900907] mount: page >>> allocation failure: order:4, mode:0x2040d0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900910] CPU: 1 PID: 1414 >>> Comm: mount Not tainted 3.16.5-gentoo #1 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900912] Hardware name: >>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>> 07/04/2012 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900914] 0000000000000000 >>> ffff880148093968 ffffffff816a31b4 0000000000000007 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900917] 00000000002040d0 >>> ffff8801480939f8 ffffffff810e609a ffffffff00000040 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900919] 0000000000000286 >>> ffffffff819a8a78 fffffff00000000f ffff8801480939c8 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900922] Call Trace: >>> Nov 2 09:13:48 krshina3 kernel: [582660.900929] [<ffffffff816a31b4>] >>> dump_stack+0x46/0x58 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900933] [<ffffffff810e609a>] >>> warn_alloc_failed+0xda/0x130 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900937] [<ffffffff810e86c9>] >>> __alloc_pages_nodemask+0x5d9/0x7a0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900941] [<ffffffff8111f16a>] >>> cache_alloc_refill+0x31a/0x550 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900945] [<ffffffff8111ee23>] >>> kmem_cache_alloc+0xb3/0xe0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900948] [<ffffffff81186529>] >>> znodes_tree_init+0xc9/0x120 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900951] [<ffffffff8118e7b4>] >>> reiser4_init_tree+0x44/0xd0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900955] [<ffffffff811cb905>] >>> init_format_format40+0x265/0x5b0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900959] [<ffffffff8119e8b1>] >>> fill_super+0x101/0x200 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900963] [<ffffffff81126be4>] >>> mount_bdev+0x194/0x1d0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900966] [<ffffffff8119e7b0>] >>> ? reiser4_mount+0x20/0x20 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900969] [<ffffffff8119e7a0>] >>> reiser4_mount+0x10/0x20 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900972] [<ffffffff81126e2b>] >>> mount_fs+0x1b/0xd0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900976] [<ffffffff8114042f>] >>> vfs_kern_mount+0x6f/0x130 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900979] [<ffffffff81141f68>] >>> do_mount+0x218/0xab0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900982] [<ffffffff810e88a2>] >>> ? __get_free_pages+0x12/0x60 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900986] [<ffffffff81141bf5>] >>> ? copy_mount_options+0x35/0x150 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900989] [<ffffffff81142ad9>] >>> SyS_mount+0x89/0xd0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900993] [<ffffffff816ab1d2>] >>> system_call_fastpath+0x16/0x1b >>> Nov 2 09:13:48 krshina3 kernel: [582660.900994] Mem-Info: >>> Nov 2 09:13:48 krshina3 kernel: [582660.900996] DMA per-cpu: >>> Nov 2 09:13:48 krshina3 kernel: [582660.900997] CPU 0: hi: 0, >>> btch: 1 usd: 0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.900999] CPU 1: hi: 0, >>> btch: 1 usd: 0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901000] CPU 2: hi: 0, >>> btch: 1 usd: 0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901001] CPU 3: hi: 0, >>> btch: 1 usd: 0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901002] DMA32 per-cpu: >>> Nov 2 09:13:48 krshina3 kernel: [582660.901004] CPU 0: hi: 186, >>> btch: 31 usd: 0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901005] CPU 1: hi: 186, >>> btch: 31 usd: 0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901006] CPU 2: hi: 186, >>> btch: 31 usd: 0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901008] CPU 3: hi: 186, >>> btch: 31 usd: 0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901009] Normal per-cpu: >>> Nov 2 09:13:48 krshina3 kernel: [582660.901010] CPU 0: hi: 186, >>> btch: 31 usd: 0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901011] CPU 1: hi: 186, >>> btch: 31 usd: 0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901013] CPU 2: hi: 186, >>> btch: 31 usd: 21 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901014] CPU 3: hi: 186, >>> btch: 31 usd: 0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] active_anon:719713 >>> inactive_anon:145280 isolated_anon:0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] active_file:390035 >>> inactive_file:389999 isolated_file:0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] unevictable:0 >>> dirty:1180 writeback:0 unstable:0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] free:161223 >>> slab_reclaimable:112227 slab_unreclaimable:9155 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] mapped:35966 >>> shmem:7263 pagetables:10549 bounce:0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] free_cma:0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901024] DMA free:15900kB >>> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >>> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >>> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >>> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >>> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >>> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>> all_unreclaimable? yes >>> Nov 2 09:13:48 krshina3 kernel: [582660.901026] lowmem_reserve[]: 0 >>> 2950 7665 7665 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901033] DMA32 free:243456kB >>> min:4308kB low:5384kB high:6460kB active_anon:1055312kB >>> inactive_anon:268364kB active_file:605480kB inactive_file:605344kB >>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>> present:3098560kB managed:3022260kB mlocked:0kB dirty:1728kB >>> writeback:0kB mapped:55944kB shmem:11860kB slab_reclaimable:164900kB >>> slab_unreclaimable:12340kB kernel_stack:2496kB pagetables:17284kB >>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>> all_unreclaimable? no >>> Nov 2 09:13:48 krshina3 kernel: [582660.901034] lowmem_reserve[]: 0 0 >>> 4714 4714 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901040] Normal free:385536kB >>> min:6884kB low:8604kB high:10324kB active_anon:1823540kB >>> inactive_anon:312756kB active_file:954660kB inactive_file:954652kB >>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>> present:4954112kB managed:4828124kB mlocked:0kB dirty:2992kB >>> writeback:0kB mapped:87920kB shmem:17192kB slab_reclaimable:284008kB >>> slab_unreclaimable:24280kB kernel_stack:4368kB pagetables:24912kB >>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB >>> pages_scanned:21 all_unreclaimable? no >>> Nov 2 09:13:48 krshina3 kernel: [582660.901041] lowmem_reserve[]: 0 0 0 0 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901044] DMA: 1*4kB (U) 1*8kB >>> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >>> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >>> Nov 2 09:13:48 krshina3 kernel: [582660.901054] DMA32: 46552*4kB (UE) >>> 7159*8kB (U) 2*16kB (R) 0*32kB 1*64kB (R) 0*128kB 0*256kB 0*512kB >>> 0*1024kB 0*2048kB 0*4096kB = 243576kB >>> Nov 2 09:13:48 krshina3 kernel: [582660.901063] Normal: 40881*4kB >>> (UEM) 27461*8kB (UEM) 151*16kB (UR) 2*32kB (R) 0*64kB 0*128kB 0*256kB >>> 0*512kB 0*1024kB 0*2048kB 0*4096kB = 385692kB >>> Nov 2 09:13:48 krshina3 kernel: [582660.901072] Node 0 >>> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >>> hugepages_size=2048kB >>> Nov 2 09:13:48 krshina3 kernel: [582660.901073] 789766 total pagecache >>> pages >>> Nov 2 09:13:48 krshina3 kernel: [582660.901075] 2404 pages in swap cache >>> Nov 2 09:13:48 krshina3 kernel: [582660.901076] Swap cache stats: add >>> 94924, delete 92520, find 40323/43073 >>> Nov 2 09:13:48 krshina3 kernel: [582660.901077] Free swap = 261888kB >>> Nov 2 09:13:48 krshina3 kernel: [582660.901078] Total swap = 594300kB >>> Nov 2 09:13:48 krshina3 kernel: [582660.901079] 2017164 pages RAM >>> Nov 2 09:13:48 krshina3 kernel: [582660.901080] 0 pages >>> HighMem/MovableOnly >>> Nov 2 09:13:48 krshina3 kernel: [582660.901081] 31497 pages reserved >>> >>> >>> Now I'm gonna fsck all partitions and report if anything comes up. >>> >>> Ask if you need more info >>> >>> Thanks in advance >>> Dushan >> >> -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-11-03 11:42 ` Edward Shishkin @ 2014-11-03 12:25 ` Dušan Čolić 2014-11-03 13:28 ` Dušan Čolić 0 siblings, 1 reply; 33+ messages in thread From: Dušan Čolić @ 2014-11-03 12:25 UTC (permalink / raw) To: Edward Shishkin; +Cc: reiserfs-devel, Ivan Shapovalov On Mon, Nov 3, 2014 at 12:42 PM, Edward Shishkin <edward.shishkin@gmail.com> wrote: > > On 11/03/2014 12:12 PM, Dušan Čolić wrote: >> >> I fscked it yesterday before crash and now I'm fsck-ing it again but >> as you remember it lasts 1hr+ for some reason. > > > > For the full 70G partition it looks normal. > > OK, if you can reproduce this BUG at fs/reiser4/plugin/item/ctail.c:669 > after fsck, then please let me know: it will essentially speed up things.. > This time it fscked the same partition much faster (44 vs 70min) dunno why as that partition is fscked daily with this cron script: #!/bin/sh echo "### RSNAPSHOT DAILY ###" fsck.reiser4 -a /dev/md125 && mount /mnt/backup && rsnapshot -c /etc/rsnapshot.d/daily.conf daily || echo "Backup failure" umount /mnt/backup logger -s "### RSNAPSHOT DAILY OK###" Now I executed rsnapshot -c /etc/rsnapshot.d/daily.conf daily and I can't see no action for last 10 minutes, nothing in iotop just in top rsync process in D state. krshina3 goran # ps -aux | grep rsync root 6655 0.1 0.1 101568 9328 pts/4 D+ 13:08 0:01 /usr/bin/rsync -ax --delete --numeric-ids --relative --delete-excluded --exclude=/home/windows.qcow2 --link-dest=/mnt/backup/daily.1/localhost/ /home /mnt/backup/daily.0/localhost/ root 6656 0.0 0.0 112292 4380 pts/4 S+ 13:08 0:00 /usr/bin/rsync -ax --delete --numeric-ids --relative --delete-excluded --exclude=/home/windows.qcow2 --link-dest=/mnt/backup/daily.1/localhost/ /home /mnt/backup/daily.0/localhost/ root 6657 0.0 0.0 101488 3496 pts/4 S+ 13:08 0:00 /usr/bin/rsync -ax --delete --numeric-ids --relative --delete-excluded --exclude=/home/windows.qcow2 --link-dest=/mnt/backup/daily.1/localhost/ /home /mnt/backup/daily.0/localhost/ fsck results: krshina3 goran # fsck.reiser4 /dev/md125 ******************************************************************* This is an EXPERIMENTAL version of fsck.reiser4. Read README first. ******************************************************************* Fscking the /dev/md125 block device. Will check the consistency of the Reiser4 SuperBlock. Will check the consistency of the Reiser4 FileSystem. Continue? (Yes/No): y ***** fsck.reiser4 started at Mon Nov 3 12:13:15 2014 Reiser4 fs was detected on /dev/md125. Master super block (16): magic: ReIsEr4 blksize: 4096 format: 0x0 (format40) uuid: 184e9560-bdf9-42b0-896c-0af2a0c84066 label: <none> Format super block (17): plugin: format40 description: Disk-format plugin. version: 0 magic: ReIsEr40FoRmAt mkfs id: 0x2a685787 flushes: 0 blocks: 17091120 free blocks: 2838775 root block: 7346608 tail policy: 0x2 (smart) next oid: 0xbc056d file count: 856668 tree height: 5 key policy: LARGE CHECKING THE STORAGE TREE Read nodes 9972078 Nodes left in the tree 9972078 Leaves of them 9855619, Twigs of them 115030 Time interval: Mon Nov 3 12:13:19 2014 - Mon Nov 3 12:27:35 2014 CHECKING EXTENT REGIONS. Read twigs 115030 Time interval: Mon Nov 3 12:27:35 2014 - Mon Nov 3 12:34:50 2014 CHECKING THE SEMANTIC TREE Found 2571171 objects (some could be encountered more then once). Time interval: Mon Nov 3 12:34:50 2014 - Mon Nov 3 12:57:16 2014 ***** fsck.reiser4 finished at Mon Nov 3 12:57:16 2014 Closing fs...done FS is consistent. > Edward. > > > > >> >> On Mon, Nov 3, 2014 at 12:10 PM, Edward Shishkin >> <edward.shishkin@gmail.com> wrote: >>> >>> On 11/03/2014 11:58 AM, Dušan Čolić wrote: >>> >>> Now a Bug happened to me on this same ccreg40 partition with >>> Reiser4-for-3.16.2.patch and I don't know if it's related. >>> >>> >>> >>> It can not be related to inability to allocate memory at mount time. >>> >>> >>> I have a partition that I use for daily, weekly and monthly snapshots - >>> /dev/md125 with rsnapshot. >>> I fsck-ed it yesterday. >>> >>> >>> >>> Did you fsck-ed it before, or after crash? >>> >>> Edward. >>> >>> >>> >>> After mounting rsync starts and snapshots my /home directory. This Bug >>> happened on rsync start. >>> >>> >>> rsnapshot log: >>> fsck.reiser4 /dev/md125 >>> rsync: writefd_unbuffered failed to write 5 bytes to socket [generator]: >>> Broken pipe (32) >>> rsync error: error in rsync protocol data stream (code 12) at io.c(1532) >>> [generator=3.0.9] >>> ------------------------------ >>> ---------------------------------------------- >>> rsnapshot encountered an error! The program was invoked with these >>> options: >>> /usr/bin/rsnapshot -c /etc/rsnapshot.d/daily.conf daily >>> >>> ---------------------------------------------------------------------------- >>> ERROR: /usr/bin/rsync returned 0.04296875 while processing /home/ >>> WARNING: Rolling back "localhost/" >>> Backup failure >>> >>> daily.conf: >>> include_conf /etc/rsnapshot.d/base.conf >>> >>> # Daily (30 increments) >>> interval daily 30 >>> backup /home/ localhost/ >>> exclude /home/windows.qcow2 >>> >>> base.conf: >>> >>> # Default config version >>> config_version 1.2 >>> >>> # So the hard disk is not polluted in case the backup filesystem is not >>> available >>> no_create_root 1 >>> >>> # Standard settings >>> cmd_cp /bin/cp >>> cmd_rm /bin/rm >>> cmd_rsync /usr/bin/rsync >>> link_dest 1 >>> cmd_rsnapshot_diff /usr/bin/rsnapshot-diff >>> >>> # For convenience, so that mount points can be taken as backup starting >>> points >>> one_fs 1 >>> >>> # Store all backups in one directory per machine >>> # A useful alternative may be to create a separate directory for each >>> interval >>> snapshot_root /mnt/backup/ >>> >>> Logs: >>> Nov 3 07:00:10 krshina3 kernel: [ 1650.974059] reiser4: md125: found >>> disk >>> format 4.0.0. >>> Nov 3 07:00:13 krshina3 kernel: [ 1654.207021] reiser4: md125: using >>> Hybrid >>> Transaction Model. >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.914414] ------------[ cut here >>> ]------------ >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.914682] kernel BUG at >>> fs/reiser4/plugin/item/ctail.c:669! >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.915010] invalid opcode: 0000 [#1] >>> SMP >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.915259] CPU: 0 PID: 4950 Comm: >>> rsync >>> Not tainted 3.16.5-gentoo #1 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.915625] Hardware name: Gigabyte >>> Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 07/04/2012 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.916183] task: ffff88022d3f17d0 >>> ti: >>> ffff880100004000 task.ti: ffff880100004000 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.916610] RIP: >>> 0010:[<ffffffff811c3a70>] [<ffffffff811c3a70>] >>> do_readpage_ctail+0x2c0/0x420 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.917111] RSP: >>> 0018:ffff880100007978 >>> EFLAGS: 00010246 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.917412] RAX: 8000000000000025 >>> RBX: >>> ffffea0004570218 RCX: ffff8800b94f0800 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.917819] RDX: 0000000000000035 >>> RSI: >>> 0000000000000000 RDI: ffff8800b94f0000 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.918226] RBP: ffff8801000079b8 >>> R08: >>> 0000000000001000 R09: 0000000000000001 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.918632] R10: ffffffff811b3fc0 >>> R11: >>> ffffea00023f1330 R12: 0000000000000002 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.919039] R13: ffff8801ebb78d20 >>> R14: >>> ffff880100007a88 R15: 0000000000000001 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.919450] FS: >>> 00007f4d6b27c700(0000) >>> GS:ffff88022e200000(0000) knlGS:0000000000000000 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.919912] CS: 0010 DS: 0000 ES: >>> 0000 >>> CR0: 0000000080050033 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.920239] CR2: 0000000003035ddf >>> CR3: >>> 0000000008a76000 CR4: 00000000001427e0 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.920645] Stack: >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.920756] ffff8801000079b8 >>> ffffffff811b5c4f ffffea0004570218 ffff880100007a88 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.921200] ffffea0004570218 >>> 0000000000000000 ffff8801ebb78d20 ffffffff811c3bd0 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.921643] ffff880100007a08 >>> ffffffff811c3cea ffff880100007a08 00000000810e1785 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.922087] Call Trace: >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.922226] [<ffffffff811b5c4f>] ? >>> prepare_page_cluster+0xff/0x1f0 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.922583] [<ffffffff811c3bd0>] ? >>> do_readpage_ctail+0x420/0x420 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.922931] [<ffffffff811c3cea>] >>> ctail_readpages_filler+0x11a/0x220 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.923299] [<ffffffff811c3bd0>] ? >>> do_readpage_ctail+0x420/0x420 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.923646] [<ffffffff810ebdfa>] >>> read_cache_pages+0xba/0x120 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.923973] [<ffffffff811c4073>] >>> readpages_ctail+0x133/0x360 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.924299] [<ffffffff811b7e76>] >>> readpages_cryptcompress+0x46/0x80 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.924656] [<ffffffff811a2b8e>] >>> reiser4_readpages_dispatch+0x3e/0x50 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.925029] [<ffffffff810ec009>] >>> __do_page_cache_readahead+0x1a9/0x240 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.925407] [<ffffffff810ec1f7>] >>> ondemand_readahead+0x157/0x290 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.925749] [<ffffffff810e2326>] ? >>> pagecache_get_page+0x36/0x1e0 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.926097] [<ffffffff810ec41e>] >>> page_cache_sync_readahead+0x2e/0x50 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.926464] [<ffffffff810e33e9>] >>> generic_file_read_iter+0x409/0x5f0 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.926827] [<ffffffff8112da8e>] ? >>> link_path_walk+0x26e/0x880 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.927160] [<ffffffff81122b49>] >>> new_sync_read+0x79/0xb0 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.927470] [<ffffffff811b7f23>] >>> read_cryptcompress+0x73/0xb0 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.927803] [<ffffffff811b21c2>] >>> reiser4_read_dispatch+0x72/0x160 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.928156] [<ffffffff81123abb>] >>> vfs_read+0x9b/0x190 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.928443] [<ffffffff8112408a>] >>> SyS_read+0x4a/0xc0 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.928726] [<ffffffff816ab1d2>] >>> system_call_fastpath+0x16/0x1b >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.929068] Code: fe ff ff 0f 1f 84 >>> 00 >>> 00 00 00 00 48 89 df e8 a8 e4 f1 ff e9 3c fe ff ff 0f 1f 00 48 89 df e8 >>> 98 >>> e4 f1 ff e9 73 fe ff ff 0f 1f 00 <0f> 0b 48 8b 03 a8 08 0f 84 a1 00 00 00 >>> 49 >>> 8b be 80 00 00 00 e8 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.930505] RIP [<ffffffff811c3a70>] >>> do_readpage_ctail+0x2c0/0x420 >>> Nov 3 07:00:52 krshina3 kernel: [ 1692.930868] RSP <ffff880100007978> >>> Nov 3 07:00:52 krshina3 kernel: [ 1693.043372] ---[ end trace >>> 36e8590f8aa347d3 ]--- >>> >>> On Sun, Nov 2, 2014 at 9:38 AM, Dušan Čolić <dusanc@gmail.com> wrote: >>>> >>>> When I try to mount a cc reiser4 partition (reiser4-for-3.16.2.patch) >>>> I get: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate >>>> memory >>>> Uptime is almost 7 days and mounting of this partition worked every >>>> day untill last night (I get automated messages on mail when something >>>> goes wrong). >>>> >>>> Now I tried on kernel 3.10 and everything works OK >>>> >>>> krshina3 goran # uname -a >>>> Linux krshina3 3.10.6-gentoo #2 SMP Wed Aug 14 17:33:45 CEST 2013 >>>> x86_64 Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz GenuineIntel GNU/Linux >>>> >>>> krshina3 goran# free -m >>>> total used free shared buffers >>>> cached >>>> Mem: 7681 6794 887 30 0 >>>> 2933 >>>> -/+ buffers/cache: 3860 3821 >>>> Swap: 580 325 254 >>>> >>>> krshina3 goran# cat /etc/fstab | grep -v "#" >>>> >>>> /dev/sda1 /boot ext2 noauto,noatime >>>> 1 >>>> 2 >>>> /dev/md123 none swap sw >>>> 0 >>>> 0 >>>> /dev/sda2 / reiser4 >>>> noatime,onerror=remount-ro 0 0 >>>> /dev/md125 /mnt/backup reiser4 >>>> noatime,noauto,onerror=remount-ro 0 0 >>>> /dev/md126 /mnt/media reiser4 >>>> noatime,users,onerror=remount-ro 0 0 >>>> /dev/md127 /usr/portage reiser4 >>>> noatime,onerror=remount-ro 0 0 >>>> shm /dev/shm tmpfs >>>> nodev,nosuid,noexec 0 0 >>>> >>>> >>>> krshina3 goran # df >>>> Filesystem 1K-blocks Used Available Use% Mounted on >>>> /dev/sda2 37017728 24870384 12147344 68% / >>>> tmpfs 786872 832 786040 1% /run >>>> udev 10240 0 10240 0% /dev >>>> shm 3934340 80 3934260 1% /dev/shm >>>> /dev/md126 383034100 298007740 85026360 78% /mnt/media >>>> /dev/md127 6113484 5427288 686196 89% /usr/portage >>>> /dev/md125 64959612 57618884 7340728 89% /mnt/backup >>>> >>>> I get these in logs: >>>> >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221513] reiser4: md125: found >>>> disk format 4.0.0. >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221749] mount: page >>>> allocation failure: order:4, mode:0x2040d0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221752] CPU: 0 PID: 517 Comm: >>>> mount Not tainted 3.16.5-gentoo #1 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221753] Hardware name: >>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>>> 07/04/2012 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221754] 0000000000000000 >>>> ffff88020ece7968 ffffffff816a31b4 0000000000000007 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221757] 00000000002040d0 >>>> ffff88020ece79f8 ffffffff810e609a ffffffff00000040 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221758] 0000000000000286 >>>> ffffffff819a8a78 fffffff00000000f ffff88020ece79c8 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221760] Call Trace: >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221765] [<ffffffff816a31b4>] >>>> dump_stack+0x46/0x58 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221768] [<ffffffff810e609a>] >>>> warn_alloc_failed+0xda/0x130 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221770] [<ffffffff810e86c9>] >>>> __alloc_pages_nodemask+0x5d9/0x7a0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221774] [<ffffffff8111f16a>] >>>> cache_alloc_refill+0x31a/0x550 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221776] [<ffffffff8111ee23>] >>>> kmem_cache_alloc+0xb3/0xe0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221778] [<ffffffff81186529>] >>>> znodes_tree_init+0xc9/0x120 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221781] [<ffffffff8118e7b4>] >>>> reiser4_init_tree+0x44/0xd0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221784] [<ffffffff811cb905>] >>>> init_format_format40+0x265/0x5b0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221787] [<ffffffff8119e8b1>] >>>> fill_super+0x101/0x200 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221789] [<ffffffff81126be4>] >>>> mount_bdev+0x194/0x1d0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221792] [<ffffffff8119e7b0>] >>>> ? reiser4_mount+0x20/0x20 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221794] [<ffffffff8119e7a0>] >>>> reiser4_mount+0x10/0x20 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221796] [<ffffffff81126e2b>] >>>> mount_fs+0x1b/0xd0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221799] [<ffffffff8114042f>] >>>> vfs_kern_mount+0x6f/0x130 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221801] [<ffffffff81141f68>] >>>> do_mount+0x218/0xab0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221803] [<ffffffff810e88a2>] >>>> ? __get_free_pages+0x12/0x60 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221805] [<ffffffff81141bf5>] >>>> ? copy_mount_options+0x35/0x150 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221808] [<ffffffff81142ad9>] >>>> SyS_mount+0x89/0xd0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221811] [<ffffffff816ab1d2>] >>>> system_call_fastpath+0x16/0x1b >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221812] Mem-Info: >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221813] DMA per-cpu: >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221814] CPU 0: hi: 0, >>>> btch: 1 usd: 0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221815] CPU 1: hi: 0, >>>> btch: 1 usd: 0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221816] CPU 2: hi: 0, >>>> btch: 1 usd: 0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221817] CPU 3: hi: 0, >>>> btch: 1 usd: 0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221817] DMA32 per-cpu: >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221819] CPU 0: hi: 186, >>>> btch: 31 usd: 0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221819] CPU 1: hi: 186, >>>> btch: 31 usd: 0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221820] CPU 2: hi: 186, >>>> btch: 31 usd: 0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221821] CPU 3: hi: 186, >>>> btch: 31 usd: 0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221822] Normal per-cpu: >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221823] CPU 0: hi: 186, >>>> btch: 31 usd: 0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221824] CPU 1: hi: 186, >>>> btch: 31 usd: 0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221825] CPU 2: hi: 186, >>>> btch: 31 usd: 56 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221826] CPU 3: hi: 186, >>>> btch: 31 usd: 0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] active_anon:701641 >>>> inactive_anon:138699 isolated_anon:0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] active_file:399519 >>>> inactive_file:396920 isolated_file:0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] unevictable:0 >>>> dirty:204 writeback:0 unstable:0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] free:155878 >>>> slab_reclaimable:126123 slab_unreclaimable:9074 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] mapped:21535 >>>> shmem:5701 pagetables:10162 bounce:0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] free_cma:0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221833] DMA free:15900kB >>>> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >>>> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >>>> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >>>> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >>>> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >>>> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>> all_unreclaimable? yes >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221834] lowmem_reserve[]: 0 >>>> 2950 7665 7665 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221839] DMA32 free:250180kB >>>> min:4308kB low:5384kB high:6460kB active_anon:1026572kB >>>> inactive_anon:257356kB active_file:616152kB inactive_file:612572kB >>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>> present:3098560kB managed:3022260kB mlocked:0kB dirty:4kB >>>> writeback:0kB mapped:33232kB shmem:9336kB slab_reclaimable:180492kB >>>> slab_unreclaimable:12176kB kernel_stack:2496kB pagetables:16872kB >>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>> all_unreclaimable? no >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221840] lowmem_reserve[]: 0 0 >>>> 4714 4714 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221844] Normal free:357432kB >>>> min:6884kB low:8604kB high:10324kB active_anon:1779992kB >>>> inactive_anon:297440kB active_file:981924kB inactive_file:975108kB >>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>> present:4954112kB managed:4828124kB mlocked:0kB dirty:812kB >>>> writeback:0kB mapped:52908kB shmem:13468kB slab_reclaimable:324000kB >>>> slab_unreclaimable:24120kB kernel_stack:4160kB pagetables:23776kB >>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB >>>> pages_scanned:24 all_unreclaimable? no >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221845] lowmem_reserve[]: 0 0 0 >>>> 0 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221847] DMA: 1*4kB (U) 1*8kB >>>> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >>>> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221855] DMA32: 52520*4kB >>>> (UEM) 5030*8kB (UE) 3*16kB (UR) 0*32kB 1*64kB (R) 0*128kB 0*256kB >>>> 0*512kB 0*1024kB 0*2048kB 0*4096kB = 250432kB >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221861] Normal: 62961*4kB >>>> (UEM) 11874*8kB (UEM) 640*16kB (UEMR) 17*32kB (UEMR) 1*64kB (E) >>>> 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 357684kB >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221867] Node 0 >>>> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >>>> hugepages_size=2048kB >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221868] 804788 total pagecache >>>> pages >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221869] 2600 pages in swap >>>> cache >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221870] Swap cache stats: add >>>> 91111, delete 88511, find 38599/41340 >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221871] Free swap = 277028kB >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221872] Total swap = 594300kB >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221873] 2017164 pages RAM >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221873] 0 pages >>>> HighMem/MovableOnly >>>> Nov 2 03:30:01 krshina3 kernel: [562035.221874] 31497 pages reserved >>>> >>>> >>>> >>>> >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900521] reiser4: md125: found >>>> disk format 4.0.0. >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900907] mount: page >>>> allocation failure: order:4, mode:0x2040d0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900910] CPU: 1 PID: 1414 >>>> Comm: mount Not tainted 3.16.5-gentoo #1 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900912] Hardware name: >>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>>> 07/04/2012 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900914] 0000000000000000 >>>> ffff880148093968 ffffffff816a31b4 0000000000000007 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900917] 00000000002040d0 >>>> ffff8801480939f8 ffffffff810e609a ffffffff00000040 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900919] 0000000000000286 >>>> ffffffff819a8a78 fffffff00000000f ffff8801480939c8 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900922] Call Trace: >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900929] [<ffffffff816a31b4>] >>>> dump_stack+0x46/0x58 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900933] [<ffffffff810e609a>] >>>> warn_alloc_failed+0xda/0x130 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900937] [<ffffffff810e86c9>] >>>> __alloc_pages_nodemask+0x5d9/0x7a0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900941] [<ffffffff8111f16a>] >>>> cache_alloc_refill+0x31a/0x550 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900945] [<ffffffff8111ee23>] >>>> kmem_cache_alloc+0xb3/0xe0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900948] [<ffffffff81186529>] >>>> znodes_tree_init+0xc9/0x120 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900951] [<ffffffff8118e7b4>] >>>> reiser4_init_tree+0x44/0xd0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900955] [<ffffffff811cb905>] >>>> init_format_format40+0x265/0x5b0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900959] [<ffffffff8119e8b1>] >>>> fill_super+0x101/0x200 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900963] [<ffffffff81126be4>] >>>> mount_bdev+0x194/0x1d0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900966] [<ffffffff8119e7b0>] >>>> ? reiser4_mount+0x20/0x20 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900969] [<ffffffff8119e7a0>] >>>> reiser4_mount+0x10/0x20 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900972] [<ffffffff81126e2b>] >>>> mount_fs+0x1b/0xd0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900976] [<ffffffff8114042f>] >>>> vfs_kern_mount+0x6f/0x130 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900979] [<ffffffff81141f68>] >>>> do_mount+0x218/0xab0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900982] [<ffffffff810e88a2>] >>>> ? __get_free_pages+0x12/0x60 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900986] [<ffffffff81141bf5>] >>>> ? copy_mount_options+0x35/0x150 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900989] [<ffffffff81142ad9>] >>>> SyS_mount+0x89/0xd0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900993] [<ffffffff816ab1d2>] >>>> system_call_fastpath+0x16/0x1b >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900994] Mem-Info: >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900996] DMA per-cpu: >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900997] CPU 0: hi: 0, >>>> btch: 1 usd: 0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.900999] CPU 1: hi: 0, >>>> btch: 1 usd: 0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901000] CPU 2: hi: 0, >>>> btch: 1 usd: 0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901001] CPU 3: hi: 0, >>>> btch: 1 usd: 0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901002] DMA32 per-cpu: >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901004] CPU 0: hi: 186, >>>> btch: 31 usd: 0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901005] CPU 1: hi: 186, >>>> btch: 31 usd: 0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901006] CPU 2: hi: 186, >>>> btch: 31 usd: 0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901008] CPU 3: hi: 186, >>>> btch: 31 usd: 0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901009] Normal per-cpu: >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901010] CPU 0: hi: 186, >>>> btch: 31 usd: 0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901011] CPU 1: hi: 186, >>>> btch: 31 usd: 0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901013] CPU 2: hi: 186, >>>> btch: 31 usd: 21 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901014] CPU 3: hi: 186, >>>> btch: 31 usd: 0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] active_anon:719713 >>>> inactive_anon:145280 isolated_anon:0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] active_file:390035 >>>> inactive_file:389999 isolated_file:0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] unevictable:0 >>>> dirty:1180 writeback:0 unstable:0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] free:161223 >>>> slab_reclaimable:112227 slab_unreclaimable:9155 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] mapped:35966 >>>> shmem:7263 pagetables:10549 bounce:0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] free_cma:0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901024] DMA free:15900kB >>>> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >>>> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >>>> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >>>> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >>>> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >>>> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>> all_unreclaimable? yes >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901026] lowmem_reserve[]: 0 >>>> 2950 7665 7665 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901033] DMA32 free:243456kB >>>> min:4308kB low:5384kB high:6460kB active_anon:1055312kB >>>> inactive_anon:268364kB active_file:605480kB inactive_file:605344kB >>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>> present:3098560kB managed:3022260kB mlocked:0kB dirty:1728kB >>>> writeback:0kB mapped:55944kB shmem:11860kB slab_reclaimable:164900kB >>>> slab_unreclaimable:12340kB kernel_stack:2496kB pagetables:17284kB >>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>> all_unreclaimable? no >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901034] lowmem_reserve[]: 0 0 >>>> 4714 4714 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901040] Normal free:385536kB >>>> min:6884kB low:8604kB high:10324kB active_anon:1823540kB >>>> inactive_anon:312756kB active_file:954660kB inactive_file:954652kB >>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>> present:4954112kB managed:4828124kB mlocked:0kB dirty:2992kB >>>> writeback:0kB mapped:87920kB shmem:17192kB slab_reclaimable:284008kB >>>> slab_unreclaimable:24280kB kernel_stack:4368kB pagetables:24912kB >>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB >>>> pages_scanned:21 all_unreclaimable? no >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901041] lowmem_reserve[]: 0 0 0 >>>> 0 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901044] DMA: 1*4kB (U) 1*8kB >>>> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >>>> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901054] DMA32: 46552*4kB (UE) >>>> 7159*8kB (U) 2*16kB (R) 0*32kB 1*64kB (R) 0*128kB 0*256kB 0*512kB >>>> 0*1024kB 0*2048kB 0*4096kB = 243576kB >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901063] Normal: 40881*4kB >>>> (UEM) 27461*8kB (UEM) 151*16kB (UR) 2*32kB (R) 0*64kB 0*128kB 0*256kB >>>> 0*512kB 0*1024kB 0*2048kB 0*4096kB = 385692kB >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901072] Node 0 >>>> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >>>> hugepages_size=2048kB >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901073] 789766 total pagecache >>>> pages >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901075] 2404 pages in swap >>>> cache >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901076] Swap cache stats: add >>>> 94924, delete 92520, find 40323/43073 >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901077] Free swap = 261888kB >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901078] Total swap = 594300kB >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901079] 2017164 pages RAM >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901080] 0 pages >>>> HighMem/MovableOnly >>>> Nov 2 09:13:48 krshina3 kernel: [582660.901081] 31497 pages reserved >>>> >>>> >>>> Now I'm gonna fsck all partitions and report if anything comes up. >>>> >>>> Ask if you need more info >>>> >>>> Thanks in advance >>>> Dushan >>> >>> >>> > -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-11-03 12:25 ` Dušan Čolić @ 2014-11-03 13:28 ` Dušan Čolić 2014-11-03 13:33 ` Dušan Čolić 2014-11-03 13:36 ` Edward Shishkin 0 siblings, 2 replies; 33+ messages in thread From: Dušan Čolić @ 2014-11-03 13:28 UTC (permalink / raw) To: Edward Shishkin; +Cc: reiserfs-devel, Ivan Shapovalov After an hour or more still nothing, one rsync went to zombie other still in D state I killed the main process and rebooted. krshina3 goran # ps -aux | grep rsync root 6655 0.0 0.1 101568 9328 pts/4 D 13:08 0:01 /usr/bin/rsync -ax --delete --numeric-ids --relative --delete-excluded --exclude=/home/windows.qcow2 --link-dest=/mnt/backup/daily.1/localhost/ /home /mnt/backup/daily.0/localhost/ root 6656 0.0 0.0 0 0 pts/4 Z 13:08 0:00 [rsync] <defunct> Now I tried same command (rsnapshot -c /etc/rsnapshot.d/daily.conf daily) and kernel BUGed with: krshina3 goran # rsnapshot -c /etc/rsnapshot.d/daily.conf daily rsync: writefd_unbuffered failed to write 5 bytes to socket [generator]: Broken pipe (32) ---------------------------------------------------------------------------- rsnapshot encountered an error! The program was invoked with these options: /usr/bin/rsnapshot -c /etc/rsnapshot.d/daily.conf daily ---------------------------------------------------------------------------- ERROR: /usr/bin/rsync returned 0.04296875 while processing /home/ WARNING: Rolling back "localhost/" rsync error: error in rsync protocol data stream (code 12) at io.c(1532) [generator=3.0.9] Nov 3 14:25:56 krshina3 kernel: [ 282.735583] ------------[ cut here ]------------ Nov 3 14:25:56 krshina3 kernel: [ 282.735905] kernel BUG at fs/reiser4/plugin/item/ctail.c:669! Nov 3 14:25:56 krshina3 kernel: [ 282.736296] invalid opcode: 0000 [#1] SMP Nov 3 14:25:56 krshina3 kernel: [ 282.736575] CPU: 3 PID: 3890 Comm: rsync Not tainted 3.16.5-gentoo #1 Nov 3 14:25:56 krshina3 kernel: [ 282.736996] Hardware name: Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 07/04/2012 Nov 3 14:25:56 krshina3 kernel: [ 282.737635] task: ffff8801adeeb010 ti: ffff880050d08000 task.ti: ffff880050d08000 Nov 3 14:25:56 krshina3 kernel: [ 282.738132] RIP: 0010:[<ffffffff811c3a70>] [<ffffffff811c3a70>] do_readpage_ctail+0x2c0/0x420 Nov 3 14:25:56 krshina3 kernel: [ 282.738713] RSP: 0018:ffff880050d0b978 EFLAGS: 00010246 Nov 3 14:25:56 krshina3 kernel: [ 282.739080] RAX: 8000000000000025 RBX: ffffea0005586f98 RCX: ffff8800b9563800 Nov 3 14:25:56 krshina3 kernel: [ 282.739546] RDX: 0000000000000035 RSI: 0000000000000000 RDI: ffff8800b9563000 Nov 3 14:25:56 krshina3 kernel: [ 282.740013] RBP: ffff880050d0b9b8 R08: 0000000000001000 R09: 0000000000000001 Nov 3 14:25:56 krshina3 kernel: [ 282.740480] R10: ffffffff811b3fc0 R11: ffffea00011718c8 R12: 0000000000000002 Nov 3 14:25:56 krshina3 kernel: [ 282.740963] R13: ffff880075770d60 R14: ffff880050d0ba88 R15: 0000000000000001 Nov 3 14:25:56 krshina3 kernel: [ 282.741429] FS: 00007f4355338700(0000) GS:ffff88022e380000(0000) knlGS:0000000000000000 Nov 3 14:25:56 krshina3 kernel: [ 282.741957] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Nov 3 14:25:56 krshina3 kernel: [ 282.742329] CR2: 0000000003604268 CR3: 0000000050c86000 CR4: 00000000001427e0 Nov 3 14:25:56 krshina3 kernel: [ 282.742794] Stack: Nov 3 14:25:56 krshina3 kernel: [ 282.742922] ffff880050d0b9b8 ffffffff811b5c4f ffffea0005586f98 ffff880050d0ba88 Nov 3 14:25:56 krshina3 kernel: [ 282.743449] ffffea0005586f98 0000000000000000 ffff880075770d60 ffffffff811c3bd0 Nov 3 14:25:56 krshina3 kernel: [ 282.743957] ffff880050d0ba08 ffffffff811c3cea ffff880050d0ba08 00000000810e1785 Nov 3 14:25:56 krshina3 kernel: [ 282.744465] Call Trace: Nov 3 14:25:56 krshina3 kernel: [ 282.744624] [<ffffffff811b5c4f>] ? prepare_page_cluster+0xff/0x1f0 Nov 3 14:25:56 krshina3 kernel: [ 282.745034] [<ffffffff811c3bd0>] ? do_readpage_ctail+0x420/0x420 Nov 3 14:25:56 krshina3 kernel: [ 282.745432] [<ffffffff811c3cea>] ctail_readpages_filler+0x11a/0x220 Nov 3 14:25:56 krshina3 kernel: [ 282.745847] [<ffffffff811c3bd0>] ? do_readpage_ctail+0x420/0x420 Nov 3 14:25:56 krshina3 kernel: [ 282.746248] [<ffffffff810ebdfa>] read_cache_pages+0xba/0x120 Nov 3 14:25:56 krshina3 kernel: [ 282.746623] [<ffffffff811c4073>] readpages_ctail+0x133/0x360 Nov 3 14:25:56 krshina3 kernel: [ 282.746998] [<ffffffff811b7e76>] readpages_cryptcompress+0x46/0x80 Nov 3 14:25:56 krshina3 kernel: [ 282.747413] [<ffffffff811a2b8e>] reiser4_readpages_dispatch+0x3e/0x50 Nov 3 14:25:56 krshina3 kernel: [ 282.747841] [<ffffffff810ec009>] __do_page_cache_readahead+0x1a9/0x240 Nov 3 14:25:56 krshina3 kernel: [ 282.748293] [<ffffffff810ec1f7>] ondemand_readahead+0x157/0x290 Nov 3 14:25:56 krshina3 kernel: [ 282.748686] [<ffffffff810e2326>] ? pagecache_get_page+0x36/0x1e0 Nov 3 14:25:56 krshina3 kernel: [ 282.749084] [<ffffffff810ec41e>] page_cache_sync_readahead+0x2e/0x50 Nov 3 14:25:56 krshina3 kernel: [ 282.749506] [<ffffffff810e33e9>] generic_file_read_iter+0x409/0x5f0 Nov 3 14:25:56 krshina3 kernel: [ 282.749922] [<ffffffff8112da8e>] ? link_path_walk+0x26e/0x880 Nov 3 14:25:56 krshina3 kernel: [ 282.750304] [<ffffffff810ed8e9>] ? lru_cache_add+0x9/0x10 Nov 3 14:25:56 krshina3 kernel: [ 282.750663] [<ffffffff8110c98e>] ? page_add_new_anon_rmap+0x7e/0xd0 Nov 3 14:25:56 krshina3 kernel: [ 282.751082] [<ffffffff81122b49>] new_sync_read+0x79/0xb0 Nov 3 14:25:56 krshina3 kernel: [ 282.751435] [<ffffffff811b7f23>] read_cryptcompress+0x73/0xb0 Nov 3 14:25:56 krshina3 kernel: [ 282.751815] [<ffffffff811b21c2>] reiser4_read_dispatch+0x72/0x160 Nov 3 14:25:56 krshina3 kernel: [ 282.752221] [<ffffffff81123abb>] vfs_read+0x9b/0x190 Nov 3 14:25:56 krshina3 kernel: [ 282.752551] [<ffffffff8112408a>] SyS_read+0x4a/0xc0 Nov 3 14:25:56 krshina3 kernel: [ 282.752875] [<ffffffff8106d72c>] ? do_page_fault+0xc/0x10 Nov 3 14:25:56 krshina3 kernel: [ 282.753245] [<ffffffff816ab1d2>] system_call_fastpath+0x16/0x1b Nov 3 14:25:56 krshina3 kernel: [ 282.753636] Code: fe ff ff 0f 1f 84 00 00 00 00 00 48 89 df e8 a8 e4 f1 ff e9 3c fe ff ff 0f 1f 00 48 89 df e8 98 e4 f1 ff e9 73 fe ff ff 0f 1f 00 <0f> 0b 48 8b 03 a8 08 0f 84 a1 00 00 00 49 8b be 80 00 00 00 e8 Nov 3 14:25:56 krshina3 kernel: [ 282.755335] RIP [<ffffffff811c3a70>] do_readpage_ctail+0x2c0/0x420 Nov 3 14:25:56 krshina3 kernel: [ 282.755750] RSP <ffff880050d0b978> Nov 3 14:25:56 krshina3 kernel: [ 282.888599] ---[ end trace 5749d003e849c626 ]--- On Mon, Nov 3, 2014 at 1:25 PM, Dušan Čolić <dusanc@gmail.com> wrote: > On Mon, Nov 3, 2014 at 12:42 PM, Edward Shishkin > <edward.shishkin@gmail.com> wrote: >> >> On 11/03/2014 12:12 PM, Dušan Čolić wrote: >>> >>> I fscked it yesterday before crash and now I'm fsck-ing it again but >>> as you remember it lasts 1hr+ for some reason. >> >> >> >> For the full 70G partition it looks normal. >> >> OK, if you can reproduce this BUG at fs/reiser4/plugin/item/ctail.c:669 >> after fsck, then please let me know: it will essentially speed up things.. >> > This time it fscked the same partition much faster (44 vs 70min) dunno > why as that partition is fscked daily with this cron script: > #!/bin/sh > > echo "### RSNAPSHOT DAILY ###" > fsck.reiser4 -a /dev/md125 && mount /mnt/backup && rsnapshot -c > /etc/rsnapshot.d/daily.conf daily || echo "Backup failure" > umount /mnt/backup > logger -s "### RSNAPSHOT DAILY OK###" > > Now I executed rsnapshot -c /etc/rsnapshot.d/daily.conf daily and I > can't see no action for last 10 minutes, nothing in iotop just in top > rsync process in D state. > > krshina3 goran # ps -aux | grep rsync > root 6655 0.1 0.1 101568 9328 pts/4 D+ 13:08 0:01 > /usr/bin/rsync -ax --delete --numeric-ids --relative --delete-excluded > --exclude=/home/windows.qcow2 > --link-dest=/mnt/backup/daily.1/localhost/ /home > /mnt/backup/daily.0/localhost/ > root 6656 0.0 0.0 112292 4380 pts/4 S+ 13:08 0:00 > /usr/bin/rsync -ax --delete --numeric-ids --relative --delete-excluded > --exclude=/home/windows.qcow2 > --link-dest=/mnt/backup/daily.1/localhost/ /home > /mnt/backup/daily.0/localhost/ > root 6657 0.0 0.0 101488 3496 pts/4 S+ 13:08 0:00 > /usr/bin/rsync -ax --delete --numeric-ids --relative --delete-excluded > --exclude=/home/windows.qcow2 > --link-dest=/mnt/backup/daily.1/localhost/ /home > /mnt/backup/daily.0/localhost/ > > > fsck results: > > krshina3 goran # fsck.reiser4 /dev/md125 > ******************************************************************* > This is an EXPERIMENTAL version of fsck.reiser4. Read README first. > ******************************************************************* > > Fscking the /dev/md125 block device. > Will check the consistency of the Reiser4 SuperBlock. > Will check the consistency of the Reiser4 FileSystem. > Continue? > (Yes/No): y > ***** fsck.reiser4 started at Mon Nov 3 12:13:15 2014 > Reiser4 fs was detected on /dev/md125. > Master super block (16): > magic: ReIsEr4 > blksize: 4096 > format: 0x0 (format40) > uuid: 184e9560-bdf9-42b0-896c-0af2a0c84066 > label: <none> > > Format super block (17): > plugin: format40 > description: Disk-format plugin. > version: 0 > magic: ReIsEr40FoRmAt > mkfs id: 0x2a685787 > flushes: 0 > blocks: 17091120 > free blocks: 2838775 > root block: 7346608 > tail policy: 0x2 (smart) > next oid: 0xbc056d > file count: 856668 > tree height: 5 > key policy: LARGE > > > CHECKING THE STORAGE TREE > Read nodes 9972078 > Nodes left in the tree 9972078 > Leaves of them 9855619, Twigs of them 115030 > Time interval: Mon Nov 3 12:13:19 2014 - Mon Nov 3 12:27:35 2014 > CHECKING EXTENT REGIONS. > Read twigs 115030 > Time interval: Mon Nov 3 12:27:35 2014 - Mon Nov 3 12:34:50 2014 > CHECKING THE SEMANTIC TREE > Found 2571171 objects (some could be encountered more then > once). > Time interval: Mon Nov 3 12:34:50 2014 - Mon Nov 3 12:57:16 2014 > ***** fsck.reiser4 finished at Mon Nov 3 12:57:16 2014 > Closing fs...done > > FS is consistent. > > > > > > > >> Edward. >> >> >> >> >>> >>> On Mon, Nov 3, 2014 at 12:10 PM, Edward Shishkin >>> <edward.shishkin@gmail.com> wrote: >>>> >>>> On 11/03/2014 11:58 AM, Dušan Čolić wrote: >>>> >>>> Now a Bug happened to me on this same ccreg40 partition with >>>> Reiser4-for-3.16.2.patch and I don't know if it's related. >>>> >>>> >>>> >>>> It can not be related to inability to allocate memory at mount time. >>>> >>>> >>>> I have a partition that I use for daily, weekly and monthly snapshots - >>>> /dev/md125 with rsnapshot. >>>> I fsck-ed it yesterday. >>>> >>>> >>>> >>>> Did you fsck-ed it before, or after crash? >>>> >>>> Edward. >>>> >>>> >>>> >>>> After mounting rsync starts and snapshots my /home directory. This Bug >>>> happened on rsync start. >>>> >>>> >>>> rsnapshot log: >>>> fsck.reiser4 /dev/md125 >>>> rsync: writefd_unbuffered failed to write 5 bytes to socket [generator]: >>>> Broken pipe (32) >>>> rsync error: error in rsync protocol data stream (code 12) at io.c(1532) >>>> [generator=3.0.9] >>>> ------------------------------ >>>> ---------------------------------------------- >>>> rsnapshot encountered an error! The program was invoked with these >>>> options: >>>> /usr/bin/rsnapshot -c /etc/rsnapshot.d/daily.conf daily >>>> >>>> ---------------------------------------------------------------------------- >>>> ERROR: /usr/bin/rsync returned 0.04296875 while processing /home/ >>>> WARNING: Rolling back "localhost/" >>>> Backup failure >>>> >>>> daily.conf: >>>> include_conf /etc/rsnapshot.d/base.conf >>>> >>>> # Daily (30 increments) >>>> interval daily 30 >>>> backup /home/ localhost/ >>>> exclude /home/windows.qcow2 >>>> >>>> base.conf: >>>> >>>> # Default config version >>>> config_version 1.2 >>>> >>>> # So the hard disk is not polluted in case the backup filesystem is not >>>> available >>>> no_create_root 1 >>>> >>>> # Standard settings >>>> cmd_cp /bin/cp >>>> cmd_rm /bin/rm >>>> cmd_rsync /usr/bin/rsync >>>> link_dest 1 >>>> cmd_rsnapshot_diff /usr/bin/rsnapshot-diff >>>> >>>> # For convenience, so that mount points can be taken as backup starting >>>> points >>>> one_fs 1 >>>> >>>> # Store all backups in one directory per machine >>>> # A useful alternative may be to create a separate directory for each >>>> interval >>>> snapshot_root /mnt/backup/ >>>> >>>> Logs: >>>> Nov 3 07:00:10 krshina3 kernel: [ 1650.974059] reiser4: md125: found >>>> disk >>>> format 4.0.0. >>>> Nov 3 07:00:13 krshina3 kernel: [ 1654.207021] reiser4: md125: using >>>> Hybrid >>>> Transaction Model. >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.914414] ------------[ cut here >>>> ]------------ >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.914682] kernel BUG at >>>> fs/reiser4/plugin/item/ctail.c:669! >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.915010] invalid opcode: 0000 [#1] >>>> SMP >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.915259] CPU: 0 PID: 4950 Comm: >>>> rsync >>>> Not tainted 3.16.5-gentoo #1 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.915625] Hardware name: Gigabyte >>>> Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 07/04/2012 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.916183] task: ffff88022d3f17d0 >>>> ti: >>>> ffff880100004000 task.ti: ffff880100004000 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.916610] RIP: >>>> 0010:[<ffffffff811c3a70>] [<ffffffff811c3a70>] >>>> do_readpage_ctail+0x2c0/0x420 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.917111] RSP: >>>> 0018:ffff880100007978 >>>> EFLAGS: 00010246 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.917412] RAX: 8000000000000025 >>>> RBX: >>>> ffffea0004570218 RCX: ffff8800b94f0800 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.917819] RDX: 0000000000000035 >>>> RSI: >>>> 0000000000000000 RDI: ffff8800b94f0000 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.918226] RBP: ffff8801000079b8 >>>> R08: >>>> 0000000000001000 R09: 0000000000000001 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.918632] R10: ffffffff811b3fc0 >>>> R11: >>>> ffffea00023f1330 R12: 0000000000000002 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.919039] R13: ffff8801ebb78d20 >>>> R14: >>>> ffff880100007a88 R15: 0000000000000001 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.919450] FS: >>>> 00007f4d6b27c700(0000) >>>> GS:ffff88022e200000(0000) knlGS:0000000000000000 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.919912] CS: 0010 DS: 0000 ES: >>>> 0000 >>>> CR0: 0000000080050033 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.920239] CR2: 0000000003035ddf >>>> CR3: >>>> 0000000008a76000 CR4: 00000000001427e0 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.920645] Stack: >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.920756] ffff8801000079b8 >>>> ffffffff811b5c4f ffffea0004570218 ffff880100007a88 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.921200] ffffea0004570218 >>>> 0000000000000000 ffff8801ebb78d20 ffffffff811c3bd0 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.921643] ffff880100007a08 >>>> ffffffff811c3cea ffff880100007a08 00000000810e1785 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.922087] Call Trace: >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.922226] [<ffffffff811b5c4f>] ? >>>> prepare_page_cluster+0xff/0x1f0 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.922583] [<ffffffff811c3bd0>] ? >>>> do_readpage_ctail+0x420/0x420 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.922931] [<ffffffff811c3cea>] >>>> ctail_readpages_filler+0x11a/0x220 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.923299] [<ffffffff811c3bd0>] ? >>>> do_readpage_ctail+0x420/0x420 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.923646] [<ffffffff810ebdfa>] >>>> read_cache_pages+0xba/0x120 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.923973] [<ffffffff811c4073>] >>>> readpages_ctail+0x133/0x360 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.924299] [<ffffffff811b7e76>] >>>> readpages_cryptcompress+0x46/0x80 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.924656] [<ffffffff811a2b8e>] >>>> reiser4_readpages_dispatch+0x3e/0x50 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.925029] [<ffffffff810ec009>] >>>> __do_page_cache_readahead+0x1a9/0x240 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.925407] [<ffffffff810ec1f7>] >>>> ondemand_readahead+0x157/0x290 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.925749] [<ffffffff810e2326>] ? >>>> pagecache_get_page+0x36/0x1e0 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.926097] [<ffffffff810ec41e>] >>>> page_cache_sync_readahead+0x2e/0x50 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.926464] [<ffffffff810e33e9>] >>>> generic_file_read_iter+0x409/0x5f0 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.926827] [<ffffffff8112da8e>] ? >>>> link_path_walk+0x26e/0x880 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.927160] [<ffffffff81122b49>] >>>> new_sync_read+0x79/0xb0 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.927470] [<ffffffff811b7f23>] >>>> read_cryptcompress+0x73/0xb0 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.927803] [<ffffffff811b21c2>] >>>> reiser4_read_dispatch+0x72/0x160 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.928156] [<ffffffff81123abb>] >>>> vfs_read+0x9b/0x190 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.928443] [<ffffffff8112408a>] >>>> SyS_read+0x4a/0xc0 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.928726] [<ffffffff816ab1d2>] >>>> system_call_fastpath+0x16/0x1b >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.929068] Code: fe ff ff 0f 1f 84 >>>> 00 >>>> 00 00 00 00 48 89 df e8 a8 e4 f1 ff e9 3c fe ff ff 0f 1f 00 48 89 df e8 >>>> 98 >>>> e4 f1 ff e9 73 fe ff ff 0f 1f 00 <0f> 0b 48 8b 03 a8 08 0f 84 a1 00 00 00 >>>> 49 >>>> 8b be 80 00 00 00 e8 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.930505] RIP [<ffffffff811c3a70>] >>>> do_readpage_ctail+0x2c0/0x420 >>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.930868] RSP <ffff880100007978> >>>> Nov 3 07:00:52 krshina3 kernel: [ 1693.043372] ---[ end trace >>>> 36e8590f8aa347d3 ]--- >>>> >>>> On Sun, Nov 2, 2014 at 9:38 AM, Dušan Čolić <dusanc@gmail.com> wrote: >>>>> >>>>> When I try to mount a cc reiser4 partition (reiser4-for-3.16.2.patch) >>>>> I get: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate >>>>> memory >>>>> Uptime is almost 7 days and mounting of this partition worked every >>>>> day untill last night (I get automated messages on mail when something >>>>> goes wrong). >>>>> >>>>> Now I tried on kernel 3.10 and everything works OK >>>>> >>>>> krshina3 goran # uname -a >>>>> Linux krshina3 3.10.6-gentoo #2 SMP Wed Aug 14 17:33:45 CEST 2013 >>>>> x86_64 Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz GenuineIntel GNU/Linux >>>>> >>>>> krshina3 goran# free -m >>>>> total used free shared buffers >>>>> cached >>>>> Mem: 7681 6794 887 30 0 >>>>> 2933 >>>>> -/+ buffers/cache: 3860 3821 >>>>> Swap: 580 325 254 >>>>> >>>>> krshina3 goran# cat /etc/fstab | grep -v "#" >>>>> >>>>> /dev/sda1 /boot ext2 noauto,noatime >>>>> 1 >>>>> 2 >>>>> /dev/md123 none swap sw >>>>> 0 >>>>> 0 >>>>> /dev/sda2 / reiser4 >>>>> noatime,onerror=remount-ro 0 0 >>>>> /dev/md125 /mnt/backup reiser4 >>>>> noatime,noauto,onerror=remount-ro 0 0 >>>>> /dev/md126 /mnt/media reiser4 >>>>> noatime,users,onerror=remount-ro 0 0 >>>>> /dev/md127 /usr/portage reiser4 >>>>> noatime,onerror=remount-ro 0 0 >>>>> shm /dev/shm tmpfs >>>>> nodev,nosuid,noexec 0 0 >>>>> >>>>> >>>>> krshina3 goran # df >>>>> Filesystem 1K-blocks Used Available Use% Mounted on >>>>> /dev/sda2 37017728 24870384 12147344 68% / >>>>> tmpfs 786872 832 786040 1% /run >>>>> udev 10240 0 10240 0% /dev >>>>> shm 3934340 80 3934260 1% /dev/shm >>>>> /dev/md126 383034100 298007740 85026360 78% /mnt/media >>>>> /dev/md127 6113484 5427288 686196 89% /usr/portage >>>>> /dev/md125 64959612 57618884 7340728 89% /mnt/backup >>>>> >>>>> I get these in logs: >>>>> >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221513] reiser4: md125: found >>>>> disk format 4.0.0. >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221749] mount: page >>>>> allocation failure: order:4, mode:0x2040d0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221752] CPU: 0 PID: 517 Comm: >>>>> mount Not tainted 3.16.5-gentoo #1 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221753] Hardware name: >>>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>>>> 07/04/2012 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221754] 0000000000000000 >>>>> ffff88020ece7968 ffffffff816a31b4 0000000000000007 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221757] 00000000002040d0 >>>>> ffff88020ece79f8 ffffffff810e609a ffffffff00000040 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221758] 0000000000000286 >>>>> ffffffff819a8a78 fffffff00000000f ffff88020ece79c8 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221760] Call Trace: >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221765] [<ffffffff816a31b4>] >>>>> dump_stack+0x46/0x58 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221768] [<ffffffff810e609a>] >>>>> warn_alloc_failed+0xda/0x130 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221770] [<ffffffff810e86c9>] >>>>> __alloc_pages_nodemask+0x5d9/0x7a0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221774] [<ffffffff8111f16a>] >>>>> cache_alloc_refill+0x31a/0x550 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221776] [<ffffffff8111ee23>] >>>>> kmem_cache_alloc+0xb3/0xe0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221778] [<ffffffff81186529>] >>>>> znodes_tree_init+0xc9/0x120 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221781] [<ffffffff8118e7b4>] >>>>> reiser4_init_tree+0x44/0xd0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221784] [<ffffffff811cb905>] >>>>> init_format_format40+0x265/0x5b0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221787] [<ffffffff8119e8b1>] >>>>> fill_super+0x101/0x200 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221789] [<ffffffff81126be4>] >>>>> mount_bdev+0x194/0x1d0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221792] [<ffffffff8119e7b0>] >>>>> ? reiser4_mount+0x20/0x20 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221794] [<ffffffff8119e7a0>] >>>>> reiser4_mount+0x10/0x20 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221796] [<ffffffff81126e2b>] >>>>> mount_fs+0x1b/0xd0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221799] [<ffffffff8114042f>] >>>>> vfs_kern_mount+0x6f/0x130 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221801] [<ffffffff81141f68>] >>>>> do_mount+0x218/0xab0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221803] [<ffffffff810e88a2>] >>>>> ? __get_free_pages+0x12/0x60 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221805] [<ffffffff81141bf5>] >>>>> ? copy_mount_options+0x35/0x150 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221808] [<ffffffff81142ad9>] >>>>> SyS_mount+0x89/0xd0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221811] [<ffffffff816ab1d2>] >>>>> system_call_fastpath+0x16/0x1b >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221812] Mem-Info: >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221813] DMA per-cpu: >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221814] CPU 0: hi: 0, >>>>> btch: 1 usd: 0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221815] CPU 1: hi: 0, >>>>> btch: 1 usd: 0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221816] CPU 2: hi: 0, >>>>> btch: 1 usd: 0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221817] CPU 3: hi: 0, >>>>> btch: 1 usd: 0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221817] DMA32 per-cpu: >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221819] CPU 0: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221819] CPU 1: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221820] CPU 2: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221821] CPU 3: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221822] Normal per-cpu: >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221823] CPU 0: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221824] CPU 1: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221825] CPU 2: hi: 186, >>>>> btch: 31 usd: 56 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221826] CPU 3: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] active_anon:701641 >>>>> inactive_anon:138699 isolated_anon:0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] active_file:399519 >>>>> inactive_file:396920 isolated_file:0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] unevictable:0 >>>>> dirty:204 writeback:0 unstable:0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] free:155878 >>>>> slab_reclaimable:126123 slab_unreclaimable:9074 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] mapped:21535 >>>>> shmem:5701 pagetables:10162 bounce:0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] free_cma:0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221833] DMA free:15900kB >>>>> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >>>>> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >>>>> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >>>>> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >>>>> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >>>>> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>>> all_unreclaimable? yes >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221834] lowmem_reserve[]: 0 >>>>> 2950 7665 7665 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221839] DMA32 free:250180kB >>>>> min:4308kB low:5384kB high:6460kB active_anon:1026572kB >>>>> inactive_anon:257356kB active_file:616152kB inactive_file:612572kB >>>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>>> present:3098560kB managed:3022260kB mlocked:0kB dirty:4kB >>>>> writeback:0kB mapped:33232kB shmem:9336kB slab_reclaimable:180492kB >>>>> slab_unreclaimable:12176kB kernel_stack:2496kB pagetables:16872kB >>>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>>> all_unreclaimable? no >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221840] lowmem_reserve[]: 0 0 >>>>> 4714 4714 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221844] Normal free:357432kB >>>>> min:6884kB low:8604kB high:10324kB active_anon:1779992kB >>>>> inactive_anon:297440kB active_file:981924kB inactive_file:975108kB >>>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>>> present:4954112kB managed:4828124kB mlocked:0kB dirty:812kB >>>>> writeback:0kB mapped:52908kB shmem:13468kB slab_reclaimable:324000kB >>>>> slab_unreclaimable:24120kB kernel_stack:4160kB pagetables:23776kB >>>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB >>>>> pages_scanned:24 all_unreclaimable? no >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221845] lowmem_reserve[]: 0 0 0 >>>>> 0 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221847] DMA: 1*4kB (U) 1*8kB >>>>> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >>>>> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221855] DMA32: 52520*4kB >>>>> (UEM) 5030*8kB (UE) 3*16kB (UR) 0*32kB 1*64kB (R) 0*128kB 0*256kB >>>>> 0*512kB 0*1024kB 0*2048kB 0*4096kB = 250432kB >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221861] Normal: 62961*4kB >>>>> (UEM) 11874*8kB (UEM) 640*16kB (UEMR) 17*32kB (UEMR) 1*64kB (E) >>>>> 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 357684kB >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221867] Node 0 >>>>> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >>>>> hugepages_size=2048kB >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221868] 804788 total pagecache >>>>> pages >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221869] 2600 pages in swap >>>>> cache >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221870] Swap cache stats: add >>>>> 91111, delete 88511, find 38599/41340 >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221871] Free swap = 277028kB >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221872] Total swap = 594300kB >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221873] 2017164 pages RAM >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221873] 0 pages >>>>> HighMem/MovableOnly >>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221874] 31497 pages reserved >>>>> >>>>> >>>>> >>>>> >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900521] reiser4: md125: found >>>>> disk format 4.0.0. >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900907] mount: page >>>>> allocation failure: order:4, mode:0x2040d0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900910] CPU: 1 PID: 1414 >>>>> Comm: mount Not tainted 3.16.5-gentoo #1 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900912] Hardware name: >>>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>>>> 07/04/2012 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900914] 0000000000000000 >>>>> ffff880148093968 ffffffff816a31b4 0000000000000007 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900917] 00000000002040d0 >>>>> ffff8801480939f8 ffffffff810e609a ffffffff00000040 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900919] 0000000000000286 >>>>> ffffffff819a8a78 fffffff00000000f ffff8801480939c8 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900922] Call Trace: >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900929] [<ffffffff816a31b4>] >>>>> dump_stack+0x46/0x58 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900933] [<ffffffff810e609a>] >>>>> warn_alloc_failed+0xda/0x130 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900937] [<ffffffff810e86c9>] >>>>> __alloc_pages_nodemask+0x5d9/0x7a0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900941] [<ffffffff8111f16a>] >>>>> cache_alloc_refill+0x31a/0x550 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900945] [<ffffffff8111ee23>] >>>>> kmem_cache_alloc+0xb3/0xe0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900948] [<ffffffff81186529>] >>>>> znodes_tree_init+0xc9/0x120 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900951] [<ffffffff8118e7b4>] >>>>> reiser4_init_tree+0x44/0xd0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900955] [<ffffffff811cb905>] >>>>> init_format_format40+0x265/0x5b0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900959] [<ffffffff8119e8b1>] >>>>> fill_super+0x101/0x200 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900963] [<ffffffff81126be4>] >>>>> mount_bdev+0x194/0x1d0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900966] [<ffffffff8119e7b0>] >>>>> ? reiser4_mount+0x20/0x20 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900969] [<ffffffff8119e7a0>] >>>>> reiser4_mount+0x10/0x20 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900972] [<ffffffff81126e2b>] >>>>> mount_fs+0x1b/0xd0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900976] [<ffffffff8114042f>] >>>>> vfs_kern_mount+0x6f/0x130 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900979] [<ffffffff81141f68>] >>>>> do_mount+0x218/0xab0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900982] [<ffffffff810e88a2>] >>>>> ? __get_free_pages+0x12/0x60 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900986] [<ffffffff81141bf5>] >>>>> ? copy_mount_options+0x35/0x150 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900989] [<ffffffff81142ad9>] >>>>> SyS_mount+0x89/0xd0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900993] [<ffffffff816ab1d2>] >>>>> system_call_fastpath+0x16/0x1b >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900994] Mem-Info: >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900996] DMA per-cpu: >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900997] CPU 0: hi: 0, >>>>> btch: 1 usd: 0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900999] CPU 1: hi: 0, >>>>> btch: 1 usd: 0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901000] CPU 2: hi: 0, >>>>> btch: 1 usd: 0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901001] CPU 3: hi: 0, >>>>> btch: 1 usd: 0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901002] DMA32 per-cpu: >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901004] CPU 0: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901005] CPU 1: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901006] CPU 2: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901008] CPU 3: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901009] Normal per-cpu: >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901010] CPU 0: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901011] CPU 1: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901013] CPU 2: hi: 186, >>>>> btch: 31 usd: 21 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901014] CPU 3: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] active_anon:719713 >>>>> inactive_anon:145280 isolated_anon:0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] active_file:390035 >>>>> inactive_file:389999 isolated_file:0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] unevictable:0 >>>>> dirty:1180 writeback:0 unstable:0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] free:161223 >>>>> slab_reclaimable:112227 slab_unreclaimable:9155 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] mapped:35966 >>>>> shmem:7263 pagetables:10549 bounce:0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] free_cma:0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901024] DMA free:15900kB >>>>> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >>>>> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >>>>> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >>>>> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >>>>> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >>>>> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>>> all_unreclaimable? yes >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901026] lowmem_reserve[]: 0 >>>>> 2950 7665 7665 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901033] DMA32 free:243456kB >>>>> min:4308kB low:5384kB high:6460kB active_anon:1055312kB >>>>> inactive_anon:268364kB active_file:605480kB inactive_file:605344kB >>>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>>> present:3098560kB managed:3022260kB mlocked:0kB dirty:1728kB >>>>> writeback:0kB mapped:55944kB shmem:11860kB slab_reclaimable:164900kB >>>>> slab_unreclaimable:12340kB kernel_stack:2496kB pagetables:17284kB >>>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>>> all_unreclaimable? no >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901034] lowmem_reserve[]: 0 0 >>>>> 4714 4714 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901040] Normal free:385536kB >>>>> min:6884kB low:8604kB high:10324kB active_anon:1823540kB >>>>> inactive_anon:312756kB active_file:954660kB inactive_file:954652kB >>>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>>> present:4954112kB managed:4828124kB mlocked:0kB dirty:2992kB >>>>> writeback:0kB mapped:87920kB shmem:17192kB slab_reclaimable:284008kB >>>>> slab_unreclaimable:24280kB kernel_stack:4368kB pagetables:24912kB >>>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB >>>>> pages_scanned:21 all_unreclaimable? no >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901041] lowmem_reserve[]: 0 0 0 >>>>> 0 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901044] DMA: 1*4kB (U) 1*8kB >>>>> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >>>>> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901054] DMA32: 46552*4kB (UE) >>>>> 7159*8kB (U) 2*16kB (R) 0*32kB 1*64kB (R) 0*128kB 0*256kB 0*512kB >>>>> 0*1024kB 0*2048kB 0*4096kB = 243576kB >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901063] Normal: 40881*4kB >>>>> (UEM) 27461*8kB (UEM) 151*16kB (UR) 2*32kB (R) 0*64kB 0*128kB 0*256kB >>>>> 0*512kB 0*1024kB 0*2048kB 0*4096kB = 385692kB >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901072] Node 0 >>>>> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >>>>> hugepages_size=2048kB >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901073] 789766 total pagecache >>>>> pages >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901075] 2404 pages in swap >>>>> cache >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901076] Swap cache stats: add >>>>> 94924, delete 92520, find 40323/43073 >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901077] Free swap = 261888kB >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901078] Total swap = 594300kB >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901079] 2017164 pages RAM >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901080] 0 pages >>>>> HighMem/MovableOnly >>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901081] 31497 pages reserved >>>>> >>>>> >>>>> Now I'm gonna fsck all partitions and report if anything comes up. >>>>> >>>>> Ask if you need more info >>>>> >>>>> Thanks in advance >>>>> Dushan >>>> >>>> >>>> >> -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-11-03 13:28 ` Dušan Čolić @ 2014-11-03 13:33 ` Dušan Čolić 2014-11-03 15:42 ` Edward Shishkin 2014-11-03 13:36 ` Edward Shishkin 1 sibling, 1 reply; 33+ messages in thread From: Dušan Čolić @ 2014-11-03 13:33 UTC (permalink / raw) To: Edward Shishkin; +Cc: reiserfs-devel, Ivan Shapovalov I forgot: It was working for some time (deleting old directories etc.) and then crashed. Btw. why didn't that partition (/dev/md125) remounted read-only on error when I have that in /etc/fstab? On Mon, Nov 3, 2014 at 2:28 PM, Dušan Čolić <dusanc@gmail.com> wrote: > After an hour or more still nothing, one rsync went to zombie other > still in D state > I killed the main process and rebooted. > > krshina3 goran # ps -aux | grep rsync > root 6655 0.0 0.1 101568 9328 pts/4 D 13:08 0:01 > /usr/bin/rsync -ax --delete --numeric-ids --relative --delete-excluded > --exclude=/home/windows.qcow2 > --link-dest=/mnt/backup/daily.1/localhost/ /home > /mnt/backup/daily.0/localhost/ > root 6656 0.0 0.0 0 0 pts/4 Z 13:08 0:00 > [rsync] <defunct> > > > Now I tried same command (rsnapshot -c /etc/rsnapshot.d/daily.conf > daily) and kernel BUGed with: > > krshina3 goran # rsnapshot -c /etc/rsnapshot.d/daily.conf daily > rsync: writefd_unbuffered failed to write 5 bytes to socket > [generator]: Broken pipe (32) > ---------------------------------------------------------------------------- > rsnapshot encountered an error! The program was invoked with these options: > /usr/bin/rsnapshot -c /etc/rsnapshot.d/daily.conf daily > ---------------------------------------------------------------------------- > ERROR: /usr/bin/rsync returned 0.04296875 while processing /home/ > WARNING: Rolling back "localhost/" > rsync error: error in rsync protocol data stream (code 12) at > io.c(1532) [generator=3.0.9] > > > > Nov 3 14:25:56 krshina3 kernel: [ 282.735583] ------------[ cut here > ]------------ > Nov 3 14:25:56 krshina3 kernel: [ 282.735905] kernel BUG at > fs/reiser4/plugin/item/ctail.c:669! > Nov 3 14:25:56 krshina3 kernel: [ 282.736296] invalid opcode: 0000 [#1] SMP > Nov 3 14:25:56 krshina3 kernel: [ 282.736575] CPU: 3 PID: 3890 Comm: > rsync Not tainted 3.16.5-gentoo #1 > Nov 3 14:25:56 krshina3 kernel: [ 282.736996] Hardware name: > Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 > 07/04/2012 > Nov 3 14:25:56 krshina3 kernel: [ 282.737635] task: ffff8801adeeb010 > ti: ffff880050d08000 task.ti: ffff880050d08000 > Nov 3 14:25:56 krshina3 kernel: [ 282.738132] RIP: > 0010:[<ffffffff811c3a70>] [<ffffffff811c3a70>] > do_readpage_ctail+0x2c0/0x420 > Nov 3 14:25:56 krshina3 kernel: [ 282.738713] RSP: > 0018:ffff880050d0b978 EFLAGS: 00010246 > Nov 3 14:25:56 krshina3 kernel: [ 282.739080] RAX: 8000000000000025 > RBX: ffffea0005586f98 RCX: ffff8800b9563800 > Nov 3 14:25:56 krshina3 kernel: [ 282.739546] RDX: 0000000000000035 > RSI: 0000000000000000 RDI: ffff8800b9563000 > Nov 3 14:25:56 krshina3 kernel: [ 282.740013] RBP: ffff880050d0b9b8 > R08: 0000000000001000 R09: 0000000000000001 > Nov 3 14:25:56 krshina3 kernel: [ 282.740480] R10: ffffffff811b3fc0 > R11: ffffea00011718c8 R12: 0000000000000002 > Nov 3 14:25:56 krshina3 kernel: [ 282.740963] R13: ffff880075770d60 > R14: ffff880050d0ba88 R15: 0000000000000001 > Nov 3 14:25:56 krshina3 kernel: [ 282.741429] FS: > 00007f4355338700(0000) GS:ffff88022e380000(0000) > knlGS:0000000000000000 > Nov 3 14:25:56 krshina3 kernel: [ 282.741957] CS: 0010 DS: 0000 ES: > 0000 CR0: 0000000080050033 > Nov 3 14:25:56 krshina3 kernel: [ 282.742329] CR2: 0000000003604268 > CR3: 0000000050c86000 CR4: 00000000001427e0 > Nov 3 14:25:56 krshina3 kernel: [ 282.742794] Stack: > Nov 3 14:25:56 krshina3 kernel: [ 282.742922] ffff880050d0b9b8 > ffffffff811b5c4f ffffea0005586f98 ffff880050d0ba88 > Nov 3 14:25:56 krshina3 kernel: [ 282.743449] ffffea0005586f98 > 0000000000000000 ffff880075770d60 ffffffff811c3bd0 > Nov 3 14:25:56 krshina3 kernel: [ 282.743957] ffff880050d0ba08 > ffffffff811c3cea ffff880050d0ba08 00000000810e1785 > Nov 3 14:25:56 krshina3 kernel: [ 282.744465] Call Trace: > Nov 3 14:25:56 krshina3 kernel: [ 282.744624] [<ffffffff811b5c4f>] > ? prepare_page_cluster+0xff/0x1f0 > Nov 3 14:25:56 krshina3 kernel: [ 282.745034] [<ffffffff811c3bd0>] > ? do_readpage_ctail+0x420/0x420 > Nov 3 14:25:56 krshina3 kernel: [ 282.745432] [<ffffffff811c3cea>] > ctail_readpages_filler+0x11a/0x220 > Nov 3 14:25:56 krshina3 kernel: [ 282.745847] [<ffffffff811c3bd0>] > ? do_readpage_ctail+0x420/0x420 > Nov 3 14:25:56 krshina3 kernel: [ 282.746248] [<ffffffff810ebdfa>] > read_cache_pages+0xba/0x120 > Nov 3 14:25:56 krshina3 kernel: [ 282.746623] [<ffffffff811c4073>] > readpages_ctail+0x133/0x360 > Nov 3 14:25:56 krshina3 kernel: [ 282.746998] [<ffffffff811b7e76>] > readpages_cryptcompress+0x46/0x80 > Nov 3 14:25:56 krshina3 kernel: [ 282.747413] [<ffffffff811a2b8e>] > reiser4_readpages_dispatch+0x3e/0x50 > Nov 3 14:25:56 krshina3 kernel: [ 282.747841] [<ffffffff810ec009>] > __do_page_cache_readahead+0x1a9/0x240 > Nov 3 14:25:56 krshina3 kernel: [ 282.748293] [<ffffffff810ec1f7>] > ondemand_readahead+0x157/0x290 > Nov 3 14:25:56 krshina3 kernel: [ 282.748686] [<ffffffff810e2326>] > ? pagecache_get_page+0x36/0x1e0 > Nov 3 14:25:56 krshina3 kernel: [ 282.749084] [<ffffffff810ec41e>] > page_cache_sync_readahead+0x2e/0x50 > Nov 3 14:25:56 krshina3 kernel: [ 282.749506] [<ffffffff810e33e9>] > generic_file_read_iter+0x409/0x5f0 > Nov 3 14:25:56 krshina3 kernel: [ 282.749922] [<ffffffff8112da8e>] > ? link_path_walk+0x26e/0x880 > Nov 3 14:25:56 krshina3 kernel: [ 282.750304] [<ffffffff810ed8e9>] > ? lru_cache_add+0x9/0x10 > Nov 3 14:25:56 krshina3 kernel: [ 282.750663] [<ffffffff8110c98e>] > ? page_add_new_anon_rmap+0x7e/0xd0 > Nov 3 14:25:56 krshina3 kernel: [ 282.751082] [<ffffffff81122b49>] > new_sync_read+0x79/0xb0 > Nov 3 14:25:56 krshina3 kernel: [ 282.751435] [<ffffffff811b7f23>] > read_cryptcompress+0x73/0xb0 > Nov 3 14:25:56 krshina3 kernel: [ 282.751815] [<ffffffff811b21c2>] > reiser4_read_dispatch+0x72/0x160 > Nov 3 14:25:56 krshina3 kernel: [ 282.752221] [<ffffffff81123abb>] > vfs_read+0x9b/0x190 > Nov 3 14:25:56 krshina3 kernel: [ 282.752551] [<ffffffff8112408a>] > SyS_read+0x4a/0xc0 > Nov 3 14:25:56 krshina3 kernel: [ 282.752875] [<ffffffff8106d72c>] > ? do_page_fault+0xc/0x10 > Nov 3 14:25:56 krshina3 kernel: [ 282.753245] [<ffffffff816ab1d2>] > system_call_fastpath+0x16/0x1b > Nov 3 14:25:56 krshina3 kernel: [ 282.753636] Code: fe ff ff 0f 1f > 84 00 00 00 00 00 48 89 df e8 a8 e4 f1 ff e9 3c fe ff ff 0f 1f 00 48 > 89 df e8 98 e4 f1 ff e9 73 fe ff ff 0f 1f 00 <0f> 0b 48 8b 03 a8 08 0f > 84 a1 00 00 00 49 8b be 80 00 00 00 e8 > Nov 3 14:25:56 krshina3 kernel: [ 282.755335] RIP > [<ffffffff811c3a70>] do_readpage_ctail+0x2c0/0x420 > Nov 3 14:25:56 krshina3 kernel: [ 282.755750] RSP <ffff880050d0b978> > Nov 3 14:25:56 krshina3 kernel: [ 282.888599] ---[ end trace > 5749d003e849c626 ]--- > > On Mon, Nov 3, 2014 at 1:25 PM, Dušan Čolić <dusanc@gmail.com> wrote: >> On Mon, Nov 3, 2014 at 12:42 PM, Edward Shishkin >> <edward.shishkin@gmail.com> wrote: >>> >>> On 11/03/2014 12:12 PM, Dušan Čolić wrote: >>>> >>>> I fscked it yesterday before crash and now I'm fsck-ing it again but >>>> as you remember it lasts 1hr+ for some reason. >>> >>> >>> >>> For the full 70G partition it looks normal. >>> >>> OK, if you can reproduce this BUG at fs/reiser4/plugin/item/ctail.c:669 >>> after fsck, then please let me know: it will essentially speed up things.. >>> >> This time it fscked the same partition much faster (44 vs 70min) dunno >> why as that partition is fscked daily with this cron script: >> #!/bin/sh >> >> echo "### RSNAPSHOT DAILY ###" >> fsck.reiser4 -a /dev/md125 && mount /mnt/backup && rsnapshot -c >> /etc/rsnapshot.d/daily.conf daily || echo "Backup failure" >> umount /mnt/backup >> logger -s "### RSNAPSHOT DAILY OK###" >> >> Now I executed rsnapshot -c /etc/rsnapshot.d/daily.conf daily and I >> can't see no action for last 10 minutes, nothing in iotop just in top >> rsync process in D state. >> >> krshina3 goran # ps -aux | grep rsync >> root 6655 0.1 0.1 101568 9328 pts/4 D+ 13:08 0:01 >> /usr/bin/rsync -ax --delete --numeric-ids --relative --delete-excluded >> --exclude=/home/windows.qcow2 >> --link-dest=/mnt/backup/daily.1/localhost/ /home >> /mnt/backup/daily.0/localhost/ >> root 6656 0.0 0.0 112292 4380 pts/4 S+ 13:08 0:00 >> /usr/bin/rsync -ax --delete --numeric-ids --relative --delete-excluded >> --exclude=/home/windows.qcow2 >> --link-dest=/mnt/backup/daily.1/localhost/ /home >> /mnt/backup/daily.0/localhost/ >> root 6657 0.0 0.0 101488 3496 pts/4 S+ 13:08 0:00 >> /usr/bin/rsync -ax --delete --numeric-ids --relative --delete-excluded >> --exclude=/home/windows.qcow2 >> --link-dest=/mnt/backup/daily.1/localhost/ /home >> /mnt/backup/daily.0/localhost/ >> >> >> fsck results: >> >> krshina3 goran # fsck.reiser4 /dev/md125 >> ******************************************************************* >> This is an EXPERIMENTAL version of fsck.reiser4. Read README first. >> ******************************************************************* >> >> Fscking the /dev/md125 block device. >> Will check the consistency of the Reiser4 SuperBlock. >> Will check the consistency of the Reiser4 FileSystem. >> Continue? >> (Yes/No): y >> ***** fsck.reiser4 started at Mon Nov 3 12:13:15 2014 >> Reiser4 fs was detected on /dev/md125. >> Master super block (16): >> magic: ReIsEr4 >> blksize: 4096 >> format: 0x0 (format40) >> uuid: 184e9560-bdf9-42b0-896c-0af2a0c84066 >> label: <none> >> >> Format super block (17): >> plugin: format40 >> description: Disk-format plugin. >> version: 0 >> magic: ReIsEr40FoRmAt >> mkfs id: 0x2a685787 >> flushes: 0 >> blocks: 17091120 >> free blocks: 2838775 >> root block: 7346608 >> tail policy: 0x2 (smart) >> next oid: 0xbc056d >> file count: 856668 >> tree height: 5 >> key policy: LARGE >> >> >> CHECKING THE STORAGE TREE >> Read nodes 9972078 >> Nodes left in the tree 9972078 >> Leaves of them 9855619, Twigs of them 115030 >> Time interval: Mon Nov 3 12:13:19 2014 - Mon Nov 3 12:27:35 2014 >> CHECKING EXTENT REGIONS. >> Read twigs 115030 >> Time interval: Mon Nov 3 12:27:35 2014 - Mon Nov 3 12:34:50 2014 >> CHECKING THE SEMANTIC TREE >> Found 2571171 objects (some could be encountered more then >> once). >> Time interval: Mon Nov 3 12:34:50 2014 - Mon Nov 3 12:57:16 2014 >> ***** fsck.reiser4 finished at Mon Nov 3 12:57:16 2014 >> Closing fs...done >> >> FS is consistent. >> >> >> >> >> >> >> >>> Edward. >>> >>> >>> >>> >>>> >>>> On Mon, Nov 3, 2014 at 12:10 PM, Edward Shishkin >>>> <edward.shishkin@gmail.com> wrote: >>>>> >>>>> On 11/03/2014 11:58 AM, Dušan Čolić wrote: >>>>> >>>>> Now a Bug happened to me on this same ccreg40 partition with >>>>> Reiser4-for-3.16.2.patch and I don't know if it's related. >>>>> >>>>> >>>>> >>>>> It can not be related to inability to allocate memory at mount time. >>>>> >>>>> >>>>> I have a partition that I use for daily, weekly and monthly snapshots - >>>>> /dev/md125 with rsnapshot. >>>>> I fsck-ed it yesterday. >>>>> >>>>> >>>>> >>>>> Did you fsck-ed it before, or after crash? >>>>> >>>>> Edward. >>>>> >>>>> >>>>> >>>>> After mounting rsync starts and snapshots my /home directory. This Bug >>>>> happened on rsync start. >>>>> >>>>> >>>>> rsnapshot log: >>>>> fsck.reiser4 /dev/md125 >>>>> rsync: writefd_unbuffered failed to write 5 bytes to socket [generator]: >>>>> Broken pipe (32) >>>>> rsync error: error in rsync protocol data stream (code 12) at io.c(1532) >>>>> [generator=3.0.9] >>>>> ------------------------------ >>>>> ---------------------------------------------- >>>>> rsnapshot encountered an error! The program was invoked with these >>>>> options: >>>>> /usr/bin/rsnapshot -c /etc/rsnapshot.d/daily.conf daily >>>>> >>>>> ---------------------------------------------------------------------------- >>>>> ERROR: /usr/bin/rsync returned 0.04296875 while processing /home/ >>>>> WARNING: Rolling back "localhost/" >>>>> Backup failure >>>>> >>>>> daily.conf: >>>>> include_conf /etc/rsnapshot.d/base.conf >>>>> >>>>> # Daily (30 increments) >>>>> interval daily 30 >>>>> backup /home/ localhost/ >>>>> exclude /home/windows.qcow2 >>>>> >>>>> base.conf: >>>>> >>>>> # Default config version >>>>> config_version 1.2 >>>>> >>>>> # So the hard disk is not polluted in case the backup filesystem is not >>>>> available >>>>> no_create_root 1 >>>>> >>>>> # Standard settings >>>>> cmd_cp /bin/cp >>>>> cmd_rm /bin/rm >>>>> cmd_rsync /usr/bin/rsync >>>>> link_dest 1 >>>>> cmd_rsnapshot_diff /usr/bin/rsnapshot-diff >>>>> >>>>> # For convenience, so that mount points can be taken as backup starting >>>>> points >>>>> one_fs 1 >>>>> >>>>> # Store all backups in one directory per machine >>>>> # A useful alternative may be to create a separate directory for each >>>>> interval >>>>> snapshot_root /mnt/backup/ >>>>> >>>>> Logs: >>>>> Nov 3 07:00:10 krshina3 kernel: [ 1650.974059] reiser4: md125: found >>>>> disk >>>>> format 4.0.0. >>>>> Nov 3 07:00:13 krshina3 kernel: [ 1654.207021] reiser4: md125: using >>>>> Hybrid >>>>> Transaction Model. >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.914414] ------------[ cut here >>>>> ]------------ >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.914682] kernel BUG at >>>>> fs/reiser4/plugin/item/ctail.c:669! >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.915010] invalid opcode: 0000 [#1] >>>>> SMP >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.915259] CPU: 0 PID: 4950 Comm: >>>>> rsync >>>>> Not tainted 3.16.5-gentoo #1 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.915625] Hardware name: Gigabyte >>>>> Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 07/04/2012 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.916183] task: ffff88022d3f17d0 >>>>> ti: >>>>> ffff880100004000 task.ti: ffff880100004000 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.916610] RIP: >>>>> 0010:[<ffffffff811c3a70>] [<ffffffff811c3a70>] >>>>> do_readpage_ctail+0x2c0/0x420 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.917111] RSP: >>>>> 0018:ffff880100007978 >>>>> EFLAGS: 00010246 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.917412] RAX: 8000000000000025 >>>>> RBX: >>>>> ffffea0004570218 RCX: ffff8800b94f0800 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.917819] RDX: 0000000000000035 >>>>> RSI: >>>>> 0000000000000000 RDI: ffff8800b94f0000 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.918226] RBP: ffff8801000079b8 >>>>> R08: >>>>> 0000000000001000 R09: 0000000000000001 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.918632] R10: ffffffff811b3fc0 >>>>> R11: >>>>> ffffea00023f1330 R12: 0000000000000002 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.919039] R13: ffff8801ebb78d20 >>>>> R14: >>>>> ffff880100007a88 R15: 0000000000000001 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.919450] FS: >>>>> 00007f4d6b27c700(0000) >>>>> GS:ffff88022e200000(0000) knlGS:0000000000000000 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.919912] CS: 0010 DS: 0000 ES: >>>>> 0000 >>>>> CR0: 0000000080050033 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.920239] CR2: 0000000003035ddf >>>>> CR3: >>>>> 0000000008a76000 CR4: 00000000001427e0 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.920645] Stack: >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.920756] ffff8801000079b8 >>>>> ffffffff811b5c4f ffffea0004570218 ffff880100007a88 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.921200] ffffea0004570218 >>>>> 0000000000000000 ffff8801ebb78d20 ffffffff811c3bd0 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.921643] ffff880100007a08 >>>>> ffffffff811c3cea ffff880100007a08 00000000810e1785 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.922087] Call Trace: >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.922226] [<ffffffff811b5c4f>] ? >>>>> prepare_page_cluster+0xff/0x1f0 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.922583] [<ffffffff811c3bd0>] ? >>>>> do_readpage_ctail+0x420/0x420 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.922931] [<ffffffff811c3cea>] >>>>> ctail_readpages_filler+0x11a/0x220 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.923299] [<ffffffff811c3bd0>] ? >>>>> do_readpage_ctail+0x420/0x420 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.923646] [<ffffffff810ebdfa>] >>>>> read_cache_pages+0xba/0x120 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.923973] [<ffffffff811c4073>] >>>>> readpages_ctail+0x133/0x360 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.924299] [<ffffffff811b7e76>] >>>>> readpages_cryptcompress+0x46/0x80 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.924656] [<ffffffff811a2b8e>] >>>>> reiser4_readpages_dispatch+0x3e/0x50 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.925029] [<ffffffff810ec009>] >>>>> __do_page_cache_readahead+0x1a9/0x240 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.925407] [<ffffffff810ec1f7>] >>>>> ondemand_readahead+0x157/0x290 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.925749] [<ffffffff810e2326>] ? >>>>> pagecache_get_page+0x36/0x1e0 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.926097] [<ffffffff810ec41e>] >>>>> page_cache_sync_readahead+0x2e/0x50 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.926464] [<ffffffff810e33e9>] >>>>> generic_file_read_iter+0x409/0x5f0 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.926827] [<ffffffff8112da8e>] ? >>>>> link_path_walk+0x26e/0x880 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.927160] [<ffffffff81122b49>] >>>>> new_sync_read+0x79/0xb0 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.927470] [<ffffffff811b7f23>] >>>>> read_cryptcompress+0x73/0xb0 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.927803] [<ffffffff811b21c2>] >>>>> reiser4_read_dispatch+0x72/0x160 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.928156] [<ffffffff81123abb>] >>>>> vfs_read+0x9b/0x190 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.928443] [<ffffffff8112408a>] >>>>> SyS_read+0x4a/0xc0 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.928726] [<ffffffff816ab1d2>] >>>>> system_call_fastpath+0x16/0x1b >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.929068] Code: fe ff ff 0f 1f 84 >>>>> 00 >>>>> 00 00 00 00 48 89 df e8 a8 e4 f1 ff e9 3c fe ff ff 0f 1f 00 48 89 df e8 >>>>> 98 >>>>> e4 f1 ff e9 73 fe ff ff 0f 1f 00 <0f> 0b 48 8b 03 a8 08 0f 84 a1 00 00 00 >>>>> 49 >>>>> 8b be 80 00 00 00 e8 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.930505] RIP [<ffffffff811c3a70>] >>>>> do_readpage_ctail+0x2c0/0x420 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.930868] RSP <ffff880100007978> >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1693.043372] ---[ end trace >>>>> 36e8590f8aa347d3 ]--- >>>>> >>>>> On Sun, Nov 2, 2014 at 9:38 AM, Dušan Čolić <dusanc@gmail.com> wrote: >>>>>> >>>>>> When I try to mount a cc reiser4 partition (reiser4-for-3.16.2.patch) >>>>>> I get: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate >>>>>> memory >>>>>> Uptime is almost 7 days and mounting of this partition worked every >>>>>> day untill last night (I get automated messages on mail when something >>>>>> goes wrong). >>>>>> >>>>>> Now I tried on kernel 3.10 and everything works OK >>>>>> >>>>>> krshina3 goran # uname -a >>>>>> Linux krshina3 3.10.6-gentoo #2 SMP Wed Aug 14 17:33:45 CEST 2013 >>>>>> x86_64 Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz GenuineIntel GNU/Linux >>>>>> >>>>>> krshina3 goran# free -m >>>>>> total used free shared buffers >>>>>> cached >>>>>> Mem: 7681 6794 887 30 0 >>>>>> 2933 >>>>>> -/+ buffers/cache: 3860 3821 >>>>>> Swap: 580 325 254 >>>>>> >>>>>> krshina3 goran# cat /etc/fstab | grep -v "#" >>>>>> >>>>>> /dev/sda1 /boot ext2 noauto,noatime >>>>>> 1 >>>>>> 2 >>>>>> /dev/md123 none swap sw >>>>>> 0 >>>>>> 0 >>>>>> /dev/sda2 / reiser4 >>>>>> noatime,onerror=remount-ro 0 0 >>>>>> /dev/md125 /mnt/backup reiser4 >>>>>> noatime,noauto,onerror=remount-ro 0 0 >>>>>> /dev/md126 /mnt/media reiser4 >>>>>> noatime,users,onerror=remount-ro 0 0 >>>>>> /dev/md127 /usr/portage reiser4 >>>>>> noatime,onerror=remount-ro 0 0 >>>>>> shm /dev/shm tmpfs >>>>>> nodev,nosuid,noexec 0 0 >>>>>> >>>>>> >>>>>> krshina3 goran # df >>>>>> Filesystem 1K-blocks Used Available Use% Mounted on >>>>>> /dev/sda2 37017728 24870384 12147344 68% / >>>>>> tmpfs 786872 832 786040 1% /run >>>>>> udev 10240 0 10240 0% /dev >>>>>> shm 3934340 80 3934260 1% /dev/shm >>>>>> /dev/md126 383034100 298007740 85026360 78% /mnt/media >>>>>> /dev/md127 6113484 5427288 686196 89% /usr/portage >>>>>> /dev/md125 64959612 57618884 7340728 89% /mnt/backup >>>>>> >>>>>> I get these in logs: >>>>>> >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221513] reiser4: md125: found >>>>>> disk format 4.0.0. >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221749] mount: page >>>>>> allocation failure: order:4, mode:0x2040d0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221752] CPU: 0 PID: 517 Comm: >>>>>> mount Not tainted 3.16.5-gentoo #1 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221753] Hardware name: >>>>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>>>>> 07/04/2012 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221754] 0000000000000000 >>>>>> ffff88020ece7968 ffffffff816a31b4 0000000000000007 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221757] 00000000002040d0 >>>>>> ffff88020ece79f8 ffffffff810e609a ffffffff00000040 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221758] 0000000000000286 >>>>>> ffffffff819a8a78 fffffff00000000f ffff88020ece79c8 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221760] Call Trace: >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221765] [<ffffffff816a31b4>] >>>>>> dump_stack+0x46/0x58 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221768] [<ffffffff810e609a>] >>>>>> warn_alloc_failed+0xda/0x130 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221770] [<ffffffff810e86c9>] >>>>>> __alloc_pages_nodemask+0x5d9/0x7a0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221774] [<ffffffff8111f16a>] >>>>>> cache_alloc_refill+0x31a/0x550 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221776] [<ffffffff8111ee23>] >>>>>> kmem_cache_alloc+0xb3/0xe0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221778] [<ffffffff81186529>] >>>>>> znodes_tree_init+0xc9/0x120 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221781] [<ffffffff8118e7b4>] >>>>>> reiser4_init_tree+0x44/0xd0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221784] [<ffffffff811cb905>] >>>>>> init_format_format40+0x265/0x5b0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221787] [<ffffffff8119e8b1>] >>>>>> fill_super+0x101/0x200 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221789] [<ffffffff81126be4>] >>>>>> mount_bdev+0x194/0x1d0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221792] [<ffffffff8119e7b0>] >>>>>> ? reiser4_mount+0x20/0x20 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221794] [<ffffffff8119e7a0>] >>>>>> reiser4_mount+0x10/0x20 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221796] [<ffffffff81126e2b>] >>>>>> mount_fs+0x1b/0xd0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221799] [<ffffffff8114042f>] >>>>>> vfs_kern_mount+0x6f/0x130 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221801] [<ffffffff81141f68>] >>>>>> do_mount+0x218/0xab0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221803] [<ffffffff810e88a2>] >>>>>> ? __get_free_pages+0x12/0x60 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221805] [<ffffffff81141bf5>] >>>>>> ? copy_mount_options+0x35/0x150 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221808] [<ffffffff81142ad9>] >>>>>> SyS_mount+0x89/0xd0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221811] [<ffffffff816ab1d2>] >>>>>> system_call_fastpath+0x16/0x1b >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221812] Mem-Info: >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221813] DMA per-cpu: >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221814] CPU 0: hi: 0, >>>>>> btch: 1 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221815] CPU 1: hi: 0, >>>>>> btch: 1 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221816] CPU 2: hi: 0, >>>>>> btch: 1 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221817] CPU 3: hi: 0, >>>>>> btch: 1 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221817] DMA32 per-cpu: >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221819] CPU 0: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221819] CPU 1: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221820] CPU 2: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221821] CPU 3: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221822] Normal per-cpu: >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221823] CPU 0: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221824] CPU 1: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221825] CPU 2: hi: 186, >>>>>> btch: 31 usd: 56 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221826] CPU 3: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] active_anon:701641 >>>>>> inactive_anon:138699 isolated_anon:0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] active_file:399519 >>>>>> inactive_file:396920 isolated_file:0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] unevictable:0 >>>>>> dirty:204 writeback:0 unstable:0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] free:155878 >>>>>> slab_reclaimable:126123 slab_unreclaimable:9074 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] mapped:21535 >>>>>> shmem:5701 pagetables:10162 bounce:0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] free_cma:0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221833] DMA free:15900kB >>>>>> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >>>>>> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >>>>>> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >>>>>> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >>>>>> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >>>>>> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>>>> all_unreclaimable? yes >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221834] lowmem_reserve[]: 0 >>>>>> 2950 7665 7665 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221839] DMA32 free:250180kB >>>>>> min:4308kB low:5384kB high:6460kB active_anon:1026572kB >>>>>> inactive_anon:257356kB active_file:616152kB inactive_file:612572kB >>>>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>>>> present:3098560kB managed:3022260kB mlocked:0kB dirty:4kB >>>>>> writeback:0kB mapped:33232kB shmem:9336kB slab_reclaimable:180492kB >>>>>> slab_unreclaimable:12176kB kernel_stack:2496kB pagetables:16872kB >>>>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>>>> all_unreclaimable? no >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221840] lowmem_reserve[]: 0 0 >>>>>> 4714 4714 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221844] Normal free:357432kB >>>>>> min:6884kB low:8604kB high:10324kB active_anon:1779992kB >>>>>> inactive_anon:297440kB active_file:981924kB inactive_file:975108kB >>>>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>>>> present:4954112kB managed:4828124kB mlocked:0kB dirty:812kB >>>>>> writeback:0kB mapped:52908kB shmem:13468kB slab_reclaimable:324000kB >>>>>> slab_unreclaimable:24120kB kernel_stack:4160kB pagetables:23776kB >>>>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB >>>>>> pages_scanned:24 all_unreclaimable? no >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221845] lowmem_reserve[]: 0 0 0 >>>>>> 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221847] DMA: 1*4kB (U) 1*8kB >>>>>> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >>>>>> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221855] DMA32: 52520*4kB >>>>>> (UEM) 5030*8kB (UE) 3*16kB (UR) 0*32kB 1*64kB (R) 0*128kB 0*256kB >>>>>> 0*512kB 0*1024kB 0*2048kB 0*4096kB = 250432kB >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221861] Normal: 62961*4kB >>>>>> (UEM) 11874*8kB (UEM) 640*16kB (UEMR) 17*32kB (UEMR) 1*64kB (E) >>>>>> 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 357684kB >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221867] Node 0 >>>>>> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >>>>>> hugepages_size=2048kB >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221868] 804788 total pagecache >>>>>> pages >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221869] 2600 pages in swap >>>>>> cache >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221870] Swap cache stats: add >>>>>> 91111, delete 88511, find 38599/41340 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221871] Free swap = 277028kB >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221872] Total swap = 594300kB >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221873] 2017164 pages RAM >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221873] 0 pages >>>>>> HighMem/MovableOnly >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221874] 31497 pages reserved >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900521] reiser4: md125: found >>>>>> disk format 4.0.0. >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900907] mount: page >>>>>> allocation failure: order:4, mode:0x2040d0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900910] CPU: 1 PID: 1414 >>>>>> Comm: mount Not tainted 3.16.5-gentoo #1 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900912] Hardware name: >>>>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>>>>> 07/04/2012 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900914] 0000000000000000 >>>>>> ffff880148093968 ffffffff816a31b4 0000000000000007 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900917] 00000000002040d0 >>>>>> ffff8801480939f8 ffffffff810e609a ffffffff00000040 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900919] 0000000000000286 >>>>>> ffffffff819a8a78 fffffff00000000f ffff8801480939c8 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900922] Call Trace: >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900929] [<ffffffff816a31b4>] >>>>>> dump_stack+0x46/0x58 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900933] [<ffffffff810e609a>] >>>>>> warn_alloc_failed+0xda/0x130 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900937] [<ffffffff810e86c9>] >>>>>> __alloc_pages_nodemask+0x5d9/0x7a0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900941] [<ffffffff8111f16a>] >>>>>> cache_alloc_refill+0x31a/0x550 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900945] [<ffffffff8111ee23>] >>>>>> kmem_cache_alloc+0xb3/0xe0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900948] [<ffffffff81186529>] >>>>>> znodes_tree_init+0xc9/0x120 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900951] [<ffffffff8118e7b4>] >>>>>> reiser4_init_tree+0x44/0xd0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900955] [<ffffffff811cb905>] >>>>>> init_format_format40+0x265/0x5b0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900959] [<ffffffff8119e8b1>] >>>>>> fill_super+0x101/0x200 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900963] [<ffffffff81126be4>] >>>>>> mount_bdev+0x194/0x1d0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900966] [<ffffffff8119e7b0>] >>>>>> ? reiser4_mount+0x20/0x20 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900969] [<ffffffff8119e7a0>] >>>>>> reiser4_mount+0x10/0x20 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900972] [<ffffffff81126e2b>] >>>>>> mount_fs+0x1b/0xd0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900976] [<ffffffff8114042f>] >>>>>> vfs_kern_mount+0x6f/0x130 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900979] [<ffffffff81141f68>] >>>>>> do_mount+0x218/0xab0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900982] [<ffffffff810e88a2>] >>>>>> ? __get_free_pages+0x12/0x60 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900986] [<ffffffff81141bf5>] >>>>>> ? copy_mount_options+0x35/0x150 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900989] [<ffffffff81142ad9>] >>>>>> SyS_mount+0x89/0xd0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900993] [<ffffffff816ab1d2>] >>>>>> system_call_fastpath+0x16/0x1b >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900994] Mem-Info: >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900996] DMA per-cpu: >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900997] CPU 0: hi: 0, >>>>>> btch: 1 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900999] CPU 1: hi: 0, >>>>>> btch: 1 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901000] CPU 2: hi: 0, >>>>>> btch: 1 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901001] CPU 3: hi: 0, >>>>>> btch: 1 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901002] DMA32 per-cpu: >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901004] CPU 0: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901005] CPU 1: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901006] CPU 2: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901008] CPU 3: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901009] Normal per-cpu: >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901010] CPU 0: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901011] CPU 1: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901013] CPU 2: hi: 186, >>>>>> btch: 31 usd: 21 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901014] CPU 3: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] active_anon:719713 >>>>>> inactive_anon:145280 isolated_anon:0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] active_file:390035 >>>>>> inactive_file:389999 isolated_file:0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] unevictable:0 >>>>>> dirty:1180 writeback:0 unstable:0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] free:161223 >>>>>> slab_reclaimable:112227 slab_unreclaimable:9155 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] mapped:35966 >>>>>> shmem:7263 pagetables:10549 bounce:0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] free_cma:0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901024] DMA free:15900kB >>>>>> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >>>>>> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >>>>>> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >>>>>> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >>>>>> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >>>>>> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>>>> all_unreclaimable? yes >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901026] lowmem_reserve[]: 0 >>>>>> 2950 7665 7665 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901033] DMA32 free:243456kB >>>>>> min:4308kB low:5384kB high:6460kB active_anon:1055312kB >>>>>> inactive_anon:268364kB active_file:605480kB inactive_file:605344kB >>>>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>>>> present:3098560kB managed:3022260kB mlocked:0kB dirty:1728kB >>>>>> writeback:0kB mapped:55944kB shmem:11860kB slab_reclaimable:164900kB >>>>>> slab_unreclaimable:12340kB kernel_stack:2496kB pagetables:17284kB >>>>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>>>> all_unreclaimable? no >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901034] lowmem_reserve[]: 0 0 >>>>>> 4714 4714 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901040] Normal free:385536kB >>>>>> min:6884kB low:8604kB high:10324kB active_anon:1823540kB >>>>>> inactive_anon:312756kB active_file:954660kB inactive_file:954652kB >>>>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>>>> present:4954112kB managed:4828124kB mlocked:0kB dirty:2992kB >>>>>> writeback:0kB mapped:87920kB shmem:17192kB slab_reclaimable:284008kB >>>>>> slab_unreclaimable:24280kB kernel_stack:4368kB pagetables:24912kB >>>>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB >>>>>> pages_scanned:21 all_unreclaimable? no >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901041] lowmem_reserve[]: 0 0 0 >>>>>> 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901044] DMA: 1*4kB (U) 1*8kB >>>>>> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >>>>>> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901054] DMA32: 46552*4kB (UE) >>>>>> 7159*8kB (U) 2*16kB (R) 0*32kB 1*64kB (R) 0*128kB 0*256kB 0*512kB >>>>>> 0*1024kB 0*2048kB 0*4096kB = 243576kB >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901063] Normal: 40881*4kB >>>>>> (UEM) 27461*8kB (UEM) 151*16kB (UR) 2*32kB (R) 0*64kB 0*128kB 0*256kB >>>>>> 0*512kB 0*1024kB 0*2048kB 0*4096kB = 385692kB >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901072] Node 0 >>>>>> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >>>>>> hugepages_size=2048kB >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901073] 789766 total pagecache >>>>>> pages >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901075] 2404 pages in swap >>>>>> cache >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901076] Swap cache stats: add >>>>>> 94924, delete 92520, find 40323/43073 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901077] Free swap = 261888kB >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901078] Total swap = 594300kB >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901079] 2017164 pages RAM >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901080] 0 pages >>>>>> HighMem/MovableOnly >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901081] 31497 pages reserved >>>>>> >>>>>> >>>>>> Now I'm gonna fsck all partitions and report if anything comes up. >>>>>> >>>>>> Ask if you need more info >>>>>> >>>>>> Thanks in advance >>>>>> Dushan >>>>> >>>>> >>>>> >>> -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-11-03 13:33 ` Dušan Čolić @ 2014-11-03 15:42 ` Edward Shishkin [not found] ` <CADW=+3mzX7evaqZmvOSJ6F9XNmzmauegL4Vy0nqz6yqG8EyLyw@mail.gmail.com> 0 siblings, 1 reply; 33+ messages in thread From: Edward Shishkin @ 2014-11-03 15:42 UTC (permalink / raw) To: Dušan Čolić; +Cc: reiserfs-devel, Ivan Shapovalov On 11/03/2014 02:33 PM, Dušan Čolić wrote: > I forgot: > It was working for some time (deleting old directories etc.) and then crashed. > Btw. why didn't that partition (/dev/md125) remounted read-only on > error when I have that in /etc/fstab? What do you suggest to do when encountering IO error? There is another option: to oops. You like this better? Edward. > > On Mon, Nov 3, 2014 at 2:28 PM, Dušan Čolić <dusanc@gmail.com> wrote: >> After an hour or more still nothing, one rsync went to zombie other >> still in D state >> I killed the main process and rebooted. >> >> krshina3 goran # ps -aux | grep rsync >> root 6655 0.0 0.1 101568 9328 pts/4 D 13:08 0:01 >> /usr/bin/rsync -ax --delete --numeric-ids --relative --delete-excluded >> --exclude=/home/windows.qcow2 >> --link-dest=/mnt/backup/daily.1/localhost/ /home >> /mnt/backup/daily.0/localhost/ >> root 6656 0.0 0.0 0 0 pts/4 Z 13:08 0:00 >> [rsync] <defunct> >> >> >> Now I tried same command (rsnapshot -c /etc/rsnapshot.d/daily.conf >> daily) and kernel BUGed with: >> >> krshina3 goran # rsnapshot -c /etc/rsnapshot.d/daily.conf daily >> rsync: writefd_unbuffered failed to write 5 bytes to socket >> [generator]: Broken pipe (32) >> ---------------------------------------------------------------------------- >> rsnapshot encountered an error! The program was invoked with these options: >> /usr/bin/rsnapshot -c /etc/rsnapshot.d/daily.conf daily >> ---------------------------------------------------------------------------- >> ERROR: /usr/bin/rsync returned 0.04296875 while processing /home/ >> WARNING: Rolling back "localhost/" >> rsync error: error in rsync protocol data stream (code 12) at >> io.c(1532) [generator=3.0.9] >> -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
[parent not found: <CADW=+3mzX7evaqZmvOSJ6F9XNmzmauegL4Vy0nqz6yqG8EyLyw@mail.gmail.com>]
[parent not found: <5457B0AB.6030203@gmail.com>]
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory [not found] ` <5457B0AB.6030203@gmail.com> @ 2014-11-03 18:27 ` Dušan Čolić 2014-11-04 12:49 ` Edward Shishkin 0 siblings, 1 reply; 33+ messages in thread From: Dušan Čolić @ 2014-11-03 18:27 UTC (permalink / raw) To: Edward Shishkin; +Cc: reiserfs-devel, Ivan Shapovalov Ok now with same config kernels 3.16, 3.14 and 3.10 fail in same spot. It failes around rsync --delete or something command, dunno how to find what it is I looked at iotop. So let me reiterate: One automated operation that worked after fsck every day for months with kernel 3.10 started making problems since I started using 3.16 BUT it makes kernel Oops even if I go back to 3.10. The only funky thing I did was having txmod=wa for few days in /etc/fstab but that was before these problems. Could it be that some corrupted file makes this, unseen by fsck? I can reformat this partition but I suspect that problematic file is on my /. And then we wouldn't have a test case to reproduce this oops :) Is there any way to record all IO requests to find what exactly does this? This is Oops from 3.14: Nov 3 18:57:40 krshina3 kernel: [ 179.693947] ------------[ cut here ]------------ Nov 3 18:57:40 krshina3 kernel: [ 179.694212] kernel BUG at fs/reiser4/plugin/item/ctail.c:669! Nov 3 18:57:40 krshina3 kernel: [ 179.694537] invalid opcode: 0000 [#1] SMP Nov 3 18:57:40 krshina3 kernel: [ 179.694779] CPU: 1 PID: 3203 Comm: rsync Not tainted 3.14.14-gentoo #1 Nov 3 18:57:40 krshina3 kernel: [ 179.695148] Hardware name: Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 07/04/2012 Nov 3 18:57:40 krshina3 kernel: [ 179.695702] task: ffff8800b6cf47b0 ti: ffff8801db7f6000 task.ti: ffff8801db7f6000 Nov 3 18:57:40 krshina3 kernel: [ 179.696128] RIP: 0010:[<ffffffff811bc700>] [<ffffffff811bc700>] do_readpage_ctail+0x2a0/0x400 Nov 3 18:57:40 krshina3 kernel: [ 179.696625] RSP: 0018:ffff8801db7f7a68 EFLAGS: 00010246 Nov 3 18:57:40 krshina3 kernel: [ 179.696925] RAX: 8000000000000021 RBX: ffffea000664a8c8 RCX: ffff8800b9964800 Nov 3 18:57:40 krshina3 kernel: [ 179.697329] RDX: 0000000000000035 RSI: 0000000000000000 RDI: ffff8800b9967800 Nov 3 18:57:40 krshina3 kernel: [ 179.697739] RBP: 0000000000000002 R08: 0000000000000000 R09: 0000000000000001 Nov 3 18:57:40 krshina3 kernel: [ 179.698145] R10: ffffffff811ad0a0 R11: 0000000000000000 R12: ffff8800841dfd58 Nov 3 18:57:40 krshina3 kernel: [ 179.698548] R13: ffff8801db7f7b58 R14: 0000000000000001 R15: 0000000000001000 Nov 3 18:57:40 krshina3 kernel: [ 179.698952] FS: 00007f40176a0700(0000) GS:ffff88022e280000(0000) knlGS:0000000000000000 Nov 3 18:57:40 krshina3 kernel: [ 179.699410] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Nov 3 18:57:40 krshina3 kernel: [ 179.699735] CR2: 0000000002b30248 CR3: 00000001de9d8000 CR4: 00000000001427e0 Nov 3 18:57:40 krshina3 kernel: [ 179.700145] DR0: 0000000000000045 DR1: 0000000000000000 DR2: 0000000000000000 Nov 3 18:57:40 krshina3 kernel: [ 179.700555] DR3: 0000000000000005 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Nov 3 18:57:40 krshina3 kernel: [ 179.700966] Stack: Nov 3 18:57:40 krshina3 kernel: [ 179.701080] ffff8800841dfe98 ffff8801db7f7b58 ffffea000664a8c8 0000000000000000 Nov 3 18:57:40 krshina3 kernel: [ 179.701523] ffff8800b6cf47b0 ffff8800841dfd58 0000000000000000 ffffffff811bc969 Nov 3 18:57:40 krshina3 kernel: [ 179.701963] ffffea000664a8c8 ffffea000664a8c8 ffff8801db7f7c90 ffff8800841dfe98 Nov 3 18:57:40 krshina3 kernel: [ 179.702402] Call Trace: Nov 3 18:57:40 krshina3 kernel: [ 179.702540] [<ffffffff811bc969>] ? ctail_readpages_filler+0x109/0x210 Nov 3 18:57:40 krshina3 kernel: [ 179.702911] [<ffffffff811bc860>] ? do_readpage_ctail+0x400/0x400 Nov 3 18:57:40 krshina3 kernel: [ 179.703257] [<ffffffff810e9b91>] ? read_cache_pages+0xb1/0x120 Nov 3 18:57:40 krshina3 kernel: [ 179.703592] [<ffffffff811bccf5>] ? readpages_ctail+0x135/0x340 Nov 3 18:57:40 krshina3 kernel: [ 179.703928] [<ffffffff811b0da6>] ? readpages_cryptcompress+0x46/0x90 Nov 3 18:57:40 krshina3 kernel: [ 179.704292] [<ffffffff810e99c1>] ? __do_page_cache_readahead+0x1b1/0x260 Nov 3 18:57:40 krshina3 kernel: [ 179.704677] [<ffffffff811ab0a0>] ? reiser4_write_dispatch+0x4d0/0x4d0 Nov 3 18:57:40 krshina3 kernel: [ 179.705047] [<ffffffff810e9d1c>] ? ra_submit+0x1c/0x30 Nov 3 18:57:40 krshina3 kernel: [ 179.705343] [<ffffffff810e09b6>] ? generic_file_aio_read+0x4d6/0x6f0 Nov 3 18:57:40 krshina3 kernel: [ 179.705708] [<ffffffff8111bb4a>] ? do_sync_read+0x5a/0x90 Nov 3 18:57:40 krshina3 kernel: [ 179.706023] [<ffffffff8109de30>] ? __dequeue_entity+0x40/0x50 Nov 3 18:57:40 krshina3 kernel: [ 179.706354] [<ffffffff811b0e68>] ? read_cryptcompress+0x78/0xc0 Nov 3 18:57:40 krshina3 kernel: [ 179.706694] [<ffffffff811ab244>] ? reiser4_read_dispatch+0x74/0x170 Nov 3 18:57:40 krshina3 kernel: [ 179.707056] [<ffffffff8111c8a1>] ? vfs_read+0xa1/0x180 Nov 3 18:57:40 krshina3 kernel: [ 179.707351] [<ffffffff8111cd9f>] ? SyS_read+0x4f/0xc0 Nov 3 18:57:40 krshina3 kernel: [ 179.707642] [<ffffffff81670d62>] ? system_call_fastpath+0x16/0x1b Nov 3 18:57:40 krshina3 kernel: [ 179.707992] Code: 80 0b 08 31 ed e9 b0 fe ff ff 90 48 89 df e8 18 2d f2 ff e9 62 fe ff ff 0f 1f 00 48 89 df e8 08 2d f2 ff e9 92 fe ff ff 0f 1f 00 <0f> 0b 48 8b 03 a8 08 0f 84 a2 00 00 00 49 8b bd 80 00 00 00 e8 Nov 3 18:57:40 krshina3 kernel: [ 179.709414] RIP [<ffffffff811bc700>] do_readpage_ctail+0x2a0/0x400 Nov 3 18:57:40 krshina3 kernel: [ 179.709774] RSP <ffff8801db7f7a68> Nov 3 18:57:40 krshina3 kernel: [ 179.821174] ---[ end trace d60466a8b91493b8 ]--- This is from 3.10: Nov 3 19:08:36 krshina3 kernel: [ 449.276796] ------------[ cut here ]------------ Nov 3 19:08:36 krshina3 kernel: [ 449.276825] kernel BUG at fs/reiser4/plugin/item/ctail.c:669! Nov 3 19:08:36 krshina3 kernel: [ 449.276841] invalid opcode: 0000 [#1] SMP Nov 3 19:08:36 krshina3 kernel: [ 449.276857] CPU: 1 PID: 3167 Comm: rsync Not tainted 3.10.6-gentoo #2 Nov 3 19:08:36 krshina3 kernel: [ 449.276875] Hardware name: Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 07/04/2012 Nov 3 19:08:36 krshina3 kernel: [ 449.276900] task: ffff88022d2ac690 ti: ffff880074f80000 task.ti: ffff880074f80000 Nov 3 19:08:36 krshina3 kernel: [ 449.276920] RIP: 0010:[<ffffffff811555e9>] [<ffffffff811555e9>] do_readpage_ctail+0x2f3/0x3ed Nov 3 19:08:36 krshina3 kernel: [ 449.276948] RSP: 0018:ffff880074f81a28 EFLAGS: 00010246 Nov 3 19:08:36 krshina3 kernel: [ 449.276962] RAX: 0000000000000000 RBX: ffffea0005a31988 RCX: 00000000000354d4 Nov 3 19:08:36 krshina3 kernel: [ 449.276981] RDX: 0000000000000035 RSI: 0000000000000000 RDI: ffff8801a139fcd8 Nov 3 19:08:36 krshina3 kernel: [ 449.276999] RBP: ffff880074f81b18 R08: 0000000000000000 R09: 0000000000000000 Nov 3 19:08:36 krshina3 kernel: [ 449.277018] R10: 0000000000000866 R11: 0000000000000866 R12: ffff8801a139fb98 Nov 3 19:08:36 krshina3 kernel: [ 449.277037] R13: 0000000000000002 R14: 0000000000000000 R15: 0000000000001000 Nov 3 19:08:36 krshina3 kernel: [ 449.277056] FS: 00007fc4e9c01700(0000) GS:ffff88022e280000(0000) knlGS:0000000000000000 Nov 3 19:08:36 krshina3 kernel: [ 449.277077] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Nov 3 19:08:36 krshina3 kernel: [ 449.277092] CR2: 000000000331a248 CR3: 0000000075069000 CR4: 00000000001427e0 Nov 3 19:08:36 krshina3 kernel: [ 449.277111] DR0: 0000000000000045 DR1: 0000000000000000 DR2: 0000000000000000 Nov 3 19:08:36 krshina3 kernel: [ 449.277129] DR3: 0000000000000005 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Nov 3 19:08:36 krshina3 kernel: [ 449.277147] Stack: Nov 3 19:08:36 krshina3 kernel: [ 449.277154] ffff8801a139fcd8 ffff880074f81b18 ffff8801a139fb98 ffffea0005a31988 Nov 3 19:08:36 krshina3 kernel: [ 449.277177] 0000000000000000 0000000000000000 ffff880074f81b18 ffffffff81155861 Nov 3 19:08:36 krshina3 kernel: [ 449.277200] ffffea0005a31988 ffffea0005a31988 ffff880074f81c78 ffff8801a139fcd8 Nov 3 19:08:36 krshina3 kernel: [ 449.277223] Call Trace: Nov 3 19:08:36 krshina3 kernel: [ 449.277232] [<ffffffff81155861>] ? ctail_readpages_filler+0x17e/0x1c2 Nov 3 19:08:36 krshina3 kernel: [ 449.277250] [<ffffffff811556e3>] ? do_readpage_ctail+0x3ed/0x3ed Nov 3 19:08:36 krshina3 kernel: [ 449.277268] [<ffffffff810ad77c>] ? read_cache_pages+0x91/0x108 Nov 3 19:08:36 krshina3 kernel: [ 449.277286] [<ffffffff8113a7d1>] ? reiser4_get_file_fsdata+0x33/0x8a Nov 3 19:08:36 krshina3 kernel: [ 449.277304] [<ffffffff81155c95>] ? readpages_ctail+0x2f2/0x2f9 Nov 3 19:08:36 krshina3 kernel: [ 449.277321] [<ffffffff8114bef8>] ? readpages_cryptcompress+0x3f/0x6b Nov 3 19:08:36 krshina3 kernel: [ 449.277339] [<ffffffff810ad5b3>] ? __do_page_cache_readahead+0x11f/0x1c3 Nov 3 19:08:36 krshina3 kernel: [ 449.277357] [<ffffffff810ad8c3>] ? ra_submit+0x1c/0x23 Nov 3 19:08:36 krshina3 kernel: [ 449.277372] [<ffffffff810a6348>] ? generic_file_aio_read+0x269/0x5b6 Nov 3 19:08:36 krshina3 kernel: [ 449.277390] [<ffffffff810d4399>] ? do_sync_read+0x6e/0x90 Nov 3 19:08:36 krshina3 kernel: [ 449.277406] [<ffffffff8114bf8d>] ? read_cryptcompress+0x69/0x95 Nov 3 19:08:36 krshina3 kernel: [ 449.277423] [<ffffffff8114723b>] ? reiser4_read_dispatch+0xc9/0x124 Nov 3 19:08:36 krshina3 kernel: [ 449.277441] [<ffffffff810d4dc2>] ? vfs_read+0xac/0x146 Nov 3 19:08:36 krshina3 kernel: [ 449.277456] [<ffffffff810d51da>] ? SyS_read+0x4e/0x78 Nov 3 19:08:36 krshina3 kernel: [ 449.277471] [<ffffffff814c9312>] ? system_call_fastpath+0x16/0x1b Nov 3 19:08:36 krshina3 kernel: [ 449.277487] Code: f9 00 00 00 44 8b ad 88 00 00 00 41 83 fd 02 74 1a 77 0c 41 83 fd 01 0f 85 e0 00 00 00 eb 61 41 83 fd 04 0f 87 d4 00 00 00 eb 02 <0f> 0b 65 48 8b 14 25 48 b7 00 00 48 81 ea d8 1f 00 00 ff 42 1c Nov 3 19:08:36 krshina3 kernel: [ 449.277612] RIP [<ffffffff811555e9>] do_readpage_ctail+0x2f3/0x3ed Nov 3 19:08:36 krshina3 kernel: [ 449.277630] RSP <ffff880074f81a28> Nov 3 19:08:36 krshina3 kernel: [ 449.282221] ---[ end trace f14ff60ec68f3286 ]--- On Mon, Nov 3, 2014 at 5:43 PM, Edward Shishkin <edward.shishkin@gmail.com> wrote: > On 11/03/2014 04:48 PM, Dušan Čolić wrote: > > > On Nov 3, 2014 4:43 PM, "Edward Shishkin" <edward.shishkin@gmail.com> wrote: >> >> On 11/03/2014 02:33 PM, Dušan Čolić wrote: >>> >>> I forgot: >>> It was working for some time (deleting old directories etc.) and then >>> crashed. >>> Btw. why didn't that partition (/dev/md125) remounted read-only on >>> error when I have that in /etc/fstab? >> >> >> >> What do you suggest to do when encountering IO error? >> There is another option: to oops. You like this better? >> > > There's a misunderstanding maybe.... Long time ago you told me to add > onerror=remount-ro to fstab but now when this error happened system > continued to work but the partition stayed rw, maybe I misunderstood the > option? > > > > Ah, "onerror" means "on IO error". > That is, file system submitted a RW-request, and the disk driver returns > IO error for this request. If so, then you file system will become > read-only. > > As to your case: there is no IO errors. There is a kernel oops, this is > another > situation.. > > Edward. > > > >> Edward. >> >> >>> >>> On Mon, Nov 3, 2014 at 2:28 PM, Dušan Čolić <dusanc@gmail.com> wrote: >>>> >>>> After an hour or more still nothing, one rsync went to zombie other >>>> still in D state >>>> I killed the main process and rebooted. >>>> >>>> krshina3 goran # ps -aux | grep rsync >>>> root 6655 0.0 0.1 101568 9328 pts/4 D 13:08 0:01 >>>> /usr/bin/rsync -ax --delete --numeric-ids --relative --delete-excluded >>>> --exclude=/home/windows.qcow2 >>>> --link-dest=/mnt/backup/daily.1/localhost/ /home >>>> /mnt/backup/daily.0/localhost/ >>>> root 6656 0.0 0.0 0 0 pts/4 Z 13:08 0:00 >>>> [rsync] <defunct> >>>> >>>> >>>> Now I tried same command (rsnapshot -c /etc/rsnapshot.d/daily.conf >>>> daily) and kernel BUGed with: >>>> >>>> krshina3 goran # rsnapshot -c /etc/rsnapshot.d/daily.conf daily >>>> rsync: writefd_unbuffered failed to write 5 bytes to socket >>>> [generator]: Broken pipe (32) >>>> >>>> ---------------------------------------------------------------------------- >>>> rsnapshot encountered an error! The program was invoked with these >>>> options: >>>> /usr/bin/rsnapshot -c /etc/rsnapshot.d/daily.conf daily >>>> >>>> ---------------------------------------------------------------------------- >>>> ERROR: /usr/bin/rsync returned 0.04296875 while processing /home/ >>>> WARNING: Rolling back "localhost/" >>>> rsync error: error in rsync protocol data stream (code 12) at >>>> io.c(1532) [generator=3.0.9] >>>> >> > > -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-11-03 18:27 ` Dušan Čolić @ 2014-11-04 12:49 ` Edward Shishkin 2014-11-04 13:16 ` Dušan Čolić 0 siblings, 1 reply; 33+ messages in thread From: Edward Shishkin @ 2014-11-04 12:49 UTC (permalink / raw) To: Dušan Čolić; +Cc: reiserfs-devel, Ivan Shapovalov [-- Attachment #1: Type: text/plain, Size: 13060 bytes --] The attached patch prevents panic. Thanks, Edward. On 11/03/2014 07:27 PM, Dušan Čolić wrote: > Ok now with same config kernels 3.16, 3.14 and 3.10 fail in same spot. > It failes around rsync --delete or something command, dunno how to > find what it is I looked at iotop. > So let me reiterate: > One automated operation that worked after fsck every day for months > with kernel 3.10 started making problems since I started using 3.16 > BUT it makes kernel Oops even if I go back to 3.10. The only funky > thing I did was having txmod=wa for few days in /etc/fstab but that > was before these problems. Could it be that some corrupted file makes > this, unseen by fsck? > I can reformat this partition but I suspect that problematic file is > on my /. And then we wouldn't have a test case to reproduce this oops > :) > Is there any way to record all IO requests to find what exactly does this? > > This is Oops from 3.14: > > Nov 3 18:57:40 krshina3 kernel: [ 179.693947] ------------[ cut here > ]------------ > Nov 3 18:57:40 krshina3 kernel: [ 179.694212] kernel BUG at > fs/reiser4/plugin/item/ctail.c:669! > Nov 3 18:57:40 krshina3 kernel: [ 179.694537] invalid opcode: 0000 [#1] SMP > Nov 3 18:57:40 krshina3 kernel: [ 179.694779] CPU: 1 PID: 3203 Comm: > rsync Not tainted 3.14.14-gentoo #1 > Nov 3 18:57:40 krshina3 kernel: [ 179.695148] Hardware name: > Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 > 07/04/2012 > Nov 3 18:57:40 krshina3 kernel: [ 179.695702] task: ffff8800b6cf47b0 > ti: ffff8801db7f6000 task.ti: ffff8801db7f6000 > Nov 3 18:57:40 krshina3 kernel: [ 179.696128] RIP: > 0010:[<ffffffff811bc700>] [<ffffffff811bc700>] > do_readpage_ctail+0x2a0/0x400 > Nov 3 18:57:40 krshina3 kernel: [ 179.696625] RSP: > 0018:ffff8801db7f7a68 EFLAGS: 00010246 > Nov 3 18:57:40 krshina3 kernel: [ 179.696925] RAX: 8000000000000021 > RBX: ffffea000664a8c8 RCX: ffff8800b9964800 > Nov 3 18:57:40 krshina3 kernel: [ 179.697329] RDX: 0000000000000035 > RSI: 0000000000000000 RDI: ffff8800b9967800 > Nov 3 18:57:40 krshina3 kernel: [ 179.697739] RBP: 0000000000000002 > R08: 0000000000000000 R09: 0000000000000001 > Nov 3 18:57:40 krshina3 kernel: [ 179.698145] R10: ffffffff811ad0a0 > R11: 0000000000000000 R12: ffff8800841dfd58 > Nov 3 18:57:40 krshina3 kernel: [ 179.698548] R13: ffff8801db7f7b58 > R14: 0000000000000001 R15: 0000000000001000 > Nov 3 18:57:40 krshina3 kernel: [ 179.698952] FS: > 00007f40176a0700(0000) GS:ffff88022e280000(0000) > knlGS:0000000000000000 > Nov 3 18:57:40 krshina3 kernel: [ 179.699410] CS: 0010 DS: 0000 ES: > 0000 CR0: 0000000080050033 > Nov 3 18:57:40 krshina3 kernel: [ 179.699735] CR2: 0000000002b30248 > CR3: 00000001de9d8000 CR4: 00000000001427e0 > Nov 3 18:57:40 krshina3 kernel: [ 179.700145] DR0: 0000000000000045 > DR1: 0000000000000000 DR2: 0000000000000000 > Nov 3 18:57:40 krshina3 kernel: [ 179.700555] DR3: 0000000000000005 > DR6: 00000000ffff0ff0 DR7: 0000000000000400 > Nov 3 18:57:40 krshina3 kernel: [ 179.700966] Stack: > Nov 3 18:57:40 krshina3 kernel: [ 179.701080] ffff8800841dfe98 > ffff8801db7f7b58 ffffea000664a8c8 0000000000000000 > Nov 3 18:57:40 krshina3 kernel: [ 179.701523] ffff8800b6cf47b0 > ffff8800841dfd58 0000000000000000 ffffffff811bc969 > Nov 3 18:57:40 krshina3 kernel: [ 179.701963] ffffea000664a8c8 > ffffea000664a8c8 ffff8801db7f7c90 ffff8800841dfe98 > Nov 3 18:57:40 krshina3 kernel: [ 179.702402] Call Trace: > Nov 3 18:57:40 krshina3 kernel: [ 179.702540] [<ffffffff811bc969>] > ? ctail_readpages_filler+0x109/0x210 > Nov 3 18:57:40 krshina3 kernel: [ 179.702911] [<ffffffff811bc860>] > ? do_readpage_ctail+0x400/0x400 > Nov 3 18:57:40 krshina3 kernel: [ 179.703257] [<ffffffff810e9b91>] > ? read_cache_pages+0xb1/0x120 > Nov 3 18:57:40 krshina3 kernel: [ 179.703592] [<ffffffff811bccf5>] > ? readpages_ctail+0x135/0x340 > Nov 3 18:57:40 krshina3 kernel: [ 179.703928] [<ffffffff811b0da6>] > ? readpages_cryptcompress+0x46/0x90 > Nov 3 18:57:40 krshina3 kernel: [ 179.704292] [<ffffffff810e99c1>] > ? __do_page_cache_readahead+0x1b1/0x260 > Nov 3 18:57:40 krshina3 kernel: [ 179.704677] [<ffffffff811ab0a0>] > ? reiser4_write_dispatch+0x4d0/0x4d0 > Nov 3 18:57:40 krshina3 kernel: [ 179.705047] [<ffffffff810e9d1c>] > ? ra_submit+0x1c/0x30 > Nov 3 18:57:40 krshina3 kernel: [ 179.705343] [<ffffffff810e09b6>] > ? generic_file_aio_read+0x4d6/0x6f0 > Nov 3 18:57:40 krshina3 kernel: [ 179.705708] [<ffffffff8111bb4a>] > ? do_sync_read+0x5a/0x90 > Nov 3 18:57:40 krshina3 kernel: [ 179.706023] [<ffffffff8109de30>] > ? __dequeue_entity+0x40/0x50 > Nov 3 18:57:40 krshina3 kernel: [ 179.706354] [<ffffffff811b0e68>] > ? read_cryptcompress+0x78/0xc0 > Nov 3 18:57:40 krshina3 kernel: [ 179.706694] [<ffffffff811ab244>] > ? reiser4_read_dispatch+0x74/0x170 > Nov 3 18:57:40 krshina3 kernel: [ 179.707056] [<ffffffff8111c8a1>] > ? vfs_read+0xa1/0x180 > Nov 3 18:57:40 krshina3 kernel: [ 179.707351] [<ffffffff8111cd9f>] > ? SyS_read+0x4f/0xc0 > Nov 3 18:57:40 krshina3 kernel: [ 179.707642] [<ffffffff81670d62>] > ? system_call_fastpath+0x16/0x1b > Nov 3 18:57:40 krshina3 kernel: [ 179.707992] Code: 80 0b 08 31 ed > e9 b0 fe ff ff 90 48 89 df e8 18 2d f2 ff e9 62 fe ff ff 0f 1f 00 48 > 89 df e8 08 2d f2 ff e9 92 fe ff ff 0f 1f 00 <0f> 0b 48 8b 03 a8 08 0f > 84 a2 00 00 00 49 8b bd 80 00 00 00 e8 > Nov 3 18:57:40 krshina3 kernel: [ 179.709414] RIP > [<ffffffff811bc700>] do_readpage_ctail+0x2a0/0x400 > Nov 3 18:57:40 krshina3 kernel: [ 179.709774] RSP <ffff8801db7f7a68> > Nov 3 18:57:40 krshina3 kernel: [ 179.821174] ---[ end trace > d60466a8b91493b8 ]--- > > This is from 3.10: > > Nov 3 19:08:36 krshina3 kernel: [ 449.276796] ------------[ cut here > ]------------ > Nov 3 19:08:36 krshina3 kernel: [ 449.276825] kernel BUG at > fs/reiser4/plugin/item/ctail.c:669! > Nov 3 19:08:36 krshina3 kernel: [ 449.276841] invalid opcode: 0000 [#1] SMP > Nov 3 19:08:36 krshina3 kernel: [ 449.276857] CPU: 1 PID: 3167 Comm: > rsync Not tainted 3.10.6-gentoo #2 > Nov 3 19:08:36 krshina3 kernel: [ 449.276875] Hardware name: > Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 > 07/04/2012 > Nov 3 19:08:36 krshina3 kernel: [ 449.276900] task: ffff88022d2ac690 > ti: ffff880074f80000 task.ti: ffff880074f80000 > Nov 3 19:08:36 krshina3 kernel: [ 449.276920] RIP: > 0010:[<ffffffff811555e9>] [<ffffffff811555e9>] > do_readpage_ctail+0x2f3/0x3ed > Nov 3 19:08:36 krshina3 kernel: [ 449.276948] RSP: > 0018:ffff880074f81a28 EFLAGS: 00010246 > Nov 3 19:08:36 krshina3 kernel: [ 449.276962] RAX: 0000000000000000 > RBX: ffffea0005a31988 RCX: 00000000000354d4 > Nov 3 19:08:36 krshina3 kernel: [ 449.276981] RDX: 0000000000000035 > RSI: 0000000000000000 RDI: ffff8801a139fcd8 > Nov 3 19:08:36 krshina3 kernel: [ 449.276999] RBP: ffff880074f81b18 > R08: 0000000000000000 R09: 0000000000000000 > Nov 3 19:08:36 krshina3 kernel: [ 449.277018] R10: 0000000000000866 > R11: 0000000000000866 R12: ffff8801a139fb98 > Nov 3 19:08:36 krshina3 kernel: [ 449.277037] R13: 0000000000000002 > R14: 0000000000000000 R15: 0000000000001000 > Nov 3 19:08:36 krshina3 kernel: [ 449.277056] FS: > 00007fc4e9c01700(0000) GS:ffff88022e280000(0000) > knlGS:0000000000000000 > Nov 3 19:08:36 krshina3 kernel: [ 449.277077] CS: 0010 DS: 0000 ES: > 0000 CR0: 0000000080050033 > Nov 3 19:08:36 krshina3 kernel: [ 449.277092] CR2: 000000000331a248 > CR3: 0000000075069000 CR4: 00000000001427e0 > Nov 3 19:08:36 krshina3 kernel: [ 449.277111] DR0: 0000000000000045 > DR1: 0000000000000000 DR2: 0000000000000000 > Nov 3 19:08:36 krshina3 kernel: [ 449.277129] DR3: 0000000000000005 > DR6: 00000000ffff0ff0 DR7: 0000000000000400 > Nov 3 19:08:36 krshina3 kernel: [ 449.277147] Stack: > Nov 3 19:08:36 krshina3 kernel: [ 449.277154] ffff8801a139fcd8 > ffff880074f81b18 ffff8801a139fb98 ffffea0005a31988 > Nov 3 19:08:36 krshina3 kernel: [ 449.277177] 0000000000000000 > 0000000000000000 ffff880074f81b18 ffffffff81155861 > Nov 3 19:08:36 krshina3 kernel: [ 449.277200] ffffea0005a31988 > ffffea0005a31988 ffff880074f81c78 ffff8801a139fcd8 > Nov 3 19:08:36 krshina3 kernel: [ 449.277223] Call Trace: > Nov 3 19:08:36 krshina3 kernel: [ 449.277232] [<ffffffff81155861>] > ? ctail_readpages_filler+0x17e/0x1c2 > Nov 3 19:08:36 krshina3 kernel: [ 449.277250] [<ffffffff811556e3>] > ? do_readpage_ctail+0x3ed/0x3ed > Nov 3 19:08:36 krshina3 kernel: [ 449.277268] [<ffffffff810ad77c>] > ? read_cache_pages+0x91/0x108 > Nov 3 19:08:36 krshina3 kernel: [ 449.277286] [<ffffffff8113a7d1>] > ? reiser4_get_file_fsdata+0x33/0x8a > Nov 3 19:08:36 krshina3 kernel: [ 449.277304] [<ffffffff81155c95>] > ? readpages_ctail+0x2f2/0x2f9 > Nov 3 19:08:36 krshina3 kernel: [ 449.277321] [<ffffffff8114bef8>] > ? readpages_cryptcompress+0x3f/0x6b > Nov 3 19:08:36 krshina3 kernel: [ 449.277339] [<ffffffff810ad5b3>] > ? __do_page_cache_readahead+0x11f/0x1c3 > Nov 3 19:08:36 krshina3 kernel: [ 449.277357] [<ffffffff810ad8c3>] > ? ra_submit+0x1c/0x23 > Nov 3 19:08:36 krshina3 kernel: [ 449.277372] [<ffffffff810a6348>] > ? generic_file_aio_read+0x269/0x5b6 > Nov 3 19:08:36 krshina3 kernel: [ 449.277390] [<ffffffff810d4399>] > ? do_sync_read+0x6e/0x90 > Nov 3 19:08:36 krshina3 kernel: [ 449.277406] [<ffffffff8114bf8d>] > ? read_cryptcompress+0x69/0x95 > Nov 3 19:08:36 krshina3 kernel: [ 449.277423] [<ffffffff8114723b>] > ? reiser4_read_dispatch+0xc9/0x124 > Nov 3 19:08:36 krshina3 kernel: [ 449.277441] [<ffffffff810d4dc2>] > ? vfs_read+0xac/0x146 > Nov 3 19:08:36 krshina3 kernel: [ 449.277456] [<ffffffff810d51da>] > ? SyS_read+0x4e/0x78 > Nov 3 19:08:36 krshina3 kernel: [ 449.277471] [<ffffffff814c9312>] > ? system_call_fastpath+0x16/0x1b > Nov 3 19:08:36 krshina3 kernel: [ 449.277487] Code: f9 00 00 00 44 > 8b ad 88 00 00 00 41 83 fd 02 74 1a 77 0c 41 83 fd 01 0f 85 e0 00 00 > 00 eb 61 41 83 fd 04 0f 87 d4 00 00 00 eb 02 <0f> 0b 65 48 8b 14 25 48 > b7 00 00 48 81 ea d8 1f 00 00 ff 42 1c > Nov 3 19:08:36 krshina3 kernel: [ 449.277612] RIP > [<ffffffff811555e9>] do_readpage_ctail+0x2f3/0x3ed > Nov 3 19:08:36 krshina3 kernel: [ 449.277630] RSP <ffff880074f81a28> > Nov 3 19:08:36 krshina3 kernel: [ 449.282221] ---[ end trace > f14ff60ec68f3286 ]--- > > On Mon, Nov 3, 2014 at 5:43 PM, Edward Shishkin > <edward.shishkin@gmail.com> wrote: >> On 11/03/2014 04:48 PM, Dušan Čolić wrote: >> >> >> On Nov 3, 2014 4:43 PM, "Edward Shishkin" <edward.shishkin@gmail.com> wrote: >>> On 11/03/2014 02:33 PM, Dušan Čolić wrote: >>>> I forgot: >>>> It was working for some time (deleting old directories etc.) and then >>>> crashed. >>>> Btw. why didn't that partition (/dev/md125) remounted read-only on >>>> error when I have that in /etc/fstab? >>> >>> >>> What do you suggest to do when encountering IO error? >>> There is another option: to oops. You like this better? >>> >> There's a misunderstanding maybe.... Long time ago you told me to add >> onerror=remount-ro to fstab but now when this error happened system >> continued to work but the partition stayed rw, maybe I misunderstood the >> option? >> >> >> >> Ah, "onerror" means "on IO error". >> That is, file system submitted a RW-request, and the disk driver returns >> IO error for this request. If so, then you file system will become >> read-only. >> >> As to your case: there is no IO errors. There is a kernel oops, this is >> another >> situation.. >> >> Edward. >> >> >> >>> Edward. >>> >>> >>>> On Mon, Nov 3, 2014 at 2:28 PM, Dušan Čolić <dusanc@gmail.com> wrote: >>>>> After an hour or more still nothing, one rsync went to zombie other >>>>> still in D state >>>>> I killed the main process and rebooted. >>>>> >>>>> krshina3 goran # ps -aux | grep rsync >>>>> root 6655 0.0 0.1 101568 9328 pts/4 D 13:08 0:01 >>>>> /usr/bin/rsync -ax --delete --numeric-ids --relative --delete-excluded >>>>> --exclude=/home/windows.qcow2 >>>>> --link-dest=/mnt/backup/daily.1/localhost/ /home >>>>> /mnt/backup/daily.0/localhost/ >>>>> root 6656 0.0 0.0 0 0 pts/4 Z 13:08 0:00 >>>>> [rsync] <defunct> >>>>> >>>>> >>>>> Now I tried same command (rsnapshot -c /etc/rsnapshot.d/daily.conf >>>>> daily) and kernel BUGed with: >>>>> >>>>> krshina3 goran # rsnapshot -c /etc/rsnapshot.d/daily.conf daily >>>>> rsync: writefd_unbuffered failed to write 5 bytes to socket >>>>> [generator]: Broken pipe (32) >>>>> >>>>> ---------------------------------------------------------------------------- >>>>> rsnapshot encountered an error! The program was invoked with these >>>>> options: >>>>> /usr/bin/rsnapshot -c /etc/rsnapshot.d/daily.conf daily >>>>> >>>>> ---------------------------------------------------------------------------- >>>>> ERROR: /usr/bin/rsync returned 0.04296875 while processing /home/ >>>>> WARNING: Rolling back "localhost/" >>>>> rsync error: error in rsync protocol data stream (code 12) at >>>>> io.c(1532) [generator=3.0.9] >>>>> >> [-- Attachment #2: reiser4-crc-fixups.patch --] [-- Type: text/x-patch, Size: 678 bytes --] Don't panic when unprepped ctail cluster is found. Instead, return error and suggest to fsck. Signed-off-by: Edward Shishkin <edward.shishkin@gmail.com> --- fs/reiser4/plugin/item/ctail.c | 6 +++++- 1 file changed, 5 insertions(+), 1 deletion(-) --- a/fs/reiser4/plugin/item/ctail.c +++ b/fs/reiser4/plugin/item/ctail.c @@ -666,7 +666,11 @@ int do_readpage_ctail(struct inode * ino switch (clust->dstat) { case UNPR_DISK_CLUSTER: - BUG_ON(1); + warning("edward-1632", + "Bad item cluster %lu (Inode %llu). Fsck?", + clust->index, + (unsigned long long)get_inode_oid(inode)); + return RETERR(-EIO); case TRNC_DISK_CLUSTER: /* * Race with truncate! ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-11-04 12:49 ` Edward Shishkin @ 2014-11-04 13:16 ` Dušan Čolić 2014-11-04 13:21 ` Edward Shishkin [not found] ` <545965C7.5010304@gmail.com> 0 siblings, 2 replies; 33+ messages in thread From: Dušan Čolić @ 2014-11-04 13:16 UTC (permalink / raw) To: Edward Shishkin; +Cc: reiserfs-devel, Ivan Shapovalov Did a fsck of source partition. Btw. why is there a reason this corruption appeared when I started using 3.16.2 instead 3.10? And here are the results: krshina3 ~ # cat fsck.sda2 FSCK: node.c: 108: repair_node_items_check: Node (4093690), items (27) and (28): Wrong order of keys. FSCK: filter.c: 407: repair_filter_update_traverse: Node (4093690): the node is broken. Pointed from the node (531714), item (15), unit (0). The whole subtree is skipped. FSCK: node.c: 108: repair_node_items_check: Node (4099659), items (12) and (13): Wrong order of keys. FSCK: filter.c: 407: repair_filter_update_traverse: Node (4099659): the node is broken. Pointed from the node (531714), item (16), unit (0). The whole subtree is skipped. FSCK: node.c: 108: repair_node_items_check: Node (4099663), items (21) and (22): Wrong order of keys. FSCK: filter.c: 407: repair_filter_update_traverse: Node (4099663): the node is broken. Pointed from the node (531714), item (17), unit (0). The whole subtree is skipped. krshina3 ~ # cat fsck.build.sda2 FSCK: node.c: 108: repair_node_items_check: Node (4093690), items (27) and (28): Wrong order of keys. FSCK: filter.c: 407: repair_filter_update_traverse: Node (4093690): the node is unrecoverable. Pointed from the node (531714), item (15), unit (0). Removed. FSCK: node.c: 108: repair_node_items_check: Node (4099659), items (12) and (13): Wrong order of keys. FSCK: filter.c: 407: repair_filter_update_traverse: Node (4099659): the node is unrecoverable. Pointed from the node (531714), item (15), unit (0). Removed. FSCK: node.c: 108: repair_node_items_check: Node (4099663), items (21) and (22): Wrong order of keys. FSCK: filter.c: 407: repair_filter_update_traverse: Node (4099663): the node is unrecoverable. Pointed from the node (531714), item (15), unit (0). Removed. FSCK: node.c: 108: repair_node_items_check: Node (4080447), items (0) and (1): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4080571), items (0) and (1): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4081137), items (1) and (2): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4090871), items (0) and (1): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4091337), items (0) and (1): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4091990), items (0) and (1): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4093016), items (0) and (1): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4094525), items (0) and (1): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4096175), items (0) and (1): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4113492), items (0) and (1): Wrong order of keys. On Tue, Nov 4, 2014 at 1:49 PM, Edward Shishkin <edward.shishkin@gmail.com> wrote: > The attached patch prevents panic. > > Thanks, > Edward. > > > > On 11/03/2014 07:27 PM, Dušan Čolić wrote: >> >> Ok now with same config kernels 3.16, 3.14 and 3.10 fail in same spot. >> It failes around rsync --delete or something command, dunno how to >> find what it is I looked at iotop. >> So let me reiterate: >> One automated operation that worked after fsck every day for months >> with kernel 3.10 started making problems since I started using 3.16 >> BUT it makes kernel Oops even if I go back to 3.10. The only funky >> thing I did was having txmod=wa for few days in /etc/fstab but that >> was before these problems. Could it be that some corrupted file makes >> this, unseen by fsck? >> I can reformat this partition but I suspect that problematic file is >> on my /. And then we wouldn't have a test case to reproduce this oops >> :) >> Is there any way to record all IO requests to find what exactly does this? >> >> This is Oops from 3.14: >> >> Nov 3 18:57:40 krshina3 kernel: [ 179.693947] ------------[ cut here >> ]------------ >> Nov 3 18:57:40 krshina3 kernel: [ 179.694212] kernel BUG at >> fs/reiser4/plugin/item/ctail.c:669! >> Nov 3 18:57:40 krshina3 kernel: [ 179.694537] invalid opcode: 0000 [#1] >> SMP >> Nov 3 18:57:40 krshina3 kernel: [ 179.694779] CPU: 1 PID: 3203 Comm: >> rsync Not tainted 3.14.14-gentoo #1 >> Nov 3 18:57:40 krshina3 kernel: [ 179.695148] Hardware name: >> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >> 07/04/2012 >> Nov 3 18:57:40 krshina3 kernel: [ 179.695702] task: ffff8800b6cf47b0 >> ti: ffff8801db7f6000 task.ti: ffff8801db7f6000 >> Nov 3 18:57:40 krshina3 kernel: [ 179.696128] RIP: >> 0010:[<ffffffff811bc700>] [<ffffffff811bc700>] >> do_readpage_ctail+0x2a0/0x400 >> Nov 3 18:57:40 krshina3 kernel: [ 179.696625] RSP: >> 0018:ffff8801db7f7a68 EFLAGS: 00010246 >> Nov 3 18:57:40 krshina3 kernel: [ 179.696925] RAX: 8000000000000021 >> RBX: ffffea000664a8c8 RCX: ffff8800b9964800 >> Nov 3 18:57:40 krshina3 kernel: [ 179.697329] RDX: 0000000000000035 >> RSI: 0000000000000000 RDI: ffff8800b9967800 >> Nov 3 18:57:40 krshina3 kernel: [ 179.697739] RBP: 0000000000000002 >> R08: 0000000000000000 R09: 0000000000000001 >> Nov 3 18:57:40 krshina3 kernel: [ 179.698145] R10: ffffffff811ad0a0 >> R11: 0000000000000000 R12: ffff8800841dfd58 >> Nov 3 18:57:40 krshina3 kernel: [ 179.698548] R13: ffff8801db7f7b58 >> R14: 0000000000000001 R15: 0000000000001000 >> Nov 3 18:57:40 krshina3 kernel: [ 179.698952] FS: >> 00007f40176a0700(0000) GS:ffff88022e280000(0000) >> knlGS:0000000000000000 >> Nov 3 18:57:40 krshina3 kernel: [ 179.699410] CS: 0010 DS: 0000 ES: >> 0000 CR0: 0000000080050033 >> Nov 3 18:57:40 krshina3 kernel: [ 179.699735] CR2: 0000000002b30248 >> CR3: 00000001de9d8000 CR4: 00000000001427e0 >> Nov 3 18:57:40 krshina3 kernel: [ 179.700145] DR0: 0000000000000045 >> DR1: 0000000000000000 DR2: 0000000000000000 >> Nov 3 18:57:40 krshina3 kernel: [ 179.700555] DR3: 0000000000000005 >> DR6: 00000000ffff0ff0 DR7: 0000000000000400 >> Nov 3 18:57:40 krshina3 kernel: [ 179.700966] Stack: >> Nov 3 18:57:40 krshina3 kernel: [ 179.701080] ffff8800841dfe98 >> ffff8801db7f7b58 ffffea000664a8c8 0000000000000000 >> Nov 3 18:57:40 krshina3 kernel: [ 179.701523] ffff8800b6cf47b0 >> ffff8800841dfd58 0000000000000000 ffffffff811bc969 >> Nov 3 18:57:40 krshina3 kernel: [ 179.701963] ffffea000664a8c8 >> ffffea000664a8c8 ffff8801db7f7c90 ffff8800841dfe98 >> Nov 3 18:57:40 krshina3 kernel: [ 179.702402] Call Trace: >> Nov 3 18:57:40 krshina3 kernel: [ 179.702540] [<ffffffff811bc969>] >> ? ctail_readpages_filler+0x109/0x210 >> Nov 3 18:57:40 krshina3 kernel: [ 179.702911] [<ffffffff811bc860>] >> ? do_readpage_ctail+0x400/0x400 >> Nov 3 18:57:40 krshina3 kernel: [ 179.703257] [<ffffffff810e9b91>] >> ? read_cache_pages+0xb1/0x120 >> Nov 3 18:57:40 krshina3 kernel: [ 179.703592] [<ffffffff811bccf5>] >> ? readpages_ctail+0x135/0x340 >> Nov 3 18:57:40 krshina3 kernel: [ 179.703928] [<ffffffff811b0da6>] >> ? readpages_cryptcompress+0x46/0x90 >> Nov 3 18:57:40 krshina3 kernel: [ 179.704292] [<ffffffff810e99c1>] >> ? __do_page_cache_readahead+0x1b1/0x260 >> Nov 3 18:57:40 krshina3 kernel: [ 179.704677] [<ffffffff811ab0a0>] >> ? reiser4_write_dispatch+0x4d0/0x4d0 >> Nov 3 18:57:40 krshina3 kernel: [ 179.705047] [<ffffffff810e9d1c>] >> ? ra_submit+0x1c/0x30 >> Nov 3 18:57:40 krshina3 kernel: [ 179.705343] [<ffffffff810e09b6>] >> ? generic_file_aio_read+0x4d6/0x6f0 >> Nov 3 18:57:40 krshina3 kernel: [ 179.705708] [<ffffffff8111bb4a>] >> ? do_sync_read+0x5a/0x90 >> Nov 3 18:57:40 krshina3 kernel: [ 179.706023] [<ffffffff8109de30>] >> ? __dequeue_entity+0x40/0x50 >> Nov 3 18:57:40 krshina3 kernel: [ 179.706354] [<ffffffff811b0e68>] >> ? read_cryptcompress+0x78/0xc0 >> Nov 3 18:57:40 krshina3 kernel: [ 179.706694] [<ffffffff811ab244>] >> ? reiser4_read_dispatch+0x74/0x170 >> Nov 3 18:57:40 krshina3 kernel: [ 179.707056] [<ffffffff8111c8a1>] >> ? vfs_read+0xa1/0x180 >> Nov 3 18:57:40 krshina3 kernel: [ 179.707351] [<ffffffff8111cd9f>] >> ? SyS_read+0x4f/0xc0 >> Nov 3 18:57:40 krshina3 kernel: [ 179.707642] [<ffffffff81670d62>] >> ? system_call_fastpath+0x16/0x1b >> Nov 3 18:57:40 krshina3 kernel: [ 179.707992] Code: 80 0b 08 31 ed >> e9 b0 fe ff ff 90 48 89 df e8 18 2d f2 ff e9 62 fe ff ff 0f 1f 00 48 >> 89 df e8 08 2d f2 ff e9 92 fe ff ff 0f 1f 00 <0f> 0b 48 8b 03 a8 08 0f >> 84 a2 00 00 00 49 8b bd 80 00 00 00 e8 >> Nov 3 18:57:40 krshina3 kernel: [ 179.709414] RIP >> [<ffffffff811bc700>] do_readpage_ctail+0x2a0/0x400 >> Nov 3 18:57:40 krshina3 kernel: [ 179.709774] RSP <ffff8801db7f7a68> >> Nov 3 18:57:40 krshina3 kernel: [ 179.821174] ---[ end trace >> d60466a8b91493b8 ]--- >> >> This is from 3.10: >> >> Nov 3 19:08:36 krshina3 kernel: [ 449.276796] ------------[ cut here >> ]------------ >> Nov 3 19:08:36 krshina3 kernel: [ 449.276825] kernel BUG at >> fs/reiser4/plugin/item/ctail.c:669! >> Nov 3 19:08:36 krshina3 kernel: [ 449.276841] invalid opcode: 0000 [#1] >> SMP >> Nov 3 19:08:36 krshina3 kernel: [ 449.276857] CPU: 1 PID: 3167 Comm: >> rsync Not tainted 3.10.6-gentoo #2 >> Nov 3 19:08:36 krshina3 kernel: [ 449.276875] Hardware name: >> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >> 07/04/2012 >> Nov 3 19:08:36 krshina3 kernel: [ 449.276900] task: ffff88022d2ac690 >> ti: ffff880074f80000 task.ti: ffff880074f80000 >> Nov 3 19:08:36 krshina3 kernel: [ 449.276920] RIP: >> 0010:[<ffffffff811555e9>] [<ffffffff811555e9>] >> do_readpage_ctail+0x2f3/0x3ed >> Nov 3 19:08:36 krshina3 kernel: [ 449.276948] RSP: >> 0018:ffff880074f81a28 EFLAGS: 00010246 >> Nov 3 19:08:36 krshina3 kernel: [ 449.276962] RAX: 0000000000000000 >> RBX: ffffea0005a31988 RCX: 00000000000354d4 >> Nov 3 19:08:36 krshina3 kernel: [ 449.276981] RDX: 0000000000000035 >> RSI: 0000000000000000 RDI: ffff8801a139fcd8 >> Nov 3 19:08:36 krshina3 kernel: [ 449.276999] RBP: ffff880074f81b18 >> R08: 0000000000000000 R09: 0000000000000000 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277018] R10: 0000000000000866 >> R11: 0000000000000866 R12: ffff8801a139fb98 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277037] R13: 0000000000000002 >> R14: 0000000000000000 R15: 0000000000001000 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277056] FS: >> 00007fc4e9c01700(0000) GS:ffff88022e280000(0000) >> knlGS:0000000000000000 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277077] CS: 0010 DS: 0000 ES: >> 0000 CR0: 0000000080050033 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277092] CR2: 000000000331a248 >> CR3: 0000000075069000 CR4: 00000000001427e0 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277111] DR0: 0000000000000045 >> DR1: 0000000000000000 DR2: 0000000000000000 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277129] DR3: 0000000000000005 >> DR6: 00000000ffff0ff0 DR7: 0000000000000400 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277147] Stack: >> Nov 3 19:08:36 krshina3 kernel: [ 449.277154] ffff8801a139fcd8 >> ffff880074f81b18 ffff8801a139fb98 ffffea0005a31988 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277177] 0000000000000000 >> 0000000000000000 ffff880074f81b18 ffffffff81155861 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277200] ffffea0005a31988 >> ffffea0005a31988 ffff880074f81c78 ffff8801a139fcd8 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277223] Call Trace: >> Nov 3 19:08:36 krshina3 kernel: [ 449.277232] [<ffffffff81155861>] >> ? ctail_readpages_filler+0x17e/0x1c2 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277250] [<ffffffff811556e3>] >> ? do_readpage_ctail+0x3ed/0x3ed >> Nov 3 19:08:36 krshina3 kernel: [ 449.277268] [<ffffffff810ad77c>] >> ? read_cache_pages+0x91/0x108 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277286] [<ffffffff8113a7d1>] >> ? reiser4_get_file_fsdata+0x33/0x8a >> Nov 3 19:08:36 krshina3 kernel: [ 449.277304] [<ffffffff81155c95>] >> ? readpages_ctail+0x2f2/0x2f9 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277321] [<ffffffff8114bef8>] >> ? readpages_cryptcompress+0x3f/0x6b >> Nov 3 19:08:36 krshina3 kernel: [ 449.277339] [<ffffffff810ad5b3>] >> ? __do_page_cache_readahead+0x11f/0x1c3 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277357] [<ffffffff810ad8c3>] >> ? ra_submit+0x1c/0x23 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277372] [<ffffffff810a6348>] >> ? generic_file_aio_read+0x269/0x5b6 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277390] [<ffffffff810d4399>] >> ? do_sync_read+0x6e/0x90 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277406] [<ffffffff8114bf8d>] >> ? read_cryptcompress+0x69/0x95 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277423] [<ffffffff8114723b>] >> ? reiser4_read_dispatch+0xc9/0x124 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277441] [<ffffffff810d4dc2>] >> ? vfs_read+0xac/0x146 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277456] [<ffffffff810d51da>] >> ? SyS_read+0x4e/0x78 >> Nov 3 19:08:36 krshina3 kernel: [ 449.277471] [<ffffffff814c9312>] >> ? system_call_fastpath+0x16/0x1b >> Nov 3 19:08:36 krshina3 kernel: [ 449.277487] Code: f9 00 00 00 44 >> 8b ad 88 00 00 00 41 83 fd 02 74 1a 77 0c 41 83 fd 01 0f 85 e0 00 00 >> 00 eb 61 41 83 fd 04 0f 87 d4 00 00 00 eb 02 <0f> 0b 65 48 8b 14 25 48 >> b7 00 00 48 81 ea d8 1f 00 00 ff 42 1c >> Nov 3 19:08:36 krshina3 kernel: [ 449.277612] RIP >> [<ffffffff811555e9>] do_readpage_ctail+0x2f3/0x3ed >> Nov 3 19:08:36 krshina3 kernel: [ 449.277630] RSP <ffff880074f81a28> >> Nov 3 19:08:36 krshina3 kernel: [ 449.282221] ---[ end trace >> f14ff60ec68f3286 ]--- >> >> On Mon, Nov 3, 2014 at 5:43 PM, Edward Shishkin >> <edward.shishkin@gmail.com> wrote: >>> >>> On 11/03/2014 04:48 PM, Dušan Čolić wrote: >>> >>> >>> On Nov 3, 2014 4:43 PM, "Edward Shishkin" <edward.shishkin@gmail.com> >>> wrote: >>>> >>>> On 11/03/2014 02:33 PM, Dušan Čolić wrote: >>>>> >>>>> I forgot: >>>>> It was working for some time (deleting old directories etc.) and then >>>>> crashed. >>>>> Btw. why didn't that partition (/dev/md125) remounted read-only on >>>>> error when I have that in /etc/fstab? >>>> >>>> >>>> >>>> What do you suggest to do when encountering IO error? >>>> There is another option: to oops. You like this better? >>>> >>> There's a misunderstanding maybe.... Long time ago you told me to add >>> onerror=remount-ro to fstab but now when this error happened system >>> continued to work but the partition stayed rw, maybe I misunderstood the >>> option? >>> >>> >>> >>> Ah, "onerror" means "on IO error". >>> That is, file system submitted a RW-request, and the disk driver returns >>> IO error for this request. If so, then you file system will become >>> read-only. >>> >>> As to your case: there is no IO errors. There is a kernel oops, this is >>> another >>> situation.. >>> >>> Edward. >>> >>> >>> >>>> Edward. >>>> >>>> >>>>> On Mon, Nov 3, 2014 at 2:28 PM, Dušan Čolić <dusanc@gmail.com> wrote: >>>>>> >>>>>> After an hour or more still nothing, one rsync went to zombie other >>>>>> still in D state >>>>>> I killed the main process and rebooted. >>>>>> >>>>>> krshina3 goran # ps -aux | grep rsync >>>>>> root 6655 0.0 0.1 101568 9328 pts/4 D 13:08 0:01 >>>>>> /usr/bin/rsync -ax --delete --numeric-ids --relative --delete-excluded >>>>>> --exclude=/home/windows.qcow2 >>>>>> --link-dest=/mnt/backup/daily.1/localhost/ /home >>>>>> /mnt/backup/daily.0/localhost/ >>>>>> root 6656 0.0 0.0 0 0 pts/4 Z 13:08 0:00 >>>>>> [rsync] <defunct> >>>>>> >>>>>> >>>>>> Now I tried same command (rsnapshot -c /etc/rsnapshot.d/daily.conf >>>>>> daily) and kernel BUGed with: >>>>>> >>>>>> krshina3 goran # rsnapshot -c /etc/rsnapshot.d/daily.conf daily >>>>>> rsync: writefd_unbuffered failed to write 5 bytes to socket >>>>>> [generator]: Broken pipe (32) >>>>>> >>>>>> >>>>>> ---------------------------------------------------------------------------- >>>>>> rsnapshot encountered an error! The program was invoked with these >>>>>> options: >>>>>> /usr/bin/rsnapshot -c /etc/rsnapshot.d/daily.conf daily >>>>>> >>>>>> >>>>>> ---------------------------------------------------------------------------- >>>>>> ERROR: /usr/bin/rsync returned 0.04296875 while processing /home/ >>>>>> WARNING: Rolling back "localhost/" >>>>>> rsync error: error in rsync protocol data stream (code 12) at >>>>>> io.c(1532) [generator=3.0.9] >>>>>> >>> > -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-11-04 13:16 ` Dušan Čolić @ 2014-11-04 13:21 ` Edward Shishkin 2014-11-04 13:23 ` Dušan Čolić [not found] ` <545965C7.5010304@gmail.com> 1 sibling, 1 reply; 33+ messages in thread From: Edward Shishkin @ 2014-11-04 13:21 UTC (permalink / raw) To: Dušan Čolić; +Cc: reiserfs-devel, Ivan Shapovalov On 11/04/2014 02:16 PM, Dušan Čolić wrote: > Did a fsck of source partition. > Btw. why is there a reason this corruption appeared when I started > using 3.16.2 instead 3.10? Why are you sure that it wasn't corrupted when you used 3.10? Edward. > And here are the results: > > krshina3 ~ # cat fsck.sda2 > FSCK: node.c: 108: repair_node_items_check: Node (4093690), items (27) and (28): > Wrong order of keys. > FSCK: filter.c: 407: repair_filter_update_traverse: Node (4093690): the node is > broken. Pointed from the node (531714), item (15), unit (0). The whole subtree > is skipped. > FSCK: node.c: 108: repair_node_items_check: Node (4099659), items (12) and (13): > Wrong order of keys. > FSCK: filter.c: 407: repair_filter_update_traverse: Node (4099659): the node is > broken. Pointed from the node (531714), item (16), unit (0). The whole subtree > is skipped. > FSCK: node.c: 108: repair_node_items_check: Node (4099663), items (21) and (22): > Wrong order of keys. > FSCK: filter.c: 407: repair_filter_update_traverse: Node (4099663): the node is > broken. Pointed from the node (531714), item (17), unit (0). The whole subtree > is skipped. > > > > krshina3 ~ # cat fsck.build.sda2 > FSCK: node.c: 108: repair_node_items_check: Node (4093690), items (27) and (28): > Wrong order of keys. > FSCK: filter.c: 407: repair_filter_update_traverse: Node (4093690): the node is > unrecoverable. Pointed from the node (531714), item (15), unit (0). Removed. > FSCK: node.c: 108: repair_node_items_check: Node (4099659), items (12) and (13): > Wrong order of keys. > FSCK: filter.c: 407: repair_filter_update_traverse: Node (4099659): the node is > unrecoverable. Pointed from the node (531714), item (15), unit (0). Removed. > FSCK: node.c: 108: repair_node_items_check: Node (4099663), items (21) and (22): > Wrong order of keys. > FSCK: filter.c: 407: repair_filter_update_traverse: Node (4099663): the node is > unrecoverable. Pointed from the node (531714), item (15), unit (0). Removed. > FSCK: node.c: 108: repair_node_items_check: Node (4080447), items (0) and (1): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4080571), items (0) and (1): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4081137), items (1) and (2): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4090871), items (0) and (1): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4091337), items (0) > and (1): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4091990), items (0) > and (1): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4093016), items (0) > and (1): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4094525), items (0) > and (1): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4096175), items (0) > and (1): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4113492), items (0) > and (1): > Wrong order of keys. > > On Tue, Nov 4, 2014 at 1:49 PM, Edward Shishkin > <edward.shishkin@gmail.com> wrote: >> The attached patch prevents panic. >> >> Thanks, >> Edward. >> >> >> >> On 11/03/2014 07:27 PM, Dušan Čolić wrote: >>> Ok now with same config kernels 3.16, 3.14 and 3.10 fail in same spot. >>> It failes around rsync --delete or something command, dunno how to >>> find what it is I looked at iotop. >>> So let me reiterate: >>> One automated operation that worked after fsck every day for months >>> with kernel 3.10 started making problems since I started using 3.16 >>> BUT it makes kernel Oops even if I go back to 3.10. The only funky >>> thing I did was having txmod=wa for few days in /etc/fstab but that >>> was before these problems. Could it be that some corrupted file makes >>> this, unseen by fsck? >>> I can reformat this partition but I suspect that problematic file is >>> on my /. And then we wouldn't have a test case to reproduce this oops >>> :) >>> Is there any way to record all IO requests to find what exactly does this? >>> >>> This is Oops from 3.14: >>> >>> Nov 3 18:57:40 krshina3 kernel: [ 179.693947] ------------[ cut here >>> ]------------ >>> Nov 3 18:57:40 krshina3 kernel: [ 179.694212] kernel BUG at >>> fs/reiser4/plugin/item/ctail.c:669! >>> Nov 3 18:57:40 krshina3 kernel: [ 179.694537] invalid opcode: 0000 [#1] >>> SMP >>> Nov 3 18:57:40 krshina3 kernel: [ 179.694779] CPU: 1 PID: 3203 Comm: >>> rsync Not tainted 3.14.14-gentoo #1 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.695148] Hardware name: >>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>> 07/04/2012 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.695702] task: ffff8800b6cf47b0 >>> ti: ffff8801db7f6000 task.ti: ffff8801db7f6000 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.696128] RIP: >>> 0010:[<ffffffff811bc700>] [<ffffffff811bc700>] >>> do_readpage_ctail+0x2a0/0x400 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.696625] RSP: >>> 0018:ffff8801db7f7a68 EFLAGS: 00010246 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.696925] RAX: 8000000000000021 >>> RBX: ffffea000664a8c8 RCX: ffff8800b9964800 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.697329] RDX: 0000000000000035 >>> RSI: 0000000000000000 RDI: ffff8800b9967800 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.697739] RBP: 0000000000000002 >>> R08: 0000000000000000 R09: 0000000000000001 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.698145] R10: ffffffff811ad0a0 >>> R11: 0000000000000000 R12: ffff8800841dfd58 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.698548] R13: ffff8801db7f7b58 >>> R14: 0000000000000001 R15: 0000000000001000 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.698952] FS: >>> 00007f40176a0700(0000) GS:ffff88022e280000(0000) >>> knlGS:0000000000000000 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.699410] CS: 0010 DS: 0000 ES: >>> 0000 CR0: 0000000080050033 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.699735] CR2: 0000000002b30248 >>> CR3: 00000001de9d8000 CR4: 00000000001427e0 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.700145] DR0: 0000000000000045 >>> DR1: 0000000000000000 DR2: 0000000000000000 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.700555] DR3: 0000000000000005 >>> DR6: 00000000ffff0ff0 DR7: 0000000000000400 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.700966] Stack: >>> Nov 3 18:57:40 krshina3 kernel: [ 179.701080] ffff8800841dfe98 >>> ffff8801db7f7b58 ffffea000664a8c8 0000000000000000 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.701523] ffff8800b6cf47b0 >>> ffff8800841dfd58 0000000000000000 ffffffff811bc969 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.701963] ffffea000664a8c8 >>> ffffea000664a8c8 ffff8801db7f7c90 ffff8800841dfe98 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.702402] Call Trace: >>> Nov 3 18:57:40 krshina3 kernel: [ 179.702540] [<ffffffff811bc969>] >>> ? ctail_readpages_filler+0x109/0x210 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.702911] [<ffffffff811bc860>] >>> ? do_readpage_ctail+0x400/0x400 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.703257] [<ffffffff810e9b91>] >>> ? read_cache_pages+0xb1/0x120 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.703592] [<ffffffff811bccf5>] >>> ? readpages_ctail+0x135/0x340 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.703928] [<ffffffff811b0da6>] >>> ? readpages_cryptcompress+0x46/0x90 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.704292] [<ffffffff810e99c1>] >>> ? __do_page_cache_readahead+0x1b1/0x260 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.704677] [<ffffffff811ab0a0>] >>> ? reiser4_write_dispatch+0x4d0/0x4d0 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.705047] [<ffffffff810e9d1c>] >>> ? ra_submit+0x1c/0x30 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.705343] [<ffffffff810e09b6>] >>> ? generic_file_aio_read+0x4d6/0x6f0 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.705708] [<ffffffff8111bb4a>] >>> ? do_sync_read+0x5a/0x90 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.706023] [<ffffffff8109de30>] >>> ? __dequeue_entity+0x40/0x50 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.706354] [<ffffffff811b0e68>] >>> ? read_cryptcompress+0x78/0xc0 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.706694] [<ffffffff811ab244>] >>> ? reiser4_read_dispatch+0x74/0x170 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.707056] [<ffffffff8111c8a1>] >>> ? vfs_read+0xa1/0x180 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.707351] [<ffffffff8111cd9f>] >>> ? SyS_read+0x4f/0xc0 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.707642] [<ffffffff81670d62>] >>> ? system_call_fastpath+0x16/0x1b >>> Nov 3 18:57:40 krshina3 kernel: [ 179.707992] Code: 80 0b 08 31 ed >>> e9 b0 fe ff ff 90 48 89 df e8 18 2d f2 ff e9 62 fe ff ff 0f 1f 00 48 >>> 89 df e8 08 2d f2 ff e9 92 fe ff ff 0f 1f 00 <0f> 0b 48 8b 03 a8 08 0f >>> 84 a2 00 00 00 49 8b bd 80 00 00 00 e8 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.709414] RIP >>> [<ffffffff811bc700>] do_readpage_ctail+0x2a0/0x400 >>> Nov 3 18:57:40 krshina3 kernel: [ 179.709774] RSP <ffff8801db7f7a68> >>> Nov 3 18:57:40 krshina3 kernel: [ 179.821174] ---[ end trace >>> d60466a8b91493b8 ]--- >>> >>> This is from 3.10: >>> >>> Nov 3 19:08:36 krshina3 kernel: [ 449.276796] ------------[ cut here >>> ]------------ >>> Nov 3 19:08:36 krshina3 kernel: [ 449.276825] kernel BUG at >>> fs/reiser4/plugin/item/ctail.c:669! >>> Nov 3 19:08:36 krshina3 kernel: [ 449.276841] invalid opcode: 0000 [#1] >>> SMP >>> Nov 3 19:08:36 krshina3 kernel: [ 449.276857] CPU: 1 PID: 3167 Comm: >>> rsync Not tainted 3.10.6-gentoo #2 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.276875] Hardware name: >>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>> 07/04/2012 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.276900] task: ffff88022d2ac690 >>> ti: ffff880074f80000 task.ti: ffff880074f80000 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.276920] RIP: >>> 0010:[<ffffffff811555e9>] [<ffffffff811555e9>] >>> do_readpage_ctail+0x2f3/0x3ed >>> Nov 3 19:08:36 krshina3 kernel: [ 449.276948] RSP: >>> 0018:ffff880074f81a28 EFLAGS: 00010246 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.276962] RAX: 0000000000000000 >>> RBX: ffffea0005a31988 RCX: 00000000000354d4 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.276981] RDX: 0000000000000035 >>> RSI: 0000000000000000 RDI: ffff8801a139fcd8 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.276999] RBP: ffff880074f81b18 >>> R08: 0000000000000000 R09: 0000000000000000 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277018] R10: 0000000000000866 >>> R11: 0000000000000866 R12: ffff8801a139fb98 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277037] R13: 0000000000000002 >>> R14: 0000000000000000 R15: 0000000000001000 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277056] FS: >>> 00007fc4e9c01700(0000) GS:ffff88022e280000(0000) >>> knlGS:0000000000000000 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277077] CS: 0010 DS: 0000 ES: >>> 0000 CR0: 0000000080050033 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277092] CR2: 000000000331a248 >>> CR3: 0000000075069000 CR4: 00000000001427e0 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277111] DR0: 0000000000000045 >>> DR1: 0000000000000000 DR2: 0000000000000000 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277129] DR3: 0000000000000005 >>> DR6: 00000000ffff0ff0 DR7: 0000000000000400 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277147] Stack: >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277154] ffff8801a139fcd8 >>> ffff880074f81b18 ffff8801a139fb98 ffffea0005a31988 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277177] 0000000000000000 >>> 0000000000000000 ffff880074f81b18 ffffffff81155861 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277200] ffffea0005a31988 >>> ffffea0005a31988 ffff880074f81c78 ffff8801a139fcd8 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277223] Call Trace: >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277232] [<ffffffff81155861>] >>> ? ctail_readpages_filler+0x17e/0x1c2 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277250] [<ffffffff811556e3>] >>> ? do_readpage_ctail+0x3ed/0x3ed >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277268] [<ffffffff810ad77c>] >>> ? read_cache_pages+0x91/0x108 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277286] [<ffffffff8113a7d1>] >>> ? reiser4_get_file_fsdata+0x33/0x8a >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277304] [<ffffffff81155c95>] >>> ? readpages_ctail+0x2f2/0x2f9 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277321] [<ffffffff8114bef8>] >>> ? readpages_cryptcompress+0x3f/0x6b >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277339] [<ffffffff810ad5b3>] >>> ? __do_page_cache_readahead+0x11f/0x1c3 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277357] [<ffffffff810ad8c3>] >>> ? ra_submit+0x1c/0x23 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277372] [<ffffffff810a6348>] >>> ? generic_file_aio_read+0x269/0x5b6 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277390] [<ffffffff810d4399>] >>> ? do_sync_read+0x6e/0x90 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277406] [<ffffffff8114bf8d>] >>> ? read_cryptcompress+0x69/0x95 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277423] [<ffffffff8114723b>] >>> ? reiser4_read_dispatch+0xc9/0x124 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277441] [<ffffffff810d4dc2>] >>> ? vfs_read+0xac/0x146 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277456] [<ffffffff810d51da>] >>> ? SyS_read+0x4e/0x78 >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277471] [<ffffffff814c9312>] >>> ? system_call_fastpath+0x16/0x1b >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277487] Code: f9 00 00 00 44 >>> 8b ad 88 00 00 00 41 83 fd 02 74 1a 77 0c 41 83 fd 01 0f 85 e0 00 00 >>> 00 eb 61 41 83 fd 04 0f 87 d4 00 00 00 eb 02 <0f> 0b 65 48 8b 14 25 48 >>> b7 00 00 48 81 ea d8 1f 00 00 ff 42 1c >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277612] RIP >>> [<ffffffff811555e9>] do_readpage_ctail+0x2f3/0x3ed >>> Nov 3 19:08:36 krshina3 kernel: [ 449.277630] RSP <ffff880074f81a28> >>> Nov 3 19:08:36 krshina3 kernel: [ 449.282221] ---[ end trace >>> f14ff60ec68f3286 ]--- >>> >>> On Mon, Nov 3, 2014 at 5:43 PM, Edward Shishkin >>> <edward.shishkin@gmail.com> wrote: >>>> On 11/03/2014 04:48 PM, Dušan Čolić wrote: >>>> >>>> >>>> On Nov 3, 2014 4:43 PM, "Edward Shishkin" <edward.shishkin@gmail.com> >>>> wrote: >>>>> On 11/03/2014 02:33 PM, Dušan Čolić wrote: >>>>>> I forgot: >>>>>> It was working for some time (deleting old directories etc.) and then >>>>>> crashed. >>>>>> Btw. why didn't that partition (/dev/md125) remounted read-only on >>>>>> error when I have that in /etc/fstab? >>>>> >>>>> >>>>> What do you suggest to do when encountering IO error? >>>>> There is another option: to oops. You like this better? >>>>> >>>> There's a misunderstanding maybe.... Long time ago you told me to add >>>> onerror=remount-ro to fstab but now when this error happened system >>>> continued to work but the partition stayed rw, maybe I misunderstood the >>>> option? >>>> >>>> >>>> >>>> Ah, "onerror" means "on IO error". >>>> That is, file system submitted a RW-request, and the disk driver returns >>>> IO error for this request. If so, then you file system will become >>>> read-only. >>>> >>>> As to your case: there is no IO errors. There is a kernel oops, this is >>>> another >>>> situation.. >>>> >>>> Edward. >>>> >>>> >>>> >>>>> Edward. >>>>> >>>>> >>>>>> On Mon, Nov 3, 2014 at 2:28 PM, Dušan Čolić <dusanc@gmail.com> wrote: >>>>>>> After an hour or more still nothing, one rsync went to zombie other >>>>>>> still in D state >>>>>>> I killed the main process and rebooted. >>>>>>> >>>>>>> krshina3 goran # ps -aux | grep rsync >>>>>>> root 6655 0.0 0.1 101568 9328 pts/4 D 13:08 0:01 >>>>>>> /usr/bin/rsync -ax --delete --numeric-ids --relative --delete-excluded >>>>>>> --exclude=/home/windows.qcow2 >>>>>>> --link-dest=/mnt/backup/daily.1/localhost/ /home >>>>>>> /mnt/backup/daily.0/localhost/ >>>>>>> root 6656 0.0 0.0 0 0 pts/4 Z 13:08 0:00 >>>>>>> [rsync] <defunct> >>>>>>> >>>>>>> >>>>>>> Now I tried same command (rsnapshot -c /etc/rsnapshot.d/daily.conf >>>>>>> daily) and kernel BUGed with: >>>>>>> >>>>>>> krshina3 goran # rsnapshot -c /etc/rsnapshot.d/daily.conf daily >>>>>>> rsync: writefd_unbuffered failed to write 5 bytes to socket >>>>>>> [generator]: Broken pipe (32) >>>>>>> >>>>>>> >>>>>>> ---------------------------------------------------------------------------- >>>>>>> rsnapshot encountered an error! The program was invoked with these >>>>>>> options: >>>>>>> /usr/bin/rsnapshot -c /etc/rsnapshot.d/daily.conf daily >>>>>>> >>>>>>> >>>>>>> ---------------------------------------------------------------------------- >>>>>>> ERROR: /usr/bin/rsync returned 0.04296875 while processing /home/ >>>>>>> WARNING: Rolling back "localhost/" >>>>>>> rsync error: error in rsync protocol data stream (code 12) at >>>>>>> io.c(1532) [generator=3.0.9] >>>>>>> -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-11-04 13:21 ` Edward Shishkin @ 2014-11-04 13:23 ` Dušan Čolić 0 siblings, 0 replies; 33+ messages in thread From: Dušan Čolić @ 2014-11-04 13:23 UTC (permalink / raw) To: Edward Shishkin; +Cc: reiserfs-devel, Ivan Shapovalov Because that rsync operation I do every night worked fine for few days on 3.16 and then it Oopsed and when I tried to return to 3.10 it oopsed. If 3.10 was broken while I was using it earlier it would've oopsed and not finish the operation (snapshot of whole partition) every night. On Tue, Nov 4, 2014 at 2:21 PM, Edward Shishkin <edward.shishkin@gmail.com> wrote: > On 11/04/2014 02:16 PM, Dušan Čolić wrote: >> >> Did a fsck of source partition. >> Btw. why is there a reason this corruption appeared when I started >> using 3.16.2 instead 3.10? > > > > Why are you sure that it wasn't corrupted when you used 3.10? > > Edward. > > > >> And here are the results: >> >> krshina3 ~ # cat fsck.sda2 >> FSCK: node.c: 108: repair_node_items_check: Node (4093690), items (27) and >> (28): >> Wrong order of keys. >> FSCK: filter.c: 407: repair_filter_update_traverse: Node (4093690): the >> node is >> broken. Pointed from the node (531714), item (15), unit (0). The whole >> subtree >> is skipped. >> FSCK: node.c: 108: repair_node_items_check: Node (4099659), items (12) and >> (13): >> Wrong order of keys. >> FSCK: filter.c: 407: repair_filter_update_traverse: Node (4099659): the >> node is >> broken. Pointed from the node (531714), item (16), unit (0). The whole >> subtree >> is skipped. >> FSCK: node.c: 108: repair_node_items_check: Node (4099663), items (21) and >> (22): >> Wrong order of keys. >> FSCK: filter.c: 407: repair_filter_update_traverse: Node (4099663): the >> node is >> broken. Pointed from the node (531714), item (17), unit (0). The whole >> subtree >> is skipped. >> >> >> >> krshina3 ~ # cat fsck.build.sda2 >> FSCK: node.c: 108: repair_node_items_check: Node (4093690), items (27) and >> (28): >> Wrong order of keys. >> FSCK: filter.c: 407: repair_filter_update_traverse: Node (4093690): the >> node is >> unrecoverable. Pointed from the node (531714), item (15), unit (0). >> Removed. >> FSCK: node.c: 108: repair_node_items_check: Node (4099659), items (12) and >> (13): >> Wrong order of keys. >> FSCK: filter.c: 407: repair_filter_update_traverse: Node (4099659): the >> node is >> unrecoverable. Pointed from the node (531714), item (15), unit (0). >> Removed. >> FSCK: node.c: 108: repair_node_items_check: Node (4099663), items (21) and >> (22): >> Wrong order of keys. >> FSCK: filter.c: 407: repair_filter_update_traverse: Node (4099663): the >> node is >> unrecoverable. Pointed from the node (531714), item (15), unit (0). >> Removed. >> FSCK: node.c: 108: repair_node_items_check: Node (4080447), items (0) and >> (1): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4080571), items (0) and >> (1): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4081137), items (1) and >> (2): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4090871), items (0) and >> (1): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4091337), items (0) >> and (1): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4091990), items (0) >> and (1): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4093016), items (0) >> and (1): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4094525), items (0) >> and (1): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4096175), items (0) >> and (1): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4113492), items (0) >> and (1): >> Wrong order of keys. >> >> On Tue, Nov 4, 2014 at 1:49 PM, Edward Shishkin >> <edward.shishkin@gmail.com> wrote: >>> >>> The attached patch prevents panic. >>> >>> Thanks, >>> Edward. >>> >>> >>> >>> On 11/03/2014 07:27 PM, Dušan Čolić wrote: >>>> >>>> Ok now with same config kernels 3.16, 3.14 and 3.10 fail in same spot. >>>> It failes around rsync --delete or something command, dunno how to >>>> find what it is I looked at iotop. >>>> So let me reiterate: >>>> One automated operation that worked after fsck every day for months >>>> with kernel 3.10 started making problems since I started using 3.16 >>>> BUT it makes kernel Oops even if I go back to 3.10. The only funky >>>> thing I did was having txmod=wa for few days in /etc/fstab but that >>>> was before these problems. Could it be that some corrupted file makes >>>> this, unseen by fsck? >>>> I can reformat this partition but I suspect that problematic file is >>>> on my /. And then we wouldn't have a test case to reproduce this oops >>>> :) >>>> Is there any way to record all IO requests to find what exactly does >>>> this? >>>> >>>> This is Oops from 3.14: >>>> >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.693947] ------------[ cut here >>>> ]------------ >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.694212] kernel BUG at >>>> fs/reiser4/plugin/item/ctail.c:669! >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.694537] invalid opcode: 0000 >>>> [#1] >>>> SMP >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.694779] CPU: 1 PID: 3203 Comm: >>>> rsync Not tainted 3.14.14-gentoo #1 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.695148] Hardware name: >>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>>> 07/04/2012 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.695702] task: ffff8800b6cf47b0 >>>> ti: ffff8801db7f6000 task.ti: ffff8801db7f6000 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.696128] RIP: >>>> 0010:[<ffffffff811bc700>] [<ffffffff811bc700>] >>>> do_readpage_ctail+0x2a0/0x400 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.696625] RSP: >>>> 0018:ffff8801db7f7a68 EFLAGS: 00010246 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.696925] RAX: 8000000000000021 >>>> RBX: ffffea000664a8c8 RCX: ffff8800b9964800 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.697329] RDX: 0000000000000035 >>>> RSI: 0000000000000000 RDI: ffff8800b9967800 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.697739] RBP: 0000000000000002 >>>> R08: 0000000000000000 R09: 0000000000000001 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.698145] R10: ffffffff811ad0a0 >>>> R11: 0000000000000000 R12: ffff8800841dfd58 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.698548] R13: ffff8801db7f7b58 >>>> R14: 0000000000000001 R15: 0000000000001000 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.698952] FS: >>>> 00007f40176a0700(0000) GS:ffff88022e280000(0000) >>>> knlGS:0000000000000000 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.699410] CS: 0010 DS: 0000 ES: >>>> 0000 CR0: 0000000080050033 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.699735] CR2: 0000000002b30248 >>>> CR3: 00000001de9d8000 CR4: 00000000001427e0 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.700145] DR0: 0000000000000045 >>>> DR1: 0000000000000000 DR2: 0000000000000000 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.700555] DR3: 0000000000000005 >>>> DR6: 00000000ffff0ff0 DR7: 0000000000000400 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.700966] Stack: >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.701080] ffff8800841dfe98 >>>> ffff8801db7f7b58 ffffea000664a8c8 0000000000000000 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.701523] ffff8800b6cf47b0 >>>> ffff8800841dfd58 0000000000000000 ffffffff811bc969 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.701963] ffffea000664a8c8 >>>> ffffea000664a8c8 ffff8801db7f7c90 ffff8800841dfe98 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.702402] Call Trace: >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.702540] [<ffffffff811bc969>] >>>> ? ctail_readpages_filler+0x109/0x210 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.702911] [<ffffffff811bc860>] >>>> ? do_readpage_ctail+0x400/0x400 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.703257] [<ffffffff810e9b91>] >>>> ? read_cache_pages+0xb1/0x120 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.703592] [<ffffffff811bccf5>] >>>> ? readpages_ctail+0x135/0x340 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.703928] [<ffffffff811b0da6>] >>>> ? readpages_cryptcompress+0x46/0x90 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.704292] [<ffffffff810e99c1>] >>>> ? __do_page_cache_readahead+0x1b1/0x260 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.704677] [<ffffffff811ab0a0>] >>>> ? reiser4_write_dispatch+0x4d0/0x4d0 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.705047] [<ffffffff810e9d1c>] >>>> ? ra_submit+0x1c/0x30 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.705343] [<ffffffff810e09b6>] >>>> ? generic_file_aio_read+0x4d6/0x6f0 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.705708] [<ffffffff8111bb4a>] >>>> ? do_sync_read+0x5a/0x90 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.706023] [<ffffffff8109de30>] >>>> ? __dequeue_entity+0x40/0x50 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.706354] [<ffffffff811b0e68>] >>>> ? read_cryptcompress+0x78/0xc0 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.706694] [<ffffffff811ab244>] >>>> ? reiser4_read_dispatch+0x74/0x170 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.707056] [<ffffffff8111c8a1>] >>>> ? vfs_read+0xa1/0x180 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.707351] [<ffffffff8111cd9f>] >>>> ? SyS_read+0x4f/0xc0 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.707642] [<ffffffff81670d62>] >>>> ? system_call_fastpath+0x16/0x1b >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.707992] Code: 80 0b 08 31 ed >>>> e9 b0 fe ff ff 90 48 89 df e8 18 2d f2 ff e9 62 fe ff ff 0f 1f 00 48 >>>> 89 df e8 08 2d f2 ff e9 92 fe ff ff 0f 1f 00 <0f> 0b 48 8b 03 a8 08 0f >>>> 84 a2 00 00 00 49 8b bd 80 00 00 00 e8 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.709414] RIP >>>> [<ffffffff811bc700>] do_readpage_ctail+0x2a0/0x400 >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.709774] RSP <ffff8801db7f7a68> >>>> Nov 3 18:57:40 krshina3 kernel: [ 179.821174] ---[ end trace >>>> d60466a8b91493b8 ]--- >>>> >>>> This is from 3.10: >>>> >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.276796] ------------[ cut here >>>> ]------------ >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.276825] kernel BUG at >>>> fs/reiser4/plugin/item/ctail.c:669! >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.276841] invalid opcode: 0000 >>>> [#1] >>>> SMP >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.276857] CPU: 1 PID: 3167 Comm: >>>> rsync Not tainted 3.10.6-gentoo #2 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.276875] Hardware name: >>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>>> 07/04/2012 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.276900] task: ffff88022d2ac690 >>>> ti: ffff880074f80000 task.ti: ffff880074f80000 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.276920] RIP: >>>> 0010:[<ffffffff811555e9>] [<ffffffff811555e9>] >>>> do_readpage_ctail+0x2f3/0x3ed >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.276948] RSP: >>>> 0018:ffff880074f81a28 EFLAGS: 00010246 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.276962] RAX: 0000000000000000 >>>> RBX: ffffea0005a31988 RCX: 00000000000354d4 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.276981] RDX: 0000000000000035 >>>> RSI: 0000000000000000 RDI: ffff8801a139fcd8 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.276999] RBP: ffff880074f81b18 >>>> R08: 0000000000000000 R09: 0000000000000000 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277018] R10: 0000000000000866 >>>> R11: 0000000000000866 R12: ffff8801a139fb98 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277037] R13: 0000000000000002 >>>> R14: 0000000000000000 R15: 0000000000001000 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277056] FS: >>>> 00007fc4e9c01700(0000) GS:ffff88022e280000(0000) >>>> knlGS:0000000000000000 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277077] CS: 0010 DS: 0000 ES: >>>> 0000 CR0: 0000000080050033 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277092] CR2: 000000000331a248 >>>> CR3: 0000000075069000 CR4: 00000000001427e0 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277111] DR0: 0000000000000045 >>>> DR1: 0000000000000000 DR2: 0000000000000000 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277129] DR3: 0000000000000005 >>>> DR6: 00000000ffff0ff0 DR7: 0000000000000400 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277147] Stack: >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277154] ffff8801a139fcd8 >>>> ffff880074f81b18 ffff8801a139fb98 ffffea0005a31988 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277177] 0000000000000000 >>>> 0000000000000000 ffff880074f81b18 ffffffff81155861 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277200] ffffea0005a31988 >>>> ffffea0005a31988 ffff880074f81c78 ffff8801a139fcd8 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277223] Call Trace: >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277232] [<ffffffff81155861>] >>>> ? ctail_readpages_filler+0x17e/0x1c2 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277250] [<ffffffff811556e3>] >>>> ? do_readpage_ctail+0x3ed/0x3ed >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277268] [<ffffffff810ad77c>] >>>> ? read_cache_pages+0x91/0x108 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277286] [<ffffffff8113a7d1>] >>>> ? reiser4_get_file_fsdata+0x33/0x8a >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277304] [<ffffffff81155c95>] >>>> ? readpages_ctail+0x2f2/0x2f9 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277321] [<ffffffff8114bef8>] >>>> ? readpages_cryptcompress+0x3f/0x6b >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277339] [<ffffffff810ad5b3>] >>>> ? __do_page_cache_readahead+0x11f/0x1c3 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277357] [<ffffffff810ad8c3>] >>>> ? ra_submit+0x1c/0x23 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277372] [<ffffffff810a6348>] >>>> ? generic_file_aio_read+0x269/0x5b6 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277390] [<ffffffff810d4399>] >>>> ? do_sync_read+0x6e/0x90 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277406] [<ffffffff8114bf8d>] >>>> ? read_cryptcompress+0x69/0x95 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277423] [<ffffffff8114723b>] >>>> ? reiser4_read_dispatch+0xc9/0x124 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277441] [<ffffffff810d4dc2>] >>>> ? vfs_read+0xac/0x146 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277456] [<ffffffff810d51da>] >>>> ? SyS_read+0x4e/0x78 >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277471] [<ffffffff814c9312>] >>>> ? system_call_fastpath+0x16/0x1b >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277487] Code: f9 00 00 00 44 >>>> 8b ad 88 00 00 00 41 83 fd 02 74 1a 77 0c 41 83 fd 01 0f 85 e0 00 00 >>>> 00 eb 61 41 83 fd 04 0f 87 d4 00 00 00 eb 02 <0f> 0b 65 48 8b 14 25 48 >>>> b7 00 00 48 81 ea d8 1f 00 00 ff 42 1c >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277612] RIP >>>> [<ffffffff811555e9>] do_readpage_ctail+0x2f3/0x3ed >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.277630] RSP <ffff880074f81a28> >>>> Nov 3 19:08:36 krshina3 kernel: [ 449.282221] ---[ end trace >>>> f14ff60ec68f3286 ]--- >>>> >>>> On Mon, Nov 3, 2014 at 5:43 PM, Edward Shishkin >>>> <edward.shishkin@gmail.com> wrote: >>>>> >>>>> On 11/03/2014 04:48 PM, Dušan Čolić wrote: >>>>> >>>>> >>>>> On Nov 3, 2014 4:43 PM, "Edward Shishkin" <edward.shishkin@gmail.com> >>>>> wrote: >>>>>> >>>>>> On 11/03/2014 02:33 PM, Dušan Čolić wrote: >>>>>>> >>>>>>> I forgot: >>>>>>> It was working for some time (deleting old directories etc.) and then >>>>>>> crashed. >>>>>>> Btw. why didn't that partition (/dev/md125) remounted read-only on >>>>>>> error when I have that in /etc/fstab? >>>>>> >>>>>> >>>>>> >>>>>> What do you suggest to do when encountering IO error? >>>>>> There is another option: to oops. You like this better? >>>>>> >>>>> There's a misunderstanding maybe.... Long time ago you told me to add >>>>> onerror=remount-ro to fstab but now when this error happened system >>>>> continued to work but the partition stayed rw, maybe I misunderstood >>>>> the >>>>> option? >>>>> >>>>> >>>>> >>>>> Ah, "onerror" means "on IO error". >>>>> That is, file system submitted a RW-request, and the disk driver >>>>> returns >>>>> IO error for this request. If so, then you file system will become >>>>> read-only. >>>>> >>>>> As to your case: there is no IO errors. There is a kernel oops, this is >>>>> another >>>>> situation.. >>>>> >>>>> Edward. >>>>> >>>>> >>>>> >>>>>> Edward. >>>>>> >>>>>> >>>>>>> On Mon, Nov 3, 2014 at 2:28 PM, Dušan Čolić <dusanc@gmail.com> wrote: >>>>>>>> >>>>>>>> After an hour or more still nothing, one rsync went to zombie other >>>>>>>> still in D state >>>>>>>> I killed the main process and rebooted. >>>>>>>> >>>>>>>> krshina3 goran # ps -aux | grep rsync >>>>>>>> root 6655 0.0 0.1 101568 9328 pts/4 D 13:08 0:01 >>>>>>>> /usr/bin/rsync -ax --delete --numeric-ids --relative >>>>>>>> --delete-excluded >>>>>>>> --exclude=/home/windows.qcow2 >>>>>>>> --link-dest=/mnt/backup/daily.1/localhost/ /home >>>>>>>> /mnt/backup/daily.0/localhost/ >>>>>>>> root 6656 0.0 0.0 0 0 pts/4 Z 13:08 0:00 >>>>>>>> [rsync] <defunct> >>>>>>>> >>>>>>>> >>>>>>>> Now I tried same command (rsnapshot -c /etc/rsnapshot.d/daily.conf >>>>>>>> daily) and kernel BUGed with: >>>>>>>> >>>>>>>> krshina3 goran # rsnapshot -c /etc/rsnapshot.d/daily.conf daily >>>>>>>> rsync: writefd_unbuffered failed to write 5 bytes to socket >>>>>>>> [generator]: Broken pipe (32) >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> ---------------------------------------------------------------------------- >>>>>>>> rsnapshot encountered an error! The program was invoked with these >>>>>>>> options: >>>>>>>> /usr/bin/rsnapshot -c /etc/rsnapshot.d/daily.conf daily >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> ---------------------------------------------------------------------------- >>>>>>>> ERROR: /usr/bin/rsync returned 0.04296875 while processing /home/ >>>>>>>> WARNING: Rolling back "localhost/" >>>>>>>> rsync error: error in rsync protocol data stream (code 12) at >>>>>>>> io.c(1532) [generator=3.0.9] >>>>>>>> > -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
[parent not found: <545965C7.5010304@gmail.com>]
[parent not found: <CADW=+3k40KVKf5hLD1BgJ8a6uj=ZJ=T_gOmijDZVxWS3pK_6AQ@mail.gmail.com>]
[parent not found: <54665EFD.7030304@gmail.com>]
[parent not found: <CADW=+3mrqv=BjX8TCpRszFbr3OYEvgOk0OpcYe56f6OJmYDZbQ@mail.gmail.com>]
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory [not found] ` <CADW=+3mrqv=BjX8TCpRszFbr3OYEvgOk0OpcYe56f6OJmYDZbQ@mail.gmail.com> @ 2014-11-30 23:04 ` Dušan Čolić 2014-11-30 23:48 ` Edward Shishkin 0 siblings, 1 reply; 33+ messages in thread From: Dušan Čolić @ 2014-11-30 23:04 UTC (permalink / raw) To: Edward Shishkin, reiserfs-devel; +Cc: Ivan Shapovalov On Fri, Nov 14, 2014 at 9:09 PM, Dušan Čolić <dusanc@gmail.com> wrote: > As I had no time to make a full backup I went back to 3.10 kernel and had no > problem since. > > Could this issue be connected with those firefox cache files that were bad > (see other mail thread) so I deleted them but for some reason they continued > making problems or problem wasn't really solved by deletion? I ask this as > after long time of stable r4 I got 2 problems in same week so they're > probably related. > > On Nov 14, 2014 8:58 PM, "Edward Shishkin" <edward.shishkin@gmail.com> > wrote: >> >> On 11/05/2014 12:04 PM, Dušan Čolić wrote: >> >> >> On Nov 5, 2014 12:48 AM, "Edward Shishkin" <edward.shishkin@gmail.com> >> wrote: >> > >> > On 11/04/2014 02:16 PM, Dušan Čolić wrote: >> >> >> >> Did a fsck of source partition. >> >> Btw. why is there a reason this corruption appeared when I started >> >> using 3.16.2 instead 3.10? >> >> >> > >> > >> > I would also suspect this failed mount. >> > It could have fatal consequences for the system, and, in particular for >> > your ''/". >> > >> >> Failed mount happened on the partition that I was copying to,/mnt/backup, >> and it fscked ok. >> / was partition I was copying from and it had errors. >> >> >> >> Hi Dušan, >> >> So, how is your / ? So I was feeling brave so I put 3.16.2 back 4 days ago and I got this: Nov 30 03:30:36 krshina3 kernel: [293446.436017] ------------[ cut here ]------------ Nov 30 03:30:36 krshina3 kernel: [293446.436320] kernel BUG at fs/reiser4/plugin/item/ctail.c:669! Nov 30 03:30:36 krshina3 kernel: [293446.436652] invalid opcode: 0000 [#1] SMP Nov 30 03:30:36 krshina3 kernel: [293446.436899] CPU: 3 PID: 30235 Comm: rsync Not tainted 3.16.5-gentoo #2 Nov 30 03:30:36 krshina3 kernel: [293446.437275] Hardware name: Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 07/04/2012 Nov 30 03:30:36 krshina3 kernel: [293446.437834] task: ffff8801333d4010 ti: ffff880118218000 task.ti: ffff880118218000 Nov 30 03:30:36 krshina3 kernel: [293446.438264] RIP: 0010:[<ffffffff8115aaf4>] [<ffffffff8115aaf4>] do_readpage_ctail+0x2c5/0x3c4 Nov 30 03:30:36 krshina3 kernel: [293446.438768] RSP: 0018:ffff88011821baa8 EFLAGS: 00010246 Nov 30 03:30:36 krshina3 kernel: [293446.439073] RAX: 0000000000000000 RBX: ffff88011821bb78 RCX: 000000000002f35d Nov 30 03:30:36 krshina3 kernel: [293446.439484] RDX: 000000000000002f RSI: 0000000000000000 RDI: ffff8800b953b000 Nov 30 03:30:36 krshina3 kernel: [293446.439894] RBP: ffff880169d231a0 R08: 0000000000000000 R09: 0000000000000000 Nov 30 03:30:36 krshina3 kernel: [293446.440304] R10: ffffffff8114eb84 R11: 0000000000012368 R12: 0000000000000002 Nov 30 03:30:36 krshina3 kernel: [293446.440713] R13: 0000000000001000 R14: ffffea00052f5158 R15: 0000000000000000 Nov 30 03:30:36 krshina3 kernel: [293446.441124] FS: 00007f3d4d434700(0000) GS:ffff88022e380000(0000) knlGS:0000000000000000 Nov 30 03:30:36 krshina3 kernel: [293446.441589] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Nov 30 03:30:36 krshina3 kernel: [293446.441918] CR2: 0000000000980000 CR3: 00000001a0c03000 CR4: 00000000001427e0 Nov 30 03:30:36 krshina3 kernel: [293446.442327] Stack: Nov 30 03:30:36 krshina3 kernel: [293446.442443] 0000000000000000 ffff88011821bb78 0000000000000000 ffff880169d231a0 Nov 30 03:30:36 krshina3 kernel: [293446.442890] 0000000000000000 ffffea00052f5158 0000000000000000 ffffffff8115ad7b Nov 30 03:30:36 krshina3 kernel: [293446.443336] 00000000000aa1a1 ffff88011821bca0 ffffea00052f5158 ffff880169d232e0 Nov 30 03:30:36 krshina3 kernel: [293446.443784] Call Trace: Nov 30 03:30:36 krshina3 kernel: [293446.443926] [<ffffffff8115ad7b>] ? ctail_readpages_filler+0x188/0x1c9 Nov 30 03:30:36 krshina3 kernel: [293446.444302] [<ffffffff8115abf3>] ? do_readpage_ctail+0x3c4/0x3c4 Nov 30 03:30:36 krshina3 kernel: [293446.444655] [<ffffffff810b5528>] ? read_cache_pages+0x91/0xfc Nov 30 03:30:36 krshina3 kernel: [293446.444990] [<ffffffff8115b17c>] ? readpages_ctail+0x2c8/0x2e5 Nov 30 03:30:36 krshina3 kernel: [293446.445332] [<ffffffff81151e72>] ? readpages_cryptcompress+0x39/0x5f Nov 30 03:30:36 krshina3 kernel: [293446.445704] [<ffffffff810b56c9>] ? __do_page_cache_readahead+0x136/0x1d0 Nov 30 03:30:36 krshina3 kernel: [293446.446094] [<ffffffff810b5958>] ? ondemand_readahead+0x1f5/0x203 Nov 30 03:30:36 krshina3 kernel: [293446.446450] [<ffffffff810ae761>] ? generic_file_read_iter+0x191/0x539 Nov 30 03:30:36 krshina3 kernel: [293446.446827] [<ffffffff810e9256>] ? path_openat+0x24b/0x5ce Nov 30 03:30:36 krshina3 kernel: [293446.447147] [<ffffffff810de1e6>] ? new_sync_read+0x6b/0x8f Nov 30 03:30:36 krshina3 kernel: [293446.447469] [<ffffffff81151f07>] ? read_cryptcompress+0x6f/0x97 Nov 30 03:30:36 krshina3 kernel: [293446.447815] [<ffffffff8114d4c0>] ? reiser4_read_dispatch+0xc7/0x11e Nov 30 03:30:36 krshina3 kernel: [293446.448181] [<ffffffff810dedc9>] ? vfs_read+0x84/0x13e Nov 30 03:30:36 krshina3 kernel: [293446.448483] [<ffffffff810df25c>] ? SyS_read+0x41/0x84 Nov 30 03:30:36 krshina3 kernel: [293446.448780] [<ffffffff815346d2>] ? system_call_fastpath+0x16/0x1b Nov 30 03:30:36 krshina3 kernel: [293446.449135] Code: 01 00 00 e9 00 ff ff ff 8b 43 58 41 0f b7 4d 04 48 8d 04 48 48 89 54 c3 28 e9 ea fe ff ff 44 8b a3 88 00 00 00 41 83 fc 02 75 02 <0f> 0b 0f 87 87 00 00 00 41 83 fc 01 0f 85 de 00 00 00 49 8b 56 Nov 30 03:30:36 krshina3 kernel: [293446.450567] RIP [<ffffffff8115aaf4>] do_readpage_ctail+0x2c5/0x3c4 Nov 30 03:30:36 krshina3 kernel: [293446.450934] RSP <ffff88011821baa8> Nov 30 03:30:36 krshina3 kernel: [293446.562843] ---[ end trace 45473ce04b35219f ]--- Looks like same error like last time I used 3.16. Kernel 3.10 lasted with 20 days uptime without problems this month and 3.16 had this oops after 3 days. -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-11-30 23:04 ` Dušan Čolić @ 2014-11-30 23:48 ` Edward Shishkin [not found] ` <CADW=+3=Tqw-2yfe6q4ERKSdyu9BmbApoREi-p4A7Auu_k27A6Q@mail.gmail.com> 0 siblings, 1 reply; 33+ messages in thread From: Edward Shishkin @ 2014-11-30 23:48 UTC (permalink / raw) To: Dušan Čolić, reiserfs-devel; +Cc: Ivan Shapovalov On 12/01/2014 12:04 AM, Dušan Čolić wrote: > On Fri, Nov 14, 2014 at 9:09 PM, Dušan Čolić <dusanc@gmail.com> wrote: >> As I had no time to make a full backup I went back to 3.10 kernel and had no >> problem since. >> >> Could this issue be connected with those firefox cache files that were bad >> (see other mail thread) so I deleted them but for some reason they continued >> making problems or problem wasn't really solved by deletion? I ask this as >> after long time of stable r4 I got 2 problems in same week so they're >> probably related. >> >> On Nov 14, 2014 8:58 PM, "Edward Shishkin" <edward.shishkin@gmail.com> >> wrote: >>> On 11/05/2014 12:04 PM, Dušan Čolić wrote: >>> >>> >>> On Nov 5, 2014 12:48 AM, "Edward Shishkin" <edward.shishkin@gmail.com> >>> wrote: >>>> On 11/04/2014 02:16 PM, Dušan Čolić wrote: >>>>> Did a fsck of source partition. >>>>> Btw. why is there a reason this corruption appeared when I started >>>>> using 3.16.2 instead 3.10? >>>>> >>>> >>>> I would also suspect this failed mount. >>>> It could have fatal consequences for the system, and, in particular for >>>> your ''/". >>>> >>> Failed mount happened on the partition that I was copying to,/mnt/backup, >>> and it fscked ok. >>> / was partition I was copying from and it had errors. >>> >>> >>> >>> Hi Dušan, >>> >>> So, how is your / ? > So I was feeling brave so I put 3.16.2 back 4 days ago and I got this: > > Nov 30 03:30:36 krshina3 kernel: [293446.436017] ------------[ cut > here ]------------ > Nov 30 03:30:36 krshina3 kernel: [293446.436320] kernel BUG at > fs/reiser4/plugin/item/ctail.c:669! > Nov 30 03:30:36 krshina3 kernel: [293446.436652] invalid opcode: 0000 [#1] SMP > Nov 30 03:30:36 krshina3 kernel: [293446.436899] CPU: 3 PID: 30235 > Comm: rsync Not tainted 3.16.5-gentoo #2 > Nov 30 03:30:36 krshina3 kernel: [293446.437275] Hardware name: > Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 > 07/04/2012 > Nov 30 03:30:36 krshina3 kernel: [293446.437834] task: > ffff8801333d4010 ti: ffff880118218000 task.ti: ffff880118218000 > Nov 30 03:30:36 krshina3 kernel: [293446.438264] RIP: > 0010:[<ffffffff8115aaf4>] [<ffffffff8115aaf4>] > do_readpage_ctail+0x2c5/0x3c4 > Nov 30 03:30:36 krshina3 kernel: [293446.438768] RSP: > 0018:ffff88011821baa8 EFLAGS: 00010246 > Nov 30 03:30:36 krshina3 kernel: [293446.439073] RAX: 0000000000000000 > RBX: ffff88011821bb78 RCX: 000000000002f35d > Nov 30 03:30:36 krshina3 kernel: [293446.439484] RDX: 000000000000002f > RSI: 0000000000000000 RDI: ffff8800b953b000 > Nov 30 03:30:36 krshina3 kernel: [293446.439894] RBP: ffff880169d231a0 > R08: 0000000000000000 R09: 0000000000000000 > Nov 30 03:30:36 krshina3 kernel: [293446.440304] R10: ffffffff8114eb84 > R11: 0000000000012368 R12: 0000000000000002 > Nov 30 03:30:36 krshina3 kernel: [293446.440713] R13: 0000000000001000 > R14: ffffea00052f5158 R15: 0000000000000000 > Nov 30 03:30:36 krshina3 kernel: [293446.441124] FS: > 00007f3d4d434700(0000) GS:ffff88022e380000(0000) > knlGS:0000000000000000 > Nov 30 03:30:36 krshina3 kernel: [293446.441589] CS: 0010 DS: 0000 > ES: 0000 CR0: 0000000080050033 > Nov 30 03:30:36 krshina3 kernel: [293446.441918] CR2: 0000000000980000 > CR3: 00000001a0c03000 CR4: 00000000001427e0 > Nov 30 03:30:36 krshina3 kernel: [293446.442327] Stack: > Nov 30 03:30:36 krshina3 kernel: [293446.442443] 0000000000000000 > ffff88011821bb78 0000000000000000 ffff880169d231a0 > Nov 30 03:30:36 krshina3 kernel: [293446.442890] 0000000000000000 > ffffea00052f5158 0000000000000000 ffffffff8115ad7b > Nov 30 03:30:36 krshina3 kernel: [293446.443336] 00000000000aa1a1 > ffff88011821bca0 ffffea00052f5158 ffff880169d232e0 > Nov 30 03:30:36 krshina3 kernel: [293446.443784] Call Trace: > Nov 30 03:30:36 krshina3 kernel: [293446.443926] [<ffffffff8115ad7b>] > ? ctail_readpages_filler+0x188/0x1c9 > Nov 30 03:30:36 krshina3 kernel: [293446.444302] [<ffffffff8115abf3>] > ? do_readpage_ctail+0x3c4/0x3c4 > Nov 30 03:30:36 krshina3 kernel: [293446.444655] [<ffffffff810b5528>] > ? read_cache_pages+0x91/0xfc > Nov 30 03:30:36 krshina3 kernel: [293446.444990] [<ffffffff8115b17c>] > ? readpages_ctail+0x2c8/0x2e5 > Nov 30 03:30:36 krshina3 kernel: [293446.445332] [<ffffffff81151e72>] > ? readpages_cryptcompress+0x39/0x5f > Nov 30 03:30:36 krshina3 kernel: [293446.445704] [<ffffffff810b56c9>] > ? __do_page_cache_readahead+0x136/0x1d0 > Nov 30 03:30:36 krshina3 kernel: [293446.446094] [<ffffffff810b5958>] > ? ondemand_readahead+0x1f5/0x203 > Nov 30 03:30:36 krshina3 kernel: [293446.446450] [<ffffffff810ae761>] > ? generic_file_read_iter+0x191/0x539 > Nov 30 03:30:36 krshina3 kernel: [293446.446827] [<ffffffff810e9256>] > ? path_openat+0x24b/0x5ce > Nov 30 03:30:36 krshina3 kernel: [293446.447147] [<ffffffff810de1e6>] > ? new_sync_read+0x6b/0x8f > Nov 30 03:30:36 krshina3 kernel: [293446.447469] [<ffffffff81151f07>] > ? read_cryptcompress+0x6f/0x97 > Nov 30 03:30:36 krshina3 kernel: [293446.447815] [<ffffffff8114d4c0>] > ? reiser4_read_dispatch+0xc7/0x11e > Nov 30 03:30:36 krshina3 kernel: [293446.448181] [<ffffffff810dedc9>] > ? vfs_read+0x84/0x13e > Nov 30 03:30:36 krshina3 kernel: [293446.448483] [<ffffffff810df25c>] > ? SyS_read+0x41/0x84 > Nov 30 03:30:36 krshina3 kernel: [293446.448780] [<ffffffff815346d2>] > ? system_call_fastpath+0x16/0x1b > Nov 30 03:30:36 krshina3 kernel: [293446.449135] Code: 01 00 00 e9 00 > ff ff ff 8b 43 58 41 0f b7 4d 04 48 8d 04 48 48 89 54 c3 28 e9 ea fe > ff ff 44 8b a3 88 00 00 00 41 83 fc 02 75 02 <0f> 0b 0f 87 87 00 00 00 > 41 83 fc 01 0f 85 de 00 00 00 49 8b 56 > Nov 30 03:30:36 krshina3 kernel: [293446.450567] RIP > [<ffffffff8115aaf4>] do_readpage_ctail+0x2c5/0x3c4 > Nov 30 03:30:36 krshina3 kernel: [293446.450934] RSP <ffff88011821baa8> > Nov 30 03:30:36 krshina3 kernel: [293446.562843] ---[ end trace > 45473ce04b35219f ]--- > > Looks like same error like last time I used 3.16. Kernel 3.10 lasted > with 20 days uptime without problems this month and 3.16 had this oops > after 3 days. Unfortunately, there is no any ideas... I can port reiser4-for-3.10 stuff to 3.16. Will you test this port? Thanks, Edward. -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
[parent not found: <CADW=+3=Tqw-2yfe6q4ERKSdyu9BmbApoREi-p4A7Auu_k27A6Q@mail.gmail.com>]
[parent not found: <547BAF3D.1000605@gmail.com>]
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory [not found] ` <547BAF3D.1000605@gmail.com> @ 2014-12-03 20:16 ` Dušan Čolić 2014-12-07 8:07 ` Dušan Čolić 0 siblings, 1 reply; 33+ messages in thread From: Dušan Čolić @ 2014-12-03 20:16 UTC (permalink / raw) To: Edward Shishkin; +Cc: reiserfs-devel, Ivan Shapovalov On Mon, Dec 1, 2014 at 12:58 AM, Edward Shishkin <edward.shishkin@gmail.com> wrote: > > On 12/01/2014 12:53 AM, Dušan Čolić wrote: > > > On Dec 1, 2014 12:47 AM, "Edward Shishkin" <edward.shishkin@gmail.com> > wrote: >> >> >> On 12/01/2014 12:04 AM, Dušan Čolić wrote: >>> >>> On Fri, Nov 14, 2014 at 9:09 PM, Dušan Čolić <dusanc@gmail.com> wrote: >>>> >>>> As I had no time to make a full backup I went back to 3.10 kernel and >>>> had no >>>> problem since. >>>> >>>> Could this issue be connected with those firefox cache files that were >>>> bad >>>> (see other mail thread) so I deleted them but for some reason they >>>> continued >>>> making problems or problem wasn't really solved by deletion? I ask this >>>> as >>>> after long time of stable r4 I got 2 problems in same week so they're >>>> probably related. >>>> >>>> On Nov 14, 2014 8:58 PM, "Edward Shishkin" <edward.shishkin@gmail.com> >>>> wrote: >>>>> >>>>> On 11/05/2014 12:04 PM, Dušan Čolić wrote: >>>>> >>>>> >>>>> On Nov 5, 2014 12:48 AM, "Edward Shishkin" <edward.shishkin@gmail.com> >>>>> wrote: >>>>>> >>>>>> On 11/04/2014 02:16 PM, Dušan Čolić wrote: >>>>>>> >>>>>>> Did a fsck of source partition. >>>>>>> Btw. why is there a reason this corruption appeared when I started >>>>>>> using 3.16.2 instead 3.10? >>>>>>> >>>>>> >>>>>> I would also suspect this failed mount. >>>>>> It could have fatal consequences for the system, and, in particular >>>>>> for >>>>>> your ''/". >>>>>> >>>>> Failed mount happened on the partition that I was copying >>>>> to,/mnt/backup, >>>>> and it fscked ok. >>>>> / was partition I was copying from and it had errors. >>>>> >>>>> >>>>> >>>>> Hi Dušan, >>>>> >>>>> So, how is your / ? >>> >>> So I was feeling brave so I put 3.16.2 back 4 days ago and I got this: >>> >>> Nov 30 03:30:36 krshina3 kernel: [293446.436017] ------------[ cut >>> here ]------------ >>> Nov 30 03:30:36 krshina3 kernel: [293446.436320] kernel BUG at >>> fs/reiser4/plugin/item/ctail.c:669! >>> Nov 30 03:30:36 krshina3 kernel: [293446.436652] invalid opcode: 0000 >>> [#1] SMP >>> Nov 30 03:30:36 krshina3 kernel: [293446.436899] CPU: 3 PID: 30235 >>> Comm: rsync Not tainted 3.16.5-gentoo #2 >>> Nov 30 03:30:36 krshina3 kernel: [293446.437275] Hardware name: >>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>> 07/04/2012 >>> Nov 30 03:30:36 krshina3 kernel: [293446.437834] task: >>> ffff8801333d4010 ti: ffff880118218000 task.ti: ffff880118218000 >>> Nov 30 03:30:36 krshina3 kernel: [293446.438264] RIP: >>> 0010:[<ffffffff8115aaf4>] [<ffffffff8115aaf4>] >>> do_readpage_ctail+0x2c5/0x3c4 >>> Nov 30 03:30:36 krshina3 kernel: [293446.438768] RSP: >>> 0018:ffff88011821baa8 EFLAGS: 00010246 >>> Nov 30 03:30:36 krshina3 kernel: [293446.439073] RAX: 0000000000000000 >>> RBX: ffff88011821bb78 RCX: 000000000002f35d >>> Nov 30 03:30:36 krshina3 kernel: [293446.439484] RDX: 000000000000002f >>> RSI: 0000000000000000 RDI: ffff8800b953b000 >>> Nov 30 03:30:36 krshina3 kernel: [293446.439894] RBP: ffff880169d231a0 >>> R08: 0000000000000000 R09: 0000000000000000 >>> Nov 30 03:30:36 krshina3 kernel: [293446.440304] R10: ffffffff8114eb84 >>> R11: 0000000000012368 R12: 0000000000000002 >>> Nov 30 03:30:36 krshina3 kernel: [293446.440713] R13: 0000000000001000 >>> R14: ffffea00052f5158 R15: 0000000000000000 >>> Nov 30 03:30:36 krshina3 kernel: [293446.441124] FS: >>> 00007f3d4d434700(0000) GS:ffff88022e380000(0000) >>> knlGS:0000000000000000 >>> Nov 30 03:30:36 krshina3 kernel: [293446.441589] CS: 0010 DS: 0000 >>> ES: 0000 CR0: 0000000080050033 >>> Nov 30 03:30:36 krshina3 kernel: [293446.441918] CR2: 0000000000980000 >>> CR3: 00000001a0c03000 CR4: 00000000001427e0 >>> Nov 30 03:30:36 krshina3 kernel: [293446.442327] Stack: >>> Nov 30 03:30:36 krshina3 kernel: [293446.442443] 0000000000000000 >>> ffff88011821bb78 0000000000000000 ffff880169d231a0 >>> Nov 30 03:30:36 krshina3 kernel: [293446.442890] 0000000000000000 >>> ffffea00052f5158 0000000000000000 ffffffff8115ad7b >>> Nov 30 03:30:36 krshina3 kernel: [293446.443336] 00000000000aa1a1 >>> ffff88011821bca0 ffffea00052f5158 ffff880169d232e0 >>> Nov 30 03:30:36 krshina3 kernel: [293446.443784] Call Trace: >>> Nov 30 03:30:36 krshina3 kernel: [293446.443926] [<ffffffff8115ad7b>] >>> ? ctail_readpages_filler+0x188/0x1c9 >>> Nov 30 03:30:36 krshina3 kernel: [293446.444302] [<ffffffff8115abf3>] >>> ? do_readpage_ctail+0x3c4/0x3c4 >>> Nov 30 03:30:36 krshina3 kernel: [293446.444655] [<ffffffff810b5528>] >>> ? read_cache_pages+0x91/0xfc >>> Nov 30 03:30:36 krshina3 kernel: [293446.444990] [<ffffffff8115b17c>] >>> ? readpages_ctail+0x2c8/0x2e5 >>> Nov 30 03:30:36 krshina3 kernel: [293446.445332] [<ffffffff81151e72>] >>> ? readpages_cryptcompress+0x39/0x5f >>> Nov 30 03:30:36 krshina3 kernel: [293446.445704] [<ffffffff810b56c9>] >>> ? __do_page_cache_readahead+0x136/0x1d0 >>> Nov 30 03:30:36 krshina3 kernel: [293446.446094] [<ffffffff810b5958>] >>> ? ondemand_readahead+0x1f5/0x203 >>> Nov 30 03:30:36 krshina3 kernel: [293446.446450] [<ffffffff810ae761>] >>> ? generic_file_read_iter+0x191/0x539 >>> Nov 30 03:30:36 krshina3 kernel: [293446.446827] [<ffffffff810e9256>] >>> ? path_openat+0x24b/0x5ce >>> Nov 30 03:30:36 krshina3 kernel: [293446.447147] [<ffffffff810de1e6>] >>> ? new_sync_read+0x6b/0x8f >>> Nov 30 03:30:36 krshina3 kernel: [293446.447469] [<ffffffff81151f07>] >>> ? read_cryptcompress+0x6f/0x97 >>> Nov 30 03:30:36 krshina3 kernel: [293446.447815] [<ffffffff8114d4c0>] >>> ? reiser4_read_dispatch+0xc7/0x11e >>> Nov 30 03:30:36 krshina3 kernel: [293446.448181] [<ffffffff810dedc9>] >>> ? vfs_read+0x84/0x13e >>> Nov 30 03:30:36 krshina3 kernel: [293446.448483] [<ffffffff810df25c>] >>> ? SyS_read+0x41/0x84 >>> Nov 30 03:30:36 krshina3 kernel: [293446.448780] [<ffffffff815346d2>] >>> ? system_call_fastpath+0x16/0x1b >>> Nov 30 03:30:36 krshina3 kernel: [293446.449135] Code: 01 00 00 e9 00 >>> ff ff ff 8b 43 58 41 0f b7 4d 04 48 8d 04 48 48 89 54 c3 28 e9 ea fe >>> ff ff 44 8b a3 88 00 00 00 41 83 fc 02 75 02 <0f> 0b 0f 87 87 00 00 00 >>> 41 83 fc 01 0f 85 de 00 00 00 49 8b 56 >>> Nov 30 03:30:36 krshina3 kernel: [293446.450567] RIP >>> [<ffffffff8115aaf4>] do_readpage_ctail+0x2c5/0x3c4 >>> Nov 30 03:30:36 krshina3 kernel: [293446.450934] RSP <ffff88011821baa8> >>> Nov 30 03:30:36 krshina3 kernel: [293446.562843] ---[ end trace >>> 45473ce04b35219f ]--- >>> >>> Looks like same error like last time I used 3.16. Kernel 3.10 lasted >>> with 20 days uptime without problems this month and 3.16 had this oops >>> after 3 days. >> >> >> >> Unfortunately, there is no any ideas... >> I can port reiser4-for-3.10 stuff to 3.16. Will you test this port? >> > > Ofcourse! > Funny thing is that again only 2 twigs were damaged.. Now I'm going to use R4-from3.11-ported-to3.16.patch and report on the results. Results from fsck --build-fs: FSCK: node.c: 108: repair_node_items_check: Node (4078203), items (60) and (61): Wrong order of keys. FSCK: filter.c: 407: repair_filter_update_traverse: Node (4078203): the node is unrecoverable. Pointed from the node (655473), item (14), unit (0). Removed. FSCK: node.c: 108: repair_node_items_check: Node (4078899), items (6) and (7): Wrong order of keys. FSCK: filter.c: 407: repair_filter_update_traverse: Node (4078899): the node is unrecoverable. Pointed from the node (655473), item (14), unit (0). Removed. FSCK: node.c: 108: repair_node_items_check: Node (4079383), items (0) and (1): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4079488), items (0) and (1): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4079546), items (0) and (1): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4080447), items (0) and (1): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4080571), items (0) and (1): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4081137), items (1) and (2): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4090871), items (0) and (1): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4091337), items (0) and (1): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4091990), items (0) and (1): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4092423), items (1) and (2): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4093016), items (0) and (1): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4093690), items (27) and (28): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4094525), items (0) and (1): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4096175), items (0) and (1): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4099659), items (12) and (13): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4099663), items (21) and (22): Wrong order of keys. FSCK: node.c: 108: repair_node_items_check: Node (4113492), items (0) and (1): Wrong order of keys. > > > OK, I'll try to port it ASAP, > for now fsck your / .. . > > Thanks, > Edward. -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-12-03 20:16 ` Dušan Čolić @ 2014-12-07 8:07 ` Dušan Čolić 2014-12-07 10:52 ` Edward Shishkin 2014-12-10 9:46 ` doiggl 0 siblings, 2 replies; 33+ messages in thread From: Dušan Čolić @ 2014-12-07 8:07 UTC (permalink / raw) To: Edward Shishkin; +Cc: reiserfs-devel, Ivan Shapovalov And on the 4th day: ### RSNAPSHOT DAILY ### fsck.reiser4 /dev/md125 mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory Backup failure umount: /mnt/backup: not mounted krshina3 ~ # cat /proc/meminfo MemTotal: 7867900 kB MemFree: 1553044 kB MemAvailable: 4853752 kB Buffers: 0 kB Cached: 2975880 kB SwapCached: 4944 kB Active: 3780968 kB Inactive: 2003640 kB Active(anon): 2336740 kB Inactive(anon): 498120 kB Active(file): 1444228 kB Inactive(file): 1505520 kB Unevictable: 0 kB Mlocked: 0 kB SwapTotal: 594300 kB SwapFree: 180008 kB Dirty: 3064 kB Writeback: 0 kB AnonPages: 2804424 kB Mapped: 180772 kB Shmem: 26132 kB Slab: 427632 kB SReclaimable: 392984 kB SUnreclaim: 34648 kB KernelStack: 7536 kB PageTables: 38328 kB NFS_Unstable: 0 kB Bounce: 0 kB WritebackTmp: 0 kB CommitLimit: 4528248 kB Committed_AS: 5352472 kB VmallocTotal: 34359738367 kB VmallocUsed: 352244 kB VmallocChunk: 34359293283 kB HugePages_Total: 0 HugePages_Free: 0 HugePages_Rsvd: 0 HugePages_Surp: 0 Hugepagesize: 2048 kB DirectMap4k: 12224 kB DirectMap2M: 8056832 kB Dec 7 03:30:01 krshina3 kernel: [281555.958316] reiser4: md125: found disk format 4.0.0. Dec 7 03:30:01 krshina3 kernel: [281555.958998] mount: page allocation failure: order:4, mode:0x2040d0 Dec 7 03:30:01 krshina3 kernel: [281555.959000] CPU: 2 PID: 7078 Comm: mount Not tainted 3.16.5-gentoo #1 Dec 7 03:30:01 krshina3 kernel: [281555.959001] Hardware name: Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 07/04/2012 Dec 7 03:30:01 krshina3 kernel: [281555.959003] 0000000000000006 ffffffff8152bdfb 0000000000000001 ffffffff810b0bc3 Dec 7 03:30:01 krshina3 kernel: [281555.959005] ffffffff81818df8 0000000000000000 00000002fffffff0 0000000000000010 Dec 7 03:30:01 krshina3 kernel: [281555.959006] ffff8801007b27a0 0000000000000000 0000000000000010 0000204081818240 Dec 7 03:30:01 krshina3 kernel: [281555.959008] Call Trace: Dec 7 03:30:01 krshina3 kernel: [281555.959011] [<ffffffff8152bdfb>] ? dump_stack+0x41/0x51 Dec 7 03:30:01 krshina3 kernel: [281555.959014] [<ffffffff810b0bc3>] ? warn_alloc_failed+0x10c/0x120 Dec 7 03:30:01 krshina3 kernel: [281555.959016] [<ffffffff810b2b66>] ? __alloc_pages_nodemask+0x581/0x69d Dec 7 03:30:01 krshina3 kernel: [281555.959019] [<ffffffff810db5f4>] ? cache_alloc_refill+0x261/0x48c Dec 7 03:30:01 krshina3 kernel: [281555.959022] [<ffffffff8113eefd>] ? reiser4_mount+0xc/0xc Dec 7 03:30:01 krshina3 kernel: [281555.959024] [<ffffffff810db35f>] ? kmem_cache_alloc+0x6d/0xa1 Dec 7 03:30:01 krshina3 kernel: [281555.959026] [<ffffffff8112bf58>] ? znodes_tree_init+0xb9/0xe6 Dec 7 03:30:01 krshina3 kernel: [281555.959028] [<ffffffff811323ee>] ? reiser4_init_tree+0x3f/0xb2 Dec 7 03:30:01 krshina3 kernel: [281555.959031] [<ffffffff8115fb05>] ? init_format_format40+0x357/0x4e4 Dec 7 03:30:01 krshina3 kernel: [281555.959033] [<ffffffff81080f74>] ? wake_up_bit+0xc/0x1b Dec 7 03:30:01 krshina3 kernel: [281555.959035] [<ffffffff8113efc8>] ? fill_super+0xcb/0x1ad Dec 7 03:30:01 krshina3 kernel: [281555.959037] [<ffffffff810e142e>] ? mount_bdev+0x133/0x186 Dec 7 03:30:01 krshina3 kernel: [281555.959039] [<ffffffff810e15ed>] ? mount_fs+0xc/0x9e Dec 7 03:30:01 krshina3 kernel: [281555.959041] [<ffffffff810f55f2>] ? vfs_kern_mount+0x5e/0xef Dec 7 03:30:01 krshina3 kernel: [281555.959042] [<ffffffff810f71c1>] ? do_mount+0x80b/0x904 Dec 7 03:30:01 krshina3 kernel: [281555.959044] [<ffffffff810f74d5>] ? SyS_mount+0x7e/0xb7 Dec 7 03:30:01 krshina3 kernel: [281555.959046] [<ffffffff81533612>] ? system_call_fastpath+0x16/0x1b Dec 7 03:30:01 krshina3 kernel: [281555.959047] Mem-Info: Dec 7 03:30:01 krshina3 kernel: [281555.959048] DMA per-cpu: Dec 7 03:30:01 krshina3 kernel: [281555.959049] CPU 0: hi: 0, btch: 1 usd: 0 Dec 7 03:30:01 krshina3 kernel: [281555.959050] CPU 1: hi: 0, btch: 1 usd: 0 Dec 7 03:30:01 krshina3 kernel: [281555.959051] CPU 2: hi: 0, btch: 1 usd: 0 Dec 7 03:30:01 krshina3 kernel: [281555.959052] CPU 3: hi: 0, btch: 1 usd: 0 Dec 7 03:30:01 krshina3 kernel: [281555.959052] DMA32 per-cpu: Dec 7 03:30:01 krshina3 kernel: [281555.959053] CPU 0: hi: 186, btch: 31 usd: 0 Dec 7 03:30:01 krshina3 kernel: [281555.959054] CPU 1: hi: 186, btch: 31 usd: 0 Dec 7 03:30:01 krshina3 kernel: [281555.959055] CPU 2: hi: 186, btch: 31 usd: 0 Dec 7 03:30:01 krshina3 kernel: [281555.959056] CPU 3: hi: 186, btch: 31 usd: 0 Dec 7 03:30:01 krshina3 kernel: [281555.959057] Normal per-cpu: Dec 7 03:30:01 krshina3 kernel: [281555.959057] CPU 0: hi: 186, btch: 31 usd: 0 Dec 7 03:30:01 krshina3 kernel: [281555.959058] CPU 1: hi: 186, btch: 31 usd: 0 Dec 7 03:30:01 krshina3 kernel: [281555.959059] CPU 2: hi: 186, btch: 31 usd: 0 Dec 7 03:30:01 krshina3 kernel: [281555.959060] CPU 3: hi: 186, btch: 31 usd: 0 Dec 7 03:30:01 krshina3 kernel: [281555.959062] active_anon:593069 inactive_anon:120226 isolated_anon:0 Dec 7 03:30:01 krshina3 kernel: [281555.959062] active_file:503137 inactive_file:503029 isolated_file:0 Dec 7 03:30:01 krshina3 kernel: [281555.959062] unevictable:0 dirty:333 writeback:0 unstable:0 Dec 7 03:30:01 krshina3 kernel: [281555.959062] free:104532 slab_reclaimable:109978 slab_unreclaimable:8402 Dec 7 03:30:01 krshina3 kernel: [281555.959062] mapped:51579 shmem:5928 pagetables:9488 bounce:0 Dec 7 03:30:01 krshina3 kernel: [281555.959062] free_cma:0 Dec 7 03:30:01 krshina3 kernel: [281555.959068] DMA free:15900kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes Dec 7 03:30:01 krshina3 kernel: [281555.959069] lowmem_reserve[]: 0 2952 7667 7667 Dec 7 03:30:01 krshina3 kernel: [281555.959074] DMA32 free:168028kB min:4308kB low:5384kB high:6460kB active_anon:837216kB inactive_anon:214776kB active_file:790440kB inactive_file:790440kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3098560kB managed:3023876kB mlocked:0kB dirty:316kB writeback:0kB mapped:78860kB shmem:8760kB slab_reclaimable:171284kB slab_unreclaimable:11888kB kernel_stack:2240kB pagetables:16348kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no Dec 7 03:30:01 krshina3 kernel: [281555.959075] lowmem_reserve[]: 0 0 4714 4714 Dec 7 03:30:01 krshina3 kernel: [281555.959079] Normal free:234200kB min:6880kB low:8600kB high:10320kB active_anon:1535060kB inactive_anon:266128kB active_file:1222108kB inactive_file:1221676kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:4954112kB managed:4828124kB mlocked:0kB dirty:1016kB writeback:0kB mapped:127456kB shmem:14952kB slab_reclaimable:268628kB slab_unreclaimable:21720kB kernel_stack:4976kB pagetables:21604kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no Dec 7 03:30:01 krshina3 kernel: [281555.959080] lowmem_reserve[]: 0 0 0 0 Dec 7 03:30:01 krshina3 kernel: [281555.959081] DMA: 1*4kB (U) 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB Dec 7 03:30:01 krshina3 kernel: [281555.959088] DMA32: 36545*4kB (UEM) 2543*8kB (UEM) 70*16kB (UMR) 0*32kB 0*64kB 1*128kB (R) 0*256kB 1*512kB (R) 0*1024kB 0*2048kB 0*4096kB = 168284kB Dec 7 03:30:01 krshina3 kernel: [281555.959093] Normal: 50408*4kB (UEM) 3913*8kB (UEM) 36*16kB (UMR) 0*32kB 1*64kB (R) 1*128kB (R) 1*256kB (R) 1*512kB (R) 0*1024kB 0*2048kB 0*4096kB = 234472kB Dec 7 03:30:01 krshina3 kernel: [281555.959099] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Dec 7 03:30:01 krshina3 kernel: [281555.959100] 1013453 total pagecache pages Dec 7 03:30:01 krshina3 kernel: [281555.959101] 1228 pages in swap cache Dec 7 03:30:01 krshina3 kernel: [281555.959102] Swap cache stats: add 133257, delete 132029, find 57308/68141 Dec 7 03:30:01 krshina3 kernel: [281555.959103] Free swap = 184632kB Dec 7 03:30:01 krshina3 kernel: [281555.959103] Total swap = 594300kB Dec 7 03:30:01 krshina3 kernel: [281555.959104] 2017164 pages RAM Dec 7 03:30:01 krshina3 kernel: [281555.959105] 0 pages HighMem/MovableOnly Dec 7 03:30:01 krshina3 kernel: [281555.959106] 31497 pages reserved On Wed, Dec 3, 2014 at 9:16 PM, Dušan Čolić <dusanc@gmail.com> wrote: > On Mon, Dec 1, 2014 at 12:58 AM, Edward Shishkin > <edward.shishkin@gmail.com> wrote: >> >> On 12/01/2014 12:53 AM, Dušan Čolić wrote: >> >> >> On Dec 1, 2014 12:47 AM, "Edward Shishkin" <edward.shishkin@gmail.com> >> wrote: >>> >>> >>> On 12/01/2014 12:04 AM, Dušan Čolić wrote: >>>> >>>> On Fri, Nov 14, 2014 at 9:09 PM, Dušan Čolić <dusanc@gmail.com> wrote: >>>>> >>>>> As I had no time to make a full backup I went back to 3.10 kernel and >>>>> had no >>>>> problem since. >>>>> >>>>> Could this issue be connected with those firefox cache files that were >>>>> bad >>>>> (see other mail thread) so I deleted them but for some reason they >>>>> continued >>>>> making problems or problem wasn't really solved by deletion? I ask this >>>>> as >>>>> after long time of stable r4 I got 2 problems in same week so they're >>>>> probably related. >>>>> >>>>> On Nov 14, 2014 8:58 PM, "Edward Shishkin" <edward.shishkin@gmail.com> >>>>> wrote: >>>>>> >>>>>> On 11/05/2014 12:04 PM, Dušan Čolić wrote: >>>>>> >>>>>> >>>>>> On Nov 5, 2014 12:48 AM, "Edward Shishkin" <edward.shishkin@gmail.com> >>>>>> wrote: >>>>>>> >>>>>>> On 11/04/2014 02:16 PM, Dušan Čolić wrote: >>>>>>>> >>>>>>>> Did a fsck of source partition. >>>>>>>> Btw. why is there a reason this corruption appeared when I started >>>>>>>> using 3.16.2 instead 3.10? >>>>>>>> >>>>>>> >>>>>>> I would also suspect this failed mount. >>>>>>> It could have fatal consequences for the system, and, in particular >>>>>>> for >>>>>>> your ''/". >>>>>>> >>>>>> Failed mount happened on the partition that I was copying >>>>>> to,/mnt/backup, >>>>>> and it fscked ok. >>>>>> / was partition I was copying from and it had errors. >>>>>> >>>>>> >>>>>> >>>>>> Hi Dušan, >>>>>> >>>>>> So, how is your / ? >>>> >>>> So I was feeling brave so I put 3.16.2 back 4 days ago and I got this: >>>> >>>> Nov 30 03:30:36 krshina3 kernel: [293446.436017] ------------[ cut >>>> here ]------------ >>>> Nov 30 03:30:36 krshina3 kernel: [293446.436320] kernel BUG at >>>> fs/reiser4/plugin/item/ctail.c:669! >>>> Nov 30 03:30:36 krshina3 kernel: [293446.436652] invalid opcode: 0000 >>>> [#1] SMP >>>> Nov 30 03:30:36 krshina3 kernel: [293446.436899] CPU: 3 PID: 30235 >>>> Comm: rsync Not tainted 3.16.5-gentoo #2 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.437275] Hardware name: >>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>>> 07/04/2012 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.437834] task: >>>> ffff8801333d4010 ti: ffff880118218000 task.ti: ffff880118218000 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.438264] RIP: >>>> 0010:[<ffffffff8115aaf4>] [<ffffffff8115aaf4>] >>>> do_readpage_ctail+0x2c5/0x3c4 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.438768] RSP: >>>> 0018:ffff88011821baa8 EFLAGS: 00010246 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.439073] RAX: 0000000000000000 >>>> RBX: ffff88011821bb78 RCX: 000000000002f35d >>>> Nov 30 03:30:36 krshina3 kernel: [293446.439484] RDX: 000000000000002f >>>> RSI: 0000000000000000 RDI: ffff8800b953b000 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.439894] RBP: ffff880169d231a0 >>>> R08: 0000000000000000 R09: 0000000000000000 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.440304] R10: ffffffff8114eb84 >>>> R11: 0000000000012368 R12: 0000000000000002 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.440713] R13: 0000000000001000 >>>> R14: ffffea00052f5158 R15: 0000000000000000 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.441124] FS: >>>> 00007f3d4d434700(0000) GS:ffff88022e380000(0000) >>>> knlGS:0000000000000000 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.441589] CS: 0010 DS: 0000 >>>> ES: 0000 CR0: 0000000080050033 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.441918] CR2: 0000000000980000 >>>> CR3: 00000001a0c03000 CR4: 00000000001427e0 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.442327] Stack: >>>> Nov 30 03:30:36 krshina3 kernel: [293446.442443] 0000000000000000 >>>> ffff88011821bb78 0000000000000000 ffff880169d231a0 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.442890] 0000000000000000 >>>> ffffea00052f5158 0000000000000000 ffffffff8115ad7b >>>> Nov 30 03:30:36 krshina3 kernel: [293446.443336] 00000000000aa1a1 >>>> ffff88011821bca0 ffffea00052f5158 ffff880169d232e0 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.443784] Call Trace: >>>> Nov 30 03:30:36 krshina3 kernel: [293446.443926] [<ffffffff8115ad7b>] >>>> ? ctail_readpages_filler+0x188/0x1c9 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.444302] [<ffffffff8115abf3>] >>>> ? do_readpage_ctail+0x3c4/0x3c4 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.444655] [<ffffffff810b5528>] >>>> ? read_cache_pages+0x91/0xfc >>>> Nov 30 03:30:36 krshina3 kernel: [293446.444990] [<ffffffff8115b17c>] >>>> ? readpages_ctail+0x2c8/0x2e5 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.445332] [<ffffffff81151e72>] >>>> ? readpages_cryptcompress+0x39/0x5f >>>> Nov 30 03:30:36 krshina3 kernel: [293446.445704] [<ffffffff810b56c9>] >>>> ? __do_page_cache_readahead+0x136/0x1d0 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.446094] [<ffffffff810b5958>] >>>> ? ondemand_readahead+0x1f5/0x203 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.446450] [<ffffffff810ae761>] >>>> ? generic_file_read_iter+0x191/0x539 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.446827] [<ffffffff810e9256>] >>>> ? path_openat+0x24b/0x5ce >>>> Nov 30 03:30:36 krshina3 kernel: [293446.447147] [<ffffffff810de1e6>] >>>> ? new_sync_read+0x6b/0x8f >>>> Nov 30 03:30:36 krshina3 kernel: [293446.447469] [<ffffffff81151f07>] >>>> ? read_cryptcompress+0x6f/0x97 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.447815] [<ffffffff8114d4c0>] >>>> ? reiser4_read_dispatch+0xc7/0x11e >>>> Nov 30 03:30:36 krshina3 kernel: [293446.448181] [<ffffffff810dedc9>] >>>> ? vfs_read+0x84/0x13e >>>> Nov 30 03:30:36 krshina3 kernel: [293446.448483] [<ffffffff810df25c>] >>>> ? SyS_read+0x41/0x84 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.448780] [<ffffffff815346d2>] >>>> ? system_call_fastpath+0x16/0x1b >>>> Nov 30 03:30:36 krshina3 kernel: [293446.449135] Code: 01 00 00 e9 00 >>>> ff ff ff 8b 43 58 41 0f b7 4d 04 48 8d 04 48 48 89 54 c3 28 e9 ea fe >>>> ff ff 44 8b a3 88 00 00 00 41 83 fc 02 75 02 <0f> 0b 0f 87 87 00 00 00 >>>> 41 83 fc 01 0f 85 de 00 00 00 49 8b 56 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.450567] RIP >>>> [<ffffffff8115aaf4>] do_readpage_ctail+0x2c5/0x3c4 >>>> Nov 30 03:30:36 krshina3 kernel: [293446.450934] RSP <ffff88011821baa8> >>>> Nov 30 03:30:36 krshina3 kernel: [293446.562843] ---[ end trace >>>> 45473ce04b35219f ]--- >>>> >>>> Looks like same error like last time I used 3.16. Kernel 3.10 lasted >>>> with 20 days uptime without problems this month and 3.16 had this oops >>>> after 3 days. >>> >>> >>> >>> Unfortunately, there is no any ideas... >>> I can port reiser4-for-3.10 stuff to 3.16. Will you test this port? >>> >> >> Ofcourse! >> > Funny thing is that again only 2 twigs were damaged.. > Now I'm going to use R4-from3.11-ported-to3.16.patch and report on the results. > > Results from fsck --build-fs: > > FSCK: node.c: 108: repair_node_items_check: Node (4078203), items (60) and (61): > Wrong order of keys. > FSCK: filter.c: 407: repair_filter_update_traverse: Node (4078203): the node is > unrecoverable. Pointed from the node (655473), item (14), unit (0). Removed. > FSCK: node.c: 108: repair_node_items_check: Node (4078899), items (6) and (7): > Wrong order of keys. > FSCK: filter.c: 407: repair_filter_update_traverse: Node (4078899): the node is > unrecoverable. Pointed from the node (655473), item (14), unit (0). Removed. > FSCK: node.c: 108: repair_node_items_check: Node (4079383), items (0) and (1): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4079488), items (0) and (1): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4079546), items (0) and (1): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4080447), items (0) and (1): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4080571), items (0) and (1): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4081137), items (1) and (2): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4090871), items (0) and (1): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4091337), items (0) and (1): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4091990), items (0) and (1): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4092423), items (1) and (2): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4093016), items (0) and (1): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4093690), items (27) and (28): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4094525), items (0) and (1): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4096175), items (0) and (1): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4099659), items (12) and (13): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4099663), items (21) and (22): > Wrong order of keys. > FSCK: node.c: 108: repair_node_items_check: Node (4113492), items (0) and (1): > Wrong order of keys. > > > > >> >> >> OK, I'll try to port it ASAP, >> for now fsck your / .. . >> >> Thanks, >> Edward. -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-12-07 8:07 ` Dušan Čolić @ 2014-12-07 10:52 ` Edward Shishkin 2014-12-07 23:45 ` Dušan Čolić 2014-12-10 9:46 ` doiggl 1 sibling, 1 reply; 33+ messages in thread From: Edward Shishkin @ 2014-12-07 10:52 UTC (permalink / raw) To: Dušan Čolić; +Cc: reiserfs-devel, Ivan Shapovalov And the root partition became corrupted, or...? Thanks, Edward. On 12/07/2014 09:07 AM, Dušan Čolić wrote: > And on the 4th day: > > ### RSNAPSHOT DAILY ### > fsck.reiser4 /dev/md125 > mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory > Backup failure > umount: /mnt/backup: not mounted > > > krshina3 ~ # cat /proc/meminfo > MemTotal: 7867900 kB > MemFree: 1553044 kB > MemAvailable: 4853752 kB > Buffers: 0 kB > Cached: 2975880 kB > SwapCached: 4944 kB > Active: 3780968 kB > Inactive: 2003640 kB > Active(anon): 2336740 kB > Inactive(anon): 498120 kB > Active(file): 1444228 kB > Inactive(file): 1505520 kB > Unevictable: 0 kB > Mlocked: 0 kB > SwapTotal: 594300 kB > SwapFree: 180008 kB > Dirty: 3064 kB > Writeback: 0 kB > AnonPages: 2804424 kB > Mapped: 180772 kB > Shmem: 26132 kB > Slab: 427632 kB > SReclaimable: 392984 kB > SUnreclaim: 34648 kB > KernelStack: 7536 kB > PageTables: 38328 kB > NFS_Unstable: 0 kB > Bounce: 0 kB > WritebackTmp: 0 kB > CommitLimit: 4528248 kB > Committed_AS: 5352472 kB > VmallocTotal: 34359738367 kB > VmallocUsed: 352244 kB > VmallocChunk: 34359293283 kB > HugePages_Total: 0 > HugePages_Free: 0 > HugePages_Rsvd: 0 > HugePages_Surp: 0 > Hugepagesize: 2048 kB > DirectMap4k: 12224 kB > DirectMap2M: 8056832 kB > > > Dec 7 03:30:01 krshina3 kernel: [281555.958316] reiser4: md125: found > disk format 4.0.0. > Dec 7 03:30:01 krshina3 kernel: [281555.958998] mount: page > allocation failure: order:4, mode:0x2040d0 > Dec 7 03:30:01 krshina3 kernel: [281555.959000] CPU: 2 PID: 7078 > Comm: mount Not tainted 3.16.5-gentoo #1 > Dec 7 03:30:01 krshina3 kernel: [281555.959001] Hardware name: > Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 > 07/04/2012 > Dec 7 03:30:01 krshina3 kernel: [281555.959003] 0000000000000006 > ffffffff8152bdfb 0000000000000001 ffffffff810b0bc3 > Dec 7 03:30:01 krshina3 kernel: [281555.959005] ffffffff81818df8 > 0000000000000000 00000002fffffff0 0000000000000010 > Dec 7 03:30:01 krshina3 kernel: [281555.959006] ffff8801007b27a0 > 0000000000000000 0000000000000010 0000204081818240 > Dec 7 03:30:01 krshina3 kernel: [281555.959008] Call Trace: > Dec 7 03:30:01 krshina3 kernel: [281555.959011] [<ffffffff8152bdfb>] > ? dump_stack+0x41/0x51 > Dec 7 03:30:01 krshina3 kernel: [281555.959014] [<ffffffff810b0bc3>] > ? warn_alloc_failed+0x10c/0x120 > Dec 7 03:30:01 krshina3 kernel: [281555.959016] [<ffffffff810b2b66>] > ? __alloc_pages_nodemask+0x581/0x69d > Dec 7 03:30:01 krshina3 kernel: [281555.959019] [<ffffffff810db5f4>] > ? cache_alloc_refill+0x261/0x48c > Dec 7 03:30:01 krshina3 kernel: [281555.959022] [<ffffffff8113eefd>] > ? reiser4_mount+0xc/0xc > Dec 7 03:30:01 krshina3 kernel: [281555.959024] [<ffffffff810db35f>] > ? kmem_cache_alloc+0x6d/0xa1 > Dec 7 03:30:01 krshina3 kernel: [281555.959026] [<ffffffff8112bf58>] > ? znodes_tree_init+0xb9/0xe6 > Dec 7 03:30:01 krshina3 kernel: [281555.959028] [<ffffffff811323ee>] > ? reiser4_init_tree+0x3f/0xb2 > Dec 7 03:30:01 krshina3 kernel: [281555.959031] [<ffffffff8115fb05>] > ? init_format_format40+0x357/0x4e4 > Dec 7 03:30:01 krshina3 kernel: [281555.959033] [<ffffffff81080f74>] > ? wake_up_bit+0xc/0x1b > Dec 7 03:30:01 krshina3 kernel: [281555.959035] [<ffffffff8113efc8>] > ? fill_super+0xcb/0x1ad > Dec 7 03:30:01 krshina3 kernel: [281555.959037] [<ffffffff810e142e>] > ? mount_bdev+0x133/0x186 > Dec 7 03:30:01 krshina3 kernel: [281555.959039] [<ffffffff810e15ed>] > ? mount_fs+0xc/0x9e > Dec 7 03:30:01 krshina3 kernel: [281555.959041] [<ffffffff810f55f2>] > ? vfs_kern_mount+0x5e/0xef > Dec 7 03:30:01 krshina3 kernel: [281555.959042] [<ffffffff810f71c1>] > ? do_mount+0x80b/0x904 > Dec 7 03:30:01 krshina3 kernel: [281555.959044] [<ffffffff810f74d5>] > ? SyS_mount+0x7e/0xb7 > Dec 7 03:30:01 krshina3 kernel: [281555.959046] [<ffffffff81533612>] > ? system_call_fastpath+0x16/0x1b > Dec 7 03:30:01 krshina3 kernel: [281555.959047] Mem-Info: > Dec 7 03:30:01 krshina3 kernel: [281555.959048] DMA per-cpu: > Dec 7 03:30:01 krshina3 kernel: [281555.959049] CPU 0: hi: 0, > btch: 1 usd: 0 > Dec 7 03:30:01 krshina3 kernel: [281555.959050] CPU 1: hi: 0, > btch: 1 usd: 0 > Dec 7 03:30:01 krshina3 kernel: [281555.959051] CPU 2: hi: 0, > btch: 1 usd: 0 > Dec 7 03:30:01 krshina3 kernel: [281555.959052] CPU 3: hi: 0, > btch: 1 usd: 0 > Dec 7 03:30:01 krshina3 kernel: [281555.959052] DMA32 per-cpu: > Dec 7 03:30:01 krshina3 kernel: [281555.959053] CPU 0: hi: 186, > btch: 31 usd: 0 > Dec 7 03:30:01 krshina3 kernel: [281555.959054] CPU 1: hi: 186, > btch: 31 usd: 0 > Dec 7 03:30:01 krshina3 kernel: [281555.959055] CPU 2: hi: 186, > btch: 31 usd: 0 > Dec 7 03:30:01 krshina3 kernel: [281555.959056] CPU 3: hi: 186, > btch: 31 usd: 0 > Dec 7 03:30:01 krshina3 kernel: [281555.959057] Normal per-cpu: > Dec 7 03:30:01 krshina3 kernel: [281555.959057] CPU 0: hi: 186, > btch: 31 usd: 0 > Dec 7 03:30:01 krshina3 kernel: [281555.959058] CPU 1: hi: 186, > btch: 31 usd: 0 > Dec 7 03:30:01 krshina3 kernel: [281555.959059] CPU 2: hi: 186, > btch: 31 usd: 0 > Dec 7 03:30:01 krshina3 kernel: [281555.959060] CPU 3: hi: 186, > btch: 31 usd: 0 > Dec 7 03:30:01 krshina3 kernel: [281555.959062] active_anon:593069 > inactive_anon:120226 isolated_anon:0 > Dec 7 03:30:01 krshina3 kernel: [281555.959062] active_file:503137 > inactive_file:503029 isolated_file:0 > Dec 7 03:30:01 krshina3 kernel: [281555.959062] unevictable:0 > dirty:333 writeback:0 unstable:0 > Dec 7 03:30:01 krshina3 kernel: [281555.959062] free:104532 > slab_reclaimable:109978 slab_unreclaimable:8402 > Dec 7 03:30:01 krshina3 kernel: [281555.959062] mapped:51579 > shmem:5928 pagetables:9488 bounce:0 > Dec 7 03:30:01 krshina3 kernel: [281555.959062] free_cma:0 > Dec 7 03:30:01 krshina3 kernel: [281555.959068] DMA free:15900kB > min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB > active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB > isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB > dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB > slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB > bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 > all_unreclaimable? yes > Dec 7 03:30:01 krshina3 kernel: [281555.959069] lowmem_reserve[]: 0 > 2952 7667 7667 > Dec 7 03:30:01 krshina3 kernel: [281555.959074] DMA32 free:168028kB > min:4308kB low:5384kB high:6460kB active_anon:837216kB > inactive_anon:214776kB active_file:790440kB inactive_file:790440kB > unevictable:0kB isolated(anon):0kB isolated(file):0kB > present:3098560kB managed:3023876kB mlocked:0kB dirty:316kB > writeback:0kB mapped:78860kB shmem:8760kB slab_reclaimable:171284kB > slab_unreclaimable:11888kB kernel_stack:2240kB pagetables:16348kB > unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 > all_unreclaimable? no > Dec 7 03:30:01 krshina3 kernel: [281555.959075] lowmem_reserve[]: 0 0 4714 4714 > Dec 7 03:30:01 krshina3 kernel: [281555.959079] Normal free:234200kB > min:6880kB low:8600kB high:10320kB active_anon:1535060kB > inactive_anon:266128kB active_file:1222108kB inactive_file:1221676kB > unevictable:0kB isolated(anon):0kB isolated(file):0kB > present:4954112kB managed:4828124kB mlocked:0kB dirty:1016kB > writeback:0kB mapped:127456kB shmem:14952kB slab_reclaimable:268628kB > slab_unreclaimable:21720kB kernel_stack:4976kB pagetables:21604kB > unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 > all_unreclaimable? no > Dec 7 03:30:01 krshina3 kernel: [281555.959080] lowmem_reserve[]: 0 0 0 0 > Dec 7 03:30:01 krshina3 kernel: [281555.959081] DMA: 1*4kB (U) 1*8kB > (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB > 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB > Dec 7 03:30:01 krshina3 kernel: [281555.959088] DMA32: 36545*4kB > (UEM) 2543*8kB (UEM) 70*16kB (UMR) 0*32kB 0*64kB 1*128kB (R) 0*256kB > 1*512kB (R) 0*1024kB 0*2048kB 0*4096kB = 168284kB > Dec 7 03:30:01 krshina3 kernel: [281555.959093] Normal: 50408*4kB > (UEM) 3913*8kB (UEM) 36*16kB (UMR) 0*32kB 1*64kB (R) 1*128kB (R) > 1*256kB (R) 1*512kB (R) 0*1024kB 0*2048kB 0*4096kB = 234472kB > Dec 7 03:30:01 krshina3 kernel: [281555.959099] Node 0 > hugepages_total=0 hugepages_free=0 hugepages_surp=0 > hugepages_size=2048kB > Dec 7 03:30:01 krshina3 kernel: [281555.959100] 1013453 total pagecache pages > Dec 7 03:30:01 krshina3 kernel: [281555.959101] 1228 pages in swap cache > Dec 7 03:30:01 krshina3 kernel: [281555.959102] Swap cache stats: add > 133257, delete 132029, find 57308/68141 > Dec 7 03:30:01 krshina3 kernel: [281555.959103] Free swap = 184632kB > Dec 7 03:30:01 krshina3 kernel: [281555.959103] Total swap = 594300kB > Dec 7 03:30:01 krshina3 kernel: [281555.959104] 2017164 pages RAM > Dec 7 03:30:01 krshina3 kernel: [281555.959105] 0 pages HighMem/MovableOnly > Dec 7 03:30:01 krshina3 kernel: [281555.959106] 31497 pages reserved > > On Wed, Dec 3, 2014 at 9:16 PM, Dušan Čolić <dusanc@gmail.com> wrote: >> On Mon, Dec 1, 2014 at 12:58 AM, Edward Shishkin >> <edward.shishkin@gmail.com> wrote: >>> On 12/01/2014 12:53 AM, Dušan Čolić wrote: >>> >>> >>> On Dec 1, 2014 12:47 AM, "Edward Shishkin" <edward.shishkin@gmail.com> >>> wrote: >>>> >>>> On 12/01/2014 12:04 AM, Dušan Čolić wrote: >>>>> On Fri, Nov 14, 2014 at 9:09 PM, Dušan Čolić <dusanc@gmail.com> wrote: >>>>>> As I had no time to make a full backup I went back to 3.10 kernel and >>>>>> had no >>>>>> problem since. >>>>>> >>>>>> Could this issue be connected with those firefox cache files that were >>>>>> bad >>>>>> (see other mail thread) so I deleted them but for some reason they >>>>>> continued >>>>>> making problems or problem wasn't really solved by deletion? I ask this >>>>>> as >>>>>> after long time of stable r4 I got 2 problems in same week so they're >>>>>> probably related. >>>>>> >>>>>> On Nov 14, 2014 8:58 PM, "Edward Shishkin" <edward.shishkin@gmail.com> >>>>>> wrote: >>>>>>> On 11/05/2014 12:04 PM, Dušan Čolić wrote: >>>>>>> >>>>>>> >>>>>>> On Nov 5, 2014 12:48 AM, "Edward Shishkin" <edward.shishkin@gmail.com> >>>>>>> wrote: >>>>>>>> On 11/04/2014 02:16 PM, Dušan Čolić wrote: >>>>>>>>> Did a fsck of source partition. >>>>>>>>> Btw. why is there a reason this corruption appeared when I started >>>>>>>>> using 3.16.2 instead 3.10? >>>>>>>>> >>>>>>>> I would also suspect this failed mount. >>>>>>>> It could have fatal consequences for the system, and, in particular >>>>>>>> for >>>>>>>> your ''/". >>>>>>>> >>>>>>> Failed mount happened on the partition that I was copying >>>>>>> to,/mnt/backup, >>>>>>> and it fscked ok. >>>>>>> / was partition I was copying from and it had errors. >>>>>>> >>>>>>> >>>>>>> >>>>>>> Hi Dušan, >>>>>>> >>>>>>> So, how is your / ? >>>>> So I was feeling brave so I put 3.16.2 back 4 days ago and I got this: >>>>> >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436017] ------------[ cut >>>>> here ]------------ >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436320] kernel BUG at >>>>> fs/reiser4/plugin/item/ctail.c:669! >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436652] invalid opcode: 0000 >>>>> [#1] SMP >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436899] CPU: 3 PID: 30235 >>>>> Comm: rsync Not tainted 3.16.5-gentoo #2 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.437275] Hardware name: >>>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>>>> 07/04/2012 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.437834] task: >>>>> ffff8801333d4010 ti: ffff880118218000 task.ti: ffff880118218000 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.438264] RIP: >>>>> 0010:[<ffffffff8115aaf4>] [<ffffffff8115aaf4>] >>>>> do_readpage_ctail+0x2c5/0x3c4 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.438768] RSP: >>>>> 0018:ffff88011821baa8 EFLAGS: 00010246 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439073] RAX: 0000000000000000 >>>>> RBX: ffff88011821bb78 RCX: 000000000002f35d >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439484] RDX: 000000000000002f >>>>> RSI: 0000000000000000 RDI: ffff8800b953b000 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439894] RBP: ffff880169d231a0 >>>>> R08: 0000000000000000 R09: 0000000000000000 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.440304] R10: ffffffff8114eb84 >>>>> R11: 0000000000012368 R12: 0000000000000002 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.440713] R13: 0000000000001000 >>>>> R14: ffffea00052f5158 R15: 0000000000000000 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441124] FS: >>>>> 00007f3d4d434700(0000) GS:ffff88022e380000(0000) >>>>> knlGS:0000000000000000 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441589] CS: 0010 DS: 0000 >>>>> ES: 0000 CR0: 0000000080050033 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441918] CR2: 0000000000980000 >>>>> CR3: 00000001a0c03000 CR4: 00000000001427e0 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442327] Stack: >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442443] 0000000000000000 >>>>> ffff88011821bb78 0000000000000000 ffff880169d231a0 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442890] 0000000000000000 >>>>> ffffea00052f5158 0000000000000000 ffffffff8115ad7b >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443336] 00000000000aa1a1 >>>>> ffff88011821bca0 ffffea00052f5158 ffff880169d232e0 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443784] Call Trace: >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443926] [<ffffffff8115ad7b>] >>>>> ? ctail_readpages_filler+0x188/0x1c9 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444302] [<ffffffff8115abf3>] >>>>> ? do_readpage_ctail+0x3c4/0x3c4 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444655] [<ffffffff810b5528>] >>>>> ? read_cache_pages+0x91/0xfc >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444990] [<ffffffff8115b17c>] >>>>> ? readpages_ctail+0x2c8/0x2e5 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.445332] [<ffffffff81151e72>] >>>>> ? readpages_cryptcompress+0x39/0x5f >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.445704] [<ffffffff810b56c9>] >>>>> ? __do_page_cache_readahead+0x136/0x1d0 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446094] [<ffffffff810b5958>] >>>>> ? ondemand_readahead+0x1f5/0x203 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446450] [<ffffffff810ae761>] >>>>> ? generic_file_read_iter+0x191/0x539 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446827] [<ffffffff810e9256>] >>>>> ? path_openat+0x24b/0x5ce >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447147] [<ffffffff810de1e6>] >>>>> ? new_sync_read+0x6b/0x8f >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447469] [<ffffffff81151f07>] >>>>> ? read_cryptcompress+0x6f/0x97 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447815] [<ffffffff8114d4c0>] >>>>> ? reiser4_read_dispatch+0xc7/0x11e >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448181] [<ffffffff810dedc9>] >>>>> ? vfs_read+0x84/0x13e >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448483] [<ffffffff810df25c>] >>>>> ? SyS_read+0x41/0x84 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448780] [<ffffffff815346d2>] >>>>> ? system_call_fastpath+0x16/0x1b >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.449135] Code: 01 00 00 e9 00 >>>>> ff ff ff 8b 43 58 41 0f b7 4d 04 48 8d 04 48 48 89 54 c3 28 e9 ea fe >>>>> ff ff 44 8b a3 88 00 00 00 41 83 fc 02 75 02 <0f> 0b 0f 87 87 00 00 00 >>>>> 41 83 fc 01 0f 85 de 00 00 00 49 8b 56 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.450567] RIP >>>>> [<ffffffff8115aaf4>] do_readpage_ctail+0x2c5/0x3c4 >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.450934] RSP <ffff88011821baa8> >>>>> Nov 30 03:30:36 krshina3 kernel: [293446.562843] ---[ end trace >>>>> 45473ce04b35219f ]--- >>>>> >>>>> Looks like same error like last time I used 3.16. Kernel 3.10 lasted >>>>> with 20 days uptime without problems this month and 3.16 had this oops >>>>> after 3 days. >>>> >>>> >>>> Unfortunately, there is no any ideas... >>>> I can port reiser4-for-3.10 stuff to 3.16. Will you test this port? >>>> >>> Ofcourse! >>> >> Funny thing is that again only 2 twigs were damaged.. >> Now I'm going to use R4-from3.11-ported-to3.16.patch and report on the results. >> >> Results from fsck --build-fs: >> >> FSCK: node.c: 108: repair_node_items_check: Node (4078203), items (60) and (61): >> Wrong order of keys. >> FSCK: filter.c: 407: repair_filter_update_traverse: Node (4078203): the node is >> unrecoverable. Pointed from the node (655473), item (14), unit (0). Removed. >> FSCK: node.c: 108: repair_node_items_check: Node (4078899), items (6) and (7): >> Wrong order of keys. >> FSCK: filter.c: 407: repair_filter_update_traverse: Node (4078899): the node is >> unrecoverable. Pointed from the node (655473), item (14), unit (0). Removed. >> FSCK: node.c: 108: repair_node_items_check: Node (4079383), items (0) and (1): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4079488), items (0) and (1): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4079546), items (0) and (1): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4080447), items (0) and (1): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4080571), items (0) and (1): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4081137), items (1) and (2): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4090871), items (0) and (1): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4091337), items (0) and (1): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4091990), items (0) and (1): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4092423), items (1) and (2): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4093016), items (0) and (1): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4093690), items (27) and (28): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4094525), items (0) and (1): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4096175), items (0) and (1): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4099659), items (12) and (13): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4099663), items (21) and (22): >> Wrong order of keys. >> FSCK: node.c: 108: repair_node_items_check: Node (4113492), items (0) and (1): >> Wrong order of keys. >> >> >> >> >>> >>> OK, I'll try to port it ASAP, >>> for now fsck your / .. . >>> >>> Thanks, >>> Edward. -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-12-07 10:52 ` Edward Shishkin @ 2014-12-07 23:45 ` Dušan Čolić 2014-12-08 11:22 ` Edward Shishkin 0 siblings, 1 reply; 33+ messages in thread From: Dušan Čolić @ 2014-12-07 23:45 UTC (permalink / raw) To: Edward Shishkin; +Cc: reiserfs-devel, Ivan Shapovalov On Sun, Dec 7, 2014 at 11:52 AM, Edward Shishkin <edward.shishkin@gmail.com> wrote: > And the root partition became corrupted, or...? > Yes, just managed to fsck it now. fsck: CHECKING THE STORAGE TREE $ [==\ ] 4% $ Nodes left in the tree 3678479 Leaves of them 3626831, Twigs of them 50438 Time interval: Sun Dec 7 23:22:35 2014 - Sun Dec 7 23:25:26 2014 CHECKING EXTENT REGIONS. Read twigs 50438 Time interval: Sun Dec 7 23:25:26 2014 - Sun Dec 7 23:25:35 2014 CHECKING THE SEMANTIC TREE FSCK: /mkdeb/build/reiser4progs/reiser4progs/plugin/object/ccreg40/ccreg40_repair.c: 167: ccreg40_check_cluster: The file [1b529a6:134623831303736:1d80a73] (ccreg40): the cluster at [0] offset 65536 bytes long is orphan. Found 543127 objects (some could be encountered more then once). Time interval: Sun Dec 7 23:25:35 2014 - Sun Dec 7 23:28:50 2014 FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/repair.c: 550: repair_sem_fini: On-disk used block bitmap and really used block bitmap differ. ***** fsck.reiser4 finished at Sun Dec 7 23:28:50 2014 Closing fs...done build-fs: FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: repair_node_items_check: Node (4078203), items (60) and (61): Wrong order of keys. FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: repair_node_items_check: Node (4078899), items (6) and (7): Wrong order of keys. FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: repair_node_items_check: Node (4079383), items (0) and (1): Wrong order of keys. FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: repair_node_items_check: Node (4079488), items (0) and (1): Wrong order of keys. FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: repair_node_items_check: Node (4079546), items (0) and (1): Wrong order of keys. FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: repair_node_items_check: Node (4080447), items (0) and (1): Wrong order of keys. FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: repair_node_items_check: Node (4080571), items (0) and (1): Wrong order of keys. FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: repair_node_items_check: Node (4081137), items (1) and (2): Wrong order of keys. FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: repair_node_items_check: Node (4090871), items (0) and (1): Wrong order of keys. FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: repair_node_items_check: Node (4091337), items (0) and (1): Wrong order of keys. FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: repair_node_items_check: Node (4091990), items (0) and (1): Wrong order of keys. FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: repair_node_items_check: Node (4092423), items (1) and (2): Wrong order of keys. FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: repair_node_items_check: Node (4093016), items (0) and (1): Wrong order of keys. FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: repair_node_items_check: Node (4093690), items (27) and (28): Wrong order of keys. FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: repair_node_items_check: Node (4094525), items (0) and (1): Wrong order of keys. FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: repair_node_items_check: Node (4096175), items (0) and (1): Wrong order of keys. FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: repair_node_items_check: Node (4099659), items (12) and (13): Wrong order of keys. FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: repair_node_items_check: Node (4099663), items (21) and (22): Wrong order of keys. FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: repair_node_items_check: Node (4113492), items (0) and (1): Wrong order of keys. > Thanks, > Edward. > > > > On 12/07/2014 09:07 AM, Dušan Čolić wrote: >> >> And on the 4th day: >> >> ### RSNAPSHOT DAILY ### >> fsck.reiser4 /dev/md125 >> mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory >> Backup failure >> umount: /mnt/backup: not mounted >> >> >> krshina3 ~ # cat /proc/meminfo >> MemTotal: 7867900 kB >> MemFree: 1553044 kB >> MemAvailable: 4853752 kB >> Buffers: 0 kB >> Cached: 2975880 kB >> SwapCached: 4944 kB >> Active: 3780968 kB >> Inactive: 2003640 kB >> Active(anon): 2336740 kB >> Inactive(anon): 498120 kB >> Active(file): 1444228 kB >> Inactive(file): 1505520 kB >> Unevictable: 0 kB >> Mlocked: 0 kB >> SwapTotal: 594300 kB >> SwapFree: 180008 kB >> Dirty: 3064 kB >> Writeback: 0 kB >> AnonPages: 2804424 kB >> Mapped: 180772 kB >> Shmem: 26132 kB >> Slab: 427632 kB >> SReclaimable: 392984 kB >> SUnreclaim: 34648 kB >> KernelStack: 7536 kB >> PageTables: 38328 kB >> NFS_Unstable: 0 kB >> Bounce: 0 kB >> WritebackTmp: 0 kB >> CommitLimit: 4528248 kB >> Committed_AS: 5352472 kB >> VmallocTotal: 34359738367 kB >> VmallocUsed: 352244 kB >> VmallocChunk: 34359293283 kB >> HugePages_Total: 0 >> HugePages_Free: 0 >> HugePages_Rsvd: 0 >> HugePages_Surp: 0 >> Hugepagesize: 2048 kB >> DirectMap4k: 12224 kB >> DirectMap2M: 8056832 kB >> >> >> Dec 7 03:30:01 krshina3 kernel: [281555.958316] reiser4: md125: found >> disk format 4.0.0. >> Dec 7 03:30:01 krshina3 kernel: [281555.958998] mount: page >> allocation failure: order:4, mode:0x2040d0 >> Dec 7 03:30:01 krshina3 kernel: [281555.959000] CPU: 2 PID: 7078 >> Comm: mount Not tainted 3.16.5-gentoo #1 >> Dec 7 03:30:01 krshina3 kernel: [281555.959001] Hardware name: >> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >> 07/04/2012 >> Dec 7 03:30:01 krshina3 kernel: [281555.959003] 0000000000000006 >> ffffffff8152bdfb 0000000000000001 ffffffff810b0bc3 >> Dec 7 03:30:01 krshina3 kernel: [281555.959005] ffffffff81818df8 >> 0000000000000000 00000002fffffff0 0000000000000010 >> Dec 7 03:30:01 krshina3 kernel: [281555.959006] ffff8801007b27a0 >> 0000000000000000 0000000000000010 0000204081818240 >> Dec 7 03:30:01 krshina3 kernel: [281555.959008] Call Trace: >> Dec 7 03:30:01 krshina3 kernel: [281555.959011] [<ffffffff8152bdfb>] >> ? dump_stack+0x41/0x51 >> Dec 7 03:30:01 krshina3 kernel: [281555.959014] [<ffffffff810b0bc3>] >> ? warn_alloc_failed+0x10c/0x120 >> Dec 7 03:30:01 krshina3 kernel: [281555.959016] [<ffffffff810b2b66>] >> ? __alloc_pages_nodemask+0x581/0x69d >> Dec 7 03:30:01 krshina3 kernel: [281555.959019] [<ffffffff810db5f4>] >> ? cache_alloc_refill+0x261/0x48c >> Dec 7 03:30:01 krshina3 kernel: [281555.959022] [<ffffffff8113eefd>] >> ? reiser4_mount+0xc/0xc >> Dec 7 03:30:01 krshina3 kernel: [281555.959024] [<ffffffff810db35f>] >> ? kmem_cache_alloc+0x6d/0xa1 >> Dec 7 03:30:01 krshina3 kernel: [281555.959026] [<ffffffff8112bf58>] >> ? znodes_tree_init+0xb9/0xe6 >> Dec 7 03:30:01 krshina3 kernel: [281555.959028] [<ffffffff811323ee>] >> ? reiser4_init_tree+0x3f/0xb2 >> Dec 7 03:30:01 krshina3 kernel: [281555.959031] [<ffffffff8115fb05>] >> ? init_format_format40+0x357/0x4e4 >> Dec 7 03:30:01 krshina3 kernel: [281555.959033] [<ffffffff81080f74>] >> ? wake_up_bit+0xc/0x1b >> Dec 7 03:30:01 krshina3 kernel: [281555.959035] [<ffffffff8113efc8>] >> ? fill_super+0xcb/0x1ad >> Dec 7 03:30:01 krshina3 kernel: [281555.959037] [<ffffffff810e142e>] >> ? mount_bdev+0x133/0x186 >> Dec 7 03:30:01 krshina3 kernel: [281555.959039] [<ffffffff810e15ed>] >> ? mount_fs+0xc/0x9e >> Dec 7 03:30:01 krshina3 kernel: [281555.959041] [<ffffffff810f55f2>] >> ? vfs_kern_mount+0x5e/0xef >> Dec 7 03:30:01 krshina3 kernel: [281555.959042] [<ffffffff810f71c1>] >> ? do_mount+0x80b/0x904 >> Dec 7 03:30:01 krshina3 kernel: [281555.959044] [<ffffffff810f74d5>] >> ? SyS_mount+0x7e/0xb7 >> Dec 7 03:30:01 krshina3 kernel: [281555.959046] [<ffffffff81533612>] >> ? system_call_fastpath+0x16/0x1b >> Dec 7 03:30:01 krshina3 kernel: [281555.959047] Mem-Info: >> Dec 7 03:30:01 krshina3 kernel: [281555.959048] DMA per-cpu: >> Dec 7 03:30:01 krshina3 kernel: [281555.959049] CPU 0: hi: 0, >> btch: 1 usd: 0 >> Dec 7 03:30:01 krshina3 kernel: [281555.959050] CPU 1: hi: 0, >> btch: 1 usd: 0 >> Dec 7 03:30:01 krshina3 kernel: [281555.959051] CPU 2: hi: 0, >> btch: 1 usd: 0 >> Dec 7 03:30:01 krshina3 kernel: [281555.959052] CPU 3: hi: 0, >> btch: 1 usd: 0 >> Dec 7 03:30:01 krshina3 kernel: [281555.959052] DMA32 per-cpu: >> Dec 7 03:30:01 krshina3 kernel: [281555.959053] CPU 0: hi: 186, >> btch: 31 usd: 0 >> Dec 7 03:30:01 krshina3 kernel: [281555.959054] CPU 1: hi: 186, >> btch: 31 usd: 0 >> Dec 7 03:30:01 krshina3 kernel: [281555.959055] CPU 2: hi: 186, >> btch: 31 usd: 0 >> Dec 7 03:30:01 krshina3 kernel: [281555.959056] CPU 3: hi: 186, >> btch: 31 usd: 0 >> Dec 7 03:30:01 krshina3 kernel: [281555.959057] Normal per-cpu: >> Dec 7 03:30:01 krshina3 kernel: [281555.959057] CPU 0: hi: 186, >> btch: 31 usd: 0 >> Dec 7 03:30:01 krshina3 kernel: [281555.959058] CPU 1: hi: 186, >> btch: 31 usd: 0 >> Dec 7 03:30:01 krshina3 kernel: [281555.959059] CPU 2: hi: 186, >> btch: 31 usd: 0 >> Dec 7 03:30:01 krshina3 kernel: [281555.959060] CPU 3: hi: 186, >> btch: 31 usd: 0 >> Dec 7 03:30:01 krshina3 kernel: [281555.959062] active_anon:593069 >> inactive_anon:120226 isolated_anon:0 >> Dec 7 03:30:01 krshina3 kernel: [281555.959062] active_file:503137 >> inactive_file:503029 isolated_file:0 >> Dec 7 03:30:01 krshina3 kernel: [281555.959062] unevictable:0 >> dirty:333 writeback:0 unstable:0 >> Dec 7 03:30:01 krshina3 kernel: [281555.959062] free:104532 >> slab_reclaimable:109978 slab_unreclaimable:8402 >> Dec 7 03:30:01 krshina3 kernel: [281555.959062] mapped:51579 >> shmem:5928 pagetables:9488 bounce:0 >> Dec 7 03:30:01 krshina3 kernel: [281555.959062] free_cma:0 >> Dec 7 03:30:01 krshina3 kernel: [281555.959068] DMA free:15900kB >> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >> all_unreclaimable? yes >> Dec 7 03:30:01 krshina3 kernel: [281555.959069] lowmem_reserve[]: 0 >> 2952 7667 7667 >> Dec 7 03:30:01 krshina3 kernel: [281555.959074] DMA32 free:168028kB >> min:4308kB low:5384kB high:6460kB active_anon:837216kB >> inactive_anon:214776kB active_file:790440kB inactive_file:790440kB >> unevictable:0kB isolated(anon):0kB isolated(file):0kB >> present:3098560kB managed:3023876kB mlocked:0kB dirty:316kB >> writeback:0kB mapped:78860kB shmem:8760kB slab_reclaimable:171284kB >> slab_unreclaimable:11888kB kernel_stack:2240kB pagetables:16348kB >> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >> all_unreclaimable? no >> Dec 7 03:30:01 krshina3 kernel: [281555.959075] lowmem_reserve[]: 0 0 >> 4714 4714 >> Dec 7 03:30:01 krshina3 kernel: [281555.959079] Normal free:234200kB >> min:6880kB low:8600kB high:10320kB active_anon:1535060kB >> inactive_anon:266128kB active_file:1222108kB inactive_file:1221676kB >> unevictable:0kB isolated(anon):0kB isolated(file):0kB >> present:4954112kB managed:4828124kB mlocked:0kB dirty:1016kB >> writeback:0kB mapped:127456kB shmem:14952kB slab_reclaimable:268628kB >> slab_unreclaimable:21720kB kernel_stack:4976kB pagetables:21604kB >> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >> all_unreclaimable? no >> Dec 7 03:30:01 krshina3 kernel: [281555.959080] lowmem_reserve[]: 0 0 0 0 >> Dec 7 03:30:01 krshina3 kernel: [281555.959081] DMA: 1*4kB (U) 1*8kB >> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >> Dec 7 03:30:01 krshina3 kernel: [281555.959088] DMA32: 36545*4kB >> (UEM) 2543*8kB (UEM) 70*16kB (UMR) 0*32kB 0*64kB 1*128kB (R) 0*256kB >> 1*512kB (R) 0*1024kB 0*2048kB 0*4096kB = 168284kB >> Dec 7 03:30:01 krshina3 kernel: [281555.959093] Normal: 50408*4kB >> (UEM) 3913*8kB (UEM) 36*16kB (UMR) 0*32kB 1*64kB (R) 1*128kB (R) >> 1*256kB (R) 1*512kB (R) 0*1024kB 0*2048kB 0*4096kB = 234472kB >> Dec 7 03:30:01 krshina3 kernel: [281555.959099] Node 0 >> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >> hugepages_size=2048kB >> Dec 7 03:30:01 krshina3 kernel: [281555.959100] 1013453 total pagecache >> pages >> Dec 7 03:30:01 krshina3 kernel: [281555.959101] 1228 pages in swap cache >> Dec 7 03:30:01 krshina3 kernel: [281555.959102] Swap cache stats: add >> 133257, delete 132029, find 57308/68141 >> Dec 7 03:30:01 krshina3 kernel: [281555.959103] Free swap = 184632kB >> Dec 7 03:30:01 krshina3 kernel: [281555.959103] Total swap = 594300kB >> Dec 7 03:30:01 krshina3 kernel: [281555.959104] 2017164 pages RAM >> Dec 7 03:30:01 krshina3 kernel: [281555.959105] 0 pages >> HighMem/MovableOnly >> Dec 7 03:30:01 krshina3 kernel: [281555.959106] 31497 pages reserved >> >> On Wed, Dec 3, 2014 at 9:16 PM, Dušan Čolić <dusanc@gmail.com> wrote: >>> >>> On Mon, Dec 1, 2014 at 12:58 AM, Edward Shishkin >>> <edward.shishkin@gmail.com> wrote: >>>> >>>> On 12/01/2014 12:53 AM, Dušan Čolić wrote: >>>> >>>> >>>> On Dec 1, 2014 12:47 AM, "Edward Shishkin" <edward.shishkin@gmail.com> >>>> wrote: >>>>> >>>>> >>>>> On 12/01/2014 12:04 AM, Dušan Čolić wrote: >>>>>> >>>>>> On Fri, Nov 14, 2014 at 9:09 PM, Dušan Čolić <dusanc@gmail.com> wrote: >>>>>>> >>>>>>> As I had no time to make a full backup I went back to 3.10 kernel and >>>>>>> had no >>>>>>> problem since. >>>>>>> >>>>>>> Could this issue be connected with those firefox cache files that >>>>>>> were >>>>>>> bad >>>>>>> (see other mail thread) so I deleted them but for some reason they >>>>>>> continued >>>>>>> making problems or problem wasn't really solved by deletion? I ask >>>>>>> this >>>>>>> as >>>>>>> after long time of stable r4 I got 2 problems in same week so they're >>>>>>> probably related. >>>>>>> >>>>>>> On Nov 14, 2014 8:58 PM, "Edward Shishkin" >>>>>>> <edward.shishkin@gmail.com> >>>>>>> wrote: >>>>>>>> >>>>>>>> On 11/05/2014 12:04 PM, Dušan Čolić wrote: >>>>>>>> >>>>>>>> >>>>>>>> On Nov 5, 2014 12:48 AM, "Edward Shishkin" >>>>>>>> <edward.shishkin@gmail.com> >>>>>>>> wrote: >>>>>>>>> >>>>>>>>> On 11/04/2014 02:16 PM, Dušan Čolić wrote: >>>>>>>>>> >>>>>>>>>> Did a fsck of source partition. >>>>>>>>>> Btw. why is there a reason this corruption appeared when I started >>>>>>>>>> using 3.16.2 instead 3.10? >>>>>>>>>> >>>>>>>>> I would also suspect this failed mount. >>>>>>>>> It could have fatal consequences for the system, and, in particular >>>>>>>>> for >>>>>>>>> your ''/". >>>>>>>>> >>>>>>>> Failed mount happened on the partition that I was copying >>>>>>>> to,/mnt/backup, >>>>>>>> and it fscked ok. >>>>>>>> / was partition I was copying from and it had errors. >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> Hi Dušan, >>>>>>>> >>>>>>>> So, how is your / ? >>>>>> >>>>>> So I was feeling brave so I put 3.16.2 back 4 days ago and I got this: >>>>>> >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436017] ------------[ cut >>>>>> here ]------------ >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436320] kernel BUG at >>>>>> fs/reiser4/plugin/item/ctail.c:669! >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436652] invalid opcode: 0000 >>>>>> [#1] SMP >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436899] CPU: 3 PID: 30235 >>>>>> Comm: rsync Not tainted 3.16.5-gentoo #2 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.437275] Hardware name: >>>>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>>>>> 07/04/2012 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.437834] task: >>>>>> ffff8801333d4010 ti: ffff880118218000 task.ti: ffff880118218000 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.438264] RIP: >>>>>> 0010:[<ffffffff8115aaf4>] [<ffffffff8115aaf4>] >>>>>> do_readpage_ctail+0x2c5/0x3c4 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.438768] RSP: >>>>>> 0018:ffff88011821baa8 EFLAGS: 00010246 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439073] RAX: 0000000000000000 >>>>>> RBX: ffff88011821bb78 RCX: 000000000002f35d >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439484] RDX: 000000000000002f >>>>>> RSI: 0000000000000000 RDI: ffff8800b953b000 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439894] RBP: ffff880169d231a0 >>>>>> R08: 0000000000000000 R09: 0000000000000000 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.440304] R10: ffffffff8114eb84 >>>>>> R11: 0000000000012368 R12: 0000000000000002 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.440713] R13: 0000000000001000 >>>>>> R14: ffffea00052f5158 R15: 0000000000000000 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441124] FS: >>>>>> 00007f3d4d434700(0000) GS:ffff88022e380000(0000) >>>>>> knlGS:0000000000000000 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441589] CS: 0010 DS: 0000 >>>>>> ES: 0000 CR0: 0000000080050033 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441918] CR2: 0000000000980000 >>>>>> CR3: 00000001a0c03000 CR4: 00000000001427e0 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442327] Stack: >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442443] 0000000000000000 >>>>>> ffff88011821bb78 0000000000000000 ffff880169d231a0 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442890] 0000000000000000 >>>>>> ffffea00052f5158 0000000000000000 ffffffff8115ad7b >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443336] 00000000000aa1a1 >>>>>> ffff88011821bca0 ffffea00052f5158 ffff880169d232e0 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443784] Call Trace: >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443926] [<ffffffff8115ad7b>] >>>>>> ? ctail_readpages_filler+0x188/0x1c9 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444302] [<ffffffff8115abf3>] >>>>>> ? do_readpage_ctail+0x3c4/0x3c4 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444655] [<ffffffff810b5528>] >>>>>> ? read_cache_pages+0x91/0xfc >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444990] [<ffffffff8115b17c>] >>>>>> ? readpages_ctail+0x2c8/0x2e5 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.445332] [<ffffffff81151e72>] >>>>>> ? readpages_cryptcompress+0x39/0x5f >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.445704] [<ffffffff810b56c9>] >>>>>> ? __do_page_cache_readahead+0x136/0x1d0 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446094] [<ffffffff810b5958>] >>>>>> ? ondemand_readahead+0x1f5/0x203 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446450] [<ffffffff810ae761>] >>>>>> ? generic_file_read_iter+0x191/0x539 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446827] [<ffffffff810e9256>] >>>>>> ? path_openat+0x24b/0x5ce >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447147] [<ffffffff810de1e6>] >>>>>> ? new_sync_read+0x6b/0x8f >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447469] [<ffffffff81151f07>] >>>>>> ? read_cryptcompress+0x6f/0x97 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447815] [<ffffffff8114d4c0>] >>>>>> ? reiser4_read_dispatch+0xc7/0x11e >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448181] [<ffffffff810dedc9>] >>>>>> ? vfs_read+0x84/0x13e >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448483] [<ffffffff810df25c>] >>>>>> ? SyS_read+0x41/0x84 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448780] [<ffffffff815346d2>] >>>>>> ? system_call_fastpath+0x16/0x1b >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.449135] Code: 01 00 00 e9 00 >>>>>> ff ff ff 8b 43 58 41 0f b7 4d 04 48 8d 04 48 48 89 54 c3 28 e9 ea fe >>>>>> ff ff 44 8b a3 88 00 00 00 41 83 fc 02 75 02 <0f> 0b 0f 87 87 00 00 00 >>>>>> 41 83 fc 01 0f 85 de 00 00 00 49 8b 56 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.450567] RIP >>>>>> [<ffffffff8115aaf4>] do_readpage_ctail+0x2c5/0x3c4 >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.450934] RSP >>>>>> <ffff88011821baa8> >>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.562843] ---[ end trace >>>>>> 45473ce04b35219f ]--- >>>>>> >>>>>> Looks like same error like last time I used 3.16. Kernel 3.10 lasted >>>>>> with 20 days uptime without problems this month and 3.16 had this oops >>>>>> after 3 days. >>>>> >>>>> >>>>> >>>>> Unfortunately, there is no any ideas... >>>>> I can port reiser4-for-3.10 stuff to 3.16. Will you test this port? >>>>> >>>> Ofcourse! >>>> >>> Funny thing is that again only 2 twigs were damaged.. >>> Now I'm going to use R4-from3.11-ported-to3.16.patch and report on the >>> results. >>> >>> Results from fsck --build-fs: >>> >>> FSCK: node.c: 108: repair_node_items_check: Node (4078203), items (60) >>> and (61): >>> Wrong order of keys. >>> FSCK: filter.c: 407: repair_filter_update_traverse: Node (4078203): the >>> node is >>> unrecoverable. Pointed from the node (655473), item (14), unit (0). >>> Removed. >>> FSCK: node.c: 108: repair_node_items_check: Node (4078899), items (6) and >>> (7): >>> Wrong order of keys. >>> FSCK: filter.c: 407: repair_filter_update_traverse: Node (4078899): the >>> node is >>> unrecoverable. Pointed from the node (655473), item (14), unit (0). >>> Removed. >>> FSCK: node.c: 108: repair_node_items_check: Node (4079383), items (0) and >>> (1): >>> Wrong order of keys. >>> FSCK: node.c: 108: repair_node_items_check: Node (4079488), items (0) and >>> (1): >>> Wrong order of keys. >>> FSCK: node.c: 108: repair_node_items_check: Node (4079546), items (0) and >>> (1): >>> Wrong order of keys. >>> FSCK: node.c: 108: repair_node_items_check: Node (4080447), items (0) and >>> (1): >>> Wrong order of keys. >>> FSCK: node.c: 108: repair_node_items_check: Node (4080571), items (0) and >>> (1): >>> Wrong order of keys. >>> FSCK: node.c: 108: repair_node_items_check: Node (4081137), items (1) and >>> (2): >>> Wrong order of keys. >>> FSCK: node.c: 108: repair_node_items_check: Node (4090871), items (0) and >>> (1): >>> Wrong order of keys. >>> FSCK: node.c: 108: repair_node_items_check: Node (4091337), items (0) and >>> (1): >>> Wrong order of keys. >>> FSCK: node.c: 108: repair_node_items_check: Node (4091990), items (0) and >>> (1): >>> Wrong order of keys. >>> FSCK: node.c: 108: repair_node_items_check: Node (4092423), items (1) and >>> (2): >>> Wrong order of keys. >>> FSCK: node.c: 108: repair_node_items_check: Node (4093016), items (0) and >>> (1): >>> Wrong order of keys. >>> FSCK: node.c: 108: repair_node_items_check: Node (4093690), items (27) >>> and (28): >>> Wrong order of keys. >>> FSCK: node.c: 108: repair_node_items_check: Node (4094525), items (0) and >>> (1): >>> Wrong order of keys. >>> FSCK: node.c: 108: repair_node_items_check: Node (4096175), items (0) and >>> (1): >>> Wrong order of keys. >>> FSCK: node.c: 108: repair_node_items_check: Node (4099659), items (12) >>> and (13): >>> Wrong order of keys. >>> FSCK: node.c: 108: repair_node_items_check: Node (4099663), items (21) >>> and (22): >>> Wrong order of keys. >>> FSCK: node.c: 108: repair_node_items_check: Node (4113492), items (0) and >>> (1): >>> Wrong order of keys. >>> >>> >>> >>> >>>> >>>> OK, I'll try to port it ASAP, >>>> for now fsck your / .. . >>>> >>>> Thanks, >>>> Edward. > > -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-12-07 23:45 ` Dušan Čolić @ 2014-12-08 11:22 ` Edward Shishkin 2014-12-08 11:54 ` Dušan Čolić [not found] ` <CADW=+3kGn9OBoHiVWT3EkmSxGn==0ZsEa1nS_dP7-oQeq5h48g@mail.gmail.com> 0 siblings, 2 replies; 33+ messages in thread From: Edward Shishkin @ 2014-12-08 11:22 UTC (permalink / raw) To: Dušan Čolić; +Cc: reiserfs-devel, Ivan Shapovalov Is .config the same as in the stuff for 3.10? Thanks, Edward. On 12/08/2014 12:45 AM, Dušan Čolić wrote: > On Sun, Dec 7, 2014 at 11:52 AM, Edward Shishkin > <edward.shishkin@gmail.com> wrote: >> And the root partition became corrupted, or...? >> > Yes, just managed to fsck it now. > > fsck: > > CHECKING THE STORAGE TREE $ > [==\ ] 4% $ > Nodes left in the tree 3678479 > Leaves of them 3626831, Twigs of them 50438 > Time interval: Sun Dec 7 23:22:35 2014 - Sun Dec 7 23:25:26 2014 > CHECKING EXTENT REGIONS. > Read twigs 50438 > Time interval: Sun Dec 7 23:25:26 2014 - Sun Dec 7 23:25:35 2014 > CHECKING THE SEMANTIC TREE > FSCK: > /mkdeb/build/reiser4progs/reiser4progs/plugin/object/ccreg40/ccreg40_repair.c: > 167: ccreg40_check_cluster: The file [1b529a6:134623831303736:1d80a73] > (ccreg40): the cluster at [0] offset 65536 bytes long is orphan. > Found 543127 objects (some could be encountered more then once). > Time interval: Sun Dec 7 23:25:35 2014 - Sun Dec 7 23:28:50 2014 > FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/repair.c: 550: > repair_sem_fini: On-disk used block bitmap and really used block bitmap differ. > ***** fsck.reiser4 finished at Sun Dec 7 23:28:50 2014 > Closing fs...done > > > build-fs: > > FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: > repair_node_items_check: Node (4078203), items (60) and (61): Wrong order of > keys. > FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: > repair_node_items_check: Node (4078899), items (6) and (7): Wrong order of keys. > FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: > repair_node_items_check: Node (4079383), items (0) and (1): Wrong order of keys. > FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: > repair_node_items_check: Node (4079488), items (0) and (1): Wrong order of keys. > FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: > repair_node_items_check: Node (4079546), items (0) and (1): Wrong order of keys. > FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: > repair_node_items_check: Node (4080447), items (0) and (1): Wrong order of keys. > FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: > repair_node_items_check: Node (4080571), items (0) and (1): Wrong order of keys. > FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: > repair_node_items_check: Node (4081137), items (1) and (2): Wrong order of keys. > FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: > repair_node_items_check: Node (4090871), items (0) and (1): Wrong order of keys. > FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: > repair_node_items_check: Node (4091337), items (0) and (1): Wrong order of keys. > FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: > repair_node_items_check: Node (4091990), items (0) and (1): Wrong order of keys. > FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: > repair_node_items_check: Node (4092423), items (1) and (2): Wrong order of keys. > FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: > repair_node_items_check: Node (4093016), items (0) and (1): Wrong order of keys. > FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: > repair_node_items_check: Node (4093690), items (27) and (28): Wrong order of > keys. > FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: > repair_node_items_check: Node (4094525), items (0) and (1): Wrong order of keys. > FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: > repair_node_items_check: Node (4096175), items (0) and (1): Wrong order of keys. > FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: > repair_node_items_check: Node (4099659), items (12) and (13): Wrong order of > keys. > FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: > repair_node_items_check: Node (4099663), items (21) and (22): Wrong order of > keys. > FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: > repair_node_items_check: Node (4113492), items (0) and (1): Wrong order of keys. > >> Thanks, >> Edward. >> >> >> >> On 12/07/2014 09:07 AM, Dušan Čolić wrote: >>> And on the 4th day: >>> >>> ### RSNAPSHOT DAILY ### >>> fsck.reiser4 /dev/md125 >>> mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory >>> Backup failure >>> umount: /mnt/backup: not mounted >>> >>> >>> krshina3 ~ # cat /proc/meminfo >>> MemTotal: 7867900 kB >>> MemFree: 1553044 kB >>> MemAvailable: 4853752 kB >>> Buffers: 0 kB >>> Cached: 2975880 kB >>> SwapCached: 4944 kB >>> Active: 3780968 kB >>> Inactive: 2003640 kB >>> Active(anon): 2336740 kB >>> Inactive(anon): 498120 kB >>> Active(file): 1444228 kB >>> Inactive(file): 1505520 kB >>> Unevictable: 0 kB >>> Mlocked: 0 kB >>> SwapTotal: 594300 kB >>> SwapFree: 180008 kB >>> Dirty: 3064 kB >>> Writeback: 0 kB >>> AnonPages: 2804424 kB >>> Mapped: 180772 kB >>> Shmem: 26132 kB >>> Slab: 427632 kB >>> SReclaimable: 392984 kB >>> SUnreclaim: 34648 kB >>> KernelStack: 7536 kB >>> PageTables: 38328 kB >>> NFS_Unstable: 0 kB >>> Bounce: 0 kB >>> WritebackTmp: 0 kB >>> CommitLimit: 4528248 kB >>> Committed_AS: 5352472 kB >>> VmallocTotal: 34359738367 kB >>> VmallocUsed: 352244 kB >>> VmallocChunk: 34359293283 kB >>> HugePages_Total: 0 >>> HugePages_Free: 0 >>> HugePages_Rsvd: 0 >>> HugePages_Surp: 0 >>> Hugepagesize: 2048 kB >>> DirectMap4k: 12224 kB >>> DirectMap2M: 8056832 kB >>> >>> >>> Dec 7 03:30:01 krshina3 kernel: [281555.958316] reiser4: md125: found >>> disk format 4.0.0. >>> Dec 7 03:30:01 krshina3 kernel: [281555.958998] mount: page >>> allocation failure: order:4, mode:0x2040d0 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959000] CPU: 2 PID: 7078 >>> Comm: mount Not tainted 3.16.5-gentoo #1 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959001] Hardware name: >>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>> 07/04/2012 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959003] 0000000000000006 >>> ffffffff8152bdfb 0000000000000001 ffffffff810b0bc3 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959005] ffffffff81818df8 >>> 0000000000000000 00000002fffffff0 0000000000000010 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959006] ffff8801007b27a0 >>> 0000000000000000 0000000000000010 0000204081818240 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959008] Call Trace: >>> Dec 7 03:30:01 krshina3 kernel: [281555.959011] [<ffffffff8152bdfb>] >>> ? dump_stack+0x41/0x51 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959014] [<ffffffff810b0bc3>] >>> ? warn_alloc_failed+0x10c/0x120 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959016] [<ffffffff810b2b66>] >>> ? __alloc_pages_nodemask+0x581/0x69d >>> Dec 7 03:30:01 krshina3 kernel: [281555.959019] [<ffffffff810db5f4>] >>> ? cache_alloc_refill+0x261/0x48c >>> Dec 7 03:30:01 krshina3 kernel: [281555.959022] [<ffffffff8113eefd>] >>> ? reiser4_mount+0xc/0xc >>> Dec 7 03:30:01 krshina3 kernel: [281555.959024] [<ffffffff810db35f>] >>> ? kmem_cache_alloc+0x6d/0xa1 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959026] [<ffffffff8112bf58>] >>> ? znodes_tree_init+0xb9/0xe6 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959028] [<ffffffff811323ee>] >>> ? reiser4_init_tree+0x3f/0xb2 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959031] [<ffffffff8115fb05>] >>> ? init_format_format40+0x357/0x4e4 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959033] [<ffffffff81080f74>] >>> ? wake_up_bit+0xc/0x1b >>> Dec 7 03:30:01 krshina3 kernel: [281555.959035] [<ffffffff8113efc8>] >>> ? fill_super+0xcb/0x1ad >>> Dec 7 03:30:01 krshina3 kernel: [281555.959037] [<ffffffff810e142e>] >>> ? mount_bdev+0x133/0x186 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959039] [<ffffffff810e15ed>] >>> ? mount_fs+0xc/0x9e >>> Dec 7 03:30:01 krshina3 kernel: [281555.959041] [<ffffffff810f55f2>] >>> ? vfs_kern_mount+0x5e/0xef >>> Dec 7 03:30:01 krshina3 kernel: [281555.959042] [<ffffffff810f71c1>] >>> ? do_mount+0x80b/0x904 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959044] [<ffffffff810f74d5>] >>> ? SyS_mount+0x7e/0xb7 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959046] [<ffffffff81533612>] >>> ? system_call_fastpath+0x16/0x1b >>> Dec 7 03:30:01 krshina3 kernel: [281555.959047] Mem-Info: >>> Dec 7 03:30:01 krshina3 kernel: [281555.959048] DMA per-cpu: >>> Dec 7 03:30:01 krshina3 kernel: [281555.959049] CPU 0: hi: 0, >>> btch: 1 usd: 0 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959050] CPU 1: hi: 0, >>> btch: 1 usd: 0 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959051] CPU 2: hi: 0, >>> btch: 1 usd: 0 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959052] CPU 3: hi: 0, >>> btch: 1 usd: 0 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959052] DMA32 per-cpu: >>> Dec 7 03:30:01 krshina3 kernel: [281555.959053] CPU 0: hi: 186, >>> btch: 31 usd: 0 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959054] CPU 1: hi: 186, >>> btch: 31 usd: 0 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959055] CPU 2: hi: 186, >>> btch: 31 usd: 0 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959056] CPU 3: hi: 186, >>> btch: 31 usd: 0 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959057] Normal per-cpu: >>> Dec 7 03:30:01 krshina3 kernel: [281555.959057] CPU 0: hi: 186, >>> btch: 31 usd: 0 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959058] CPU 1: hi: 186, >>> btch: 31 usd: 0 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959059] CPU 2: hi: 186, >>> btch: 31 usd: 0 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959060] CPU 3: hi: 186, >>> btch: 31 usd: 0 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] active_anon:593069 >>> inactive_anon:120226 isolated_anon:0 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] active_file:503137 >>> inactive_file:503029 isolated_file:0 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] unevictable:0 >>> dirty:333 writeback:0 unstable:0 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] free:104532 >>> slab_reclaimable:109978 slab_unreclaimable:8402 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] mapped:51579 >>> shmem:5928 pagetables:9488 bounce:0 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] free_cma:0 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959068] DMA free:15900kB >>> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >>> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >>> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >>> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >>> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >>> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>> all_unreclaimable? yes >>> Dec 7 03:30:01 krshina3 kernel: [281555.959069] lowmem_reserve[]: 0 >>> 2952 7667 7667 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959074] DMA32 free:168028kB >>> min:4308kB low:5384kB high:6460kB active_anon:837216kB >>> inactive_anon:214776kB active_file:790440kB inactive_file:790440kB >>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>> present:3098560kB managed:3023876kB mlocked:0kB dirty:316kB >>> writeback:0kB mapped:78860kB shmem:8760kB slab_reclaimable:171284kB >>> slab_unreclaimable:11888kB kernel_stack:2240kB pagetables:16348kB >>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>> all_unreclaimable? no >>> Dec 7 03:30:01 krshina3 kernel: [281555.959075] lowmem_reserve[]: 0 0 >>> 4714 4714 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959079] Normal free:234200kB >>> min:6880kB low:8600kB high:10320kB active_anon:1535060kB >>> inactive_anon:266128kB active_file:1222108kB inactive_file:1221676kB >>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>> present:4954112kB managed:4828124kB mlocked:0kB dirty:1016kB >>> writeback:0kB mapped:127456kB shmem:14952kB slab_reclaimable:268628kB >>> slab_unreclaimable:21720kB kernel_stack:4976kB pagetables:21604kB >>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>> all_unreclaimable? no >>> Dec 7 03:30:01 krshina3 kernel: [281555.959080] lowmem_reserve[]: 0 0 0 0 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959081] DMA: 1*4kB (U) 1*8kB >>> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >>> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >>> Dec 7 03:30:01 krshina3 kernel: [281555.959088] DMA32: 36545*4kB >>> (UEM) 2543*8kB (UEM) 70*16kB (UMR) 0*32kB 0*64kB 1*128kB (R) 0*256kB >>> 1*512kB (R) 0*1024kB 0*2048kB 0*4096kB = 168284kB >>> Dec 7 03:30:01 krshina3 kernel: [281555.959093] Normal: 50408*4kB >>> (UEM) 3913*8kB (UEM) 36*16kB (UMR) 0*32kB 1*64kB (R) 1*128kB (R) >>> 1*256kB (R) 1*512kB (R) 0*1024kB 0*2048kB 0*4096kB = 234472kB >>> Dec 7 03:30:01 krshina3 kernel: [281555.959099] Node 0 >>> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >>> hugepages_size=2048kB >>> Dec 7 03:30:01 krshina3 kernel: [281555.959100] 1013453 total pagecache >>> pages >>> Dec 7 03:30:01 krshina3 kernel: [281555.959101] 1228 pages in swap cache >>> Dec 7 03:30:01 krshina3 kernel: [281555.959102] Swap cache stats: add >>> 133257, delete 132029, find 57308/68141 >>> Dec 7 03:30:01 krshina3 kernel: [281555.959103] Free swap = 184632kB >>> Dec 7 03:30:01 krshina3 kernel: [281555.959103] Total swap = 594300kB >>> Dec 7 03:30:01 krshina3 kernel: [281555.959104] 2017164 pages RAM >>> Dec 7 03:30:01 krshina3 kernel: [281555.959105] 0 pages >>> HighMem/MovableOnly >>> Dec 7 03:30:01 krshina3 kernel: [281555.959106] 31497 pages reserved >>> >>> On Wed, Dec 3, 2014 at 9:16 PM, Dušan Čolić<dusanc@gmail.com> wrote: >>>> On Mon, Dec 1, 2014 at 12:58 AM, Edward Shishkin >>>> <edward.shishkin@gmail.com> wrote: >>>>> On 12/01/2014 12:53 AM, Dušan Čolić wrote: >>>>> >>>>> >>>>> On Dec 1, 2014 12:47 AM, "Edward Shishkin"<edward.shishkin@gmail.com> >>>>> wrote: >>>>>> On 12/01/2014 12:04 AM, Dušan Čolić wrote: >>>>>>> On Fri, Nov 14, 2014 at 9:09 PM, Dušan Čolić<dusanc@gmail.com> wrote: >>>>>>>> As I had no time to make a full backup I went back to 3.10 kernel and >>>>>>>> had no >>>>>>>> problem since. >>>>>>>> >>>>>>>> Could this issue be connected with those firefox cache files that >>>>>>>> were >>>>>>>> bad >>>>>>>> (see other mail thread) so I deleted them but for some reason they >>>>>>>> continued >>>>>>>> making problems or problem wasn't really solved by deletion? I ask >>>>>>>> this >>>>>>>> as >>>>>>>> after long time of stable r4 I got 2 problems in same week so they're >>>>>>>> probably related. >>>>>>>> >>>>>>>> On Nov 14, 2014 8:58 PM, "Edward Shishkin" >>>>>>>> <edward.shishkin@gmail.com> >>>>>>>> wrote: >>>>>>>>> On 11/05/2014 12:04 PM, Dušan Čolić wrote: >>>>>>>>> >>>>>>>>> >>>>>>>>> On Nov 5, 2014 12:48 AM, "Edward Shishkin" >>>>>>>>> <edward.shishkin@gmail.com> >>>>>>>>> wrote: >>>>>>>>>> On 11/04/2014 02:16 PM, Dušan Čolić wrote: >>>>>>>>>>> Did a fsck of source partition. >>>>>>>>>>> Btw. why is there a reason this corruption appeared when I started >>>>>>>>>>> using 3.16.2 instead 3.10? >>>>>>>>>>> >>>>>>>>>> I would also suspect this failed mount. >>>>>>>>>> It could have fatal consequences for the system, and, in particular >>>>>>>>>> for >>>>>>>>>> your ''/". >>>>>>>>>> >>>>>>>>> Failed mount happened on the partition that I was copying >>>>>>>>> to,/mnt/backup, >>>>>>>>> and it fscked ok. >>>>>>>>> / was partition I was copying from and it had errors. >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> Hi Dušan, >>>>>>>>> >>>>>>>>> So, how is your / ? >>>>>>> So I was feeling brave so I put 3.16.2 back 4 days ago and I got this: >>>>>>> >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436017] ------------[ cut >>>>>>> here ]------------ >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436320] kernel BUG at >>>>>>> fs/reiser4/plugin/item/ctail.c:669! >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436652] invalid opcode: 0000 >>>>>>> [#1] SMP >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436899] CPU: 3 PID: 30235 >>>>>>> Comm: rsync Not tainted 3.16.5-gentoo #2 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.437275] Hardware name: >>>>>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>>>>>> 07/04/2012 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.437834] task: >>>>>>> ffff8801333d4010 ti: ffff880118218000 task.ti: ffff880118218000 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.438264] RIP: >>>>>>> 0010:[<ffffffff8115aaf4>] [<ffffffff8115aaf4>] >>>>>>> do_readpage_ctail+0x2c5/0x3c4 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.438768] RSP: >>>>>>> 0018:ffff88011821baa8 EFLAGS: 00010246 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439073] RAX: 0000000000000000 >>>>>>> RBX: ffff88011821bb78 RCX: 000000000002f35d >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439484] RDX: 000000000000002f >>>>>>> RSI: 0000000000000000 RDI: ffff8800b953b000 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439894] RBP: ffff880169d231a0 >>>>>>> R08: 0000000000000000 R09: 0000000000000000 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.440304] R10: ffffffff8114eb84 >>>>>>> R11: 0000000000012368 R12: 0000000000000002 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.440713] R13: 0000000000001000 >>>>>>> R14: ffffea00052f5158 R15: 0000000000000000 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441124] FS: >>>>>>> 00007f3d4d434700(0000) GS:ffff88022e380000(0000) >>>>>>> knlGS:0000000000000000 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441589] CS: 0010 DS: 0000 >>>>>>> ES: 0000 CR0: 0000000080050033 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441918] CR2: 0000000000980000 >>>>>>> CR3: 00000001a0c03000 CR4: 00000000001427e0 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442327] Stack: >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442443] 0000000000000000 >>>>>>> ffff88011821bb78 0000000000000000 ffff880169d231a0 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442890] 0000000000000000 >>>>>>> ffffea00052f5158 0000000000000000 ffffffff8115ad7b >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443336] 00000000000aa1a1 >>>>>>> ffff88011821bca0 ffffea00052f5158 ffff880169d232e0 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443784] Call Trace: >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443926] [<ffffffff8115ad7b>] >>>>>>> ? ctail_readpages_filler+0x188/0x1c9 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444302] [<ffffffff8115abf3>] >>>>>>> ? do_readpage_ctail+0x3c4/0x3c4 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444655] [<ffffffff810b5528>] >>>>>>> ? read_cache_pages+0x91/0xfc >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444990] [<ffffffff8115b17c>] >>>>>>> ? readpages_ctail+0x2c8/0x2e5 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.445332] [<ffffffff81151e72>] >>>>>>> ? readpages_cryptcompress+0x39/0x5f >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.445704] [<ffffffff810b56c9>] >>>>>>> ? __do_page_cache_readahead+0x136/0x1d0 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446094] [<ffffffff810b5958>] >>>>>>> ? ondemand_readahead+0x1f5/0x203 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446450] [<ffffffff810ae761>] >>>>>>> ? generic_file_read_iter+0x191/0x539 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446827] [<ffffffff810e9256>] >>>>>>> ? path_openat+0x24b/0x5ce >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447147] [<ffffffff810de1e6>] >>>>>>> ? new_sync_read+0x6b/0x8f >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447469] [<ffffffff81151f07>] >>>>>>> ? read_cryptcompress+0x6f/0x97 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447815] [<ffffffff8114d4c0>] >>>>>>> ? reiser4_read_dispatch+0xc7/0x11e >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448181] [<ffffffff810dedc9>] >>>>>>> ? vfs_read+0x84/0x13e >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448483] [<ffffffff810df25c>] >>>>>>> ? SyS_read+0x41/0x84 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448780] [<ffffffff815346d2>] >>>>>>> ? system_call_fastpath+0x16/0x1b >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.449135] Code: 01 00 00 e9 00 >>>>>>> ff ff ff 8b 43 58 41 0f b7 4d 04 48 8d 04 48 48 89 54 c3 28 e9 ea fe >>>>>>> ff ff 44 8b a3 88 00 00 00 41 83 fc 02 75 02 <0f> 0b 0f 87 87 00 00 00 >>>>>>> 41 83 fc 01 0f 85 de 00 00 00 49 8b 56 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.450567] RIP >>>>>>> [<ffffffff8115aaf4>] do_readpage_ctail+0x2c5/0x3c4 >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.450934] RSP >>>>>>> <ffff88011821baa8> >>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.562843] ---[ end trace >>>>>>> 45473ce04b35219f ]--- >>>>>>> >>>>>>> Looks like same error like last time I used 3.16. Kernel 3.10 lasted >>>>>>> with 20 days uptime without problems this month and 3.16 had this oops >>>>>>> after 3 days. >>>>>> >>>>>> Unfortunately, there is no any ideas... >>>>>> I can port reiser4-for-3.10 stuff to 3.16. Will you test this port? >>>>>> >>>>> Ofcourse! -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-12-08 11:22 ` Edward Shishkin @ 2014-12-08 11:54 ` Dušan Čolić 2014-12-08 19:27 ` Edward Shishkin [not found] ` <CADW=+3kGn9OBoHiVWT3EkmSxGn==0ZsEa1nS_dP7-oQeq5h48g@mail.gmail.com> 1 sibling, 1 reply; 33+ messages in thread From: Dušan Čolić @ 2014-12-08 11:54 UTC (permalink / raw) To: Edward Shishkin; +Cc: reiserfs-devel, Ivan Shapovalov On Mon, Dec 8, 2014 at 12:22 PM, Edward Shishkin <edward.shishkin@gmail.com> wrote: > Is .config the same as in the stuff for 3.10? > > Thanks, > Edward. > Only thing that jumps out that we haven't mentioned yet is optimize for size.... I used same config for 3.16.2.patch and for 3.16ported-from3.11.patch http://marc.info/?l=reiserfs-devel&m=141503126615043&w=2 " Last time I enabled page migration in kernel so I tried to find what's the difference between kernel config that worked and that fails: krshina3 linux-3.16.5-gentoo # diff -du ./.config configBAD |grep "+"|grep -v "#"|grep -v "@@" --- ./.config 2014-11-03 17:09:03.895249969 +0100 +++ configBAD 2014-10-24 01:27:07.677613236 +0200 +CONFIG_CGROUPS=y +CONFIG_CGROUP_SCHED=y +CONFIG_FAIR_GROUP_SCHED=y +CONFIG_SCHED_AUTOGROUP=y +CONFIG_SCHED_MC=y +CONFIG_KSM=y +CONFIG_X86_INTEL_PSTATE=y +CONFIG_EDAC=y +CONFIG_EDAC_LEGACY_SYSFS=y +CONFIG_DEBUG_INFO=y +CONFIG_DEBUG_INFO_REDUCED=y +CONFIG_FRAME_POINTER=y krshina3 linux-3.16.5-gentoo # diff -du ./.config configBAD |grep "-"|grep -v "#"|grep -v "@@" --- ./.config 2014-11-03 17:09:03.895249969 +0100 +++ configBAD 2014-10-24 01:27:07.677613236 +0200 -CONFIG_USELIB=y -CONFIG_AUDIT=y -CONFIG_AUDITSYSCALL=y -CONFIG_AUDIT_WATCH=y -CONFIG_AUDIT_TREE=y -CONFIG_CC_OPTIMIZE_FOR_SIZE=y -CONFIG_GART_IOMMU=y -CONFIG_LCD_CLASS_DEVICE=y " > > > On 12/08/2014 12:45 AM, Dušan Čolić wrote: >> >> On Sun, Dec 7, 2014 at 11:52 AM, Edward Shishkin >> <edward.shishkin@gmail.com> wrote: >>> >>> And the root partition became corrupted, or...? >>> >> Yes, just managed to fsck it now. >> >> fsck: >> >> CHECKING THE STORAGE TREE >> $ >> [==\ ] 4% >> $ >> Nodes left in the tree 3678479 >> Leaves of them 3626831, Twigs of them 50438 >> Time interval: Sun Dec 7 23:22:35 2014 - Sun Dec 7 23:25:26 >> 2014 >> CHECKING EXTENT REGIONS. >> Read twigs 50438 >> Time interval: Sun Dec 7 23:25:26 2014 - Sun Dec 7 23:25:35 >> 2014 >> CHECKING THE SEMANTIC TREE >> FSCK: >> >> /mkdeb/build/reiser4progs/reiser4progs/plugin/object/ccreg40/ccreg40_repair.c: >> 167: ccreg40_check_cluster: The file [1b529a6:134623831303736:1d80a73] >> (ccreg40): the cluster at [0] offset 65536 bytes long is orphan. >> Found 543127 objects (some could be encountered more then once). >> Time interval: Sun Dec 7 23:25:35 2014 - Sun Dec 7 23:28:50 >> 2014 >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/repair.c: 550: >> repair_sem_fini: On-disk used block bitmap and really used block bitmap >> differ. >> ***** fsck.reiser4 finished at Sun Dec 7 23:28:50 2014 >> Closing fs...done >> >> >> build-fs: >> >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4078203), items (60) and (61): Wrong order >> of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4078899), items (6) and (7): Wrong order of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4079383), items (0) and (1): Wrong order of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4079488), items (0) and (1): Wrong order of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4079546), items (0) and (1): Wrong order of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4080447), items (0) and (1): Wrong order of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4080571), items (0) and (1): Wrong order of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4081137), items (1) and (2): Wrong order of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4090871), items (0) and (1): Wrong order of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4091337), items (0) and (1): Wrong order of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4091990), items (0) and (1): Wrong order of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4092423), items (1) and (2): Wrong order of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4093016), items (0) and (1): Wrong order of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4093690), items (27) and (28): Wrong order >> of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4094525), items (0) and (1): Wrong order of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4096175), items (0) and (1): Wrong order of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4099659), items (12) and (13): Wrong order >> of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4099663), items (21) and (22): Wrong order >> of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4113492), items (0) and (1): Wrong order of >> keys. >> >>> Thanks, >>> Edward. >>> >>> >>> >>> On 12/07/2014 09:07 AM, Dušan Čolić wrote: >>>> >>>> And on the 4th day: >>>> >>>> ### RSNAPSHOT DAILY ### >>>> fsck.reiser4 /dev/md125 >>>> mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory >>>> Backup failure >>>> umount: /mnt/backup: not mounted >>>> >>>> >>>> krshina3 ~ # cat /proc/meminfo >>>> MemTotal: 7867900 kB >>>> MemFree: 1553044 kB >>>> MemAvailable: 4853752 kB >>>> Buffers: 0 kB >>>> Cached: 2975880 kB >>>> SwapCached: 4944 kB >>>> Active: 3780968 kB >>>> Inactive: 2003640 kB >>>> Active(anon): 2336740 kB >>>> Inactive(anon): 498120 kB >>>> Active(file): 1444228 kB >>>> Inactive(file): 1505520 kB >>>> Unevictable: 0 kB >>>> Mlocked: 0 kB >>>> SwapTotal: 594300 kB >>>> SwapFree: 180008 kB >>>> Dirty: 3064 kB >>>> Writeback: 0 kB >>>> AnonPages: 2804424 kB >>>> Mapped: 180772 kB >>>> Shmem: 26132 kB >>>> Slab: 427632 kB >>>> SReclaimable: 392984 kB >>>> SUnreclaim: 34648 kB >>>> KernelStack: 7536 kB >>>> PageTables: 38328 kB >>>> NFS_Unstable: 0 kB >>>> Bounce: 0 kB >>>> WritebackTmp: 0 kB >>>> CommitLimit: 4528248 kB >>>> Committed_AS: 5352472 kB >>>> VmallocTotal: 34359738367 kB >>>> VmallocUsed: 352244 kB >>>> VmallocChunk: 34359293283 kB >>>> HugePages_Total: 0 >>>> HugePages_Free: 0 >>>> HugePages_Rsvd: 0 >>>> HugePages_Surp: 0 >>>> Hugepagesize: 2048 kB >>>> DirectMap4k: 12224 kB >>>> DirectMap2M: 8056832 kB >>>> >>>> >>>> Dec 7 03:30:01 krshina3 kernel: [281555.958316] reiser4: md125: found >>>> disk format 4.0.0. >>>> Dec 7 03:30:01 krshina3 kernel: [281555.958998] mount: page >>>> allocation failure: order:4, mode:0x2040d0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959000] CPU: 2 PID: 7078 >>>> Comm: mount Not tainted 3.16.5-gentoo #1 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959001] Hardware name: >>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>>> 07/04/2012 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959003] 0000000000000006 >>>> ffffffff8152bdfb 0000000000000001 ffffffff810b0bc3 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959005] ffffffff81818df8 >>>> 0000000000000000 00000002fffffff0 0000000000000010 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959006] ffff8801007b27a0 >>>> 0000000000000000 0000000000000010 0000204081818240 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959008] Call Trace: >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959011] [<ffffffff8152bdfb>] >>>> ? dump_stack+0x41/0x51 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959014] [<ffffffff810b0bc3>] >>>> ? warn_alloc_failed+0x10c/0x120 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959016] [<ffffffff810b2b66>] >>>> ? __alloc_pages_nodemask+0x581/0x69d >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959019] [<ffffffff810db5f4>] >>>> ? cache_alloc_refill+0x261/0x48c >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959022] [<ffffffff8113eefd>] >>>> ? reiser4_mount+0xc/0xc >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959024] [<ffffffff810db35f>] >>>> ? kmem_cache_alloc+0x6d/0xa1 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959026] [<ffffffff8112bf58>] >>>> ? znodes_tree_init+0xb9/0xe6 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959028] [<ffffffff811323ee>] >>>> ? reiser4_init_tree+0x3f/0xb2 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959031] [<ffffffff8115fb05>] >>>> ? init_format_format40+0x357/0x4e4 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959033] [<ffffffff81080f74>] >>>> ? wake_up_bit+0xc/0x1b >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959035] [<ffffffff8113efc8>] >>>> ? fill_super+0xcb/0x1ad >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959037] [<ffffffff810e142e>] >>>> ? mount_bdev+0x133/0x186 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959039] [<ffffffff810e15ed>] >>>> ? mount_fs+0xc/0x9e >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959041] [<ffffffff810f55f2>] >>>> ? vfs_kern_mount+0x5e/0xef >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959042] [<ffffffff810f71c1>] >>>> ? do_mount+0x80b/0x904 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959044] [<ffffffff810f74d5>] >>>> ? SyS_mount+0x7e/0xb7 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959046] [<ffffffff81533612>] >>>> ? system_call_fastpath+0x16/0x1b >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959047] Mem-Info: >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959048] DMA per-cpu: >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959049] CPU 0: hi: 0, >>>> btch: 1 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959050] CPU 1: hi: 0, >>>> btch: 1 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959051] CPU 2: hi: 0, >>>> btch: 1 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959052] CPU 3: hi: 0, >>>> btch: 1 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959052] DMA32 per-cpu: >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959053] CPU 0: hi: 186, >>>> btch: 31 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959054] CPU 1: hi: 186, >>>> btch: 31 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959055] CPU 2: hi: 186, >>>> btch: 31 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959056] CPU 3: hi: 186, >>>> btch: 31 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959057] Normal per-cpu: >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959057] CPU 0: hi: 186, >>>> btch: 31 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959058] CPU 1: hi: 186, >>>> btch: 31 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959059] CPU 2: hi: 186, >>>> btch: 31 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959060] CPU 3: hi: 186, >>>> btch: 31 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] active_anon:593069 >>>> inactive_anon:120226 isolated_anon:0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] active_file:503137 >>>> inactive_file:503029 isolated_file:0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] unevictable:0 >>>> dirty:333 writeback:0 unstable:0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] free:104532 >>>> slab_reclaimable:109978 slab_unreclaimable:8402 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] mapped:51579 >>>> shmem:5928 pagetables:9488 bounce:0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] free_cma:0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959068] DMA free:15900kB >>>> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >>>> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >>>> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >>>> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >>>> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >>>> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>> all_unreclaimable? yes >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959069] lowmem_reserve[]: 0 >>>> 2952 7667 7667 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959074] DMA32 free:168028kB >>>> min:4308kB low:5384kB high:6460kB active_anon:837216kB >>>> inactive_anon:214776kB active_file:790440kB inactive_file:790440kB >>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>> present:3098560kB managed:3023876kB mlocked:0kB dirty:316kB >>>> writeback:0kB mapped:78860kB shmem:8760kB slab_reclaimable:171284kB >>>> slab_unreclaimable:11888kB kernel_stack:2240kB pagetables:16348kB >>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>> all_unreclaimable? no >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959075] lowmem_reserve[]: 0 0 >>>> 4714 4714 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959079] Normal free:234200kB >>>> min:6880kB low:8600kB high:10320kB active_anon:1535060kB >>>> inactive_anon:266128kB active_file:1222108kB inactive_file:1221676kB >>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>> present:4954112kB managed:4828124kB mlocked:0kB dirty:1016kB >>>> writeback:0kB mapped:127456kB shmem:14952kB slab_reclaimable:268628kB >>>> slab_unreclaimable:21720kB kernel_stack:4976kB pagetables:21604kB >>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>> all_unreclaimable? no >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959080] lowmem_reserve[]: 0 0 0 >>>> 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959081] DMA: 1*4kB (U) 1*8kB >>>> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >>>> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959088] DMA32: 36545*4kB >>>> (UEM) 2543*8kB (UEM) 70*16kB (UMR) 0*32kB 0*64kB 1*128kB (R) 0*256kB >>>> 1*512kB (R) 0*1024kB 0*2048kB 0*4096kB = 168284kB >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959093] Normal: 50408*4kB >>>> (UEM) 3913*8kB (UEM) 36*16kB (UMR) 0*32kB 1*64kB (R) 1*128kB (R) >>>> 1*256kB (R) 1*512kB (R) 0*1024kB 0*2048kB 0*4096kB = 234472kB >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959099] Node 0 >>>> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >>>> hugepages_size=2048kB >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959100] 1013453 total pagecache >>>> pages >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959101] 1228 pages in swap >>>> cache >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959102] Swap cache stats: add >>>> 133257, delete 132029, find 57308/68141 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959103] Free swap = 184632kB >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959103] Total swap = 594300kB >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959104] 2017164 pages RAM >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959105] 0 pages >>>> HighMem/MovableOnly >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959106] 31497 pages reserved >>>> >>>> On Wed, Dec 3, 2014 at 9:16 PM, Dušan Čolić<dusanc@gmail.com> wrote: >>>>> >>>>> On Mon, Dec 1, 2014 at 12:58 AM, Edward Shishkin >>>>> <edward.shishkin@gmail.com> wrote: >>>>>> >>>>>> On 12/01/2014 12:53 AM, Dušan Čolić wrote: >>>>>> >>>>>> >>>>>> On Dec 1, 2014 12:47 AM, "Edward Shishkin"<edward.shishkin@gmail.com> >>>>>> wrote: >>>>>>> >>>>>>> On 12/01/2014 12:04 AM, Dušan Čolić wrote: >>>>>>>> >>>>>>>> On Fri, Nov 14, 2014 at 9:09 PM, Dušan Čolić<dusanc@gmail.com> >>>>>>>> wrote: >>>>>>>>> >>>>>>>>> As I had no time to make a full backup I went back to 3.10 kernel >>>>>>>>> and >>>>>>>>> had no >>>>>>>>> problem since. >>>>>>>>> >>>>>>>>> Could this issue be connected with those firefox cache files that >>>>>>>>> were >>>>>>>>> bad >>>>>>>>> (see other mail thread) so I deleted them but for some reason they >>>>>>>>> continued >>>>>>>>> making problems or problem wasn't really solved by deletion? I ask >>>>>>>>> this >>>>>>>>> as >>>>>>>>> after long time of stable r4 I got 2 problems in same week so >>>>>>>>> they're >>>>>>>>> probably related. >>>>>>>>> >>>>>>>>> On Nov 14, 2014 8:58 PM, "Edward Shishkin" >>>>>>>>> <edward.shishkin@gmail.com> >>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>> On 11/05/2014 12:04 PM, Dušan Čolić wrote: >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Nov 5, 2014 12:48 AM, "Edward Shishkin" >>>>>>>>>> <edward.shishkin@gmail.com> >>>>>>>>>> wrote: >>>>>>>>>>> >>>>>>>>>>> On 11/04/2014 02:16 PM, Dušan Čolić wrote: >>>>>>>>>>>> >>>>>>>>>>>> Did a fsck of source partition. >>>>>>>>>>>> Btw. why is there a reason this corruption appeared when I >>>>>>>>>>>> started >>>>>>>>>>>> using 3.16.2 instead 3.10? >>>>>>>>>>>> >>>>>>>>>>> I would also suspect this failed mount. >>>>>>>>>>> It could have fatal consequences for the system, and, in >>>>>>>>>>> particular >>>>>>>>>>> for >>>>>>>>>>> your ''/". >>>>>>>>>>> >>>>>>>>>> Failed mount happened on the partition that I was copying >>>>>>>>>> to,/mnt/backup, >>>>>>>>>> and it fscked ok. >>>>>>>>>> / was partition I was copying from and it had errors. >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> Hi Dušan, >>>>>>>>>> >>>>>>>>>> So, how is your / ? >>>>>>>> >>>>>>>> So I was feeling brave so I put 3.16.2 back 4 days ago and I got >>>>>>>> this: >>>>>>>> >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436017] ------------[ cut >>>>>>>> here ]------------ >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436320] kernel BUG at >>>>>>>> fs/reiser4/plugin/item/ctail.c:669! >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436652] invalid opcode: >>>>>>>> 0000 >>>>>>>> [#1] SMP >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436899] CPU: 3 PID: 30235 >>>>>>>> Comm: rsync Not tainted 3.16.5-gentoo #2 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.437275] Hardware name: >>>>>>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS >>>>>>>> F5 >>>>>>>> 07/04/2012 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.437834] task: >>>>>>>> ffff8801333d4010 ti: ffff880118218000 task.ti: ffff880118218000 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.438264] RIP: >>>>>>>> 0010:[<ffffffff8115aaf4>] [<ffffffff8115aaf4>] >>>>>>>> do_readpage_ctail+0x2c5/0x3c4 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.438768] RSP: >>>>>>>> 0018:ffff88011821baa8 EFLAGS: 00010246 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439073] RAX: >>>>>>>> 0000000000000000 >>>>>>>> RBX: ffff88011821bb78 RCX: 000000000002f35d >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439484] RDX: >>>>>>>> 000000000000002f >>>>>>>> RSI: 0000000000000000 RDI: ffff8800b953b000 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439894] RBP: >>>>>>>> ffff880169d231a0 >>>>>>>> R08: 0000000000000000 R09: 0000000000000000 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.440304] R10: >>>>>>>> ffffffff8114eb84 >>>>>>>> R11: 0000000000012368 R12: 0000000000000002 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.440713] R13: >>>>>>>> 0000000000001000 >>>>>>>> R14: ffffea00052f5158 R15: 0000000000000000 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441124] FS: >>>>>>>> 00007f3d4d434700(0000) GS:ffff88022e380000(0000) >>>>>>>> knlGS:0000000000000000 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441589] CS: 0010 DS: 0000 >>>>>>>> ES: 0000 CR0: 0000000080050033 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441918] CR2: >>>>>>>> 0000000000980000 >>>>>>>> CR3: 00000001a0c03000 CR4: 00000000001427e0 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442327] Stack: >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442443] 0000000000000000 >>>>>>>> ffff88011821bb78 0000000000000000 ffff880169d231a0 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442890] 0000000000000000 >>>>>>>> ffffea00052f5158 0000000000000000 ffffffff8115ad7b >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443336] 00000000000aa1a1 >>>>>>>> ffff88011821bca0 ffffea00052f5158 ffff880169d232e0 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443784] Call Trace: >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443926] >>>>>>>> [<ffffffff8115ad7b>] >>>>>>>> ? ctail_readpages_filler+0x188/0x1c9 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444302] >>>>>>>> [<ffffffff8115abf3>] >>>>>>>> ? do_readpage_ctail+0x3c4/0x3c4 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444655] >>>>>>>> [<ffffffff810b5528>] >>>>>>>> ? read_cache_pages+0x91/0xfc >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444990] >>>>>>>> [<ffffffff8115b17c>] >>>>>>>> ? readpages_ctail+0x2c8/0x2e5 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.445332] >>>>>>>> [<ffffffff81151e72>] >>>>>>>> ? readpages_cryptcompress+0x39/0x5f >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.445704] >>>>>>>> [<ffffffff810b56c9>] >>>>>>>> ? __do_page_cache_readahead+0x136/0x1d0 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446094] >>>>>>>> [<ffffffff810b5958>] >>>>>>>> ? ondemand_readahead+0x1f5/0x203 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446450] >>>>>>>> [<ffffffff810ae761>] >>>>>>>> ? generic_file_read_iter+0x191/0x539 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446827] >>>>>>>> [<ffffffff810e9256>] >>>>>>>> ? path_openat+0x24b/0x5ce >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447147] >>>>>>>> [<ffffffff810de1e6>] >>>>>>>> ? new_sync_read+0x6b/0x8f >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447469] >>>>>>>> [<ffffffff81151f07>] >>>>>>>> ? read_cryptcompress+0x6f/0x97 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447815] >>>>>>>> [<ffffffff8114d4c0>] >>>>>>>> ? reiser4_read_dispatch+0xc7/0x11e >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448181] >>>>>>>> [<ffffffff810dedc9>] >>>>>>>> ? vfs_read+0x84/0x13e >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448483] >>>>>>>> [<ffffffff810df25c>] >>>>>>>> ? SyS_read+0x41/0x84 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448780] >>>>>>>> [<ffffffff815346d2>] >>>>>>>> ? system_call_fastpath+0x16/0x1b >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.449135] Code: 01 00 00 e9 >>>>>>>> 00 >>>>>>>> ff ff ff 8b 43 58 41 0f b7 4d 04 48 8d 04 48 48 89 54 c3 28 e9 ea fe >>>>>>>> ff ff 44 8b a3 88 00 00 00 41 83 fc 02 75 02 <0f> 0b 0f 87 87 00 00 >>>>>>>> 00 >>>>>>>> 41 83 fc 01 0f 85 de 00 00 00 49 8b 56 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.450567] RIP >>>>>>>> [<ffffffff8115aaf4>] do_readpage_ctail+0x2c5/0x3c4 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.450934] RSP >>>>>>>> <ffff88011821baa8> >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.562843] ---[ end trace >>>>>>>> 45473ce04b35219f ]--- >>>>>>>> >>>>>>>> Looks like same error like last time I used 3.16. Kernel 3.10 lasted >>>>>>>> with 20 days uptime without problems this month and 3.16 had this >>>>>>>> oops >>>>>>>> after 3 days. >>>>>>> >>>>>>> >>>>>>> Unfortunately, there is no any ideas... >>>>>>> I can port reiser4-for-3.10 stuff to 3.16. Will you test this port? >>>>>>> >>>>>> Ofcourse! > > -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-12-08 11:54 ` Dušan Čolić @ 2014-12-08 19:27 ` Edward Shishkin 2014-12-16 13:03 ` Dušan Čolić 0 siblings, 1 reply; 33+ messages in thread From: Edward Shishkin @ 2014-12-08 19:27 UTC (permalink / raw) To: Dušan Čolić; +Cc: reiserfs-devel, Ivan Shapovalov So in 3.16 when we ask for some memory, we get ENOMEM plus a corrupted root partition.. I would also check the stuff for 3.17 before doing anything. Thanks, Edward. On 12/08/2014 12:54 PM, Dušan Čolić wrote: > On Mon, Dec 8, 2014 at 12:22 PM, Edward Shishkin > <edward.shishkin@gmail.com> wrote: >> Is .config the same as in the stuff for 3.10? >> >> Thanks, >> Edward. >> > Only thing that jumps out that we haven't mentioned yet is optimize for size.... > I used same config for 3.16.2.patch and for 3.16ported-from3.11.patch > > http://marc.info/?l=reiserfs-devel&m=141503126615043&w=2 > > " > > Last time I enabled page migration in kernel so I tried to find what's > the difference between kernel config that worked and that fails: > > krshina3 linux-3.16.5-gentoo # diff -du ./.config configBAD |grep > "+"|grep -v "#"|grep -v "@@" > --- ./.config 2014-11-03 17:09:03.895249969 +0100 > +++ configBAD 2014-10-24 01:27:07.677613236 +0200 > +CONFIG_CGROUPS=y > +CONFIG_CGROUP_SCHED=y > +CONFIG_FAIR_GROUP_SCHED=y > +CONFIG_SCHED_AUTOGROUP=y > +CONFIG_SCHED_MC=y > +CONFIG_KSM=y > +CONFIG_X86_INTEL_PSTATE=y > +CONFIG_EDAC=y > +CONFIG_EDAC_LEGACY_SYSFS=y > +CONFIG_DEBUG_INFO=y > +CONFIG_DEBUG_INFO_REDUCED=y > +CONFIG_FRAME_POINTER=y > > > krshina3 linux-3.16.5-gentoo # diff -du ./.config configBAD |grep > "-"|grep -v "#"|grep -v "@@" > --- ./.config 2014-11-03 17:09:03.895249969 +0100 > +++ configBAD 2014-10-24 01:27:07.677613236 +0200 > -CONFIG_USELIB=y > -CONFIG_AUDIT=y > -CONFIG_AUDITSYSCALL=y > -CONFIG_AUDIT_WATCH=y > -CONFIG_AUDIT_TREE=y > -CONFIG_CC_OPTIMIZE_FOR_SIZE=y > -CONFIG_GART_IOMMU=y > -CONFIG_LCD_CLASS_DEVICE=y > " > > >> >> On 12/08/2014 12:45 AM, Dušan Čolić wrote: >>> On Sun, Dec 7, 2014 at 11:52 AM, Edward Shishkin >>> <edward.shishkin@gmail.com> wrote: >>>> And the root partition became corrupted, or...? >>>> >>> Yes, just managed to fsck it now. >>> >>> fsck: >>> >>> CHECKING THE STORAGE TREE >>> $ >>> [==\ ] 4% >>> $ >>> Nodes left in the tree 3678479 >>> Leaves of them 3626831, Twigs of them 50438 >>> Time interval: Sun Dec 7 23:22:35 2014 - Sun Dec 7 23:25:26 >>> 2014 >>> CHECKING EXTENT REGIONS. >>> Read twigs 50438 >>> Time interval: Sun Dec 7 23:25:26 2014 - Sun Dec 7 23:25:35 >>> 2014 >>> CHECKING THE SEMANTIC TREE >>> FSCK: >>> >>> /mkdeb/build/reiser4progs/reiser4progs/plugin/object/ccreg40/ccreg40_repair.c: >>> 167: ccreg40_check_cluster: The file [1b529a6:134623831303736:1d80a73] >>> (ccreg40): the cluster at [0] offset 65536 bytes long is orphan. >>> Found 543127 objects (some could be encountered more then once). >>> Time interval: Sun Dec 7 23:25:35 2014 - Sun Dec 7 23:28:50 >>> 2014 >>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/repair.c: 550: >>> repair_sem_fini: On-disk used block bitmap and really used block bitmap >>> differ. >>> ***** fsck.reiser4 finished at Sun Dec 7 23:28:50 2014 >>> Closing fs...done >>> >>> >>> build-fs: >>> >>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>> repair_node_items_check: Node (4078203), items (60) and (61): Wrong order >>> of >>> keys. >>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>> repair_node_items_check: Node (4078899), items (6) and (7): Wrong order of >>> keys. >>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>> repair_node_items_check: Node (4079383), items (0) and (1): Wrong order of >>> keys. >>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>> repair_node_items_check: Node (4079488), items (0) and (1): Wrong order of >>> keys. >>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>> repair_node_items_check: Node (4079546), items (0) and (1): Wrong order of >>> keys. >>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>> repair_node_items_check: Node (4080447), items (0) and (1): Wrong order of >>> keys. >>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>> repair_node_items_check: Node (4080571), items (0) and (1): Wrong order of >>> keys. >>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>> repair_node_items_check: Node (4081137), items (1) and (2): Wrong order of >>> keys. >>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>> repair_node_items_check: Node (4090871), items (0) and (1): Wrong order of >>> keys. >>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>> repair_node_items_check: Node (4091337), items (0) and (1): Wrong order of >>> keys. >>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>> repair_node_items_check: Node (4091990), items (0) and (1): Wrong order of >>> keys. >>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>> repair_node_items_check: Node (4092423), items (1) and (2): Wrong order of >>> keys. >>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>> repair_node_items_check: Node (4093016), items (0) and (1): Wrong order of >>> keys. >>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>> repair_node_items_check: Node (4093690), items (27) and (28): Wrong order >>> of >>> keys. >>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>> repair_node_items_check: Node (4094525), items (0) and (1): Wrong order of >>> keys. >>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>> repair_node_items_check: Node (4096175), items (0) and (1): Wrong order of >>> keys. >>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>> repair_node_items_check: Node (4099659), items (12) and (13): Wrong order >>> of >>> keys. >>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>> repair_node_items_check: Node (4099663), items (21) and (22): Wrong order >>> of >>> keys. >>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>> repair_node_items_check: Node (4113492), items (0) and (1): Wrong order of >>> keys. >>> >>>> Thanks, >>>> Edward. >>>> >>>> >>>> >>>> On 12/07/2014 09:07 AM, Dušan Čolić wrote: >>>>> And on the 4th day: >>>>> >>>>> ### RSNAPSHOT DAILY ### >>>>> fsck.reiser4 /dev/md125 >>>>> mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory >>>>> Backup failure >>>>> umount: /mnt/backup: not mounted >>>>> >>>>> >>>>> krshina3 ~ # cat /proc/meminfo >>>>> MemTotal: 7867900 kB >>>>> MemFree: 1553044 kB >>>>> MemAvailable: 4853752 kB >>>>> Buffers: 0 kB >>>>> Cached: 2975880 kB >>>>> SwapCached: 4944 kB >>>>> Active: 3780968 kB >>>>> Inactive: 2003640 kB >>>>> Active(anon): 2336740 kB >>>>> Inactive(anon): 498120 kB >>>>> Active(file): 1444228 kB >>>>> Inactive(file): 1505520 kB >>>>> Unevictable: 0 kB >>>>> Mlocked: 0 kB >>>>> SwapTotal: 594300 kB >>>>> SwapFree: 180008 kB >>>>> Dirty: 3064 kB >>>>> Writeback: 0 kB >>>>> AnonPages: 2804424 kB >>>>> Mapped: 180772 kB >>>>> Shmem: 26132 kB >>>>> Slab: 427632 kB >>>>> SReclaimable: 392984 kB >>>>> SUnreclaim: 34648 kB >>>>> KernelStack: 7536 kB >>>>> PageTables: 38328 kB >>>>> NFS_Unstable: 0 kB >>>>> Bounce: 0 kB >>>>> WritebackTmp: 0 kB >>>>> CommitLimit: 4528248 kB >>>>> Committed_AS: 5352472 kB >>>>> VmallocTotal: 34359738367 kB >>>>> VmallocUsed: 352244 kB >>>>> VmallocChunk: 34359293283 kB >>>>> HugePages_Total: 0 >>>>> HugePages_Free: 0 >>>>> HugePages_Rsvd: 0 >>>>> HugePages_Surp: 0 >>>>> Hugepagesize: 2048 kB >>>>> DirectMap4k: 12224 kB >>>>> DirectMap2M: 8056832 kB >>>>> >>>>> >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.958316] reiser4: md125: found >>>>> disk format 4.0.0. >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.958998] mount: page >>>>> allocation failure: order:4, mode:0x2040d0 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959000] CPU: 2 PID: 7078 >>>>> Comm: mount Not tainted 3.16.5-gentoo #1 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959001] Hardware name: >>>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>>>> 07/04/2012 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959003] 0000000000000006 >>>>> ffffffff8152bdfb 0000000000000001 ffffffff810b0bc3 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959005] ffffffff81818df8 >>>>> 0000000000000000 00000002fffffff0 0000000000000010 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959006] ffff8801007b27a0 >>>>> 0000000000000000 0000000000000010 0000204081818240 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959008] Call Trace: >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959011] [<ffffffff8152bdfb>] >>>>> ? dump_stack+0x41/0x51 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959014] [<ffffffff810b0bc3>] >>>>> ? warn_alloc_failed+0x10c/0x120 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959016] [<ffffffff810b2b66>] >>>>> ? __alloc_pages_nodemask+0x581/0x69d >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959019] [<ffffffff810db5f4>] >>>>> ? cache_alloc_refill+0x261/0x48c >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959022] [<ffffffff8113eefd>] >>>>> ? reiser4_mount+0xc/0xc >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959024] [<ffffffff810db35f>] >>>>> ? kmem_cache_alloc+0x6d/0xa1 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959026] [<ffffffff8112bf58>] >>>>> ? znodes_tree_init+0xb9/0xe6 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959028] [<ffffffff811323ee>] >>>>> ? reiser4_init_tree+0x3f/0xb2 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959031] [<ffffffff8115fb05>] >>>>> ? init_format_format40+0x357/0x4e4 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959033] [<ffffffff81080f74>] >>>>> ? wake_up_bit+0xc/0x1b >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959035] [<ffffffff8113efc8>] >>>>> ? fill_super+0xcb/0x1ad >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959037] [<ffffffff810e142e>] >>>>> ? mount_bdev+0x133/0x186 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959039] [<ffffffff810e15ed>] >>>>> ? mount_fs+0xc/0x9e >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959041] [<ffffffff810f55f2>] >>>>> ? vfs_kern_mount+0x5e/0xef >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959042] [<ffffffff810f71c1>] >>>>> ? do_mount+0x80b/0x904 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959044] [<ffffffff810f74d5>] >>>>> ? SyS_mount+0x7e/0xb7 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959046] [<ffffffff81533612>] >>>>> ? system_call_fastpath+0x16/0x1b >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959047] Mem-Info: >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959048] DMA per-cpu: >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959049] CPU 0: hi: 0, >>>>> btch: 1 usd: 0 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959050] CPU 1: hi: 0, >>>>> btch: 1 usd: 0 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959051] CPU 2: hi: 0, >>>>> btch: 1 usd: 0 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959052] CPU 3: hi: 0, >>>>> btch: 1 usd: 0 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959052] DMA32 per-cpu: >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959053] CPU 0: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959054] CPU 1: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959055] CPU 2: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959056] CPU 3: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959057] Normal per-cpu: >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959057] CPU 0: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959058] CPU 1: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959059] CPU 2: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959060] CPU 3: hi: 186, >>>>> btch: 31 usd: 0 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] active_anon:593069 >>>>> inactive_anon:120226 isolated_anon:0 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] active_file:503137 >>>>> inactive_file:503029 isolated_file:0 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] unevictable:0 >>>>> dirty:333 writeback:0 unstable:0 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] free:104532 >>>>> slab_reclaimable:109978 slab_unreclaimable:8402 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] mapped:51579 >>>>> shmem:5928 pagetables:9488 bounce:0 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] free_cma:0 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959068] DMA free:15900kB >>>>> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >>>>> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >>>>> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >>>>> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >>>>> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >>>>> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>>> all_unreclaimable? yes >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959069] lowmem_reserve[]: 0 >>>>> 2952 7667 7667 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959074] DMA32 free:168028kB >>>>> min:4308kB low:5384kB high:6460kB active_anon:837216kB >>>>> inactive_anon:214776kB active_file:790440kB inactive_file:790440kB >>>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>>> present:3098560kB managed:3023876kB mlocked:0kB dirty:316kB >>>>> writeback:0kB mapped:78860kB shmem:8760kB slab_reclaimable:171284kB >>>>> slab_unreclaimable:11888kB kernel_stack:2240kB pagetables:16348kB >>>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>>> all_unreclaimable? no >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959075] lowmem_reserve[]: 0 0 >>>>> 4714 4714 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959079] Normal free:234200kB >>>>> min:6880kB low:8600kB high:10320kB active_anon:1535060kB >>>>> inactive_anon:266128kB active_file:1222108kB inactive_file:1221676kB >>>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>>> present:4954112kB managed:4828124kB mlocked:0kB dirty:1016kB >>>>> writeback:0kB mapped:127456kB shmem:14952kB slab_reclaimable:268628kB >>>>> slab_unreclaimable:21720kB kernel_stack:4976kB pagetables:21604kB >>>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>>> all_unreclaimable? no >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959080] lowmem_reserve[]: 0 0 0 >>>>> 0 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959081] DMA: 1*4kB (U) 1*8kB >>>>> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >>>>> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959088] DMA32: 36545*4kB >>>>> (UEM) 2543*8kB (UEM) 70*16kB (UMR) 0*32kB 0*64kB 1*128kB (R) 0*256kB >>>>> 1*512kB (R) 0*1024kB 0*2048kB 0*4096kB = 168284kB >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959093] Normal: 50408*4kB >>>>> (UEM) 3913*8kB (UEM) 36*16kB (UMR) 0*32kB 1*64kB (R) 1*128kB (R) >>>>> 1*256kB (R) 1*512kB (R) 0*1024kB 0*2048kB 0*4096kB = 234472kB >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959099] Node 0 >>>>> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >>>>> hugepages_size=2048kB >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959100] 1013453 total pagecache >>>>> pages >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959101] 1228 pages in swap >>>>> cache >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959102] Swap cache stats: add >>>>> 133257, delete 132029, find 57308/68141 >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959103] Free swap = 184632kB >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959103] Total swap = 594300kB >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959104] 2017164 pages RAM >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959105] 0 pages >>>>> HighMem/MovableOnly >>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959106] 31497 pages reserved >>>>> >>>>> On Wed, Dec 3, 2014 at 9:16 PM, Dušan Čolić<dusanc@gmail.com> wrote: >>>>>> On Mon, Dec 1, 2014 at 12:58 AM, Edward Shishkin >>>>>> <edward.shishkin@gmail.com> wrote: >>>>>>> On 12/01/2014 12:53 AM, Dušan Čolić wrote: >>>>>>> >>>>>>> >>>>>>> On Dec 1, 2014 12:47 AM, "Edward Shishkin"<edward.shishkin@gmail.com> >>>>>>> wrote: >>>>>>>> On 12/01/2014 12:04 AM, Dušan Čolić wrote: >>>>>>>>> On Fri, Nov 14, 2014 at 9:09 PM, Dušan Čolić<dusanc@gmail.com> >>>>>>>>> wrote: >>>>>>>>>> As I had no time to make a full backup I went back to 3.10 kernel >>>>>>>>>> and >>>>>>>>>> had no >>>>>>>>>> problem since. >>>>>>>>>> >>>>>>>>>> Could this issue be connected with those firefox cache files that >>>>>>>>>> were >>>>>>>>>> bad >>>>>>>>>> (see other mail thread) so I deleted them but for some reason they >>>>>>>>>> continued >>>>>>>>>> making problems or problem wasn't really solved by deletion? I ask >>>>>>>>>> this >>>>>>>>>> as >>>>>>>>>> after long time of stable r4 I got 2 problems in same week so >>>>>>>>>> they're >>>>>>>>>> probably related. >>>>>>>>>> >>>>>>>>>> On Nov 14, 2014 8:58 PM, "Edward Shishkin" >>>>>>>>>> <edward.shishkin@gmail.com> >>>>>>>>>> wrote: >>>>>>>>>>> On 11/05/2014 12:04 PM, Dušan Čolić wrote: >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Nov 5, 2014 12:48 AM, "Edward Shishkin" >>>>>>>>>>> <edward.shishkin@gmail.com> >>>>>>>>>>> wrote: >>>>>>>>>>>> On 11/04/2014 02:16 PM, Dušan Čolić wrote: >>>>>>>>>>>>> Did a fsck of source partition. >>>>>>>>>>>>> Btw. why is there a reason this corruption appeared when I >>>>>>>>>>>>> started >>>>>>>>>>>>> using 3.16.2 instead 3.10? >>>>>>>>>>>>> >>>>>>>>>>>> I would also suspect this failed mount. >>>>>>>>>>>> It could have fatal consequences for the system, and, in >>>>>>>>>>>> particular >>>>>>>>>>>> for >>>>>>>>>>>> your ''/". >>>>>>>>>>>> >>>>>>>>>>> Failed mount happened on the partition that I was copying >>>>>>>>>>> to,/mnt/backup, >>>>>>>>>>> and it fscked ok. >>>>>>>>>>> / was partition I was copying from and it had errors. >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> Hi Dušan, >>>>>>>>>>> >>>>>>>>>>> So, how is your / ? >>>>>>>>> So I was feeling brave so I put 3.16.2 back 4 days ago and I got >>>>>>>>> this: >>>>>>>>> >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436017] ------------[ cut >>>>>>>>> here ]------------ >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436320] kernel BUG at >>>>>>>>> fs/reiser4/plugin/item/ctail.c:669! >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436652] invalid opcode: >>>>>>>>> 0000 >>>>>>>>> [#1] SMP >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436899] CPU: 3 PID: 30235 >>>>>>>>> Comm: rsync Not tainted 3.16.5-gentoo #2 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.437275] Hardware name: >>>>>>>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS >>>>>>>>> F5 >>>>>>>>> 07/04/2012 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.437834] task: >>>>>>>>> ffff8801333d4010 ti: ffff880118218000 task.ti: ffff880118218000 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.438264] RIP: >>>>>>>>> 0010:[<ffffffff8115aaf4>] [<ffffffff8115aaf4>] >>>>>>>>> do_readpage_ctail+0x2c5/0x3c4 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.438768] RSP: >>>>>>>>> 0018:ffff88011821baa8 EFLAGS: 00010246 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439073] RAX: >>>>>>>>> 0000000000000000 >>>>>>>>> RBX: ffff88011821bb78 RCX: 000000000002f35d >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439484] RDX: >>>>>>>>> 000000000000002f >>>>>>>>> RSI: 0000000000000000 RDI: ffff8800b953b000 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439894] RBP: >>>>>>>>> ffff880169d231a0 >>>>>>>>> R08: 0000000000000000 R09: 0000000000000000 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.440304] R10: >>>>>>>>> ffffffff8114eb84 >>>>>>>>> R11: 0000000000012368 R12: 0000000000000002 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.440713] R13: >>>>>>>>> 0000000000001000 >>>>>>>>> R14: ffffea00052f5158 R15: 0000000000000000 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441124] FS: >>>>>>>>> 00007f3d4d434700(0000) GS:ffff88022e380000(0000) >>>>>>>>> knlGS:0000000000000000 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441589] CS: 0010 DS: 0000 >>>>>>>>> ES: 0000 CR0: 0000000080050033 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441918] CR2: >>>>>>>>> 0000000000980000 >>>>>>>>> CR3: 00000001a0c03000 CR4: 00000000001427e0 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442327] Stack: >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442443] 0000000000000000 >>>>>>>>> ffff88011821bb78 0000000000000000 ffff880169d231a0 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442890] 0000000000000000 >>>>>>>>> ffffea00052f5158 0000000000000000 ffffffff8115ad7b >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443336] 00000000000aa1a1 >>>>>>>>> ffff88011821bca0 ffffea00052f5158 ffff880169d232e0 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443784] Call Trace: >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443926] >>>>>>>>> [<ffffffff8115ad7b>] >>>>>>>>> ? ctail_readpages_filler+0x188/0x1c9 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444302] >>>>>>>>> [<ffffffff8115abf3>] >>>>>>>>> ? do_readpage_ctail+0x3c4/0x3c4 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444655] >>>>>>>>> [<ffffffff810b5528>] >>>>>>>>> ? read_cache_pages+0x91/0xfc >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444990] >>>>>>>>> [<ffffffff8115b17c>] >>>>>>>>> ? readpages_ctail+0x2c8/0x2e5 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.445332] >>>>>>>>> [<ffffffff81151e72>] >>>>>>>>> ? readpages_cryptcompress+0x39/0x5f >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.445704] >>>>>>>>> [<ffffffff810b56c9>] >>>>>>>>> ? __do_page_cache_readahead+0x136/0x1d0 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446094] >>>>>>>>> [<ffffffff810b5958>] >>>>>>>>> ? ondemand_readahead+0x1f5/0x203 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446450] >>>>>>>>> [<ffffffff810ae761>] >>>>>>>>> ? generic_file_read_iter+0x191/0x539 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446827] >>>>>>>>> [<ffffffff810e9256>] >>>>>>>>> ? path_openat+0x24b/0x5ce >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447147] >>>>>>>>> [<ffffffff810de1e6>] >>>>>>>>> ? new_sync_read+0x6b/0x8f >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447469] >>>>>>>>> [<ffffffff81151f07>] >>>>>>>>> ? read_cryptcompress+0x6f/0x97 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447815] >>>>>>>>> [<ffffffff8114d4c0>] >>>>>>>>> ? reiser4_read_dispatch+0xc7/0x11e >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448181] >>>>>>>>> [<ffffffff810dedc9>] >>>>>>>>> ? vfs_read+0x84/0x13e >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448483] >>>>>>>>> [<ffffffff810df25c>] >>>>>>>>> ? SyS_read+0x41/0x84 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448780] >>>>>>>>> [<ffffffff815346d2>] >>>>>>>>> ? system_call_fastpath+0x16/0x1b >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.449135] Code: 01 00 00 e9 >>>>>>>>> 00 >>>>>>>>> ff ff ff 8b 43 58 41 0f b7 4d 04 48 8d 04 48 48 89 54 c3 28 e9 ea fe >>>>>>>>> ff ff 44 8b a3 88 00 00 00 41 83 fc 02 75 02 <0f> 0b 0f 87 87 00 00 >>>>>>>>> 00 >>>>>>>>> 41 83 fc 01 0f 85 de 00 00 00 49 8b 56 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.450567] RIP >>>>>>>>> [<ffffffff8115aaf4>] do_readpage_ctail+0x2c5/0x3c4 >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.450934] RSP >>>>>>>>> <ffff88011821baa8> >>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.562843] ---[ end trace >>>>>>>>> 45473ce04b35219f ]--- >>>>>>>>> >>>>>>>>> Looks like same error like last time I used 3.16. Kernel 3.10 lasted >>>>>>>>> with 20 days uptime without problems this month and 3.16 had this >>>>>>>>> oops >>>>>>>>> after 3 days. >>>>>>>> >>>>>>>> Unfortunately, there is no any ideas... >>>>>>>> I can port reiser4-for-3.10 stuff to 3.16. Will you test this port? >>>>>>>> >>>>>>> Ofcourse! >> -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-12-08 19:27 ` Edward Shishkin @ 2014-12-16 13:03 ` Dušan Čolić 2014-12-17 13:44 ` Edward Shishkin 0 siblings, 1 reply; 33+ messages in thread From: Dušan Čolić @ 2014-12-16 13:03 UTC (permalink / raw) To: Edward Shishkin; +Cc: reiserfs-devel, Ivan Shapovalov On Mon, Dec 8, 2014 at 8:27 PM, Edward Shishkin <edward.shishkin@gmail.com> wrote: > So in 3.16 when we ask for some memory, we get ENOMEM > plus a corrupted root partition.. > I would also check the stuff for 3.17 before doing anything. > With 3.16.2.patch the problem usually manifested after 4th run. With 3.17.2.patch last night system finished 5th rsnapshot run without problems. I'll try to keep it up as long as possible. > Thanks, > Edward. > > > > On 12/08/2014 12:54 PM, Dušan Čolić wrote: >> >> On Mon, Dec 8, 2014 at 12:22 PM, Edward Shishkin >> <edward.shishkin@gmail.com> wrote: >>> >>> Is .config the same as in the stuff for 3.10? >>> >>> Thanks, >>> Edward. >>> >> Only thing that jumps out that we haven't mentioned yet is optimize for >> size.... >> I used same config for 3.16.2.patch and for 3.16ported-from3.11.patch >> >> http://marc.info/?l=reiserfs-devel&m=141503126615043&w=2 >> >> " >> >> Last time I enabled page migration in kernel so I tried to find what's >> the difference between kernel config that worked and that fails: >> >> krshina3 linux-3.16.5-gentoo # diff -du ./.config configBAD |grep >> "+"|grep -v "#"|grep -v "@@" >> --- ./.config 2014-11-03 17:09:03.895249969 +0100 >> +++ configBAD 2014-10-24 01:27:07.677613236 +0200 >> +CONFIG_CGROUPS=y >> +CONFIG_CGROUP_SCHED=y >> +CONFIG_FAIR_GROUP_SCHED=y >> +CONFIG_SCHED_AUTOGROUP=y >> +CONFIG_SCHED_MC=y >> +CONFIG_KSM=y >> +CONFIG_X86_INTEL_PSTATE=y >> +CONFIG_EDAC=y >> +CONFIG_EDAC_LEGACY_SYSFS=y >> +CONFIG_DEBUG_INFO=y >> +CONFIG_DEBUG_INFO_REDUCED=y >> +CONFIG_FRAME_POINTER=y >> >> >> krshina3 linux-3.16.5-gentoo # diff -du ./.config configBAD |grep >> "-"|grep -v "#"|grep -v "@@" >> --- ./.config 2014-11-03 17:09:03.895249969 +0100 >> +++ configBAD 2014-10-24 01:27:07.677613236 +0200 >> -CONFIG_USELIB=y >> -CONFIG_AUDIT=y >> -CONFIG_AUDITSYSCALL=y >> -CONFIG_AUDIT_WATCH=y >> -CONFIG_AUDIT_TREE=y >> -CONFIG_CC_OPTIMIZE_FOR_SIZE=y >> -CONFIG_GART_IOMMU=y >> -CONFIG_LCD_CLASS_DEVICE=y >> " >> >> >>> >>> On 12/08/2014 12:45 AM, Dušan Čolić wrote: >>>> >>>> On Sun, Dec 7, 2014 at 11:52 AM, Edward Shishkin >>>> <edward.shishkin@gmail.com> wrote: >>>>> >>>>> And the root partition became corrupted, or...? >>>>> >>>> Yes, just managed to fsck it now. >>>> >>>> fsck: >>>> >>>> CHECKING THE STORAGE TREE >>>> $ >>>> [==\ ] 4% >>>> $ >>>> Nodes left in the tree 3678479 >>>> Leaves of them 3626831, Twigs of them 50438 >>>> Time interval: Sun Dec 7 23:22:35 2014 - Sun Dec 7 23:25:26 >>>> 2014 >>>> CHECKING EXTENT REGIONS. >>>> Read twigs 50438 >>>> Time interval: Sun Dec 7 23:25:26 2014 - Sun Dec 7 23:25:35 >>>> 2014 >>>> CHECKING THE SEMANTIC TREE >>>> FSCK: >>>> >>>> >>>> /mkdeb/build/reiser4progs/reiser4progs/plugin/object/ccreg40/ccreg40_repair.c: >>>> 167: ccreg40_check_cluster: The file [1b529a6:134623831303736:1d80a73] >>>> (ccreg40): the cluster at [0] offset 65536 bytes long is orphan. >>>> Found 543127 objects (some could be encountered more then >>>> once). >>>> Time interval: Sun Dec 7 23:25:35 2014 - Sun Dec 7 23:28:50 >>>> 2014 >>>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/repair.c: 550: >>>> repair_sem_fini: On-disk used block bitmap and really used block bitmap >>>> differ. >>>> ***** fsck.reiser4 finished at Sun Dec 7 23:28:50 2014 >>>> Closing fs...done >>>> >>>> >>>> build-fs: >>>> >>>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>>> repair_node_items_check: Node (4078203), items (60) and (61): Wrong >>>> order >>>> of >>>> keys. >>>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>>> repair_node_items_check: Node (4078899), items (6) and (7): Wrong order >>>> of >>>> keys. >>>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>>> repair_node_items_check: Node (4079383), items (0) and (1): Wrong order >>>> of >>>> keys. >>>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>>> repair_node_items_check: Node (4079488), items (0) and (1): Wrong order >>>> of >>>> keys. >>>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>>> repair_node_items_check: Node (4079546), items (0) and (1): Wrong order >>>> of >>>> keys. >>>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>>> repair_node_items_check: Node (4080447), items (0) and (1): Wrong order >>>> of >>>> keys. >>>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>>> repair_node_items_check: Node (4080571), items (0) and (1): Wrong order >>>> of >>>> keys. >>>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>>> repair_node_items_check: Node (4081137), items (1) and (2): Wrong order >>>> of >>>> keys. >>>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>>> repair_node_items_check: Node (4090871), items (0) and (1): Wrong order >>>> of >>>> keys. >>>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>>> repair_node_items_check: Node (4091337), items (0) and (1): Wrong order >>>> of >>>> keys. >>>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>>> repair_node_items_check: Node (4091990), items (0) and (1): Wrong order >>>> of >>>> keys. >>>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>>> repair_node_items_check: Node (4092423), items (1) and (2): Wrong order >>>> of >>>> keys. >>>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>>> repair_node_items_check: Node (4093016), items (0) and (1): Wrong order >>>> of >>>> keys. >>>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>>> repair_node_items_check: Node (4093690), items (27) and (28): Wrong >>>> order >>>> of >>>> keys. >>>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>>> repair_node_items_check: Node (4094525), items (0) and (1): Wrong order >>>> of >>>> keys. >>>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>>> repair_node_items_check: Node (4096175), items (0) and (1): Wrong order >>>> of >>>> keys. >>>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>>> repair_node_items_check: Node (4099659), items (12) and (13): Wrong >>>> order >>>> of >>>> keys. >>>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>>> repair_node_items_check: Node (4099663), items (21) and (22): Wrong >>>> order >>>> of >>>> keys. >>>> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >>>> repair_node_items_check: Node (4113492), items (0) and (1): Wrong order >>>> of >>>> keys. >>>> >>>>> Thanks, >>>>> Edward. >>>>> >>>>> >>>>> >>>>> On 12/07/2014 09:07 AM, Dušan Čolić wrote: >>>>>> >>>>>> And on the 4th day: >>>>>> >>>>>> ### RSNAPSHOT DAILY ### >>>>>> fsck.reiser4 /dev/md125 >>>>>> mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory >>>>>> Backup failure >>>>>> umount: /mnt/backup: not mounted >>>>>> >>>>>> >>>>>> krshina3 ~ # cat /proc/meminfo >>>>>> MemTotal: 7867900 kB >>>>>> MemFree: 1553044 kB >>>>>> MemAvailable: 4853752 kB >>>>>> Buffers: 0 kB >>>>>> Cached: 2975880 kB >>>>>> SwapCached: 4944 kB >>>>>> Active: 3780968 kB >>>>>> Inactive: 2003640 kB >>>>>> Active(anon): 2336740 kB >>>>>> Inactive(anon): 498120 kB >>>>>> Active(file): 1444228 kB >>>>>> Inactive(file): 1505520 kB >>>>>> Unevictable: 0 kB >>>>>> Mlocked: 0 kB >>>>>> SwapTotal: 594300 kB >>>>>> SwapFree: 180008 kB >>>>>> Dirty: 3064 kB >>>>>> Writeback: 0 kB >>>>>> AnonPages: 2804424 kB >>>>>> Mapped: 180772 kB >>>>>> Shmem: 26132 kB >>>>>> Slab: 427632 kB >>>>>> SReclaimable: 392984 kB >>>>>> SUnreclaim: 34648 kB >>>>>> KernelStack: 7536 kB >>>>>> PageTables: 38328 kB >>>>>> NFS_Unstable: 0 kB >>>>>> Bounce: 0 kB >>>>>> WritebackTmp: 0 kB >>>>>> CommitLimit: 4528248 kB >>>>>> Committed_AS: 5352472 kB >>>>>> VmallocTotal: 34359738367 kB >>>>>> VmallocUsed: 352244 kB >>>>>> VmallocChunk: 34359293283 kB >>>>>> HugePages_Total: 0 >>>>>> HugePages_Free: 0 >>>>>> HugePages_Rsvd: 0 >>>>>> HugePages_Surp: 0 >>>>>> Hugepagesize: 2048 kB >>>>>> DirectMap4k: 12224 kB >>>>>> DirectMap2M: 8056832 kB >>>>>> >>>>>> >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.958316] reiser4: md125: found >>>>>> disk format 4.0.0. >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.958998] mount: page >>>>>> allocation failure: order:4, mode:0x2040d0 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959000] CPU: 2 PID: 7078 >>>>>> Comm: mount Not tainted 3.16.5-gentoo #1 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959001] Hardware name: >>>>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>>>>> 07/04/2012 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959003] 0000000000000006 >>>>>> ffffffff8152bdfb 0000000000000001 ffffffff810b0bc3 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959005] ffffffff81818df8 >>>>>> 0000000000000000 00000002fffffff0 0000000000000010 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959006] ffff8801007b27a0 >>>>>> 0000000000000000 0000000000000010 0000204081818240 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959008] Call Trace: >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959011] [<ffffffff8152bdfb>] >>>>>> ? dump_stack+0x41/0x51 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959014] [<ffffffff810b0bc3>] >>>>>> ? warn_alloc_failed+0x10c/0x120 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959016] [<ffffffff810b2b66>] >>>>>> ? __alloc_pages_nodemask+0x581/0x69d >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959019] [<ffffffff810db5f4>] >>>>>> ? cache_alloc_refill+0x261/0x48c >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959022] [<ffffffff8113eefd>] >>>>>> ? reiser4_mount+0xc/0xc >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959024] [<ffffffff810db35f>] >>>>>> ? kmem_cache_alloc+0x6d/0xa1 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959026] [<ffffffff8112bf58>] >>>>>> ? znodes_tree_init+0xb9/0xe6 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959028] [<ffffffff811323ee>] >>>>>> ? reiser4_init_tree+0x3f/0xb2 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959031] [<ffffffff8115fb05>] >>>>>> ? init_format_format40+0x357/0x4e4 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959033] [<ffffffff81080f74>] >>>>>> ? wake_up_bit+0xc/0x1b >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959035] [<ffffffff8113efc8>] >>>>>> ? fill_super+0xcb/0x1ad >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959037] [<ffffffff810e142e>] >>>>>> ? mount_bdev+0x133/0x186 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959039] [<ffffffff810e15ed>] >>>>>> ? mount_fs+0xc/0x9e >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959041] [<ffffffff810f55f2>] >>>>>> ? vfs_kern_mount+0x5e/0xef >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959042] [<ffffffff810f71c1>] >>>>>> ? do_mount+0x80b/0x904 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959044] [<ffffffff810f74d5>] >>>>>> ? SyS_mount+0x7e/0xb7 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959046] [<ffffffff81533612>] >>>>>> ? system_call_fastpath+0x16/0x1b >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959047] Mem-Info: >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959048] DMA per-cpu: >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959049] CPU 0: hi: 0, >>>>>> btch: 1 usd: 0 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959050] CPU 1: hi: 0, >>>>>> btch: 1 usd: 0 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959051] CPU 2: hi: 0, >>>>>> btch: 1 usd: 0 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959052] CPU 3: hi: 0, >>>>>> btch: 1 usd: 0 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959052] DMA32 per-cpu: >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959053] CPU 0: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959054] CPU 1: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959055] CPU 2: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959056] CPU 3: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959057] Normal per-cpu: >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959057] CPU 0: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959058] CPU 1: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959059] CPU 2: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959060] CPU 3: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] active_anon:593069 >>>>>> inactive_anon:120226 isolated_anon:0 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] active_file:503137 >>>>>> inactive_file:503029 isolated_file:0 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] unevictable:0 >>>>>> dirty:333 writeback:0 unstable:0 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] free:104532 >>>>>> slab_reclaimable:109978 slab_unreclaimable:8402 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] mapped:51579 >>>>>> shmem:5928 pagetables:9488 bounce:0 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] free_cma:0 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959068] DMA free:15900kB >>>>>> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >>>>>> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >>>>>> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >>>>>> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >>>>>> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >>>>>> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>>>> all_unreclaimable? yes >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959069] lowmem_reserve[]: 0 >>>>>> 2952 7667 7667 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959074] DMA32 free:168028kB >>>>>> min:4308kB low:5384kB high:6460kB active_anon:837216kB >>>>>> inactive_anon:214776kB active_file:790440kB inactive_file:790440kB >>>>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>>>> present:3098560kB managed:3023876kB mlocked:0kB dirty:316kB >>>>>> writeback:0kB mapped:78860kB shmem:8760kB slab_reclaimable:171284kB >>>>>> slab_unreclaimable:11888kB kernel_stack:2240kB pagetables:16348kB >>>>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>>>> all_unreclaimable? no >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959075] lowmem_reserve[]: 0 0 >>>>>> 4714 4714 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959079] Normal free:234200kB >>>>>> min:6880kB low:8600kB high:10320kB active_anon:1535060kB >>>>>> inactive_anon:266128kB active_file:1222108kB inactive_file:1221676kB >>>>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>>>> present:4954112kB managed:4828124kB mlocked:0kB dirty:1016kB >>>>>> writeback:0kB mapped:127456kB shmem:14952kB slab_reclaimable:268628kB >>>>>> slab_unreclaimable:21720kB kernel_stack:4976kB pagetables:21604kB >>>>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>>>> all_unreclaimable? no >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959080] lowmem_reserve[]: 0 0 >>>>>> 0 >>>>>> 0 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959081] DMA: 1*4kB (U) 1*8kB >>>>>> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >>>>>> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959088] DMA32: 36545*4kB >>>>>> (UEM) 2543*8kB (UEM) 70*16kB (UMR) 0*32kB 0*64kB 1*128kB (R) 0*256kB >>>>>> 1*512kB (R) 0*1024kB 0*2048kB 0*4096kB = 168284kB >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959093] Normal: 50408*4kB >>>>>> (UEM) 3913*8kB (UEM) 36*16kB (UMR) 0*32kB 1*64kB (R) 1*128kB (R) >>>>>> 1*256kB (R) 1*512kB (R) 0*1024kB 0*2048kB 0*4096kB = 234472kB >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959099] Node 0 >>>>>> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >>>>>> hugepages_size=2048kB >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959100] 1013453 total >>>>>> pagecache >>>>>> pages >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959101] 1228 pages in swap >>>>>> cache >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959102] Swap cache stats: add >>>>>> 133257, delete 132029, find 57308/68141 >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959103] Free swap = 184632kB >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959103] Total swap = 594300kB >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959104] 2017164 pages RAM >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959105] 0 pages >>>>>> HighMem/MovableOnly >>>>>> Dec 7 03:30:01 krshina3 kernel: [281555.959106] 31497 pages reserved >>>>>> >>>>>> On Wed, Dec 3, 2014 at 9:16 PM, Dušan Čolić<dusanc@gmail.com> wrote: >>>>>>> >>>>>>> On Mon, Dec 1, 2014 at 12:58 AM, Edward Shishkin >>>>>>> <edward.shishkin@gmail.com> wrote: >>>>>>>> >>>>>>>> On 12/01/2014 12:53 AM, Dušan Čolić wrote: >>>>>>>> >>>>>>>> >>>>>>>> On Dec 1, 2014 12:47 AM, "Edward >>>>>>>> Shishkin"<edward.shishkin@gmail.com> >>>>>>>> wrote: >>>>>>>>> >>>>>>>>> On 12/01/2014 12:04 AM, Dušan Čolić wrote: >>>>>>>>>> >>>>>>>>>> On Fri, Nov 14, 2014 at 9:09 PM, Dušan Čolić<dusanc@gmail.com> >>>>>>>>>> wrote: >>>>>>>>>>> >>>>>>>>>>> As I had no time to make a full backup I went back to 3.10 kernel >>>>>>>>>>> and >>>>>>>>>>> had no >>>>>>>>>>> problem since. >>>>>>>>>>> >>>>>>>>>>> Could this issue be connected with those firefox cache files that >>>>>>>>>>> were >>>>>>>>>>> bad >>>>>>>>>>> (see other mail thread) so I deleted them but for some reason >>>>>>>>>>> they >>>>>>>>>>> continued >>>>>>>>>>> making problems or problem wasn't really solved by deletion? I >>>>>>>>>>> ask >>>>>>>>>>> this >>>>>>>>>>> as >>>>>>>>>>> after long time of stable r4 I got 2 problems in same week so >>>>>>>>>>> they're >>>>>>>>>>> probably related. >>>>>>>>>>> >>>>>>>>>>> On Nov 14, 2014 8:58 PM, "Edward Shishkin" >>>>>>>>>>> <edward.shishkin@gmail.com> >>>>>>>>>>> wrote: >>>>>>>>>>>> >>>>>>>>>>>> On 11/05/2014 12:04 PM, Dušan Čolić wrote: >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Nov 5, 2014 12:48 AM, "Edward Shishkin" >>>>>>>>>>>> <edward.shishkin@gmail.com> >>>>>>>>>>>> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>> On 11/04/2014 02:16 PM, Dušan Čolić wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>> Did a fsck of source partition. >>>>>>>>>>>>>> Btw. why is there a reason this corruption appeared when I >>>>>>>>>>>>>> started >>>>>>>>>>>>>> using 3.16.2 instead 3.10? >>>>>>>>>>>>>> >>>>>>>>>>>>> I would also suspect this failed mount. >>>>>>>>>>>>> It could have fatal consequences for the system, and, in >>>>>>>>>>>>> particular >>>>>>>>>>>>> for >>>>>>>>>>>>> your ''/". >>>>>>>>>>>>> >>>>>>>>>>>> Failed mount happened on the partition that I was copying >>>>>>>>>>>> to,/mnt/backup, >>>>>>>>>>>> and it fscked ok. >>>>>>>>>>>> / was partition I was copying from and it had errors. >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> Hi Dušan, >>>>>>>>>>>> >>>>>>>>>>>> So, how is your / ? >>>>>>>>>> >>>>>>>>>> So I was feeling brave so I put 3.16.2 back 4 days ago and I got >>>>>>>>>> this: >>>>>>>>>> >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436017] ------------[ cut >>>>>>>>>> here ]------------ >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436320] kernel BUG at >>>>>>>>>> fs/reiser4/plugin/item/ctail.c:669! >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436652] invalid opcode: >>>>>>>>>> 0000 >>>>>>>>>> [#1] SMP >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436899] CPU: 3 PID: 30235 >>>>>>>>>> Comm: rsync Not tainted 3.16.5-gentoo #2 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.437275] Hardware name: >>>>>>>>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS >>>>>>>>>> F5 >>>>>>>>>> 07/04/2012 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.437834] task: >>>>>>>>>> ffff8801333d4010 ti: ffff880118218000 task.ti: ffff880118218000 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.438264] RIP: >>>>>>>>>> 0010:[<ffffffff8115aaf4>] [<ffffffff8115aaf4>] >>>>>>>>>> do_readpage_ctail+0x2c5/0x3c4 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.438768] RSP: >>>>>>>>>> 0018:ffff88011821baa8 EFLAGS: 00010246 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439073] RAX: >>>>>>>>>> 0000000000000000 >>>>>>>>>> RBX: ffff88011821bb78 RCX: 000000000002f35d >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439484] RDX: >>>>>>>>>> 000000000000002f >>>>>>>>>> RSI: 0000000000000000 RDI: ffff8800b953b000 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439894] RBP: >>>>>>>>>> ffff880169d231a0 >>>>>>>>>> R08: 0000000000000000 R09: 0000000000000000 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.440304] R10: >>>>>>>>>> ffffffff8114eb84 >>>>>>>>>> R11: 0000000000012368 R12: 0000000000000002 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.440713] R13: >>>>>>>>>> 0000000000001000 >>>>>>>>>> R14: ffffea00052f5158 R15: 0000000000000000 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441124] FS: >>>>>>>>>> 00007f3d4d434700(0000) GS:ffff88022e380000(0000) >>>>>>>>>> knlGS:0000000000000000 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441589] CS: 0010 DS: >>>>>>>>>> 0000 >>>>>>>>>> ES: 0000 CR0: 0000000080050033 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441918] CR2: >>>>>>>>>> 0000000000980000 >>>>>>>>>> CR3: 00000001a0c03000 CR4: 00000000001427e0 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442327] Stack: >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442443] 0000000000000000 >>>>>>>>>> ffff88011821bb78 0000000000000000 ffff880169d231a0 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442890] 0000000000000000 >>>>>>>>>> ffffea00052f5158 0000000000000000 ffffffff8115ad7b >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443336] 00000000000aa1a1 >>>>>>>>>> ffff88011821bca0 ffffea00052f5158 ffff880169d232e0 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443784] Call Trace: >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443926] >>>>>>>>>> [<ffffffff8115ad7b>] >>>>>>>>>> ? ctail_readpages_filler+0x188/0x1c9 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444302] >>>>>>>>>> [<ffffffff8115abf3>] >>>>>>>>>> ? do_readpage_ctail+0x3c4/0x3c4 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444655] >>>>>>>>>> [<ffffffff810b5528>] >>>>>>>>>> ? read_cache_pages+0x91/0xfc >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444990] >>>>>>>>>> [<ffffffff8115b17c>] >>>>>>>>>> ? readpages_ctail+0x2c8/0x2e5 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.445332] >>>>>>>>>> [<ffffffff81151e72>] >>>>>>>>>> ? readpages_cryptcompress+0x39/0x5f >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.445704] >>>>>>>>>> [<ffffffff810b56c9>] >>>>>>>>>> ? __do_page_cache_readahead+0x136/0x1d0 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446094] >>>>>>>>>> [<ffffffff810b5958>] >>>>>>>>>> ? ondemand_readahead+0x1f5/0x203 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446450] >>>>>>>>>> [<ffffffff810ae761>] >>>>>>>>>> ? generic_file_read_iter+0x191/0x539 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446827] >>>>>>>>>> [<ffffffff810e9256>] >>>>>>>>>> ? path_openat+0x24b/0x5ce >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447147] >>>>>>>>>> [<ffffffff810de1e6>] >>>>>>>>>> ? new_sync_read+0x6b/0x8f >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447469] >>>>>>>>>> [<ffffffff81151f07>] >>>>>>>>>> ? read_cryptcompress+0x6f/0x97 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447815] >>>>>>>>>> [<ffffffff8114d4c0>] >>>>>>>>>> ? reiser4_read_dispatch+0xc7/0x11e >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448181] >>>>>>>>>> [<ffffffff810dedc9>] >>>>>>>>>> ? vfs_read+0x84/0x13e >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448483] >>>>>>>>>> [<ffffffff810df25c>] >>>>>>>>>> ? SyS_read+0x41/0x84 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448780] >>>>>>>>>> [<ffffffff815346d2>] >>>>>>>>>> ? system_call_fastpath+0x16/0x1b >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.449135] Code: 01 00 00 e9 >>>>>>>>>> 00 >>>>>>>>>> ff ff ff 8b 43 58 41 0f b7 4d 04 48 8d 04 48 48 89 54 c3 28 e9 ea >>>>>>>>>> fe >>>>>>>>>> ff ff 44 8b a3 88 00 00 00 41 83 fc 02 75 02 <0f> 0b 0f 87 87 00 >>>>>>>>>> 00 >>>>>>>>>> 00 >>>>>>>>>> 41 83 fc 01 0f 85 de 00 00 00 49 8b 56 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.450567] RIP >>>>>>>>>> [<ffffffff8115aaf4>] do_readpage_ctail+0x2c5/0x3c4 >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.450934] RSP >>>>>>>>>> <ffff88011821baa8> >>>>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.562843] ---[ end trace >>>>>>>>>> 45473ce04b35219f ]--- >>>>>>>>>> >>>>>>>>>> Looks like same error like last time I used 3.16. Kernel 3.10 >>>>>>>>>> lasted >>>>>>>>>> with 20 days uptime without problems this month and 3.16 had this >>>>>>>>>> oops >>>>>>>>>> after 3 days. >>>>>>>>> >>>>>>>>> >>>>>>>>> Unfortunately, there is no any ideas... >>>>>>>>> I can port reiser4-for-3.10 stuff to 3.16. Will you test this port? >>>>>>>>> >>>>>>>> Ofcourse! >>> >>> > -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-12-16 13:03 ` Dušan Čolić @ 2014-12-17 13:44 ` Edward Shishkin 0 siblings, 0 replies; 33+ messages in thread From: Edward Shishkin @ 2014-12-17 13:44 UTC (permalink / raw) To: Dušan Čolić; +Cc: reiserfs-devel, Ivan Shapovalov On 12/16/2014 02:03 PM, Dušan Čolić wrote: > On Mon, Dec 8, 2014 at 8:27 PM, Edward Shishkin > <edward.shishkin@gmail.com> wrote: >> So in 3.16 when we ask for some memory, we get ENOMEM >> plus a corrupted root partition.. >> I would also check the stuff for 3.17 before doing anything. >> > With 3.16.2.patch the problem usually manifested after 4th run. > With 3.17.2.patch last night system finished 5th rsnapshot run without problems. > I'll try to keep it up as long as possible. .config is from 3.16.2? -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
[parent not found: <CADW=+3kGn9OBoHiVWT3EkmSxGn==0ZsEa1nS_dP7-oQeq5h48g@mail.gmail.com>]
* Fwd: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory [not found] ` <CADW=+3kGn9OBoHiVWT3EkmSxGn==0ZsEa1nS_dP7-oQeq5h48g@mail.gmail.com> @ 2014-12-10 11:38 ` Dušan Čolić 0 siblings, 0 replies; 33+ messages in thread From: Dušan Čolić @ 2014-12-10 11:38 UTC (permalink / raw) To: reiserfs-devel On Mon, Dec 8, 2014 at 12:22 PM, Edward Shishkin <edward.shishkin@gmail.com> wrote: > > Is .config the same as in the stuff for 3.10? > I double checked and maybe I messed up the diff between configs. krshina3 src # diff -du config3.10good config3.16badfrom3.11 |grep -v "#"|grep -v "@@"| grep -e "+" -e "-" --- config3.10good 2014-12-10 12:19:13.796804296 +0100 +++ config3.16badfrom3.11 2014-12-10 12:20:14.975493022 +0100 + +CONFIG_GENTOO_LINUX=y +CONFIG_GENTOO_LINUX_UDEV=y + +CONFIG_GENTOO_LINUX_INIT_SCRIPT=y -CONFIG_ARCH_HAS_CPU_AUTOPROBE=y +CONFIG_ARCH_WANT_HUGE_PMD_SHARE=y +CONFIG_ARCH_WANT_GENERAL_HUGETLB=y CONFIG_ARCH_HWEIGHT_CFLAGS="-fcall-saved-rdi -fcall-saved-rsi -fcall-saved-rdx -fcall-saved-rcx -fcall-saved-r8 -fcall-saved-r9 -fcall-saved-r10 -fcall-saved-r11" +CONFIG_FIX_EARLYCON_MEM=y +CONFIG_HAVE_KERNEL_LZ4=y +CONFIG_CROSS_MEMORY_ATTACH=y +CONFIG_USELIB=y +CONFIG_HAVE_ARCH_AUDITSYSCALL=y -CONFIG_HAVE_GENERIC_HARDIRQS=y -CONFIG_GENERIC_HARDIRQS=y +CONFIG_GENERIC_IRQ_LEGACY_ALLOC_HWIRQ=y +CONFIG_ARCH_SUPPORTS_INT128=y -CONFIG_UIDGID_CONVERTED=y -CONFIG_HOTPLUG=y +CONFIG_SGETMASK_SYSCALL=y +CONFIG_SYSFS_SYSCALL=y -CONFIG_USE_GENERIC_SMP_HELPERS=y +CONFIG_HAVE_DMA_CONTIGUOUS=y +CONFIG_HAVE_CC_STACKPROTECTOR=y +CONFIG_CC_STACKPROTECTOR_NONE=y +CONFIG_HAVE_VIRT_CPU_ACCOUNTING_GEN=y +CONFIG_HAVE_ARCH_SOFT_DIRTY=y +CONFIG_HAVE_IRQ_EXIT_ON_IRQ_STACK=y -CONFIG_STOP_MACHINE=y +CONFIG_ARCH_SUPPORTS_ATOMIC_RMW=y +CONFIG_RWSEM_SPIN_ON_OWNER=y +CONFIG_ARCH_USE_QUEUE_RWLOCK=y +CONFIG_QUEUE_RWLOCK=y +CONFIG_X86_16BIT=y +CONFIG_X86_ESPFIX64=y +CONFIG_ARCH_ENABLE_SPLIT_PMD_PTLOCK=y -CONFIG_CROSS_MEMORY_ATTACH=y +CONFIG_GENERIC_EARLY_IOREMAP=y -CONFIG_ACPI_I2C=y -CONFIG_ACPI_BLACKLIST_YEAR=0 -CONFIG_CPU_FREQ_TABLE=y + -CONFIG_ARCH_SUPPORTS_MSI=y + -CONFIG_HAVE_TEXT_POKE_SMP=y +CONFIG_IOSF_MBI=y +CONFIG_NET_RX_BUSY_POLL=y +CONFIG_NET_FLOW_LIMIT=y +CONFIG_UEVENT_HELPER=y +CONFIG_GENERIC_CPU_AUTOPROBE=y +CONFIG_ARCH_MIGHT_HAVE_PC_PARPORT=y + + +CONFIG_MII=y -CONFIG_MII=y +CONFIG_NET_VENDOR_ARC=y -CONFIG_NET_CADENCE=y +CONFIG_NET_VENDOR_SAMSUNG=y +CONFIG_ARCH_MIGHT_HAVE_PC_SERIO=y +CONFIG_VT_HW_CONSOLE_BINDING=y +CONFIG_SERIAL_EARLYCON=y -CONFIG_FIX_EARLYCON_MEM=y +CONFIG_HPET_MMAP_DEFAULT=y - -CONFIG_GPIO_DEVRES=y +CONFIG_THERMAL_GOV_USER_SPACE=y +CONFIG_X86_PKG_TEMP_THERMAL=y + +CONFIG_INTEL_GTT=y + +CONFIG_DRM_KMS_FB_HELPER=y +CONFIG_DRM_I915_FBDEV=y -CONFIG_VIDEO_OUTPUT_CONTROL=y -CONFIG_HDMI=y + +CONFIG_HDMI=y -CONFIG_FONT_8x8=y -CONFIG_FONT_8x16=y +CONFIG_SND_MAX_CARDS=32 -CONFIG_SND_HDA_INTEL=y -CONFIG_SND_HDA_PREALLOC_SIZE=64 -CONFIG_SND_HDA_INPUT_JACK=y -CONFIG_SND_HDA_GENERIC=y + +CONFIG_SND_HDA=y +CONFIG_SND_HDA_INTEL=y +CONFIG_SND_HDA_PREALLOC_SIZE=64 +CONFIG_SND_HDA_INPUT_JACK=y +CONFIG_SND_HDA_I915=y +CONFIG_SND_HDA_GENERIC=y -CONFIG_USB_ARCH_HAS_OHCI=y -CONFIG_USB_ARCH_HAS_EHCI=y -CONFIG_USB_ARCH_HAS_XHCI=y +CONFIG_USB_OHCI_LITTLE_ENDIAN=y + + + +CONFIG_DMI_SCAN_MACHINE_NON_EFI_FALLBACK=y -CONFIG_GENERIC_ACL=y +CONFIG_KERNFS=y + + -CONFIG_MAGIC_SYSRQ=y +CONFIG_ARCH_WANT_FRAME_POINTERS=y +CONFIG_MAGIC_SYSRQ=y +CONFIG_MAGIC_SYSRQ_DEFAULT_ENABLE=0x1 + +CONFIG_HAVE_DEBUG_KMEMLEAK=y +CONFIG_DEBUG_MEMORY_INIT=y +CONFIG_HAVE_DEBUG_STACKOVERFLOW=y +CONFIG_DEBUG_STACKOVERFLOW=y +CONFIG_HAVE_ARCH_KMEMCHECK=y + -CONFIG_PANIC_ON_OOPS_VALUE=0 +CONFIG_PANIC_ON_OOPS_VALUE=0 +CONFIG_PANIC_TIMEOUT=0 -CONFIG_HAVE_DEBUG_KMEMLEAK=y + -CONFIG_DEBUG_MEMORY_INIT=y -CONFIG_ARCH_WANT_FRAME_POINTERS=y + -CONFIG_HAVE_ARCH_KMEMCHECK=y -CONFIG_DEBUG_STACKOVERFLOW=y +CONFIG_DOUBLEFAULT=y +CONFIG_CRYPTO_CMAC=y +CONFIG_KVM_VFIO=y +CONFIG_GENERIC_NET_UTILS=y +CONFIG_ARCH_USE_CMPXCHG_LOCKREF=y +CONFIG_INTERVAL_TREE=y -CONFIG_HAS_IOPORT=y +CONFIG_HAS_IOPORT_MAP=y +CONFIG_FONT_SUPPORT=y +CONFIG_FONT_8x8=y +CONFIG_FONT_8x16=y > > Thanks, > Edward. > > > > On 12/08/2014 12:45 AM, Dušan Čolić wrote: >> >> On Sun, Dec 7, 2014 at 11:52 AM, Edward Shishkin >> <edward.shishkin@gmail.com> wrote: >>> >>> And the root partition became corrupted, or...? >>> >> Yes, just managed to fsck it now. >> >> fsck: >> >> CHECKING THE STORAGE TREE $ >> [==\ ] 4% $ >> Nodes left in the tree 3678479 >> Leaves of them 3626831, Twigs of them 50438 >> Time interval: Sun Dec 7 23:22:35 2014 - Sun Dec 7 23:25:26 2014 >> CHECKING EXTENT REGIONS. >> Read twigs 50438 >> Time interval: Sun Dec 7 23:25:26 2014 - Sun Dec 7 23:25:35 2014 >> CHECKING THE SEMANTIC TREE >> FSCK: >> /mkdeb/build/reiser4progs/reiser4progs/plugin/object/ccreg40/ccreg40_repair.c: >> 167: ccreg40_check_cluster: The file [1b529a6:134623831303736:1d80a73] >> (ccreg40): the cluster at [0] offset 65536 bytes long is orphan. >> Found 543127 objects (some could be encountered more then once). >> Time interval: Sun Dec 7 23:25:35 2014 - Sun Dec 7 23:28:50 2014 >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/repair.c: 550: >> repair_sem_fini: On-disk used block bitmap and really used block bitmap differ. >> ***** fsck.reiser4 finished at Sun Dec 7 23:28:50 2014 >> Closing fs...done >> >> >> build-fs: >> >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4078203), items (60) and (61): Wrong order of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4078899), items (6) and (7): Wrong order of keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4079383), items (0) and (1): Wrong order of keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4079488), items (0) and (1): Wrong order of keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4079546), items (0) and (1): Wrong order of keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4080447), items (0) and (1): Wrong order of keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4080571), items (0) and (1): Wrong order of keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4081137), items (1) and (2): Wrong order of keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4090871), items (0) and (1): Wrong order of keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4091337), items (0) and (1): Wrong order of keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4091990), items (0) and (1): Wrong order of keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4092423), items (1) and (2): Wrong order of keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4093016), items (0) and (1): Wrong order of keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4093690), items (27) and (28): Wrong order of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4094525), items (0) and (1): Wrong order of keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4096175), items (0) and (1): Wrong order of keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4099659), items (12) and (13): Wrong order of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4099663), items (21) and (22): Wrong order of >> keys. >> FSCK: /mkdeb/build/reiser4progs/reiser4progs/librepair/node.c: 108: >> repair_node_items_check: Node (4113492), items (0) and (1): Wrong order of keys. >> >>> Thanks, >>> Edward. >>> >>> >>> >>> On 12/07/2014 09:07 AM, Dušan Čolić wrote: >>>> >>>> And on the 4th day: >>>> >>>> ### RSNAPSHOT DAILY ### >>>> fsck.reiser4 /dev/md125 >>>> mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory >>>> Backup failure >>>> umount: /mnt/backup: not mounted >>>> >>>> >>>> krshina3 ~ # cat /proc/meminfo >>>> MemTotal: 7867900 kB >>>> MemFree: 1553044 kB >>>> MemAvailable: 4853752 kB >>>> Buffers: 0 kB >>>> Cached: 2975880 kB >>>> SwapCached: 4944 kB >>>> Active: 3780968 kB >>>> Inactive: 2003640 kB >>>> Active(anon): 2336740 kB >>>> Inactive(anon): 498120 kB >>>> Active(file): 1444228 kB >>>> Inactive(file): 1505520 kB >>>> Unevictable: 0 kB >>>> Mlocked: 0 kB >>>> SwapTotal: 594300 kB >>>> SwapFree: 180008 kB >>>> Dirty: 3064 kB >>>> Writeback: 0 kB >>>> AnonPages: 2804424 kB >>>> Mapped: 180772 kB >>>> Shmem: 26132 kB >>>> Slab: 427632 kB >>>> SReclaimable: 392984 kB >>>> SUnreclaim: 34648 kB >>>> KernelStack: 7536 kB >>>> PageTables: 38328 kB >>>> NFS_Unstable: 0 kB >>>> Bounce: 0 kB >>>> WritebackTmp: 0 kB >>>> CommitLimit: 4528248 kB >>>> Committed_AS: 5352472 kB >>>> VmallocTotal: 34359738367 kB >>>> VmallocUsed: 352244 kB >>>> VmallocChunk: 34359293283 kB >>>> HugePages_Total: 0 >>>> HugePages_Free: 0 >>>> HugePages_Rsvd: 0 >>>> HugePages_Surp: 0 >>>> Hugepagesize: 2048 kB >>>> DirectMap4k: 12224 kB >>>> DirectMap2M: 8056832 kB >>>> >>>> >>>> Dec 7 03:30:01 krshina3 kernel: [281555.958316] reiser4: md125: found >>>> disk format 4.0.0. >>>> Dec 7 03:30:01 krshina3 kernel: [281555.958998] mount: page >>>> allocation failure: order:4, mode:0x2040d0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959000] CPU: 2 PID: 7078 >>>> Comm: mount Not tainted 3.16.5-gentoo #1 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959001] Hardware name: >>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>>> 07/04/2012 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959003] 0000000000000006 >>>> ffffffff8152bdfb 0000000000000001 ffffffff810b0bc3 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959005] ffffffff81818df8 >>>> 0000000000000000 00000002fffffff0 0000000000000010 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959006] ffff8801007b27a0 >>>> 0000000000000000 0000000000000010 0000204081818240 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959008] Call Trace: >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959011] [<ffffffff8152bdfb>] >>>> ? dump_stack+0x41/0x51 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959014] [<ffffffff810b0bc3>] >>>> ? warn_alloc_failed+0x10c/0x120 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959016] [<ffffffff810b2b66>] >>>> ? __alloc_pages_nodemask+0x581/0x69d >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959019] [<ffffffff810db5f4>] >>>> ? cache_alloc_refill+0x261/0x48c >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959022] [<ffffffff8113eefd>] >>>> ? reiser4_mount+0xc/0xc >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959024] [<ffffffff810db35f>] >>>> ? kmem_cache_alloc+0x6d/0xa1 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959026] [<ffffffff8112bf58>] >>>> ? znodes_tree_init+0xb9/0xe6 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959028] [<ffffffff811323ee>] >>>> ? reiser4_init_tree+0x3f/0xb2 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959031] [<ffffffff8115fb05>] >>>> ? init_format_format40+0x357/0x4e4 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959033] [<ffffffff81080f74>] >>>> ? wake_up_bit+0xc/0x1b >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959035] [<ffffffff8113efc8>] >>>> ? fill_super+0xcb/0x1ad >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959037] [<ffffffff810e142e>] >>>> ? mount_bdev+0x133/0x186 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959039] [<ffffffff810e15ed>] >>>> ? mount_fs+0xc/0x9e >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959041] [<ffffffff810f55f2>] >>>> ? vfs_kern_mount+0x5e/0xef >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959042] [<ffffffff810f71c1>] >>>> ? do_mount+0x80b/0x904 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959044] [<ffffffff810f74d5>] >>>> ? SyS_mount+0x7e/0xb7 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959046] [<ffffffff81533612>] >>>> ? system_call_fastpath+0x16/0x1b >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959047] Mem-Info: >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959048] DMA per-cpu: >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959049] CPU 0: hi: 0, >>>> btch: 1 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959050] CPU 1: hi: 0, >>>> btch: 1 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959051] CPU 2: hi: 0, >>>> btch: 1 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959052] CPU 3: hi: 0, >>>> btch: 1 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959052] DMA32 per-cpu: >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959053] CPU 0: hi: 186, >>>> btch: 31 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959054] CPU 1: hi: 186, >>>> btch: 31 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959055] CPU 2: hi: 186, >>>> btch: 31 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959056] CPU 3: hi: 186, >>>> btch: 31 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959057] Normal per-cpu: >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959057] CPU 0: hi: 186, >>>> btch: 31 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959058] CPU 1: hi: 186, >>>> btch: 31 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959059] CPU 2: hi: 186, >>>> btch: 31 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959060] CPU 3: hi: 186, >>>> btch: 31 usd: 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] active_anon:593069 >>>> inactive_anon:120226 isolated_anon:0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] active_file:503137 >>>> inactive_file:503029 isolated_file:0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] unevictable:0 >>>> dirty:333 writeback:0 unstable:0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] free:104532 >>>> slab_reclaimable:109978 slab_unreclaimable:8402 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] mapped:51579 >>>> shmem:5928 pagetables:9488 bounce:0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959062] free_cma:0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959068] DMA free:15900kB >>>> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >>>> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >>>> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >>>> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >>>> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >>>> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>> all_unreclaimable? yes >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959069] lowmem_reserve[]: 0 >>>> 2952 7667 7667 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959074] DMA32 free:168028kB >>>> min:4308kB low:5384kB high:6460kB active_anon:837216kB >>>> inactive_anon:214776kB active_file:790440kB inactive_file:790440kB >>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>> present:3098560kB managed:3023876kB mlocked:0kB dirty:316kB >>>> writeback:0kB mapped:78860kB shmem:8760kB slab_reclaimable:171284kB >>>> slab_unreclaimable:11888kB kernel_stack:2240kB pagetables:16348kB >>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>> all_unreclaimable? no >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959075] lowmem_reserve[]: 0 0 >>>> 4714 4714 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959079] Normal free:234200kB >>>> min:6880kB low:8600kB high:10320kB active_anon:1535060kB >>>> inactive_anon:266128kB active_file:1222108kB inactive_file:1221676kB >>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>> present:4954112kB managed:4828124kB mlocked:0kB dirty:1016kB >>>> writeback:0kB mapped:127456kB shmem:14952kB slab_reclaimable:268628kB >>>> slab_unreclaimable:21720kB kernel_stack:4976kB pagetables:21604kB >>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>> all_unreclaimable? no >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959080] lowmem_reserve[]: 0 0 0 0 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959081] DMA: 1*4kB (U) 1*8kB >>>> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >>>> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959088] DMA32: 36545*4kB >>>> (UEM) 2543*8kB (UEM) 70*16kB (UMR) 0*32kB 0*64kB 1*128kB (R) 0*256kB >>>> 1*512kB (R) 0*1024kB 0*2048kB 0*4096kB = 168284kB >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959093] Normal: 50408*4kB >>>> (UEM) 3913*8kB (UEM) 36*16kB (UMR) 0*32kB 1*64kB (R) 1*128kB (R) >>>> 1*256kB (R) 1*512kB (R) 0*1024kB 0*2048kB 0*4096kB = 234472kB >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959099] Node 0 >>>> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >>>> hugepages_size=2048kB >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959100] 1013453 total pagecache >>>> pages >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959101] 1228 pages in swap cache >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959102] Swap cache stats: add >>>> 133257, delete 132029, find 57308/68141 >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959103] Free swap = 184632kB >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959103] Total swap = 594300kB >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959104] 2017164 pages RAM >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959105] 0 pages >>>> HighMem/MovableOnly >>>> Dec 7 03:30:01 krshina3 kernel: [281555.959106] 31497 pages reserved >>>> >>>> On Wed, Dec 3, 2014 at 9:16 PM, Dušan Čolić<dusanc@gmail.com> wrote: >>>>> >>>>> On Mon, Dec 1, 2014 at 12:58 AM, Edward Shishkin >>>>> <edward.shishkin@gmail.com> wrote: >>>>>> >>>>>> On 12/01/2014 12:53 AM, Dušan Čolić wrote: >>>>>> >>>>>> >>>>>> On Dec 1, 2014 12:47 AM, "Edward Shishkin"<edward.shishkin@gmail.com> >>>>>> wrote: >>>>>>> >>>>>>> On 12/01/2014 12:04 AM, Dušan Čolić wrote: >>>>>>>> >>>>>>>> On Fri, Nov 14, 2014 at 9:09 PM, Dušan Čolić<dusanc@gmail.com> wrote: >>>>>>>>> >>>>>>>>> As I had no time to make a full backup I went back to 3.10 kernel and >>>>>>>>> had no >>>>>>>>> problem since. >>>>>>>>> >>>>>>>>> Could this issue be connected with those firefox cache files that >>>>>>>>> were >>>>>>>>> bad >>>>>>>>> (see other mail thread) so I deleted them but for some reason they >>>>>>>>> continued >>>>>>>>> making problems or problem wasn't really solved by deletion? I ask >>>>>>>>> this >>>>>>>>> as >>>>>>>>> after long time of stable r4 I got 2 problems in same week so they're >>>>>>>>> probably related. >>>>>>>>> >>>>>>>>> On Nov 14, 2014 8:58 PM, "Edward Shishkin" >>>>>>>>> <edward.shishkin@gmail.com> >>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>> On 11/05/2014 12:04 PM, Dušan Čolić wrote: >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Nov 5, 2014 12:48 AM, "Edward Shishkin" >>>>>>>>>> <edward.shishkin@gmail.com> >>>>>>>>>> wrote: >>>>>>>>>>> >>>>>>>>>>> On 11/04/2014 02:16 PM, Dušan Čolić wrote: >>>>>>>>>>>> >>>>>>>>>>>> Did a fsck of source partition. >>>>>>>>>>>> Btw. why is there a reason this corruption appeared when I started >>>>>>>>>>>> using 3.16.2 instead 3.10? >>>>>>>>>>>> >>>>>>>>>>> I would also suspect this failed mount. >>>>>>>>>>> It could have fatal consequences for the system, and, in particular >>>>>>>>>>> for >>>>>>>>>>> your ''/". >>>>>>>>>>> >>>>>>>>>> Failed mount happened on the partition that I was copying >>>>>>>>>> to,/mnt/backup, >>>>>>>>>> and it fscked ok. >>>>>>>>>> / was partition I was copying from and it had errors. >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> Hi Dušan, >>>>>>>>>> >>>>>>>>>> So, how is your / ? >>>>>>>> >>>>>>>> So I was feeling brave so I put 3.16.2 back 4 days ago and I got this: >>>>>>>> >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436017] ------------[ cut >>>>>>>> here ]------------ >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436320] kernel BUG at >>>>>>>> fs/reiser4/plugin/item/ctail.c:669! >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436652] invalid opcode: 0000 >>>>>>>> [#1] SMP >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.436899] CPU: 3 PID: 30235 >>>>>>>> Comm: rsync Not tainted 3.16.5-gentoo #2 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.437275] Hardware name: >>>>>>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>>>>>>> 07/04/2012 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.437834] task: >>>>>>>> ffff8801333d4010 ti: ffff880118218000 task.ti: ffff880118218000 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.438264] RIP: >>>>>>>> 0010:[<ffffffff8115aaf4>] [<ffffffff8115aaf4>] >>>>>>>> do_readpage_ctail+0x2c5/0x3c4 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.438768] RSP: >>>>>>>> 0018:ffff88011821baa8 EFLAGS: 00010246 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439073] RAX: 0000000000000000 >>>>>>>> RBX: ffff88011821bb78 RCX: 000000000002f35d >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439484] RDX: 000000000000002f >>>>>>>> RSI: 0000000000000000 RDI: ffff8800b953b000 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.439894] RBP: ffff880169d231a0 >>>>>>>> R08: 0000000000000000 R09: 0000000000000000 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.440304] R10: ffffffff8114eb84 >>>>>>>> R11: 0000000000012368 R12: 0000000000000002 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.440713] R13: 0000000000001000 >>>>>>>> R14: ffffea00052f5158 R15: 0000000000000000 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441124] FS: >>>>>>>> 00007f3d4d434700(0000) GS:ffff88022e380000(0000) >>>>>>>> knlGS:0000000000000000 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441589] CS: 0010 DS: 0000 >>>>>>>> ES: 0000 CR0: 0000000080050033 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.441918] CR2: 0000000000980000 >>>>>>>> CR3: 00000001a0c03000 CR4: 00000000001427e0 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442327] Stack: >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442443] 0000000000000000 >>>>>>>> ffff88011821bb78 0000000000000000 ffff880169d231a0 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.442890] 0000000000000000 >>>>>>>> ffffea00052f5158 0000000000000000 ffffffff8115ad7b >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443336] 00000000000aa1a1 >>>>>>>> ffff88011821bca0 ffffea00052f5158 ffff880169d232e0 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443784] Call Trace: >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.443926] [<ffffffff8115ad7b>] >>>>>>>> ? ctail_readpages_filler+0x188/0x1c9 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444302] [<ffffffff8115abf3>] >>>>>>>> ? do_readpage_ctail+0x3c4/0x3c4 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444655] [<ffffffff810b5528>] >>>>>>>> ? read_cache_pages+0x91/0xfc >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.444990] [<ffffffff8115b17c>] >>>>>>>> ? readpages_ctail+0x2c8/0x2e5 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.445332] [<ffffffff81151e72>] >>>>>>>> ? readpages_cryptcompress+0x39/0x5f >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.445704] [<ffffffff810b56c9>] >>>>>>>> ? __do_page_cache_readahead+0x136/0x1d0 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446094] [<ffffffff810b5958>] >>>>>>>> ? ondemand_readahead+0x1f5/0x203 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446450] [<ffffffff810ae761>] >>>>>>>> ? generic_file_read_iter+0x191/0x539 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.446827] [<ffffffff810e9256>] >>>>>>>> ? path_openat+0x24b/0x5ce >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447147] [<ffffffff810de1e6>] >>>>>>>> ? new_sync_read+0x6b/0x8f >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447469] [<ffffffff81151f07>] >>>>>>>> ? read_cryptcompress+0x6f/0x97 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.447815] [<ffffffff8114d4c0>] >>>>>>>> ? reiser4_read_dispatch+0xc7/0x11e >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448181] [<ffffffff810dedc9>] >>>>>>>> ? vfs_read+0x84/0x13e >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448483] [<ffffffff810df25c>] >>>>>>>> ? SyS_read+0x41/0x84 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.448780] [<ffffffff815346d2>] >>>>>>>> ? system_call_fastpath+0x16/0x1b >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.449135] Code: 01 00 00 e9 00 >>>>>>>> ff ff ff 8b 43 58 41 0f b7 4d 04 48 8d 04 48 48 89 54 c3 28 e9 ea fe >>>>>>>> ff ff 44 8b a3 88 00 00 00 41 83 fc 02 75 02 <0f> 0b 0f 87 87 00 00 00 >>>>>>>> 41 83 fc 01 0f 85 de 00 00 00 49 8b 56 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.450567] RIP >>>>>>>> [<ffffffff8115aaf4>] do_readpage_ctail+0x2c5/0x3c4 >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.450934] RSP >>>>>>>> <ffff88011821baa8> >>>>>>>> Nov 30 03:30:36 krshina3 kernel: [293446.562843] ---[ end trace >>>>>>>> 45473ce04b35219f ]--- >>>>>>>> >>>>>>>> Looks like same error like last time I used 3.16. Kernel 3.10 lasted >>>>>>>> with 20 days uptime without problems this month and 3.16 had this oops >>>>>>>> after 3 days. >>>>>>> >>>>>>> >>>>>>> Unfortunately, there is no any ideas... >>>>>>> I can port reiser4-for-3.10 stuff to 3.16. Will you test this port? >>>>>>> >>>>>> Ofcourse! > > -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-12-07 8:07 ` Dušan Čolić 2014-12-07 10:52 ` Edward Shishkin @ 2014-12-10 9:46 ` doiggl 1 sibling, 0 replies; 33+ messages in thread From: doiggl @ 2014-12-10 9:46 UTC (permalink / raw) To: reiserfs-devel <CADW=+3=GpYCc3aQOexJY7afL6suKxXRhs=dkf0m9zZfHQ0cnFA@mail.gmail.com> <CADW=+3kpg6zYxNWwX5tN0AWZ8Cuof0ccVRsQaL-6knM5AmOhbg@mail.gmail.com> Message-ID: <19cc0a2ad9f331ee56016e24dbeb6883@mail.velocitynet.com.au> X-Sender: doiggl@velocitynet.com.au User-Agent: RoundCube Webmail/0.3.1 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 Hello, Something is eating up ram. Yours reads: # cat /proc/meminfo MemTotal: 7867900 kB MemFree: 1553044 kB MemAvailable: 4853752 kB Buffers: 0 kB Cached: 2975880 kB Mine reads: #cat /proc/meminfo MemTotal: 7932564 kB MemFree: 5352992 kB Buffers: 86092 kB Cached: 1778548 kB I have no r4 partitions mounted. I have 8 GB ram installed - What does your /proc/meminfo say before using fsck.reiser4 /dev/md125 command ? - What does your /proc/meminfo say before and after using fsck.reiser4 /dev/md125 command using on 3.10 kernel ? --Glenn ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-11-03 13:28 ` Dušan Čolić 2014-11-03 13:33 ` Dušan Čolić @ 2014-11-03 13:36 ` Edward Shishkin 1 sibling, 0 replies; 33+ messages in thread From: Edward Shishkin @ 2014-11-03 13:36 UTC (permalink / raw) To: Dušan Čolić; +Cc: reiserfs-devel, Ivan Shapovalov Sorry, Can not reproduce. I have create a ticket http://sourceforge.net/p/reiser4/tickets/3/ will keep this in mind. Thanks! On 11/03/2014 02:28 PM, Dušan Čolić wrote: > After an hour or more still nothing, one rsync went to zombie other > still in D state > I killed the main process and rebooted. > > krshina3 goran # ps -aux | grep rsync > root 6655 0.0 0.1 101568 9328 pts/4 D 13:08 0:01 > /usr/bin/rsync -ax --delete --numeric-ids --relative --delete-excluded > --exclude=/home/windows.qcow2 > --link-dest=/mnt/backup/daily.1/localhost/ /home > /mnt/backup/daily.0/localhost/ > root 6656 0.0 0.0 0 0 pts/4 Z 13:08 0:00 > [rsync] <defunct> > > > Now I tried same command (rsnapshot -c /etc/rsnapshot.d/daily.conf > daily) and kernel BUGed with: > > krshina3 goran # rsnapshot -c /etc/rsnapshot.d/daily.conf daily > rsync: writefd_unbuffered failed to write 5 bytes to socket > [generator]: Broken pipe (32) > ---------------------------------------------------------------------------- > rsnapshot encountered an error! The program was invoked with these options: > /usr/bin/rsnapshot -c /etc/rsnapshot.d/daily.conf daily > ---------------------------------------------------------------------------- > ERROR: /usr/bin/rsync returned 0.04296875 while processing /home/ > WARNING: Rolling back "localhost/" > rsync error: error in rsync protocol data stream (code 12) at > io.c(1532) [generator=3.0.9] > > > > Nov 3 14:25:56 krshina3 kernel: [ 282.735583] ------------[ cut here > ]------------ > Nov 3 14:25:56 krshina3 kernel: [ 282.735905] kernel BUG at > fs/reiser4/plugin/item/ctail.c:669! > Nov 3 14:25:56 krshina3 kernel: [ 282.736296] invalid opcode: 0000 [#1] SMP > Nov 3 14:25:56 krshina3 kernel: [ 282.736575] CPU: 3 PID: 3890 Comm: > rsync Not tainted 3.16.5-gentoo #1 > Nov 3 14:25:56 krshina3 kernel: [ 282.736996] Hardware name: > Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 > 07/04/2012 > Nov 3 14:25:56 krshina3 kernel: [ 282.737635] task: ffff8801adeeb010 > ti: ffff880050d08000 task.ti: ffff880050d08000 > Nov 3 14:25:56 krshina3 kernel: [ 282.738132] RIP: > 0010:[<ffffffff811c3a70>] [<ffffffff811c3a70>] > do_readpage_ctail+0x2c0/0x420 > Nov 3 14:25:56 krshina3 kernel: [ 282.738713] RSP: > 0018:ffff880050d0b978 EFLAGS: 00010246 > Nov 3 14:25:56 krshina3 kernel: [ 282.739080] RAX: 8000000000000025 > RBX: ffffea0005586f98 RCX: ffff8800b9563800 > Nov 3 14:25:56 krshina3 kernel: [ 282.739546] RDX: 0000000000000035 > RSI: 0000000000000000 RDI: ffff8800b9563000 > Nov 3 14:25:56 krshina3 kernel: [ 282.740013] RBP: ffff880050d0b9b8 > R08: 0000000000001000 R09: 0000000000000001 > Nov 3 14:25:56 krshina3 kernel: [ 282.740480] R10: ffffffff811b3fc0 > R11: ffffea00011718c8 R12: 0000000000000002 > Nov 3 14:25:56 krshina3 kernel: [ 282.740963] R13: ffff880075770d60 > R14: ffff880050d0ba88 R15: 0000000000000001 > Nov 3 14:25:56 krshina3 kernel: [ 282.741429] FS: > 00007f4355338700(0000) GS:ffff88022e380000(0000) > knlGS:0000000000000000 > Nov 3 14:25:56 krshina3 kernel: [ 282.741957] CS: 0010 DS: 0000 ES: > 0000 CR0: 0000000080050033 > Nov 3 14:25:56 krshina3 kernel: [ 282.742329] CR2: 0000000003604268 > CR3: 0000000050c86000 CR4: 00000000001427e0 > Nov 3 14:25:56 krshina3 kernel: [ 282.742794] Stack: > Nov 3 14:25:56 krshina3 kernel: [ 282.742922] ffff880050d0b9b8 > ffffffff811b5c4f ffffea0005586f98 ffff880050d0ba88 > Nov 3 14:25:56 krshina3 kernel: [ 282.743449] ffffea0005586f98 > 0000000000000000 ffff880075770d60 ffffffff811c3bd0 > Nov 3 14:25:56 krshina3 kernel: [ 282.743957] ffff880050d0ba08 > ffffffff811c3cea ffff880050d0ba08 00000000810e1785 > Nov 3 14:25:56 krshina3 kernel: [ 282.744465] Call Trace: > Nov 3 14:25:56 krshina3 kernel: [ 282.744624] [<ffffffff811b5c4f>] > ? prepare_page_cluster+0xff/0x1f0 > Nov 3 14:25:56 krshina3 kernel: [ 282.745034] [<ffffffff811c3bd0>] > ? do_readpage_ctail+0x420/0x420 > Nov 3 14:25:56 krshina3 kernel: [ 282.745432] [<ffffffff811c3cea>] > ctail_readpages_filler+0x11a/0x220 > Nov 3 14:25:56 krshina3 kernel: [ 282.745847] [<ffffffff811c3bd0>] > ? do_readpage_ctail+0x420/0x420 > Nov 3 14:25:56 krshina3 kernel: [ 282.746248] [<ffffffff810ebdfa>] > read_cache_pages+0xba/0x120 > Nov 3 14:25:56 krshina3 kernel: [ 282.746623] [<ffffffff811c4073>] > readpages_ctail+0x133/0x360 > Nov 3 14:25:56 krshina3 kernel: [ 282.746998] [<ffffffff811b7e76>] > readpages_cryptcompress+0x46/0x80 > Nov 3 14:25:56 krshina3 kernel: [ 282.747413] [<ffffffff811a2b8e>] > reiser4_readpages_dispatch+0x3e/0x50 > Nov 3 14:25:56 krshina3 kernel: [ 282.747841] [<ffffffff810ec009>] > __do_page_cache_readahead+0x1a9/0x240 > Nov 3 14:25:56 krshina3 kernel: [ 282.748293] [<ffffffff810ec1f7>] > ondemand_readahead+0x157/0x290 > Nov 3 14:25:56 krshina3 kernel: [ 282.748686] [<ffffffff810e2326>] > ? pagecache_get_page+0x36/0x1e0 > Nov 3 14:25:56 krshina3 kernel: [ 282.749084] [<ffffffff810ec41e>] > page_cache_sync_readahead+0x2e/0x50 > Nov 3 14:25:56 krshina3 kernel: [ 282.749506] [<ffffffff810e33e9>] > generic_file_read_iter+0x409/0x5f0 > Nov 3 14:25:56 krshina3 kernel: [ 282.749922] [<ffffffff8112da8e>] > ? link_path_walk+0x26e/0x880 > Nov 3 14:25:56 krshina3 kernel: [ 282.750304] [<ffffffff810ed8e9>] > ? lru_cache_add+0x9/0x10 > Nov 3 14:25:56 krshina3 kernel: [ 282.750663] [<ffffffff8110c98e>] > ? page_add_new_anon_rmap+0x7e/0xd0 > Nov 3 14:25:56 krshina3 kernel: [ 282.751082] [<ffffffff81122b49>] > new_sync_read+0x79/0xb0 > Nov 3 14:25:56 krshina3 kernel: [ 282.751435] [<ffffffff811b7f23>] > read_cryptcompress+0x73/0xb0 > Nov 3 14:25:56 krshina3 kernel: [ 282.751815] [<ffffffff811b21c2>] > reiser4_read_dispatch+0x72/0x160 > Nov 3 14:25:56 krshina3 kernel: [ 282.752221] [<ffffffff81123abb>] > vfs_read+0x9b/0x190 > Nov 3 14:25:56 krshina3 kernel: [ 282.752551] [<ffffffff8112408a>] > SyS_read+0x4a/0xc0 > Nov 3 14:25:56 krshina3 kernel: [ 282.752875] [<ffffffff8106d72c>] > ? do_page_fault+0xc/0x10 > Nov 3 14:25:56 krshina3 kernel: [ 282.753245] [<ffffffff816ab1d2>] > system_call_fastpath+0x16/0x1b > Nov 3 14:25:56 krshina3 kernel: [ 282.753636] Code: fe ff ff 0f 1f > 84 00 00 00 00 00 48 89 df e8 a8 e4 f1 ff e9 3c fe ff ff 0f 1f 00 48 > 89 df e8 98 e4 f1 ff e9 73 fe ff ff 0f 1f 00 <0f> 0b 48 8b 03 a8 08 0f > 84 a1 00 00 00 49 8b be 80 00 00 00 e8 > Nov 3 14:25:56 krshina3 kernel: [ 282.755335] RIP > [<ffffffff811c3a70>] do_readpage_ctail+0x2c0/0x420 > Nov 3 14:25:56 krshina3 kernel: [ 282.755750] RSP <ffff880050d0b978> > Nov 3 14:25:56 krshina3 kernel: [ 282.888599] ---[ end trace > 5749d003e849c626 ]--- > > On Mon, Nov 3, 2014 at 1:25 PM, Dušan Čolić <dusanc@gmail.com> wrote: >> On Mon, Nov 3, 2014 at 12:42 PM, Edward Shishkin >> <edward.shishkin@gmail.com> wrote: >>> On 11/03/2014 12:12 PM, Dušan Čolić wrote: >>>> I fscked it yesterday before crash and now I'm fsck-ing it again but >>>> as you remember it lasts 1hr+ for some reason. >>> >>> >>> For the full 70G partition it looks normal. >>> >>> OK, if you can reproduce this BUG at fs/reiser4/plugin/item/ctail.c:669 >>> after fsck, then please let me know: it will essentially speed up things.. >>> >> This time it fscked the same partition much faster (44 vs 70min) dunno >> why as that partition is fscked daily with this cron script: >> #!/bin/sh >> >> echo "### RSNAPSHOT DAILY ###" >> fsck.reiser4 -a /dev/md125 && mount /mnt/backup && rsnapshot -c >> /etc/rsnapshot.d/daily.conf daily || echo "Backup failure" >> umount /mnt/backup >> logger -s "### RSNAPSHOT DAILY OK###" >> >> Now I executed rsnapshot -c /etc/rsnapshot.d/daily.conf daily and I >> can't see no action for last 10 minutes, nothing in iotop just in top >> rsync process in D state. >> >> krshina3 goran # ps -aux | grep rsync >> root 6655 0.1 0.1 101568 9328 pts/4 D+ 13:08 0:01 >> /usr/bin/rsync -ax --delete --numeric-ids --relative --delete-excluded >> --exclude=/home/windows.qcow2 >> --link-dest=/mnt/backup/daily.1/localhost/ /home >> /mnt/backup/daily.0/localhost/ >> root 6656 0.0 0.0 112292 4380 pts/4 S+ 13:08 0:00 >> /usr/bin/rsync -ax --delete --numeric-ids --relative --delete-excluded >> --exclude=/home/windows.qcow2 >> --link-dest=/mnt/backup/daily.1/localhost/ /home >> /mnt/backup/daily.0/localhost/ >> root 6657 0.0 0.0 101488 3496 pts/4 S+ 13:08 0:00 >> /usr/bin/rsync -ax --delete --numeric-ids --relative --delete-excluded >> --exclude=/home/windows.qcow2 >> --link-dest=/mnt/backup/daily.1/localhost/ /home >> /mnt/backup/daily.0/localhost/ >> >> >> fsck results: >> >> krshina3 goran # fsck.reiser4 /dev/md125 >> ******************************************************************* >> This is an EXPERIMENTAL version of fsck.reiser4. Read README first. >> ******************************************************************* >> >> Fscking the /dev/md125 block device. >> Will check the consistency of the Reiser4 SuperBlock. >> Will check the consistency of the Reiser4 FileSystem. >> Continue? >> (Yes/No): y >> ***** fsck.reiser4 started at Mon Nov 3 12:13:15 2014 >> Reiser4 fs was detected on /dev/md125. >> Master super block (16): >> magic: ReIsEr4 >> blksize: 4096 >> format: 0x0 (format40) >> uuid: 184e9560-bdf9-42b0-896c-0af2a0c84066 >> label: <none> >> >> Format super block (17): >> plugin: format40 >> description: Disk-format plugin. >> version: 0 >> magic: ReIsEr40FoRmAt >> mkfs id: 0x2a685787 >> flushes: 0 >> blocks: 17091120 >> free blocks: 2838775 >> root block: 7346608 >> tail policy: 0x2 (smart) >> next oid: 0xbc056d >> file count: 856668 >> tree height: 5 >> key policy: LARGE >> >> >> CHECKING THE STORAGE TREE >> Read nodes 9972078 >> Nodes left in the tree 9972078 >> Leaves of them 9855619, Twigs of them 115030 >> Time interval: Mon Nov 3 12:13:19 2014 - Mon Nov 3 12:27:35 2014 >> CHECKING EXTENT REGIONS. >> Read twigs 115030 >> Time interval: Mon Nov 3 12:27:35 2014 - Mon Nov 3 12:34:50 2014 >> CHECKING THE SEMANTIC TREE >> Found 2571171 objects (some could be encountered more then >> once). >> Time interval: Mon Nov 3 12:34:50 2014 - Mon Nov 3 12:57:16 2014 >> ***** fsck.reiser4 finished at Mon Nov 3 12:57:16 2014 >> Closing fs...done >> >> FS is consistent. >> >> >> >> >> >> >> >>> Edward. >>> >>> >>> >>> >>>> On Mon, Nov 3, 2014 at 12:10 PM, Edward Shishkin >>>> <edward.shishkin@gmail.com> wrote: >>>>> On 11/03/2014 11:58 AM, Dušan Čolić wrote: >>>>> >>>>> Now a Bug happened to me on this same ccreg40 partition with >>>>> Reiser4-for-3.16.2.patch and I don't know if it's related. >>>>> >>>>> >>>>> >>>>> It can not be related to inability to allocate memory at mount time. >>>>> >>>>> >>>>> I have a partition that I use for daily, weekly and monthly snapshots - >>>>> /dev/md125 with rsnapshot. >>>>> I fsck-ed it yesterday. >>>>> >>>>> >>>>> >>>>> Did you fsck-ed it before, or after crash? >>>>> >>>>> Edward. >>>>> >>>>> >>>>> >>>>> After mounting rsync starts and snapshots my /home directory. This Bug >>>>> happened on rsync start. >>>>> >>>>> >>>>> rsnapshot log: >>>>> fsck.reiser4 /dev/md125 >>>>> rsync: writefd_unbuffered failed to write 5 bytes to socket [generator]: >>>>> Broken pipe (32) >>>>> rsync error: error in rsync protocol data stream (code 12) at io.c(1532) >>>>> [generator=3.0.9] >>>>> ------------------------------ >>>>> ---------------------------------------------- >>>>> rsnapshot encountered an error! The program was invoked with these >>>>> options: >>>>> /usr/bin/rsnapshot -c /etc/rsnapshot.d/daily.conf daily >>>>> >>>>> ---------------------------------------------------------------------------- >>>>> ERROR: /usr/bin/rsync returned 0.04296875 while processing /home/ >>>>> WARNING: Rolling back "localhost/" >>>>> Backup failure >>>>> >>>>> daily.conf: >>>>> include_conf /etc/rsnapshot.d/base.conf >>>>> >>>>> # Daily (30 increments) >>>>> interval daily 30 >>>>> backup /home/ localhost/ >>>>> exclude /home/windows.qcow2 >>>>> >>>>> base.conf: >>>>> >>>>> # Default config version >>>>> config_version 1.2 >>>>> >>>>> # So the hard disk is not polluted in case the backup filesystem is not >>>>> available >>>>> no_create_root 1 >>>>> >>>>> # Standard settings >>>>> cmd_cp /bin/cp >>>>> cmd_rm /bin/rm >>>>> cmd_rsync /usr/bin/rsync >>>>> link_dest 1 >>>>> cmd_rsnapshot_diff /usr/bin/rsnapshot-diff >>>>> >>>>> # For convenience, so that mount points can be taken as backup starting >>>>> points >>>>> one_fs 1 >>>>> >>>>> # Store all backups in one directory per machine >>>>> # A useful alternative may be to create a separate directory for each >>>>> interval >>>>> snapshot_root /mnt/backup/ >>>>> >>>>> Logs: >>>>> Nov 3 07:00:10 krshina3 kernel: [ 1650.974059] reiser4: md125: found >>>>> disk >>>>> format 4.0.0. >>>>> Nov 3 07:00:13 krshina3 kernel: [ 1654.207021] reiser4: md125: using >>>>> Hybrid >>>>> Transaction Model. >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.914414] ------------[ cut here >>>>> ]------------ >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.914682] kernel BUG at >>>>> fs/reiser4/plugin/item/ctail.c:669! >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.915010] invalid opcode: 0000 [#1] >>>>> SMP >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.915259] CPU: 0 PID: 4950 Comm: >>>>> rsync >>>>> Not tainted 3.16.5-gentoo #1 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.915625] Hardware name: Gigabyte >>>>> Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 07/04/2012 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.916183] task: ffff88022d3f17d0 >>>>> ti: >>>>> ffff880100004000 task.ti: ffff880100004000 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.916610] RIP: >>>>> 0010:[<ffffffff811c3a70>] [<ffffffff811c3a70>] >>>>> do_readpage_ctail+0x2c0/0x420 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.917111] RSP: >>>>> 0018:ffff880100007978 >>>>> EFLAGS: 00010246 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.917412] RAX: 8000000000000025 >>>>> RBX: >>>>> ffffea0004570218 RCX: ffff8800b94f0800 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.917819] RDX: 0000000000000035 >>>>> RSI: >>>>> 0000000000000000 RDI: ffff8800b94f0000 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.918226] RBP: ffff8801000079b8 >>>>> R08: >>>>> 0000000000001000 R09: 0000000000000001 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.918632] R10: ffffffff811b3fc0 >>>>> R11: >>>>> ffffea00023f1330 R12: 0000000000000002 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.919039] R13: ffff8801ebb78d20 >>>>> R14: >>>>> ffff880100007a88 R15: 0000000000000001 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.919450] FS: >>>>> 00007f4d6b27c700(0000) >>>>> GS:ffff88022e200000(0000) knlGS:0000000000000000 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.919912] CS: 0010 DS: 0000 ES: >>>>> 0000 >>>>> CR0: 0000000080050033 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.920239] CR2: 0000000003035ddf >>>>> CR3: >>>>> 0000000008a76000 CR4: 00000000001427e0 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.920645] Stack: >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.920756] ffff8801000079b8 >>>>> ffffffff811b5c4f ffffea0004570218 ffff880100007a88 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.921200] ffffea0004570218 >>>>> 0000000000000000 ffff8801ebb78d20 ffffffff811c3bd0 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.921643] ffff880100007a08 >>>>> ffffffff811c3cea ffff880100007a08 00000000810e1785 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.922087] Call Trace: >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.922226] [<ffffffff811b5c4f>] ? >>>>> prepare_page_cluster+0xff/0x1f0 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.922583] [<ffffffff811c3bd0>] ? >>>>> do_readpage_ctail+0x420/0x420 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.922931] [<ffffffff811c3cea>] >>>>> ctail_readpages_filler+0x11a/0x220 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.923299] [<ffffffff811c3bd0>] ? >>>>> do_readpage_ctail+0x420/0x420 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.923646] [<ffffffff810ebdfa>] >>>>> read_cache_pages+0xba/0x120 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.923973] [<ffffffff811c4073>] >>>>> readpages_ctail+0x133/0x360 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.924299] [<ffffffff811b7e76>] >>>>> readpages_cryptcompress+0x46/0x80 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.924656] [<ffffffff811a2b8e>] >>>>> reiser4_readpages_dispatch+0x3e/0x50 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.925029] [<ffffffff810ec009>] >>>>> __do_page_cache_readahead+0x1a9/0x240 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.925407] [<ffffffff810ec1f7>] >>>>> ondemand_readahead+0x157/0x290 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.925749] [<ffffffff810e2326>] ? >>>>> pagecache_get_page+0x36/0x1e0 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.926097] [<ffffffff810ec41e>] >>>>> page_cache_sync_readahead+0x2e/0x50 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.926464] [<ffffffff810e33e9>] >>>>> generic_file_read_iter+0x409/0x5f0 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.926827] [<ffffffff8112da8e>] ? >>>>> link_path_walk+0x26e/0x880 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.927160] [<ffffffff81122b49>] >>>>> new_sync_read+0x79/0xb0 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.927470] [<ffffffff811b7f23>] >>>>> read_cryptcompress+0x73/0xb0 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.927803] [<ffffffff811b21c2>] >>>>> reiser4_read_dispatch+0x72/0x160 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.928156] [<ffffffff81123abb>] >>>>> vfs_read+0x9b/0x190 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.928443] [<ffffffff8112408a>] >>>>> SyS_read+0x4a/0xc0 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.928726] [<ffffffff816ab1d2>] >>>>> system_call_fastpath+0x16/0x1b >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.929068] Code: fe ff ff 0f 1f 84 >>>>> 00 >>>>> 00 00 00 00 48 89 df e8 a8 e4 f1 ff e9 3c fe ff ff 0f 1f 00 48 89 df e8 >>>>> 98 >>>>> e4 f1 ff e9 73 fe ff ff 0f 1f 00 <0f> 0b 48 8b 03 a8 08 0f 84 a1 00 00 00 >>>>> 49 >>>>> 8b be 80 00 00 00 e8 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.930505] RIP [<ffffffff811c3a70>] >>>>> do_readpage_ctail+0x2c0/0x420 >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1692.930868] RSP <ffff880100007978> >>>>> Nov 3 07:00:52 krshina3 kernel: [ 1693.043372] ---[ end trace >>>>> 36e8590f8aa347d3 ]--- >>>>> >>>>> On Sun, Nov 2, 2014 at 9:38 AM, Dušan Čolić <dusanc@gmail.com> wrote: >>>>>> When I try to mount a cc reiser4 partition (reiser4-for-3.16.2.patch) >>>>>> I get: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate >>>>>> memory >>>>>> Uptime is almost 7 days and mounting of this partition worked every >>>>>> day untill last night (I get automated messages on mail when something >>>>>> goes wrong). >>>>>> >>>>>> Now I tried on kernel 3.10 and everything works OK >>>>>> >>>>>> krshina3 goran # uname -a >>>>>> Linux krshina3 3.10.6-gentoo #2 SMP Wed Aug 14 17:33:45 CEST 2013 >>>>>> x86_64 Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz GenuineIntel GNU/Linux >>>>>> >>>>>> krshina3 goran# free -m >>>>>> total used free shared buffers >>>>>> cached >>>>>> Mem: 7681 6794 887 30 0 >>>>>> 2933 >>>>>> -/+ buffers/cache: 3860 3821 >>>>>> Swap: 580 325 254 >>>>>> >>>>>> krshina3 goran# cat /etc/fstab | grep -v "#" >>>>>> >>>>>> /dev/sda1 /boot ext2 noauto,noatime >>>>>> 1 >>>>>> 2 >>>>>> /dev/md123 none swap sw >>>>>> 0 >>>>>> 0 >>>>>> /dev/sda2 / reiser4 >>>>>> noatime,onerror=remount-ro 0 0 >>>>>> /dev/md125 /mnt/backup reiser4 >>>>>> noatime,noauto,onerror=remount-ro 0 0 >>>>>> /dev/md126 /mnt/media reiser4 >>>>>> noatime,users,onerror=remount-ro 0 0 >>>>>> /dev/md127 /usr/portage reiser4 >>>>>> noatime,onerror=remount-ro 0 0 >>>>>> shm /dev/shm tmpfs >>>>>> nodev,nosuid,noexec 0 0 >>>>>> >>>>>> >>>>>> krshina3 goran # df >>>>>> Filesystem 1K-blocks Used Available Use% Mounted on >>>>>> /dev/sda2 37017728 24870384 12147344 68% / >>>>>> tmpfs 786872 832 786040 1% /run >>>>>> udev 10240 0 10240 0% /dev >>>>>> shm 3934340 80 3934260 1% /dev/shm >>>>>> /dev/md126 383034100 298007740 85026360 78% /mnt/media >>>>>> /dev/md127 6113484 5427288 686196 89% /usr/portage >>>>>> /dev/md125 64959612 57618884 7340728 89% /mnt/backup >>>>>> >>>>>> I get these in logs: >>>>>> >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221513] reiser4: md125: found >>>>>> disk format 4.0.0. >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221749] mount: page >>>>>> allocation failure: order:4, mode:0x2040d0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221752] CPU: 0 PID: 517 Comm: >>>>>> mount Not tainted 3.16.5-gentoo #1 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221753] Hardware name: >>>>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>>>>> 07/04/2012 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221754] 0000000000000000 >>>>>> ffff88020ece7968 ffffffff816a31b4 0000000000000007 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221757] 00000000002040d0 >>>>>> ffff88020ece79f8 ffffffff810e609a ffffffff00000040 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221758] 0000000000000286 >>>>>> ffffffff819a8a78 fffffff00000000f ffff88020ece79c8 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221760] Call Trace: >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221765] [<ffffffff816a31b4>] >>>>>> dump_stack+0x46/0x58 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221768] [<ffffffff810e609a>] >>>>>> warn_alloc_failed+0xda/0x130 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221770] [<ffffffff810e86c9>] >>>>>> __alloc_pages_nodemask+0x5d9/0x7a0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221774] [<ffffffff8111f16a>] >>>>>> cache_alloc_refill+0x31a/0x550 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221776] [<ffffffff8111ee23>] >>>>>> kmem_cache_alloc+0xb3/0xe0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221778] [<ffffffff81186529>] >>>>>> znodes_tree_init+0xc9/0x120 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221781] [<ffffffff8118e7b4>] >>>>>> reiser4_init_tree+0x44/0xd0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221784] [<ffffffff811cb905>] >>>>>> init_format_format40+0x265/0x5b0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221787] [<ffffffff8119e8b1>] >>>>>> fill_super+0x101/0x200 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221789] [<ffffffff81126be4>] >>>>>> mount_bdev+0x194/0x1d0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221792] [<ffffffff8119e7b0>] >>>>>> ? reiser4_mount+0x20/0x20 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221794] [<ffffffff8119e7a0>] >>>>>> reiser4_mount+0x10/0x20 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221796] [<ffffffff81126e2b>] >>>>>> mount_fs+0x1b/0xd0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221799] [<ffffffff8114042f>] >>>>>> vfs_kern_mount+0x6f/0x130 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221801] [<ffffffff81141f68>] >>>>>> do_mount+0x218/0xab0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221803] [<ffffffff810e88a2>] >>>>>> ? __get_free_pages+0x12/0x60 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221805] [<ffffffff81141bf5>] >>>>>> ? copy_mount_options+0x35/0x150 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221808] [<ffffffff81142ad9>] >>>>>> SyS_mount+0x89/0xd0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221811] [<ffffffff816ab1d2>] >>>>>> system_call_fastpath+0x16/0x1b >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221812] Mem-Info: >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221813] DMA per-cpu: >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221814] CPU 0: hi: 0, >>>>>> btch: 1 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221815] CPU 1: hi: 0, >>>>>> btch: 1 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221816] CPU 2: hi: 0, >>>>>> btch: 1 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221817] CPU 3: hi: 0, >>>>>> btch: 1 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221817] DMA32 per-cpu: >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221819] CPU 0: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221819] CPU 1: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221820] CPU 2: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221821] CPU 3: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221822] Normal per-cpu: >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221823] CPU 0: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221824] CPU 1: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221825] CPU 2: hi: 186, >>>>>> btch: 31 usd: 56 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221826] CPU 3: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] active_anon:701641 >>>>>> inactive_anon:138699 isolated_anon:0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] active_file:399519 >>>>>> inactive_file:396920 isolated_file:0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] unevictable:0 >>>>>> dirty:204 writeback:0 unstable:0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] free:155878 >>>>>> slab_reclaimable:126123 slab_unreclaimable:9074 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] mapped:21535 >>>>>> shmem:5701 pagetables:10162 bounce:0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221828] free_cma:0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221833] DMA free:15900kB >>>>>> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >>>>>> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >>>>>> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >>>>>> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >>>>>> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >>>>>> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>>>> all_unreclaimable? yes >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221834] lowmem_reserve[]: 0 >>>>>> 2950 7665 7665 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221839] DMA32 free:250180kB >>>>>> min:4308kB low:5384kB high:6460kB active_anon:1026572kB >>>>>> inactive_anon:257356kB active_file:616152kB inactive_file:612572kB >>>>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>>>> present:3098560kB managed:3022260kB mlocked:0kB dirty:4kB >>>>>> writeback:0kB mapped:33232kB shmem:9336kB slab_reclaimable:180492kB >>>>>> slab_unreclaimable:12176kB kernel_stack:2496kB pagetables:16872kB >>>>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>>>> all_unreclaimable? no >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221840] lowmem_reserve[]: 0 0 >>>>>> 4714 4714 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221844] Normal free:357432kB >>>>>> min:6884kB low:8604kB high:10324kB active_anon:1779992kB >>>>>> inactive_anon:297440kB active_file:981924kB inactive_file:975108kB >>>>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>>>> present:4954112kB managed:4828124kB mlocked:0kB dirty:812kB >>>>>> writeback:0kB mapped:52908kB shmem:13468kB slab_reclaimable:324000kB >>>>>> slab_unreclaimable:24120kB kernel_stack:4160kB pagetables:23776kB >>>>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB >>>>>> pages_scanned:24 all_unreclaimable? no >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221845] lowmem_reserve[]: 0 0 0 >>>>>> 0 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221847] DMA: 1*4kB (U) 1*8kB >>>>>> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >>>>>> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221855] DMA32: 52520*4kB >>>>>> (UEM) 5030*8kB (UE) 3*16kB (UR) 0*32kB 1*64kB (R) 0*128kB 0*256kB >>>>>> 0*512kB 0*1024kB 0*2048kB 0*4096kB = 250432kB >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221861] Normal: 62961*4kB >>>>>> (UEM) 11874*8kB (UEM) 640*16kB (UEMR) 17*32kB (UEMR) 1*64kB (E) >>>>>> 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 357684kB >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221867] Node 0 >>>>>> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >>>>>> hugepages_size=2048kB >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221868] 804788 total pagecache >>>>>> pages >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221869] 2600 pages in swap >>>>>> cache >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221870] Swap cache stats: add >>>>>> 91111, delete 88511, find 38599/41340 >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221871] Free swap = 277028kB >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221872] Total swap = 594300kB >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221873] 2017164 pages RAM >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221873] 0 pages >>>>>> HighMem/MovableOnly >>>>>> Nov 2 03:30:01 krshina3 kernel: [562035.221874] 31497 pages reserved >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900521] reiser4: md125: found >>>>>> disk format 4.0.0. >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900907] mount: page >>>>>> allocation failure: order:4, mode:0x2040d0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900910] CPU: 1 PID: 1414 >>>>>> Comm: mount Not tainted 3.16.5-gentoo #1 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900912] Hardware name: >>>>>> Gigabyte Technology Co., Ltd. To be filled by O.E.M./B75-D3V, BIOS F5 >>>>>> 07/04/2012 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900914] 0000000000000000 >>>>>> ffff880148093968 ffffffff816a31b4 0000000000000007 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900917] 00000000002040d0 >>>>>> ffff8801480939f8 ffffffff810e609a ffffffff00000040 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900919] 0000000000000286 >>>>>> ffffffff819a8a78 fffffff00000000f ffff8801480939c8 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900922] Call Trace: >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900929] [<ffffffff816a31b4>] >>>>>> dump_stack+0x46/0x58 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900933] [<ffffffff810e609a>] >>>>>> warn_alloc_failed+0xda/0x130 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900937] [<ffffffff810e86c9>] >>>>>> __alloc_pages_nodemask+0x5d9/0x7a0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900941] [<ffffffff8111f16a>] >>>>>> cache_alloc_refill+0x31a/0x550 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900945] [<ffffffff8111ee23>] >>>>>> kmem_cache_alloc+0xb3/0xe0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900948] [<ffffffff81186529>] >>>>>> znodes_tree_init+0xc9/0x120 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900951] [<ffffffff8118e7b4>] >>>>>> reiser4_init_tree+0x44/0xd0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900955] [<ffffffff811cb905>] >>>>>> init_format_format40+0x265/0x5b0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900959] [<ffffffff8119e8b1>] >>>>>> fill_super+0x101/0x200 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900963] [<ffffffff81126be4>] >>>>>> mount_bdev+0x194/0x1d0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900966] [<ffffffff8119e7b0>] >>>>>> ? reiser4_mount+0x20/0x20 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900969] [<ffffffff8119e7a0>] >>>>>> reiser4_mount+0x10/0x20 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900972] [<ffffffff81126e2b>] >>>>>> mount_fs+0x1b/0xd0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900976] [<ffffffff8114042f>] >>>>>> vfs_kern_mount+0x6f/0x130 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900979] [<ffffffff81141f68>] >>>>>> do_mount+0x218/0xab0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900982] [<ffffffff810e88a2>] >>>>>> ? __get_free_pages+0x12/0x60 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900986] [<ffffffff81141bf5>] >>>>>> ? copy_mount_options+0x35/0x150 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900989] [<ffffffff81142ad9>] >>>>>> SyS_mount+0x89/0xd0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900993] [<ffffffff816ab1d2>] >>>>>> system_call_fastpath+0x16/0x1b >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900994] Mem-Info: >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900996] DMA per-cpu: >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900997] CPU 0: hi: 0, >>>>>> btch: 1 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.900999] CPU 1: hi: 0, >>>>>> btch: 1 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901000] CPU 2: hi: 0, >>>>>> btch: 1 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901001] CPU 3: hi: 0, >>>>>> btch: 1 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901002] DMA32 per-cpu: >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901004] CPU 0: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901005] CPU 1: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901006] CPU 2: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901008] CPU 3: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901009] Normal per-cpu: >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901010] CPU 0: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901011] CPU 1: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901013] CPU 2: hi: 186, >>>>>> btch: 31 usd: 21 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901014] CPU 3: hi: 186, >>>>>> btch: 31 usd: 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] active_anon:719713 >>>>>> inactive_anon:145280 isolated_anon:0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] active_file:390035 >>>>>> inactive_file:389999 isolated_file:0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] unevictable:0 >>>>>> dirty:1180 writeback:0 unstable:0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] free:161223 >>>>>> slab_reclaimable:112227 slab_unreclaimable:9155 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] mapped:35966 >>>>>> shmem:7263 pagetables:10549 bounce:0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901017] free_cma:0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901024] DMA free:15900kB >>>>>> min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB >>>>>> active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB >>>>>> isolated(file):0kB present:15984kB managed:15900kB mlocked:0kB >>>>>> dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB >>>>>> slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB >>>>>> bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>>>> all_unreclaimable? yes >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901026] lowmem_reserve[]: 0 >>>>>> 2950 7665 7665 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901033] DMA32 free:243456kB >>>>>> min:4308kB low:5384kB high:6460kB active_anon:1055312kB >>>>>> inactive_anon:268364kB active_file:605480kB inactive_file:605344kB >>>>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>>>> present:3098560kB managed:3022260kB mlocked:0kB dirty:1728kB >>>>>> writeback:0kB mapped:55944kB shmem:11860kB slab_reclaimable:164900kB >>>>>> slab_unreclaimable:12340kB kernel_stack:2496kB pagetables:17284kB >>>>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 >>>>>> all_unreclaimable? no >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901034] lowmem_reserve[]: 0 0 >>>>>> 4714 4714 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901040] Normal free:385536kB >>>>>> min:6884kB low:8604kB high:10324kB active_anon:1823540kB >>>>>> inactive_anon:312756kB active_file:954660kB inactive_file:954652kB >>>>>> unevictable:0kB isolated(anon):0kB isolated(file):0kB >>>>>> present:4954112kB managed:4828124kB mlocked:0kB dirty:2992kB >>>>>> writeback:0kB mapped:87920kB shmem:17192kB slab_reclaimable:284008kB >>>>>> slab_unreclaimable:24280kB kernel_stack:4368kB pagetables:24912kB >>>>>> unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB >>>>>> pages_scanned:21 all_unreclaimable? no >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901041] lowmem_reserve[]: 0 0 0 >>>>>> 0 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901044] DMA: 1*4kB (U) 1*8kB >>>>>> (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB >>>>>> 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15900kB >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901054] DMA32: 46552*4kB (UE) >>>>>> 7159*8kB (U) 2*16kB (R) 0*32kB 1*64kB (R) 0*128kB 0*256kB 0*512kB >>>>>> 0*1024kB 0*2048kB 0*4096kB = 243576kB >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901063] Normal: 40881*4kB >>>>>> (UEM) 27461*8kB (UEM) 151*16kB (UR) 2*32kB (R) 0*64kB 0*128kB 0*256kB >>>>>> 0*512kB 0*1024kB 0*2048kB 0*4096kB = 385692kB >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901072] Node 0 >>>>>> hugepages_total=0 hugepages_free=0 hugepages_surp=0 >>>>>> hugepages_size=2048kB >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901073] 789766 total pagecache >>>>>> pages >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901075] 2404 pages in swap >>>>>> cache >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901076] Swap cache stats: add >>>>>> 94924, delete 92520, find 40323/43073 >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901077] Free swap = 261888kB >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901078] Total swap = 594300kB >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901079] 2017164 pages RAM >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901080] 0 pages >>>>>> HighMem/MovableOnly >>>>>> Nov 2 09:13:48 krshina3 kernel: [582660.901081] 31497 pages reserved >>>>>> >>>>>> >>>>>> Now I'm gonna fsck all partitions and report if anything comes up. >>>>>> >>>>>> Ask if you need more info >>>>>> >>>>>> Thanks in advance >>>>>> Dushan >>>>> >>>>> -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
[parent not found: <CADW=+3nzK0rLpQR-+rhn_siKCYr5mSSbfkyyw5NXgagZWEPLvA@mail.gmail.com>]
[parent not found: <54578AC2.3040803@gmail.com>]
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory [not found] ` <54578AC2.3040803@gmail.com> @ 2014-11-03 15:12 ` Ivan Shapovalov 2014-11-03 15:25 ` Edward Shishkin 0 siblings, 1 reply; 33+ messages in thread From: Ivan Shapovalov @ 2014-11-03 15:12 UTC (permalink / raw) To: Edward Shishkin; +Cc: Dušan Čolić, reiserfs-devel [-- Attachment #1: Type: text/plain, Size: 814 bytes --] On Monday 03 November 2014 at 15:01:38, Edward Shishkin wrote: > On 11/03/2014 02:56 PM, Dušan Čolić wrote: > > > > > > On Nov 3, 2014 2:36 PM, "Edward Shishkin" <edward.shishkin@gmail.com > > <mailto:edward.shishkin@gmail.com>> wrote: > > > > > > Sorry, Can not reproduce. > > > I have create a ticket http://sourceforge.net/p/reiser4/tickets/3/ > > > will keep this in mind. > > > > > > Thanks! > > > > Will it help if I try earlier kernels? > > How can I find what file crashes it? > > > > > Somebody steals pages of compressed file's address space. > It can be e.g. because of races. I don't have any ideas except > code inspection... Do you remember the migration issue? Can't it be related? (btw, reiser4's pages are still non-migratable...) -- Ivan Shapovalov / intelfx / [-- Attachment #2: This is a digitally signed message part. --] [-- Type: application/pgp-signature, Size: 213 bytes --] ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-11-03 15:12 ` Ivan Shapovalov @ 2014-11-03 15:25 ` Edward Shishkin 2014-11-03 15:50 ` Ivan Shapovalov 0 siblings, 1 reply; 33+ messages in thread From: Edward Shishkin @ 2014-11-03 15:25 UTC (permalink / raw) To: Ivan Shapovalov; +Cc: Dušan Čolić, reiserfs-devel On 11/03/2014 04:12 PM, Ivan Shapovalov wrote: > On Monday 03 November 2014 at 15:01:38, Edward Shishkin wrote: >> On 11/03/2014 02:56 PM, Dušan Čolić wrote: >>> >>> On Nov 3, 2014 2:36 PM, "Edward Shishkin" <edward.shishkin@gmail.com >>> <mailto:edward.shishkin@gmail.com>> wrote: >>>> Sorry, Can not reproduce. >>>> I have create a ticket http://sourceforge.net/p/reiser4/tickets/3/ >>>> will keep this in mind. >>>> >>>> Thanks! >>> Will it help if I try earlier kernels? >>> How can I find what file crashes it? >>> >> >> Somebody steals pages of compressed file's address space. >> It can be e.g. because of races. I don't have any ideas except >> code inspection... > Do you remember the migration issue? Can't it be related? I don't think so: page migration is disabled in reiser4.. > (btw, reiser4's pages are still non-migratable...) You still sit on the patch, which enables migration? Edward. -- To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-11-03 15:25 ` Edward Shishkin @ 2014-11-03 15:50 ` Ivan Shapovalov 2014-11-03 16:14 ` Dušan Čolić 0 siblings, 1 reply; 33+ messages in thread From: Ivan Shapovalov @ 2014-11-03 15:50 UTC (permalink / raw) To: Edward Shishkin; +Cc: Dušan Čolić, reiserfs-devel [-- Attachment #1: Type: text/plain, Size: 742 bytes --] On Monday 03 November 2014 at 16:25:27, Edward Shishkin wrote: > On 11/03/2014 04:12 PM, Ivan Shapovalov wrote: > > On Monday 03 November 2014 at 15:01:38, Edward Shishkin wrote: > >> [...] > >> > >> Somebody steals pages of compressed file's address space. > >> It can be e.g. because of races. I don't have any ideas except > >> code inspection... > > Do you remember the migration issue? Can't it be related? > > I don't think so: page migration is disabled in reiser4.. I know. What I'm trying to say: aren't there any other similar mechanisms in the kernel? > > (btw, reiser4's pages are still non-migratable...) > > You still sit on the patch, which enables migration? Yeah. -- Ivan Shapovalov / intelfx / [-- Attachment #2: This is a digitally signed message part. --] [-- Type: application/pgp-signature, Size: 213 bytes --] ^ permalink raw reply [flat|nested] 33+ messages in thread
* Re: Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory 2014-11-03 15:50 ` Ivan Shapovalov @ 2014-11-03 16:14 ` Dušan Čolić 0 siblings, 0 replies; 33+ messages in thread From: Dušan Čolić @ 2014-11-03 16:14 UTC (permalink / raw) To: Ivan Shapovalov; +Cc: Edward Shishkin, reiserfs-devel On Mon, Nov 3, 2014 at 4:50 PM, Ivan Shapovalov <intelfx100@gmail.com> wrote: > On Monday 03 November 2014 at 16:25:27, Edward Shishkin wrote: >> On 11/03/2014 04:12 PM, Ivan Shapovalov wrote: >> > On Monday 03 November 2014 at 15:01:38, Edward Shishkin wrote: >> >> [...] >> >> >> >> Somebody steals pages of compressed file's address space. >> >> It can be e.g. because of races. I don't have any ideas except >> >> code inspection... >> > Do you remember the migration issue? Can't it be related? >> >> I don't think so: page migration is disabled in reiser4.. > > I know. What I'm trying to say: aren't there any other similar mechanisms > in the kernel? Last time I enabled page migration in kernel so I tried to find what's the difference between kernel config that worked and that fails: krshina3 linux-3.16.5-gentoo # diff -du ./.config configBAD |grep "+"|grep -v "#"|grep -v "@@" --- ./.config 2014-11-03 17:09:03.895249969 +0100 +++ configBAD 2014-10-24 01:27:07.677613236 +0200 +CONFIG_CGROUPS=y +CONFIG_CGROUP_SCHED=y +CONFIG_FAIR_GROUP_SCHED=y +CONFIG_SCHED_AUTOGROUP=y +CONFIG_SCHED_MC=y +CONFIG_KSM=y +CONFIG_X86_INTEL_PSTATE=y +CONFIG_EDAC=y +CONFIG_EDAC_LEGACY_SYSFS=y +CONFIG_DEBUG_INFO=y +CONFIG_DEBUG_INFO_REDUCED=y +CONFIG_FRAME_POINTER=y krshina3 linux-3.16.5-gentoo # diff -du ./.config configBAD |grep "-"|grep -v "#"|grep -v "@@" --- ./.config 2014-11-03 17:09:03.895249969 +0100 +++ configBAD 2014-10-24 01:27:07.677613236 +0200 -CONFIG_USELIB=y -CONFIG_AUDIT=y -CONFIG_AUDITSYSCALL=y -CONFIG_AUDIT_WATCH=y -CONFIG_AUDIT_TREE=y -CONFIG_CC_OPTIMIZE_FOR_SIZE=y -CONFIG_GART_IOMMU=y -CONFIG_LCD_CLASS_DEVICE=y > >> > (btw, reiser4's pages are still non-migratable...) >> >> You still sit on the patch, which enables migration? > > Yeah. > > -- > Ivan Shapovalov / intelfx / ^ permalink raw reply [flat|nested] 33+ messages in thread
end of thread, other threads:[~2014-12-17 13:44 UTC | newest] Thread overview: 33+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2014-11-02 8:38 Reiser4 for 3.16.2 problem: mount: mount /dev/md125 on /mnt/backup failed: Cannot allocate memory Dušan Čolić 2014-11-02 9:55 ` Dušan Čolić 2014-11-02 12:08 ` Dušan Čolić [not found] ` <CADW=+3ms6zaqzpkRBEgApi=gkMNPLCzzex8ShK4CkCFD-WNk8Q@mail.gmail.com> 2014-11-03 11:11 ` Dušan Čolić [not found] ` <5457629C.8040906@gmail.com> 2014-11-03 11:12 ` Dušan Čolić 2014-11-03 11:42 ` Edward Shishkin 2014-11-03 12:25 ` Dušan Čolić 2014-11-03 13:28 ` Dušan Čolić 2014-11-03 13:33 ` Dušan Čolić 2014-11-03 15:42 ` Edward Shishkin [not found] ` <CADW=+3mzX7evaqZmvOSJ6F9XNmzmauegL4Vy0nqz6yqG8EyLyw@mail.gmail.com> [not found] ` <5457B0AB.6030203@gmail.com> 2014-11-03 18:27 ` Dušan Čolić 2014-11-04 12:49 ` Edward Shishkin 2014-11-04 13:16 ` Dušan Čolić 2014-11-04 13:21 ` Edward Shishkin 2014-11-04 13:23 ` Dušan Čolić [not found] ` <545965C7.5010304@gmail.com> [not found] ` <CADW=+3k40KVKf5hLD1BgJ8a6uj=ZJ=T_gOmijDZVxWS3pK_6AQ@mail.gmail.com> [not found] ` <54665EFD.7030304@gmail.com> [not found] ` <CADW=+3mrqv=BjX8TCpRszFbr3OYEvgOk0OpcYe56f6OJmYDZbQ@mail.gmail.com> 2014-11-30 23:04 ` Dušan Čolić 2014-11-30 23:48 ` Edward Shishkin [not found] ` <CADW=+3=Tqw-2yfe6q4ERKSdyu9BmbApoREi-p4A7Auu_k27A6Q@mail.gmail.com> [not found] ` <547BAF3D.1000605@gmail.com> 2014-12-03 20:16 ` Dušan Čolić 2014-12-07 8:07 ` Dušan Čolić 2014-12-07 10:52 ` Edward Shishkin 2014-12-07 23:45 ` Dušan Čolić 2014-12-08 11:22 ` Edward Shishkin 2014-12-08 11:54 ` Dušan Čolić 2014-12-08 19:27 ` Edward Shishkin 2014-12-16 13:03 ` Dušan Čolić 2014-12-17 13:44 ` Edward Shishkin [not found] ` <CADW=+3kGn9OBoHiVWT3EkmSxGn==0ZsEa1nS_dP7-oQeq5h48g@mail.gmail.com> 2014-12-10 11:38 ` Fwd: " Dušan Čolić 2014-12-10 9:46 ` doiggl 2014-11-03 13:36 ` Edward Shishkin [not found] ` <CADW=+3nzK0rLpQR-+rhn_siKCYr5mSSbfkyyw5NXgagZWEPLvA@mail.gmail.com> [not found] ` <54578AC2.3040803@gmail.com> 2014-11-03 15:12 ` Ivan Shapovalov 2014-11-03 15:25 ` Edward Shishkin 2014-11-03 15:50 ` Ivan Shapovalov 2014-11-03 16:14 ` Dušan Čolić
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).