Linux NILFS development
 help / color / mirror / Atom feed
From: Anthony Doggett <Anthony2486-fDpYTK8McCxDP812hmKXO1pr/1R2p/CL@public.gmane.org>
To: linux-nilfs-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
Subject: mkfs.nilfs2 -b 1024 -B 8192
Date: Wed, 13 Mar 2013 07:14:53 +0000	[thread overview]
Message-ID: <20130313071453.GA17072@grill.lan> (raw)

Hi

Thanks for nilfs:)
I have been trying it out again recently, this time using 1kB blocks for
the partitions containing often-appended files like those in $HOME and
/var.  Unfortunately the 1kB partitions keep dying; I detail the one of
the common failures that I've managed to cut down below.

I started using nilfs with the default block/segment size, but was
surprised how many blocks get appended by operations like "echo
something >> something.txt".  Decreasing the block size from 4kB to 1kB
reduced the amount of disk space required to house partitions containing
$HOME and /var/log by about 60%.

The machine I've been trialling nilfs on is running Debian Testing,
Linux version 3.2.0-4-686-pae (debian-kernel-0aAXYlwwYIJuHlm7Suoebg@public.gmane.org) (gcc
version 4.6.3 (Debian 4.6.3-14) ) #1 SMP Debian 3.2.35-2), but I've also
reproduced it (identically) with Debian Unstable amd64 and Debian
Experimental (using the 3.8-trunk kernel).  The problematic partitions
were formatted with "mkfs.nilfs2 -b 1024 -B 8192".  A script to
reproduce this issue is below.  Am I hitting the "bad btree node
messages" issue mentioned in
http://www.mail-archive.com/linux-nilfs-u79uwXL29TY76Z2rM5mHXA@public.gmane.org/msg01535.html ?

Thanks,
Anthony

Script:
    VG=unencrypted
    #apt-get install nilfs-tools darcs
    lvcreate --size 2G --name ntest $VG
    mkfs.nilfs2 -b 1024 -B 8192 /dev/mapper/$VG-ntest
    mkdir /var/tmp/n
    mkdir /var/tmp/n/ntest
    mount /dev/mapper/$VG-ntest /var/tmp/n/ntest
    mkdir /var/tmp/n/ntest/thedir
    cd /var/tmp/n/ntest/thedir
    sleep 2
    date
    darcs init
    sleep 2
    dmesg|tail -n 5
    date
    darcs whatsnew || true
    date
    sleep 2
    dmesg|tail -n 5

(It's the "darcs whatsnew" that trips the issue.)

The error resulting from the above (the "inode number" varies):

    [63097.325138] segctord starting. Construction interval = 5 seconds, CP frequency < 30 seconds
    [63102.496756] nilfs_direct_assign: invalid pointer: 0
    [63102.496786] NILFS error (device dm-17): nilfs_bmap_assign: broken bmap (inode number=28)
    [63102.496798]
    [63102.524403] Remounting filesystem read-only

The other error that I keep getting (again, only on the 1kB partitions):

    [  923.632623] nilfs_btree_propagate: key = 11, level == 0
    [  968.416465] nilfs_btree_propagate: key = 11, level == 0
    [  973.536551] nilfs_btree_propagate: key = 11, level == 0
    [  981.088554] nilfs_btree_propagate: key = 11, level == 0
    [  986.112465] nilfs_btree_propagate: key = 11, level == 0

This second error I have managed to suffer on multiple nilfs partitions
(complete with the same key and level, and both on old partitions that
have been gc'd many times and on fresh never-gc'd partitions) but have
yet to reproduce with anything smaller than "run X, firefox, rsync and
vim and a handful of other apps for a few minutes".
--
To unsubscribe from this list: send the line "unsubscribe linux-nilfs" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

             reply	other threads:[~2013-03-13  7:14 UTC|newest]

Thread overview: 7+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-03-13  7:14 Anthony Doggett [this message]
     [not found] ` <20130313071453.GA17072-P/DK4avwC2n/PtFMR13I2A@public.gmane.org>
2013-03-13  8:25   ` mkfs.nilfs2 -b 1024 -B 8192 Vyacheslav Dubeyko
2013-03-13 14:27     ` Anthony Doggett
     [not found]       ` <20130313142726.GA3328-9gBkq9fxGAp+urZeOPWqwQ@public.gmane.org>
2013-03-14  6:40         ` Vyacheslav Dubeyko
2013-03-14 18:14   ` Vyacheslav Dubeyko
     [not found]     ` <424816AD-A79B-4F3D-A886-8D0CC735812B-yeENwD64cLxBDgjK7y7TUQ@public.gmane.org>
2013-04-09 21:08       ` Anthony Doggett
     [not found]         ` <20130409210827.GA3809-P/DK4avwC2n/PtFMR13I2A@public.gmane.org>
2013-04-10  6:19           ` Vyacheslav Dubeyko

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20130313071453.GA17072@grill.lan \
    --to=anthony2486-fdpytk8mccxdp812hmkxo1pr/1r2p/cl@public.gmane.org \
    --cc=linux-nilfs-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox