Cleanerd performance, and symlinks issue observations

Cleanerd performance, and symlinks issue observations

[Alex Bitney]

Hello,

I am using nilfs on root filesystem, too, on 8G SSD drive (Acer Aspire
One). While converting filesystem to nilfs, I used tar, and upon
extraction received 0-length files instead of symlinks in /etc/rc2.d
and similar directories. After that, I started using CPIO and problem
has gone. So, maybe this is TAR issue, not nilfs, some rare
conditions..

Regarding performance of cleanerd. Correct me, if I'm wrong. It seems
to circularly scan the whole filesystem. For some busy parts of the
filesystem it works slower, for parts which will become unused it is
faster. In my /var/log/debug it reports total number of clean segments
each time after cleanup iteration, and it seems that this number is
not increased when nilfs works harder (it means data remains in
place). In the same time I observe intensive write operations. My
question is: why write segments if they are not going to be freed?
Saying "write operations" i mean really hard I/O, long 20mb/sec
reading, followed by long 15mb/sec writing. Maybe this is how SSD
disks work.. but system is unresponsive during this operation.

Several people here already asked for cleanerd GC overview. I have no
ACM access and I don't know whether that document contains it. Could
you please share some details with this mailing list. Or, forget it,
I'm going to read the sources.

I would like to thank you for your great work, too ;)

Regards,
Sanoff.

Re: Cleanerd performance, and symlinks issue observations

[Ryusuke Konishi]

Hi,
On Mon, 9 Feb 2009 02:03:59 +0200, Alex Bitney wrote:
> Hello,
> 
> I am using nilfs on root filesystem, too, on 8G SSD drive (Acer Aspire
> One). While converting filesystem to nilfs, I used tar, and upon
> extraction received 0-length files instead of symlinks in /etc/rc2.d
> and similar directories. After that, I started using CPIO and problem
> has gone. So, maybe this is TAR issue, not nilfs, some rare
> conditions..

We found tar makes 0-length files during expansion, but we didn't yet
see them after extraction completed.
It needs more tests or much easy way to reproduce the problem.
 
> Regarding performance of cleanerd. Correct me, if I'm wrong. It seems
> to circularly scan the whole filesystem. For some busy parts of the
> filesystem it works slower, for parts which will become unused it is
> faster. In my /var/log/debug it reports total number of clean segments
> each time after cleanup iteration, and it seems that this number is
> not increased when nilfs works harder (it means data remains in
> place). In the same time I observe intensive write operations. My
> question is: why write segments if they are not going to be freed?
> Saying "write operations" i mean really hard I/O, long 20mb/sec
> reading, followed by long 15mb/sec writing. Maybe this is how SSD
> disks work.. but system is unresponsive during this operation.

Yes, I don't think the current GC method is enough.
Honesty, it is unfinished and should be revised to cleverly select
segments to be cleaned.

Actually, the kernel code of nilfs can clean segments in any order.
So, the above problem mainly depends on the implementation level of
the current userland cleaner program.  Other GC strategy should be
developed especially for SSD, I think.
 
> Several people here already asked for cleanerd GC overview. I have no
> ACM access and I don't know whether that document contains it. Could
> you please share some details with this mailing list. Or, forget it,
> I'm going to read the sources.

ACM papar does not include information on GC.
Sorry for this. I heard that that mail is not yet responded.
I'll make time to answer the mail.
 
> I would like to thank you for your great work, too ;)
> 
> Regards,
> Sanoff.

Thanks for cheering, thanks.

Ryusuke

CentOS rpm's

[Reinoud Zandijk]

Dear Ryusuke,

could you please take a look at the CentOS rpm's? i see they are not updated
yet.

With regards,
Reinoud

Re: CentOS rpm's

[Seiji Kihara]

Hello,

RPMs for CentOS is now updated to nilfs{,-utils}-2.0.7.
Please enjoy!

RPMs for other OSes (Fedora 8 - 10, OpenSUSE 10.3 - 11.1)
will be updated in a week.
If anyone need them urgently, please tell us.

Regards,

Seiji Kihara
NILFS Team

At Tue, 17 Feb 2009 19:28:21 +0100,
Reinoud Zandijk wrote:
> 
> Dear Ryusuke,
> 
> could you please take a look at the CentOS rpm's? i see they are not updated
> yet.
> 
> With regards,
> Reinoud