linux-btrfs.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Shridhar Daithankar <ghodechhap@ghodechhap.net>
To: "Garry T. Williams" <gtwilliams@gmail.com>
Cc: linux-btrfs@vger.kernel.org
Subject: Re: unclean shutdown and space cache rebuild
Date: Mon, 01 Jul 2013 08:20:19 +0530	[thread overview]
Message-ID: <2982023.ALTX9LRhaY@bheem> (raw)
In-Reply-To: <4774295.3Q3X7zsTmb@vfr>

On Sunday, June 30, 2013 01:53:48 PM Garry T. Williams wrote:
> I suspect this is, at least in part, related to severe fragmentation
> in /home.

I don't think so. The problem I have described occur only before anybody logs 
in to the system and /home being a separate partition, it is not the problem 
in this case.
w
> 
> There are large files in these directories that are updated frequently
> by various components of KDE and the Chrome browser.  (Firefox has its
> own databases that are frequently updated, too.)
> 
>     ~/.local/share/akonadi

Thats 3.9MB in my case since I point the akonadi db to a systemwide postgresql 
instance. of course, it will just shift defragmentation there.

>     ~/.kde/share/apps/nepomuk/repository/main/data/virtuosobackend

damn!

# filefrag soprano-virtuoso.db                                                                                                             
soprano-virtuoso.db: 10518 extents found
                                                                                                                               
# btrfs fi defrag soprano-virtuoso.db

# filefrag soprano-virtuoso.db
soprano-virtuoso.db: 957 extents found

How much is an extend anyways?  is it a page or 256M?


>     ~/.cache/chromium/Default/Cache
>     ~/.cache/chromium/Default/Media\ Cache

I don't use chromium. but I get the idea.

But in general, how to find out most fragmented files and folders? mouting 
with autodefrag is a serious degradation..

> I improved performance dramatically (orders of magnitude) by copying
> the database files into an empty file that was modified with:
> 
>     chattr -C
> 
> and renaming to make the files no COW.  (Note that this is the only
> way to change an existing file to no COW.)  I also set the same
> attribute on the owning directories so that all new files inherit the
> no COW attribute.
> 
> I suspect there are other files that fragment badly since I see
> periods of high disk activity coming back slowly over a few weeks of
> use after making the modifications above.  I intend to track them down
> and do the same.

hmm.. a trick to find most badly fragmented files/directories and defragment 
them should do too I think.


-- 
Regards
 Shridhar

  parent reply	other threads:[~2013-07-01  2:50 UTC|newest]

Thread overview: 12+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-06-30 13:56 unclean shutdown and space cache rebuild Shridhar Daithankar
2013-06-30 17:53 ` Garry T. Williams
2013-06-30 19:58   ` Pete
2013-06-30 20:10   ` Clemens Eisserer
2013-06-30 21:20   ` Duncan
2013-06-30 23:12   ` Roger Binns
2013-07-01  2:50   ` Shridhar Daithankar [this message]
2013-07-01  9:10     ` Duncan
2013-07-01 16:19       ` Shridhar Daithankar
2013-07-02 13:00         ` Duncan
2013-07-02 15:49           ` Shridhar Daithankar
2013-07-05  3:45             ` Shridhar Daithankar

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=2982023.ALTX9LRhaY@bheem \
    --to=ghodechhap@ghodechhap.net \
    --cc=gtwilliams@gmail.com \
    --cc=linux-btrfs@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).