From: Phillip Susi <psusi@cfl.rr.com>
To: Jim Dennis <jimd@starshine.org>
Cc: linux-kernel@vger.kernel.org
Subject: Re: SEEK_HOLE and SEEK_DATA support?
Date: Fri, 03 Mar 2006 12:56:48 -0500 [thread overview]
Message-ID: <44088360.2030705@cfl.rr.com> (raw)
In-Reply-To: <20060303170417.GA26909@starshine.org>
Aren't there already apis to query for the holes in the file, and
doesn't tar already use them to efficiently back up sparse files? I
seem to remember seeing that somewhere.
Jim Dennis wrote:
>
> Perhaps I should have been a bit more clear. /var/log/lastlog has
> been a sparse file in most implementation for ... well ... forever.
>
> The example issue is that the support for large UIDs and the convention
> of setting nfsnobody to -1 (4294967294) combine to create a file whose
> size is very large. The du of the file is (in my case) only about
> 100KiB. So there's a small cluster of used blocks for the valid
> corporate UIDs that have ever accessed this machine ... then a huge
> allocate hole, and then one block storing the lastlog timestamp for
> nfsnobody.
>
> However, this message was not intended to dwell on the cause of that
> huge sparse file ... but rather to inquire as to the core issue;
> how do we efficiently handle skipping over (potentially huge)
> allocation holes in a portable fashion that might be adopted by
> archiving and other tools? I provided this example simply to point
> out that it does happen, in the real world and has a significant
> cost (40 minutes to scan through NULs with which the filesystem fills
> the hole for read()s).
>
> OpenSolaris has implemented a mechanism for doing this and it sounds
> reasonable from my admittedly superficial perspective.
>
next prev parent reply other threads:[~2006-03-03 17:58 UTC|newest]
Thread overview: 8+ messages / expand[flat|nested] mbox.gz Atom feed top
2006-03-03 17:04 SEEK_HOLE and SEEK_DATA support? Jim Dennis
2006-03-03 17:56 ` Phillip Susi [this message]
2006-03-03 22:03 ` Nicholas Miell
-- strict thread matches above, loose matches on Subject: below --
2006-03-02 21:49 Jim Dennis
2006-03-03 8:33 ` Lee Revell
2006-03-03 9:15 ` Arjan van de Ven
2006-03-05 3:05 ` Andrew Morton
2006-03-05 4:18 ` Nicholas Miell
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=44088360.2030705@cfl.rr.com \
--to=psusi@cfl.rr.com \
--cc=jimd@starshine.org \
--cc=linux-kernel@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox