public inbox for linux-xfs@vger.kernel.org
 help / color / mirror / Atom feed
From: Markus Trippelsdorf <markus@trippelsdorf.de>
To: Eric Sandeen <sandeen@sandeen.net>
Cc: linux-ext4@vger.kernel.org, "Pádraig Brady" <P@draigBrady.com>,
	coreutils@gnu.org, xfs-oss <xfs@oss.sgi.com>
Subject: Re: Files full of zeros with coreutils-8.11 and xfs (FIEMAP related?)
Date: Thu, 14 Apr 2011 18:03:43 +0200	[thread overview]
Message-ID: <20110414160343.GA12787@x4.trippels.de> (raw)
In-Reply-To: <4DA71920.9@sandeen.net>

On 2011.04.14 at 10:56 -0500, Eric Sandeen wrote:
> On 4/14/11 10:52 AM, Pádraig Brady wrote:
> > On 14/04/11 16:50, Eric Sandeen wrote:
> >> On 4/14/11 9:59 AM, Pádraig Brady wrote:
> >>> On 14/04/11 15:02, Markus Trippelsdorf wrote:
> >>>>>> Hi Pádraig,
> >>>>>>
> >>>>>> here you go:
> >>>>>> + filefrag -v unwritten.withdata                                                                                                                     
> >>>>>> Filesystem type is: ef53                                                                                                                             
> >>>>>> File size of unwritten.withdata is 5120 (2 blocks, blocksize 4096)                                                                                   
> >>>>>>  ext logical physical expected length flags                                                                                                          
> >>>>>>    0       0   274432            2560 unwritten,eof                                                                                                  
> >>>>>> unwritten.withdata: 1 extent found
> >>>>>>
> >>>>>> Please notice that this also happens with ext4 on the same kernel. 
> >>>>>> Btrfs is fine.
> >>>>>
> >>>> `filefrag -vs` fixes the issue on both xfs and ext4.
> >>>
> >>> So in summary, currently on (2.6.39-rc3), the following
> >>> will (usually?) report a single unwritten extent,
> >>> on both ext4 and xfs
> >>>
> >>>   fallocate -l 10MiB -n k
> >>>   dd count=10 if=/dev/urandom conv=notrunc iflag=fullblock of=k
> >>>   filefrag -v k # grep for an extent without unwritten || fail
> >>
> >> right, that's what I see too in testing.
> >>
> >> But would the coreutils install have done a preallocation of the destination file?
> >>
> >> Otherwise this looks like a different bug...
> >>
> >>> This particular issue has been discussed so far at:
> >>> http://debbugs.gnu.org/cgi/bugreport.cgi?bug=8411
> >>> Note there it was stated there that ext4 had this
> >>> fixed as of 2.6.39-rc1, so maybe there is something lurking?
> >>
> >> ext4 got a fix, but not xfs, I guess.  My poor brain can't remember, I think I started looking into it, but it's clearly still broken.
> >>
> >> Still, I don't know for sure what happened to Markus - did something preallocate, in his case?
> > 
> > Well that preallocate test is failing for him
> > when the source file is either on ext4 or xfs.
> > He noticed the issue initially on XFS when copying
> > none preallocated files, so XFS probably just has
> > the general issue of needing a sync before fiemap,
> > where as EXT4 just has this preallocate one
> > (though I've not seen it myself).
> > 
> > cheers,
> > Pádraig.
> > 
> 
> well, if I simply take the preallocation step out of the testcase, it works fine on xfs without a sync.
> 
> So I still don't know what Markus hit...

Maybe it's delalloc:

x4 /tmp # dd count=10 if=/dev/urandom conv=notrunc iflag=fullblock of=k                                                                               
10+0 records in
10+0 records out
5120 bytes (5.1 kB) copied, 0.0021822 s, 2.3 MB/s
x4 /tmp # filefrag -v k 
Filesystem type is: 58465342
File size of k is 5120 (2 blocks, blocksize 4096)
 ext logical physical expected length flags
   0       0        0              16 unknown,delalloc,eof
k: 1 extent found
x4 /tmp # sync
x4 /tmp # filefrag -v k 
Filesystem type is: 58465342
File size of k is 5120 (2 blocks, blocksize 4096)
 ext logical physical expected length flags
   0       0 26960045              16 eof
k: 1 extent found

-- 
Markus

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

  reply	other threads:[~2011-04-15 15:41 UTC|newest]

Thread overview: 61+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-04-14 10:26 Files full of zeros with coreutils-8.11 and xfs (FIEMAP related?) Markus Trippelsdorf
2011-04-14 12:06 ` Markus Trippelsdorf
2011-04-14 14:02   ` Markus Trippelsdorf
2011-04-14 14:59     ` Pádraig Brady
2011-04-14 15:50       ` Eric Sandeen
2011-04-14 15:52         ` Pádraig Brady
2011-04-14 15:56           ` Eric Sandeen
2011-04-14 16:03             ` Markus Trippelsdorf [this message]
2011-04-14 16:14               ` Eric Sandeen
2011-04-14 16:21               ` Yongqiang Yang
2011-04-14 16:28                 ` Markus Trippelsdorf
2011-04-14 16:31                   ` Eric Sandeen
2011-04-14 16:48                     ` Markus Trippelsdorf
2011-04-14 16:49                       ` Eric Sandeen
2011-04-14 16:04             ` Yongqiang Yang
2011-04-14 16:10               ` Yongqiang Yang
2011-05-05 11:29                 ` Pádraig Brady
2011-05-05 11:47                   ` Yongqiang Yang
2011-04-14 17:27           ` Jim Meyering
2011-04-14 19:13             ` Pádraig Brady
2011-04-14 19:39             ` Jim Meyering
2011-04-14 22:59         ` Dave Chinner
2011-04-14 23:29           ` Pádraig Brady
2011-04-15  0:09             ` Dave Chinner
2011-04-15  5:01               ` Andreas Dilger
2011-04-16  0:50                 ` Dave Chinner
2011-04-16  5:11                   ` Andreas Dilger
2011-04-16 12:21                     ` Theodore Tso
2011-04-18  0:40                       ` Dave Chinner
2011-04-18  2:45                         ` Andreas Dilger
2011-04-19  1:58                           ` Yongqiang Yang
2011-04-19  2:59                             ` Ted Ts'o
2011-04-19  3:05                               ` Eric Sandeen
2011-04-21 20:12                                 ` Jim Meyering
2011-04-19  3:30                               ` Yongqiang Yang
2011-04-19  4:14                               ` Dave Chinner
2011-04-19  5:27                               ` Christoph Hellwig
2011-04-19  3:44                             ` Dave Chinner
2011-04-19  6:53                               ` Yongqiang Yang
2011-04-19  7:45                                 ` Dave Chinner
2011-04-19  8:11                                   ` Yongqiang Yang
2011-04-19 14:05                                     ` Eric Sandeen
2011-04-19 14:09                                   ` Ted Ts'o
2011-04-19 14:13                                     ` Eric Sandeen
2011-04-19 16:01                                       ` Ted Ts'o
2011-04-20  1:53                                         ` Yongqiang Yang
2011-04-20 15:21                                         ` Christoph Hellwig
2011-04-20 17:21                                           ` Ted Ts'o
2011-04-19 21:08                                     ` Dave Chinner
2011-04-20 15:29                                       ` Christoph Hellwig
2011-04-16  6:05                   ` Yongqiang Yang
2011-04-18  0:35                     ` Dave Chinner
2011-04-15  8:53               ` Jim Meyering
2011-04-15 17:16                 ` Christoph Hellwig
2011-04-15 17:24                   ` Eric Blake
2011-04-15 17:26                     ` Christoph Hellwig
2011-04-15 22:28                       ` Andreas Dilger
2011-04-16  0:25                         ` Dave Chinner
2011-04-14 14:39 ` Eric Sandeen
2011-04-20 14:39 ` Jim Meyering
2011-04-21 20:01   ` Jim Meyering

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20110414160343.GA12787@x4.trippels.de \
    --to=markus@trippelsdorf.de \
    --cc=P@draigBrady.com \
    --cc=coreutils@gnu.org \
    --cc=linux-ext4@vger.kernel.org \
    --cc=sandeen@sandeen.net \
    --cc=xfs@oss.sgi.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox