* btrfs reads only 4k blocks -- how to improve?
@ 2010-12-16 12:31 Jörg Sommer
2010-12-16 22:12 ` Erik Logtenberg
[not found] ` <4D0A0E2E.5010204@gmail.com>
0 siblings, 2 replies; 3+ messages in thread
From: Jörg Sommer @ 2010-12-16 12:31 UTC (permalink / raw)
To: linux-btrfs
[-- Attachment #1: Type: text/plain, Size: 19143 bytes --]
Hi,
I have a btrfs that conains many hardlinks. I'm using rsync to create
backups. It creates the backup of a day by (hard‐)linking the files
(inodes) they haven't changed with the files from a former day.
% find 2010-12-1[10]-00 -maxdepth 1
2010-12-10-00
2010-12-10-00/etc
2010-12-10-00/home
2010-12-10-00/root
2010-12-10-00/srv
2010-12-10-00/usr
2010-12-10-00/var
2010-12-11-00
2010-12-11-00/etc
2010-12-11-00/home
2010-12-11-00/root
2010-12-11-00/srv
2010-12-11-00/usr
2010-12-11-00/var
% stat 2010-12-1[01]-00/etc/services
File: „2010-12-10-00/etc/services“
Size: 18480 Blocks: 40 IO Block: 4096 reguläre Datei
Device: 15h/21d Inode: 7945534 Links: 7
Access: (0644/-rw-r--r--) Uid: ( 1000/ateo-service) Gid: ( 34/ backup)
Access: 2010-11-19 02:26:01.000000000 +0100
Modify: 2008-08-28 04:00:12.000000000 +0200
Change: 2010-12-14 07:56:19.999523630 +0100
File: „2010-12-11-00/etc/services“
Size: 18480 Blocks: 40 IO Block: 4096 reguläre Datei
Device: 15h/21d Inode: 7945534 Links: 7
Access: (0644/-rw-r--r--) Uid: ( 1000/ateo-service) Gid: ( 34/ backup)
Access: 2010-11-19 02:26:01.000000000 +0100
Modify: 2008-08-28 04:00:12.000000000 +0200
Change: 2010-12-14 07:56:19.999523630 +0100
When running rm -r to remove an old backup or running rsync I see the
average size of a read or a write request ist 4k. This leads to a very
bad throughput of fewer than 2MByte/s. I'm using atop to watch these
numbers.
rsync is mostly doing this:
02:54:30.027895 link("../2010-12-14-00/home/peter/dump_070903", "home/peter/dump_070903") = 0
02:54:30.028398 lstat("home/peter/dump_070904", 0x7fffd17410c0) = -1 ENOENT (No such file or directory)
02:54:30.028475 lstat("../2010-12-14-00/home/peter/dump_070904", {st_dev=makedev(0, 21), st_ino=9813608, st_mode=S_IFREG|0644, st_nlink=7, st_uid=1000, st_gid=34, st_blksize=4096, st_blocks=6, st_size=3244, st_atime=2010/11/20-08:25:40, st_mtime=2007/09/05-01:13:00, st_ctime=2010/12/14-08:08:31}) = 0
02:54:30.028598 lgetxattr("../2010-12-14-00/home/peter/dump_070904", "user.rsync.%stat", "100644 0,0 1001:1000", 255) = 20
02:54:30.028679 lgetxattr("../2010-12-14-00/home/peter/dump_070904", "user.rsync.%aacl", 0x0, 0) = -1 ENODATA (No data available)
02:54:30.028734 llistxattr("../2010-12-14-00/home/peter/dump_070904", 0x1612800, 1024) = 17
02:54:30.028783 link("../2010-12-14-00/home/peter/dump_070904", "home/peter/dump_070904") = 0
02:54:30.029078 lstat("home/peter/dump_070905", 0x7fffd17410c0) = -1 ENOENT (No such file or directory)
02:54:30.029127 lstat("../2010-12-14-00/home/peter/dump_070905", {st_dev=makedev(0, 21), st_ino=9813609, st_mode=S_IFREG|0644, st_nlink=7, st_uid=1000, st_gid=34, st_blksize=4096, st_blocks=6, st_size=3251, st_atime=2010/11/20-08:25:40, st_mtime=2007/09/06-01:13:00, st_ctime=2010/12/14-08:08:31}) = 0
02:54:30.029226 lgetxattr("../2010-12-14-00/home/peter/dump_070905", "user.rsync.%stat", "100644 0,0 1001:1000", 255) = 20
02:54:30.029290 lgetxattr("../2010-12-14-00/home/peter/dump_070905", "user.rsync.%aacl", 0x0, 0) = -1 ENODATA (No data available)
02:54:30.029343 llistxattr("../2010-12-14-00/home/peter/dump_070905", 0x1612800, 1024) = 17
02:54:30.029389 link("../2010-12-14-00/home/peter/dump_070905", "home/peter/dump_070905") = 0
02:54:30.029564 lstat("home/peter/dump_070906", 0x7fffd17410c0) = -1 ENOENT (No such file or directory)
02:54:30.029612 lstat("../2010-12-14-00/home/peter/dump_070906", {st_dev=makedev(0, 21), st_ino=9813610, st_mode=S_IFREG|0644, st_nlink=7, st_uid=1000, st_gid=34, st_blksize=4096, st_blocks=6, st_size=3183, st_atime=2010/11/20-08:25:40, st_mtime=2007/09/07-01:13:00, st_ctime=2010/12/14-08:08:31}) = 0
02:54:30.029704 lgetxattr("../2010-12-14-00/home/peter/dump_070906", "user.rsync.%stat", "100644 0,0 1001:1000", 255) = 20
02:54:30.029767 lgetxattr("../2010-12-14-00/home/peter/dump_070906", "user.rsync.%aacl", 0x0, 0) = -1 ENODATA (No data available)
02:54:30.029819 llistxattr("../2010-12-14-00/home/peter/dump_070906", 0x1612800, 1024) = 17
02:54:30.029865 link("../2010-12-14-00/home/peter/dump_070906", "home/peter/dump_070906") = 0
02:54:30.030097 lstat("home/peter/dump_070907", 0x7fffd17410c0) = -1 ENOENT (No such file or directory)
02:54:30.030145 lstat("../2010-12-14-00/home/peter/dump_070907", {st_dev=makedev(0, 21), st_ino=9813611, st_mode=S_IFREG|0644, st_nlink=7, st_uid=1000, st_gid=34, st_blksize=4096, st_blocks=6, st_size=3239, st_atime=2010/11/20-08:25:40, st_mtime=2007/09/08-01:13:00, st_ctime=2010/12/14-08:08:31}) = 0
02:54:30.030240 lgetxattr("../2010-12-14-00/home/peter/dump_070907", "user.rsync.%stat", "100644 0,0 1001:1000", 255) = 20
02:54:30.030601 lgetxattr("../2010-12-14-00/home/peter/dump_070907", "user.rsync.%aacl", 0x0, 0) = -1 ENODATA (No data available)
02:54:30.030658 llistxattr("../2010-12-14-00/home/peter/dump_070907", 0x1612800, 1024) = 17
02:54:30.030707 link("../2010-12-14-00/home/peter/dump_070907", "home/peter/dump_070907") = 0
02:54:30.030913 lstat("home/peter/dump_070908", 0x7fffd17410c0) = -1 ENOENT (No such file or directory)
02:54:30.030964 lstat("../2010-12-14-00/home/peter/dump_070908", {st_dev=makedev(0, 21), st_ino=9813612, st_mode=S_IFREG|0644, st_nlink=7, st_uid=1000, st_gid=34, st_blksize=4096, st_blocks=5, st_size=2802, st_atime=2010/11/20-08:25:40, st_mtime=2007/09/09-01:13:00, st_ctime=2010/12/14-08:08:31}) = 0
02:54:30.031061 lgetxattr("../2010-12-14-00/home/peter/dump_070908", "user.rsync.%stat", "100644 0,0 1001:1000", 255) = 20
02:54:30.032196 lgetxattr("../2010-12-14-00/home/peter/dump_070908", "user.rsync.%aacl", 0x0, 0) = -1 ENODATA (No data available)
02:54:30.032272 llistxattr("../2010-12-14-00/home/peter/dump_070908", 0x1612800, 1024) = 17
02:54:30.032320 link("../2010-12-14-00/home/peter/dump_070908", "home/peter/dump_070908") = 0
02:54:30.032576 lstat("home/peter/dump_070909", 0x7fffd17410c0) = -1 ENOENT (No such file or directory)
02:54:30.032628 lstat("../2010-12-14-00/home/peter/dump_070909", {st_dev=makedev(0, 21), st_ino=9813613, st_mode=S_IFREG|0644, st_nlink=7, st_uid=1000, st_gid=34, st_blksize=4096, st_blocks=5, st_size=2672, st_atime=2010/11/20-08:25:40, st_mtime=2007/09/10-01:13:00, st_ctime=2010/12/14-08:08:31}) = 0
02:54:30.032728 lgetxattr("../2010-12-14-00/home/peter/dump_070909", "user.rsync.%stat", "100644 0,0 1001:1000", 255) = 20
02:54:30.032793 lgetxattr("../2010-12-14-00/home/peter/dump_070909", "user.rsync.%aacl", 0x0, 0) = -1 ENODATA (No data available)
02:54:30.032846 llistxattr("../2010-12-14-00/home/peter/dump_070909", 0x1612800, 1024) = 17
02:54:30.032893 link("../2010-12-14-00/home/peter/dump_070909", "home/peter/dump_070909") = 0
02:54:30.033094 lstat("home/peter/dump_070910", 0x7fffd17410c0) = -1 ENOENT (No such file or directory)
02:54:30.033142 lstat("../2010-12-14-00/home/peter/dump_070910", {st_dev=makedev(0, 21), st_ino=9813614, st_mode=S_IFREG|0644, st_nlink=7, st_uid=1000, st_gid=34, st_blksize=4096, st_blocks=6, st_size=3393, st_atime=2010/11/20-08:25:40, st_mtime=2007/09/11-01:13:00, st_ctime=2010/12/14-08:08:31}) = 0
02:54:30.033237 lgetxattr("../2010-12-14-00/home/peter/dump_070910", "user.rsync.%stat", "100644 0,0 1001:1000", 255) = 20
02:54:30.033902 lgetxattr("../2010-12-14-00/home/peter/dump_070910", "user.rsync.%aacl", 0x0, 0) = -1 ENODATA (No data available)
02:54:30.033960 llistxattr("../2010-12-14-00/home/peter/dump_070910", 0x1612800, 1024) = 17
02:54:30.034018 link("../2010-12-14-00/home/peter/dump_070910", "home/peter/dump_070910") = 0
02:54:30.034123 lstat("home/peter/dump_070911", 0x7fffd17410c0) = -1 ENOENT (No such file or directory)
02:54:30.034171 lstat("../2010-12-14-00/home/peter/dump_070911", {st_dev=makedev(0, 21), st_ino=9813615, st_mode=S_IFREG|0644, st_nlink=7, st_uid=1000, st_gid=34, st_blksize=4096, st_blocks=6, st_size=3340, st_atime=2010/11/20-08:25:40, st_mtime=2007/09/12-01:13:00, st_ctime=2010/12/14-08:08:32}) = 0
02:54:30.034264 lgetxattr("../2010-12-14-00/home/peter/dump_070911", "user.rsync.%stat", "100644 0,0 1001:1000", 255) = 20
02:54:30.034324 lgetxattr("../2010-12-14-00/home/peter/dump_070911", "user.rsync.%aacl", 0x0, 0) = -1 ENODATA (No data available)
02:54:30.034376 llistxattr("../2010-12-14-00/home/peter/dump_070911", 0x1612800, 1024) = 17
02:54:30.036405 link("../2010-12-14-00/home/peter/dump_070911", "home/peter/dump_070911") = 0
02:54:30.036986 lstat("home/peter/dump_070912", 0x7fffd17410c0) = -1 ENOENT (No such file or directory)
02:54:30.037045 lstat("../2010-12-14-00/home/peter/dump_070912", {st_dev=makedev(0, 21), st_ino=9813616, st_mode=S_IFREG|0644, st_nlink=7, st_uid=1000, st_gid=34, st_blksize=4096, st_blocks=6, st_size=3407, st_atime=2010/11/20-08:25:40, st_mtime=2007/09/13-01:13:00, st_ctime=2010/12/14-08:08:32}) = 0
02:54:30.037155 lgetxattr("../2010-12-14-00/home/peter/dump_070912", "user.rsync.%stat", "100644 0,0 1001:1000", 255) = 20
02:54:30.057221 lgetxattr("../2010-12-14-00/home/peter/dump_070912", "user.rsync.%aacl", 0x0, 0) = -1 ENODATA (No data available)
02:54:30.057279 llistxattr("../2010-12-14-00/home/peter/dump_070912", 0x1612800, 1024) = 17
02:54:30.057347 link("../2010-12-14-00/home/peter/dump_070912", "home/peter/dump_070912") = 0
02:54:30.057574 lstat("home/peter/dump_070913", 0x7fffd17410c0) = -1 ENOENT (No such file or directory)
02:54:30.057625 lstat("../2010-12-14-00/home/peter/dump_070913", {st_dev=makedev(0, 21), st_ino=9813617, st_mode=S_IFREG|0644, st_nlink=7, st_uid=1000, st_gid=34, st_blksize=4096, st_blocks=6, st_size=3335, st_atime=2010/11/20-08:25:40, st_mtime=2007/09/14-01:13:00, st_ctime=2010/12/14-08:08:32}) = 0
02:54:30.057724 lgetxattr("../2010-12-14-00/home/peter/dump_070913", "user.rsync.%stat", "100644 0,0 1001:1000", 255) = 20
02:54:30.057788 lgetxattr("../2010-12-14-00/home/peter/dump_070913", "user.rsync.%aacl", 0x0, 0) = -1 ENODATA (No data available)
02:54:30.057841 llistxattr("../2010-12-14-00/home/peter/dump_070913", 0x1612800, 1024) = 17
02:54:30.057889 link("../2010-12-14-00/home/peter/dump_070913", "home/peter/dump_070913") = 0
02:54:30.058126 lstat("home/peter/dump_070914", 0x7fffd17410c0) = -1 ENOENT (No such file or directory)
02:54:30.058175 lstat("../2010-12-14-00/home/peter/dump_070914", {st_dev=makedev(0, 21), st_ino=9813618, st_mode=S_IFREG|0644, st_nlink=7, st_uid=1000, st_gid=34, st_blksize=4096, st_blocks=6, st_size=3166, st_atime=2010/11/20-08:25:40, st_mtime=2007/09/15-01:13:00, st_ctime=2010/12/14-08:08:32}) = 0
02:54:30.058269 lgetxattr("../2010-12-14-00/home/peter/dump_070914", "user.rsync.%stat", "100644 0,0 1001:1000", 255) = 20
02:54:30.058332 lgetxattr("../2010-12-14-00/home/peter/dump_070914", "user.rsync.%aacl", 0x0, 0) = -1 ENODATA (No data available)
02:54:30.058385 llistxattr("../2010-12-14-00/home/peter/dump_070914", 0x1612800, 1024) = 17
02:54:30.058432 link("../2010-12-14-00/home/peter/dump_070914", "home/peter/dump_070914") = 0
02:54:30.058674 lstat("home/peter/dump_070915", 0x7fffd17410c0) = -1 ENOENT (No such file or directory)
02:54:30.058722 lstat("../2010-12-14-00/home/peter/dump_070915", {st_dev=makedev(0, 21), st_ino=9813619, st_mode=S_IFREG|0644, st_nlink=7, st_uid=1000, st_gid=34, st_blksize=4096, st_blocks=5, st_size=3056, st_atime=2010/11/20-08:25:40, st_mtime=2007/09/16-01:13:00, st_ctime=2010/12/14-08:08:32}) = 0
02:54:30.059068 lgetxattr("../2010-12-14-00/home/peter/dump_070915", "user.rsync.%stat", "100644 0,0 1001:1000", 255) = 20
02:54:30.059139 lgetxattr("../2010-12-14-00/home/peter/dump_070915", "user.rsync.%aacl", 0x0, 0) = -1 ENODATA (No data available)
02:54:30.059192 llistxattr("../2010-12-14-00/home/peter/dump_070915", 0x1612800, 1024) = 17
02:54:30.059241 link("../2010-12-14-00/home/peter/dump_070915", "home/peter/dump_070915") = 0
02:54:30.059513 lstat("home/peter/dump_070916", 0x7fffd17410c0) = -1 ENOENT (No such file or directory)
02:54:30.059568 lstat("../2010-12-14-00/home/peter/dump_070916", {st_dev=makedev(0, 21), st_ino=9813620, st_mode=S_IFREG|0644, st_nlink=7, st_uid=1000, st_gid=34, st_blksize=4096, st_blocks=5, st_size=2864, st_atime=2010/11/20-08:25:40, st_mtime=2007/09/17-01:13:00, st_ctime=2010/12/14-08:08:33}) = 0
02:54:30.100912 lgetxattr("../2010-12-14-00/home/peter/dump_070916", "user.rsync.%stat", "100644 0,0 1001:1000", 255) = 20
02:54:30.100986 lgetxattr("../2010-12-14-00/home/peter/dump_070916", "user.rsync.%aacl", 0x0, 0) = -1 ENODATA (No data available)
02:54:30.101042 llistxattr("../2010-12-14-00/home/peter/dump_070916", 0x1612800, 1024) = 17
02:54:30.101091 link("../2010-12-14-00/home/peter/dump_070916", "home/peter/dump_070916") = 0
02:54:30.101488 lstat("home/peter/dump_070917", 0x7fffd17410c0) = -1 ENOENT (No such file or directory)
02:54:30.101543 lstat("../2010-12-14-00/home/peter/dump_070917", {st_dev=makedev(0, 21), st_ino=9813621, st_mode=S_IFREG|0644, st_nlink=7, st_uid=1000, st_gid=34, st_blksize=4096, st_blocks=6, st_size=3220, st_atime=2010/11/20-08:25:40, st_mtime=2007/09/18-01:13:00, st_ctime=2010/12/14-08:08:33}) = 0
02:54:30.101646 lgetxattr("../2010-12-14-00/home/peter/dump_070917", "user.rsync.%stat", "100644 0,0 1001:1000", 255) = 20
02:54:30.101714 lgetxattr("../2010-12-14-00/home/peter/dump_070917", "user.rsync.%aacl", 0x0, 0) = -1 ENODATA (No data available)
02:54:30.101769 llistxattr("../2010-12-14-00/home/peter/dump_070917", 0x1612800, 1024) = 17
02:54:30.101819 link("../2010-12-14-00/home/peter/dump_070917", "home/peter/dump_070917") = 0
02:54:30.102024 lstat("home/peter/dump_070918", 0x7fffd17410c0) = -1 ENOENT (No such file or directory)
02:54:30.102075 lstat("../2010-12-14-00/home/peter/dump_070918", {st_dev=makedev(0, 21), st_ino=9813622, st_mode=S_IFREG|0644, st_nlink=7, st_uid=1000, st_gid=34, st_blksize=4096, st_blocks=6, st_size=3184, st_atime=2010/11/20-08:25:40, st_mtime=2007/09/19-01:13:00, st_ctime=2010/12/14-08:08:33}) = 0
02:54:30.102172 lgetxattr("../2010-12-14-00/home/peter/dump_070918", "user.rsync.%stat", "100644 0,0 1001:1000", 255) = 20
02:54:30.102237 lgetxattr("../2010-12-14-00/home/peter/dump_070918", "user.rsync.%aacl", 0x0, 0) = -1 ENODATA (No data available)
02:54:30.102291 llistxattr("../2010-12-14-00/home/peter/dump_070918", 0x1612800, 1024) = 17
02:54:30.102339 link("../2010-12-14-00/home/peter/dump_070918", "home/peter/dump_070918") = 0
02:54:30.102559 lstat("home/peter/dump_070919", 0x7fffd17410c0) = -1 ENOENT (No such file or directory)
02:54:30.102609 lstat("../2010-12-14-00/home/peter/dump_070919", {st_dev=makedev(0, 21), st_ino=9813623, st_mode=S_IFREG|0644, st_nlink=7, st_uid=1000, st_gid=34, st_blksize=4096, st_blocks=6, st_size=3275, st_atime=2010/11/20-08:25:40, st_mtime=2007/09/20-01:13:00, st_ctime=2010/12/14-08:08:33}) = 0
02:54:30.942826 lgetxattr("../2010-12-14-00/home/peter/dump_070919", "user.rsync.%stat", "100644 0,0 1001:1000", 255) = 20
02:54:30.942916 lgetxattr("../2010-12-14-00/home/peter/dump_070919", "user.rsync.%aacl", 0x0, 0) = -1 ENODATA (No data available)
02:54:30.942977 llistxattr("../2010-12-14-00/home/peter/dump_070919", 0x1612800, 1024) = 17
02:54:30.943029 link("../2010-12-14-00/home/peter/dump_070919", "home/peter/dump_070919") = 0
02:54:30.945281 lstat("home/peter/dump_070920", 0x7fffd17410c0) = -1 ENOENT (No such file or directory)
02:54:30.945375 lstat("../2010-12-14-00/home/peter/dump_070920", {st_dev=makedev(0, 21), st_ino=9813624, st_mode=S_IFREG|0644, st_nlink=7, st_uid=1000, st_gid=34, st_blksize=4096, st_blocks=5, st_size=3006, st_atime=2010/11/20-08:25:40, st_mtime=2007/09/21-01:13:00, st_ctime=2010/12/14-08:08:33}) = 0
02:54:30.945500 lgetxattr("../2010-12-14-00/home/peter/dump_070920", "user.rsync.%stat", "100644 0,0 1001:1000", 255) = 20
02:54:30.945582 lgetxattr("../2010-12-14-00/home/peter/dump_070920", "user.rsync.%aacl", 0x0, 0) = -1 ENODATA (No data available)
02:54:30.945639 llistxattr("../2010-12-14-00/home/peter/dump_070920", 0x1612800, 1024) = 17
02:54:30.945691 link("../2010-12-14-00/home/peter/dump_070920", "home/peter/dump_070920") = 0
and rm is mostly doing that:
unlinkat(8, "TERASSE_01.jpg", 0) = 0
unlinkat(8, "TERASSE_02-600x470.jpg", 0) = 0
unlinkat(8, "TERASSE_02.jpg", 0) = 0
unlinkat(8, "TERASSE_03-600x463.jpg", 0) = 0
unlinkat(8, "TERASSE_03.jpg", 0) = 0
unlinkat(8, "TERASSE_04-600x466.jpg", 0) = 0
unlinkat(8, "TERASSE_04.jpg", 0) = 0
close(8) = 0
unlinkat(6, "pic", AT_REMOVEDIR) = 0
close(6) = 0
unlinkat(4, "fuerte", AT_REMOVEDIR) = 0
newfstatat(4, "fuerteventura_elba_sara", {st_mode=S_IFDIR|0777, st_size=448, ...}, AT_SYMLINK_NOFOLLOW) = 0
openat(4, "fuerteventura_elba_sara", O_RDONLY|O_NOCTTY|O_NONBLOCK|O_DIRECTORY) = 3
fcntl(3, F_GETFD) = 0
fcntl(3, F_SETFD, FD_CLOEXEC) = 0
fstat(3, {st_mode=S_IFDIR|0777, st_size=448, ...}) = 0
fcntl(3, F_GETFL) = 0x18800 (flags O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY)
fcntl(3, F_SETFD, FD_CLOEXEC) = 0
fcntl(3, F_DUPFD, 3) = 6
fcntl(6, F_GETFD) = 0
fcntl(6, F_SETFD, FD_CLOEXEC) = 0
getdents(3, /* 15 entries */, 32768) = 568
getdents(3, /* 0 entries */, 32768) = 0
close(3) = 0
unlinkat(6, "beschreibung.php3", 0) = 0
unlinkat(6, "buchungsanfrage.php3", 0) = 0
unlinkat(6, "buchungsanfrage_danke.php3", 0) = 0
unlinkat(6, "buchungsanfrage_formular.php3", 0) = 0
unlinkat(6, "buchungsanfragenavi.php3", 0) = 0
unlinkat(6, "email_gen.php3", 0) = 0
unlinkat(6, "fotos.php3", 0) = 0
Now, the question is, what can I do to increase the throughput? Can I
make btrfs caches more aggressively?
% free -m
total used free shared buffers cached
Mem: 3006 2696 310 0 5 2098
-/+ buffers/cache: 591 2414
Swap: 0 0 0
# smartctl -i /dev/sdb
smartctl 5.40 2010-07-12 r3124 [x86_64-unknown-linux-gnu] (local build)
Copyright (C) 2002-10 by Bruce Allen, http://smartmontools.sourceforge.net
=== START OF INFORMATION SECTION ===
Model Family: Western Digital Caviar Green (Adv. Format) family
Device Model: WDC WD15EARS-00MVWB0
Serial Number: WD-WCAZA1548514
Firmware Version: 51.0AB51
User Capacity: 1.500.301.910.016 bytes
Device is: In smartctl database [for details use: -P show]
ATA Version is: 8
ATA Standard is: Exact ATA specification draft version not indicated
Local Time is: Thu Dec 16 13:28:50 2010 CET
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
Should I provide more informations?
Bye, Jörg.
PS: Please, Cc me. I'm not subscribed the list.
--
Perfection is reached, not when there is no longer anything that can be
added, but when there is no longer anything to take away.
(Antoine de Saint‐Exupery)
[-- Attachment #2: Digital signature http://en.wikipedia.org/wiki/OpenPGP --]
[-- Type: application/pgp-signature, Size: 198 bytes --]
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: btrfs reads only 4k blocks -- how to improve?
2010-12-16 12:31 btrfs reads only 4k blocks -- how to improve? Jörg Sommer
@ 2010-12-16 22:12 ` Erik Logtenberg
[not found] ` <4D0A0E2E.5010204@gmail.com>
1 sibling, 0 replies; 3+ messages in thread
From: Erik Logtenberg @ 2010-12-16 22:12 UTC (permalink / raw)
Cc: linux-btrfs
Hi,
I'm not really answering your question, but may I suggest you change
your backup strategy to leverage one of btrfs main features: instead of
using the hardlink-feature of rsync, use snapshots. Btrfs snapshots are
way better than a hardlink-tree, for multiple reasons:
- It uses less diskspace, because only real changes take up extra space=
;
- It performs way better, because making a snapshot is really cheap
while making the entire hardlink tree can be expensive, especially on
large backups (many files);
- With the hardlink feature of rsync, it is not possible to reliably
backup existing hardlinks. Now that you're no longer using hardlinks fo=
r
the backup itself, you can easily add the -H switch to rsync;
- Generally rsync can not reliably resume a backup with --link-dest whe=
n
it's interrupted, for instance by a network failure. In that case you
have to trash the partial backup and start over. Now that you're no
longer using --link-dest, you can resume just fine.
I used your setup (using rsnapshot, which is a rsync wrapper) and
switched over to snapshots (and for that reason to btrfs) exactly
because of these advantages.
Kind regards,
Erik.
On 12/16/2010 01:31 PM, J=C3=B6rg Sommer wrote:
> Hi,
>=20
> I have a btrfs that conains many hardlinks. I'm using rsync to create
> backups. It creates the backup of a day by (hard=E2=80=90)linking the=
files
> (inodes) they haven't changed with the files from a former day.
>=20
> % find 2010-12-1[10]-00 -maxdepth 1
> 2010-12-10-00
> 2010-12-10-00/etc
> 2010-12-10-00/home
> 2010-12-10-00/root
> 2010-12-10-00/srv
> 2010-12-10-00/usr
> 2010-12-10-00/var
> 2010-12-11-00
> 2010-12-11-00/etc
> 2010-12-11-00/home
> 2010-12-11-00/root
> 2010-12-11-00/srv
> 2010-12-11-00/usr
> 2010-12-11-00/var
> % stat 2010-12-1[01]-00/etc/services
> File: =E2=80=9E2010-12-10-00/etc/services=E2=80=9C
> Size: 18480 Blocks: 40 IO Block: 4096 regul=C3=A4=
re Datei
> Device: 15h/21d Inode: 7945534 Links: 7
> Access: (0644/-rw-r--r--) Uid: ( 1000/ateo-service) Gid: ( 34/ =
backup)
> Access: 2010-11-19 02:26:01.000000000 +0100
> Modify: 2008-08-28 04:00:12.000000000 +0200
> Change: 2010-12-14 07:56:19.999523630 +0100
> File: =E2=80=9E2010-12-11-00/etc/services=E2=80=9C
> Size: 18480 Blocks: 40 IO Block: 4096 regul=C3=A4=
re Datei
> Device: 15h/21d Inode: 7945534 Links: 7
> Access: (0644/-rw-r--r--) Uid: ( 1000/ateo-service) Gid: ( 34/ =
backup)
> Access: 2010-11-19 02:26:01.000000000 +0100
> Modify: 2008-08-28 04:00:12.000000000 +0200
> Change: 2010-12-14 07:56:19.999523630 +0100
>=20
> When running rm -r to remove an old backup or running rsync I see the
> average size of a read or a write request ist 4k. This leads to a ver=
y
> bad throughput of fewer than 2MByte/s. I'm using atop to watch these
> numbers.
>=20
> rsync is mostly doing this:
>=20
> 02:54:30.027895 link("../2010-12-14-00/home/peter/dump_070903", "home=
/peter/dump_070903") =3D 0
> 02:54:30.028398 lstat("home/peter/dump_070904", 0x7fffd17410c0) =3D -=
1 ENOENT (No such file or directory)
> 02:54:30.028475 lstat("../2010-12-14-00/home/peter/dump_070904", {st_=
dev=3Dmakedev(0, 21), st_ino=3D9813608, st_mode=3DS_IFREG|0644, st_nlin=
k=3D7, st_uid=3D1000, st_gid=3D34, st_blksize=3D4096, st_blocks=3D6, st=
_size=3D3244, st_atime=3D2010/11/20-08:25:40, st_mtime=3D2007/09/05-01:=
13:00, st_ctime=3D2010/12/14-08:08:31}) =3D 0
> 02:54:30.028598 lgetxattr("../2010-12-14-00/home/peter/dump_070904", =
"user.rsync.%stat", "100644 0,0 1001:1000", 255) =3D 20
> 02:54:30.028679 lgetxattr("../2010-12-14-00/home/peter/dump_070904", =
"user.rsync.%aacl", 0x0, 0) =3D -1 ENODATA (No data available)
> 02:54:30.028734 llistxattr("../2010-12-14-00/home/peter/dump_070904",=
0x1612800, 1024) =3D 17
> 02:54:30.028783 link("../2010-12-14-00/home/peter/dump_070904", "home=
/peter/dump_070904") =3D 0
> 02:54:30.029078 lstat("home/peter/dump_070905", 0x7fffd17410c0) =3D -=
1 ENOENT (No such file or directory)
> 02:54:30.029127 lstat("../2010-12-14-00/home/peter/dump_070905", {st_=
dev=3Dmakedev(0, 21), st_ino=3D9813609, st_mode=3DS_IFREG|0644, st_nlin=
k=3D7, st_uid=3D1000, st_gid=3D34, st_blksize=3D4096, st_blocks=3D6, st=
_size=3D3251, st_atime=3D2010/11/20-08:25:40, st_mtime=3D2007/09/06-01:=
13:00, st_ctime=3D2010/12/14-08:08:31}) =3D 0
> 02:54:30.029226 lgetxattr("../2010-12-14-00/home/peter/dump_070905", =
"user.rsync.%stat", "100644 0,0 1001:1000", 255) =3D 20
> 02:54:30.029290 lgetxattr("../2010-12-14-00/home/peter/dump_070905", =
"user.rsync.%aacl", 0x0, 0) =3D -1 ENODATA (No data available)
> 02:54:30.029343 llistxattr("../2010-12-14-00/home/peter/dump_070905",=
0x1612800, 1024) =3D 17
> 02:54:30.029389 link("../2010-12-14-00/home/peter/dump_070905", "home=
/peter/dump_070905") =3D 0
> 02:54:30.029564 lstat("home/peter/dump_070906", 0x7fffd17410c0) =3D -=
1 ENOENT (No such file or directory)
> 02:54:30.029612 lstat("../2010-12-14-00/home/peter/dump_070906", {st_=
dev=3Dmakedev(0, 21), st_ino=3D9813610, st_mode=3DS_IFREG|0644, st_nlin=
k=3D7, st_uid=3D1000, st_gid=3D34, st_blksize=3D4096, st_blocks=3D6, st=
_size=3D3183, st_atime=3D2010/11/20-08:25:40, st_mtime=3D2007/09/07-01:=
13:00, st_ctime=3D2010/12/14-08:08:31}) =3D 0
> 02:54:30.029704 lgetxattr("../2010-12-14-00/home/peter/dump_070906", =
"user.rsync.%stat", "100644 0,0 1001:1000", 255) =3D 20
> 02:54:30.029767 lgetxattr("../2010-12-14-00/home/peter/dump_070906", =
"user.rsync.%aacl", 0x0, 0) =3D -1 ENODATA (No data available)
> 02:54:30.029819 llistxattr("../2010-12-14-00/home/peter/dump_070906",=
0x1612800, 1024) =3D 17
> 02:54:30.029865 link("../2010-12-14-00/home/peter/dump_070906", "home=
/peter/dump_070906") =3D 0
> 02:54:30.030097 lstat("home/peter/dump_070907", 0x7fffd17410c0) =3D -=
1 ENOENT (No such file or directory)
> 02:54:30.030145 lstat("../2010-12-14-00/home/peter/dump_070907", {st_=
dev=3Dmakedev(0, 21), st_ino=3D9813611, st_mode=3DS_IFREG|0644, st_nlin=
k=3D7, st_uid=3D1000, st_gid=3D34, st_blksize=3D4096, st_blocks=3D6, st=
_size=3D3239, st_atime=3D2010/11/20-08:25:40, st_mtime=3D2007/09/08-01:=
13:00, st_ctime=3D2010/12/14-08:08:31}) =3D 0
> 02:54:30.030240 lgetxattr("../2010-12-14-00/home/peter/dump_070907", =
"user.rsync.%stat", "100644 0,0 1001:1000", 255) =3D 20
> 02:54:30.030601 lgetxattr("../2010-12-14-00/home/peter/dump_070907", =
"user.rsync.%aacl", 0x0, 0) =3D -1 ENODATA (No data available)
> 02:54:30.030658 llistxattr("../2010-12-14-00/home/peter/dump_070907",=
0x1612800, 1024) =3D 17
> 02:54:30.030707 link("../2010-12-14-00/home/peter/dump_070907", "home=
/peter/dump_070907") =3D 0
> 02:54:30.030913 lstat("home/peter/dump_070908", 0x7fffd17410c0) =3D -=
1 ENOENT (No such file or directory)
> 02:54:30.030964 lstat("../2010-12-14-00/home/peter/dump_070908", {st_=
dev=3Dmakedev(0, 21), st_ino=3D9813612, st_mode=3DS_IFREG|0644, st_nlin=
k=3D7, st_uid=3D1000, st_gid=3D34, st_blksize=3D4096, st_blocks=3D5, st=
_size=3D2802, st_atime=3D2010/11/20-08:25:40, st_mtime=3D2007/09/09-01:=
13:00, st_ctime=3D2010/12/14-08:08:31}) =3D 0
> 02:54:30.031061 lgetxattr("../2010-12-14-00/home/peter/dump_070908", =
"user.rsync.%stat", "100644 0,0 1001:1000", 255) =3D 20
> 02:54:30.032196 lgetxattr("../2010-12-14-00/home/peter/dump_070908", =
"user.rsync.%aacl", 0x0, 0) =3D -1 ENODATA (No data available)
> 02:54:30.032272 llistxattr("../2010-12-14-00/home/peter/dump_070908",=
0x1612800, 1024) =3D 17
> 02:54:30.032320 link("../2010-12-14-00/home/peter/dump_070908", "home=
/peter/dump_070908") =3D 0
> 02:54:30.032576 lstat("home/peter/dump_070909", 0x7fffd17410c0) =3D -=
1 ENOENT (No such file or directory)
> 02:54:30.032628 lstat("../2010-12-14-00/home/peter/dump_070909", {st_=
dev=3Dmakedev(0, 21), st_ino=3D9813613, st_mode=3DS_IFREG|0644, st_nlin=
k=3D7, st_uid=3D1000, st_gid=3D34, st_blksize=3D4096, st_blocks=3D5, st=
_size=3D2672, st_atime=3D2010/11/20-08:25:40, st_mtime=3D2007/09/10-01:=
13:00, st_ctime=3D2010/12/14-08:08:31}) =3D 0
> 02:54:30.032728 lgetxattr("../2010-12-14-00/home/peter/dump_070909", =
"user.rsync.%stat", "100644 0,0 1001:1000", 255) =3D 20
> 02:54:30.032793 lgetxattr("../2010-12-14-00/home/peter/dump_070909", =
"user.rsync.%aacl", 0x0, 0) =3D -1 ENODATA (No data available)
> 02:54:30.032846 llistxattr("../2010-12-14-00/home/peter/dump_070909",=
0x1612800, 1024) =3D 17
> 02:54:30.032893 link("../2010-12-14-00/home/peter/dump_070909", "home=
/peter/dump_070909") =3D 0
> 02:54:30.033094 lstat("home/peter/dump_070910", 0x7fffd17410c0) =3D -=
1 ENOENT (No such file or directory)
> 02:54:30.033142 lstat("../2010-12-14-00/home/peter/dump_070910", {st_=
dev=3Dmakedev(0, 21), st_ino=3D9813614, st_mode=3DS_IFREG|0644, st_nlin=
k=3D7, st_uid=3D1000, st_gid=3D34, st_blksize=3D4096, st_blocks=3D6, st=
_size=3D3393, st_atime=3D2010/11/20-08:25:40, st_mtime=3D2007/09/11-01:=
13:00, st_ctime=3D2010/12/14-08:08:31}) =3D 0
> 02:54:30.033237 lgetxattr("../2010-12-14-00/home/peter/dump_070910", =
"user.rsync.%stat", "100644 0,0 1001:1000", 255) =3D 20
> 02:54:30.033902 lgetxattr("../2010-12-14-00/home/peter/dump_070910", =
"user.rsync.%aacl", 0x0, 0) =3D -1 ENODATA (No data available)
> 02:54:30.033960 llistxattr("../2010-12-14-00/home/peter/dump_070910",=
0x1612800, 1024) =3D 17
> 02:54:30.034018 link("../2010-12-14-00/home/peter/dump_070910", "home=
/peter/dump_070910") =3D 0
> 02:54:30.034123 lstat("home/peter/dump_070911", 0x7fffd17410c0) =3D -=
1 ENOENT (No such file or directory)
> 02:54:30.034171 lstat("../2010-12-14-00/home/peter/dump_070911", {st_=
dev=3Dmakedev(0, 21), st_ino=3D9813615, st_mode=3DS_IFREG|0644, st_nlin=
k=3D7, st_uid=3D1000, st_gid=3D34, st_blksize=3D4096, st_blocks=3D6, st=
_size=3D3340, st_atime=3D2010/11/20-08:25:40, st_mtime=3D2007/09/12-01:=
13:00, st_ctime=3D2010/12/14-08:08:32}) =3D 0
> 02:54:30.034264 lgetxattr("../2010-12-14-00/home/peter/dump_070911", =
"user.rsync.%stat", "100644 0,0 1001:1000", 255) =3D 20
> 02:54:30.034324 lgetxattr("../2010-12-14-00/home/peter/dump_070911", =
"user.rsync.%aacl", 0x0, 0) =3D -1 ENODATA (No data available)
> 02:54:30.034376 llistxattr("../2010-12-14-00/home/peter/dump_070911",=
0x1612800, 1024) =3D 17
> 02:54:30.036405 link("../2010-12-14-00/home/peter/dump_070911", "home=
/peter/dump_070911") =3D 0
> 02:54:30.036986 lstat("home/peter/dump_070912", 0x7fffd17410c0) =3D -=
1 ENOENT (No such file or directory)
> 02:54:30.037045 lstat("../2010-12-14-00/home/peter/dump_070912", {st_=
dev=3Dmakedev(0, 21), st_ino=3D9813616, st_mode=3DS_IFREG|0644, st_nlin=
k=3D7, st_uid=3D1000, st_gid=3D34, st_blksize=3D4096, st_blocks=3D6, st=
_size=3D3407, st_atime=3D2010/11/20-08:25:40, st_mtime=3D2007/09/13-01:=
13:00, st_ctime=3D2010/12/14-08:08:32}) =3D 0
> 02:54:30.037155 lgetxattr("../2010-12-14-00/home/peter/dump_070912", =
"user.rsync.%stat", "100644 0,0 1001:1000", 255) =3D 20
> 02:54:30.057221 lgetxattr("../2010-12-14-00/home/peter/dump_070912", =
"user.rsync.%aacl", 0x0, 0) =3D -1 ENODATA (No data available)
> 02:54:30.057279 llistxattr("../2010-12-14-00/home/peter/dump_070912",=
0x1612800, 1024) =3D 17
> 02:54:30.057347 link("../2010-12-14-00/home/peter/dump_070912", "home=
/peter/dump_070912") =3D 0
> 02:54:30.057574 lstat("home/peter/dump_070913", 0x7fffd17410c0) =3D -=
1 ENOENT (No such file or directory)
> 02:54:30.057625 lstat("../2010-12-14-00/home/peter/dump_070913", {st_=
dev=3Dmakedev(0, 21), st_ino=3D9813617, st_mode=3DS_IFREG|0644, st_nlin=
k=3D7, st_uid=3D1000, st_gid=3D34, st_blksize=3D4096, st_blocks=3D6, st=
_size=3D3335, st_atime=3D2010/11/20-08:25:40, st_mtime=3D2007/09/14-01:=
13:00, st_ctime=3D2010/12/14-08:08:32}) =3D 0
> 02:54:30.057724 lgetxattr("../2010-12-14-00/home/peter/dump_070913", =
"user.rsync.%stat", "100644 0,0 1001:1000", 255) =3D 20
> 02:54:30.057788 lgetxattr("../2010-12-14-00/home/peter/dump_070913", =
"user.rsync.%aacl", 0x0, 0) =3D -1 ENODATA (No data available)
> 02:54:30.057841 llistxattr("../2010-12-14-00/home/peter/dump_070913",=
0x1612800, 1024) =3D 17
> 02:54:30.057889 link("../2010-12-14-00/home/peter/dump_070913", "home=
/peter/dump_070913") =3D 0
> 02:54:30.058126 lstat("home/peter/dump_070914", 0x7fffd17410c0) =3D -=
1 ENOENT (No such file or directory)
> 02:54:30.058175 lstat("../2010-12-14-00/home/peter/dump_070914", {st_=
dev=3Dmakedev(0, 21), st_ino=3D9813618, st_mode=3DS_IFREG|0644, st_nlin=
k=3D7, st_uid=3D1000, st_gid=3D34, st_blksize=3D4096, st_blocks=3D6, st=
_size=3D3166, st_atime=3D2010/11/20-08:25:40, st_mtime=3D2007/09/15-01:=
13:00, st_ctime=3D2010/12/14-08:08:32}) =3D 0
> 02:54:30.058269 lgetxattr("../2010-12-14-00/home/peter/dump_070914", =
"user.rsync.%stat", "100644 0,0 1001:1000", 255) =3D 20
> 02:54:30.058332 lgetxattr("../2010-12-14-00/home/peter/dump_070914", =
"user.rsync.%aacl", 0x0, 0) =3D -1 ENODATA (No data available)
> 02:54:30.058385 llistxattr("../2010-12-14-00/home/peter/dump_070914",=
0x1612800, 1024) =3D 17
> 02:54:30.058432 link("../2010-12-14-00/home/peter/dump_070914", "home=
/peter/dump_070914") =3D 0
> 02:54:30.058674 lstat("home/peter/dump_070915", 0x7fffd17410c0) =3D -=
1 ENOENT (No such file or directory)
> 02:54:30.058722 lstat("../2010-12-14-00/home/peter/dump_070915", {st_=
dev=3Dmakedev(0, 21), st_ino=3D9813619, st_mode=3DS_IFREG|0644, st_nlin=
k=3D7, st_uid=3D1000, st_gid=3D34, st_blksize=3D4096, st_blocks=3D5, st=
_size=3D3056, st_atime=3D2010/11/20-08:25:40, st_mtime=3D2007/09/16-01:=
13:00, st_ctime=3D2010/12/14-08:08:32}) =3D 0
> 02:54:30.059068 lgetxattr("../2010-12-14-00/home/peter/dump_070915", =
"user.rsync.%stat", "100644 0,0 1001:1000", 255) =3D 20
> 02:54:30.059139 lgetxattr("../2010-12-14-00/home/peter/dump_070915", =
"user.rsync.%aacl", 0x0, 0) =3D -1 ENODATA (No data available)
> 02:54:30.059192 llistxattr("../2010-12-14-00/home/peter/dump_070915",=
0x1612800, 1024) =3D 17
> 02:54:30.059241 link("../2010-12-14-00/home/peter/dump_070915", "home=
/peter/dump_070915") =3D 0
> 02:54:30.059513 lstat("home/peter/dump_070916", 0x7fffd17410c0) =3D -=
1 ENOENT (No such file or directory)
> 02:54:30.059568 lstat("../2010-12-14-00/home/peter/dump_070916", {st_=
dev=3Dmakedev(0, 21), st_ino=3D9813620, st_mode=3DS_IFREG|0644, st_nlin=
k=3D7, st_uid=3D1000, st_gid=3D34, st_blksize=3D4096, st_blocks=3D5, st=
_size=3D2864, st_atime=3D2010/11/20-08:25:40, st_mtime=3D2007/09/17-01:=
13:00, st_ctime=3D2010/12/14-08:08:33}) =3D 0
> 02:54:30.100912 lgetxattr("../2010-12-14-00/home/peter/dump_070916", =
"user.rsync.%stat", "100644 0,0 1001:1000", 255) =3D 20
> 02:54:30.100986 lgetxattr("../2010-12-14-00/home/peter/dump_070916", =
"user.rsync.%aacl", 0x0, 0) =3D -1 ENODATA (No data available)
> 02:54:30.101042 llistxattr("../2010-12-14-00/home/peter/dump_070916",=
0x1612800, 1024) =3D 17
> 02:54:30.101091 link("../2010-12-14-00/home/peter/dump_070916", "home=
/peter/dump_070916") =3D 0
> 02:54:30.101488 lstat("home/peter/dump_070917", 0x7fffd17410c0) =3D -=
1 ENOENT (No such file or directory)
> 02:54:30.101543 lstat("../2010-12-14-00/home/peter/dump_070917", {st_=
dev=3Dmakedev(0, 21), st_ino=3D9813621, st_mode=3DS_IFREG|0644, st_nlin=
k=3D7, st_uid=3D1000, st_gid=3D34, st_blksize=3D4096, st_blocks=3D6, st=
_size=3D3220, st_atime=3D2010/11/20-08:25:40, st_mtime=3D2007/09/18-01:=
13:00, st_ctime=3D2010/12/14-08:08:33}) =3D 0
> 02:54:30.101646 lgetxattr("../2010-12-14-00/home/peter/dump_070917", =
"user.rsync.%stat", "100644 0,0 1001:1000", 255) =3D 20
> 02:54:30.101714 lgetxattr("../2010-12-14-00/home/peter/dump_070917", =
"user.rsync.%aacl", 0x0, 0) =3D -1 ENODATA (No data available)
> 02:54:30.101769 llistxattr("../2010-12-14-00/home/peter/dump_070917",=
0x1612800, 1024) =3D 17
> 02:54:30.101819 link("../2010-12-14-00/home/peter/dump_070917", "home=
/peter/dump_070917") =3D 0
> 02:54:30.102024 lstat("home/peter/dump_070918", 0x7fffd17410c0) =3D -=
1 ENOENT (No such file or directory)
> 02:54:30.102075 lstat("../2010-12-14-00/home/peter/dump_070918", {st_=
dev=3Dmakedev(0, 21), st_ino=3D9813622, st_mode=3DS_IFREG|0644, st_nlin=
k=3D7, st_uid=3D1000, st_gid=3D34, st_blksize=3D4096, st_blocks=3D6, st=
_size=3D3184, st_atime=3D2010/11/20-08:25:40, st_mtime=3D2007/09/19-01:=
13:00, st_ctime=3D2010/12/14-08:08:33}) =3D 0
> 02:54:30.102172 lgetxattr("../2010-12-14-00/home/peter/dump_070918", =
"user.rsync.%stat", "100644 0,0 1001:1000", 255) =3D 20
> 02:54:30.102237 lgetxattr("../2010-12-14-00/home/peter/dump_070918", =
"user.rsync.%aacl", 0x0, 0) =3D -1 ENODATA (No data available)
> 02:54:30.102291 llistxattr("../2010-12-14-00/home/peter/dump_070918",=
0x1612800, 1024) =3D 17
> 02:54:30.102339 link("../2010-12-14-00/home/peter/dump_070918", "home=
/peter/dump_070918") =3D 0
> 02:54:30.102559 lstat("home/peter/dump_070919", 0x7fffd17410c0) =3D -=
1 ENOENT (No such file or directory)
> 02:54:30.102609 lstat("../2010-12-14-00/home/peter/dump_070919", {st_=
dev=3Dmakedev(0, 21), st_ino=3D9813623, st_mode=3DS_IFREG|0644, st_nlin=
k=3D7, st_uid=3D1000, st_gid=3D34, st_blksize=3D4096, st_blocks=3D6, st=
_size=3D3275, st_atime=3D2010/11/20-08:25:40, st_mtime=3D2007/09/20-01:=
13:00, st_ctime=3D2010/12/14-08:08:33}) =3D 0
> 02:54:30.942826 lgetxattr("../2010-12-14-00/home/peter/dump_070919", =
"user.rsync.%stat", "100644 0,0 1001:1000", 255) =3D 20
> 02:54:30.942916 lgetxattr("../2010-12-14-00/home/peter/dump_070919", =
"user.rsync.%aacl", 0x0, 0) =3D -1 ENODATA (No data available)
> 02:54:30.942977 llistxattr("../2010-12-14-00/home/peter/dump_070919",=
0x1612800, 1024) =3D 17
> 02:54:30.943029 link("../2010-12-14-00/home/peter/dump_070919", "home=
/peter/dump_070919") =3D 0
> 02:54:30.945281 lstat("home/peter/dump_070920", 0x7fffd17410c0) =3D -=
1 ENOENT (No such file or directory)
> 02:54:30.945375 lstat("../2010-12-14-00/home/peter/dump_070920", {st_=
dev=3Dmakedev(0, 21), st_ino=3D9813624, st_mode=3DS_IFREG|0644, st_nlin=
k=3D7, st_uid=3D1000, st_gid=3D34, st_blksize=3D4096, st_blocks=3D5, st=
_size=3D3006, st_atime=3D2010/11/20-08:25:40, st_mtime=3D2007/09/21-01:=
13:00, st_ctime=3D2010/12/14-08:08:33}) =3D 0
> 02:54:30.945500 lgetxattr("../2010-12-14-00/home/peter/dump_070920", =
"user.rsync.%stat", "100644 0,0 1001:1000", 255) =3D 20
> 02:54:30.945582 lgetxattr("../2010-12-14-00/home/peter/dump_070920", =
"user.rsync.%aacl", 0x0, 0) =3D -1 ENODATA (No data available)
> 02:54:30.945639 llistxattr("../2010-12-14-00/home/peter/dump_070920",=
0x1612800, 1024) =3D 17
> 02:54:30.945691 link("../2010-12-14-00/home/peter/dump_070920", "home=
/peter/dump_070920") =3D 0
>=20
> and rm is mostly doing that:
>=20
> unlinkat(8, "TERASSE_01.jpg", 0) =3D 0
> unlinkat(8, "TERASSE_02-600x470.jpg", 0) =3D 0
> unlinkat(8, "TERASSE_02.jpg", 0) =3D 0
> unlinkat(8, "TERASSE_03-600x463.jpg", 0) =3D 0
> unlinkat(8, "TERASSE_03.jpg", 0) =3D 0
> unlinkat(8, "TERASSE_04-600x466.jpg", 0) =3D 0
> unlinkat(8, "TERASSE_04.jpg", 0) =3D 0
> close(8) =3D 0
> unlinkat(6, "pic", AT_REMOVEDIR) =3D 0
> close(6) =3D 0
> unlinkat(4, "fuerte", AT_REMOVEDIR) =3D 0
> newfstatat(4, "fuerteventura_elba_sara", {st_mode=3DS_IFDIR|0777, st_=
size=3D448, ...}, AT_SYMLINK_NOFOLLOW) =3D 0
> openat(4, "fuerteventura_elba_sara", O_RDONLY|O_NOCTTY|O_NONBLOCK|O_D=
IRECTORY) =3D 3
> fcntl(3, F_GETFD) =3D 0
> fcntl(3, F_SETFD, FD_CLOEXEC) =3D 0
> fstat(3, {st_mode=3DS_IFDIR|0777, st_size=3D448, ...}) =3D 0
> fcntl(3, F_GETFL) =3D 0x18800 (flags O_RDONLY|O=
_NONBLOCK|O_LARGEFILE|O_DIRECTORY)
> fcntl(3, F_SETFD, FD_CLOEXEC) =3D 0
> fcntl(3, F_DUPFD, 3) =3D 6
> fcntl(6, F_GETFD) =3D 0
> fcntl(6, F_SETFD, FD_CLOEXEC) =3D 0
> getdents(3, /* 15 entries */, 32768) =3D 568
> getdents(3, /* 0 entries */, 32768) =3D 0
> close(3) =3D 0
> unlinkat(6, "beschreibung.php3", 0) =3D 0
> unlinkat(6, "buchungsanfrage.php3", 0) =3D 0
> unlinkat(6, "buchungsanfrage_danke.php3", 0) =3D 0
> unlinkat(6, "buchungsanfrage_formular.php3", 0) =3D 0
> unlinkat(6, "buchungsanfragenavi.php3", 0) =3D 0
> unlinkat(6, "email_gen.php3", 0) =3D 0
> unlinkat(6, "fotos.php3", 0) =3D 0
>=20
> Now, the question is, what can I do to increase the throughput? Can I
> make btrfs caches more aggressively?
>=20
> % free -m
> total used free shared buffers ca=
ched
> Mem: 3006 2696 310 0 5 =
2098
> -/+ buffers/cache: 591 2414
> Swap: 0 0 0
>=20
> # smartctl -i /dev/sdb
> smartctl 5.40 2010-07-12 r3124 [x86_64-unknown-linux-gnu] (local buil=
d)
> Copyright (C) 2002-10 by Bruce Allen, http://smartmontools.sourceforg=
e.net
>=20
> =3D=3D=3D START OF INFORMATION SECTION =3D=3D=3D
> Model Family: Western Digital Caviar Green (Adv. Format) family
> Device Model: WDC WD15EARS-00MVWB0
> Serial Number: WD-WCAZA1548514
> Firmware Version: 51.0AB51
> User Capacity: 1.500.301.910.016 bytes
> Device is: In smartctl database [for details use: -P show]
> ATA Version is: 8
> ATA Standard is: Exact ATA specification draft version not indicated
> Local Time is: Thu Dec 16 13:28:50 2010 CET
> SMART support is: Available - device has SMART capability.
> SMART support is: Enabled
>=20
> Should I provide more informations?
>=20
> Bye, J=C3=B6rg.
>=20
> PS: Please, Cc me. I'm not subscribed the list.
--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs" =
in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: btrfs reads only 4k blocks -- how to improve?
[not found] ` <4D0A0E2E.5010204@gmail.com>
@ 2010-12-17 0:32 ` Jörg Sommer
0 siblings, 0 replies; 3+ messages in thread
From: Jörg Sommer @ 2010-12-17 0:32 UTC (permalink / raw)
To: Andreas Philipp; +Cc: linux-btrfs
[-- Attachment #1: Type: text/plain, Size: 797 bytes --]
Andreas Philipp hat am Thu 16. Dec, 14:03 (+0100) geschrieben:
> On 16.12.2010 13:31, Jörg Sommer wrote:
> > When running rm -r to remove an old backup or running rsync I see the
> > average size of a read or a write request ist 4k. This leads to a very
> > bad throughput of fewer than 2MByte/s. I'm using atop to watch these
> > numbers.
> Just one probably easy question. Are you sure your partition(s) are
> aligned correctly with respect to the 4k blocks of your drive?
Good idea, but I don't use partitions on this drive.
# file -s /dev/sdb
/dev/sdb: BTRFS Filesystem (label "Backup", sectorsize 4096, nodesize 4096, leafsize 4096)
Bye, Jörg.
--
Je planmäßiger ein Mensch vorgeht,
desto stärker mag ihn der Zufall treffen.
Erich Krunau ‚Die Physiker‘
[-- Attachment #2: Digital signature http://en.wikipedia.org/wiki/OpenPGP --]
[-- Type: application/pgp-signature, Size: 198 bytes --]
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2010-12-17 0:32 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2010-12-16 12:31 btrfs reads only 4k blocks -- how to improve? Jörg Sommer
2010-12-16 22:12 ` Erik Logtenberg
[not found] ` <4D0A0E2E.5010204@gmail.com>
2010-12-17 0:32 ` Jörg Sommer
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.