public inbox for linux-xfs@vger.kernel.org
 help / color / mirror / Atom feed
From: Dave Chinner <david@fromorbit.com>
To: xfs@oss.sgi.com
Subject: [PATCH 28/37] xfs_db: avoid libxfs buffer lookup warnings
Date: Wed,  6 Nov 2013 12:07:14 +1100	[thread overview]
Message-ID: <1383700043-32305-29-git-send-email-david@fromorbit.com> (raw)
In-Reply-To: <1383700043-32305-1-git-send-email-david@fromorbit.com>

From: Dave Chinner <dchinner@redhat.com>

When we mount the filesystem inside xfs_db, libxfs is tasked with
reading some information from disk, such as root inodes. Because
libxfs does this inode reading, it uses inode cluster buffers to
read the inodes. xfs_db, OTOH, just uses FSB sized buffers to read
inodes, and hence xfs_db throws a warning when reading the root
inode block like so:

$ sudo xfs_db -c "sb 0" -c "p rootino" -c "inode 32" /dev/vda
Version 5 superblock detected. xfsprogs has EXPERIMENTAL support enabled!
Use of these features is at your own risk!
rootino = 32
7f59f20e6740: Badness in key lookup (length)
bp=(bno 0x20, len 8192 bytes) key=(bno 0x20, len 1024 bytes)
$

There is another way this can happen, and that is dumping raw data
from disk using either the "fsb NNN" or "daddr MMM" commands to dump
untyped information. This is always read in sector or filesystem
block units, and so will cause similar badness warnings.

To avoid this problem when reading inodes, teach xfs_db to read
inode clusters rather individual filesystem blocks when asked to
read an inode.

Signed-off-by: Dave Chinner <dchinner@redhat.com>
---
 db/inode.c | 33 +++++++++++++++++++++++++++++++--
 1 file changed, 31 insertions(+), 2 deletions(-)

diff --git a/db/inode.c b/db/inode.c
index 4090855..24170ba 100644
--- a/db/inode.c
+++ b/db/inode.c
@@ -623,6 +623,14 @@ inode_u_symlink_count(
 		(int)be64_to_cpu(dip->di_size) : 0;
 }
 
+/*
+ * We are now using libxfs for our IO backend, so we should always try to use
+ * inode cluster buffers rather than filesystem block sized buffers for reading
+ * inodes. This means that we always use the same buffers as libxfs operations
+ * does, and that avoids buffer cache issues caused by overlapping buffers. This
+ * can be seen clearly when trying to read the root inode. Much of this logic is
+ * similar to libxfs_imap().
+ */
 void
 set_cur_inode(
 	xfs_ino_t	ino)
@@ -632,6 +640,9 @@ set_cur_inode(
 	xfs_agnumber_t	agno;
 	xfs_dinode_t	*dip;
 	int		offset;
+	int		numblks = blkbb;
+	xfs_agblock_t	cluster_agbno;
+
 
 	agno = XFS_INO_TO_AGNO(mp, ino);
 	agino = XFS_INO_TO_AGINO(mp, ino);
@@ -644,6 +655,24 @@ set_cur_inode(
 		return;
 	}
 	cur_agno = agno;
+
+	if (mp->m_inode_cluster_size > mp->m_sb.sb_blocksize &&
+	    mp->m_inoalign_mask) {
+		xfs_agblock_t	chunk_agbno;
+		xfs_agblock_t	offset_agbno;
+		int		blks_per_cluster;
+
+		blks_per_cluster = mp->m_inode_cluster_size >>
+							mp->m_sb.sb_blocklog;
+		offset_agbno = agbno & mp->m_inoalign_mask;
+		chunk_agbno = agbno - offset_agbno;
+		cluster_agbno = chunk_agbno +
+			((offset_agbno / blks_per_cluster) * blks_per_cluster);
+		offset += ((agbno - cluster_agbno) * mp->m_sb.sb_inopblock);
+		numblks = XFS_FSB_TO_BB(mp, blks_per_cluster);
+	} else
+		cluster_agbno = agbno;
+
 	/*
 	 * First set_cur to the block with the inode
 	 * then use off_cur to get the right part of the buffer.
@@ -651,8 +680,8 @@ set_cur_inode(
 	ASSERT(typtab[TYP_INODE].typnm == TYP_INODE);
 
 	/* ingore ring update here, do it explicitly below */
-	set_cur(&typtab[TYP_INODE], XFS_AGB_TO_DADDR(mp, agno, agbno),
-		blkbb, DB_RING_IGN, NULL);
+	set_cur(&typtab[TYP_INODE], XFS_AGB_TO_DADDR(mp, agno, cluster_agbno),
+		numblks, DB_RING_IGN, NULL);
 	off_cur(offset << mp->m_sb.sb_inodelog, mp->m_sb.sb_inodesize);
 	dip = iocur_top->data;
 	iocur_top->ino_crc_ok = libxfs_dinode_verify(mp, ino, dip);
-- 
1.8.4.rc3

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

  parent reply	other threads:[~2013-11-06  1:07 UTC|newest]

Thread overview: 58+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-11-06  1:06 [PATCH 00/37 V4] xfsprogs: CRC write support for xfs_db + more Dave Chinner
2013-11-06  1:06 ` [PATCH 01/37] xfsprogs: fix automatic dependency generation Dave Chinner
2013-11-06  1:06 ` [PATCH 02/37] xfs: fix some minor sparse warnings Dave Chinner
2013-11-06  1:06 ` [PATCH 03/37] xfs: create a shared header file for format-related information Dave Chinner
2013-11-06  1:06 ` [PATCH 04/37] xfs: split dquot buffer operations out Dave Chinner
2013-11-06  1:06 ` [PATCH 05/37] xfs: decouple inode and bmap btree header files Dave Chinner
2013-11-06  1:06 ` [PATCH 06/37] libxfs: unify xfs_btree.c with kernel code Dave Chinner
2013-11-06  1:06 ` [PATCH 07/37] libxfs: bmap btree owner swap support Dave Chinner
2013-11-06  1:06 ` [PATCH 08/37] libxfs: xfs_rtalloc.c becomes xfs_rtbitmap.c Dave Chinner
2013-11-06  1:06 ` [PATCH 09/37] libxfs: bring across inode buffer readahead verifier changes Dave Chinner
2013-11-06  1:06 ` [PATCH 10/37] libxfs: Minor cleanup and bug fix sync Dave Chinner
2013-11-06  1:06 ` [PATCH 11/37] xfs: remove newlines from strings passed to __xfs_printk Dave Chinner
2013-11-06  1:06 ` [PATCH 12/37] xfs: fix the wrong new_size/rnew_size at xfs_iext_realloc_direct() Dave Chinner
2013-11-06  1:06 ` [PATCH 13/37] xfs: fix node forward in xfs_node_toosmall Dave Chinner
2013-11-06  1:07 ` [PATCH 14/37] xfs: don't emit corruption noise on fs probes Dave Chinner
2013-11-06  1:07 ` [PATCH 15/37] libxfs: fix root inode handling inconsistencies Dave Chinner
2013-11-06 10:23   ` Christoph Hellwig
2013-11-06 23:02     ` [PATCH 15/37 V2] " Dave Chinner
2013-11-07  4:58       ` [PATCH 15/37 V3] " Dave Chinner
2013-11-07  8:11         ` Christoph Hellwig
2013-11-06  1:07 ` [PATCH 16/37] libxfs: stop caching inode structures Dave Chinner
2013-11-06  1:07 ` [PATCH 17/37] db: separate out straight buffer IO from map based IO Dave Chinner
2013-11-07 20:50   ` Christoph Hellwig
2013-11-06  1:07 ` [PATCH 18/37] db: rewrite bbmap to use xfs_buf_map Dave Chinner
2013-11-06  1:07 ` [PATCH 19/37] libxfs: refactor libxfs_buf_read_map for xfs_db Dave Chinner
2013-11-07 20:51   ` Christoph Hellwig
2013-11-06  1:07 ` [PATCH 20/37] db: rewrite IO engine to use libxfs Dave Chinner
2013-11-06  1:07 ` [PATCH 21/37] db: introduce verifier support into set_cur Dave Chinner
2013-11-06  1:07 ` [PATCH 22/37] db: indicate if the CRC on a buffer is correct or not Dave Chinner
2013-11-06  1:07 ` [PATCH 23/37] db: verify and calculate inode CRCs Dave Chinner
2013-11-06  1:07 ` [PATCH 24/37] db: verify and calculate dquot CRCs Dave Chinner
2013-11-06  1:07 ` [PATCH 25/37] db: add a special directory buffer verifier Dave Chinner
2013-11-06  1:07 ` [PATCH 26/37] db: add a special attribute " Dave Chinner
2013-11-06  1:07 ` [PATCH 27/37] db: re-enable write support for v5 filesystems Dave Chinner
2013-11-06  1:07 ` Dave Chinner [this message]
2013-11-06  2:20   ` [PATCH 28/37] xfs_db: avoid libxfs buffer lookup warnings Dave Chinner
2013-11-07 20:52   ` Christoph Hellwig
2013-11-06  1:07 ` [PATCH 29/37] " Dave Chinner
2013-11-07 20:54   ` Christoph Hellwig
2013-11-06  1:07 ` [PATCH 30/37] libxfs: work around do_div() not handling 32 bit numerators Dave Chinner
2013-11-07 20:54   ` Christoph Hellwig
2013-11-06  1:07 ` [PATCH 31/37] db: Unwind the IO stack on exit Dave Chinner
2013-11-07 20:55   ` Christoph Hellwig
2013-11-06  1:07 ` [PATCH 32/37] db: enable metadump on CRC filesystems Dave Chinner
2013-11-06  1:07 ` [PATCH 33/37] xfs: support larger inode clusters on v5 filesystems Dave Chinner
2013-11-06  1:07 ` [PATCH 34/37] xfsprogs: kill experimental warnings for " Dave Chinner
2013-11-06  1:07 ` [PATCH 35/37] repair: prefetching is turned off unnecessarily Dave Chinner
2013-11-06 10:45   ` Christoph Hellwig
2013-11-06  1:07 ` [PATCH 36/37] repair: Increase default repair parallelism on large filesystems Dave Chinner
2013-11-06 10:41   ` Christoph Hellwig
2013-11-06 19:13     ` Dave Chinner
2013-11-12 23:38       ` Dave Chinner
2013-11-13  7:55         ` Christoph Hellwig
2013-11-06  1:07 ` [PATCH 37/37] repair: fix leaf node directory data check Dave Chinner
2013-11-06 10:39   ` Christoph Hellwig
2013-11-06 10:19 ` [PATCH 00/37 V4] xfsprogs: CRC write support for xfs_db + more Christoph Hellwig
2013-11-06 19:15   ` Dave Chinner
2013-11-10  1:05 ` Rich Johnston

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1383700043-32305-29-git-send-email-david@fromorbit.com \
    --to=david@fromorbit.com \
    --cc=xfs@oss.sgi.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox