All of lore.kernel.org
 help / color / mirror / Atom feed
From: Wu Fengguang <fengguang.wu@intel.com>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: Linux Memory Management List <linux-mm@kvack.org>,
	<linux-fsdevel@vger.kernel.org>, Rik van Riel <riel@redhat.com>,
	Linus Torvalds <torvalds@linux-foundation.org>,
	Wu Fengguang <fengguang.wu@intel.com>
Cc: LKML <linux-kernel@vger.kernel.org>
Cc: Andi Kleen <andi@firstfloor.org>
Subject: [PATCH 8/8] readahead: dont do start-of-file readahead after lseek()
Date: Mon, 21 Nov 2011 17:18:27 +0800	[thread overview]
Message-ID: <20111121093847.015852579@intel.com> (raw)
In-Reply-To: 20111121091819.394895091@intel.com

[-- Attachment #1: readahead-lseek.patch --]
[-- Type: text/plain, Size: 2439 bytes --]

Some applications (eg. blkid, id3tool etc.) seek around the file
to get information. For example, blkid does

	     seek to	0
	     read	1024
	     seek to	1536
	     read	16384

The start-of-file readahead heuristic is wrong for them, whose
access pattern can be identified by lseek() calls.

So test-and-set a READAHEAD_LSEEK flag on lseek() and don't
do start-of-file readahead on seeing it. Proposed by Linus.

Acked-by: Rik van Riel <riel@redhat.com>
Acked-by: Linus Torvalds <torvalds@linux-foundation.org>
Signed-off-by: Wu Fengguang <fengguang.wu@intel.com>
---
 fs/read_write.c    |    4 ++++
 include/linux/fs.h |    1 +
 mm/readahead.c     |    3 +++
 3 files changed, 8 insertions(+)

--- linux-next.orig/mm/readahead.c	2011-11-20 22:02:01.000000000 +0800
+++ linux-next/mm/readahead.c	2011-11-20 22:02:03.000000000 +0800
@@ -629,6 +629,8 @@ ondemand_readahead(struct address_space 
 	 * start of file
 	 */
 	if (!offset) {
+		if ((ra->ra_flags & READAHEAD_LSEEK) && req_size < max)
+			goto random_read;
 		ra_set_pattern(ra, RA_PATTERN_INITIAL);
 		goto initial_readahead;
 	}
@@ -707,6 +709,7 @@ ondemand_readahead(struct address_space 
 	if (try_context_readahead(mapping, ra, offset, req_size, max))
 		goto readit;
 
+random_read:
 	/*
 	 * standalone, small random read
 	 */
--- linux-next.orig/fs/read_write.c	2011-11-20 22:02:01.000000000 +0800
+++ linux-next/fs/read_write.c	2011-11-20 22:02:03.000000000 +0800
@@ -47,6 +47,10 @@ static loff_t lseek_execute(struct file 
 		file->f_pos = offset;
 		file->f_version = 0;
 	}
+
+	if (!(file->f_ra.ra_flags & READAHEAD_LSEEK))
+		file->f_ra.ra_flags |= READAHEAD_LSEEK;
+
 	return offset;
 }
 
--- linux-next.orig/include/linux/fs.h	2011-11-20 22:02:01.000000000 +0800
+++ linux-next/include/linux/fs.h	2011-11-20 22:02:03.000000000 +0800
@@ -952,6 +952,7 @@ struct file_ra_state {
 /* ra_flags bits */
 #define	READAHEAD_MMAP_MISS	0x000003ff /* cache misses for mmap access */
 #define	READAHEAD_MMAP		0x00010000
+#define	READAHEAD_LSEEK		0x00020000 /* be conservative after lseek() */
 
 #define READAHEAD_PATTERN_SHIFT	28
 #define READAHEAD_PATTERN	0xf0000000


--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Fight unfair telecom internet charges in Canada: sign http://stopthemeter.ca/
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

WARNING: multiple messages have this Message-ID (diff)
From: Wu Fengguang <fengguang.wu@intel.com>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: Linux Memory Management List <linux-mm@kvack.org>,
	linux-fsdevel@vger.kernel.org, Rik van Riel <riel@redhat.com>,
	Linus Torvalds <torvalds@linux-foundation.org>,
	Wu Fengguang <fengguang.wu@intel.com>,
	LKML <linux-kernel@vger.kernel.org>,
	Andi Kleen <andi@firstfloor.org>
Subject: [PATCH 8/8] readahead: dont do start-of-file readahead after lseek()
Date: Mon, 21 Nov 2011 17:18:27 +0800	[thread overview]
Message-ID: <20111121093847.015852579@intel.com> (raw)
In-Reply-To: 20111121091819.394895091@intel.com

[-- Attachment #1: readahead-lseek.patch --]
[-- Type: text/plain, Size: 2439 bytes --]

Some applications (eg. blkid, id3tool etc.) seek around the file
to get information. For example, blkid does

	     seek to	0
	     read	1024
	     seek to	1536
	     read	16384

The start-of-file readahead heuristic is wrong for them, whose
access pattern can be identified by lseek() calls.

So test-and-set a READAHEAD_LSEEK flag on lseek() and don't
do start-of-file readahead on seeing it. Proposed by Linus.

Acked-by: Rik van Riel <riel@redhat.com>
Acked-by: Linus Torvalds <torvalds@linux-foundation.org>
Signed-off-by: Wu Fengguang <fengguang.wu@intel.com>
---
 fs/read_write.c    |    4 ++++
 include/linux/fs.h |    1 +
 mm/readahead.c     |    3 +++
 3 files changed, 8 insertions(+)

--- linux-next.orig/mm/readahead.c	2011-11-20 22:02:01.000000000 +0800
+++ linux-next/mm/readahead.c	2011-11-20 22:02:03.000000000 +0800
@@ -629,6 +629,8 @@ ondemand_readahead(struct address_space 
 	 * start of file
 	 */
 	if (!offset) {
+		if ((ra->ra_flags & READAHEAD_LSEEK) && req_size < max)
+			goto random_read;
 		ra_set_pattern(ra, RA_PATTERN_INITIAL);
 		goto initial_readahead;
 	}
@@ -707,6 +709,7 @@ ondemand_readahead(struct address_space 
 	if (try_context_readahead(mapping, ra, offset, req_size, max))
 		goto readit;
 
+random_read:
 	/*
 	 * standalone, small random read
 	 */
--- linux-next.orig/fs/read_write.c	2011-11-20 22:02:01.000000000 +0800
+++ linux-next/fs/read_write.c	2011-11-20 22:02:03.000000000 +0800
@@ -47,6 +47,10 @@ static loff_t lseek_execute(struct file 
 		file->f_pos = offset;
 		file->f_version = 0;
 	}
+
+	if (!(file->f_ra.ra_flags & READAHEAD_LSEEK))
+		file->f_ra.ra_flags |= READAHEAD_LSEEK;
+
 	return offset;
 }
 
--- linux-next.orig/include/linux/fs.h	2011-11-20 22:02:01.000000000 +0800
+++ linux-next/include/linux/fs.h	2011-11-20 22:02:03.000000000 +0800
@@ -952,6 +952,7 @@ struct file_ra_state {
 /* ra_flags bits */
 #define	READAHEAD_MMAP_MISS	0x000003ff /* cache misses for mmap access */
 #define	READAHEAD_MMAP		0x00010000
+#define	READAHEAD_LSEEK		0x00020000 /* be conservative after lseek() */
 
 #define READAHEAD_PATTERN_SHIFT	28
 #define READAHEAD_PATTERN	0xf0000000


--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Fight unfair telecom internet charges in Canada: sign http://stopthemeter.ca/
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

WARNING: multiple messages have this Message-ID (diff)
From: Wu Fengguang <fengguang.wu@intel.com>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: Linux Memory Management List <linux-mm@kvack.org>,
	<linux-fsdevel@vger.kernel.org>, Rik van Riel <riel@redhat.com>,
	Linus Torvalds <torvalds@linux-foundation.org>,
	Wu Fengguang <fengguang.wu@intel.com>
Cc: LKML <linux-kernel@vger.kernel.org>
Cc: Andi Kleen <andi@firstfloor.org>
Subject: [PATCH 8/8] readahead: dont do start-of-file readahead after lseek()
Date: Mon, 21 Nov 2011 17:18:27 +0800	[thread overview]
Message-ID: <20111121093847.015852579@intel.com> (raw)
In-Reply-To: 20111121091819.394895091@intel.com

[-- Attachment #1: readahead-lseek.patch --]
[-- Type: text/plain, Size: 2136 bytes --]

Some applications (eg. blkid, id3tool etc.) seek around the file
to get information. For example, blkid does

	     seek to	0
	     read	1024
	     seek to	1536
	     read	16384

The start-of-file readahead heuristic is wrong for them, whose
access pattern can be identified by lseek() calls.

So test-and-set a READAHEAD_LSEEK flag on lseek() and don't
do start-of-file readahead on seeing it. Proposed by Linus.

Acked-by: Rik van Riel <riel@redhat.com>
Acked-by: Linus Torvalds <torvalds@linux-foundation.org>
Signed-off-by: Wu Fengguang <fengguang.wu@intel.com>
---
 fs/read_write.c    |    4 ++++
 include/linux/fs.h |    1 +
 mm/readahead.c     |    3 +++
 3 files changed, 8 insertions(+)

--- linux-next.orig/mm/readahead.c	2011-11-20 22:02:01.000000000 +0800
+++ linux-next/mm/readahead.c	2011-11-20 22:02:03.000000000 +0800
@@ -629,6 +629,8 @@ ondemand_readahead(struct address_space 
 	 * start of file
 	 */
 	if (!offset) {
+		if ((ra->ra_flags & READAHEAD_LSEEK) && req_size < max)
+			goto random_read;
 		ra_set_pattern(ra, RA_PATTERN_INITIAL);
 		goto initial_readahead;
 	}
@@ -707,6 +709,7 @@ ondemand_readahead(struct address_space 
 	if (try_context_readahead(mapping, ra, offset, req_size, max))
 		goto readit;
 
+random_read:
 	/*
 	 * standalone, small random read
 	 */
--- linux-next.orig/fs/read_write.c	2011-11-20 22:02:01.000000000 +0800
+++ linux-next/fs/read_write.c	2011-11-20 22:02:03.000000000 +0800
@@ -47,6 +47,10 @@ static loff_t lseek_execute(struct file 
 		file->f_pos = offset;
 		file->f_version = 0;
 	}
+
+	if (!(file->f_ra.ra_flags & READAHEAD_LSEEK))
+		file->f_ra.ra_flags |= READAHEAD_LSEEK;
+
 	return offset;
 }
 
--- linux-next.orig/include/linux/fs.h	2011-11-20 22:02:01.000000000 +0800
+++ linux-next/include/linux/fs.h	2011-11-20 22:02:03.000000000 +0800
@@ -952,6 +952,7 @@ struct file_ra_state {
 /* ra_flags bits */
 #define	READAHEAD_MMAP_MISS	0x000003ff /* cache misses for mmap access */
 #define	READAHEAD_MMAP		0x00010000
+#define	READAHEAD_LSEEK		0x00020000 /* be conservative after lseek() */
 
 #define READAHEAD_PATTERN_SHIFT	28
 #define READAHEAD_PATTERN	0xf0000000



  parent reply	other threads:[~2011-11-21  9:18 UTC|newest]

Thread overview: 116+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-11-21  9:18 [PATCH 0/8] readahead stats/tracing, backwards prefetching and more Wu Fengguang
2011-11-21  9:18 ` Wu Fengguang
2011-11-21  9:18 ` Wu Fengguang
2011-11-21  9:18 ` [PATCH 1/8] block: limit default readahead size for small devices Wu Fengguang
2011-11-21  9:18   ` Wu Fengguang
2011-11-21  9:18   ` Wu Fengguang
2011-11-21 10:00   ` Christoph Hellwig
2011-11-21 10:00     ` Christoph Hellwig
2011-11-21 11:24     ` Wu Fengguang
2011-11-21 11:24       ` Wu Fengguang
2011-11-21 12:47     ` Andi Kleen
2011-11-21 12:47       ` Andi Kleen
2011-11-21 14:46   ` Jeff Moyer
2011-11-21 14:46     ` Jeff Moyer
2011-11-21 14:46     ` Jeff Moyer
2011-11-21 22:52   ` Andrew Morton
2011-11-21 22:52     ` Andrew Morton
2011-11-21 22:52     ` Andrew Morton
2011-11-22 14:23     ` Jeff Moyer
2011-11-22 14:23       ` Jeff Moyer
2011-11-22 14:23       ` Jeff Moyer
2011-11-23 12:18     ` Wu Fengguang
2011-11-23 12:18       ` Wu Fengguang
2011-11-21  9:18 ` [PATCH 2/8] readahead: make default readahead size a kernel parameter Wu Fengguang
2011-11-21  9:18   ` Wu Fengguang
2011-11-21  9:18   ` Wu Fengguang
2011-11-21 10:01   ` Christoph Hellwig
2011-11-21 10:01     ` Christoph Hellwig
2011-11-21 11:35     ` Wu Fengguang
2011-11-21 11:35       ` Wu Fengguang
2011-11-24 22:28       ` Jan Kara
2011-11-24 22:28         ` Jan Kara
2011-11-25  0:36         ` Dave Chinner
2011-11-25  0:36           ` Dave Chinner
2011-11-28  2:39           ` Wu Fengguang
2011-11-28  2:39             ` Wu Fengguang
2011-11-30 13:04             ` Christian Ehrhardt
2011-11-30 13:04               ` Christian Ehrhardt
2011-11-30 13:04               ` Christian Ehrhardt
2011-11-30 13:29               ` Wu Fengguang
2011-11-30 13:29                 ` Wu Fengguang
2011-11-30 13:29                 ` Wu Fengguang
2011-11-30 16:09                 ` Jan Kara
2011-11-30 16:09                   ` Jan Kara
2011-11-21 13:16   ` Namhyung Kim
2011-11-21 13:16     ` Namhyung Kim
2011-11-21 13:24     ` Wu Fengguang
2011-11-21 13:24       ` Wu Fengguang
2011-11-21  9:18 ` [PATCH 3/8] readahead: replace ra->mmap_miss with ra->ra_flags Wu Fengguang
2011-11-21  9:18   ` Wu Fengguang
2011-11-21  9:18   ` Wu Fengguang
2011-11-21 11:04   ` Steven Whitehouse
2011-11-21 11:04     ` Steven Whitehouse
2011-11-21 11:42     ` Wu Fengguang
2011-11-21 11:42       ` Wu Fengguang
2011-11-21 23:01   ` Andrew Morton
2011-11-21 23:01     ` Andrew Morton
2011-11-21 23:01     ` Andrew Morton
2011-11-23 12:47     ` Wu Fengguang
2011-11-23 12:47       ` Wu Fengguang
2011-11-23 20:31       ` Andrew Morton
2011-11-23 20:31         ` Andrew Morton
2011-11-29  3:42         ` Wu Fengguang
2011-11-29  3:42           ` Wu Fengguang
2011-11-21  9:18 ` [PATCH 4/8] readahead: record readahead patterns Wu Fengguang
2011-11-21  9:18   ` Wu Fengguang
2011-11-21  9:18   ` Wu Fengguang
2011-11-21 23:19   ` Andrew Morton
2011-11-21 23:19     ` Andrew Morton
2011-11-21 23:19     ` Andrew Morton
2011-11-29  2:40     ` Wu Fengguang
2011-11-29  2:40       ` Wu Fengguang
2011-11-21  9:18 ` [PATCH 5/8] readahead: add /debug/readahead/stats Wu Fengguang
2011-11-21  9:18   ` Wu Fengguang
2011-11-21  9:18   ` Wu Fengguang
2011-11-21 14:17   ` Andi Kleen
2011-11-21 14:17     ` Andi Kleen
2011-11-22 14:14     ` Wu Fengguang
2011-11-22 14:14       ` Wu Fengguang
2011-11-21 23:29   ` Andrew Morton
2011-11-21 23:29     ` Andrew Morton
2011-11-21 23:32     ` Andi Kleen
2011-11-21 23:32       ` Andi Kleen
2011-11-29  3:23     ` Wu Fengguang
2011-11-29  3:23       ` Wu Fengguang
2011-11-29  4:49       ` Andrew Morton
2011-11-29  4:49         ` Andrew Morton
2011-11-29  6:41         ` Wu Fengguang
2011-11-29  6:41           ` Wu Fengguang
2011-11-29 12:29           ` Wu Fengguang
2011-11-29 12:29             ` Wu Fengguang
2011-11-21  9:18 ` [PATCH 6/8] readahead: add debug tracing event Wu Fengguang
2011-11-21  9:18   ` Wu Fengguang
2011-11-21  9:18   ` Wu Fengguang
2011-11-21 14:01   ` Steven Rostedt
2011-11-21 14:01     ` Steven Rostedt
2011-11-21  9:18 ` [PATCH 7/8] readahead: basic support for backwards prefetching Wu Fengguang
2011-11-21  9:18   ` Wu Fengguang
2011-11-21  9:18   ` Wu Fengguang
2011-11-21 23:33   ` Andrew Morton
2011-11-21 23:33     ` Andrew Morton
2011-11-21 23:33     ` Andrew Morton
2011-11-29  3:08     ` Wu Fengguang
2011-11-29  3:08       ` Wu Fengguang
2011-11-21  9:18 ` Wu Fengguang [this message]
2011-11-21  9:18   ` [PATCH 8/8] readahead: dont do start-of-file readahead after lseek() Wu Fengguang
2011-11-21  9:18   ` Wu Fengguang
2011-11-21 23:36   ` Andrew Morton
2011-11-21 23:36     ` Andrew Morton
2011-11-21 23:36     ` Andrew Morton
2011-11-22 14:18     ` Wu Fengguang
2011-11-22 14:18       ` Wu Fengguang
2011-11-21  9:56 ` [PATCH 0/8] readahead stats/tracing, backwards prefetching and more Christoph Hellwig
2011-11-21  9:56   ` Christoph Hellwig
2011-11-21 12:00   ` Wu Fengguang
2011-11-21 12:00     ` Wu Fengguang

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20111121093847.015852579@intel.com \
    --to=fengguang.wu@intel.com \
    --cc=akpm@linux-foundation.org \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=riel@redhat.com \
    --cc=torvalds@linux-foundation.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.