linux-fsdevel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Wu Fengguang <fengguang.wu@intel.com>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: Jens Axboe <jens.axboe@oracle.com>
Cc: Chris Mason <chris.mason@oracle.com>
Cc: Peter Zijlstra <a.p.zijlstra@chello.nl>
Cc: Clemens Ladisch <clemens@ladisch.de>
Cc: Olivier Galibert <galibert@pobox.com>
Cc: Vivek Goyal <vgoyal@redhat.com>
Cc: Christian Ehrhardt <ehrhardt@linux.vnet.ibm.com>
Cc: Matt Mackall <mpm@selenic.com>
Cc: Nick Piggin <npiggin@suse.de>
Cc: Linux Memory Management List <linux-mm@kvack.org>
Cc: <linux-fsdevel@vger.kernel.org>
Cc: Wu Fengguang <fengguang.wu@intel.com>,
	LKML <linux-kernel@vger.kernel.org>
Subject: [PATCH 00/16] [PATCH 00/15] 512K readahead size with thrashing safe readahead v3
Date: Mon, 01 Mar 2010 13:26:51 +0800	[thread overview]
Message-ID: <20100301052651.857984880@intel.com> (raw)

Andrew,

This enlarges the default readahead size from 128K to 512K.
To avoid possible regressions, also do
- scale down readahead size on small device and small memory
- thrashing safe context readahead
- add readahead tracing/stats support to help expose possible problems

Besides, the patchset also includes several algorithm updates:
- no start-of-file readahead after lseek
- faster radix_tree_next_hole()/radix_tree_prev_hole()
- pagecache context based mmap read-around


Changes since v2:
- add notes on readahead size
- limit read-around size for small memory system, but don't limit readahead size
- bug fix: allow context readahead async size grow to its full size
- bug fix: let radix_tree_lookup_leaf_node() handle the height=1 case

Changes since v1:
- update mmap read-around heuristics (Thanks to Nick Piggin)
- radix_tree_lookup_leaf_node() for the pagecache based mmap read-around
- use __print_symbolic() to show readahead pattern names
  (Thanks to Steven Rostedt)
- scale down readahead size proportional to system memory
  (Thanks to Matt Mackall)
- add readahead size kernel parameter (by Nikanth Karthikesan)
- add comments from Christian Ehrhardt

Changes since RFC:
- move the lenthy intro text to individual patch changelogs
- treat get_capacity()==0 as uninitilized value (Thanks to Vivek Goyal)
- increase readahead size limit for small devices (Thanks to Jens Axboe)
- add fio test results by Vivek Goyal


[PATCH 01/16] readahead: limit readahead size for small devices
[PATCH 02/16] readahead: retain inactive lru pages to be accessed soon
[PATCH 03/16] readahead: bump up the default readahead size
[PATCH 04/16] readahead: make default readahead size a kernel parameter
[PATCH 05/16] readahead: limit read-ahead size for small memory systems
[PATCH 06/16] readahead: add notes on readahead size
[PATCH 07/16] readahead: replace ra->mmap_miss with ra->ra_flags
[PATCH 08/16] readahead: thrashing safe context readahead
[PATCH 09/16] readahead: record readahead patterns
[PATCH 10/16] readahead: add tracing event
[PATCH 11/16] readahead: add /debug/readahead/stats
[PATCH 12/16] readahead: dont do start-of-file readahead after lseek()
[PATCH 13/16] radixtree: introduce radix_tree_lookup_leaf_node()
[PATCH 14/16] radixtree: speed up the search for hole
[PATCH 15/16] readahead: reduce MMAP_LOTSAMISS for mmap read-around
[PATCH 16/16] readahead: pagecache context based mmap read-around

 Documentation/kernel-parameters.txt |    4 
 block/blk-core.c                    |    3 
 block/genhd.c                       |   24 +
 fs/fuse/inode.c                     |    2 
 fs/read_write.c                     |    3 
 include/linux/fs.h                  |   64 +++
 include/linux/mm.h                  |    8 
 include/linux/radix-tree.h          |    2 
 include/trace/events/readahead.h    |   78 ++++
 lib/radix-tree.c                    |  104 ++++-
 mm/Kconfig                          |   13 
 mm/filemap.c                        |   34 +
 mm/readahead.c                      |  458 ++++++++++++++++++++++----
 13 files changed, 688 insertions(+), 109 deletions(-)

Thanks,
Fengguang

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

             reply	other threads:[~2010-03-01  5:26 UTC|newest]

Thread overview: 17+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2010-03-01  5:26 Wu Fengguang [this message]
2010-03-01  5:26 ` [PATCH 01/16] readahead: limit readahead size for small devices Wu Fengguang
2010-03-01  5:26 ` [PATCH 02/16] readahead: retain inactive lru pages to be accessed soon Wu Fengguang
2010-03-01  5:26 ` [PATCH 03/16] readahead: bump up the default readahead size Wu Fengguang
2010-03-01  5:26 ` [PATCH 04/16] readahead: make default readahead size a kernel parameter Wu Fengguang
2010-03-01  5:26 ` [PATCH 05/16] readahead: limit read-ahead size for small memory systems Wu Fengguang
2010-03-01  5:26 ` [PATCH 06/16] readahead: add notes on readahead size Wu Fengguang
2010-03-01  5:26 ` [PATCH 07/16] readahead: replace ra->mmap_miss with ra->ra_flags Wu Fengguang
2010-03-01  5:26 ` [PATCH 08/16] readahead: thrashing safe context readahead Wu Fengguang
2010-03-01  5:27 ` [PATCH 09/16] readahead: record readahead patterns Wu Fengguang
2010-03-01  5:27 ` [PATCH 10/16] readahead: add tracing event Wu Fengguang
2010-03-01  5:27 ` [PATCH 11/16] readahead: add /debug/readahead/stats Wu Fengguang
2010-03-01  5:27 ` [PATCH 12/16] readahead: dont do start-of-file readahead after lseek() Wu Fengguang
2010-03-01  5:27 ` [PATCH 13/16] radixtree: introduce radix_tree_lookup_leaf_node() Wu Fengguang
2010-03-01  5:27 ` [PATCH 14/16] radixtree: speed up the search for hole Wu Fengguang
2010-03-01  5:27 ` [PATCH 15/16] readahead: reduce MMAP_LOTSAMISS for mmap read-around Wu Fengguang
2010-03-01  5:27 ` [PATCH 16/16] readahead: pagecache context based " Wu Fengguang

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20100301052651.857984880@intel.com \
    --to=fengguang.wu@intel.com \
    --cc=akpm@linux-foundation.org \
    --cc=jens.axboe@oracle.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).