public inbox for linux-kernel@vger.kernel.org
 help / color / mirror / Atom feed
From: Guido Fiala <gfiala@s.netic.de>
To: linux-kernel@vger.kernel.org
Subject: large files unnecessary trashing filesystem cache?
Date: Tue, 18 Oct 2005 22:01:10 +0200	[thread overview]
Message-ID: <200510182201.11241.gfiala@s.netic.de> (raw)

(please note, i'am not subscribed to the list, please CC me on reply)

Story:
Once in while we have a discussion at the vdr (video disk recorder) mailing 
list about very large files trashing the filesystems memory cache leading to 
unnecessary delays accessing directory contents no longer cached.

This program and certainly all applications that deal with very large files 
only read once (much larger than usual memory)  - it happens that all other 
cached blocks of the filessystem are removed from memory solely to keep as 
much as possible of that file in memory, which seems to be a bad strategy in 
most situations.

Of course one could always implement f_advise-calls in all applications, but i 
suggest a discussion if a maximum (configurable) in-memory-cache on a 
per-file base should be implemented in linux/mm or where this belongs.

My guess was, it has something to do with mm/readahead.c, a test limiting the 
result of the function "max_sane_readahead(...) to 8 MBytes as a quick and 
dirty test did not solve the issue, but i might have done something wrong.

I've searched the archive but could not find a previous discussion - is this a 
new idea?

It would be interesting to discuss if and when this proposed feature could 
lead to better performance or has any unwanted side effects.

Thanks for ideas on that issue.

             reply	other threads:[~2005-10-18 20:03 UTC|newest]

Thread overview: 25+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2005-10-18 20:01 Guido Fiala [this message]
2005-10-18 20:48 ` large files unnecessary trashing filesystem cache? Badari Pulavarty
2005-10-20 15:23   ` Guido Fiala
2005-10-19  3:02 ` Andrew James Wade
2005-10-19  4:37   ` Andrew Morton
2005-10-19  5:45     ` Andrew James Wade
2005-10-19 11:01       ` gfiala
2005-10-19 11:10     ` gfiala
2005-10-19 15:54       ` Ingo Oeser
2005-10-19 19:49         ` Andrew Morton
2005-10-19 22:26           ` Paul Jackson
2005-10-20  6:28           ` Ingo Oeser
2005-10-19  4:10 ` Lee Revell
2005-10-19 15:43   ` Badari Pulavarty
2005-10-19 17:58   ` Guido Fiala
2005-10-19 18:43     ` Kyle Moffett
2005-10-19 18:52       ` Guido Fiala
     [not found] <4Z5WG-1iM-19@gated-at.bofh.it>
     [not found] ` <4Z6zs-27l-39@gated-at.bofh.it>
2005-10-18 21:58   ` Bodo Eggert
2005-10-18 23:05     ` Badari Pulavarty
2005-10-19  0:20       ` David Lang
2005-10-19  0:33       ` Fawad Lateef
2005-10-19  1:42         ` Bernd Eckenfels
2005-10-19  7:23       ` Bodo Eggert
2005-10-19 11:06         ` gfiala
2005-10-19 13:43     ` Avi Kivity

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=200510182201.11241.gfiala@s.netic.de \
    --to=gfiala@s.netic.de \
    --cc=linux-kernel@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox