All of lore.kernel.org
 help / color / mirror / Atom feed
From: Jesper Krogh <jesper@krogh.cc>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: linux-kernel@vger.kernel.org
Subject: Re: Many open/close on same files yeilds "No such file or directory".
Date: Fri, 09 May 2008 08:09:34 +0200	[thread overview]
Message-ID: <4823EA9E.6050703@krogh.cc> (raw)
In-Reply-To: <20080508223635.523b8fa7.akpm@linux-foundation.org>

Andrew Morton wrote:
>> My feeling is that the script below may reveal the bug on any "busy" 
>> volume, where busy is lots of activity in the OS-cache of the volume,
>> not on the actual drives.
> 
> By this do you mean that there has to be a lot of other activity on the
> system to reproduce it?  Stuff which is turning over memory?

Yes, something like that. (sorry for not being able to be more
concrete). The applications has "high activity" on a few files, not
spread activity throughout the volume.

> Because one possiblity is that the cached dentry got reclaimed by memory
> pressure and we have some race bug which causes us to think that the file
> doesn't exist.

What can i do to explore this theory? Can I disable caching of dentries
and see it go away? Does it fit the pattern that it is only the 
"open"-syscall that is hit (not read for example)?

> (That still shouldn't happen because the dentry should be marked
> recently-accessed, but perhaps the underlying inode gets reclaimed or
> something.  Grasping at straws here)

When I disabled the NFS-server and rand my "real-world" program on a
single processor (make -j 1). It ran through fine. It basically
gets around 20 million chunks out of differnet file and assemble the
chuncks in a few other files. This processes more or less 5 individual
sections, so make can run effectively with a concurrency of 5.

I dont know if there can be any technical reasons for not seeing it on
internal attached disks? (other than I just hadn't been able to
reproduce the same error conditions there.

Jesper
-- 
Jesper

  reply	other threads:[~2008-05-09  6:09 UTC|newest]

Thread overview: 31+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2008-05-01 15:34 Many open/close on same files yeilds "No such file or directory" Jesper Krogh
2008-05-02  5:39 ` Andrew Morton
2008-05-02  8:20   ` Jesper Krogh
2008-05-01 12:15     ` Arjan van de Ven
2008-05-02 11:03       ` Many open/close on same files yeilds Jesper Krogh
2008-05-01 14:07         ` Arjan van de Ven
2008-05-02 15:19     ` Many open/close on same files yeilds "No such file or directory" Jesper Krogh
2008-05-02 15:47       ` Ray Lee
2008-05-02 15:55         ` Jesper Krogh
2008-05-02 16:45           ` Ray Lee
2008-05-02 19:53             ` Jesper Krogh
2008-05-02 19:52         ` Jesper Krogh
2008-05-05 17:43           ` Jesper Krogh
2008-05-05 17:51             ` Randy.Dunlap
2008-05-05 17:54               ` Jesper Krogh
     [not found]                 ` <2c0942db0805051121r47cc97d2jb71cc8ab9eaa7981@mail.gmail.com>
2008-05-05 18:29                   ` Jesper Krogh
     [not found]                     ` <2c0942db0805051154q63a18bcfhce8a30d4a663ea3f@mail.gmail.com>
2008-05-07 20:51                       ` Jesper Krogh
2008-05-07 22:27                         ` Jesper Krogh
2008-05-02 15:21     ` Jesper Krogh
2008-05-09  5:22 ` Jesper Krogh
2008-05-09  5:36   ` Andrew Morton
2008-05-09  6:09     ` Jesper Krogh [this message]
2008-05-09  6:22       ` Andrew Morton
2008-05-12  1:53       ` Neil Brown
2008-05-12  1:53         ` Neil Brown
     [not found]         ` <18471.41781.164396.385159-wvvUuzkyo1EYVZTmpyfIwg@public.gmane.org>
2008-05-12  6:00           ` J. Bruce Fields
2008-05-12  6:00             ` J. Bruce Fields
2008-05-12  6:41         ` Jesper Krogh
     [not found]           ` <4827E67E.3050008-Q2TZfHgGEy4@public.gmane.org>
2008-05-12  6:51             ` Andrew Morton
2008-05-12  6:51               ` Andrew Morton
     [not found] <aoJcW-38V-37@gated-at.bofh.it>
     [not found] ` <aoWjI-1Br-5@gated-at.bofh.it>
     [not found]   ` <aoYOH-6RO-13@gated-at.bofh.it>
     [not found]     ` <ap5nc-3ZT-7@gated-at.bofh.it>
     [not found]       ` <ap5Gx-4vu-43@gated-at.bofh.it>
     [not found]         ` <ap9Ar-4Nn-21@gated-at.bofh.it>
     [not found]           ` <aqcZe-7Fg-23@gated-at.bofh.it>
     [not found]             ` <aqd98-7Vb-25@gated-at.bofh.it>
     [not found]               ` <aqd99-7Vb-27@gated-at.bofh.it>
2008-05-05 19:05                 ` Henry Nestler

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4823EA9E.6050703@krogh.cc \
    --to=jesper@krogh.cc \
    --cc=akpm@linux-foundation.org \
    --cc=linux-kernel@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.