[2.6.15-rc1] VFS: file-max limit 400490 reached

[2.6.15-rc1] VFS: file-max limit 400490 reached

[Jeff Garzik]

[-- Attachment #1: Type: text/plain, Size: 679 bytes --]


I rebooted my RHEL4-based ipv4/ipv6 gateway/server into 2.6.15-rc1, and 
very soon the box was brought to its knees, spewing

	VFS: file-max limit 400490 reached

with the resultant userspace breakage associated with that.  Data points:

* recent 2.6.14-git-recent works
* 2.6.15-rc1 fails
* besides the above error, the only other notable syslog item is 
complaints from radvd (ipv6 router advertisement daemon)
* past logs don't show this radvd error
* machine: Intel x86 HT SMP SATA e1000 8139too (kernel config attached)

So, my guess is that something broke in rtnetlink ipv6.

But I could be wildly wrong.  This might not have anything to do with 
the net stack at all.



[-- Attachment #2: log.txt.bz2 --]
[-- Type: application/x-bzip2, Size: 1507 bytes --]

[-- Attachment #3: config.bz2 --]
[-- Type: application/x-bzip2, Size: 7304 bytes --]

Re: [2.6.15-rc1] VFS: file-max limit 400490 reached

[Chris Wedgwood]

On Sat, Nov 12, 2005 at 12:26:48AM -0500, Jeff Garzik wrote:

> 	VFS: file-max limit 400490 reached

does lsof show anything useful?

Re: [2.6.15-rc1] VFS: file-max limit 400490 reached

[Jeff Garzik]

Chris Wedgwood wrote:
> On Sat, Nov 12, 2005 at 12:26:48AM -0500, Jeff Garzik wrote:
> 
> 
>>	VFS: file-max limit 400490 reached
> 
> 
> does lsof show anything useful?

Alas, no.  [from memory, I've since rebooted]

lsof | wc -l
808

Re: [2.6.15-rc1] VFS: file-max limit 400490 reached

[Jeff Garzik]

[-- Attachment #1: Type: text/plain, Size: 441 bytes --]

Jeff Garzik wrote:
> 
> I rebooted my RHEL4-based ipv4/ipv6 gateway/server into 2.6.15-rc1, and 
> very soon the box was brought to its knees, spewing
> 
>     VFS: file-max limit 400490 reached

Follow-up:  I may have excised too much from the head of the log I posted.

It now looks like the radvd troubles may have started with a link 
up/down event.

Attached is some additional lines found at the -head- of the previously 
posted log.


[-- Attachment #2: log2.txt --]
[-- Type: text/plain, Size: 2485 bytes --]

Nov 11 22:38:32 pretzel dhcpd: dhcpd startup succeeded
Nov 11 22:38:33 pretzel exim: exim startup succeeded
Nov 11 22:38:34 pretzel httpd: httpd startup succeeded
Nov 11 22:38:34 pretzel crond: crond startup succeeded
Nov 11 22:38:34 pretzel anacron: anacron startup succeeded
Nov 11 22:38:35 pretzel atd: atd startup succeeded
Nov 11 22:38:40 pretzel login(pam_unix)[4705]: session opened for user root by LOGIN(uid=0)
Nov 11 22:38:40 pretzel  -- root[4705]: ROOT LOGIN ON tty1
Nov 11 22:38:55 pretzel login(pam_unix)[4705]: session closed for user root
Nov 11 22:45:54 pretzel sshd(pam_unix)[5241]: session opened for user jgarzik by (uid=0)
Nov 11 22:45:58 pretzel sshd(pam_unix)[5283]: session opened for user jgarzik by (uid=0)
Nov 11 23:01:01 pretzel crond(pam_unix)[28125]: session opened for user root by (uid=0)
Nov 11 23:01:02 pretzel crond(pam_unix)[28125]: session closed for user root
Nov 11 23:01:39 pretzel sshd(pam_unix)[29561]: session opened for user jgarzik by (uid=0)
Nov 11 23:01:48 pretzel sshd(pam_unix)[29561]: session closed for user jgarzik
Nov 11 23:34:00 pretzel kernel: e1000: eth1: e1000_watchdog_task: NIC Link is Down
Nov 11 23:34:01 pretzel netplugd[4112]: eth1: state ACTIVE flags 0x00001043 UP,BROADCAST,RUNNING,MULTICAST -> 0x00001003 UP,BROADCAST,MULTICAST
Nov 11 23:34:01 pretzel netplugd[25700]: /etc/netplug.d/netplug eth1 out -> pid 25700
Nov 11 23:34:01 pretzel radvd[4428]: resetting ipv6-allrouters membership on eth1
Nov 11 23:34:01 pretzel radvd[4428]: can't join ipv6-allrouters on eth1
Nov 11 23:34:07 pretzel kernel: e1000: eth1: e1000_watchdog_task: NIC Link is Up 1000 Mbps Full Duplex
Nov 11 23:34:07 pretzel netplugd[4112]: eth1: state OUTING flags 0x00001003 UP,BROADCAST,MULTICAST -> 0x00001043 UP,BROADCAST,RUNNING,MULTICAST
Nov 11 23:34:10 pretzel radvd[4428]: resetting ipv6-allrouters membership on eth1
Nov 11 23:34:10 pretzel radvd[4428]: can't join ipv6-allrouters on eth1
Nov 11 23:34:16 pretzel radvd[4428]: resetting ipv6-allrouters membership on eth1
Nov 11 23:34:16 pretzel radvd[4428]: can't join ipv6-allrouters on eth1
Nov 11 23:34:23 pretzel radvd[4428]: resetting ipv6-allrouters membership on eth1
Nov 11 23:34:23 pretzel radvd[4428]: can't join ipv6-allrouters on eth1
Nov 11 23:34:31 pretzel radvd[4428]: resetting ipv6-allrouters membership on eth1
Nov 11 23:34:31 pretzel radvd[4428]: can't join ipv6-allrouters on eth1
Nov 11 23:34:37 pretzel radvd[4428]: resetting ipv6-allrouters membership on eth1
[...]