linux-um archives
 help / color / mirror / Atom feed
* [uml-devel] UML not returning memory
@ 2004-10-12  1:04 Michael Richardson
  2004-10-12  1:40 ` BlaisorBlade
  0 siblings, 1 reply; 3+ messages in thread
From: Michael Richardson @ 2004-10-12  1:04 UTC (permalink / raw)
  To: user-mode-linux-devel

-----BEGIN PGP SIGNED MESSAGE-----


Host: 

gimli-[aggr/testing/pluto/basic-pluto-01] mcr 1097 %uname -a
Linux gimli 2.4.24 #4 Tue Mar 9 22:18:59 EST 2004 i686 GNU/Linux
debian-sarge, linus kernel.
I seem to be running in TT mode, rather than MM.
(I guess I forgot to apply skas3 on this host)

Guest:

east:~# uname -a
Linux east 2.4.26-3um #1 Fri Oct 8 00:26:17 EDT 2004 i686 unknown

As I run, I gradually run out of memory.
I start UMLs and stop them, reboot them, lots as I am working.
The box does nothing else. I killed all random processes that might have
been using ram, but the memory does not return. We had this problem
on another box, and never figured it out.

I expect that UML is allocating memory and never returning it.
But, given lack of /proc/mm, I don't see how it could be doing this kind
of thing.

Any ideas of where else memory might be disappearing to?


*BEFORE REBOOT*

gimli:/etc/rc2.d# free
             total       used       free     shared    buffers     cached
Mem:        514060     449504      64556          0      65128     134412
- -/+ buffers/cache:     249964     264096
Swap:      1052216        116    1052100

gimli:/etc/rc2.d# ps aux
USER       PID %CPU %MEM   VSZ  RSS TTY      STAT START   TIME COMMAND
root         1  0.0  0.0  1492  504 ?        S    Oct10   0:14 init [2]  
root         2  0.0  0.0     0    0 ?        S    Oct10   0:00 [keventd]
root         3  0.0  0.0     0    0 ?        SN   Oct10   0:01 [ksoftirqd_CPU0]
root         4  0.0  0.0     0    0 ?        S    Oct10   0:00 [kswapd]
root         5  0.0  0.0     0    0 ?        S    Oct10   0:00 [bdflush]
root         6  0.0  0.0     0    0 ?        S    Oct10   0:50 [kupdated]
root        12  0.0  0.0     0    0 ?        S    Oct10   0:00 [khubd]
root        21  0.0  0.0     0    0 ?        S    Oct10   0:31 [kjournald]
root       164  0.0  0.0     0    0 ?        S    Oct10   0:10 [kjournald]
root       165  0.0  0.0     0    0 ?        S    Oct10   0:38 [kjournald]
root       166  0.0  0.0     0    0 ?        S    Oct10   0:01 [kjournald]
root       167  0.0  0.0     0    0 ?        S    Oct10   0:00 [kjournald]
root       168  0.0  0.0     0    0 ?        S    Oct10   0:00 [kjournald]
root       169  0.0  0.0     0    0 ?        S    Oct10   0:00 [kjournald]
root       170  0.0  0.0     0    0 ?        S    Oct10   0:00 [kjournald]
root       171  0.0  0.0     0    0 ?        S    Oct10   0:01 [kjournald]
root       172  0.0  0.0     0    0 ?        S    Oct10   0:00 [kjournald]
root       173  0.0  0.0     0    0 ?        S    Oct10   0:00 [kjournald]
root       174  0.0  0.0     0    0 ?        S    Oct10   0:01 [kjournald]
root       175  0.0  0.0     0    0 ?        S    Oct10   0:00 [kjournald]
daemon     300  0.0  0.0  1608  440 ?        Ss   Oct10   0:00 /sbin/portmap
root       306  0.0  0.0     0    0 ?        S    Oct10   0:05 [rpciod]
root       307  0.0  0.0     0    0 ?        S    Oct10   0:00 [lockd]
root       397  0.0  0.1  2240  804 ?        Ss   Oct10   0:00 /sbin/syslogd
root       400  0.0  0.1  1492  572 ?        Ss   Oct10   0:00 /sbin/klogd
root       437  0.0  0.1  2220  748 ?        Ss   Oct10   0:00 /usr/sbin/inetd
root       457  0.0  0.2  3384 1264 ?        Ss   Oct10   0:00 /usr/sbin/sshd
root       466  0.0  0.1  2368  912 ?        Ss   Oct10   0:00 /sbin/rpc.statd
root       469  0.0  0.7  3916 3916 ?        SLs  Oct10   0:08 /usr/sbin/ntpd -p
daemon     545  0.0  0.1  1672  604 ?        Ss   Oct10   0:00 /usr/sbin/atd
root       552  0.0  0.1  1756  808 ?        Ss   Oct10   0:00 /usr/sbin/cron
root       825  0.0  0.2  2584 1484 ttyS0    Ss   Oct10   0:00 -bash
root       826  0.0  0.3  6148 1792 ?        Ss   Oct10   0:00 sshd: mcr [priv]
mcr        828  0.0  0.4  6580 2172 ?        S    Oct10   0:47 sshd: mcr@notty
mcr        829  0.0  0.6  5908 3368 ?        Ss   Oct10   0:04 xterm -iconic -na
mcr        839  0.0  0.3  3280 2036 pts/0    Ss+  Oct10   0:00 zsh
mcr      23123  0.0  0.5  5452 2940 pts/0    S    20:44   0:00 xterm -name GIMLI
mcr      23124  0.0  0.3  3292 1856 pts/1    Ss+  20:44   0:00 zsh
root     25944  0.0  0.1  2480  848 ttyS0    R+   20:57   0:00 ps aux

*AFTER REBOOT* (no UMLs running yet)
gimli:~# ps ax
  PID TTY      STAT   TIME COMMAND
    1 ?        S      0:07 init [2]  
    2 ?        S      0:00 [keventd]
    3 ?        SN     0:00 [ksoftirqd_CPU0]
    4 ?        S      0:00 [kswapd]
    5 ?        S      0:00 [bdflush]
    6 ?        S      0:00 [kupdated]
   12 ?        S      0:00 [khubd]
   21 ?        S      0:00 [kjournald]
  164 ?        S      0:00 [kjournald]
  165 ?        S      0:00 [kjournald]
  166 ?        S      0:00 [kjournald]
  167 ?        S      0:00 [kjournald]
  168 ?        S      0:00 [kjournald]
  169 ?        S      0:00 [kjournald]
  170 ?        S      0:00 [kjournald]
  171 ?        S      0:00 [kjournald]
  172 ?        S      0:00 [kjournald]
  173 ?        S      0:00 [kjournald]
  174 ?        S      0:00 [kjournald]
  175 ?        S      0:00 [kjournald]
  287 ?        Ss     0:00 /sbin/portmap
  293 ?        S      0:00 [rpciod]
  294 ?        S      0:00 [lockd]
  380 ?        Ss     0:00 /sbin/syslogd
  383 ?        Ss     0:00 /sbin/klogd
  391 ?        Ss     0:00 /usr/sbin/named -u bind
  393 ?        S      0:00 /usr/sbin/named -u bind
  394 ?        R      0:02 /usr/sbin/named -u bind
  395 ?        S      0:00 /usr/sbin/named -u bind
  396 ?        S      0:00 /usr/sbin/named -u bind
  402 ?        Ss     0:00 /usr/sbin/lwresd
  405 ?        S      0:00 /usr/sbin/lwresd
  406 ?        S      0:00 /usr/sbin/lwresd
  407 ?        S      0:00 /usr/sbin/lwresd
  408 ?        S      0:00 /usr/sbin/lwresd
  414 ?        Ss     0:00 /usr/sbin/inetd
  418 ?        Ss     0:00 /usr/sbin/lpd -s
  431 ?        Ss     0:00 /usr/sbin/sshd
  435 ?        Ss     0:00 /sbin/rpc.statd
  438 ?        SLs    0:00 /usr/sbin/ntpd -p /var/run/ntpd.pid
  499 ?        S      0:00 /bin/sh /usr/local/lib/ipsec/_plutorun --debug  --uni
  500 ?        S      0:00 logger -s -p daemon.error -t ipsec__plutorun
  503 ?        S      0:00 /bin/sh /usr/local/lib/ipsec/_plutorun --debug  --uni
  507 ?        S      0:00 /usr/local/libexec/ipsec/pluto --nofork --secretsfile
  508 ?        S      0:00 /bin/sh /usr/local/lib/ipsec/_plutoload --wait no --p
  513 ?        Ss     0:00 /usr/sbin/atd
  518 ?        Ss     0:00 /usr/sbin/cron
  528 ?        S      0:00 _pluto_adns
  603 ?        S      0:00 /usr/sbin/apache
  610 ttyS0    Ss     0:00 -bash
  703 ?        S      0:00 /usr/sbin/apache
  704 ?        S      0:00 /usr/sbin/apache
  705 ?        S      0:00 /usr/sbin/apache
  706 ?        S      0:00 /usr/sbin/apache
  711 ?        S      0:00 /usr/sbin/apache
  715 ?        S      0:00 _pluto_adns
  716 ?        S      0:00 _pluto_adns
  763 ?        S      0:00 _pluto_adns
  764 ?        S      0:00 _pluto_adns
  765 ?        S      0:00 _pluto_adns
  766 ?        S      0:00 _pluto_adns
  767 ?        S      0:00 _pluto_adns
  768 ?        S      0:00 _pluto_adns
  769 ?        S      0:00 _pluto_adns
  770 ?        S      0:00 _pluto_adns
  772 ttyS0    R+     0:00 ps ax

gimli:~# free
             total       used       free     shared    buffers     cached
Mem:        514060      32640     481420          0       2380      13156
- -/+ buffers/cache:      17104     496956
Swap:      1052216          0    1052216

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.2 (GNU/Linux)
Comment: Finger me for keys

iQCVAwUBQWstgYqHRg3pndX9AQHp6QQAzKKtUDn2p63cKgu+P+oAqFasJlU3oaMb
qNljaL6pteRS6NadD0cZHxuUW++5PIWIC+I3bmLngOvKMNrVh7LzhzaQcbWZ6cTh
Bw9HQfyOrjjImkG007M69fvl6L/PTOP/B2i64YH2P8PFA1bLoTMS4ZNWY56MBwoQ
+wUtFrNmVbQ=
=BpOZ
-----END PGP SIGNATURE-----


-------------------------------------------------------
This SF.net email is sponsored by: IT Product Guide on ITManagersJournal
Use IT products in your business? Tell us what you think of them. Give us
Your Opinions, Get Free ThinkGeek Gift Certificates! Click to find out more
http://productguide.itmanagersjournal.com/guidepromo.tmpl
_______________________________________________
User-mode-linux-devel mailing list
User-mode-linux-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/user-mode-linux-devel

^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: [uml-devel] UML not returning memory
  2004-10-12  1:04 [uml-devel] UML not returning memory Michael Richardson
@ 2004-10-12  1:40 ` BlaisorBlade
  2004-10-12  2:01   ` Michael Richardson
  0 siblings, 1 reply; 3+ messages in thread
From: BlaisorBlade @ 2004-10-12  1:40 UTC (permalink / raw)
  To: user-mode-linux-devel; +Cc: Michael Richardson

On Tuesday 12 October 2004 03:04, Michael Richardson wrote:
> Host:
>
> gimli-[aggr/testing/pluto/basic-pluto-01] mcr 1097 %uname -a
> Linux gimli 2.4.24 #4 Tue Mar 9 22:18:59 EST 2004 i686 GNU/Linux
> debian-sarge, linus kernel.
> I seem to be running in TT mode, rather than MM.
Ah, ok, you mean SKAS mode, right? However, please make sure that /proc/mm 
does not exist; if it exists you are running in SKAS mode.
> (I guess I forgot to apply skas3 on this host)

> Guest:
>
> east:~# uname -a
> Linux east 2.4.26-3um #1 Fri Oct 8 00:26:17 EDT 2004 i686 unknown
>
> As I run, I gradually run out of memory.
> I start UMLs and stop them, reboot them, lots as I am working.

> The box does nothing else. I killed all random processes that might have
> been using ram, but the memory does not return. We had this problem
> on another box, and never figured it out.
>
> I expect that UML is allocating memory and never returning it.
> But, given lack of /proc/mm, I don't see how it could be doing this kind
> of thing.
>
> Any ideas of where else memory might be disappearing to?
The host kernel allocates his own memory (let's say it has his kmalloc'ed() 
memory) - this is the only possible idea I have.
To check this, please go posting before/after reboot, together with this data 
(please take another shoot of this data), the content of /proc/slabinfo 
and /proc/meminfo. Also, please go in runlevel 1:

telinit 1
before taking the shoot. I'd also like a comparison between the datas before 
and after you have fully started, worked on and stopped one UML instance. And 
use "ps auxw" in both cases.

Finally, please attach everything - I don't care if it is one file or separate 
files, but just that it's not inline in the mail. I prefer to avoid line 
wrapping and such things.

However, are you able to reproduce this on a box without Open/FreeSWAN 
installed (I don't know what you are using here)? If the new data I've 
requested you that the bug is in the host kernel, either it is in the vanilla 
kernel or it is in the Open/FreeSWAN patch, or in whatever other patches you 
have applied.

Having said this, I must note that something similar happened (in some special 
configurations) on host kernels with SKAS patch; but only with the version 
for kernel >= 2.4.25, and with UML in SKAS mode, and with the very first 
patch I posted on my web-site; I fixed this months ago.

Bye
-- 
Paolo Giarrusso, aka Blaisorblade
Linux registered user n. 292729


-------------------------------------------------------
This SF.net email is sponsored by: IT Product Guide on ITManagersJournal
Use IT products in your business? Tell us what you think of them. Give us
Your Opinions, Get Free ThinkGeek Gift Certificates! Click to find out more
http://productguide.itmanagersjournal.com/guidepromo.tmpl
_______________________________________________
User-mode-linux-devel mailing list
User-mode-linux-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/user-mode-linux-devel

^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: [uml-devel] UML not returning memory
  2004-10-12  1:40 ` BlaisorBlade
@ 2004-10-12  2:01   ` Michael Richardson
  0 siblings, 0 replies; 3+ messages in thread
From: Michael Richardson @ 2004-10-12  2:01 UTC (permalink / raw)
  To: BlaisorBlade; +Cc: user-mode-linux-devel

-----BEGIN PGP SIGNED MESSAGE-----


>>>>> "BlaisorBlade" == BlaisorBlade  <blaisorblade_spam@yahoo.it> writes:
    >> Host:
    >> 
    >> gimli-[aggr/testing/pluto/basic-pluto-01] mcr 1097 %uname -a
    >> Linux gimli 2.4.24 #4 Tue Mar 9 22:18:59 EST 2004 i686 GNU/Linux
    >> debian-sarge, linus kernel.  I seem to be running in TT mode,
    >> rather than MM.
    BlaisorBlade> Ah, ok, you mean SKAS mode, right? However, please
    BlaisorBlade> make sure that /proc/mm does not exist; if it exists
    BlaisorBlade> you are running in SKAS mode.

  Not running in SKAS. no /proc/mm on host.

    >> Any ideas of where else memory might be disappearing to?

    BlaisorBlade> The host kernel allocates his own memory (let's say it
    BlaisorBlade> has his kmalloc'ed() memory) - this is the only
    BlaisorBlade> possible idea I have.  To check this, please go
    BlaisorBlade> posting before/after reboot, together with this data
    BlaisorBlade> (please take another shoot of this data), the content
    BlaisorBlade> of /proc/slabinfo and /proc/meminfo. Also, please go
    BlaisorBlade> in runlevel 1:

  okay, slabinfo and meminfo.

    BlaisorBlade> Finally, please attach everything - I don't care if it
    BlaisorBlade> is one file or separate files, but just that it's not
    BlaisorBlade> inline in the mail. I prefer to avoid line wrapping
    BlaisorBlade> and such things.

  okay.

    BlaisorBlade> However, are you able to reproduce this on a box
    BlaisorBlade> without Open/FreeSWAN installed (I don't know what you
    BlaisorBlade> are using here)? If the new data I've requested you
    BlaisorBlade> that the bug is in the host kernel, either it is in
    BlaisorBlade> the vanilla kernel or it is in the Open/FreeSWAN
    BlaisorBlade> patch, or in whatever other patches you have applied.

  That's certainly possible.
  I can disable IPsec on the host, but it is compiled in, so it will
still initialize.  If I need to rebuild host kernel, I'll do that, but
not today.

    BlaisorBlade> Having said this, I must note that something similar
    BlaisorBlade> happened (in some special configurations) on host
    BlaisorBlade> kernels with SKAS patch; but only with the version for
    BlaisorBlade> kernel >= 2.4.25, and with UML in SKAS mode, and with
    BlaisorBlade> the very first patch I posted on my web-site; I fixed
    BlaisorBlade> this months ago.

  Yes, this is what has me most confused.
  I would have expected issues with SKAS.
  I keep thinking that maybe it is all in disk buffers, but the numbers
do not make sense to me.

- --
]     "Elmo went to the wrong fundraiser" - The Simpson         |  firewalls  [
]   Michael Richardson,    Xelerance Corporation, Ottawa, ON    |net architect[
] mcr@xelerance.com      http://www.sandelman.ottawa.on.ca/mcr/ |device driver[
] panic("Just another Debian GNU/Linux using, kernel hacking, security guy"); [
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.2 (GNU/Linux)
Comment: Finger me for keys

iQCVAwUBQWs7AoqHRg3pndX9AQHU7gQA03Kp2R30w8YbleEuCJtIMc7FveOqTp0i
9NYFcGuWm9n/26/ELjd7ULOg7BFg0D/EzLXCfCZ/0k7v6pK7p6ah/NlqqB6mYORz
eACbwYbMoItsPdKqiuaFRMTV1xlF+YVuAcj5qHX+aP+dvWQmOTUOBms+H+tEb3rq
G0xrBS90IyA=
=iMWm
-----END PGP SIGNATURE-----


-------------------------------------------------------
This SF.net email is sponsored by: IT Product Guide on ITManagersJournal
Use IT products in your business? Tell us what you think of them. Give us
Your Opinions, Get Free ThinkGeek Gift Certificates! Click to find out more
http://productguide.itmanagersjournal.com/guidepromo.tmpl
_______________________________________________
User-mode-linux-devel mailing list
User-mode-linux-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/user-mode-linux-devel

^ permalink raw reply	[flat|nested] 3+ messages in thread

end of thread, other threads:[~2004-10-12  2:01 UTC | newest]

Thread overview: 3+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2004-10-12  1:04 [uml-devel] UML not returning memory Michael Richardson
2004-10-12  1:40 ` BlaisorBlade
2004-10-12  2:01   ` Michael Richardson

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox