From: Folkert van Heusden <folkert@vanheusden.com>
To: linux-kernel@vger.kernel.org
Subject: Re: [2.6.20] system sometimes stops responding
Date: Fri, 27 Apr 2007 13:49:31 +0200 [thread overview]
Message-ID: <20070427114930.GA1021@vanheusden.com> (raw)
In-Reply-To: <20070423155800.GA20799@vanheusden.com>
Today the problem occured again after 4 days of uptime.
System not responding to ssh, login on the console and also bind did not seem to respond to anything at all.
I don't know if it is of any help, but here's the alt+sysreg+m output:
[49824.174292] SysRq : Show Memory
[49824.174367] Mem-info:
[49824.174403] DMA per-cpu:
[49824.174438] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[49824.174478] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
[49824.174520] Normal per-cpu:
[49824.174556] CPU 0: Hot: hi: 186, btch: 31 usd: 9 Cold: hi: 62, btch: 15 usd: 12
[49824.174598] CPU 1: Hot: hi: 186, btch: 31 usd: 27 Cold: hi: 62, btch: 15 usd: 2
[49824.174638] HighMem per-cpu:
[49824.174673] CPU 0: Hot: hi: 186, btch: 31 usd: 12 Cold: hi: 62, btch: 15 usd: 2
[49824.174713] CPU 1: Hot: hi: 186, btch: 31 usd: 168 Cold: hi: 62, btch: 15 usd: 11
[49824.174755] Active:149895 inactive:82114 dirty:189 writeback:3 unstable:0
[49824.174756] free:220745 slab:60772 mapped:11447 pagetables:1007 bounce:9
[49824.174837] DMA free:15968kB min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16256kB pages_scanned:0 all_unreclaimable? no
[49824.174888] lowmem_reserve[]: 0 873 2015
[49824.175058] Normal free:606000kB min:3744kB low:4680kB high:5616kB active:10212kB inactive:4844kB present:894080kB pages_scanned:0 all_unreclaimable? no
[49824.175111] lowmem_reserve[]: 0 0 9137
[49824.175278] HighMem free:261012kB min:512kB low:1736kB high:2960kB active:589368kB inactive:323612kB present:1169608kB pages_scanned:0 all_unreclaimable? no
[49824.175332] lowmem_reserve[]: 0 0 0
[49824.175499] DMA: 2*4kB 3*8kB 2*16kB 3*32kB 3*64kB 2*128kB 2*256kB 1*512kB 0*1024kB 1*2048kB 3*4096kB = 15968kB
[49824.175942] Normal: 1*4kB 1*8kB 0*16kB 0*32kB 0*64kB 0*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 147*4096kB = 605964kB
[49824.176377] HighMem: 53*4kB 39*8kB 16*16kB 10*32kB 3*64kB 1*128kB 0*256kB 1*512kB 1*1024kB 0*2048kB 63*4096kB = 261004kB
[49824.176824] Swap cache: add 0, delete 0, find 0/0, race 0+0
[49824.176867] Free swap = 454600kB
[49824.176907] Total swap = 454600kB
[49824.176947] Free swap: 454600kB
[49824.183611] 524080 pages of RAM
[49824.183657] 294704 pages of HIGHMEM
[49824.183700] 5946 reserved pages
[49824.183740] 85824 pages shared
[49824.183779] 0 pages swap cached
[49824.183818] 189 pages dirty
[49824.183858] 3 pages writeback
[49824.183897] 11447 pages mapped
[49824.183942] 60772 pages slab
[49824.183985] 1007 pages pagetables
Nothing in the logging (I debug *.* to /var/log/all) and logging just stopped at a certain point with the last message being:
Apr 26 23:47:11 muur upsd[2828]: Client on 127.0.0.1 logged out
On Mon, Apr 23, 2007 at 05:58:06PM +0200, Folkert van Heusden wrote:
> System: kernel 2.6.20
> P4
> 2GB ram
> 512 MB swap
>
> Situation:
> Sometimes systems stops. SSH session stop. New logins proceed but just
> before the command-prompt they exit again (after a delay of, say, 30s)
> and return to the login prompt. New ssh logins do not even reach the
> login-prompt. Network seems to still forward traffic and also the system
> seems still be doing diskflushes.
>
> I pressed sysreq m which gives:
>
> [3535562.643029] SysRq : Show Memory
> [3535562.643113] Mem-info:
> [3535562.643153] DMA per-cpu:
> [3535562.643193] CPU 0: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
> [3535562.643242] CPU 1: Hot: hi: 0, btch: 1 usd: 0 Cold: hi: 0, btch: 1 usd: 0
> [3535562.643290] Normal per-cpu:
> [3535562.643330] CPU 0: Hot: hi: 186, btch: 31 usd: 152 Cold: hi: 62, btch: 15 usd: 13
> [3535562.643379] CPU 1: Hot: hi: 186, btch: 31 usd: 128 Cold: hi: 62, btch: 15 usd: 0
> [3535562.643426] HighMem per-cpu:
> [3535562.643466] CPU 0: Hot: hi: 186, btch: 31 usd: 156 Cold: hi: 62, btch: 15 usd: 14
> [3535562.643516] CPU 1: Hot: hi: 186, btch: 31 usd: 81 Cold: hi: 62, btch: 15 usd: 9
> [3535562.643566] Active:321905 inactive:152128 dirty:18 writeback:0 unstable:0 free:21864 slab:16213 mapped:15187 pagetables:1797
> [3535562.643619] DMA free:9876kB min:68kB low:84kB high:100kB active:1276kB inactive:3616kB present:16256kB pages_scanned:0 all_unreclaimable? no
> [3535562.643670] lowmem_reserve[]: 0 873 2015
> [3535562.643838] Normal free:71724kB min:3744kB low:4680kB high:5616kB active:349232kB inactive:375312kB present:894080kB pages_scanned:0 all_unreclaimable? no
> [3535562.643891] lowmem_reserve[]: 0 0 9137
> [3535562.644060] HighMem free:5856kB min:512kB low:1736kB high:2960kB active:937112kB inactive:229584kB present:1169608kB pages_scanned:0 all_unreclaimable? no
> [3535562.644113] lowmem_reserve[]: 0 0 0
> [3535562.644280] DMA: 339*4kB 47*8kB 161*16kB 50*32kB 8*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 9876kB
> [3535562.644713] Normal: 2151*4kB 2684*8kB 1327*16kB 486*32kB 20*64kB 6*128kB 1*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 71724kB
> [3535562.645147] HighMem: 432*4kB 406*8kB 11*16kB 10*32kB 0*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 5856kB
> [3535562.645588] Swap cache: add 2474, delete 2458, find 601/816, race 0+0
> [3535562.645633] Free swap = 454424kB
> [3535562.645675] Total swap = 454600kB
> [3535562.645714] Free swap: 454424kB
> [3535562.653672] 524080 pages of RAM
> [3535562.653725] 294704 pages of HIGHMEM
> [3535562.653765] 5929 reserved pages
> [3535562.653807] 175200 pages shared
> [3535562.653846] 16 pages swap cached
> [3535562.653886] 18 pages dirty
> [3535562.653926] 0 pages writeback
> [3535562.653966] 15187 pages mapped
> [3535562.654005] 16213 pages slab
> [3535562.654046] 1797 pages pagetables
> [3535580.176308] SysRq : Emergency Sync
>
> So it looks like it is NOT out of memory.
>
> Last messages before I pressed sysreg m:
>
> [3535514.466556] Sig 3 send to 5432 owned by 0.0 (login)
> [3535514.466748] kobject_uevent_env
> [3535514.466795] fill_kobj_path: path = '/class/vc/vcs3'
> [3535514.466919] kobject vcs3: cleaning up
> [3535514.466970] kobject_uevent_env
> [3535514.467014] fill_kobj_path: path = '/class/vc/vcsa3'
> [3535514.467110] kobject vcsa3: cleaning up
> [3535514.467774] kobject vcs3: registering. parent: vc, set: devices
> [3535514.467863] kobject_uevent_env
> [3535514.467927] fill_kobj_path: path = '/class/vc/vcs3'
> [3535514.468272] kobject vcsa3: registering. parent: vc, set: devices
> [3535514.468356] kobject_uevent_env
> [3535514.468414] fill_kobj_path: path = '/class/vc/vcsa3'
> [3535514.469533] kobject_uevent_env
> [3535514.469586] fill_kobj_path: path = '/class/vc/vcs3'
> [3535514.469729] kobject vcs3: cleaning up
> [3535514.469781] kobject_uevent_env
> [3535514.469822] fill_kobj_path: path = '/class/vc/vcsa3'
> [3535514.469919] kobject vcsa3: cleaning up
> [3535514.469998] kobject vcs3: registering. parent: vc, set: devices
> [3535514.470059] kobject_uevent_env
> [3535514.470102] fill_kobj_path: path = '/class/vc/vcs3'
> [3535514.470207] kobject vcsa3: registering. parent: vc, set: devices
> [3535514.470260] kobject_uevent_env
> [3535514.470305] fill_kobj_path: path = '/class/vc/vcsa3'
>
> (as you can see, the login process gets shot by signal 3 (SIGQUIT))
>
> Anything else I can try?
> I also found a list of stacktraces of all processes running in the
> system.
>
>
> Folkert van Heusden
>
> --
> To MultiTail einai ena polymorfiko ergaleio gia ta logfiles kai tin
> eksodo twn entolwn. Prosferei: filtrarisma, xrwmatismo, sygxwneysi,
> diaforetikes provoles. http://www.vanheusden.com/multitail/
> ----------------------------------------------------------------------
> Phone: +31-6-41278122, PGP-key: 1F28D8AE, www.vanheusden.com
Folkert van Heusden
--
MultiTail är en flexibel redskap för att fälja logfilar, utför av
commandoer, filtrera, ge färg, sammanfoga, o.s.v. följa.
http://www.vanheusden.com/multitail/
----------------------------------------------------------------------
Phone: +31-6-41278122, PGP-key: 1F28D8AE, www.vanheusden.com
next prev parent reply other threads:[~2007-04-27 11:49 UTC|newest]
Thread overview: 3+ messages / expand[flat|nested] mbox.gz Atom feed top
2007-04-23 15:58 [2.6.20] system sometimes stops responding Folkert van Heusden
2007-04-27 11:49 ` Folkert van Heusden [this message]
2007-04-27 15:20 ` Chuck Ebbert
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20070427114930.GA1021@vanheusden.com \
--to=folkert@vanheusden.com \
--cc=linux-kernel@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.