Re: kbuild: modules_install regression ? - depmod

Re: kbuild: modules_install regression ? - depmod

[devzero]

i have the same issue, but with 2.6.24-rc6 on a box with 512MB RAM

System is openSUSE 10.3

on "make modules_install" , depmod reproduceably dies with out of memory error when it is ~800MB VSZ and ~350MB RSS
this happens on different hardware.

any clue what`s going wrong?
how much memory should i expect being needed with "make modules_install" , e.g. with allmodconfig ?


Subject:    kbuild: modules_install regression ? - depmod
From:       Jan-Simon =?utf-8?q?M=C3=B6ller?= <dl9pf () gmx ! de>
Date:       2007-11-01 4:14:34
Message-ID: 200711010514.34469.dl9pf () gmx ! de
[Download message RAW]

Hi!

I compiled kernel 2.6.24-rc1 (latest git as of today) on a Box with 256MB Ram.
During "make modules_install" I got these errors:

  DEPMOD  2.6.24-rc1-default
WARNING: Can't read 
module /lib/modules/2.6.24-rc1-default/kernel/net/bridge/bridge.ko: Cannot 
allocate memory
WARNING: Can't read 
module /lib/modules/2.6.24-rc1-default/kernel/net/bridge/netfilter/ebt_redirect.ko: 
Cannot allocate memory
[...]
FATAL: Memory allocation failure depmod.c line 158: realloc(mod->deps, 
sizeof(mod->deps[0])*(mod->num_deps+1)).
make: *** [_modinst_post] Fehler 1


Depmod used too much memory and exits. Tried a 2nd time and checked with top.

IMHO this is a regression.

best regards
jan-simon

__________________________________________________________________________
Erweitern Sie FreeMail zu einem noch leistungsstärkeren E-Mail-Postfach!		
Mehr Infos unter http://produkte.web.de/club/?mc=021131

Re: kbuild: modules_install regression ? - depmod

[Jan-Simon Möller]

Am Freitag 28 Dezember 2007 16:08:19 schrieb devzero@web.de:
> i have the same issue, but with 2.6.24-rc6 on a box with 512MB RAM
>
> System is openSUSE 10.3
>
> on "make modules_install" , depmod reproduceably dies with out of memory
> error when it is ~800MB VSZ and ~350MB RSS this happens on different
> hardware.
>
> any clue what`s going wrong?
> how much memory should i expect being needed with "make modules_install" ,
> e.g. with allmodconfig ?
>
>
No news/progress on this issue afaik !

Re: kbuild: modules_install regression ? - depmod

[Jan Engelhardt]

[Adding jcm to Cc]

On Dec 28 2007 16:08, devzero@web.de wrote:
>
>i have the same issue, but with 2.6.24-rc6 on a box with 512MB RAM
>
>System is openSUSE 10.3
>
>on "make modules_install" , depmod reproduceably dies with out of memory error when it is ~800MB VSZ and ~350MB RSS
>this happens on different hardware.
>
>any clue what`s going wrong?
>how much memory should i expect being needed with "make modules_install" , e.g. with allmodconfig ?


If you enable CONFIG_DEBUG_INFO, don't be surprised.

Though I'd say depmod should ignore the debug sections.

>
>
>Subject:    kbuild: modules_install regression ? - depmod
>From:       Jan-Simon =?utf-8?q?M=C3=B6ller?= <dl9pf () gmx ! de>
>Date:       2007-11-01 4:14:34
>Message-ID: 200711010514.34469.dl9pf () gmx ! de
>[Download message RAW]
>
>Hi!
>
>I compiled kernel 2.6.24-rc1 (latest git as of today) on a Box with 256MB Ram.
>During "make modules_install" I got these errors:
>
>  DEPMOD  2.6.24-rc1-default
>WARNING: Can't read 
>module /lib/modules/2.6.24-rc1-default/kernel/net/bridge/bridge.ko: Cannot 
>allocate memory
>WARNING: Can't read 
>module /lib/modules/2.6.24-rc1-default/kernel/net/bridge/netfilter/ebt_redirect.ko: 
>Cannot allocate memory
>[...]
>FATAL: Memory allocation failure depmod.c line 158: realloc(mod->deps, 
>sizeof(mod->deps[0])*(mod->num_deps+1)).
>make: *** [_modinst_post] Fehler 1
>
>
>Depmod used too much memory and exits. Tried a 2nd time and checked with top.
>
>IMHO this is a regression.
>
>best regards
>jan-simon
>
>__________________________________________________________________________
>Erweitern Sie FreeMail zu einem noch leistungsstärkeren E-Mail-Postfach!		
>Mehr Infos unter http://produkte.web.de/club/?mc=021131
>
>--
>To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
>the body of a message to majordomo@vger.kernel.org
>More majordomo info at  http://vger.kernel.org/majordomo-info.html
>Please read the FAQ at  http://www.tux.org/lkml/
>

Re: kbuild: modules_install regression ? - depmod

[Jon Masters]

On Sat, 2007-12-29 at 02:42 +0100, Jan Engelhardt wrote:
> [Adding jcm to Cc]
> 
> On Dec 28 2007 16:08, devzero@web.de wrote:
> >
> >i have the same issue, but with 2.6.24-rc6 on a box with 512MB RAM
> >
> >System is openSUSE 10.3
> >
> >on "make modules_install" , depmod reproduceably dies with out of memory error when it is ~800MB VSZ and ~350MB RSS
> >this happens on different hardware.
> >
> >any clue what`s going wrong?
> >how much memory should i expect being needed with "make modules_install" , e.g. with allmodconfig ?
> 
> 
> If you enable CONFIG_DEBUG_INFO, don't be surprised.
> 
> Though I'd say depmod should ignore the debug sections.

Thanks for the head's up. I'll look at that, and adding the module
ordering stuff over the weekend - been unplugged for the holidays.

Jon.

Re: kbuild: modules_install regression ? - depmod

[devzero]

> Erm... same system here -
> 
> $ gzip -cd /proc/config.gz | grep DEBUG_INFO
> # CONFIG_DEBUG_INFO is not set
> 
> I think you managed to snafu something during building.

mhh - i have kernel-default-2.6.22.13-0.3 kernel (didn`t touch that since online update) and this has CONFIG_DEBUG_INFO=y
wondering about that, i installed shipping kernel (kernel-default-2.6.22.5-31 from http://download.opensuse.org/distribution/openSUSE-current/repo/oss/suse/i586/ ) 

but:

opensuse103:~ # uname -a
Linux opensuse103 2.6.22.5-31-default #1 SMP 2007/09/21 22:29:00 UTC i686 i686 i386 GNU/Linux

opensuse103:~ # zcat /proc/config.gz |grep DEBUG_INFO
CONFIG_DEBUG_INFO=y

so i don`t plead guilty.......



> -----Ursprüngliche Nachricht-----
> Von: "Jan Engelhardt" <jengelh@computergmbh.de>
> Gesendet: 29.12.07 15:08:10
> An: devzero@web.de
> CC: jcm@jonmasters.org, dl9pf@gmx.de,     Linux Kernel Mailing List <linux-kernel@vger.kernel.org>
> Betreff: Re: kbuild: modules_install regression ? - depmod


> 
> 
> On Dec 29 2007 14:30, devzero@web.de wrote:
> >> On Dec 28 2007 16:08, devzero@web.de wrote:
> >> >
> >> >i have the same issue, but with 2.6.24-rc6 on a box with 512MB RAM
> >> >
> >> >System is openSUSE 10.3
> >>
> >> If you enable CONFIG_DEBUG_INFO, don't be surprised.
> >
> >oh yes, that`s it!
> >
> >apparently CONFIG_DEBUG_KERNEL, CONFIG_DEBUG_BUGVERBOSE and CONFIG_DEBUG_INFO
> >defaults to "y" on my distro`s kernel, and i just copied config from
> >/proc/config.gz and did a "make oldconfig".
> 
> Erm... same system here -
> 
> $ gzip -cd /proc/config.gz | grep DEBUG_INFO
> # CONFIG_DEBUG_INFO is not set
> 
> I think you managed to snafu something during building.
> 


______________________________________________________________________________
Jetzt neu! Im riesigen WEB.DE Club SmartDrive Dateien freigeben und mit 
Freunden teilen! http://www.freemail.web.de/club/smartdrive_ttc.htm/?mc=021134

Re: kbuild: modules_install regression ? - depmod

[Jan Engelhardt]

On Dec 29 2007 16:51, devzero@web.de wrote:
>
>> Erm... same system here -
>> 
>> $ gzip -cd /proc/config.gz | grep DEBUG_INFO
>> # CONFIG_DEBUG_INFO is not set
>> 
>> I think you managed to snafu something during building.
>
>mhh - i have kernel-default-2.6.22.13-0.3 kernel (didn`t touch that since online update) and this has CONFIG_DEBUG_INFO=y
>wondering about that, i installed shipping kernel (kernel-default-2.6.22.5-31 from http://download.opensuse.org/distribution/openSUSE-current/repo/oss/suse/i586/ ) 
>
>but:
>
>opensuse103:~ # uname -a
>Linux opensuse103 2.6.22.5-31-default #1 SMP 2007/09/21 22:29:00 UTC i686 i686 i386 GNU/Linux
>
>opensuse103:~ # zcat /proc/config.gz |grep DEBUG_INFO
>CONFIG_DEBUG_INFO=y
>
>so i don`t plead guilty.......
>

Well, either way.

rpm2cpio /lnk/103/i586/kernel-default-2.6.22.5-31.i586.rpm [...] grep
DEBUG_INFO ./boot/config-2.6.22.5-31-default

says =y

vs

rpm2cpio /lnk/103/src/kernel-default-2.6.22.5-31.src.rpm [...]
tar -xf config.tar.bz2 [...] grep DEBUG_INFO ./config/i386/default

says =n.

Anyway, it's that option that causes the kernel to be built with -g
and m-i-t does not gracefully handle all that debug info yet.
If /lib is 800 MB, well, expect some serious swapping. Or just
compile without it. Or if you are lazy, find /lib/modules -type f
-iname '*.ko' -print0 | xargs -0 strip -g && depmod. :-)

Re: kbuild: modules_install regression ? - depmod

[devzero]

> [Adding jcm to Cc]
> 
> On Dec 28 2007 16:08, devzero@web.de wrote:
> >
> >i have the same issue, but with 2.6.24-rc6 on a box with 512MB RAM
> >
> >System is openSUSE 10.3
> >
> >on "make modules_install" , depmod reproduceably dies with out of memory error when it is ~800MB VSZ and ~350MB RSS
> >this happens on different hardware.
> >
> >any clue what`s going wrong?
> >how much memory should i expect being needed with "make modules_install" , e.g. with allmodconfig ?
> 
> 
> If you enable CONFIG_DEBUG_INFO, don't be surprised.
> 

oh yes, that`s it!

apparently CONFIG_DEBUG_KERNEL, CONFIG_DEBUG_BUGVERBOSE and CONFIG_DEBUG_INFO defaults to "y" on my distro`s kernel, and i just copied config from /proc/config.gz and did a "make oldconfig".

after disabling those, all is fine now ! 

thanks for the hint!

> Though I'd say depmod should ignore the debug sections.

so depmod is acting sort of "stupid" here ?

regards
roland


> 
> >
> >
> >Subject:    kbuild: modules_install regression ? - depmod
> >From:       Jan-Simon =?utf-8?q?M=C3=B6ller?= <dl9pf () gmx ! de>
> >Date:       2007-11-01 4:14:34
> >Message-ID: 200711010514.34469.dl9pf () gmx ! de
> >[Download message RAW]
> >
> >Hi!
> >
> >I compiled kernel 2.6.24-rc1 (latest git as of today) on a Box with 256MB Ram.
> >During "make modules_install" I got these errors:
> >
> >  DEPMOD  2.6.24-rc1-default
> >WARNING: Can't read 
> >module /lib/modules/2.6.24-rc1-default/kernel/net/bridge/bridge.ko: Cannot 
> >allocate memory
> >WARNING: Can't read 
> >module /lib/modules/2.6.24-rc1-default/kernel/net/bridge/netfilter/ebt_redirect.ko: 
> >Cannot allocate memory
> >[...]
> >FATAL: Memory allocation failure depmod.c line 158: realloc(mod->deps, 
> >sizeof(mod->deps[0])*(mod->num_deps+1)).
> >make: *** [_modinst_post] Fehler 1
> >
> >
> >Depmod used too much memory and exits. Tried a 2nd time and checked with top.
> >
> >IMHO this is a regression.
> >
> >best regards
> >jan-simon
> >
> >__________________________________________________________________________
> >Erweitern Sie FreeMail zu einem noch leistungsstärkeren E-Mail-Postfach!		
> >Mehr Infos unter http://produkte.web.de/club/?mc=021131
> >
> >--
> >To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> >the body of a message to majordomo@vger.kernel.org
> >More majordomo info at  http://vger.kernel.org/majordomo-info.html
> >Please read the FAQ at  http://www.tux.org/lkml/
> >
> 
> 


__________________________________________________________________________
Erweitern Sie FreeMail zu einem noch leistungsstärkeren E-Mail-Postfach!		
Mehr Infos unter http://produkte.web.de/club/?mc=021131

Re: kbuild: modules_install regression ? - depmod

[Jon Masters]

On Sat, 2007-12-29 at 14:30 +0100, devzero@web.de wrote:

> > Though I'd say depmod should ignore the debug sections.
> 
> so depmod is acting sort of "stupid" here ?

depmod has a bunch of issues that need taking care of, this is just one
of them, but yeah, for now it should just ignore these additional sects.
I'd rewrite the thing but I need some more time to do that in the new
year (and there's lots of special casing for cross-building for
32/64/little/big endian that would need a lot of testing).

I'll push a new release over the weekend.

Jon.

Re: kbuild: modules_install regression ? - depmod

[Jan Engelhardt]

On Dec 29 2007 14:30, devzero@web.de wrote:
>> On Dec 28 2007 16:08, devzero@web.de wrote:
>> >
>> >i have the same issue, but with 2.6.24-rc6 on a box with 512MB RAM
>> >
>> >System is openSUSE 10.3
>>
>> If you enable CONFIG_DEBUG_INFO, don't be surprised.
>
>oh yes, that`s it!
>
>apparently CONFIG_DEBUG_KERNEL, CONFIG_DEBUG_BUGVERBOSE and CONFIG_DEBUG_INFO
>defaults to "y" on my distro`s kernel, and i just copied config from
>/proc/config.gz and did a "make oldconfig".

Erm... same system here -

$ gzip -cd /proc/config.gz | grep DEBUG_INFO
# CONFIG_DEBUG_INFO is not set

I think you managed to snafu something during building.

kbuild: modules_install regression ? - depmod

[Jan-Simon Möller]

Hi!

I compiled kernel 2.6.24-rc1 (latest git as of today) on a Box with 256MB Ram.
During "make modules_install" I got these errors:

  DEPMOD  2.6.24-rc1-default
WARNING: Can't read 
module /lib/modules/2.6.24-rc1-default/kernel/net/bridge/bridge.ko: Cannot 
allocate memory
WARNING: Can't read 
module /lib/modules/2.6.24-rc1-default/kernel/net/bridge/netfilter/ebt_redirect.ko: 
Cannot allocate memory
[...]
FATAL: Memory allocation failure depmod.c line 158: realloc(mod->deps, 
sizeof(mod->deps[0])*(mod->num_deps+1)).
make: *** [_modinst_post] Fehler 1


Depmod used too much memory and exits. Tried a 2nd time and checked with top.

IMHO this is a regression.

best regards
jan-simon