"Segfault/illegal instruction" - udevd - ntpd - glibc

"Segfault/illegal instruction" - udevd - ntpd - glibc

[Sadarul Firos]

Hi all,

I am working with two MIPS based boards (one is MIPS and the other is
MIPSEL) running linux-2.6.18/glibc-2.3.5. I am performing a consecutive
reboot test on these boards. After some number of reboots (say 80) I  am
getting "segmentaion fault/illegal instruction" while running udevd and
ntpd during bootup. Upon observing the core dump, it is noted that the
segfault occured from the _init function of libnss_dns.so (in the case
of ntpd) and libnss_compat.so (in the case of udevd). I assume that
there might be a problem somewhere in the call_init function in
glibc-2.3.5/elf/dl-init.c. After I put some printf statements for
debugging in the call_init function, there is no segfault/illegal
instruction in the reboot testing. I have also used gdb to debug the
problem but the "segfault/illegal instruction" doesn't occur during the
reboot test. Could anyone please help me to sort out this problem. The
gdb output using coredump is attached.

Any help will be appreciated
Firos

-------------------------GDB O/P---------------------

-bash-3.00# gdb -c core udevd
GNU gdb 6.2.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you
are welcome to change it and/or distribute copies of it under certain
conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for
details.
This GDB was configured as "--host=i686-pc-linux-gnu
--target=mipsel-linux-gnu"...
Core was generated by `/sbin/udevd --daemon'.
Program terminated with signal 11, Segmentation fault.
Reading symbols from /lib/libgcc_s.so.1...done.
Loaded symbols for /lib/libgcc_s.so.1
Reading symbols from /lib/libc.so.6...done.
Loaded symbols for /lib/libc.so.6
Reading symbols from /lib/ld.so.1...done.
Loaded symbols for /lib/ld.so.1
Reading symbols from /lib/libnss_compat.so.2...done.
Loaded symbols for /lib/libnss_compat.so.2 Reading symbols from
/lib/libnsl.so.1...done.
Loaded symbols for /lib/libnsl.so.1
#0  0x2ad02ef8 in _init () from /lib/libnss_compat.so.2
(gdb)
(gdb) bt
#0  0x2ad02ef8 in _init () from /lib/libnss_compat.so.2
#1  0x00000001 in ?? ()
Cannot access memory at address 0xfffffffe
(gdb)

 

"Segfault/illegal instruction" - udevd - ntpd - glibc

[Sadarul Firos]

Hi all,

I am working with two MIPS based boards (one is MIPS and the other is
MIPSEL) running linux-2.6.18/glibc-2.3.5. I am performing a consecutive
reboot test on these boards. After some number of reboots (say 80) I  am
getting "segmentaion fault/illegal instruction" while running udevd and
ntpd during bootup. Upon observing the core dump, it is noted that the
segfault occured from the _init function of libnss_dns.so (in the case
of ntpd) and libnss_compat.so (in the case of udevd). I assume that
there might be a problem somewhere in the call_init function in
glibc-2.3.5/elf/dl-init.c. After I put some printf statements for
debugging in the call_init function, there is no segfault/illegal
instruction in the reboot testing. I have also used gdb to debug the
problem but the "segfault/illegal instruction" doesn't occur during the
reboot test. Could anyone please help me to sort out this problem. The
gdb output using coredump is attached.

Any help will be appreciated
Firos

-------------------------GDB O/P---------------------

-bash-3.00# gdb -c core udevd
GNU gdb 6.2.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you
are welcome to change it and/or distribute copies of it under certain
conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for
details.
This GDB was configured as "--host=i686-pc-linux-gnu
--target=mipsel-linux-gnu"...
Core was generated by `/sbin/udevd --daemon'.
Program terminated with signal 11, Segmentation fault.
Reading symbols from /lib/libgcc_s.so.1...done.
Loaded symbols for /lib/libgcc_s.so.1
Reading symbols from /lib/libc.so.6...done.
Loaded symbols for /lib/libc.so.6
Reading symbols from /lib/ld.so.1...done.
Loaded symbols for /lib/ld.so.1
Reading symbols from /lib/libnss_compat.so.2...done.
Loaded symbols for /lib/libnss_compat.so.2 Reading symbols from
/lib/libnsl.so.1...done.
Loaded symbols for /lib/libnsl.so.1
#0  0x2ad02ef8 in _init () from /lib/libnss_compat.so.2
(gdb)
(gdb) bt
#0  0x2ad02ef8 in _init () from /lib/libnss_compat.so.2
#1  0x00000001 in ?? ()
Cannot access memory at address 0xfffffffe
(gdb)

 

Re: "Segfault/illegal instruction" - udevd - ntpd - glibc

[Ralf Baechle]

On Fri, Jun 15, 2007 at 09:23:34PM +0530, Sadarul Firos wrote:

> I am working with two MIPS based boards (one is MIPS and the other is
> MIPSEL) running linux-2.6.18/glibc-2.3.5. I am performing a consecutive
> reboot test on these boards. After some number of reboots (say 80) I  am
> getting "segmentaion fault/illegal instruction" while running udevd and
> ntpd during bootup. Upon observing the core dump, it is noted that the
> segfault occured from the _init function of libnss_dns.so (in the case
> of ntpd) and libnss_compat.so (in the case of udevd). I assume that
> there might be a problem somewhere in the call_init function in
> glibc-2.3.5/elf/dl-init.c. After I put some printf statements for
> debugging in the call_init function, there is no segfault/illegal
> instruction in the reboot testing. I have also used gdb to debug the
> problem but the "segfault/illegal instruction" doesn't occur during the
> reboot test. Could anyone please help me to sort out this problem. The
> gdb output using coredump is attached.

Normally the address space layout and most other variables during a
program load should be identical each time so userspace should behave
identical.   So I sense the scent of a TLB or more likely cache managment
problem.

What 2.6.18 variant exactly are you running, that is where & when did
download it, what CPU?

  Ralf

Re: [SPAM] Re: "Segfault/illegal instruction" - udevd - ntpd - glibc

[Markus Gothe]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

Ralf Baechle wrote:
> On Fri, Jun 15, 2007 at 09:23:34PM +0530, Sadarul Firos wrote:
>
>> I am working with two MIPS based boards (one is MIPS and the other is
>> MIPSEL) running linux-2.6.18/glibc-2.3.5. I am performing a consecutive
>> reboot test on these boards. After some number of reboots (say 80) I  am
>> getting "segmentaion fault/illegal instruction" while running udevd and
>> ntpd during bootup. Upon observing the core dump, it is noted that the
>> segfault occured from the _init function of libnss_dns.so (in the case
>> of ntpd) and libnss_compat.so (in the case of udevd). I assume that
>> there might be a problem somewhere in the call_init function in
>> glibc-2.3.5/elf/dl-init.c. After I put some printf statements for
>> debugging in the call_init function, there is no segfault/illegal
>> instruction in the reboot testing. I have also used gdb to debug the
>> problem but the "segfault/illegal instruction" doesn't occur during the
>> reboot test. Could anyone please help me to sort out this problem. The
>> gdb output using coredump is attached.
>
> Normally the address space layout and most other variables during a
> program load should be identical each time so userspace should behave
> identical.   So I sense the scent of a TLB or more likely cache managment
> problem.
>
> What 2.6.18 variant exactly are you running, that is where & when did
> download it, what CPU?
>
>   Ralf
>
Seems to me like a timing issue if printf'ing helps. You should try
invoking udevd by gdb (without the printf's).

- --
_______________________________________

Mr Markus Gothe
Software Engineer

Phone: +46 (0)13 21 81 20 (ext. 1046)
Fax: +46 (0)13 21 21 15
Mobile: +46 (0)73 718 72 80
Diskettgatan 11, SE-583 35 Linköping, Sweden
www.27m.com
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)

iD8DBQFGeB3S6I0XmJx2NrwRCNxBAJ9vZb0+ngxP3nW02nXvKlEKY7DDQwCglXkW
ntaDNcvzn2pNdYruCxyZqt8=
=2MG9
-----END PGP SIGNATURE-----