All of lore.kernel.org
 help / color / mirror / Atom feed
* prlimit64: inconsistencies between kernel and userland
@ 2013-06-28 13:38 Aurelien Jarno
  2013-11-04 21:37 ` Aurelien Jarno
  0 siblings, 1 reply; 21+ messages in thread
From: Aurelien Jarno @ 2013-06-28 13:38 UTC (permalink / raw)
  To: linux-mips

[-- Attachment #1: Type: text/plain, Size: 1847 bytes --]

Hi,

There is an inconsistency in the definition of RLIM64_INFINITY between
kernel and userland for the O32 and N32 ABI:

On the kernel side, the value is defined for all architectures as
include/uapi/linux/resource.h:

| #define RLIM64_INFINITY           (~0ULL)

On the GNU libc side, the value is defined in
ports/sysdeps/unix/sysv/linux/mips/bits/resource.h:

For the O32 and N32 ABI:

| #  define RLIM64_INFINITY 0x7fffffffffffffffULL

and for the N64 ABI:

| #  define RLIM64_INFINITY 0xffffffffffffffffUL

This was not a problem until the prlimit64 syscall was wired in the
2.6.36 kernel. Since then, on a 64-bit kernel and an O32 or N32
userland, but not on a 32-bit kernel, this causes some issues for
example it's not possible to set "ulimit -c unlimited" using dash as a
non-priviledged user.

This is due to the fact that when available the glibc uses the prlimit64
syscall to implement setrlimit64, which is called from called from
pam_limits.so. Instead of setting the limit to infinity (according to
the userland), it is set to a very big value but still lower than
infinity (according to the kernel). When later the setrlimit syscall is
used to set the value to infinity, it gets an EPERM value as the kernel
consider that as an increase of the limit (from a big value to
infinity).

I don't know where the issue should be fixed. The GNU libc has this
value for more than 7 years, and as it is defined in a header file, it
means a lot of binaries are broken when used with a 2.6.36+ kernel.
Fixing that on the kernel side means that MIPS would have a different
value than other architectures.

How do you think the issue should be fixed?

Regards,
Aurelien

-- 
Aurelien Jarno	                        GPG: 1024D/F1BCDB73
aurelien@aurel32.net                 http://www.aurel32.net

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 190 bytes --]

^ permalink raw reply	[flat|nested] 21+ messages in thread

end of thread, other threads:[~2013-11-06  0:23 UTC | newest]

Thread overview: 21+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2013-06-28 13:38 prlimit64: inconsistencies between kernel and userland Aurelien Jarno
2013-11-04 21:37 ` Aurelien Jarno
2013-11-05  0:45   ` David Miller
2013-11-05  1:04     ` Joseph S. Myers
2013-11-05  1:04       ` Joseph S. Myers
2013-11-05  1:22       ` Rich Felker
2013-11-05  8:58         ` Andreas Barth
2013-11-05 18:37           ` Rich Felker
2013-11-05 18:43             ` David Daney
2013-11-05 22:36               ` Joseph S. Myers
2013-11-05 22:36                 ` Joseph S. Myers
2013-11-05 22:39                 ` Rich Felker
2013-11-05 23:25                   ` Joseph S. Myers
2013-11-05 23:25                     ` Joseph S. Myers
2013-11-05 23:52                   ` Andreas Schwab
2013-11-05 23:52                     ` Andreas Schwab
2013-11-05 23:55                     ` Rich Felker
2013-11-06  0:23                       ` Russ Allbery
2013-11-06  0:23                         ` Russ Allbery
2013-11-05 15:13         ` Joseph S. Myers
2013-11-05 15:13           ` Joseph S. Myers

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.