All of lore.kernel.org
 help / color / mirror / Atom feed
From: Kamezawa Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>
To: Davidlohr Bueso <davidlohr@hp.com>,
	KOSAKI Motohiro <kosaki.motohiro@gmail.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	Manfred Spraul <manfred@colorfullife.com>,
	aswin@hp.com, LKML <linux-kernel@vger.kernel.org>,
	"linux-mm@kvack.org" <linux-mm@kvack.org>,
	Greg Thelen <gthelen@google.com>
Subject: Re: [PATCH] ipc,shm: disable shmmax and shmall by default
Date: Thu, 03 Apr 2014 23:07:36 +0900	[thread overview]
Message-ID: <533D6B28.6070305@jp.fujitsu.com> (raw)
In-Reply-To: <1396484447.2953.1.camel@buesod1.americas.hpqcorp.net>

(2014/04/03 9:20), Davidlohr Bueso wrote:
> The default size for shmmax is, and always has been, 32Mb.
> Today, in the XXI century, it seems that this value is rather small,
> making users have to increase it via sysctl, which can cause
> unnecessary work and userspace application workarounds[1].
>
> Instead of choosing yet another arbitrary value, larger than 32Mb,
> this patch disables the use of both shmmax and shmall by default,
> allowing users to create segments of unlimited sizes. Users and
> applications that already explicitly set these values through sysctl
> are left untouched, and thus does not change any of the behavior.
>
> So a value of 0 bytes or pages, for shmmax and shmall, respectively,
> implies unlimited memory, as opposed to disabling sysv shared memory.
> This is safe as 0 cannot possibly be used previously as SHMMIN is
> hardcoded to 1 and cannot be modified.
>
> This change allows Linux to treat shm just as regular anonymous memory.
> One important difference between them, though, is handling out-of-memory
> conditions: as opposed to regular anon memory, the OOM killer will not
> kill processes that are hogging memory through shm, allowing users to
> potentially abuse this. To overcome this situation, the shm_rmid_forced
> option must be enabled.
>
> Running this patch through LTP, everything passes, except the following,
> which, due to the nature of this change, is quite expected:
>
> shmget02    1  TFAIL  :  call succeeded unexpectedly
>
> [1]: http://rhaas.blogspot.com/2012/06/absurd-shared-memory-limits.html
>
> Signed-off-by: Davidlohr Bueso <davidlohr@hp.com>

looks good to me
Acked-by: KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>

When this goes mainline, updating a man page of ipcs may be required.

Thanks,
-Kame

> ---
>   include/linux/shm.h      | 2 +-
>   include/uapi/linux/shm.h | 8 ++++----
>   ipc/shm.c                | 6 ++++--
>   3 files changed, 9 insertions(+), 7 deletions(-)
>
> diff --git a/include/linux/shm.h b/include/linux/shm.h
> index 1e2cd2e..0ca06a3 100644
> --- a/include/linux/shm.h
> +++ b/include/linux/shm.h
> @@ -4,7 +4,7 @@
>   #include <asm/page.h>
>   #include <uapi/linux/shm.h>
>
> -#define SHMALL (SHMMAX/PAGE_SIZE*(SHMMNI/16)) /* max shm system wide (pages) */
> +#define SHMALL 0 /* max shm system wide (pages) */
>   #include <asm/shmparam.h>
>   struct shmid_kernel /* private to the kernel */
>   {	
> diff --git a/include/uapi/linux/shm.h b/include/uapi/linux/shm.h
> index 78b6941..5f0ef28 100644
> --- a/include/uapi/linux/shm.h
> +++ b/include/uapi/linux/shm.h
> @@ -9,14 +9,14 @@
>
>   /*
>    * SHMMAX, SHMMNI and SHMALL are upper limits are defaults which can
> - * be increased by sysctl
> + * be increased by sysctl. By default, disable SHMMAX and SHMALL with
> + * 0 bytes, thus allowing processes to have unlimited shared memory.
>    */
> -
> -#define SHMMAX 0x2000000		 /* max shared seg size (bytes) */
> +#define SHMMAX 0		         /* max shared seg size (bytes) */
>   #define SHMMIN 1			 /* min shared seg size (bytes) */
>   #define SHMMNI 4096			 /* max num of segs system wide */
>   #ifndef __KERNEL__
> -#define SHMALL (SHMMAX/getpagesize()*(SHMMNI/16))
> +#define SHMALL 0
>   #endif
>   #define SHMSEG SHMMNI			 /* max shared segs per process */
>
> diff --git a/ipc/shm.c b/ipc/shm.c
> index 7645961..ae01ffa 100644
> --- a/ipc/shm.c
> +++ b/ipc/shm.c
> @@ -490,10 +490,12 @@ static int newseg(struct ipc_namespace *ns, struct ipc_params *params)
>   	int id;
>   	vm_flags_t acctflag = 0;
>
> -	if (size < SHMMIN || size > ns->shm_ctlmax)
> +	if (ns->shm_ctlmax &&
> +	    (size < SHMMIN || size > ns->shm_ctlmax))
>   		return -EINVAL;
>
> -	if (ns->shm_tot + numpages > ns->shm_ctlall)
> +	if (ns->shm_ctlall &&
> +	    ns->shm_tot + numpages > ns->shm_ctlall)
>   		return -ENOSPC;
>
>   	shp = ipc_rcu_alloc(sizeof(*shp));
>


--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

WARNING: multiple messages have this Message-ID (diff)
From: Kamezawa Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>
To: Davidlohr Bueso <davidlohr@hp.com>,
	KOSAKI Motohiro <kosaki.motohiro@gmail.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	Manfred Spraul <manfred@colorfullife.com>,
	aswin@hp.com, LKML <linux-kernel@vger.kernel.org>,
	"linux-mm@kvack.org" <linux-mm@kvack.org>,
	Greg Thelen <gthelen@google.com>
Subject: Re: [PATCH] ipc,shm: disable shmmax and shmall by default
Date: Thu, 03 Apr 2014 23:07:36 +0900	[thread overview]
Message-ID: <533D6B28.6070305@jp.fujitsu.com> (raw)
In-Reply-To: <1396484447.2953.1.camel@buesod1.americas.hpqcorp.net>

(2014/04/03 9:20), Davidlohr Bueso wrote:
> The default size for shmmax is, and always has been, 32Mb.
> Today, in the XXI century, it seems that this value is rather small,
> making users have to increase it via sysctl, which can cause
> unnecessary work and userspace application workarounds[1].
>
> Instead of choosing yet another arbitrary value, larger than 32Mb,
> this patch disables the use of both shmmax and shmall by default,
> allowing users to create segments of unlimited sizes. Users and
> applications that already explicitly set these values through sysctl
> are left untouched, and thus does not change any of the behavior.
>
> So a value of 0 bytes or pages, for shmmax and shmall, respectively,
> implies unlimited memory, as opposed to disabling sysv shared memory.
> This is safe as 0 cannot possibly be used previously as SHMMIN is
> hardcoded to 1 and cannot be modified.
>
> This change allows Linux to treat shm just as regular anonymous memory.
> One important difference between them, though, is handling out-of-memory
> conditions: as opposed to regular anon memory, the OOM killer will not
> kill processes that are hogging memory through shm, allowing users to
> potentially abuse this. To overcome this situation, the shm_rmid_forced
> option must be enabled.
>
> Running this patch through LTP, everything passes, except the following,
> which, due to the nature of this change, is quite expected:
>
> shmget02    1  TFAIL  :  call succeeded unexpectedly
>
> [1]: http://rhaas.blogspot.com/2012/06/absurd-shared-memory-limits.html
>
> Signed-off-by: Davidlohr Bueso <davidlohr@hp.com>

looks good to me
Acked-by: KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>

When this goes mainline, updating a man page of ipcs may be required.

Thanks,
-Kame

> ---
>   include/linux/shm.h      | 2 +-
>   include/uapi/linux/shm.h | 8 ++++----
>   ipc/shm.c                | 6 ++++--
>   3 files changed, 9 insertions(+), 7 deletions(-)
>
> diff --git a/include/linux/shm.h b/include/linux/shm.h
> index 1e2cd2e..0ca06a3 100644
> --- a/include/linux/shm.h
> +++ b/include/linux/shm.h
> @@ -4,7 +4,7 @@
>   #include <asm/page.h>
>   #include <uapi/linux/shm.h>
>
> -#define SHMALL (SHMMAX/PAGE_SIZE*(SHMMNI/16)) /* max shm system wide (pages) */
> +#define SHMALL 0 /* max shm system wide (pages) */
>   #include <asm/shmparam.h>
>   struct shmid_kernel /* private to the kernel */
>   {	
> diff --git a/include/uapi/linux/shm.h b/include/uapi/linux/shm.h
> index 78b6941..5f0ef28 100644
> --- a/include/uapi/linux/shm.h
> +++ b/include/uapi/linux/shm.h
> @@ -9,14 +9,14 @@
>
>   /*
>    * SHMMAX, SHMMNI and SHMALL are upper limits are defaults which can
> - * be increased by sysctl
> + * be increased by sysctl. By default, disable SHMMAX and SHMALL with
> + * 0 bytes, thus allowing processes to have unlimited shared memory.
>    */
> -
> -#define SHMMAX 0x2000000		 /* max shared seg size (bytes) */
> +#define SHMMAX 0		         /* max shared seg size (bytes) */
>   #define SHMMIN 1			 /* min shared seg size (bytes) */
>   #define SHMMNI 4096			 /* max num of segs system wide */
>   #ifndef __KERNEL__
> -#define SHMALL (SHMMAX/getpagesize()*(SHMMNI/16))
> +#define SHMALL 0
>   #endif
>   #define SHMSEG SHMMNI			 /* max shared segs per process */
>
> diff --git a/ipc/shm.c b/ipc/shm.c
> index 7645961..ae01ffa 100644
> --- a/ipc/shm.c
> +++ b/ipc/shm.c
> @@ -490,10 +490,12 @@ static int newseg(struct ipc_namespace *ns, struct ipc_params *params)
>   	int id;
>   	vm_flags_t acctflag = 0;
>
> -	if (size < SHMMIN || size > ns->shm_ctlmax)
> +	if (ns->shm_ctlmax &&
> +	    (size < SHMMIN || size > ns->shm_ctlmax))
>   		return -EINVAL;
>
> -	if (ns->shm_tot + numpages > ns->shm_ctlall)
> +	if (ns->shm_ctlall &&
> +	    ns->shm_tot + numpages > ns->shm_ctlall)
>   		return -ENOSPC;
>
>   	shp = ipc_rcu_alloc(sizeof(*shp));
>



  reply	other threads:[~2014-04-03 14:08 UTC|newest]

Thread overview: 114+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-03-31  3:06 [PATCH] ipc,shm: increase default size for shmmax Davidlohr Bueso
2014-03-31  3:06 ` Davidlohr Bueso
2014-03-31 21:32 ` Andrew Morton
2014-03-31 21:32   ` Andrew Morton
2014-03-31 22:59   ` Davidlohr Bueso
2014-03-31 22:59     ` Davidlohr Bueso
2014-03-31 23:13     ` Andrew Morton
2014-03-31 23:13       ` Andrew Morton
2014-03-31 23:25       ` Davidlohr Bueso
2014-03-31 23:25         ` Davidlohr Bueso
2014-04-01  0:05         ` Andrew Morton
2014-04-01  0:05           ` Andrew Morton
2014-04-01  6:29           ` Kamezawa Hiroyuki
2014-04-01  6:29             ` Kamezawa Hiroyuki
2014-04-01 19:19             ` Andrew Morton
2014-04-01 19:19               ` Andrew Morton
2014-04-01 20:15               ` KOSAKI Motohiro
2014-04-01 20:15                 ` KOSAKI Motohiro
2014-04-01 20:26                 ` Davidlohr Bueso
2014-04-01 20:26                   ` Davidlohr Bueso
2014-04-02  0:11                 ` Kamezawa Hiroyuki
2014-04-02  0:11                   ` Kamezawa Hiroyuki
2014-04-02  1:02               ` Kamezawa Hiroyuki
2014-04-02  1:02                 ` Kamezawa Hiroyuki
2014-04-02 14:55               ` One Thousand Gnomes
2014-04-02 14:55                 ` One Thousand Gnomes
2014-04-02 23:47                 ` Kamezawa Hiroyuki
2014-04-02 23:47                   ` Kamezawa Hiroyuki
2014-04-01 17:01           ` Davidlohr Bueso
2014-04-01 17:01             ` Davidlohr Bueso
2014-04-01 18:10             ` KOSAKI Motohiro
2014-04-01 18:10               ` KOSAKI Motohiro
2014-04-01 18:31               ` Davidlohr Bueso
2014-04-01 18:31                 ` Davidlohr Bueso
2014-04-01 19:51                 ` KOSAKI Motohiro
2014-04-01 19:51                   ` KOSAKI Motohiro
2014-04-01 21:01                   ` Davidlohr Bueso
2014-04-01 21:01                     ` Davidlohr Bueso
2014-04-01 21:12                     ` KOSAKI Motohiro
2014-04-01 21:12                       ` KOSAKI Motohiro
2014-04-01 21:29                       ` Andrew Morton
2014-04-01 21:29                         ` Andrew Morton
2014-04-01 21:41                         ` KOSAKI Motohiro
2014-04-01 21:41                           ` KOSAKI Motohiro
2014-04-01 21:48                           ` Andrew Morton
2014-04-01 21:48                             ` Andrew Morton
2014-04-01 22:02                             ` Davidlohr Bueso
2014-04-01 22:02                               ` Davidlohr Bueso
2014-04-01 22:08                               ` Andrew Morton
2014-04-01 22:08                                 ` Andrew Morton
2014-04-13 18:05                                 ` Manfred Spraul
2014-04-13 18:05                                   ` Manfred Spraul
2014-04-13 23:15                                   ` Davidlohr Bueso
2014-04-13 23:15                                     ` Davidlohr Bueso
2014-04-16 22:46                                   ` Andrew Morton
2014-04-16 22:46                                     ` Andrew Morton
2014-04-16 23:19                                     ` Davidlohr Bueso
2014-04-16 23:19                                       ` Davidlohr Bueso
2014-04-17 10:41                                     ` Michael Kerrisk
2014-04-17 10:41                                       ` Michael Kerrisk
2014-04-17 16:41                                       ` Manfred Spraul
2014-04-17 16:41                                         ` Manfred Spraul
2014-04-17 20:19                                         ` Michael Kerrisk (man-pages)
2014-04-17 20:19                                           ` Michael Kerrisk (man-pages)
2014-04-01 22:49                             ` KOSAKI Motohiro
2014-04-01 22:49                               ` KOSAKI Motohiro
2014-04-01 23:28                               ` Davidlohr Bueso
2014-04-01 23:28                                 ` Davidlohr Bueso
2014-04-01 23:56                                 ` KOSAKI Motohiro
2014-04-01 23:56                                   ` KOSAKI Motohiro
2014-04-02  0:40                                   ` Davidlohr Bueso
2014-04-02  0:40                                     ` Davidlohr Bueso
2014-04-02  1:08                                     ` Greg Thelen
2014-04-02  1:08                                       ` Greg Thelen
2014-04-02  1:58                                       ` Kamezawa Hiroyuki
2014-04-02  1:58                                         ` Kamezawa Hiroyuki
2014-04-02  2:11                                         ` Greg Thelen
2014-04-02  2:11                                           ` Greg Thelen
2014-04-03  0:20                                   ` [PATCH] ipc,shm: disable shmmax and shmall by default Davidlohr Bueso
2014-04-03  0:20                                     ` Davidlohr Bueso
2014-04-03 14:07                                     ` Kamezawa Hiroyuki [this message]
2014-04-03 14:07                                       ` Kamezawa Hiroyuki
2014-04-03 19:02                                     ` Manfred Spraul
2014-04-03 19:02                                       ` Manfred Spraul
2014-04-03 19:50                                       ` Davidlohr Bueso
2014-04-03 19:50                                         ` Davidlohr Bueso
2014-04-03 23:39                                         ` KOSAKI Motohiro
2014-04-03 23:39                                           ` KOSAKI Motohiro
2014-04-04  5:00                                           ` Davidlohr Bueso
2014-04-04  5:00                                             ` Davidlohr Bueso
2014-04-05 18:24                                             ` KOSAKI Motohiro
2014-04-05 18:24                                               ` KOSAKI Motohiro
2014-04-06  6:42                                               ` Manfred Spraul
2014-04-06  6:42                                                 ` Manfred Spraul
2014-04-06 16:54                                                 ` Davidlohr Bueso
2014-04-06 16:54                                                   ` Davidlohr Bueso
2014-04-03 22:29                                     ` KOSAKI Motohiro
2014-04-03 22:29                                       ` KOSAKI Motohiro
2014-04-03 23:47                                     ` KOSAKI Motohiro
2014-04-03 23:47                                       ` KOSAKI Motohiro
2014-04-11 18:28                                     ` Manfred Spraul
2014-04-11 18:28                                       ` Manfred Spraul
2014-04-11 20:27                                       ` Davidlohr Bueso
2014-04-11 20:27                                         ` Davidlohr Bueso
2014-04-11 20:48                                         ` Davidlohr Bueso
2014-04-11 20:48                                           ` Davidlohr Bueso
2014-04-12  8:50                                         ` Manfred Spraul
2014-04-12  8:50                                           ` Manfred Spraul
2014-04-12 15:33                                           ` Davidlohr Bueso
2014-04-12 15:33                                             ` Davidlohr Bueso
2014-04-01 21:43                       ` [PATCH] ipc,shm: increase default size for shmmax Davidlohr Bueso
2014-04-01 21:43                         ` Davidlohr Bueso
2014-04-01 19:26             ` Andrew Morton
2014-04-01 19:26               ` Andrew Morton

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=533D6B28.6070305@jp.fujitsu.com \
    --to=kamezawa.hiroyu@jp.fujitsu.com \
    --cc=akpm@linux-foundation.org \
    --cc=aswin@hp.com \
    --cc=davidlohr@hp.com \
    --cc=gthelen@google.com \
    --cc=kosaki.motohiro@gmail.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=manfred@colorfullife.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.