BPF List
 help / color / mirror / Atom feed
* [RFC PATCH bpf-next] bpf: Check percpu map value size first
@ 2024-09-05 17:14 Tao Chen
  2024-09-06  3:20 ` Hou Tao
  0 siblings, 1 reply; 3+ messages in thread
From: Tao Chen @ 2024-09-05 17:14 UTC (permalink / raw)
  To: Alexei Starovoitov, Daniel Borkmann, Andrii Nakryiko,
	Eduard Zingerman, Song Liu, Yonghong Song, John Fastabend,
	KP Singh, Stanislav Fomichev
  Cc: bpf, linux-kernel, chen.dylane

Percpu map is often used, but the map value size limit often ignored,
like issue: https://github.com/iovisor/bcc/issues/2519. Actually,
percpu map value size is bound by PCPU_MIN_UNIT_SZIE, so we
can check the value size whether it exceeds PCPU_MIN_UNIT_SZIE first,
like percpu map of local_storage. Maybe the error message seems clearer
compared with "cannot allocate memory".

the test case we create a percpu map with large value like:
struct test_t {
        int a[100000];
};
struct {
        __uint(type, BPF_MAP_TYPE_PERCPU_ARRAY);
        __uint(max_entries, 1);
        __type(key, u32);
        __type(value, struct test_t);
} start SEC(".maps");

test on ubuntu24.04 vm:
libbpf: Error in bpf_create_map_xattr(start):Argument list too long(-7).
Retrying without BTF.

Signed-off-by: Tao Chen <chen.dylane@gmail.com>
---
 kernel/bpf/arraymap.c | 3 +++
 kernel/bpf/hashtab.c  | 3 +++
 2 files changed, 6 insertions(+)

diff --git a/kernel/bpf/arraymap.c b/kernel/bpf/arraymap.c
index a43e62e2a8bb..7c3c32f156ff 100644
--- a/kernel/bpf/arraymap.c
+++ b/kernel/bpf/arraymap.c
@@ -73,6 +73,9 @@ int array_map_alloc_check(union bpf_attr *attr)
 	/* avoid overflow on round_up(map->value_size) */
 	if (attr->value_size > INT_MAX)
 		return -E2BIG;
+	/* percpu map value size is bound by PCPU_MIN_UNIT_SIZE */
+	if (percpu && attr->value_size > PCPU_MIN_UNIT_SIZE)
+		return -E2BIG;
 
 	return 0;
 }
diff --git a/kernel/bpf/hashtab.c b/kernel/bpf/hashtab.c
index 45c7195b65ba..16d590fe1ffb 100644
--- a/kernel/bpf/hashtab.c
+++ b/kernel/bpf/hashtab.c
@@ -462,6 +462,9 @@ static int htab_map_alloc_check(union bpf_attr *attr)
 		 * kmalloc-able later in htab_map_update_elem()
 		 */
 		return -E2BIG;
+	/* percpu map value size is bound by PCPU_MIN_UNIT_SIZE */
+	if (percpu && attr->value_size > PCPU_MIN_UNIT_SIZE)
+		return -E2BIG;
 
 	return 0;
 }
-- 
2.25.1


^ permalink raw reply related	[flat|nested] 3+ messages in thread

* Re: [RFC PATCH bpf-next] bpf: Check percpu map value size first
  2024-09-05 17:14 [RFC PATCH bpf-next] bpf: Check percpu map value size first Tao Chen
@ 2024-09-06  3:20 ` Hou Tao
  2024-09-06 15:44   ` Tao Chen
  0 siblings, 1 reply; 3+ messages in thread
From: Hou Tao @ 2024-09-06  3:20 UTC (permalink / raw)
  To: Tao Chen
  Cc: bpf, linux-kernel, Alexei Starovoitov, Daniel Borkmann,
	Andrii Nakryiko, Eduard Zingerman, Song Liu, Yonghong Song,
	John Fastabend, KP Singh, Stanislav Fomichev

Hi,

On 9/6/2024 1:14 AM, Tao Chen wrote:
> Percpu map is often used, but the map value size limit often ignored,
> like issue: https://github.com/iovisor/bcc/issues/2519. Actually,
> percpu map value size is bound by PCPU_MIN_UNIT_SZIE, so we

s/SZIE/SIZE
> can check the value size whether it exceeds PCPU_MIN_UNIT_SZIE first,

The same typo here.
> like percpu map of local_storage. Maybe the error message seems clearer
> compared with "cannot allocate memory".
>
> the test case we create a percpu map with large value like:
> struct test_t {
>         int a[100000];
> };
> struct {
>         __uint(type, BPF_MAP_TYPE_PERCPU_ARRAY);
>         __uint(max_entries, 1);
>         __type(key, u32);
>         __type(value, struct test_t);
> } start SEC(".maps");
>
> test on ubuntu24.04 vm:
> libbpf: Error in bpf_create_map_xattr(start):Argument list too long(-7).
> Retrying without BTF.

Could you please convert it into a separated bpf selftest patch ?
>
> Signed-off-by: Tao Chen <chen.dylane@gmail.com>
> ---
>  kernel/bpf/arraymap.c | 3 +++
>  kernel/bpf/hashtab.c  | 3 +++
>  2 files changed, 6 insertions(+)
>
> diff --git a/kernel/bpf/arraymap.c b/kernel/bpf/arraymap.c
> index a43e62e2a8bb..7c3c32f156ff 100644
> --- a/kernel/bpf/arraymap.c
> +++ b/kernel/bpf/arraymap.c
> @@ -73,6 +73,9 @@ int array_map_alloc_check(union bpf_attr *attr)
>  	/* avoid overflow on round_up(map->value_size) */
>  	if (attr->value_size > INT_MAX)
>  		return -E2BIG;
> +	/* percpu map value size is bound by PCPU_MIN_UNIT_SIZE */
> +	if (percpu && attr->value_size > PCPU_MIN_UNIT_SIZE)
> +		return -E2BIG;
>  
>  	return 0;
>  }

Make sense. However because the map passes round_up(attr->value_size, 8)
to bpf_map_alloc_percpu(). Is it more reasonable to check
round_up(value_size) > PCPU_MIN_UNIT_SIZE instead ?
> diff --git a/kernel/bpf/hashtab.c b/kernel/bpf/hashtab.c
> index 45c7195b65ba..16d590fe1ffb 100644
> --- a/kernel/bpf/hashtab.c
> +++ b/kernel/bpf/hashtab.c
> @@ -462,6 +462,9 @@ static int htab_map_alloc_check(union bpf_attr *attr)
>  		 * kmalloc-able later in htab_map_update_elem()
>  		 */
>  		return -E2BIG;
> +	/* percpu map value size is bound by PCPU_MIN_UNIT_SIZE */
> +	if (percpu && attr->value_size > PCPU_MIN_UNIT_SIZE)
> +		return -E2BIG;
>  

The percpu allocation logic is the same as the array map:
round_up(value_size, 8) is used.
>  	return 0;
>  }


^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: [RFC PATCH bpf-next] bpf: Check percpu map value size first
  2024-09-06  3:20 ` Hou Tao
@ 2024-09-06 15:44   ` Tao Chen
  0 siblings, 0 replies; 3+ messages in thread
From: Tao Chen @ 2024-09-06 15:44 UTC (permalink / raw)
  To: Hou Tao
  Cc: bpf, linux-kernel, Alexei Starovoitov, Daniel Borkmann,
	Andrii Nakryiko, Eduard Zingerman, Song Liu, Yonghong Song,
	John Fastabend, KP Singh, Stanislav Fomichev

在 2024/9/6 11:20, Hou Tao 写道:
> Hi,
> 
> On 9/6/2024 1:14 AM, Tao Chen wrote:
>> Percpu map is often used, but the map value size limit often ignored,
>> like issue: https://github.com/iovisor/bcc/issues/2519. Actually,
>> percpu map value size is bound by PCPU_MIN_UNIT_SZIE, so we
> 
> s/SZIE/SIZE

Hi Hou, thank you for your reply!
My bad, i will fix it in v2.

>> can check the value size whether it exceeds PCPU_MIN_UNIT_SZIE first,
> 
> The same typo here.
>> like percpu map of local_storage. Maybe the error message seems clearer
>> compared with "cannot allocate memory".
>>
>> the test case we create a percpu map with large value like:
>> struct test_t {
>>          int a[100000];
>> };
>> struct {
>>          __uint(type, BPF_MAP_TYPE_PERCPU_ARRAY);
>>          __uint(max_entries, 1);
>>          __type(key, u32);
>>          __type(value, struct test_t);
>> } start SEC(".maps");
>>
>> test on ubuntu24.04 vm:
>> libbpf: Error in bpf_create_map_xattr(start):Argument list too long(-7).
>> Retrying without BTF.
> 
> Could you please convert it into a separated bpf selftest patch ?

No problem, i will add test case in v2.

>>
>> Signed-off-by: Tao Chen <chen.dylane@gmail.com>
>> ---
>>   kernel/bpf/arraymap.c | 3 +++
>>   kernel/bpf/hashtab.c  | 3 +++
>>   2 files changed, 6 insertions(+)
>>
>> diff --git a/kernel/bpf/arraymap.c b/kernel/bpf/arraymap.c
>> index a43e62e2a8bb..7c3c32f156ff 100644
>> --- a/kernel/bpf/arraymap.c
>> +++ b/kernel/bpf/arraymap.c
>> @@ -73,6 +73,9 @@ int array_map_alloc_check(union bpf_attr *attr)
>>   	/* avoid overflow on round_up(map->value_size) */
>>   	if (attr->value_size > INT_MAX)
>>   		return -E2BIG;
>> +	/* percpu map value size is bound by PCPU_MIN_UNIT_SIZE */
>> +	if (percpu && attr->value_size > PCPU_MIN_UNIT_SIZE)
>> +		return -E2BIG;
>>   
>>   	return 0;
>>   }
> 
> Make sense. However because the map passes round_up(attr->value_size, 8)

Yeah, you are right, it seems better, i will add it in v2.

> to bpf_map_alloc_percpu(). Is it more reasonable to check
> round_up(value_size) > PCPU_MIN_UNIT_SIZE instead ?
>> diff --git a/kernel/bpf/hashtab.c b/kernel/bpf/hashtab.c
>> index 45c7195b65ba..16d590fe1ffb 100644
>> --- a/kernel/bpf/hashtab.c
>> +++ b/kernel/bpf/hashtab.c
>> @@ -462,6 +462,9 @@ static int htab_map_alloc_check(union bpf_attr *attr)
>>   		 * kmalloc-able later in htab_map_update_elem()
>>   		 */
>>   		return -E2BIG;
>> +	/* percpu map value size is bound by PCPU_MIN_UNIT_SIZE */
>> +	if (percpu && attr->value_size > PCPU_MIN_UNIT_SIZE)
>> +		return -E2BIG;
>>   
> 
> The percpu allocation logic is the same as the array map:
> round_up(value_size, 8) is used.

ok.

>>   	return 0;
>>   }
> 


-- 
Best Regards
Dylane Chen

^ permalink raw reply	[flat|nested] 3+ messages in thread

end of thread, other threads:[~2024-09-06 15:45 UTC | newest]

Thread overview: 3+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2024-09-05 17:14 [RFC PATCH bpf-next] bpf: Check percpu map value size first Tao Chen
2024-09-06  3:20 ` Hou Tao
2024-09-06 15:44   ` Tao Chen

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox