From: Yonghong Song <yhs@fb.com>
To: Yosry Ahmed <yosryahmed@google.com>
Cc: Alexei Starovoitov <ast@kernel.org>,
Daniel Borkmann <daniel@iogearbox.net>,
Andrii Nakryiko <andrii@kernel.org>,
Martin KaFai Lau <kafai@fb.com>, Song Liu <songliubraving@fb.com>,
John Fastabend <john.fastabend@gmail.com>,
KP Singh <kpsingh@kernel.org>, Hao Luo <haoluo@google.com>,
Tejun Heo <tj@kernel.org>, Zefan Li <lizefan.x@bytedance.com>,
Johannes Weiner <hannes@cmpxchg.org>,
Shuah Khan <shuah@kernel.org>,
Roman Gushchin <roman.gushchin@linux.dev>,
Michal Hocko <mhocko@kernel.org>,
Stanislav Fomichev <sdf@google.com>,
David Rientjes <rientjes@google.com>,
Greg Thelen <gthelen@google.com>,
Shakeel Butt <shakeelb@google.com>,
Linux Kernel Mailing List <linux-kernel@vger.kernel.org>,
Networking <netdev@vger.kernel.org>, bpf <bpf@vger.kernel.org>,
Cgroups <cgroups@vger.kernel.org>
Subject: Re: [PATCH bpf-next v1 2/5] cgroup: bpf: add cgroup_rstat_updated() and cgroup_rstat_flush() kfuncs
Date: Fri, 20 May 2022 09:16:08 -0700 [thread overview]
Message-ID: <eca39189-9258-b1cc-0a1d-a0d7e6027861@fb.com> (raw)
In-Reply-To: <CAJD7tkanipJ7-9H_L6KMUjpD2qS29-YCrnMXw+8BAKfbOk5P9Q@mail.gmail.com>
On 5/20/22 9:08 AM, Yosry Ahmed wrote:
> On Fri, May 20, 2022 at 8:15 AM Yonghong Song <yhs@fb.com> wrote:
>>
>>
>>
>> On 5/19/22 6:21 PM, Yosry Ahmed wrote:
>>> Add cgroup_rstat_updated() and cgroup_rstat_flush() kfuncs to bpf
>>> tracing programs. bpf programs that make use of rstat can use these
>>> functions to inform rstat when they update stats for a cgroup, and when
>>> they need to flush the stats.
>>>
>>> Signed-off-by: Yosry Ahmed <yosryahmed@google.com>
>>> ---
>>> kernel/cgroup/rstat.c | 35 ++++++++++++++++++++++++++++++++++-
>>> 1 file changed, 34 insertions(+), 1 deletion(-)
>>>
>>> diff --git a/kernel/cgroup/rstat.c b/kernel/cgroup/rstat.c
>>> index e7a88d2600bd..a16a851bc0a1 100644
>>> --- a/kernel/cgroup/rstat.c
>>> +++ b/kernel/cgroup/rstat.c
>>> @@ -3,6 +3,11 @@
>>>
>>> #include <linux/sched/cputime.h>
>>>
>>> +#include <linux/bpf.h>
>>> +#include <linux/btf.h>
>>> +#include <linux/btf_ids.h>
>>> +
>>> +
>>> static DEFINE_SPINLOCK(cgroup_rstat_lock);
>>> static DEFINE_PER_CPU(raw_spinlock_t, cgroup_rstat_cpu_lock);
>>>
>>> @@ -141,7 +146,12 @@ static struct cgroup *cgroup_rstat_cpu_pop_updated(struct cgroup *pos,
>>> return pos;
>>> }
>>>
>>> -/* A hook for bpf stat collectors to attach to and flush their stats */
>>> +/*
>>> + * A hook for bpf stat collectors to attach to and flush their stats.
>>> + * Together with providing bpf kfuncs for cgroup_rstat_updated() and
>>> + * cgroup_rstat_flush(), this enables a complete workflow where bpf progs that
>>> + * collect cgroup stats can integrate with rstat for efficient flushing.
>>> + */
>>> __weak noinline void bpf_rstat_flush(struct cgroup *cgrp,
>>> struct cgroup *parent, int cpu)
>>> {
>>> @@ -476,3 +486,26 @@ void cgroup_base_stat_cputime_show(struct seq_file *seq)
>>> "system_usec %llu\n",
>>> usage, utime, stime);
>>> }
>>> +
>>> +/* Add bpf kfuncs for cgroup_rstat_updated() and cgroup_rstat_flush() */
>>> +BTF_SET_START(bpf_rstat_check_kfunc_ids)
>>> +BTF_ID(func, cgroup_rstat_updated)
>>> +BTF_ID(func, cgroup_rstat_flush)
>>> +BTF_SET_END(bpf_rstat_check_kfunc_ids)
>>> +
>>> +BTF_SET_START(bpf_rstat_sleepable_kfunc_ids)
>>> +BTF_ID(func, cgroup_rstat_flush)
>>> +BTF_SET_END(bpf_rstat_sleepable_kfunc_ids)
>>> +
>>> +static const struct btf_kfunc_id_set bpf_rstat_kfunc_set = {
>>> + .owner = THIS_MODULE,
>>> + .check_set = &bpf_rstat_check_kfunc_ids,
>>> + .sleepable_set = &bpf_rstat_sleepable_kfunc_ids,
>>
>> There is a compilation error here:
>>
>> kernel/cgroup/rstat.c:503:3: error: ‘const struct btf_kfunc_id_set’ has
>> no member named ‘sleepable_set’; did you mean ‘release_set’?
>> 503 | .sleepable_set = &bpf_rstat_sleepable_kfunc_ids,
>> | ^~~~~~~~~~~~~
>> | release_set
>> kernel/cgroup/rstat.c:503:19: warning: excess elements in struct
>> initializer
>> 503 | .sleepable_set = &bpf_rstat_sleepable_kfunc_ids,
>> | ^
>> kernel/cgroup/rstat.c:503:19: note: (near initialization for
>> ‘bpf_rstat_kfunc_set’)
>> make[3]: *** [scripts/Makefile.build:288: kernel/cgroup/rstat.o] Error 1
>>
>> Please fix.
>
> This patch series is rebased on top of 2 patches in the mailing list:
> - bpf/btf: also allow kfunc in tracing and syscall programs
> - btf: Add a new kfunc set which allows to mark a function to be
> sleepable
>
> I specified this in the cover letter, do I need to do something else
> in this situation? Re-send the patches as part of my series?
At least put a link in the cover letter for the above two patches?
This way, people can easily find them to double check.
>
>
>
>>
>>> +};
>>> +
>>> +static int __init bpf_rstat_kfunc_init(void)
>>> +{
>>> + return register_btf_kfunc_id_set(BPF_PROG_TYPE_TRACING,
>>> + &bpf_rstat_kfunc_set);
>>> +}
>>> +late_initcall(bpf_rstat_kfunc_init);
next prev parent reply other threads:[~2022-05-20 16:16 UTC|newest]
Thread overview: 58+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-05-20 1:21 [PATCH bpf-next v1 0/5] bpf: rstat: cgroup hierarchical stats Yosry Ahmed
2022-05-20 1:21 ` [PATCH bpf-next v1 1/5] cgroup: bpf: add a hook for bpf progs to attach to rstat flushing Yosry Ahmed
2022-05-21 11:16 ` kernel test robot
2022-05-21 11:26 ` kernel test robot
2022-05-21 11:26 ` kernel test robot
2022-05-20 1:21 ` [PATCH bpf-next v1 2/5] cgroup: bpf: add cgroup_rstat_updated() and cgroup_rstat_flush() kfuncs Yosry Ahmed
2022-05-20 7:24 ` Tejun Heo
2022-05-20 9:13 ` Yosry Ahmed
2022-05-20 9:36 ` Kumar Kartikeya Dwivedi
2022-05-20 11:16 ` Tejun Heo
2022-05-20 16:06 ` Yosry Ahmed
2022-05-20 15:14 ` Yonghong Song
2022-05-20 16:08 ` Yosry Ahmed
2022-05-20 16:16 ` Yonghong Song [this message]
2022-05-20 16:20 ` Yosry Ahmed
2022-05-21 11:47 ` kernel test robot
2022-05-20 1:21 ` [PATCH bpf-next v1 3/5] bpf: Introduce cgroup iter Yosry Ahmed
2022-05-20 7:41 ` Tejun Heo
2022-05-20 7:58 ` Yosry Ahmed
2022-05-20 8:11 ` Tejun Heo
2022-05-20 11:27 ` Tejun Heo
2022-05-20 16:29 ` Yonghong Song
2022-05-20 16:45 ` Tejun Heo
2022-05-20 19:42 ` Hao Luo
2022-05-20 21:18 ` Yosry Ahmed
2022-05-20 22:19 ` Alexei Starovoitov
2022-05-20 22:36 ` Yosry Ahmed
2022-05-20 22:57 ` Tejun Heo
2022-05-21 0:59 ` Yonghong Song
2022-05-21 2:34 ` Hao Luo
2022-05-23 23:58 ` Andrii Nakryiko
2022-05-24 0:53 ` Hao Luo
2022-05-24 1:30 ` Andrii Nakryiko
2022-05-20 21:49 ` Hao Luo
2022-05-21 0:58 ` Yonghong Song
2022-05-21 2:43 ` Hao Luo
2022-05-21 4:53 ` Tejun Heo
2022-05-21 0:52 ` Yonghong Song
2022-05-20 17:30 ` Hao Luo
2022-05-20 1:21 ` [PATCH bpf-next v1 4/5] selftests/bpf: extend cgroup helpers Yosry Ahmed
2022-05-20 1:21 ` [PATCH bpf-next v1 5/5] bpf: add a selftest for cgroup hierarchical stats collection Yosry Ahmed
2022-05-20 16:09 ` Yonghong Song
2022-05-20 16:18 ` Yosry Ahmed
2022-05-24 0:01 ` Andrii Nakryiko
2022-05-24 2:35 ` Yosry Ahmed
2022-06-03 16:23 ` Michal Koutný
2022-06-03 19:52 ` Yosry Ahmed
2022-06-06 12:32 ` Michal Koutný
2022-06-06 19:41 ` Yosry Ahmed
2022-06-07 12:12 ` Michal Koutný
2022-06-07 17:43 ` Yosry Ahmed
2022-06-08 11:17 ` Michal Koutný
2022-06-03 16:22 ` [PATCH bpf-next v1 0/5] bpf: rstat: cgroup hierarchical stats Michal Koutný
2022-06-03 19:47 ` Yosry Ahmed
2022-06-06 12:32 ` Michal Koutný
2022-06-06 19:32 ` Yosry Ahmed
2022-06-06 19:54 ` Kumar Kartikeya Dwivedi
2022-06-06 20:00 ` Yosry Ahmed
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=eca39189-9258-b1cc-0a1d-a0d7e6027861@fb.com \
--to=yhs@fb.com \
--cc=andrii@kernel.org \
--cc=ast@kernel.org \
--cc=bpf@vger.kernel.org \
--cc=cgroups@vger.kernel.org \
--cc=daniel@iogearbox.net \
--cc=gthelen@google.com \
--cc=hannes@cmpxchg.org \
--cc=haoluo@google.com \
--cc=john.fastabend@gmail.com \
--cc=kafai@fb.com \
--cc=kpsingh@kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=lizefan.x@bytedance.com \
--cc=mhocko@kernel.org \
--cc=netdev@vger.kernel.org \
--cc=rientjes@google.com \
--cc=roman.gushchin@linux.dev \
--cc=sdf@google.com \
--cc=shakeelb@google.com \
--cc=shuah@kernel.org \
--cc=songliubraving@fb.com \
--cc=tj@kernel.org \
--cc=yosryahmed@google.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox