From: Martin KaFai Lau <martin.lau@linux.dev>
To: Amery Hung <ameryhung@gmail.com>
Cc: bpf@vger.kernel.org, netdev@vger.kernel.org,
alexei.starovoitov@gmail.com, andrii@kernel.org,
daniel@iogearbox.net, memxor@gmail.com, kpsingh@kernel.org,
martin.lau@kernel.org, yonghong.song@linux.dev, song@kernel.org,
haoluo@google.com, kernel-team@meta.com
Subject: Re: [RFC PATCH bpf-next v1 03/11] bpf: Open code bpf_selem_unlink_storage in bpf_selem_unlink
Date: Fri, 1 Aug 2025 17:58:02 -0700 [thread overview]
Message-ID: <8e21c788-5187-4fee-baec-22b8e80be383@linux.dev> (raw)
In-Reply-To: <20250729182550.185356-4-ameryhung@gmail.com>
On 7/29/25 11:25 AM, Amery Hung wrote:
> void bpf_selem_unlink(struct bpf_local_storage_elem *selem, bool reuse_now)
> {
> + struct bpf_local_storage_map *storage_smap;
> + struct bpf_local_storage *local_storage = NULL;
> + bool bpf_ma, free_local_storage = false;
> + HLIST_HEAD(selem_free_list);
> struct bpf_local_storage_map_bucket *b;
> - struct bpf_local_storage_map *smap;
> - unsigned long flags;
> + struct bpf_local_storage_map *smap = NULL;
> + unsigned long flags, b_flags;
>
> if (likely(selem_linked_to_map_lockless(selem))) {
Can we simplify the bpf_selem_unlink() function by skipping this map_lockless
check,
> smap = rcu_dereference_check(SDATA(selem)->smap, bpf_rcu_lock_held());
> b = select_bucket(smap, selem);
> - raw_spin_lock_irqsave(&b->lock, flags);
> + }
>
> - /* Always unlink from map before unlinking from local_storage
> - * because selem will be freed after successfully unlinked from
> - * the local_storage.
> - */
> - bpf_selem_unlink_map_nolock(selem);
> - raw_spin_unlock_irqrestore(&b->lock, flags);
> + if (likely(selem_linked_to_storage_lockless(selem))) {
only depends on this and then proceed to take the lock_storage->lock. Then
recheck selem_linked_to_storage(selem), bpf_selem_unlink_map(selem) first, and
then bpf_selem_unlink_storage_nolock(selem) last.
Then bpf_selem_unlink_map can use selem->local_storage->owner to select_bucket().
> + local_storage = rcu_dereference_check(selem->local_storage,
> + bpf_rcu_lock_held());
> + storage_smap = rcu_dereference_check(local_storage->smap,
> + bpf_rcu_lock_held());
> + bpf_ma = check_storage_bpf_ma(local_storage, storage_smap, selem);
> }
>
> - bpf_selem_unlink_storage(selem, reuse_now);
> + if (local_storage)
> + raw_spin_lock_irqsave(&local_storage->lock, flags);
> + if (smap)
> + raw_spin_lock_irqsave(&b->lock, b_flags);
> +
> + /* Always unlink from map before unlinking from local_storage
> + * because selem will be freed after successfully unlinked from
> + * the local_storage.
> + */
> + if (smap)
> + bpf_selem_unlink_map_nolock(selem);
> + if (local_storage && likely(selem_linked_to_storage(selem)))
> + free_local_storage = bpf_selem_unlink_storage_nolock(
> + local_storage, selem, true, &selem_free_list);
> +
> + if (smap)
> + raw_spin_unlock_irqrestore(&b->lock, b_flags);
> + if (local_storage)
> + raw_spin_unlock_irqrestore(&local_storage->lock, flags);
> +
> + bpf_selem_free_list(&selem_free_list, reuse_now);
> +
> + if (free_local_storage)
> + bpf_local_storage_free(local_storage, storage_smap, bpf_ma, reuse_now);
> }
>
> void __bpf_local_storage_insert_cache(struct bpf_local_storage *local_storage,
next prev parent reply other threads:[~2025-08-02 0:58 UTC|newest]
Thread overview: 19+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-07-29 18:25 [RFC PATCH bpf-next v1 00/11] Remove task and cgroup local Amery Hung
2025-07-29 18:25 ` [RFC PATCH bpf-next v1 01/11] bpf: Convert bpf_selem_unlink_map to failable Amery Hung
2025-08-01 1:05 ` Martin KaFai Lau
2025-07-29 18:25 ` [RFC PATCH bpf-next v1 02/11] bpf: Convert bpf_selem_link_map " Amery Hung
2025-07-29 18:25 ` [RFC PATCH bpf-next v1 03/11] bpf: Open code bpf_selem_unlink_storage in bpf_selem_unlink Amery Hung
2025-08-02 0:58 ` Martin KaFai Lau [this message]
2025-08-05 16:25 ` Amery Hung
2025-08-05 23:10 ` Martin KaFai Lau
2025-07-29 18:25 ` [RFC PATCH bpf-next v1 04/11] bpf: Convert bpf_selem_unlink to failable Amery Hung
2025-07-29 18:25 ` [RFC PATCH bpf-next v1 05/11] bpf: Change local_storage->lock and b->lock to rqspinlock Amery Hung
2025-07-29 18:25 ` [RFC PATCH bpf-next v1 06/11] bpf: Remove task local storage percpu counter Amery Hung
2025-08-02 1:15 ` Martin KaFai Lau
2025-07-29 18:25 ` [RFC PATCH bpf-next v1 07/11] bpf: Remove cgroup " Amery Hung
2025-07-29 18:25 ` [RFC PATCH bpf-next v1 08/11] bpf: Remove unused percpu counter from bpf_local_storage_map_free Amery Hung
2025-07-29 18:25 ` [RFC PATCH bpf-next v1 09/11] selftests/bpf: Update task_local_storage/recursion test Amery Hung
2025-07-29 18:25 ` [RFC PATCH bpf-next v1 10/11] selftests/bpf: Remove test_task_storage_map_stress_lookup Amery Hung
2025-07-29 18:25 ` [RFC PATCH bpf-next v1 11/11] selftests/bpf: Choose another percpu variable in bpf for btf_dump test Amery Hung
2025-07-29 18:28 ` [RFC PATCH bpf-next v1 00/11] Remove task and cgroup local Amery Hung
2025-08-02 1:46 ` Martin KaFai Lau
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=8e21c788-5187-4fee-baec-22b8e80be383@linux.dev \
--to=martin.lau@linux.dev \
--cc=alexei.starovoitov@gmail.com \
--cc=ameryhung@gmail.com \
--cc=andrii@kernel.org \
--cc=bpf@vger.kernel.org \
--cc=daniel@iogearbox.net \
--cc=haoluo@google.com \
--cc=kernel-team@meta.com \
--cc=kpsingh@kernel.org \
--cc=martin.lau@kernel.org \
--cc=memxor@gmail.com \
--cc=netdev@vger.kernel.org \
--cc=song@kernel.org \
--cc=yonghong.song@linux.dev \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.