From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-16.6 required=3.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH, MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_PASS,URIBL_BLOCKED,USER_AGENT_GIT, USER_IN_DEF_DKIM_WL autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id D34CCC282C8 for ; Mon, 28 Jan 2019 16:54:03 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 997142087E for ; Mon, 28 Jan 2019 16:54:03 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b="fYtDgKY4" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2388749AbfA1QyC (ORCPT ); Mon, 28 Jan 2019 11:54:02 -0500 Received: from mail-qt1-f202.google.com ([209.85.160.202]:38434 "EHLO mail-qt1-f202.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S2387641AbfA1QyB (ORCPT ); Mon, 28 Jan 2019 11:54:01 -0500 Received: by mail-qt1-f202.google.com with SMTP id n45so21326209qta.5 for ; Mon, 28 Jan 2019 08:54:00 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=date:in-reply-to:message-id:mime-version:references:subject:from:to :cc; bh=MJ/94GCjAxKMojWLZxhloRJzjvb7J+/xl4H5tnrnQ4M=; b=fYtDgKY4ErdrGz5pTN3WVIu/pq/TUtYEDTKoj6zeyTSf2Zi8lTPA5DHAUYKE1Re6Jb plngnIQmM6mairJHstyxelOjOyov65X9Ew7OWF/0MgAxjTZrM+UrFCLgSysuqI70zyoF ZPd/FhjarxZ4+fCpq0OdfaMjisAxyb3jVQ0qDNmEuGVd5xrpSw1QmiyEC2l6ocJTqxxi nqokrZaEoDlDqghh/6UvdtNcNCoBRaj5lvvzsCbXL9jQkoaxO5CRmPwApagPD/HxFa8m DvIGRkC6FLeGZwRyW8F7JDusKtqVYXxOswoS9qP7ms/KV33bq4svjvNL0i1ENjCKILUC GwxQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:in-reply-to:message-id:mime-version :references:subject:from:to:cc; bh=MJ/94GCjAxKMojWLZxhloRJzjvb7J+/xl4H5tnrnQ4M=; b=axKZDQJHAHSjdfrja7e7K2YNfD1YGUon3nl7FE6wDkwwbT2YPDFK0p7tBcUDIKxIS4 +cvEOGG8v97CV3ycKCBTu+2rlVjWlD+Qx+QY3q4tJsfLHMxcxmQd5zISUx3sfBhHk/co kzYivdAWb5zYiGBdB89oFxl+YE2KVMTe12PFABJ30tJbfO1/88KCelD6Yfxw2juQYPt6 STgwOz7yo/pnDL6PTtevc0cc0QnKRk5p7n6JT7/3UgldGvMCM8pEnLXDxOYLN29nD1zJ DMUFsZHjSS0RO6FpKcWV9o64YXBdOYEVv2Sj5skO/zJQEksvpULl3Jpv52Ix5w0zNGTk LhVQ== X-Gm-Message-State: AJcUukcSmt3DbbSvYxQrb5rsFbx8btfSpZKjHda7uSrn/tGOJyteQ8/4 FkRaNDS2fv7i95TCW5IAffqd+tqogFlW6PU7Rwzn0QQD/bnKqaW7NStV3XXNCXxBdUHRsEGzH7e XpZbxOgH0ZbgzBg98rBQQ5k+2JLRtlfgU1jDnNlaAi2kmyaRgqi+HNg== X-Google-Smtp-Source: ALg8bN7QtJ0fMn8hgPMKpmmUQf1K8/20CPARDwl3qFEy09gH9WkTl53CUrAbQK5XC92anp1/Zlve9Zs= X-Received: by 2002:ac8:2e8d:: with SMTP id h13mr369099qta.62.1548694440527; Mon, 28 Jan 2019 08:54:00 -0800 (PST) Date: Mon, 28 Jan 2019 08:53:53 -0800 In-Reply-To: <20190128165355.229403-1-sdf@google.com> Message-Id: <20190128165355.229403-2-sdf@google.com> Mime-Version: 1.0 References: <20190128165355.229403-1-sdf@google.com> X-Mailer: git-send-email 2.20.1.495.gaa96b0ce6b-goog Subject: [PATCH bpf-next v3 1/3] net/flow_dissector: move bpf case into __skb_flow_bpf_dissect From: Stanislav Fomichev To: netdev@vger.kernel.org Cc: davem@davemloft.net, ast@kernel.org, daniel@iogearbox.net, Stanislav Fomichev , Song Liu Content-Type: text/plain; charset="UTF-8" Sender: netdev-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: netdev@vger.kernel.org This way, we can reuse it for flow dissector in BPF_PROG_TEST_RUN. No functional changes. Signed-off-by: Stanislav Fomichev Acked-by: Song Liu --- include/linux/skbuff.h | 5 +++ net/core/flow_dissector.c | 92 +++++++++++++++++++++++---------------- 2 files changed, 59 insertions(+), 38 deletions(-) diff --git a/include/linux/skbuff.h b/include/linux/skbuff.h index 93f56fddd92a..be762fc34ff3 100644 --- a/include/linux/skbuff.h +++ b/include/linux/skbuff.h @@ -1221,6 +1221,11 @@ static inline int skb_flow_dissector_bpf_prog_detach(const union bpf_attr *attr) } #endif +struct bpf_flow_keys; +bool __skb_flow_bpf_dissect(struct bpf_prog *prog, + const struct sk_buff *skb, + struct flow_dissector *flow_dissector, + struct bpf_flow_keys *flow_keys); bool __skb_flow_dissect(const struct sk_buff *skb, struct flow_dissector *flow_dissector, void *target_container, diff --git a/net/core/flow_dissector.c b/net/core/flow_dissector.c index 9f2840510e63..bb1a54747d64 100644 --- a/net/core/flow_dissector.c +++ b/net/core/flow_dissector.c @@ -683,6 +683,46 @@ static void __skb_flow_bpf_to_target(const struct bpf_flow_keys *flow_keys, } } +bool __skb_flow_bpf_dissect(struct bpf_prog *prog, + const struct sk_buff *skb, + struct flow_dissector *flow_dissector, + struct bpf_flow_keys *flow_keys) +{ + struct bpf_skb_data_end cb_saved; + struct bpf_skb_data_end *cb; + u32 result; + + /* Note that even though the const qualifier is discarded + * throughout the execution of the BPF program, all changes(the + * control block) are reverted after the BPF program returns. + * Therefore, __skb_flow_dissect does not alter the skb. + */ + + cb = (struct bpf_skb_data_end *)skb->cb; + + /* Save Control Block */ + memcpy(&cb_saved, cb, sizeof(cb_saved)); + memset(cb, 0, sizeof(*cb)); + + /* Pass parameters to the BPF program */ + memset(flow_keys, 0, sizeof(*flow_keys)); + cb->qdisc_cb.flow_keys = flow_keys; + flow_keys->nhoff = skb_network_offset(skb); + flow_keys->thoff = flow_keys->nhoff; + + bpf_compute_data_pointers((struct sk_buff *)skb); + result = BPF_PROG_RUN(prog, skb); + + /* Restore state */ + memcpy(cb, &cb_saved, sizeof(cb_saved)); + + flow_keys->nhoff = clamp_t(u16, flow_keys->nhoff, 0, skb->len); + flow_keys->thoff = clamp_t(u16, flow_keys->thoff, + flow_keys->nhoff, skb->len); + + return result == BPF_OK; +} + /** * __skb_flow_dissect - extract the flow_keys struct and return it * @skb: sk_buff to extract the flow from, can be NULL if the rest are specified @@ -714,7 +754,6 @@ bool __skb_flow_dissect(const struct sk_buff *skb, struct flow_dissector_key_vlan *key_vlan; enum flow_dissect_ret fdret; enum flow_dissector_key_id dissector_vlan = FLOW_DISSECTOR_KEY_MAX; - struct bpf_prog *attached = NULL; int num_hdrs = 0; u8 ip_proto = 0; bool ret; @@ -754,53 +793,30 @@ bool __skb_flow_dissect(const struct sk_buff *skb, FLOW_DISSECTOR_KEY_BASIC, target_container); - rcu_read_lock(); if (skb) { + struct bpf_flow_keys flow_keys; + struct bpf_prog *attached = NULL; + + rcu_read_lock(); + if (skb->dev) attached = rcu_dereference(dev_net(skb->dev)->flow_dissector_prog); else if (skb->sk) attached = rcu_dereference(sock_net(skb->sk)->flow_dissector_prog); else WARN_ON_ONCE(1); - } - if (attached) { - /* Note that even though the const qualifier is discarded - * throughout the execution of the BPF program, all changes(the - * control block) are reverted after the BPF program returns. - * Therefore, __skb_flow_dissect does not alter the skb. - */ - struct bpf_flow_keys flow_keys = {}; - struct bpf_skb_data_end cb_saved; - struct bpf_skb_data_end *cb; - u32 result; - - cb = (struct bpf_skb_data_end *)skb->cb; - - /* Save Control Block */ - memcpy(&cb_saved, cb, sizeof(cb_saved)); - memset(cb, 0, sizeof(cb_saved)); - /* Pass parameters to the BPF program */ - cb->qdisc_cb.flow_keys = &flow_keys; - flow_keys.nhoff = nhoff; - flow_keys.thoff = nhoff; - - bpf_compute_data_pointers((struct sk_buff *)skb); - result = BPF_PROG_RUN(attached, skb); - - /* Restore state */ - memcpy(cb, &cb_saved, sizeof(cb_saved)); - - flow_keys.nhoff = clamp_t(u16, flow_keys.nhoff, 0, skb->len); - flow_keys.thoff = clamp_t(u16, flow_keys.thoff, - flow_keys.nhoff, skb->len); - - __skb_flow_bpf_to_target(&flow_keys, flow_dissector, - target_container); + if (attached) { + ret = __skb_flow_bpf_dissect(attached, skb, + flow_dissector, + &flow_keys); + __skb_flow_bpf_to_target(&flow_keys, flow_dissector, + target_container); + rcu_read_unlock(); + return ret; + } rcu_read_unlock(); - return result == BPF_OK; } - rcu_read_unlock(); if (dissector_uses_key(flow_dissector, FLOW_DISSECTOR_KEY_ETH_ADDRS)) { -- 2.20.1.495.gaa96b0ce6b-goog