From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-16.6 required=3.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH, MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_PASS,USER_AGENT_GIT,USER_IN_DEF_DKIM_WL autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id ABFE9C282C5 for ; Thu, 24 Jan 2019 16:50:01 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 65493218B0 for ; Thu, 24 Jan 2019 16:50:01 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b="pzsXtnt0" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728898AbfAXQuA (ORCPT ); Thu, 24 Jan 2019 11:50:00 -0500 Received: from mail-yw1-f73.google.com ([209.85.161.73]:40864 "EHLO mail-yw1-f73.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726252AbfAXQt7 (ORCPT ); Thu, 24 Jan 2019 11:49:59 -0500 Received: by mail-yw1-f73.google.com with SMTP id l69so3344090ywb.7 for ; Thu, 24 Jan 2019 08:49:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=date:in-reply-to:message-id:mime-version:references:subject:from:to :cc; bh=ZnhnbyHX5KxI7PB3Nd6opjdvONKFDvTuSvkXssBP5y0=; b=pzsXtnt0hzl/KLKizg+j9SYKF5MlecAD1aWaLliy3kdPXga3DlULNt9EkNrLCwvNtk jputtJVT4o2pgrcMH8nMU+OmGg0uyjPeRPVeJOHMzB+rKQ9A3LSBrKPhVor8CEMc0Qo3 ULH1F5qRm1N8A6zcPw74VDJ7h/2MaTiTmDe+dilbWrfJgZhPXv5jod+R0qAIkeFSCFNR DdkUShidDOXZyQNR0qm5QBL2oYVFMY8IGNz0dIVn8RQOZffu/RwPQ4i9034oquTzG42c +NvGdOU3cHMbeUHRmxGEhzqcDZsWgjPFj4v365085NTkLTKNJWcwyNzwDcPKKMhNwvuH ZhRw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:in-reply-to:message-id:mime-version :references:subject:from:to:cc; bh=ZnhnbyHX5KxI7PB3Nd6opjdvONKFDvTuSvkXssBP5y0=; b=iHytY655auFisxdu4xcDmKpja9eG8U6R+mhDi5geplIMWol5zqn5FceGAwwFMci+sB lYH86/CQOWcvptxTpBmhdYhPaIyCl4J2AlBAXYB1rHRtMSoZ7DqWqy1+ugLndvUIa642 Yg+joPSUGpPdWKTav8QRBm9Dv4DhJ2qkZGK9/rvOpnQEOmanD3W58QF7/nLhdvaVP5vP WBrgJa64H8/scugyGbepFAtS8wQlDiP/QbGd+glNxO7kak2hr6TEbWKaDxCZj8elEBek 2zFKb/MYVMu0M5dfSND45U/HdUyEAX9qAI+QMZpAcXbjc5LwGImNsk3F8SpEZQ/JyJ6b gjOA== X-Gm-Message-State: AJcUukczDxnlnd7XKerSj+ztrZAXvsuxUlXN6gLlOb39OqeSvCMRNeNX xJ8qfT0tysGzxsqnFtM5dKjo+uK5MB0kO+53AxPi156owQeETBQhiyd82YoPsbo2UvA/QYbc2oK 8hkCj9weC4RZ3tABKBciqeao0QPwg6+LXa7ahXEq0GOZGlr4uVzCw1g== X-Google-Smtp-Source: ALg8bN5gTEIA2155+yO5Pk3zmOIgZu90aeQhcUUKQH51srySX/u9gBfpdeOueJsC2UHGvpymcmPcW7Y= X-Received: by 2002:a25:c04c:: with SMTP id c73mr3601765ybf.80.1548348598217; Thu, 24 Jan 2019 08:49:58 -0800 (PST) Date: Thu, 24 Jan 2019 08:49:51 -0800 In-Reply-To: <20190124164953.29740-1-sdf@google.com> Message-Id: <20190124164953.29740-2-sdf@google.com> Mime-Version: 1.0 References: <20190124164953.29740-1-sdf@google.com> X-Mailer: git-send-email 2.20.1.321.g9e740568ce-goog Subject: [PATCH bpf-next v2 1/3] net/flow_dissector: move bpf case into __skb_flow_bpf_dissect From: Stanislav Fomichev To: netdev@vger.kernel.org Cc: davem@davemloft.net, ast@kernel.org, daniel@iogearbox.net, Stanislav Fomichev Content-Type: text/plain; charset="UTF-8" Sender: netdev-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: netdev@vger.kernel.org This way, we can reuse it for flow dissector in BPF_PROG_TEST_RUN. No functional changes. Signed-off-by: Stanislav Fomichev --- include/linux/skbuff.h | 5 +++ net/core/flow_dissector.c | 92 +++++++++++++++++++++++---------------- 2 files changed, 59 insertions(+), 38 deletions(-) diff --git a/include/linux/skbuff.h b/include/linux/skbuff.h index 93f56fddd92a..be762fc34ff3 100644 --- a/include/linux/skbuff.h +++ b/include/linux/skbuff.h @@ -1221,6 +1221,11 @@ static inline int skb_flow_dissector_bpf_prog_detach(const union bpf_attr *attr) } #endif +struct bpf_flow_keys; +bool __skb_flow_bpf_dissect(struct bpf_prog *prog, + const struct sk_buff *skb, + struct flow_dissector *flow_dissector, + struct bpf_flow_keys *flow_keys); bool __skb_flow_dissect(const struct sk_buff *skb, struct flow_dissector *flow_dissector, void *target_container, diff --git a/net/core/flow_dissector.c b/net/core/flow_dissector.c index 9f2840510e63..bb1a54747d64 100644 --- a/net/core/flow_dissector.c +++ b/net/core/flow_dissector.c @@ -683,6 +683,46 @@ static void __skb_flow_bpf_to_target(const struct bpf_flow_keys *flow_keys, } } +bool __skb_flow_bpf_dissect(struct bpf_prog *prog, + const struct sk_buff *skb, + struct flow_dissector *flow_dissector, + struct bpf_flow_keys *flow_keys) +{ + struct bpf_skb_data_end cb_saved; + struct bpf_skb_data_end *cb; + u32 result; + + /* Note that even though the const qualifier is discarded + * throughout the execution of the BPF program, all changes(the + * control block) are reverted after the BPF program returns. + * Therefore, __skb_flow_dissect does not alter the skb. + */ + + cb = (struct bpf_skb_data_end *)skb->cb; + + /* Save Control Block */ + memcpy(&cb_saved, cb, sizeof(cb_saved)); + memset(cb, 0, sizeof(*cb)); + + /* Pass parameters to the BPF program */ + memset(flow_keys, 0, sizeof(*flow_keys)); + cb->qdisc_cb.flow_keys = flow_keys; + flow_keys->nhoff = skb_network_offset(skb); + flow_keys->thoff = flow_keys->nhoff; + + bpf_compute_data_pointers((struct sk_buff *)skb); + result = BPF_PROG_RUN(prog, skb); + + /* Restore state */ + memcpy(cb, &cb_saved, sizeof(cb_saved)); + + flow_keys->nhoff = clamp_t(u16, flow_keys->nhoff, 0, skb->len); + flow_keys->thoff = clamp_t(u16, flow_keys->thoff, + flow_keys->nhoff, skb->len); + + return result == BPF_OK; +} + /** * __skb_flow_dissect - extract the flow_keys struct and return it * @skb: sk_buff to extract the flow from, can be NULL if the rest are specified @@ -714,7 +754,6 @@ bool __skb_flow_dissect(const struct sk_buff *skb, struct flow_dissector_key_vlan *key_vlan; enum flow_dissect_ret fdret; enum flow_dissector_key_id dissector_vlan = FLOW_DISSECTOR_KEY_MAX; - struct bpf_prog *attached = NULL; int num_hdrs = 0; u8 ip_proto = 0; bool ret; @@ -754,53 +793,30 @@ bool __skb_flow_dissect(const struct sk_buff *skb, FLOW_DISSECTOR_KEY_BASIC, target_container); - rcu_read_lock(); if (skb) { + struct bpf_flow_keys flow_keys; + struct bpf_prog *attached = NULL; + + rcu_read_lock(); + if (skb->dev) attached = rcu_dereference(dev_net(skb->dev)->flow_dissector_prog); else if (skb->sk) attached = rcu_dereference(sock_net(skb->sk)->flow_dissector_prog); else WARN_ON_ONCE(1); - } - if (attached) { - /* Note that even though the const qualifier is discarded - * throughout the execution of the BPF program, all changes(the - * control block) are reverted after the BPF program returns. - * Therefore, __skb_flow_dissect does not alter the skb. - */ - struct bpf_flow_keys flow_keys = {}; - struct bpf_skb_data_end cb_saved; - struct bpf_skb_data_end *cb; - u32 result; - - cb = (struct bpf_skb_data_end *)skb->cb; - - /* Save Control Block */ - memcpy(&cb_saved, cb, sizeof(cb_saved)); - memset(cb, 0, sizeof(cb_saved)); - /* Pass parameters to the BPF program */ - cb->qdisc_cb.flow_keys = &flow_keys; - flow_keys.nhoff = nhoff; - flow_keys.thoff = nhoff; - - bpf_compute_data_pointers((struct sk_buff *)skb); - result = BPF_PROG_RUN(attached, skb); - - /* Restore state */ - memcpy(cb, &cb_saved, sizeof(cb_saved)); - - flow_keys.nhoff = clamp_t(u16, flow_keys.nhoff, 0, skb->len); - flow_keys.thoff = clamp_t(u16, flow_keys.thoff, - flow_keys.nhoff, skb->len); - - __skb_flow_bpf_to_target(&flow_keys, flow_dissector, - target_container); + if (attached) { + ret = __skb_flow_bpf_dissect(attached, skb, + flow_dissector, + &flow_keys); + __skb_flow_bpf_to_target(&flow_keys, flow_dissector, + target_container); + rcu_read_unlock(); + return ret; + } rcu_read_unlock(); - return result == BPF_OK; } - rcu_read_unlock(); if (dissector_uses_key(flow_dissector, FLOW_DISSECTOR_KEY_ETH_ADDRS)) { -- 2.20.1.321.g9e740568ce-goog