From: Yuval Shaia <yuval.shaia-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
To: Zhu Yanjun <yanjun.zhu-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
Cc: monis-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org,
dledford-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org,
jgg-uk2M96/98Pc@public.gmane.org,
linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
Subject: Re: [PATCHv2 1/1] IB/rxe: remove unnecessary skb_clone
Date: Tue, 13 Feb 2018 13:21:25 +0200 [thread overview]
Message-ID: <20180213112124.GA6991@yuvallap> (raw)
In-Reply-To: <1518508786-3204-1-git-send-email-yanjun.zhu-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
On Tue, Feb 13, 2018 at 02:59:46AM -0500, Zhu Yanjun wrote:
> In send_atomic_ack function, it is not necessary make a
s/make/to make
> skb_clone. To gain better performance(high throughput and
s/e(h/e (h
> low latency), this skb_clone is removed.
>
> The following tests are made.
>
> server client
> --------- ---------
> |1.1.1.1|<----rxe-channel--->|1.1.1.2|
> --------- ---------
>
> On server: rping -s -a 1.1.1.1 -v -C 1000 -S 512
> On client: rping -c -a 1.1.1.1 -v -C 1000 -S 512
>
> The kernel config CONFIG_DEBUG_KMEMLEAK is enabled on both server
> and client.
>
> This test runs for several hours. There is no memory leak and the whole
> system can work well.
>
> As the above network, the following tests are made.
>
> Server: ibv_rc_pingpong -d rxe0 -g 1
> Client: ibv_rc_pingpong -d rxe0 -g 1 1.1.1.1
>
> The result on Server(10 tests are made).
> Before:
> Throughput is 137.07 Mbit/sec
> Latency is 517.76 usec/iter
>
> After:
> Throughput is 148.85 Mbit/sec
> Latency is 476.64 usec/iter
>
> The throughput is enhanced and the latency is reduced.
>
> CC: Srinivas Eeda <srinivas.eeda-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
> CC: Junxiao Bi <junxiao.bi-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
> Signed-off-by: Zhu Yanjun <yanjun.zhu-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
> ---
> V1-->V2: 10 tests are made. From throughput and latency, the performance is better.
> ---
> drivers/infiniband/sw/rxe/rxe_resp.c | 15 ++-------------
> 1 file changed, 2 insertions(+), 13 deletions(-)
>
> diff --git a/drivers/infiniband/sw/rxe/rxe_resp.c b/drivers/infiniband/sw/rxe/rxe_resp.c
> index d37bb9b..6d01d16 100644
> --- a/drivers/infiniband/sw/rxe/rxe_resp.c
> +++ b/drivers/infiniband/sw/rxe/rxe_resp.c
> @@ -969,7 +969,6 @@ static int send_atomic_ack(struct rxe_qp *qp, struct rxe_pkt_info *pkt,
> int rc = 0;
> struct rxe_pkt_info ack_pkt;
> struct sk_buff *skb;
> - struct sk_buff *skb_copy;
> struct rxe_dev *rxe = to_rdev(qp->ibqp.device);
> struct resp_res *res;
>
> @@ -981,15 +980,6 @@ static int send_atomic_ack(struct rxe_qp *qp, struct rxe_pkt_info *pkt,
> goto out;
> }
>
> - skb_copy = skb_clone(skb, GFP_ATOMIC);
> - if (skb_copy)
> - rxe_add_ref(qp); /* for the new SKB */
Are you sure we don't need this?
> - else {
> - pr_warn("Could not clone atomic response\n");
> - rc = -ENOMEM;
> - goto out;
> - }
> -
> res = &qp->resp.resources[qp->resp.res_head];
> free_rd_atomic_resource(qp, res);
> rxe_advance_resp_resource(qp);
> @@ -998,17 +988,16 @@ static int send_atomic_ack(struct rxe_qp *qp, struct rxe_pkt_info *pkt,
> memset((unsigned char *)SKB_TO_PKT(skb) + sizeof(ack_pkt), 0,
> sizeof(skb->cb) - sizeof(ack_pkt));
>
> + refcount_inc(&skb->users);
> res->type = RXE_ATOMIC_MASK;
> res->atomic.skb = skb;
> res->first_psn = ack_pkt.psn;
> res->last_psn = ack_pkt.psn;
> res->cur_psn = ack_pkt.psn;
>
> - rc = rxe_xmit_packet(rxe, qp, &ack_pkt, skb_copy);
> + rc = rxe_xmit_packet(rxe, qp, &ack_pkt, skb);
> if (rc) {
> pr_err_ratelimited("Failed sending ack\n");
> - rxe_drop_ref(qp);
> - kfree_skb(skb_copy);
> }
With this modification suggesting to remove the curly braces.
>
> out:
> --
> 2.7.4
>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
> the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
next prev parent reply other threads:[~2018-02-13 11:21 UTC|newest]
Thread overview: 8+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-01-05 8:19 [PATCH 1/1] IB/rxe: remove unnecessary skb_clone in xmit Zhu Yanjun
[not found] ` <1515140391-24752-1-git-send-email-yanjun.zhu-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2018-02-13 7:59 ` [PATCHv2 1/1] IB/rxe: remove unnecessary skb_clone Zhu Yanjun
[not found] ` <1518508786-3204-1-git-send-email-yanjun.zhu-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2018-02-13 11:21 ` Yuval Shaia [this message]
2018-02-14 10:30 ` Yanjun Zhu
[not found] ` <5779a11b-d0f2-3231-a63f-009b1f080fb8-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2018-02-14 10:36 ` Yuval Shaia
2018-02-17 0:48 ` Yanjun Zhu
2018-02-18 8:12 ` Yonatan Cohen
2018-02-14 10:36 ` [PATCHv3 " Zhu Yanjun
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20180213112124.GA6991@yuvallap \
--to=yuval.shaia-qhclzuegtsvqt0dzr+alfa@public.gmane.org \
--cc=dledford-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org \
--cc=jgg-uk2M96/98Pc@public.gmane.org \
--cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=monis-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org \
--cc=yanjun.zhu-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox