From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-1.0 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_PASS,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 90174C169C4 for ; Wed, 6 Feb 2019 19:50:04 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 592472083B for ; Wed, 6 Feb 2019 19:50:04 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726624AbfBFTuD (ORCPT ); Wed, 6 Feb 2019 14:50:03 -0500 Received: from mx1.redhat.com ([209.132.183.28]:55640 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726022AbfBFTuD (ORCPT ); Wed, 6 Feb 2019 14:50:03 -0500 Received: from smtp.corp.redhat.com (int-mx08.intmail.prod.int.phx2.redhat.com [10.5.11.23]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id BC6D299C4B; Wed, 6 Feb 2019 19:50:02 +0000 (UTC) Received: from carbon (ovpn-200-42.brq.redhat.com [10.40.200.42]) by smtp.corp.redhat.com (Postfix) with ESMTP id 7C03B45A8; Wed, 6 Feb 2019 19:49:58 +0000 (UTC) Date: Wed, 6 Feb 2019 20:49:56 +0100 From: Jesper Dangaard Brouer To: Ioana Ciocoi Radulescu Cc: Ilias Apalodimas , "netdev@vger.kernel.org" , "davem@davemloft.net" , Ioana Ciornei , brouer@redhat.com Subject: Re: [PATCH net-next 1/4] dpaa2-eth: Use a single page per Rx buffer Message-ID: <20190206204956.533326c2@carbon> In-Reply-To: References: <1549299625-28399-1-git-send-email-ruxandra.radulescu@nxp.com> <1549299625-28399-2-git-send-email-ruxandra.radulescu@nxp.com> <20190205093513.GA31466@apalos> MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.84 on 10.5.11.23 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.38]); Wed, 06 Feb 2019 19:50:03 +0000 (UTC) Sender: netdev-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: netdev@vger.kernel.org On Wed, 6 Feb 2019 15:36:33 +0000 Ioana Ciocoi Radulescu wrote: > > From: Ilias Apalodimas > > > > Can you share any results on XDP (XDP_DROP is usually useful for the > > hardware capabilities). > > XDP numbers are pretty much the same as before this patch: > > On a LS2088A with A72 cores @2GHz (numbers in Mpps): > 1core 8cores > ------------------------------------------------------------------------- > XDP_DROP (no touching data) 5.37 29.6 (linerate) > XDP_DROP (xdp1 sample) 3.14 24.22 It is interesting/problematic to see that the cost of touching the data is so high 5.37Mpps -> 3.14Mpps. The Intel CPUs have solved this in hardware with DDIO, which delivers frame in L3-cache. I have some ideas on how to improve this on ARM (or CPUs without DDIO). I've previous implemented this as RFC on mlx4 tested on a CPU without DDIO, with great success 10mpps -> 20Mpps (but it was shutdown, as newer Intel HW solved the issue). The basic idea is to have an array of frames, that you start an L2/L3-prefetch on, before going "back" and process them for XDP or netstack. (p.s. this is the same DPDK does) --Jesper