From mboxrd@z Thu Jan 1 00:00:00 1970 From: Xiaozhou Li Subject: Performance issues with Mellanox Connectx-3 EN Date: Wed, 12 Aug 2015 18:20:25 -0500 Message-ID: Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 To: dev@dpdk.org Return-path: Received: from yellowcard.cs.princeton.edu (yellowcard.CS.Princeton.EDU [128.112.136.66]) by dpdk.org (Postfix) with ESMTP id 10E6F6A80 for ; Thu, 13 Aug 2015 01:20:42 +0200 (CEST) Received: from mail-io0-f179.google.com (mail-io0-f179.google.com [209.85.223.179]) (authenticated bits=0) by yellowcard.cs.princeton.edu (8.14.4/8.14.4) with ESMTP id t7CNKdkn032625 (version=TLSv1/SSLv3 cipher=AES128-GCM-SHA256 bits=128 verify=NOT) for ; Wed, 12 Aug 2015 19:20:42 -0400 Received: by iods203 with SMTP id s203so36066898iod.0 for ; Wed, 12 Aug 2015 16:20:39 -0700 (PDT) List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Hi folks, I am getting performance scalability issues with DPDK on Mellanox Connectx-3 . Each of our machine has 16 cores and a single-port 40G Mellanox Connectx-3 EN. We find out the server throughput *does not scale* with number of cores. With a single thread on one core, we can get about 2 Mpps with a simple echo server implementation. However, the performance number does not increase as we use more cores. Our implementation is based on the l2fwd example. I'd greatly appreciate it if anyone could provide some insights on what might be the problem and how can we improve the performance with Mellanox Connectx-3 EN. Thanks! Best, Xiaozhou