From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from out-188.mta0.migadu.com (out-188.mta0.migadu.com [91.218.175.188]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 545C318FDC5 for ; Wed, 29 Jan 2025 18:30:36 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=91.218.175.188 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1738175438; cv=none; b=aQ2OlMSIlDqu8YJuJ08XvbjVNsa4CL00/6FwoG/sDaSPQZji2aZy2eL3M1DA2l/9L8B9FQkwdwunlvVLjGn8dhdIaUgDJSiBY7Pti08TDQ8N7oaW6X/Qn2hF5PanK0yK4+eC4d7SdIpQM9bf+lSg4aXHFz5HE5rlBrFbrf0s2wQ= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1738175438; c=relaxed/simple; bh=aRmCXbRm9LVQiaJHv7N+IutALXTUthJIKfdF6B8xQ0k=; h=Message-ID:Date:MIME-Version:Subject:To:Cc:References:From: In-Reply-To:Content-Type; b=UrKfyebx1MMTz7wgqUcSOtBYu5F1J6SI7WjBF5Sjg5HW1N6fkBStV+2TxQplMriA55u90YnX0kRHXbE8A53nUFYqmLwBQz5d02wPiIBdHBh3oowTnVjWAVH8x23mdH4LRhKPPCUQ2zk+kxjjdnkATNbuUwThCBVuC5+cAdBae2k= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.dev; spf=pass smtp.mailfrom=linux.dev; dkim=pass (1024-bit key) header.d=linux.dev header.i=@linux.dev header.b=dJ3wiC1j; arc=none smtp.client-ip=91.218.175.188 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.dev Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=linux.dev Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=linux.dev header.i=@linux.dev header.b="dJ3wiC1j" Message-ID: <62763929-9707-4633-9d22-a8d803e34129@linux.dev> DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.dev; s=key1; t=1738175429; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=DC5mSX1scPzLqQhPZMoFaLE7gVR7wl17e3VXhb1nCcs=; b=dJ3wiC1jUCM+jIrMPPSVCVBXT8H2meKBINxgowN7rEf702rRQOehKgUgKVOjspIfKr8mIE cMtA8CM5RP7EazpkNDSTNLf3jezuKp+SYWn1aSGjdczevFPr3j+mnsmO6ZZyaDlmSQb2jj PhEgYqfp/WYBPXtC4Cbs73TZWaPNO2k= Date: Wed, 29 Jan 2025 19:30:27 +0100 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Subject: Re: [PATCH 3/6] RDMA/rxe: switch to using the crc32 library To: Eric Biggers , linux-rdma@vger.kernel.org, Mustafa Ismail , Tatyana Nikolova , Jason Gunthorpe , Leon Romanovsky , Zhu Yanjun , Bernard Metzler Cc: linux-kernel@vger.kernel.org References: <20250127223840.67280-1-ebiggers@kernel.org> <20250127223840.67280-4-ebiggers@kernel.org> X-Report-Abuse: Please report any abuse attempt to abuse@migadu.com and include these headers. From: Zhu Yanjun In-Reply-To: <20250127223840.67280-4-ebiggers@kernel.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Migadu-Flow: FLOW_OUT 在 2025/1/27 23:38, Eric Biggers 写道: > From: Eric Biggers > > Now that the crc32() library function takes advantage of > architecture-specific optimizations, it is unnecessary to go through the > crypto API. Just use crc32(). This is much simpler, and it improves > performance due to eliminating the crypto API overhead. > > Signed-off-by: Eric Biggers After the patchset is applied, if the RXE can connect to MLX RDMA NIC successfully, I am fine with it. Reviewed-by: Zhu Yanjun Zhu Yanjun > --- > drivers/infiniband/sw/rxe/Kconfig | 3 +- > drivers/infiniband/sw/rxe/rxe.c | 3 -- > drivers/infiniband/sw/rxe/rxe.h | 1 - > drivers/infiniband/sw/rxe/rxe_icrc.c | 61 ++------------------------- > drivers/infiniband/sw/rxe/rxe_loc.h | 1 - > drivers/infiniband/sw/rxe/rxe_req.c | 1 - > drivers/infiniband/sw/rxe/rxe_verbs.c | 4 -- > drivers/infiniband/sw/rxe/rxe_verbs.h | 1 - > 8 files changed, 5 insertions(+), 70 deletions(-) > > diff --git a/drivers/infiniband/sw/rxe/Kconfig b/drivers/infiniband/sw/rxe/Kconfig > index 06b8dc5093f77..c180e7ebcfc5b 100644 > --- a/drivers/infiniband/sw/rxe/Kconfig > +++ b/drivers/infiniband/sw/rxe/Kconfig > @@ -2,12 +2,11 @@ > config RDMA_RXE > tristate "Software RDMA over Ethernet (RoCE) driver" > depends on INET && PCI && INFINIBAND > depends on INFINIBAND_VIRT_DMA > select NET_UDP_TUNNEL > - select CRYPTO > - select CRYPTO_CRC32 > + select CRC32 > help > This driver implements the InfiniBand RDMA transport over > the Linux network stack. It enables a system with a > standard Ethernet adapter to interoperate with a RoCE > adapter or with another system running the RXE driver. > diff --git a/drivers/infiniband/sw/rxe/rxe.c b/drivers/infiniband/sw/rxe/rxe.c > index 1ba4a0c8726ae..f8ac79ef70143 100644 > --- a/drivers/infiniband/sw/rxe/rxe.c > +++ b/drivers/infiniband/sw/rxe/rxe.c > @@ -29,13 +29,10 @@ void rxe_dealloc(struct ib_device *ib_dev) > rxe_pool_cleanup(&rxe->mr_pool); > rxe_pool_cleanup(&rxe->mw_pool); > > WARN_ON(!RB_EMPTY_ROOT(&rxe->mcg_tree)); > > - if (rxe->tfm) > - crypto_free_shash(rxe->tfm); > - > mutex_destroy(&rxe->usdev_lock); > } > > /* initialize rxe device parameters */ > static void rxe_init_device_param(struct rxe_dev *rxe) > diff --git a/drivers/infiniband/sw/rxe/rxe.h b/drivers/infiniband/sw/rxe/rxe.h > index fe7f970667325..8db65731499d0 100644 > --- a/drivers/infiniband/sw/rxe/rxe.h > +++ b/drivers/infiniband/sw/rxe/rxe.h > @@ -19,11 +19,10 @@ > #include > #include > #include > #include > #include > -#include > > #include "rxe_net.h" > #include "rxe_opcode.h" > #include "rxe_hdr.h" > #include "rxe_param.h" > diff --git a/drivers/infiniband/sw/rxe/rxe_icrc.c b/drivers/infiniband/sw/rxe/rxe_icrc.c > index c7b0b4673b959..63d03f0f71e38 100644 > --- a/drivers/infiniband/sw/rxe/rxe_icrc.c > +++ b/drivers/infiniband/sw/rxe/rxe_icrc.c > @@ -7,62 +7,10 @@ > #include > > #include "rxe.h" > #include "rxe_loc.h" > > -/** > - * rxe_icrc_init() - Initialize crypto function for computing crc32 > - * @rxe: rdma_rxe device object > - * > - * Return: 0 on success else an error > - */ > -int rxe_icrc_init(struct rxe_dev *rxe) > -{ > - struct crypto_shash *tfm; > - > - tfm = crypto_alloc_shash("crc32", 0, 0); > - if (IS_ERR(tfm)) { > - rxe_dbg_dev(rxe, "failed to init crc32 algorithm err: %ld\n", > - PTR_ERR(tfm)); > - return PTR_ERR(tfm); > - } > - > - rxe->tfm = tfm; > - > - return 0; > -} > - > -/** > - * rxe_crc32() - Compute cumulative crc32 for a contiguous segment > - * @rxe: rdma_rxe device object > - * @crc: starting crc32 value from previous segments > - * @next: starting address of current segment > - * @len: length of current segment > - * > - * Return: the cumulative crc32 checksum > - */ > -static u32 rxe_crc32(struct rxe_dev *rxe, u32 crc, void *next, size_t len) > -{ > - u32 icrc; > - int err; > - > - SHASH_DESC_ON_STACK(shash, rxe->tfm); > - > - shash->tfm = rxe->tfm; > - *(u32 *)shash_desc_ctx(shash) = crc; > - err = crypto_shash_update(shash, next, len); > - if (unlikely(err)) { > - rxe_dbg_dev(rxe, "failed crc calculation, err: %d\n", err); > - return crc32_le(crc, next, len); > - } > - > - icrc = *(u32 *)shash_desc_ctx(shash); > - barrier_data(shash_desc_ctx(shash)); > - > - return icrc; > -} > - > /** > * rxe_icrc() - Compute the ICRC of a packet > * @skb: packet buffer > * @pkt: packet information > * > @@ -117,19 +65,18 @@ static u32 rxe_icrc(struct sk_buff *skb, struct rxe_pkt_info *pkt) > > /* exclude bth.resv8a */ > bth->qpn |= cpu_to_be32(~BTH_QPN_MASK); > > /* Update the CRC with the first part of the headers. */ > - crc = rxe_crc32(pkt->rxe, crc, pshdr, hdr_size + RXE_BTH_BYTES); > + crc = crc32(crc, pshdr, hdr_size + RXE_BTH_BYTES); > > /* Update the CRC with the remainder of the headers. */ > - crc = rxe_crc32(pkt->rxe, crc, pkt->hdr + RXE_BTH_BYTES, > - rxe_opcode[pkt->opcode].length - RXE_BTH_BYTES); > + crc = crc32(crc, pkt->hdr + RXE_BTH_BYTES, > + rxe_opcode[pkt->opcode].length - RXE_BTH_BYTES); > > /* Update the CRC with the payload. */ > - crc = rxe_crc32(pkt->rxe, crc, payload_addr(pkt), > - payload_size(pkt) + bth_pad(pkt)); > + crc = crc32(crc, payload_addr(pkt), payload_size(pkt) + bth_pad(pkt)); > > /* Invert the CRC and return it. */ > return ~crc; > } > > diff --git a/drivers/infiniband/sw/rxe/rxe_loc.h b/drivers/infiniband/sw/rxe/rxe_loc.h > index ded46119151bb..c57ab8975c5d1 100644 > --- a/drivers/infiniband/sw/rxe/rxe_loc.h > +++ b/drivers/infiniband/sw/rxe/rxe_loc.h > @@ -166,11 +166,10 @@ int rxe_completer(struct rxe_qp *qp); > int rxe_requester(struct rxe_qp *qp); > int rxe_sender(struct rxe_qp *qp); > int rxe_receiver(struct rxe_qp *qp); > > /* rxe_icrc.c */ > -int rxe_icrc_init(struct rxe_dev *rxe); > int rxe_icrc_check(struct sk_buff *skb, struct rxe_pkt_info *pkt); > void rxe_icrc_generate(struct sk_buff *skb, struct rxe_pkt_info *pkt); > > void rxe_resp_queue_pkt(struct rxe_qp *qp, struct sk_buff *skb); > > diff --git a/drivers/infiniband/sw/rxe/rxe_req.c b/drivers/infiniband/sw/rxe/rxe_req.c > index 87a02f0deb000..9d0392df8a92f 100644 > --- a/drivers/infiniband/sw/rxe/rxe_req.c > +++ b/drivers/infiniband/sw/rxe/rxe_req.c > @@ -3,11 +3,10 @@ > * Copyright (c) 2016 Mellanox Technologies Ltd. All rights reserved. > * Copyright (c) 2015 System Fabric Works, Inc. All rights reserved. > */ > > #include > -#include > > #include "rxe.h" > #include "rxe_loc.h" > #include "rxe_queue.h" > > diff --git a/drivers/infiniband/sw/rxe/rxe_verbs.c b/drivers/infiniband/sw/rxe/rxe_verbs.c > index 6152a0fdfc8ca..c05379f8b4f57 100644 > --- a/drivers/infiniband/sw/rxe/rxe_verbs.c > +++ b/drivers/infiniband/sw/rxe/rxe_verbs.c > @@ -1531,14 +1531,10 @@ int rxe_register_device(struct rxe_dev *rxe, const char *ibdev_name, > ib_set_device_ops(dev, &rxe_dev_ops); > err = ib_device_set_netdev(&rxe->ib_dev, ndev, 1); > if (err) > return err; > > - err = rxe_icrc_init(rxe); > - if (err) > - return err; > - > err = ib_register_device(dev, ibdev_name, NULL); > if (err) > rxe_dbg_dev(rxe, "failed with error %d\n", err); > > /* > diff --git a/drivers/infiniband/sw/rxe/rxe_verbs.h b/drivers/infiniband/sw/rxe/rxe_verbs.h > index 6573ceec0ef58..6e31134a5fa5b 100644 > --- a/drivers/infiniband/sw/rxe/rxe_verbs.h > +++ b/drivers/infiniband/sw/rxe/rxe_verbs.h > @@ -400,11 +400,10 @@ struct rxe_dev { > u64 mmap_offset; > > atomic64_t stats_counters[RXE_NUM_OF_COUNTERS]; > > struct rxe_port port; > - struct crypto_shash *tfm; > }; > > static inline struct net_device *rxe_ib_device_get_netdev(struct ib_device *dev) > { > return ib_device_get_netdev(dev, RXE_PORT);