From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.6 required=3.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,MAILING_LIST_MULTI,MENTIONS_GIT_HOSTING, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id E27DDC3A5A1 for ; Thu, 22 Aug 2019 17:21:57 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id B202B233FC for ; Thu, 22 Aug 2019 17:21:57 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1566494517; bh=G6nwL4nzL2qmjwMsCq9q4a0gcrBClCmWuMFXQVcMo6g=; h=Date:From:To:Cc:Subject:References:In-Reply-To:List-ID:From; b=VXUdgLxzgTK4T9KP1uBOJzBhQINlRqPoWRBKkBAIkQaQ4kftpbU/cVBnxzbctwuj3 JrRMMvMjE6yWyruWAgPfWbw+hQXwL+LENzizKjhLnWJ4fYqhVnqzTDC6rl+1fADZNr qVJighoYmr+O/IDAImA6zUKriYa3x+yxpbVQckPQ= Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1730610AbfHVRV5 (ORCPT ); Thu, 22 Aug 2019 13:21:57 -0400 Received: from mail.kernel.org ([198.145.29.99]:39830 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1729455AbfHVRV5 (ORCPT ); Thu, 22 Aug 2019 13:21:57 -0400 Received: from localhost (wsip-184-188-36-2.sd.sd.cox.net [184.188.36.2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 09BE72089E; Thu, 22 Aug 2019 17:21:56 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1566494516; bh=G6nwL4nzL2qmjwMsCq9q4a0gcrBClCmWuMFXQVcMo6g=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=blIcymj7lTeMsnbhyKe7LF5B+zvaT3HUCDOcbxBgcMgKxb8kN6F+Yi/gDU87NoF1i yaVMoazklEfTPTbxopIFpbkkR3TA3UduYmbkvX7E+R7YP7VKU9nJEVawWy7EDIQ6qe GpdrKptoI8F5/OtoT9PPrvHV+nx2KxrpEPcGs7mc= Date: Thu, 22 Aug 2019 20:21:55 +0300 From: Leon Romanovsky To: Marcin Mielniczuk Cc: Krishnamraju Eraparaju , linux-rdma@vger.kernel.org Subject: Re: Setting up siw devices Message-ID: <20190822172155.GL29433@mtr-leonro.mtl.com> References: <421f6635-e69c-623d-746a-df541c27f428@golem.network> <20190822154323.GA19899@chelsio.com> <20190822155228.GH29433@mtr-leonro.mtl.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.12.1 (2019-06-15) Sender: linux-rdma-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-rdma@vger.kernel.org On Thu, Aug 22, 2019 at 07:05:12PM +0200, Marcin Mielniczuk wrote: > Thanks a lot, this did the trick. I think this is worth documenting > somewhere that this step is needed. > I'll make a PR, would README.md in the rdma-core repo be a good place? I'm not so sure, but it is better to have in some place instead of not having at all. > > Does have any significance? I did: > >      sudo rdma link add siw0 type siw netdev enpXsYYfZ > > but the resulting device is called iwpXsYYfZ. I couldn't find a trace of > `siw0` anywhere. I would say that it is a bug in kernel part of SIW, because kernel rename (the thing which change your siw0 to be iw* name) is looking for absence of mentioning PCI inside of /sys/class/infiniband/siw0/* https://github.com/linux-rdma/rdma-core/blob/master/kernel-boot/rdma_rename.c#L378 That rdma-core line works for RXE and SIW should be similar. Thanks > > On 22.08.2019 17:52, Leon Romanovsky wrote: > > On Thu, Aug 22, 2019 at 09:13:25PM +0530, Krishnamraju Eraparaju wrote: > >> On Thursday, August 08/22/19, 2019 at 17:08:49 +0200, Marcin Mielniczuk wrote: > >>> Hi, > >>> > >>> I'm trying to test the recently merged siw module. > >>> I'm running kernel 5.3-rc5 (taken from the Ubuntu mainline-kernel > >>> repository [1]) on Ubuntu 18.04 (bionic). > >>> I also manually installed rdma-core 25.0 from tarball, using the > >>> included Debian packaging. I installed all the packages but ibacm. > >>> > >>> After booting the new kernel I manually loaded the kernel module by > >>> > >>>      modprobe siw > >>>      modprobe rdma_ucm > >>> > >>> Then ibv_devinfo shows: "No IB devices found". > >>> dmesg only shows: > >>>      [   29.856751] SoftiWARP attached > >>> > >>> According to this tutorial, [2] it should be enough to just load the siw > >>> module. (unlike RXE, where one needs to use rxe_cfg to set up the > >>> interface) > >>> Is this a bug in siw or just a configuration issue on my side? > >> Have you done "rdma link"? > >> > >> rdma link add type siw netdev > >> > >> http://man7.org/linux/man-pages/man8/rdma-link.8.html > > BTW, the same goes for RXE and rxe_cfg is discouraged. > > > > Thanks > > > >>> Thanks, > >>> Marcin > >>> > >>> [1] https://kernel.ubuntu.com/~kernel-ppa/mainline/v5.3-rc5/ > >>> [2] https://budevg.github.io/posts/tutorials/2017/04/29/rdma-101-1.html > >>> > >> > >