From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-5.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 44631C07E9C for ; Tue, 6 Jul 2021 17:59:39 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 25F1A61C4B for ; Tue, 6 Jul 2021 17:59:39 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230222AbhGFSCQ (ORCPT ); Tue, 6 Jul 2021 14:02:16 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:50922 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229834AbhGFSCQ (ORCPT ); Tue, 6 Jul 2021 14:02:16 -0400 Received: from mail-qk1-x732.google.com (mail-qk1-x732.google.com [IPv6:2607:f8b0:4864:20::732]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 7E05DC061760 for ; Tue, 6 Jul 2021 10:59:37 -0700 (PDT) Received: by mail-qk1-x732.google.com with SMTP id q190so21036550qkd.2 for ; Tue, 06 Jul 2021 10:59:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ziepe.ca; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=QafN6h6Co6NuKaJg6KsXY/qvYmait2ZxGzl1LH+hKGc=; b=o+6yrnhyDXWJv8oLffV4OzrBks140sBzkKRa/BHDPAgco6gkcsk/KfM0urmbG1ZpZp aNfP9t5Y248cSGYMNP5udtisN7IexW8dI/evhDcabpX78aqPc3z4PUkjqOFT88k3q2UU VMDnrscsVmrIJXOn1Tl4GknyaQqnihC5TNeBzt7oxN9cnepeiC33KAZ1WQv24bEg5Ptl wh50zYlI3opLL0jj7l3ICvX3darwow+ATpP8HNytVg4jpuzFtVevfPbuvYAuE+UIH3oi 0+6FwhgS8LlAzXLg8Hrg7kDb7r475k6OOP9fsruyXhd5J6BvIkWbmMJ01HjVqF1+s9dG KB4A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=QafN6h6Co6NuKaJg6KsXY/qvYmait2ZxGzl1LH+hKGc=; b=YLdy6WrCZjtES3e+/Je7Se8MOLU2h6oxX6obF5R++HAvUe1M/H44smw81I0YhibVlh IFHe96QJbME5Q0MJ71ioniSC1Rfxjraiq0Ry5S2wuY6Mj/XIYyBmfsIwPtbIeaHWPsUL 3y4Qcouwxir7IERZeqxVMlsvQhL44W9kbTHyNTcQVzFN9X7XxmcyEamts/TiKcYIujQG ahVTM9XzK49q9gSRTgtHJY//1X5imK/Iel8e3uWusiyyY3uC93g9+ClJry/RQh/r+66F mFEPnT2pyLFJ4Q800T0gQWrYzovHsa3UfOI3ox8ZnN0jGrE5jltfTk0O3dLwzHFvu6CS gU0w== X-Gm-Message-State: AOAM530FDoD5/KrImh7ZRZGpiBhUo8h3I0v/xNh6VvgYFC4u+Gxt7Q3g jiEF7Wbo8cRL27gUEBnfIAldaw== X-Google-Smtp-Source: ABdhPJyVxfP24yiWMaxghSmvMQwbby4otQnbgBhcVo8qVKROchOHAE6ChpAWAzTpF2fYkJyDXgbw1w== X-Received: by 2002:a37:c448:: with SMTP id h8mr10568428qkm.191.1625594376601; Tue, 06 Jul 2021 10:59:36 -0700 (PDT) Received: from ziepe.ca ([206.223.160.26]) by smtp.gmail.com with ESMTPSA id 16sm5697170qty.15.2021.07.06.10.59.36 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 06 Jul 2021 10:59:36 -0700 (PDT) Received: from jgg by mlx with local (Exim 4.94) (envelope-from ) id 1m0pM7-004W2s-6g; Tue, 06 Jul 2021 14:59:35 -0300 Date: Tue, 6 Jul 2021 14:59:35 -0300 From: Jason Gunthorpe To: Christoph Hellwig Cc: Daniel Vetter , Oded Gabbay , Oded Gabbay , "Linux-Kernel@Vger. Kernel. Org" , Greg Kroah-Hartman , Sumit Semwal , Christian =?utf-8?B?S8O2bmln?= , Gal Pressman , sleybo@amazon.com, Maling list - DRI developers , linux-rdma , Linux Media Mailing List , Doug Ledford , Dave Airlie , Alex Deucher , Leon Romanovsky , amd-gfx list , "moderated list:DMA BUFFER SHARING FRAMEWORK" Subject: Re: [PATCH v4 0/2] Add p2p via dmabuf to habanalabs Message-ID: <20210706175935.GS4604@ziepe.ca> References: <20210706142357.GN4604@ziepe.ca> <20210706152542.GP4604@ziepe.ca> <20210706172828.GR4604@ziepe.ca> <20210706173137.GA7840@lst.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20210706173137.GA7840@lst.de> Precedence: bulk List-ID: X-Mailing-List: linux-rdma@vger.kernel.org On Tue, Jul 06, 2021 at 07:31:37PM +0200, Christoph Hellwig wrote: > On Tue, Jul 06, 2021 at 02:28:28PM -0300, Jason Gunthorpe wrote: > > > Also on your claim that drivers/gpu is a non-upstream disaster: I've > > > also learned that that for drivers/rdma there's the upstream driver, > > > and then there's the out-of-tree hackjob the vendor actually > > > supports. > > > > In the enterprise world everyone has their out of tree backport > > drivers. It varies on the vendor how much deviation there is from the > > upstream driver and what commercial support relationship the vendor > > has with the enterprise distros. > > I think he means the Mellanox OFED stack, which is a complete and utter > mess and which gets force fed by Mellanox/Nvidia on unsuspecting > customers. I know many big HPC sites that ignore it, but a lot of > enterprise customers are dumb enought to deploy it. No, I don't think so. While MOFED is indeed a giant mess, the mlx5 upstream driver is not some token effort to generate good will and Mellanox certainly does provide full commercial support for the mlx5 drivers shipped inside various enterprise distros. MOFED also doesn't have a big functional divergance from RDMA upstream, and it is not mandatory just to use the hardware. I can not say the same about other company's RDMA driver distributions, Daniel's description of "minimal effort to get goodwill" would match others much better. You are right that there are a lot of enterprise customers who deploy the MOFED. I can't agree with their choices, but they are not forced into using it anymore. Jason