From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.4 required=3.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH, MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 490DEC606B0 for ; Tue, 9 Jul 2019 09:03:07 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 0790C216C4 for ; Tue, 9 Jul 2019 09:03:07 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=amazon.com header.i=@amazon.com header.b="tNp16O5O" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726047AbfGIJDG (ORCPT ); Tue, 9 Jul 2019 05:03:06 -0400 Received: from smtp-fw-33001.amazon.com ([207.171.190.10]:2843 "EHLO smtp-fw-33001.amazon.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725985AbfGIJDG (ORCPT ); Tue, 9 Jul 2019 05:03:06 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amazon.com; i=@amazon.com; q=dns/txt; s=amazon201209; t=1562662983; x=1594198983; h=subject:to:cc:references:from:message-id:date: mime-version:in-reply-to:content-transfer-encoding; bh=z45SGeJ4QK5ENsEwNAvIn+nkO8FnF/WVnqKYAkzY+hg=; b=tNp16O5OczS/nG9M0lUlBhAmuRd7qWMZT60rdgNFNSEoHxi8DigCHtiQ LN59GNYwuUEZzc9tvmSFlYxMOoZ6nZYGIWUzU8hSoC8NuVDQR7qRnAYaC 3GK7MYe95TxFCUz4nRBacmEEy82Yr23o5dNCFP3vtCgW7AdoRweT9ubC9 c=; X-IronPort-AV: E=Sophos;i="5.62,470,1554768000"; d="scan'208";a="810130510" Received: from sea3-co-svc-lb6-vlan3.sea.amazon.com (HELO email-inbound-relay-2b-4e24fd92.us-west-2.amazon.com) ([10.47.22.38]) by smtp-border-fw-out-33001.sea14.amazon.com with ESMTP; 09 Jul 2019 09:02:57 +0000 Received: from EX13MTAUEA001.ant.amazon.com (pdx4-ws-svc-p6-lb7-vlan2.pdx.amazon.com [10.170.41.162]) by email-inbound-relay-2b-4e24fd92.us-west-2.amazon.com (Postfix) with ESMTPS id 135CAA185E; Tue, 9 Jul 2019 09:02:57 +0000 (UTC) Received: from EX13D19EUB003.ant.amazon.com (10.43.166.69) by EX13MTAUEA001.ant.amazon.com (10.43.61.243) with Microsoft SMTP Server (TLS) id 15.0.1367.3; Tue, 9 Jul 2019 09:02:56 +0000 Received: from 8c85908914bf.ant.amazon.com (10.43.162.187) by EX13D19EUB003.ant.amazon.com (10.43.166.69) with Microsoft SMTP Server (TLS) id 15.0.1367.3; Tue, 9 Jul 2019 09:02:51 +0000 Subject: Re: [PATCH v5 rdma-next 2/6] RDMA/efa: Use the common mmap_xa helpers To: Michal Kalderon , , , , CC: , , References: <20190708091503.14723-1-michal.kalderon@marvell.com> <20190708091503.14723-3-michal.kalderon@marvell.com> From: Gal Pressman Message-ID: <0a28f174-1875-452e-ea0a-c8db2d243ce5@amazon.com> Date: Tue, 9 Jul 2019 12:02:46 +0300 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:60.0) Gecko/20100101 Thunderbird/60.7.2 MIME-Version: 1.0 In-Reply-To: <20190708091503.14723-3-michal.kalderon@marvell.com> Content-Type: text/plain; charset="utf-8" Content-Language: en-US Content-Transfer-Encoding: 7bit X-Originating-IP: [10.43.162.187] X-ClientProxiedBy: EX13D02UWC001.ant.amazon.com (10.43.162.243) To EX13D19EUB003.ant.amazon.com (10.43.166.69) Sender: netdev-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: netdev@vger.kernel.org On 08/07/2019 12:14, Michal Kalderon wrote: Hi, a few nits: > Remove the functions related to managing the mmap_xa database. > This code was copied to the ib_core. Use the common API's instead. > > Signed-off-by: Michal Kalderon > --- > drivers/infiniband/hw/efa/efa.h | 3 +- > drivers/infiniband/hw/efa/efa_main.c | 1 + > drivers/infiniband/hw/efa/efa_verbs.c | 183 ++++++++-------------------------- > 3 files changed, 42 insertions(+), 145 deletions(-) > diff --git a/drivers/infiniband/hw/efa/efa_verbs.c b/drivers/infiniband/hw/efa/efa_verbs.c > index df77bc312a25..5dff892da161 100644 > --- a/drivers/infiniband/hw/efa/efa_verbs.c > +++ b/drivers/infiniband/hw/efa/efa_verbs.c > @@ -13,34 +13,15 @@ > > #include "efa.h" > > -#define EFA_MMAP_FLAG_SHIFT 56 > -#define EFA_MMAP_PAGE_MASK GENMASK(EFA_MMAP_FLAG_SHIFT - 1, 0) > -#define EFA_MMAP_INVALID U64_MAX > - Don't delete the blank line please. > enum { > EFA_MMAP_DMA_PAGE = 0, > EFA_MMAP_IO_WC, > EFA_MMAP_IO_NC, > }; > - > #define EFA_AENQ_ENABLED_GROUPS \ > (BIT(EFA_ADMIN_FATAL_ERROR) | BIT(EFA_ADMIN_WARNING) | \ > BIT(EFA_ADMIN_NOTIFICATION) | BIT(EFA_ADMIN_KEEP_ALIVE)) > > -struct efa_mmap_entry { > - void *obj; > - u64 address; > - u64 length; > - u32 mmap_page; > - u8 mmap_flag; > -}; > - > -static inline u64 get_mmap_key(const struct efa_mmap_entry *efa) > -{ > - return ((u64)efa->mmap_flag << EFA_MMAP_FLAG_SHIFT) | > - ((u64)efa->mmap_page << PAGE_SHIFT); > -} > - > #define EFA_CHUNK_PAYLOAD_SHIFT 12 > #define EFA_CHUNK_PAYLOAD_SIZE BIT(EFA_CHUNK_PAYLOAD_SHIFT) > #define EFA_CHUNK_PAYLOAD_PTR_SIZE 8 > @@ -145,105 +126,7 @@ static void *efa_zalloc_mapped(struct efa_dev *dev, dma_addr_t *dma_addr, > return addr; > } > > -/* > - * This is only called when the ucontext is destroyed and there can be no > - * concurrent query via mmap or allocate on the xarray, thus we can be sure no > - * other thread is using the entry pointer. We also know that all the BAR > - * pages have either been zap'd or munmaped at this point. Normal pages are > - * refcounted and will be freed at the proper time. > - */ > -static void mmap_entries_remove_free(struct efa_dev *dev, > - struct efa_ucontext *ucontext) > -{ > - struct efa_mmap_entry *entry; > - unsigned long mmap_page; > > - xa_for_each(&ucontext->mmap_xa, mmap_page, entry) { > - xa_erase(&ucontext->mmap_xa, mmap_page); > - > - ibdev_dbg( > - &dev->ibdev, > - "mmap: obj[0x%p] key[%#llx] addr[%#llx] len[%#llx] removed\n", > - entry->obj, get_mmap_key(entry), entry->address, > - entry->length); > - if (entry->mmap_flag == EFA_MMAP_DMA_PAGE) > - /* DMA mapping is already gone, now free the pages */ > - free_pages_exact(phys_to_virt(entry->address), > - entry->length); > - kfree(entry); > - } > -} > - > -static struct efa_mmap_entry *mmap_entry_get(struct efa_dev *dev, > - struct efa_ucontext *ucontext, > - u64 key, u64 len) > -{ > - struct efa_mmap_entry *entry; > - u64 mmap_page; > - > - mmap_page = (key & EFA_MMAP_PAGE_MASK) >> PAGE_SHIFT; > - if (mmap_page > U32_MAX) > - return NULL; > - > - entry = xa_load(&ucontext->mmap_xa, mmap_page); > - if (!entry || get_mmap_key(entry) != key || entry->length != len) > - return NULL; > - > - ibdev_dbg(&dev->ibdev, > - "mmap: obj[0x%p] key[%#llx] addr[%#llx] len[%#llx] removed\n", > - entry->obj, key, entry->address, entry->length); > - > - return entry; > -} > - > -/* > - * Note this locking scheme cannot support removal of entries, except during > - * ucontext destruction when the core code guarentees no concurrency. > - */ > -static u64 mmap_entry_insert(struct efa_dev *dev, struct efa_ucontext *ucontext, > - void *obj, u64 address, u64 length, u8 mmap_flag) > -{ > - struct efa_mmap_entry *entry; > - u32 next_mmap_page; > - int err; > - > - entry = kmalloc(sizeof(*entry), GFP_KERNEL); > - if (!entry) > - return EFA_MMAP_INVALID; > - > - entry->obj = obj; > - entry->address = address; > - entry->length = length; > - entry->mmap_flag = mmap_flag; > - > - xa_lock(&ucontext->mmap_xa); > - if (check_add_overflow(ucontext->mmap_xa_page, > - (u32)(length >> PAGE_SHIFT), > - &next_mmap_page)) > - goto err_unlock; > - > - entry->mmap_page = ucontext->mmap_xa_page; > - ucontext->mmap_xa_page = next_mmap_page; > - err = __xa_insert(&ucontext->mmap_xa, entry->mmap_page, entry, > - GFP_KERNEL); > - if (err) > - goto err_unlock; > - > - xa_unlock(&ucontext->mmap_xa); > - > - ibdev_dbg( > - &dev->ibdev, > - "mmap: obj[0x%p] addr[%#llx], len[%#llx], key[%#llx] inserted\n", > - entry->obj, entry->address, entry->length, get_mmap_key(entry)); > - > - return get_mmap_key(entry); > - > -err_unlock: > - xa_unlock(&ucontext->mmap_xa); > - kfree(entry); > - return EFA_MMAP_INVALID; > - > -} > You left two extra blank lines between efa_zalloc_mapped and efa_query_device. > int efa_query_device(struct ib_device *ibdev, > struct ib_device_attr *props, > @@ -488,45 +371,52 @@ static int qp_mmap_entries_setup(struct efa_qp *qp, > struct efa_com_create_qp_params *params, > struct efa_ibv_create_qp_resp *resp) > { > + u64 address; > + u64 length; Line break. > /* > * Once an entry is inserted it might be mmapped, hence cannot be > * cleaned up until dealloc_ucontext. > */ > resp->sq_db_mmap_key = > - mmap_entry_insert(dev, ucontext, qp, > - dev->db_bar_addr + resp->sq_db_offset, > - PAGE_SIZE, EFA_MMAP_IO_NC); > - if (resp->sq_db_mmap_key == EFA_MMAP_INVALID) > + rdma_user_mmap_entry_insert(&ucontext->ibucontext, qp, > + dev->db_bar_addr + > + resp->sq_db_offset, > + PAGE_SIZE, EFA_MMAP_IO_NC); > + if (resp->sq_db_mmap_key == RDMA_USER_MMAP_INVALID) > return -ENOMEM; > > resp->sq_db_offset &= ~PAGE_MASK; > > + address = dev->mem_bar_addr + resp->llq_desc_offset; > + length = PAGE_ALIGN(params->sq_ring_size_in_bytes + > + (resp->llq_desc_offset & ~PAGE_MASK)); > resp->llq_desc_mmap_key = > - mmap_entry_insert(dev, ucontext, qp, > - dev->mem_bar_addr + resp->llq_desc_offset, > - PAGE_ALIGN(params->sq_ring_size_in_bytes + > - (resp->llq_desc_offset & ~PAGE_MASK)), > - EFA_MMAP_IO_WC); > - if (resp->llq_desc_mmap_key == EFA_MMAP_INVALID) > + rdma_user_mmap_entry_insert(&ucontext->ibucontext, qp, > + address, > + length, > + EFA_MMAP_IO_WC); > + if (resp->llq_desc_mmap_key == RDMA_USER_MMAP_INVALID) > return -ENOMEM; > > resp->llq_desc_offset &= ~PAGE_MASK; > > if (qp->rq_size) { > + address = dev->db_bar_addr + resp->rq_db_offset; > resp->rq_db_mmap_key = > - mmap_entry_insert(dev, ucontext, qp, > - dev->db_bar_addr + resp->rq_db_offset, > - PAGE_SIZE, EFA_MMAP_IO_NC); > - if (resp->rq_db_mmap_key == EFA_MMAP_INVALID) > + rdma_user_mmap_entry_insert(&ucontext->ibucontext, qp, > + address, PAGE_SIZE, > + EFA_MMAP_IO_NC); > + if (resp->rq_db_mmap_key == RDMA_USER_MMAP_INVALID) > return -ENOMEM; > > resp->rq_db_offset &= ~PAGE_MASK; > > + address = virt_to_phys(qp->rq_cpu_addr); > resp->rq_mmap_key = > - mmap_entry_insert(dev, ucontext, qp, > - virt_to_phys(qp->rq_cpu_addr), > - qp->rq_size, EFA_MMAP_DMA_PAGE); > - if (resp->rq_mmap_key == EFA_MMAP_INVALID) > + rdma_user_mmap_entry_insert(&ucontext->ibucontext, qp, > + address, qp->rq_size, > + EFA_MMAP_DMA_PAGE); > + if (resp->rq_mmap_key == RDMA_USER_MMAP_INVALID) > return -ENOMEM; > > resp->rq_mmap_size = qp->rq_size; > @@ -875,11 +765,13 @@ void efa_destroy_cq(struct ib_cq *ibcq, struct ib_udata *udata) > static int cq_mmap_entries_setup(struct efa_dev *dev, struct efa_cq *cq, > struct efa_ibv_create_cq_resp *resp) > { > + struct efa_ucontext *ucontext = cq->ucontext; Line break. > resp->q_mmap_size = cq->size; > - resp->q_mmap_key = mmap_entry_insert(dev, cq->ucontext, cq, > - virt_to_phys(cq->cpu_addr), > - cq->size, EFA_MMAP_DMA_PAGE); > - if (resp->q_mmap_key == EFA_MMAP_INVALID) > + resp->q_mmap_key = > + rdma_user_mmap_entry_insert(&ucontext->ibucontext, cq, > + virt_to_phys(cq->cpu_addr), > + cq->size, EFA_MMAP_DMA_PAGE); > + if (resp->q_mmap_key == RDMA_USER_MMAP_INVALID) > return -ENOMEM; > > return 0; > @@ -1531,7 +1423,6 @@ int efa_alloc_ucontext(struct ib_ucontext *ibucontext, struct ib_udata *udata) > goto err_out; > > ucontext->uarn = result.uarn; > - xa_init(&ucontext->mmap_xa); > > resp.cmds_supp_udata_mask |= EFA_USER_CMDS_SUPP_UDATA_QUERY_DEVICE; > resp.cmds_supp_udata_mask |= EFA_USER_CMDS_SUPP_UDATA_CREATE_AH; > @@ -1560,19 +1451,25 @@ void efa_dealloc_ucontext(struct ib_ucontext *ibucontext) > struct efa_ucontext *ucontext = to_eucontext(ibucontext); > struct efa_dev *dev = to_edev(ibucontext->device); > > - mmap_entries_remove_free(dev, ucontext); > efa_dealloc_uar(dev, ucontext->uarn); > } > > +void efa_mmap_free(u64 address, u64 length, u8 mmap_flag) > +{ > + /* DMA mapping is already gone, now free the pages */ > + if (mmap_flag == EFA_MMAP_DMA_PAGE) > + free_pages_exact(phys_to_virt(address), length); > +} > + > static int __efa_mmap(struct efa_dev *dev, struct efa_ucontext *ucontext, > struct vm_area_struct *vma, u64 key, u64 length) > { > - struct efa_mmap_entry *entry; > + struct rdma_user_mmap_entry *entry; > unsigned long va; > u64 pfn; > int err; > > - entry = mmap_entry_get(dev, ucontext, key, length); > + entry = rdma_user_mmap_entry_get(&ucontext->ibucontext, key, length); > if (!entry) { > ibdev_dbg(&dev->ibdev, "key[%#llx] does not have valid entry\n", > key); >