From: Leon Romanovsky <leon-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
To: Doug Ledford <dledford-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>,
Jason Gunthorpe <jgg-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
Cc: RDMA mailing list
<linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>,
Mark Bloch <markb-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>,
Steve Wise
<swise-7bPotxP6k4+P2YhJcF5u+vpXobYPEAuW@public.gmane.org>
Subject: [PATCH rdma-next v3 0/7] RDMA resource tracking
Date: Thu, 11 Jan 2018 17:31:25 +0200 [thread overview]
Message-ID: <20180111153132.11143-1-leon@kernel.org> (raw)
Changelog:
v2->v3:
* Added support of PID namespaces.
* Rewrote rdma_restraack_add function to ensure that it won't
appear in lists before it is valid.
* Replace pid/task name caching logic to use task_struct instead.
* Removed report of name of task's for user space objects. Users
are expected to read it through /proc/PID/comm.
v1->v2:
* Rebased on latest rdma/for-next
* Replaced mutex lock which protect linked lists to be RW semaphore.
It has no impact on current implementation, because there is only one
reader (nldev) and it is serialized. However better to be prepared
for multiple readers from the beginning.
* Added reinitialization next QP entry logic to ensure that it exists
and didn't vanish during fill_req_qp() work.
v0->v1:
* Dropped RFC
* Separated to thre series, one for for-rc, and two for-next.
-------
The original goal of this series was to allow ability to view connection
(QP) information about running processes, however I used this opportunity and
created common infrastructure to track and report various resources. The report
part is implemented in netlink (nldev), but smart ULPs can now create
advanced usage models based on device utilization.
The current implementation relies on one lock per-object per-device, so
creation/destroying of various objects (CQ, PD, e.t.c) on various or the
same devices doesn't interfere each with another.
The data protection is performed with SRCU and its reader-writer model
ensures that resource won't be destroyed till readers will finish their
work.
Possible future work will include:
* Reducing number of locks in RDMA, because of SRCU.
* Converting CMA to be based completely on resource tracking.
* Addition of other objects and extending current to give full
and detailed state of the RDMA kernel stack.
* Replacing synchronize_srcu with call_srcu to make destroy flow
non-blocking.
* Provide reliable device reset flow, preserving resource creation ordering.
Thanks
---------------------------------------
Cc: Steve Wise <swise-7bPotxP6k4+P2YhJcF5u+vpXobYPEAuW@public.gmane.org>
Leon Romanovsky (7):
RDMA/restrack: Add general infrastructure to track RDMA resources
RDMA/core: Add helper function to create named QPs
RDMA: Annotate create QP callers
RDMA/core: Add resource tracking for create and destroy CQs
RDMA/core: Add resource tracking for create and destroy PDs
RDMA/nldev: Provide global resource utilization
RDMA/nldev: Provide detailed QP information
drivers/infiniband/core/Makefile | 2 +-
drivers/infiniband/core/cma.c | 1 +
drivers/infiniband/core/core_priv.h | 20 ++
drivers/infiniband/core/cq.c | 3 +
drivers/infiniband/core/device.c | 7 +
drivers/infiniband/core/mad.c | 1 +
drivers/infiniband/core/nldev.c | 405 +++++++++++++++++++++++++++++
drivers/infiniband/core/restrack.c | 182 +++++++++++++
drivers/infiniband/core/uverbs_cmd.c | 5 +-
drivers/infiniband/core/uverbs_std_types.c | 2 +
drivers/infiniband/core/verbs.c | 8 +-
drivers/infiniband/hw/mlx4/mad.c | 1 +
drivers/infiniband/hw/mlx4/qp.c | 1 +
drivers/infiniband/hw/mlx5/gsi.c | 2 +
drivers/infiniband/ulp/ipoib/ipoib_cm.c | 4 +-
drivers/infiniband/ulp/ipoib/ipoib_verbs.c | 1 +
drivers/infiniband/ulp/srp/ib_srp.c | 1 +
drivers/infiniband/ulp/srpt/ib_srpt.c | 1 +
include/rdma/ib_verbs.h | 23 +-
include/rdma/restrack.h | 138 ++++++++++
include/uapi/rdma/rdma_netlink.h | 56 ++++
net/smc/smc_ib.c | 1 +
22 files changed, 858 insertions(+), 7 deletions(-)
create mode 100644 drivers/infiniband/core/restrack.c
create mode 100644 include/rdma/restrack.h
--
2.15.1
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
next reply other threads:[~2018-01-11 15:31 UTC|newest]
Thread overview: 28+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-01-11 15:31 Leon Romanovsky [this message]
[not found] ` <20180111153132.11143-1-leon-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
2018-01-11 15:31 ` [PATCH rdma-next v3 1/7] RDMA/restrack: Add general infrastructure to track RDMA resources Leon Romanovsky
[not found] ` <20180111153132.11143-2-leon-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
2018-01-11 19:39 ` Steve Wise
2018-01-11 19:47 ` Bart Van Assche
[not found] ` <1515700046.2752.52.camel-Sjgp3cTcYWE@public.gmane.org>
2018-01-11 19:55 ` Jason Gunthorpe
[not found] ` <20180111195535.GI30208-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
2018-01-12 6:19 ` Leon Romanovsky
[not found] ` <20180112061924.GF15760-U/DQcQFIOTAAJjI8aNfphQ@public.gmane.org>
2018-01-14 21:26 ` Jason Gunthorpe
[not found] ` <20180114212613.GD9088-uk2M96/98Pc@public.gmane.org>
2018-01-15 10:25 ` Leon Romanovsky
2018-01-12 6:39 ` Leon Romanovsky
2018-01-11 15:31 ` [PATCH rdma-next v3 2/7] RDMA/core: Add helper function to create named QPs Leon Romanovsky
[not found] ` <20180111153132.11143-3-leon-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
2018-01-11 19:39 ` Steve Wise
2018-01-11 19:50 ` Bart Van Assche
[not found] ` <1515700219.2752.55.camel-Sjgp3cTcYWE@public.gmane.org>
2018-01-12 6:42 ` Leon Romanovsky
[not found] ` <20180112064243.GK15760-U/DQcQFIOTAAJjI8aNfphQ@public.gmane.org>
2018-01-14 15:55 ` Leon Romanovsky
2018-01-11 15:31 ` [PATCH rdma-next v3 3/7] RDMA: Annotate create QP callers Leon Romanovsky
[not found] ` <20180111153132.11143-4-leon-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
2018-01-11 19:40 ` Steve Wise
2018-01-14 21:27 ` Jason Gunthorpe
[not found] ` <20180114212704.GE9088-uk2M96/98Pc@public.gmane.org>
2018-01-15 14:31 ` Leon Romanovsky
2018-01-17 15:44 ` Doug Ledford
[not found] ` <1516203857.3403.255.camel-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>
2018-01-17 16:37 ` Leon Romanovsky
2018-01-11 15:31 ` [PATCH rdma-next v3 4/7] RDMA/core: Add resource tracking for create and destroy CQs Leon Romanovsky
[not found] ` <20180111153132.11143-5-leon-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
2018-01-11 19:41 ` Steve Wise
2018-01-11 15:31 ` [PATCH rdma-next v3 5/7] RDMA/core: Add resource tracking for create and destroy PDs Leon Romanovsky
[not found] ` <20180111153132.11143-6-leon-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
2018-01-11 19:41 ` Steve Wise
2018-01-11 15:31 ` [PATCH rdma-next v3 6/7] RDMA/nldev: Provide global resource utilization Leon Romanovsky
[not found] ` <20180111153132.11143-7-leon-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
2018-01-11 19:41 ` Steve Wise
2018-01-11 15:31 ` [PATCH rdma-next v3 7/7] RDMA/nldev: Provide detailed QP information Leon Romanovsky
[not found] ` <20180111153132.11143-8-leon-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
2018-01-11 19:42 ` Steve Wise
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20180111153132.11143-1-leon@kernel.org \
--to=leon-dgejt+ai2ygdnm+yrofe0a@public.gmane.org \
--cc=dledford-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org \
--cc=jgg-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org \
--cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=markb-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org \
--cc=swise-7bPotxP6k4+P2YhJcF5u+vpXobYPEAuW@public.gmane.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.