[PATCH rdma-next v1 0/4] scatterlist: add sg_alloc_table_append function

Leon Romanovsky
2020-09-10T21:34:23Z

From: Leon Romanovsky <leonro@nvidia.com>

Changelog:
v1:
* Changed _sg_chain to be __sg_chain
* Added dependency on ARCH_NO_SG_CHAIN
* Removed struct sg_append
v0:
* https://lore.kernel.org/lkml/20200903121853.1145976-1-leon@kernel.org

--------------------------------------------------------------------------
From Maor:

This series adds a new constructor for a scatter gather table. Like
sg_alloc_table_from_pages function, this function merges all contiguous
chunks of the pages a into single scatter gather entry.

In contrast to sg_alloc_table_from_pages, the new API allows chaining of
new pages to already initialized SG table.

This allows drivers to utilize the optimization of merging contiguous
pages without a need to pre allocate all the pages and hold them in
a very large temporary buffer prior to the call to SG table initialization.

The first two patches refactor the code of sg_alloc_table_from_pages
in order to have code sharing and add sg_alloc_next function to allow
dynamic allocation of more entries in the SG table.

The third patch introduces the new API.

The last patch changes the Infiniband driver to use the new API. It
removes duplicate functionality from the code and benefits the
optimization of allocating dynamic SG table from pages.

In huge pages system of 2MB page size, without this change, the SG table
would contain x512 SG entries.
E.g. for 100GB memory registration:

Number of entries Size
Before 26214400 600.0MB
After 51200 1.2MB

Thanks

Maor Gottlieb (4):
lib/scatterlist: Refactor sg_alloc_table_from_pages
lib/scatterlist: Add support in dynamically allocation of SG entries
lib/scatterlist: Add support in dynamic allocation of SG table from
pages
RDMA/umem: Move to allocate SG table from pages

drivers/infiniband/Kconfig | 1 +
drivers/infiniband/core/umem.c | 90 ++--------
include/linux/scatterlist.h | 35 ++--
lib/scatterlist.c | 292 +++++++++++++++++++++++++--------
4 files changed, 255 insertions(+), 163 deletions(-)

--
2.26.2