[PATCH 00/15] Dynamic drm_pagemaps and Initial multi-device SVM

["Thomas Hellström" <thomas.hellstrom@linux.intel.com>]

This series aims at providing an initial implementation of multi-device
SVM, where communitcation with peers (migration and direct execution out
of peer memory) uses some form of fast interconnect. In this series
we're using pcie p2p.

In a multi-device environment, the struct pages for device-private memory
(the dev_pagemap) may take up a significant amount of system memory. We
therefore want to provide a means of revoking / removing the dev_pagemaps
not in use. In particular when a device is offlined, we want to block
migrating *to* the device memory and migrate data already existing in the
devices memory to system. The dev_pagemap then becomes unused and can be
removed.

Removing and setting up a large dev_pagemap is also quite time-consuming,
so removal of unused dev_pagemaps only happens on system memory pressure
using a shrinker.

Patches 1-6 deals with dynamic drm_pagemaps as described above.
Patches 7-11 adds infrastructure to handle remote drm_pagemaps with
fast interconnects.
Patch 12 extends the xe madvise() UAPI to handle remote drm_pagemaps.
Patch 13 adds a pcie-p2p dma SVM interconnect to the xe driver.
Patch 14-15 are minor improvements of the xe functionality.

What's still missing is the optimized p2p migration and implementation
of migration policies. That will be implemented in follow-up series. 

Thomas Hellström (15):
  drm/pagemap, drm/xe: Add refcounting to struct drm_pagemap
  drm/pagemap: Add a refcounted drm_pagemap backpointer to struct
    drm_pagemap_zdd
  drm/pagemap, drm/xe: Manage drm_pagemap provider lifetimes
  drm/pagemap: Add a drm_pagemap cache and shrinker
  drm/xe: Use the drm_pagemap cache and shrinker
  drm/pagemap: Remove the drm_pagemap_create() interface
  drm/pagemap_util: Add a utility to assign an owner to a set of
    interconnected gpus
  drm/xe: Use the drm_pagemap_util helper to get a svm pagemap owner
  drm/xe: Pass a drm_pagemap pointer around with the memory advise
    attributes
  drm/xe: Use the vma attibute drm_pagemap to select where to migrate
  drm/xe: Simplify madvise_preferred_mem_loc()
  drm/xe/uapi: Extend the madvise functionality to support foreign
    pagemap placement for svm
  drm/xe: Support pcie p2p dma as a fast interconnect
  drm/xe/vm: Add a prefetch debug printout
  drm/xe: Retry migration once

 drivers/gpu/drm/Makefile             |   3 +-
 drivers/gpu/drm/drm_pagemap.c        | 177 ++++++++-
 drivers/gpu/drm/drm_pagemap_util.c   | 544 ++++++++++++++++++++++++++
 drivers/gpu/drm/xe/xe_device.c       |  20 +
 drivers/gpu/drm/xe/xe_device.h       |   2 +
 drivers/gpu/drm/xe/xe_device_types.h |   5 +
 drivers/gpu/drm/xe/xe_svm.c          | 551 +++++++++++++++++++++++----
 drivers/gpu/drm/xe/xe_svm.h          |  78 +++-
 drivers/gpu/drm/xe/xe_tile.c         |  34 +-
 drivers/gpu/drm/xe/xe_tile.h         |  21 +
 drivers/gpu/drm/xe/xe_userptr.c      |   2 +-
 drivers/gpu/drm/xe/xe_vm.c           |  59 ++-
 drivers/gpu/drm/xe/xe_vm.h           |   1 +
 drivers/gpu/drm/xe/xe_vm_madvise.c   |  92 ++++-
 drivers/gpu/drm/xe/xe_vm_types.h     |  21 +-
 drivers/gpu/drm/xe/xe_vram_types.h   |  15 +-
 include/drm/drm_pagemap.h            |  91 ++++-
 include/drm/drm_pagemap_util.h       |  78 ++++
 include/uapi/drm/xe_drm.h            |   4 +-
 19 files changed, 1630 insertions(+), 168 deletions(-)
 create mode 100644 drivers/gpu/drm/drm_pagemap_util.c
 create mode 100644 include/drm/drm_pagemap_util.h

-- 
2.51.0