From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id B8F3CC54F55 for ; Wed, 29 Jul 2026 02:16:28 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:List-Subscribe:List-Help :List-Post:List-Archive:List-Unsubscribe:List-Id:Content-Transfer-Encoding: MIME-Version:Message-ID:Date:Subject:Cc:To:From:Reply-To:Content-Type: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:In-Reply-To:References:List-Owner; bh=d4R1Ta7J5o9QlsZRJQtTe6q81OAsfZ4+yoYoEv/KCR0=; b=CkXFmp1ZfTBhPXMBzRYh5WLF9r Fo0+4/DD0ELJ+I2o/j9me7ecdGazN+I7Bi00RyDT4CrOhOBru5ClzFXZAKtszkkbch4+DBgiGseIp OKolb4Mbwedxa7AA9mBPiIprCMUFRFdxzc3cEnHrNHjoKfLHXgP/3V/GXUj1/RJbZONK4O52Wy/x4 WKZV/i3W9M5lmTI/Cadh5eek/Dq0PtpDn7lCHNurBOEW8nN6zr+sTras1DWf8Z3hq4wx9w8s7OBKr wmz1LA6N6aqkA5ycK7BY4bwuftMD/AR4tq6ExhngxWdvlzbLImpnjv8ey3X2wcJezrMzCBDWERc18 NPSZ7cmA==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.99.1 #2 (Red Hat Linux)) id 1wotqE-00000006fQI-2evb; Wed, 29 Jul 2026 02:16:18 +0000 Received: from mail-wr1-x42f.google.com ([2a00:1450:4864:20::42f]) by bombadil.infradead.org with esmtps (Exim 4.99.1 #2 (Red Hat Linux)) id 1wopMu-00000006KGW-19X8 for linux-nvme@lists.infradead.org; Tue, 28 Jul 2026 21:29:45 +0000 Received: by mail-wr1-x42f.google.com with SMTP id ffacd0b85a97d-4728c12ba97so236963f8f.0 for ; Tue, 28 Jul 2026 14:29:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20251104; t=1785274182; x=1785878982; darn=lists.infradead.org; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to:content-type; bh=d4R1Ta7J5o9QlsZRJQtTe6q81OAsfZ4+yoYoEv/KCR0=; b=V9Iti666pFA1VwTJh8Mv6Ll27Y4NaBXTZm5es8qpWJX8JBsGPa7kt25sXVi0uNxS8l YHBGikRrH83tlcWvbPYW3dQIeWQKywk7mVFDdhEmeeiqD697ot1QNYEcHCBQNg4NKTaf IhmK+AojABzu9rJryWEGEF3KhR+oQdh567CHU7vkGpF8MednconDLShuWR2qO/TUFlj8 hIz7nTq+6imXbw7vOhT0NtKegt9LJCZlCx/yru5QOl149Y6+YeVGdONxbF8Y8MRLaggd rw7CVRWKlFOXSsi6W22+T9x8rkXW3Hg+f3TXgGHmPu+LPqrpQRDW0TNOBzoS6sZslPJJ yVJA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1785274182; x=1785878982; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-gg:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to:content-type; bh=d4R1Ta7J5o9QlsZRJQtTe6q81OAsfZ4+yoYoEv/KCR0=; b=prOjv5VSKtVVbsOZHSllY42bnY543NLAlpgtvfgalFEL1pRtpGohF1awWvB/ntMGTc EGpy2fE9DkBErt8LyRb+0IZoNkefBHiPoSeEvS11h9OujSrajxmHmrT37ypjKi/nKhNA 3+6xCPsLTzlRV+/K+9DsBEq7BqXxDghwuRpdl2Y2CMwJ8XisPCBgkVHHTcchLKAxT/Yh dlY9J2GUo59j8YFv/rUWjhLR6PapjutbxCcS2y8glZmq8YBiy7Ige3sDMPGdYMTqDmIR HECvpl+EE9AZ1+xERLeBWUHq900pM8IALblJu9Eig6/Dk9ErbUZeHJ/6h/Z7pDuOm/SX l86Q== X-Forwarded-Encrypted: i=1; AHgh+Rp855lqhixmfS9VFiL+XdRlbWn/5bTx0nneTjPVJWQ7J8R8+dJRESGnXnN41YacCqvyciASPv3+8/Xl@lists.infradead.org X-Gm-Message-State: AOJu0YzqO8wlzO0ytZ2YAVLoh81ZH6evDdWi52FZYUqkJKl8lC4opWtm mCqGEljPtW9l6EbgYRNSq8VxZqTIrcjXsdIFK26UHvUs6VQd/HKhJuNu X-Gm-Gg: AR+sD10hzgNnwRyQbxLmmZMSlkP71Do2+7WKIRKUyeSzEHtP55KPqeMGByir3jbjXQO UopvtlCiJz5ZHMxZl1nAGZUipvZkD7jVA17t50F/aiP9TJcmofNzJD8tLOB5QsA7s4fpC8503+h GJYhOIdffW6L3vHeBYnas+Pjn5Ubk+r6N5jQvMJfqLPuNIAzBxdOw7WvZ3m1N7911HBKpV4RHW+ 48Uldh7JrdLiUFEVybStOAxaciB7iKiH4iA/lilT3sXviz6A4/+WyPU0tpeNV81Ibu0/Rq4Mzqg D5GnvK7OpDimcqAFdSKkMiTfs5S6XOVeY1oxda88YyqXUixH4Mjq81TzaDJPta9bm5SHmV/QMhc XYT0skbcJNusKpKLAAPG0DNjgOZvY79EkekDD6GMQwRFmH9f4i/bkaiv+Nc5vSikE+UdKD8VVjg tyf7BguVl5EF0xhf5EugE6MzqvxfvKalsaq5ukWIYgP6wkKa+8pc6kM8qOA7vLd+EOVwWzsmX78 BDBCuQxrU4Myfh3h2g= X-Received: by 2002:a5d:64e9:0:b0:47f:93be:dabd with SMTP id ffacd0b85a97d-47fb1f1013bmr4399028f8f.28.1785274181752; Tue, 28 Jul 2026 14:29:41 -0700 (PDT) Received: from 127.mynet ([2a01:4b00:bd21:4f00:7cc6:d3ca:494:116c]) by smtp.gmail.com with ESMTPSA id ffacd0b85a97d-47fb6ac44bcsm2245329f8f.11.2026.07.28.14.29.40 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 28 Jul 2026 14:29:40 -0700 (PDT) From: Pavel Begunkov To: Jens Axboe , Keith Busch , Christoph Hellwig , Sagi Grimberg , linux-block@vger.kernel.org, linux-kernel@vger.kernel.org, linux-nvme@lists.infradead.org, linux-fsdevel@vger.kernel.org, io-uring@vger.kernel.org, linux-media@vger.kernel.org, dri-devel@lists.freedesktop.org, linaro-mm-sig@lists.linaro.org Cc: asml.silence@gmail.com, Alexander Viro , Christian Brauner , Andrew Morton , Sumit Semwal , =?UTF-8?q?Christian=20K=C3=B6nig?= , Nitesh Shetty , Kanchan Joshi , Anuj Gupta , Tushar Gohad , William Power , Phil Cayton , Jason Gunthorpe , Damien Le Moal , Alasdair Kergon , Mike Snitzer , Mikulas Patocka , Benjamin Marzinski , Vishal Verma , David Sterba , Ilya Dryomov , dm-devel@lists.linux.dev, nvdimm@lists.linux.dev, linux-btrfs@vger.kernel.org, ceph-devel@vger.kernel.org Subject: [PATCH v4 00/14] Add dmabuf read/write via io_uring Date: Tue, 28 Jul 2026 22:29:12 +0100 Message-ID: X-Mailer: git-send-email 2.54.0 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.9.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20260728_142944_351580_34342736 X-CRM114-Status: GOOD ( 21.57 ) X-Mailman-Approved-At: Tue, 28 Jul 2026 19:16:17 -0700 X-BeenThere: linux-nvme@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "Linux-nvme" Errors-To: linux-nvme-bounces+linux-nvme=archiver.kernel.org@lists.infradead.org The patch set allows to register a dmabuf to an io_uring instance for a specified file and use it with io_uring read / write requests. The infrastructure is not tied to io_uring and there could be more users in the future. A similar idea was attempted some years ago by Keith [1], from where I borrowed a good number of changes, and later was brough up by Tushar and Vishal. It's an opt-in feature for files, and they need to implement a new file operation to use it. Only NVMe block devices are supported in this series. The user API is built on top of io_uring's "registered buffers", where a dmabuf is registered in a special way, but after it can be used as any other "registered buffer" with IORING_OP_{READ,WRITE}_FIXED requests. It's created via a new file operation and the resulted map is then passed through the I/O stack in a new iterator type. There is some additional infrastructure to glue it together, count requests, manage lifetime and implement invalidation. Tushar, William, Phil as well as Kanchan, Anuj and Nitesh did a lot of testing and experimentation with different devices. Some earlier benchmarks by Anuj for IOMMU optimisations with udmabuf showed: STRICT: before = 570 KIOPS, after = 5.01 MIOPS LAZY: before = 1.93 MIOPS, after = 5.01 MIOPS PASSTHROUGH: before = 5.01 MIOPS, after = 5.01 MIOPS # Patch set structure: - Patches 1-2 introduce internal API and infrastructure mediating io_uring and target subsystem / devices - Patches 3-7: block layer support + prep patches - Patches 8-9 implement NVMe support - Patches 10-14 add io_uring support and uapi. Patch 14 specifically enables dma-buf support, the rest are preparation patches. There are some liburing tests that can serve as an example: git: https://github.com/isilence/liburing.git rw-dmabuf-tests-v4 url: https://github.com/isilence/liburing/tree/rw-dmabuf-tests-v4 [1] https://lore.kernel.org/io-uring/20220805162444.3985535-1-kbusch@fb.com/ v4: - Add sgl support from Anuj - Move it under drivers/dma-buf/ and rename - Fix mis-sized allocations - Fix io_uring re-import mishandling - Drop map before io_uring "task work" - Move blk-mq callback to block_device_operations - Convert bio flag to REQ_OP* - Other small changes v3: https://lore.kernel.org/io-uring/cover.1777475843.git.asml.silence@gmail.com/ - Rework io_uring registration - Move token/map infrastructure code out of blk-mq - Simplify callbacks: remove a separate blk-mq table, which was mostly just forwarding calls (to nvme). - Don't skip dma sync depending on request direction - Fix a couple of hangs - Rename s/dma/dmabuf/ - Other small changes v2: - Don't pass raw dma addresses, wrap it into a driver specific object - Split into two objects: token and map - Implement move_notify Anuj Gupta (1): nvme-pci: add SGL support for the dmabuf path Pavel Begunkov (13): dma-buf: introduce initial file I/O infrastructure iov_iter: add iterator type for dmabuf maps block: rename bi_bvec_done block: always adjust bi_offset on bio_advance_iter block: move bvec init into __bio_clone block: introduce dma map backed bio type block: forward init_dma_buf_io_ctx to drivers nvme-pci: implement dma_token backed requests io_uring/rsrc: introduce buf registration structure io_uring/rsrc: extend buffer update io_uring/rsrc: add uncloneable regbuf flag io_uring/rsrc: add regbuf import flags io_uring/rsrc: add dmabuf backed registered buffers Documentation/block/biovecs.rst | 8 +- block/bio.c | 30 ++- block/blk-merge.c | 23 +- block/blk-mq-dma.c | 2 +- block/blk.h | 2 +- block/fops.c | 16 ++ drivers/block/loop.c | 2 +- drivers/block/zloop.c | 2 +- drivers/dma-buf/Makefile | 2 +- drivers/dma-buf/dma-buf-io.c | 275 ++++++++++++++++++++ drivers/md/dm-io-rewind.c | 16 +- drivers/md/dm-pcache/segment.c | 4 +- drivers/nvdimm/btt.c | 2 +- drivers/nvme/host/core.c | 12 + drivers/nvme/host/nvme.h | 2 + drivers/nvme/host/pci.c | 448 +++++++++++++++++++++++++++++++- drivers/nvme/host/tcp.c | 2 +- fs/btrfs/misc.h | 2 +- include/linux/bio.h | 22 +- include/linux/blk-mq.h | 7 + include/linux/blk_types.h | 14 +- include/linux/blkdev.h | 2 + include/linux/bvec.h | 17 +- include/linux/dma-buf-io.h | 91 +++++++ include/linux/fs.h | 2 + include/linux/io_uring_types.h | 5 + include/linux/uio.h | 11 + include/uapi/linux/io_uring.h | 31 ++- io_uring/io_uring.c | 3 +- io_uring/net.c | 4 +- io_uring/rsrc.c | 281 +++++++++++++++++--- io_uring/rsrc.h | 45 +++- io_uring/rw.c | 6 +- lib/iov_iter.c | 31 ++- net/ceph/messenger.c | 4 +- 35 files changed, 1315 insertions(+), 111 deletions(-) create mode 100644 drivers/dma-buf/dma-buf-io.c create mode 100644 include/linux/dma-buf-io.h -- 2.54.0