From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 5B523C433EF for ; Wed, 27 Apr 2022 01:46:50 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1356936AbiD0Bt4 (ORCPT ); Tue, 26 Apr 2022 21:49:56 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:52340 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1356932AbiD0Btz (ORCPT ); Tue, 26 Apr 2022 21:49:55 -0400 Received: from esa2.hgst.iphmx.com (esa2.hgst.iphmx.com [68.232.143.124]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 1C08249F17 for ; Tue, 26 Apr 2022 18:46:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=wdc.com; i=@wdc.com; q=dns/txt; s=dkim.wdc.com; t=1651024005; x=1682560005; h=message-id:date:mime-version:subject:to:cc:references: from:in-reply-to:content-transfer-encoding; bh=MdLhKR3iPWnl3Ay7JNgoR0/piJKLQFs4RnW6vFuQAdo=; b=OjECYewlPFD545WfEbOetP2AfHb//UeMBiXzvIYBrYAVMWKHNDg3kh8P BkluuRccUHnlWJ0hElxKH9SRkAPX/YaXeNokrkiHiMBKo2VCRNARzp/k2 Kl/mifesNE8JjFJoNCkDmlPQu5ByQ9LVfEqj+XRRSdTC03poBBqMDpAFk P7U5/7oXA6AxOexc4PWWh1nE7FoqSFAPn5Qs1BMbdsHDZ969W1MUrBHGv WaN78sXjgWP223meGD80t0twes+9PRjBIcoD8nNoRk7TTUeEZVhDx0Zjj Z/VcKUy61bfzxQmjQVLOJuYMEt0bznQu14QjgeszGBkU7jjRTYSZsh53w w==; X-IronPort-AV: E=Sophos;i="5.90,292,1643644800"; d="scan'208";a="303117466" Received: from h199-255-45-15.hgst.com (HELO uls-op-cesaep02.wdc.com) ([199.255.45.15]) by ob1.hgst.iphmx.com with ESMTP; 27 Apr 2022 09:46:44 +0800 IronPort-SDR: E3kb18NoIawI7osdKsCeysW/a1pqk8LcF9mMFHtb5S5NuJA5BPibDkBdwl/TbR7oHiWIVlbcDK 42L7u06hWJNW6viVBp17Pufc0jzJcOrSUxLcodzRudW9j8LyNhQv4NBJetIfGmQvNq5MorNJhC wsHDi25NEgwdR2lnksD3trv1iD07WREywcG+kacuLiy9SdSJXrwv3/DA40tba9XvCiI0jrpBGi KCkEhJM98mHmnXJKZe/dXR7+LraefPM0YVxGTCjBm63nDj3PMT7nWXyWIJ5fObNFc/Xj2glft8 6t2RfKV5+RzIGU2YudDgWGw0 Received: from uls-op-cesaip01.wdc.com ([10.248.3.36]) by uls-op-cesaep02.wdc.com with ESMTP/TLS/ECDHE-RSA-AES128-GCM-SHA256; 26 Apr 2022 18:16:55 -0700 IronPort-SDR: VD3jtQKZY6QG5Trc4qR5L7Q2tYfDxFkBgeGoLxC3srz+k+TDJcG15aq/CUWOyGRwRpu7SZXJ0D cNSwDNnv5jdZcRXUcNl6eFjTfJdT5v9Zr/z1dPkLPfrbjg6zEgaMdkLqSSzrKXGGRnJQnljL0e mHiFdh4U0cLVf1+FmC+wsyNoY8RPa37u++HJC/eXpq7Dp3mLmJRV9XCynZme6QTW8y57vLZA/8 9Tqzsr6X0rHief/2f7isbCUWovpv+HOPpRmwGdigQUp0RqBjREIsPDXlK3jLKjIDa2GPvqmTfo mqE= WDCIronportException: Internal Received: from usg-ed-osssrv.wdc.com ([10.3.10.180]) by uls-op-cesaip01.wdc.com with ESMTP/TLS/ECDHE-RSA-AES128-GCM-SHA256; 26 Apr 2022 18:46:43 -0700 Received: from usg-ed-osssrv.wdc.com (usg-ed-osssrv.wdc.com [127.0.0.1]) by usg-ed-osssrv.wdc.com (Postfix) with ESMTP id 4Kp1nY6zv6z1SVp8 for ; Tue, 26 Apr 2022 18:46:41 -0700 (PDT) Authentication-Results: usg-ed-osssrv.wdc.com (amavisd-new); dkim=pass reason="pass (just generated, assumed good)" header.d=opensource.wdc.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d= opensource.wdc.com; h=content-transfer-encoding:content-type :in-reply-to:organization:from:references:to:content-language :subject:user-agent:mime-version:date:message-id; s=dkim; t= 1651024001; x=1653616002; bh=MdLhKR3iPWnl3Ay7JNgoR0/piJKLQFs4RnW 6vFuQAdo=; b=PCbhZbhdEUJjurh6XJdybqJZjXmTfYcvV4sNNxcO2PNX5Qvr8Ki hPFZSYCBwIffH6U8FfbnV4nJ6IVgpPfdyhsrjnueMZk8u92KusgEOc/yIcr+0k59 ozKDXBIE/YUG4Znd9NBIMP9+m+R5EXtzB+BKQw3A7VZ6p2QICh0SD2qrMYWI7DuP gPZ5IVTo/tZqF/5/dGQl33NjY2aTCyh7GEAu9Ld9pRHTGjLsgOubu4EtfsAXUoAW CMndwdUpCLTssqPhyvZpORUkGmwA9s7fA3ZtGQBfwIOhZD7GYF0f7mbG0XAbcF7v hdwlQ9BlldJPN4izOQN20Ac20bVVWWzyX9Q== X-Virus-Scanned: amavisd-new at usg-ed-osssrv.wdc.com Received: from usg-ed-osssrv.wdc.com ([127.0.0.1]) by usg-ed-osssrv.wdc.com (usg-ed-osssrv.wdc.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id UzOUXtxnHNom for ; Tue, 26 Apr 2022 18:46:41 -0700 (PDT) Received: from [10.225.163.27] (unknown [10.225.163.27]) by usg-ed-osssrv.wdc.com (Postfix) with ESMTPSA id 4Kp1nQ10FXz1Rvlc; Tue, 26 Apr 2022 18:46:33 -0700 (PDT) Message-ID: Date: Wed, 27 Apr 2022 10:46:32 +0900 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.8.0 Subject: Re: [PATCH v4 00/10] Add Copy offload support Content-Language: en-US To: Nitesh Shetty Cc: chaitanyak@nvidia.com, linux-block@vger.kernel.org, linux-scsi@vger.kernel.org, dm-devel@redhat.com, linux-nvme@lists.infradead.org, linux-fsdevel@vger.kernel.org, axboe@kernel.dk, msnitzer@redhat.com, bvanassche@acm.org, martin.petersen@oracle.com, hare@suse.de, kbusch@kernel.org, hch@lst.de, Frederick.Knight@netapp.com, osandov@fb.com, lsf-pc@lists.linux-foundation.org, djwong@kernel.org, josef@toxicpanda.com, clm@fb.com, dsterba@suse.com, tytso@mit.edu, jack@suse.com, nitheshshetty@gmail.com, gost.dev@samsung.com, Alasdair Kergon , Mike Snitzer , Sagi Grimberg , James Smart , Chaitanya Kulkarni , Naohiro Aota , Johannes Thumshirn , Alexander Viro , linux-kernel@vger.kernel.org References: <20220426101241.30100-1-nj.shetty@samsung.com> From: Damien Le Moal Organization: Western Digital Research In-Reply-To: <20220426101241.30100-1-nj.shetty@samsung.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Precedence: bulk List-ID: X-Mailing-List: linux-scsi@vger.kernel.org On 4/26/22 19:12, Nitesh Shetty wrote: > The patch series covers the points discussed in November 2021 virtual c= all > [LSF/MM/BFP TOPIC] Storage: Copy Offload[0]. > We have covered the Initial agreed requirements in this patchset. > Patchset borrows Mikulas's token based approach for 2 bdev > implementation. >=20 > Overall series supports =E2=80=93 >=20 > 1. Driver > - NVMe Copy command (single NS), including support in nvme-target (for > block and file backend) >=20 > 2. Block layer > - Block-generic copy (REQ_COPY flag), with interface accommodating > two block-devs, and multi-source/destination interface > - Emulation, when offload is natively absent > - dm-linear support (for cases not requiring split) >=20 > 3. User-interface > - new ioctl > - copy_file_range for zonefs >=20 > 4. In-kernel user > - dm-kcopyd > - copy_file_range in zonefs >=20 > For zonefs copy_file_range - Seems we cannot levearge fstest here. Limi= ted > testing is done at this point using a custom application for unit testi= ng. https://github.com/westerndigitalcorporation/zonefs-tools ./configure --with-tests make sudo make install Then run tests/zonefs-tests.sh Adding test case is simple. Just add script files under tests/scripts I just realized that the README file of this project is not documenting this. I will update it. >=20 > Appreciate the inputs on plumbing and how to test this further? > Perhaps some of it can be discussed during LSF/MM too. >=20 > [0] https://lore.kernel.org/linux-nvme/CA+1E3rJ7BZ7LjQXXTdX+-0Edz=3DzT1= 4mmPGMiVCzUgB33C60tbQ@mail.gmail.com/ >=20 > Changes in v4: > - added copy_file_range support for zonefs > - added documentaion about new sysfs entries > - incorporated review comments on v3 > - minor fixes >=20 >=20 > Arnav Dawn (2): > nvmet: add copy command support for bdev and file ns > fs: add support for copy file range in zonefs >=20 > Nitesh Shetty (7): > block: Introduce queue limits for copy-offload support > block: Add copy offload support infrastructure > block: Introduce a new ioctl for copy > block: add emulation for copy > nvme: add copy offload support > dm: Add support for copy offload. > dm: Enable copy offload for dm-linear target >=20 > SelvaKumar S (1): > dm kcopyd: use copy offload support >=20 > Documentation/ABI/stable/sysfs-block | 83 +++++++ > block/blk-lib.c | 358 +++++++++++++++++++++++++++ > block/blk-map.c | 2 +- > block/blk-settings.c | 59 +++++ > block/blk-sysfs.c | 138 +++++++++++ > block/blk.h | 2 + > block/ioctl.c | 32 +++ > drivers/md/dm-kcopyd.c | 55 +++- > drivers/md/dm-linear.c | 1 + > drivers/md/dm-table.c | 45 ++++ > drivers/md/dm.c | 6 + > drivers/nvme/host/core.c | 116 ++++++++- > drivers/nvme/host/fc.c | 4 + > drivers/nvme/host/nvme.h | 7 + > drivers/nvme/host/pci.c | 25 ++ > drivers/nvme/host/rdma.c | 6 + > drivers/nvme/host/tcp.c | 14 ++ > drivers/nvme/host/trace.c | 19 ++ > drivers/nvme/target/admin-cmd.c | 8 +- > drivers/nvme/target/io-cmd-bdev.c | 65 +++++ > drivers/nvme/target/io-cmd-file.c | 49 ++++ > fs/zonefs/super.c | 178 ++++++++++++- > fs/zonefs/zonefs.h | 1 + > include/linux/blk_types.h | 21 ++ > include/linux/blkdev.h | 17 ++ > include/linux/device-mapper.h | 5 + > include/linux/nvme.h | 43 +++- > include/uapi/linux/fs.h | 23 ++ > 28 files changed, 1367 insertions(+), 15 deletions(-) >=20 >=20 > base-commit: e7d6987e09a328d4a949701db40ef63fbb970670 --=20 Damien Le Moal Western Digital Research