From: "Kani, Toshimitsu" <toshi.kani-ZPxbGqLxI0U@public.gmane.org>
To: "dan.j.williams-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org"
<dan.j.williams-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org>,
"linux-nvdimm-hn68Rpc1hR1g9hUCZPvPmw@public.gmane.org"
<linux-nvdimm-hn68Rpc1hR1g9hUCZPvPmw@public.gmane.org>
Cc: "snitzer-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org"
<snitzer-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>,
"x86-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org"
<x86-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>,
"linux-kernel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org"
<linux-kernel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>,
"dm-devel-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org"
<dm-devel-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>,
"viro-RmSDqhL/yNMiFSDQTTA3OLVCufUGDwFn@public.gmane.org"
<viro-RmSDqhL/yNMiFSDQTTA3OLVCufUGDwFn@public.gmane.org>,
"linux-fsdevel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org"
<linux-fsdevel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>,
"hch-jcswGhMUV9g@public.gmane.org"
<hch-jcswGhMUV9g@public.gmane.org>
Subject: Re: [PATCH v3 02/14] dm: add ->copy_from_iter() dax operation support
Date: Thu, 15 Jun 2017 00:46:14 +0000 [thread overview]
Message-ID: <1497487541.9288.16.camel@hpe.com> (raw)
In-Reply-To: <149703983692.20620.3787021839815275819.stgit-p8uTFz9XbKj2zm6wflaqv1nYeNYlB/vhral2JQCrhuEAvxtiuMwx3w@public.gmane.org>
On Fri, 2017-06-09 at 13:23 -0700, Dan Williams wrote:
> Allow device-mapper to route copy_from_iter operations to the
> per-target implementation. In order for the device stacking to work
> we
> need a dax_dev and a pgoff relative to that device. This gives each
> layer of the stack the information it needs to look up the operation
> pointer for the next level.
>
> This conceptually allows for an array of mixed device drivers with
> varying copy_from_iter implementations.
>
> Cc: Toshi Kani <toshi.kani@hpe.com>
> Reviewed-by: Mike Snitzer <snitzer@redhat.com>
> Signed-off-by: Dan Williams <dan.j.williams@intel.com>
I was worried about possible overhead with additional stub calls, but
it looks fine with a single thread fio write test with direct=1.
92.62% [kernel.kallsyms] [k] __copy_user_nocache
0.04% [kernel.kallsyms] [k] entry_SYSCALL_64_fastpath
0.08% libpthread-2.22.so [.] __GI___libc_write
0.01% [kernel.kallsyms] [k] sys_write
0.02% [kernel.kallsyms] [k] vfs_write
0.02% [kernel.kallsyms] [k] __vfs_write
0.02% [kernel.kallsyms] [k] ext4_file_write_iter
0.02% [kernel.kallsyms] [k] dax_iomap_rw
0.03% [kernel.kallsyms] [k] iomap_apply
0.04% [kernel.kallsyms] [k] dax_iomap_actor
0.01% [kernel.kallsyms] [k] dax_copy_from_iter
0.01% [kernel.kallsyms] [k] dm_dax_copy_from_iter
0.01% [kernel.kallsyms] [k] linear_dax_copy_from_iter
0.03% [kernel.kallsyms] [k] copy_from_iter_flushcache
0.00% [kernel.kallsyms] [k] pmem_copy_from_iter
Multi-thread fio test hits hard in inode_lock(), no contention from the
dm-layer.
Reviewed-by: Toshi Kani <toshi.kani@hpe.com>
Thanks,
-Toshi
_______________________________________________
Linux-nvdimm mailing list
Linux-nvdimm@lists.01.org
https://lists.01.org/mailman/listinfo/linux-nvdimm
WARNING: multiple messages have this Message-ID (diff)
From: "Kani, Toshimitsu" <toshi.kani@hpe.com>
To: "dan.j.williams@intel.com" <dan.j.williams@intel.com>,
"linux-nvdimm@lists.01.org" <linux-nvdimm@lists.01.org>
Cc: "snitzer@redhat.com" <snitzer@redhat.com>,
"x86@kernel.org" <x86@kernel.org>,
"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
"dm-devel@redhat.com" <dm-devel@redhat.com>,
"viro@zeniv.linux.org.uk" <viro@zeniv.linux.org.uk>,
"linux-fsdevel@vger.kernel.org" <linux-fsdevel@vger.kernel.org>,
"hch@lst.de" <hch@lst.de>
Subject: Re: [PATCH v3 02/14] dm: add ->copy_from_iter() dax operation support
Date: Thu, 15 Jun 2017 00:46:14 +0000 [thread overview]
Message-ID: <1497487541.9288.16.camel@hpe.com> (raw)
In-Reply-To: <149703983692.20620.3787021839815275819.stgit@dwillia2-desk3.amr.corp.intel.com>
On Fri, 2017-06-09 at 13:23 -0700, Dan Williams wrote:
> Allow device-mapper to route copy_from_iter operations to the
> per-target implementation. In order for the device stacking to work
> we
> need a dax_dev and a pgoff relative to that device. This gives each
> layer of the stack the information it needs to look up the operation
> pointer for the next level.
>
> This conceptually allows for an array of mixed device drivers with
> varying copy_from_iter implementations.
>
> Cc: Toshi Kani <toshi.kani@hpe.com>
> Reviewed-by: Mike Snitzer <snitzer@redhat.com>
> Signed-off-by: Dan Williams <dan.j.williams@intel.com>
I was worried about possible overhead with additional stub calls, but
it looks fine with a single thread fio write test with direct=1.
92.62% [kernel.kallsyms] [k] __copy_user_nocache
0.04% [kernel.kallsyms] [k] entry_SYSCALL_64_fastpath
0.08% libpthread-2.22.so [.] __GI___libc_write
0.01% [kernel.kallsyms] [k] sys_write
0.02% [kernel.kallsyms] [k] vfs_write
0.02% [kernel.kallsyms] [k] __vfs_write
0.02% [kernel.kallsyms] [k] ext4_file_write_iter
0.02% [kernel.kallsyms] [k] dax_iomap_rw
0.03% [kernel.kallsyms] [k] iomap_apply
0.04% [kernel.kallsyms] [k] dax_iomap_actor
0.01% [kernel.kallsyms] [k] dax_copy_from_iter
0.01% [kernel.kallsyms] [k] dm_dax_copy_from_iter
0.01% [kernel.kallsyms] [k] linear_dax_copy_from_iter
0.03% [kernel.kallsyms] [k] copy_from_iter_flushcache
0.00% [kernel.kallsyms] [k] pmem_copy_from_iter
Multi-thread fio test hits hard in inode_lock(), no contention from the
dm-layer.
Reviewed-by: Toshi Kani <toshi.kani@hpe.com>
Thanks,
-Toshi
_______________________________________________
Linux-nvdimm mailing list
Linux-nvdimm@lists.01.org
https://lists.01.org/mailman/listinfo/linux-nvdimm
WARNING: multiple messages have this Message-ID (diff)
From: "Kani, Toshimitsu" <toshi.kani@hpe.com>
To: "dan.j.williams@intel.com" <dan.j.williams@intel.com>,
"linux-nvdimm@lists.01.org" <linux-nvdimm@lists.01.org>
Cc: "dm-devel@redhat.com" <dm-devel@redhat.com>,
"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
"viro@zeniv.linux.org.uk" <viro@zeniv.linux.org.uk>,
"hch@lst.de" <hch@lst.de>, "x86@kernel.org" <x86@kernel.org>,
"snitzer@redhat.com" <snitzer@redhat.com>,
"linux-fsdevel@vger.kernel.org" <linux-fsdevel@vger.kernel.org>
Subject: Re: [PATCH v3 02/14] dm: add ->copy_from_iter() dax operation support
Date: Thu, 15 Jun 2017 00:46:14 +0000 [thread overview]
Message-ID: <1497487541.9288.16.camel@hpe.com> (raw)
In-Reply-To: <149703983692.20620.3787021839815275819.stgit@dwillia2-desk3.amr.corp.intel.com>
On Fri, 2017-06-09 at 13:23 -0700, Dan Williams wrote:
> Allow device-mapper to route copy_from_iter operations to the
> per-target implementation. In order for the device stacking to work
> we
> need a dax_dev and a pgoff relative to that device. This gives each
> layer of the stack the information it needs to look up the operation
> pointer for the next level.
>
> This conceptually allows for an array of mixed device drivers with
> varying copy_from_iter implementations.
>
> Cc: Toshi Kani <toshi.kani@hpe.com>
> Reviewed-by: Mike Snitzer <snitzer@redhat.com>
> Signed-off-by: Dan Williams <dan.j.williams@intel.com>
I was worried about possible overhead with additional stub calls, but
it looks fine with a single thread fio write test with direct=1.
92.62% [kernel.kallsyms] [k] __copy_user_nocache
0.04% [kernel.kallsyms] [k] entry_SYSCALL_64_fastpath
0.08% libpthread-2.22.so [.] __GI___libc_write
0.01% [kernel.kallsyms] [k] sys_write
0.02% [kernel.kallsyms] [k] vfs_write
0.02% [kernel.kallsyms] [k] __vfs_write
0.02% [kernel.kallsyms] [k] ext4_file_write_iter
0.02% [kernel.kallsyms] [k] dax_iomap_rw
0.03% [kernel.kallsyms] [k] iomap_apply
0.04% [kernel.kallsyms] [k] dax_iomap_actor
0.01% [kernel.kallsyms] [k] dax_copy_from_iter
0.01% [kernel.kallsyms] [k] dm_dax_copy_from_iter
0.01% [kernel.kallsyms] [k] linear_dax_copy_from_iter
0.03% [kernel.kallsyms] [k] copy_from_iter_flushcache
0.00% [kernel.kallsyms] [k] pmem_copy_from_iter
Multi-thread fio test hits hard in inode_lock(), no contention from the
dm-layer.
Reviewed-by: Toshi Kani <toshi.kani@hpe.com>
Thanks,
-Toshi
next prev parent reply other threads:[~2017-06-15 0:46 UTC|newest]
Thread overview: 117+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-06-09 20:23 [PATCH v3 00/14] pmem: stop abusing __copy_user_nocache(), and other reworks Dan Williams
2017-06-09 20:23 ` Dan Williams
2017-06-09 20:23 ` Dan Williams
[not found] ` <149703982465.20620.14881139332926778446.stgit-p8uTFz9XbKj2zm6wflaqv1nYeNYlB/vhral2JQCrhuEAvxtiuMwx3w@public.gmane.org>
2017-06-09 20:23 ` [PATCH v3 01/14] x86, uaccess: introduce copy_from_iter_flushcache for pmem / cache-bypass operations Dan Williams
2017-06-09 20:23 ` Dan Williams
2017-06-09 20:23 ` Dan Williams
[not found] ` <149703983098.20620.14791162611225792317.stgit-p8uTFz9XbKj2zm6wflaqv1nYeNYlB/vhral2JQCrhuEAvxtiuMwx3w@public.gmane.org>
2017-06-18 8:28 ` Christoph Hellwig
2017-06-18 8:28 ` Christoph Hellwig
2017-06-18 8:28 ` Christoph Hellwig
[not found] ` <20170618082841.GA26456-jcswGhMUV9g@public.gmane.org>
2017-06-19 2:02 ` Dan Williams
2017-06-19 2:02 ` Dan Williams
2017-06-19 2:02 ` Dan Williams
2017-06-09 20:23 ` [PATCH v3 02/14] dm: add ->copy_from_iter() dax operation support Dan Williams
2017-06-09 20:23 ` Dan Williams
2017-06-09 20:23 ` Dan Williams
[not found] ` <149703983692.20620.3787021839815275819.stgit-p8uTFz9XbKj2zm6wflaqv1nYeNYlB/vhral2JQCrhuEAvxtiuMwx3w@public.gmane.org>
2017-06-15 0:46 ` Kani, Toshimitsu [this message]
2017-06-15 0:46 ` Kani, Toshimitsu
2017-06-15 0:46 ` Kani, Toshimitsu
2017-06-15 1:21 ` Kani, Toshimitsu
2017-06-15 1:21 ` Kani, Toshimitsu
2017-06-18 8:37 ` Christoph Hellwig
2017-06-18 8:37 ` Christoph Hellwig
2017-06-18 8:37 ` Christoph Hellwig
[not found] ` <20170618083702.GB26456-jcswGhMUV9g@public.gmane.org>
2017-06-19 2:04 ` Dan Williams
2017-06-19 2:04 ` Dan Williams
2017-06-19 2:04 ` Dan Williams
2017-06-09 20:24 ` [PATCH v3 03/14] filesystem-dax: convert to dax_copy_from_iter() Dan Williams
2017-06-09 20:24 ` Dan Williams
2017-06-09 20:24 ` Dan Williams
[not found] ` <149703984208.20620.7803227571371078891.stgit-p8uTFz9XbKj2zm6wflaqv1nYeNYlB/vhral2JQCrhuEAvxtiuMwx3w@public.gmane.org>
2017-06-14 10:58 ` Jan Kara
2017-06-14 10:58 ` Jan Kara
2017-06-14 10:58 ` Jan Kara
2017-06-09 20:24 ` [PATCH v3 04/14] dax, pmem: introduce an optional 'flush' dax_operation Dan Williams
2017-06-09 20:24 ` Dan Williams
2017-06-09 20:24 ` Dan Williams
[not found] ` <149703984722.20620.1577767383686219477.stgit-p8uTFz9XbKj2zm6wflaqv1nYeNYlB/vhral2JQCrhuEAvxtiuMwx3w@public.gmane.org>
2017-06-14 10:57 ` Jan Kara
2017-06-14 10:57 ` Jan Kara
2017-06-14 10:57 ` Jan Kara
2017-06-09 20:24 ` [PATCH v3 05/14] dm: add ->flush() dax operation support Dan Williams
2017-06-09 20:24 ` Dan Williams
2017-06-09 20:24 ` Dan Williams
[not found] ` <149703985321.20620.13954624502810597823.stgit-p8uTFz9XbKj2zm6wflaqv1nYeNYlB/vhral2JQCrhuEAvxtiuMwx3w@public.gmane.org>
2017-06-15 1:44 ` Kani, Toshimitsu
2017-06-15 1:44 ` Kani, Toshimitsu
2017-06-15 1:44 ` Kani, Toshimitsu
2017-06-09 20:24 ` [PATCH v3 06/14] filesystem-dax: convert to dax_flush() Dan Williams
2017-06-09 20:24 ` Dan Williams
2017-06-09 20:24 ` Dan Williams
[not found] ` <149703985873.20620.14408850278717601623.stgit-p8uTFz9XbKj2zm6wflaqv1nYeNYlB/vhral2JQCrhuEAvxtiuMwx3w@public.gmane.org>
2017-06-14 10:56 ` Jan Kara
2017-06-14 10:56 ` Jan Kara
2017-06-14 10:56 ` Jan Kara
2017-06-09 20:24 ` [PATCH v3 07/14] x86, dax: replace clear_pmem() with open coded memset + dax_ops->flush Dan Williams
2017-06-09 20:24 ` Dan Williams
2017-06-09 20:24 ` Dan Williams
[not found] ` <149703986417.20620.16200765147913100718.stgit-p8uTFz9XbKj2zm6wflaqv1nYeNYlB/vhral2JQCrhuEAvxtiuMwx3w@public.gmane.org>
2017-06-14 10:55 ` Jan Kara
2017-06-14 10:55 ` Jan Kara
2017-06-14 10:55 ` Jan Kara
2017-06-09 20:24 ` [PATCH v3 08/14] x86, dax, libnvdimm: move wb_cache_pmem() to libnvdimm Dan Williams
2017-06-09 20:24 ` Dan Williams
2017-06-09 20:24 ` Dan Williams
2017-06-12 0:29 ` [PATCH v4 " Dan Williams
2017-06-12 0:29 ` Dan Williams
2017-06-14 10:54 ` [PATCH v3 " Jan Kara
2017-06-14 10:54 ` Jan Kara
[not found] ` <20170614105425.GD21506-4I4JzKEfoa/jFM9bn6wA6Q@public.gmane.org>
2017-06-14 16:49 ` Dan Williams
2017-06-14 16:49 ` Dan Williams
2017-06-14 16:49 ` Dan Williams
[not found] ` <CAPcyv4hNLkX9ct=Z9YQ8zaqAYPa_ab_+W+Z8By6=btJEkbrZag-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2017-06-15 8:11 ` Jan Kara
2017-06-15 8:11 ` Jan Kara
2017-06-15 8:11 ` Jan Kara
[not found] ` <149703986971.20620.10303247412197996310.stgit-p8uTFz9XbKj2zm6wflaqv1nYeNYlB/vhral2JQCrhuEAvxtiuMwx3w@public.gmane.org>
2017-06-18 8:40 ` Christoph Hellwig
2017-06-18 8:40 ` Christoph Hellwig
2017-06-18 8:40 ` Christoph Hellwig
[not found] ` <20170618084036.GC26456-jcswGhMUV9g@public.gmane.org>
2017-06-19 2:06 ` Dan Williams
2017-06-19 2:06 ` Dan Williams
2017-06-19 2:06 ` Dan Williams
2017-06-09 20:24 ` [PATCH v3 09/14] x86, libnvdimm, pmem: move arch_invalidate_pmem() " Dan Williams
2017-06-09 20:24 ` Dan Williams
2017-06-09 20:24 ` Dan Williams
2017-06-14 10:49 ` Jan Kara
2017-06-14 10:49 ` Jan Kara
2017-06-09 20:24 ` [PATCH v3 10/14] pmem: remove global pmem api Dan Williams
2017-06-09 20:24 ` Dan Williams
2017-06-09 20:24 ` Dan Williams
[not found] ` <149703988061.20620.2077699148888013311.stgit-p8uTFz9XbKj2zm6wflaqv1nYeNYlB/vhral2JQCrhuEAvxtiuMwx3w@public.gmane.org>
2017-06-14 10:48 ` Jan Kara
2017-06-14 10:48 ` Jan Kara
2017-06-14 10:48 ` Jan Kara
2017-06-09 20:24 ` [PATCH v3 11/14] libnvdimm, pmem: fix persistence warning Dan Williams
2017-06-09 20:24 ` Dan Williams
2017-06-09 20:24 ` Dan Williams
2017-06-09 20:24 ` [PATCH v3 12/14] libnvdimm, nfit: enable support for volatile ranges Dan Williams
2017-06-09 20:24 ` Dan Williams
2017-06-09 20:24 ` Dan Williams
2017-06-09 20:24 ` [PATCH v3 13/14] filesystem-dax: gate calls to dax_flush() on QUEUE_FLAG_WC Dan Williams
2017-06-09 20:24 ` Dan Williams
2017-06-09 20:24 ` Dan Williams
2017-06-14 10:46 ` Jan Kara
2017-06-14 10:46 ` Jan Kara
[not found] ` <20170614104626.GA21506-4I4JzKEfoa/jFM9bn6wA6Q@public.gmane.org>
2017-06-14 16:49 ` Dan Williams
2017-06-14 16:49 ` Dan Williams
2017-06-14 16:49 ` Dan Williams
2017-06-14 23:11 ` [PATCH v4 13/14] libnvdimm, pmem: gate cache management on QUEUE_FLAG_WC in pmem_dax_flush() Dan Williams
2017-06-14 23:11 ` Dan Williams
2017-06-15 8:09 ` Jan Kara
2017-06-15 8:09 ` Jan Kara
[not found] ` <149703989611.20620.6907872165215640212.stgit-p8uTFz9XbKj2zm6wflaqv1nYeNYlB/vhral2JQCrhuEAvxtiuMwx3w@public.gmane.org>
2017-06-18 8:45 ` [PATCH v3 13/14] filesystem-dax: gate calls to dax_flush() on QUEUE_FLAG_WC Christoph Hellwig
2017-06-18 8:45 ` Christoph Hellwig
2017-06-18 8:45 ` Christoph Hellwig
[not found] ` <20170618084557.GD26456-jcswGhMUV9g@public.gmane.org>
2017-06-19 2:07 ` Dan Williams
2017-06-19 2:07 ` Dan Williams
2017-06-19 2:07 ` Dan Williams
2017-06-09 20:25 ` [PATCH v3 14/14] libnvdimm, pmem: disable dax flushing when pmem is fronting a volatile region Dan Williams
2017-06-09 20:25 ` Dan Williams
2017-06-09 20:25 ` Dan Williams
2017-06-09 23:21 ` Dan Williams
2017-06-09 23:21 ` Dan Williams
2017-06-10 17:54 ` [PATCH v4 " Dan Williams
2017-06-10 17:54 ` Dan Williams
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1497487541.9288.16.camel@hpe.com \
--to=toshi.kani-zpxbgqlxi0u@public.gmane.org \
--cc=dan.j.williams-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org \
--cc=dm-devel-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org \
--cc=hch-jcswGhMUV9g@public.gmane.org \
--cc=linux-fsdevel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=linux-kernel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=linux-nvdimm-hn68Rpc1hR1g9hUCZPvPmw@public.gmane.org \
--cc=snitzer-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org \
--cc=viro-RmSDqhL/yNMiFSDQTTA3OLVCufUGDwFn@public.gmane.org \
--cc=x86-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.