From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:53266) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1gCxMz-0007bQ-L0 for qemu-devel@nongnu.org; Wed, 17 Oct 2018 21:45:02 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1gCxMs-0007kv-7t for qemu-devel@nongnu.org; Wed, 17 Oct 2018 21:44:59 -0400 Received: from mx1.redhat.com ([209.132.183.28]:36042) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1gCxMq-0007fa-7r for qemu-devel@nongnu.org; Wed, 17 Oct 2018 21:44:53 -0400 Date: Wed, 17 Oct 2018 21:44:49 -0400 (EDT) From: Pankaj Gupta Message-ID: <130749719.21742520.1539827089099.JavaMail.zimbra@redhat.com> In-Reply-To: References: <20181013050021.11962-1-pagupta@redhat.com> <20181013050021.11962-3-pagupta@redhat.com> <431127218.21694133.1539803509205.JavaMail.zimbra@redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Subject: Re: [Qemu-devel] [PATCH v2 2/2] virtio-pmem: Add virtio pmem driver List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: Dan Williams Cc: Kevin Wolf , Nitesh Narayan Lal , Jan Kara , Xiao Guangrong , KVM list , Rik van Riel , linux-nvdimm , David Hildenbrand , Linux Kernel Mailing List , Qemu Developers , Christoph Hellwig , Igor Mammedov , Paolo Bonzini , "Michael S. Tsirkin" , Stefan Hajnoczi , Vishal L Verma , zwisler@kernel.org, Dave Jiang , lcapitulino@redhat.com > > > > > > > On Fri, Oct 12, 2018 at 10:01 PM Pankaj Gupta wrote: > > > > > > > > This patch adds virtio-pmem driver for KVM guest. > > > > > > > > Guest reads the persistent memory range information from > > > > Qemu over VIRTIO and registers it on nvdimm_bus. It also > > > > creates a nd_region object with the persistent memory > > > > range information so that existing 'nvdimm/pmem' driver > > > > can reserve this into system memory map. This way > > > > 'virtio-pmem' driver uses existing functionality of pmem > > > > driver to register persistent memory compatible for DAX > > > > capable filesystems. > > > > > > > > This also provides function to perform guest flush over > > > > VIRTIO from 'pmem' driver when userspace performs flush > > > > on DAX memory range. > > > > > > Before we can move forward with this driver we need additional > > > filesystem enabling to detect when the backing device is fronting DAX > > > pmem or a paravirtualized page cache through virtio-pmem. Any > > > interface that requires fsync() and a round trip to the hypervisor to > > > flush host page cache is not DAX. > > > > I saw your proposal[1] for new mmap flag MAP_DIRECT. IIUIC mapping should > > fail for > > MAP_DIRECT if it requires explicit flush or buffer indirection. So, if we > > disable > > MAP_SYNC flag for virtio-pmem this should fail MAP_DIRECT as well? > > Otherwise > > without MAP_DIRECT, virtio-pmem should be defaulted to VIRTIO flush > > mechanism. > > Right, although I wouldn't worry about MAP_DIRECT in the short term > since we're still discussing what the upstream interface. Regardless > of whether MAP_DIRECT is specified or not the virtio-flush mechanism > would always be used for virtio-pmem. I.e. there is no possibility to > get full DAX operation with virtio-pmem, only the page-cache bypass > sub-set. Agree. I will also follow the thread. > > Taking a look at where we could inject this check for filesystems it's > a bit awkward to do it in xfs_file_mmap() for example because we do > not have the backing device for the extents of the inode. So at a > minimum you would need to investigate calling xfs_inode_supports_dax() > from that path and teaching it about a new dax_device flag. I'm > thinking the dax_device flag should be called DAXDEV_BUFFERED to > indicate the presence of software buffering on a device that otherwise > supports bypassing the local page cache. Sure. Will investigate XFS code as suggested. Thanks for the detail directions towards the solution. Will try to come up with a solution. Best regards, Pankaj