From mboxrd@z Thu Jan 1 00:00:00 1970 From: Ross Zwisler Subject: Re: [PATCH v2 7/7] pmem, dax: have direct_access use __pmem annotation Date: Mon, 17 Aug 2015 14:07:18 -0600 Message-ID: <1439842038.11296.1.camel@linux.intel.com> References: <1439484671-15718-1-git-send-email-ross.zwisler@linux.intel.com> <1439484671-15718-8-git-send-email-ross.zwisler@linux.intel.com> <20150815091950.GA21487@lst.de> Mime-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit Cc: Christoph Hellwig , "linux-kernel@vger.kernel.org" , "linux-nvdimm@lists.01.org" , Jonathan Corbet , Benjamin Herrenschmidt , Paul Mackerras , Michael Ellerman , Jens Axboe , Martin Schwidefsky , Heiko Carstens , linux390@de.ibm.com, Alexander Viro , Matthew Wilcox , Jeff Layton , Andrew Morton , Omar Sandoval , Boaz Harrosh , Miklos Szeredi , Jan Kara , Wolfram Sang , Uwe =?ISO-8859-1?Q?Kleine-K=F6nig?= , Gerald Schaefer Return-path: In-Reply-To: Sender: linux-kernel-owner@vger.kernel.org List-Id: linux-fsdevel.vger.kernel.org On Sat, 2015-08-15 at 08:44 -0700, Dan Williams wrote: > On Sat, Aug 15, 2015 at 2:19 AM, Christoph Hellwig wrote: > > On Thu, Aug 13, 2015 at 10:51:11AM -0600, Ross Zwisler wrote: > >> Update the annotation for the kaddr pointer returned by direct_access() > >> so that it is a __pmem pointer. This is consistent with the PMEM driver > >> and with how this direct_access() pointer is used in the DAX code. > > > > IFF we stick to the __pmem annotations this looks good. > > > > That beeing said I start to really dislike them. We don't special > > accesors to read/write from pmem, we just need to explicitly commit > > it if we want to make it persistent. So I really don't see the need > > to treat it special and require all the force casts to and from the > > attribute. > > I'm not going to put up much of a fight if it's really getting in the way.... > > That said, while we don't need special accessors we do need guarantees > that anything that has written to a persistent memory address has done > so in a way that wmb_pmem() is able to flush it. It's more of a "I've > audited this code path for wmb_pmem() compatibility so use this api to > write to pmem." > > Perhaps a better way to statically check for missed flushes might be > to have acquire_pmem_for_write() + release() annotations and the final > release does a wmb_pmem(), but as far as I can tell the sparse > acquire/release annotations don't stack. FWIW I've been on the fence about the __pmem annotations, but my current thought is that we really do need a way of saying that stores to these pointers need special care for wmb_pmem() to do its thing and that __pmem does a reasonably good job of that. If we can figure out a cooler way, such as the write() + release() flow Dan is talking about, great. But I think we need something to keep us from making errors by storing to PMEM pointers and leaving data in the processor cache.