From: Haozhong Zhang <haozhong.zhang@intel.com>
To: Igor Mammedov <imammedo@redhat.com>
Cc: qemu-devel@nongnu.org, Eduardo Habkost <ehabkost@redhat.com>,
Paolo Bonzini <pbonzini@redhat.com>,
Peter Crosthwaite <crosthwaite.peter@gmail.com>,
Richard Henderson <rth@twiddle.net>,
Xiao Guangrong <guangrong.xiao@linux.intel.com>,
kwolf@redhat.com, mreitz@redhat.com
Subject: Re: [Qemu-devel] [PATCH] hostmem-file: add a property 'notrunc' to avoid data corruption
Date: Thu, 20 Oct 2016 21:11:38 +0800 [thread overview]
Message-ID: <20161020131138.4gzxk5ekltkiqtq2@hz-desktop> (raw)
In-Reply-To: <20161020143412.5ea6b564@nial.brq.redhat.com>
On 10/20/16 14:34 +0200, Igor Mammedov wrote:
>On Thu, 20 Oct 2016 14:13:01 +0800
>Haozhong Zhang <haozhong.zhang@intel.com> wrote:
>
>> If a file is used as the backend of memory-backend-file and its size is
>> not identical to the property 'size', the file will be truncated. For a
>> file used as the backend of vNVDIMM, its data is expected to be
>> persistent and the truncation may corrupt the existing data.
>I wonder if it's possible just skip 'size' property in your case instead
>'notrunc' property. That way if size is not present one'd get actual size
>using get_file_size() and set 'size' to it?
>And if 'size' is provided and 'size' != file_size then error out.
>
I don't know how this can be implemented in QEMU. Specially, how does
the memory-backend-file know it's used for vNVDIMM, so that it can
skip the 'size' property?
Besides, it cannot cover the case that only a part of file is used as
the backend of vNVDIMM, which is allowed by the current implementation.
>>
>> A property 'notrunc' is added to memory-backend-file to allow users to
>> control the truncation. If 'notrunc' is on, QEMU will not truncate the
>> backend file and require the property 'size' is not larger than the file
>> size. If 'notrunc' is off, QEMU will behave as before.
>[...]
>
>>
>> #ifdef __linux__
>> +static uint64_t get_file_size(const char *path, Error **errp)
>Maybe QEMU laredy has an utility to do it that could be shared,
>CCing block maintainers.
>
>> +{
>> + int fd;
>> + struct stat st;
>> + uint64_t size = 0;
>> + Error *local_err = NULL;
>> +
>> + fd = qemu_open(path, O_RDONLY);
>> + if (fd < 0) {
>> + error_setg(&local_err, "cannot open file");
>error_setg_errno
>> + goto out;
>> + }
>> +
>> + if (stat(path, &st)) {
>fstat()
will change
>
>> + error_setg(&local_err, "cannot get file stat");
>error_setg_errno
ditto
>> + goto out_fclose;
>> + }
>> +
>> + switch (st.st_mode & S_IFMT) {
>> + case S_IFREG:
>> + size = st.st_size;
>> + break;
>> +
>> + case S_IFBLK:
>> + if (ioctl(fd, BLKGETSIZE64, &size)) {
>compilation might fail on platforms without BLKGETSIZE64,
>
BLKGETSIZE64 was first introduced by linux kernel 2.4.10. For these
linux specific code, does QEMU have any assumption for the least
kernel version? If no, I'll fallback to BLKGETSIZE if BLKGETSIZE64
fails.
>
>> + error_setg(&local_err, "cannot get size of block device");
>error_setg_errno
>> + size = 0;
>> + }
>> + break;
>> +
>> + default:
>> + error_setg(&local_err,
>> + "only block device on Linux and regular file are supported");
>what about huge page usecase, would it fall right here fail?
>
Yes, it will fail. notrunc is not necessary for the huge page case. I
could report more messages here, like "remove notrunc if hugetlbfs is used".
>> + }
>> +
>> + out_fclose:
>> + close(fd);
>> + out:
>> + error_propagate(errp, local_err);
>> + return size;
>> +}
>> +
>[...]
>
Thank you for the review!
Haozhong
next prev parent reply other threads:[~2016-10-20 13:11 UTC|newest]
Thread overview: 43+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-10-20 6:13 [Qemu-devel] [PATCH] hostmem-file: add a property 'notrunc' to avoid data corruption Haozhong Zhang
2016-10-20 6:35 ` no-reply
2016-10-20 12:34 ` Igor Mammedov
2016-10-20 13:11 ` Haozhong Zhang [this message]
2016-10-20 13:34 ` Eduardo Habkost
2016-10-20 13:47 ` Haozhong Zhang
2016-10-20 13:42 ` Igor Mammedov
2016-10-20 13:56 ` Eduardo Habkost
2016-10-20 14:15 ` Igor Mammedov
2016-10-20 14:47 ` Eduardo Habkost
2016-10-20 15:35 ` Igor Mammedov
2016-10-20 16:56 ` Eduardo Habkost
2016-10-21 9:31 ` Igor Mammedov
2016-10-21 11:53 ` Eduardo Habkost
2016-10-21 13:26 ` Igor Mammedov
2016-10-21 7:22 ` Haozhong Zhang
2016-10-21 11:07 ` Igor Mammedov
2016-10-21 11:25 ` Haozhong Zhang
2016-10-21 11:56 ` Eduardo Habkost
2016-10-20 14:22 ` Haozhong Zhang
2016-10-20 15:14 ` Eduardo Habkost
2016-10-20 13:56 ` Haozhong Zhang
2016-10-20 13:21 ` Eduardo Habkost
2016-10-20 13:33 ` Haozhong Zhang
2016-10-20 13:47 ` Eduardo Habkost
2016-10-20 14:17 ` Igor Mammedov
2016-10-20 15:15 ` Eduardo Habkost
2016-10-20 15:41 ` Igor Mammedov
2016-10-20 16:59 ` Eduardo Habkost
2016-10-21 10:28 ` Igor Mammedov
2016-10-21 11:44 ` Eduardo Habkost
2016-10-20 13:47 ` Igor Mammedov
2016-10-20 13:57 ` Eduardo Habkost
2016-10-20 14:18 ` Igor Mammedov
2016-10-20 15:00 ` Eduardo Habkost
2016-10-20 15:14 ` Igor Mammedov
2016-10-20 13:27 ` Daniel P. Berrange
2016-10-20 13:40 ` Eduardo Habkost
2016-10-20 13:54 ` Igor Mammedov
2016-10-20 13:55 ` Kevin Wolf
2016-10-24 13:10 ` Eduardo Habkost
2016-10-25 6:42 ` Haozhong Zhang
2016-10-25 10:01 ` Eduardo Habkost
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20161020131138.4gzxk5ekltkiqtq2@hz-desktop \
--to=haozhong.zhang@intel.com \
--cc=crosthwaite.peter@gmail.com \
--cc=ehabkost@redhat.com \
--cc=guangrong.xiao@linux.intel.com \
--cc=imammedo@redhat.com \
--cc=kwolf@redhat.com \
--cc=mreitz@redhat.com \
--cc=pbonzini@redhat.com \
--cc=qemu-devel@nongnu.org \
--cc=rth@twiddle.net \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).