From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:37653) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1aJ1Ay-00061d-FS for qemu-devel@nongnu.org; Tue, 12 Jan 2016 10:48:10 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1aJ1At-0006aM-E9 for qemu-devel@nongnu.org; Tue, 12 Jan 2016 10:48:04 -0500 References: <1452578622-4492-1-git-send-email-den@openvz.org> <20160112141607.GD4841@noname.redhat.com> <569514E7.8090101@redhat.com> <20160112152051.GG4841@noname.redhat.com> From: "Denis V. Lunev" Message-ID: <5695201C.2050504@openvz.org> Date: Tue, 12 Jan 2016 18:47:40 +0300 MIME-Version: 1.0 In-Reply-To: <20160112152051.GG4841@noname.redhat.com> Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: [Qemu-devel] [PATCH 1/1] blk: do not select PFLASH device for internal snapshot List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: Kevin Wolf , Paolo Bonzini Cc: Laszlo Ersek , qemu-devel@nongnu.org, qemu-block@nongnu.org On 01/12/2016 06:20 PM, Kevin Wolf wrote: > Am 12.01.2016 um 15:59 hat Paolo Bonzini geschrieben: >> >> On 12/01/2016 15:16, Kevin Wolf wrote: >>>> Thus we should avoid selection of "pflash" drives for VM state saving. >>>> >>>> For now "pflash" is read-write raw image as it configured by libvirt. >>>> Thus there are no such images in the field and we could safely disable >>>> ability to save state to those images inside QEMU. >>> This is obviously broken. If you write to the pflash, then it needs to >>> be snapshotted in order to keep a consistent state. >>> >>> If you want to avoid snapshotting the image, make it read-only and it >>> will be skipped even today. >> Sort of. The point of having flash is to _not_ make it read-only, so >> that is not a solution. >> >> Flash is already being snapshotted as part of saving RAM state. In >> fact, for this reason the device (at least the one used with OVMF; I >> haven't checked other pflash devices) can simply save it back to disk >> on the migration destination, without the need to use "migrate -b" or >> shared storage. >> [...] >> I don't like very much using IF_PFLASH this way, which is why I hadn't >> replied to the patch so far---I hadn't made up my mind about *what* to >> suggest instead, or whether to just accept it. However, it does work. >> >> Perhaps a separate "I know what I am doing" skip-snapshot option? Or >> a device callback saying "not snapshotting this is fine"? > Boy, is this ugly... > > What do you do with disk-only snapshots? The recovery only works as long > as you have VM state. > > Kevin actually I am in a bit of trouble :( I understand that this is ugly, but I would like to make working 'virsh snapshot' for OVFM VMs. This is necessary for us to make a release. Currently libvirt guys generate XML in the following way: hvm /usr/share/OVMF/OVMF_CODE_new.fd /var/lib/libvirt/qemu/nvram/f20efi_VARS.fd This results in: qemu -drive file=/usr/share/OVMF/OVMF_CODE_new.fd,if=pflash,format=raw,unit=0,readonly=on \ -drive file=/var/lib/libvirt/qemu/nvram/f20efi_VARS.fd,if=pflash,format=raw,unit=1 This obviously can not pass check in bdrv_all_can_snapshot() as 'pflash' is RW and raw, i.e. can not be snapshoted. They have discussed the switch to the following command line: qemu -drive file=/usr/share/OVMF/OVMF_CODE_new.fd,if=pflash,format=raw,unit=0,readonly=on \ -drive file=/var/lib/libvirt/qemu/nvram/f20efi_VARS.fd.qcow2,if=pflash,format=qcow2,unit=1 and say that in this case VM state could fall into PFLASH drive which is should not be big as the location of the file is different. This means that I am doomed here. Either we should force libvirt people to forget about their opinion that pflash should be small which I am unable to do or I should invent a way to ban VM state saving into pflash. OK. There are 2 options. 1) Ban pflash as it was done. 2) Add 'no-vmstate' flag to -drive (invented just now). Den P.S. Here is a summary that my colleague has receiver from libvirt list. -------- Forwarded Message -------- Subject: Re: Snapshotting OVMF guests Date: Mon, 11 Jan 2016 13:56:29 +0100 From: Laszlo Ersek To: Dmitry Andreev CC: Michal Privoznik , Markus Armbruster Hello Dmitry, (Cc: Markus.) > https://bugzilla.redhat.com/show_bug.cgi?id=1180955 I have now re-read that BZ. In comment 7 I wrote, > However, if Michal's v2 libvirt patchset was applied, and the varstore > drive was qcow2, then qemu would dump the *entire VM state*, including > memory and device state, into the varstore drive (the 6th drive) under > the command line visible in comment #0. That's *completely* bogus; > much worse than rejecting the snapshot request. It is bogus for size and configuration reasons. It is true that a pflash drive is "just a drive" *internally* to QEMU. It is also true that it more or less takes the same -drive options as any other *disk* drive. But those facts are just implementation details. The relevant trait of pflash storage files is that they are not *disk images*, on the libvirt domain XML level. They are not created in storage pools, you cannot specify their caching attributes, you don't specify their guest-visible frontend in separation (like virtio-blk / virtio-scsi / pflash). Those details are hidden (on purpose). Consequently, pflash storage files are expected to be *small* in size (in practice: identically sized to the varstore template they are instantiated from). They are created under /var/lib/libvirt/qemu/nvram. Although you can edit their path in the domain XML, they are not considered disks. This is also reflected in the way they are migrated. They are not migrated with NBD / live storage migration / blockdev migration. Instead, on the target host, when the in-migration completes, the entire contents of the flash drive are written out in one shot to the target host file. Please see: - the pflash_post_load() function in QEMU's "hw/block/pflash_cfi01.c", - and QEMU commit 4c0cfc72. Storing large amounts or data in the pflash storage file would be incompatible with this concept. ... We also had an internal team discussion at Red Hat about this. I won't re-read it now, but I think I can share a part of my own BZ comment 9. In that comment I tried to summarize the internal discussion more or less for myself. (I made that comment private because it contained RH product related bits too -- I won't quote those bits now.) So from comment 9: > [...] the upshot from [the internal discussion] seems to be that > "savevm" is *in general* inappropriate for any non-trivial -drive > setup and/or for a -drive setup that is subject to change (eg. > reordering on the command line). Comment 11 in the BZ shows that we plan to document the limitation that internal snapshotting will never be supported for OVMF. External snapshotting *should* be, but it isn't yet either (because, at least at the time of writing the BZ comment, reverting to external snapshots wasn't supported). Bottom line, pflash is implemented as a drive internally, but it is not considered a *disk* drive, for migration, snapshotting, being stored in pools, or for storing large amounts of data. I hope this helps. If you'd like to enable snapshotting for OVMF virtual machines, that would be awesome; but I think it would require implementing the above-mentioned "revert to external snapshot" functionality. Thanks! Laszlo