qemu-devel.nongnu.org archive mirror
 help / color / mirror / Atom feed
From: Max Reitz <mreitz@redhat.com>
To: Vladimir Sementsov-Ogievskiy <vsementsov@virtuozzo.com>,
	qemu-block@nongnu.org, qemu-devel@nongnu.org
Cc: pbonzini@redhat.com, armbru@redhat.com, eblake@redhat.com,
	famz@redhat.com, stefanha@redhat.com, amit.shah@redhat.com,
	quintela@redhat.com, kwolf@redhat.com, peter.maydell@linaro.org,
	dgilbert@redhat.com, den@openvz.org, jsnow@redhat.com,
	lirans@il.ibm.com
Subject: Re: [Qemu-devel] [PATCH 16/17] iotests: add dirty bitmap migration test
Date: Fri, 3 Feb 2017 20:06:15 +0100	[thread overview]
Message-ID: <08110a70-355b-acb6-8a65-fd13528d4989@redhat.com> (raw)
In-Reply-To: <e25c6fb7-0d1f-a91a-9680-e206f6db2cd8@virtuozzo.com>

[-- Attachment #1: Type: text/plain, Size: 6164 bytes --]

On 03.02.2017 11:10, Vladimir Sementsov-Ogievskiy wrote:
> 02.02.2017 02:12, Max Reitz wrote:
>> On 22.11.2016 18:54, Vladimir Sementsov-Ogievskiy wrote:
>>> The test starts two vms (vm_a, vm_b), create dirty bitmap in
>>> the first one, do several writes to corresponding device and
>>> then migrate vm_a to vm_b with dirty bitmaps.
>>>
>>> Signed-off-by: Vladimir Sementsov-Ogievskiy <vsementsov@virtuozzo.com>
>>> ---
>>>   tests/qemu-iotests/169     | 86
>>> ++++++++++++++++++++++++++++++++++++++++++++++
>>>   tests/qemu-iotests/169.out |  5 +++
>>>   tests/qemu-iotests/group   |  1 +
>>>   3 files changed, 92 insertions(+)
>>>   create mode 100755 tests/qemu-iotests/169
>>>   create mode 100644 tests/qemu-iotests/169.out
>>>
>>> diff --git a/tests/qemu-iotests/169 b/tests/qemu-iotests/169
>>> new file mode 100755
>>> index 0000000..58b1ab1
>>> --- /dev/null
>>> +++ b/tests/qemu-iotests/169
>>> @@ -0,0 +1,86 @@
>>> +#!/usr/bin/env python
>>> +#
>>> +# Tests for dirty bitmaps migration.
>>> +#
>>> +# Copyright (C) Vladimir Sementsov-Ogievskiy 2015-2016
>>> +#
>>> +# This program is free software; you can redistribute it and/or modify
>>> +# it under the terms of the GNU General Public License as published by
>>> +# the Free Software Foundation; either version 2 of the License, or
>>> +# (at your option) any later version.
>>> +#
>>> +# This program is distributed in the hope that it will be useful,
>>> +# but WITHOUT ANY WARRANTY; without even the implied warranty of
>>> +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
>>> +# GNU General Public License for more details.
>>> +#
>>> +# You should have received a copy of the GNU General Public License
>>> +# along with this program.  If not, see <http://www.gnu.org/licenses/>.
>>> +#
>>> +
>>> +import os
>>> +import iotests
>>> +import time
>>> +from iotests import qemu_img
>>> +
>>> +disk_a = os.path.join(iotests.test_dir, 'disk_a')
>>> +disk_b = os.path.join(iotests.test_dir, 'disk_b')
>>> +fifo = os.path.join(iotests.test_dir, 'mig_fifo')
>>> +
>>> +class TestDirtyBitmapMigration(iotests.QMPTestCase):
>>> +
>>> +    def setUp(self):
>>> +        size = 0x400000000 # 1G
>> I can already see someone on macOS complaining that this test eats their
>> hard drive when running it for raw images... But we can still amend it
>> once somebody complains. O:-)
>>
>> I think 1 GB is not overly large, but it's reasonable to use such a
>> rather large value for this test.
>>
>>> +        os.mkfifo(fifo)
>>> +        qemu_img('create', '-f', iotests.imgfmt, disk_a, str(size))
>>> +        qemu_img('create', '-f', iotests.imgfmt, disk_b, str(size))
>>> +        self.vm_a = iotests.VM(path_suffix='a').add_drive(disk_a)
>>> +        self.vm_b = iotests.VM(path_suffix='b').add_drive(disk_b)
>>> +        self.vm_b.add_incoming_migration("exec: cat " + fifo)
>> I guess this will break if the path contains white space. Is there
>> something we can do about that?
>>
>> (You don't need to protect against quotes or something, just white
>> space.)
>>
>>> +        self.vm_a.launch()
>>> +        self.vm_b.launch()
>>> +
>>> +    def tearDown(self):
>>> +        self.vm_a.shutdown()
>>> +        self.vm_b.shutdown()
>>> +        os.remove(disk_a)
>>> +        os.remove(disk_b)
>>> +        os.remove(fifo)
>>> +
>>> +    def test_migration(self):
>>> +        granularity = 512
>>> +        regions = [
>>> +            { 'start': 0,           'count': 0x100000 },
>>> +            { 'start': 0x100000000, 'count': 0x200000  },
>>> +            { 'start': 0x399900000, 'count': 0x100000  }
>>> +            ]
>>> +
>>> +        result = self.vm_a.qmp('block-dirty-bitmap-add', node='drive0',
>>> +                               name='bitmap', granularity=granularity)
>>> +        self.assert_qmp(result, 'return', {});
>>> +
>>> +        for r in regions:
>>> +          self.vm_a.hmp_qemu_io('drive0',
>> This line isn't aligned to four spaces.
>>
>> With that fixed, and if you deem fixing the white space issue too
>> complicated:
> 
> may be, just add quotes, like
> 
> self.vm_b.add_incoming_migration("exec: cat '" + fifo + "'")

Yep, that would be fine with me.

Max

> 
> 
> ?
> 
>>
>> Reviewed-by: Max Reitz <mreitz@redhat.com>
>>
>>> +                                'write %d %d' % (r['start'],
>>> r['count']))
>>> +
>>> +        result = self.vm_a.qmp('x-debug-block-dirty-bitmap-sha256',
>>> +                               node='drive0', name='bitmap')
>>> +        sha256 = result['return']['sha256']
>>> +
>>> +        result = self.vm_a.qmp('migrate-set-capabilities',
>>> +                               capabilities=[{'capability':
>>> 'dirty-bitmaps',
>>> +                                              'state': True}])
>>> +        self.assert_qmp(result, 'return', {})
>>> +
>>> +        result = self.vm_a.qmp('migrate', uri='exec:cat>' + fifo)
>>> +        self.assertNotEqual(self.vm_a.event_wait("STOP"), None)
>>> +        self.assertNotEqual(self.vm_b.event_wait("RESUME"), None)
>>> +        time.sleep(2)
>>> +
>>> +        result = self.vm_b.qmp('x-debug-block-dirty-bitmap-sha256',
>>> +                               node='drive0', name='bitmap')
>>> +        self.assert_qmp(result, 'return/sha256', sha256);
>>> +
>>> +
>>> +if __name__ == '__main__':
>>> +    iotests.main()
>>> diff --git a/tests/qemu-iotests/169.out b/tests/qemu-iotests/169.out
>>> new file mode 100644
>>> index 0000000..ae1213e
>>> --- /dev/null
>>> +++ b/tests/qemu-iotests/169.out
>>> @@ -0,0 +1,5 @@
>>> +.
>>> +----------------------------------------------------------------------
>>> +Ran 1 tests
>>> +
>>> +OK
>>> diff --git a/tests/qemu-iotests/group b/tests/qemu-iotests/group
>>> index 866c1a0..5dc75ef 100644
>>> --- a/tests/qemu-iotests/group
>>> +++ b/tests/qemu-iotests/group
>>> @@ -162,6 +162,7 @@
>>>   159 rw auto quick
>>>   160 rw auto quick
>>>   162 auto quick
>>> +169 rw auto quick
>>>   170 rw auto quick
>>>   171 rw auto quick
>>>   172 auto
>>>
>>
> 
> 



[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 512 bytes --]

  parent reply	other threads:[~2017-02-03 19:06 UTC|newest]

Thread overview: 51+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2016-11-22 17:54 [Qemu-devel] [PATCH v4 00/17] Dirty bitmaps postcopy migration Vladimir Sementsov-Ogievskiy
2016-11-22 17:54 ` [Qemu-devel] [PATCH 01/17] migration: add has_postcopy savevm handler Vladimir Sementsov-Ogievskiy
2016-11-22 17:54 ` [Qemu-devel] [PATCH 02/17] migration: fix ram_save_pending Vladimir Sementsov-Ogievskiy
2016-11-22 17:54 ` [Qemu-devel] [PATCH 03/17] migration: split common postcopy out of ram postcopy Vladimir Sementsov-Ogievskiy
2017-01-24  9:24   ` Juan Quintela
2017-01-24  9:35     ` Vladimir Sementsov-Ogievskiy
2017-01-24 19:53       ` Dr. David Alan Gilbert
2017-01-31 14:04         ` Vladimir Sementsov-Ogievskiy
2017-01-31 15:15           ` Dr. David Alan Gilbert
2017-02-01 11:06         ` Vladimir Sementsov-Ogievskiy
2017-02-03 11:13           ` Vladimir Sementsov-Ogievskiy
2017-02-06 11:30             ` Dr. David Alan Gilbert
2016-11-22 17:54 ` [Qemu-devel] [PATCH 04/17] migration: introduce postcopy-only pending Vladimir Sementsov-Ogievskiy
2017-01-24  9:17   ` Juan Quintela
2016-11-22 17:54 ` [Qemu-devel] [PATCH 05/17] block: add bdrv_next_dirty_bitmap() Vladimir Sementsov-Ogievskiy
2016-11-22 17:54 ` [Qemu-devel] [PATCH 06/17] block: add bdrv_dirty_bitmap_enable_successor() Vladimir Sementsov-Ogievskiy
2017-02-01 22:29   ` Max Reitz
2016-11-22 17:54 ` [Qemu-devel] [PATCH 07/17] qapi: add dirty-bitmaps migration capability Vladimir Sementsov-Ogievskiy
2017-01-24  9:18   ` Juan Quintela
2016-11-22 17:54 ` [Qemu-devel] [PATCH 08/17] block/dirty-bitmap: add bdrv_dirty_bitmap_release_successor Vladimir Sementsov-Ogievskiy
2017-02-01 22:29   ` Max Reitz
2016-11-22 17:54 ` [Qemu-devel] [PATCH 09/17] migration: include migrate_dirty_bitmaps in migrate_postcopy Vladimir Sementsov-Ogievskiy
2017-01-24  9:29   ` Juan Quintela
2016-11-22 17:54 ` [Qemu-devel] [PATCH 10/17] migration/qemu-file: add qemu_put_counted_string() Vladimir Sementsov-Ogievskiy
2017-01-24  9:29   ` Juan Quintela
2016-11-22 17:54 ` [Qemu-devel] [PATCH 11/17] migration: add is_active_iterate handler Vladimir Sementsov-Ogievskiy
2017-01-24  9:48   ` Juan Quintela
2017-02-07 12:44     ` Vladimir Sementsov-Ogievskiy
2016-11-22 17:54 ` [Qemu-devel] [PATCH 12/17] migration: add postcopy migration of dirty bitmaps Vladimir Sementsov-Ogievskiy
2017-01-24  9:40   ` Juan Quintela
2017-02-01 23:02   ` Max Reitz
2016-11-22 17:54 ` [Qemu-devel] [PATCH 13/17] iotests: add add_incoming_migration to VM class Vladimir Sementsov-Ogievskiy
2016-11-22 17:54 ` [Qemu-devel] [PATCH 14/17] qmp: add x-debug-block-dirty-bitmap-sha256 Vladimir Sementsov-Ogievskiy
2016-11-22 17:54 ` [Qemu-devel] [PATCH 15/17] iotests: add default node-name Vladimir Sementsov-Ogievskiy
2017-01-09 15:57   ` Denis V. Lunev
2017-01-09 16:04     ` Vladimir Sementsov-Ogievskiy
2016-11-22 17:54 ` [Qemu-devel] [PATCH 16/17] iotests: add dirty bitmap migration test Vladimir Sementsov-Ogievskiy
2017-02-01 23:12   ` Max Reitz
2017-02-03 10:10     ` Vladimir Sementsov-Ogievskiy
2017-02-03 11:08       ` Vladimir Sementsov-Ogievskiy
2017-02-03 19:07         ` Max Reitz
2017-02-03 19:06       ` Max Reitz [this message]
2016-11-22 17:54 ` [Qemu-devel] [PATCH 17/17] iotests: add dirty bitmap postcopy test Vladimir Sementsov-Ogievskiy
2017-02-01 23:21   ` Max Reitz
2016-12-21 14:58 ` [Qemu-devel] ping Re: [PATCH v4 00/17] Dirty bitmaps postcopy migration Vladimir Sementsov-Ogievskiy
2017-01-23 11:48 ` [Qemu-devel] ping2 " Vladimir Sementsov-Ogievskiy
2017-01-23 17:27   ` John Snow
2017-01-24  9:49     ` Juan Quintela
  -- strict thread matches above, loose matches on Subject: below --
2017-02-13  9:54 [Qemu-devel] [PATCH v6 " Vladimir Sementsov-Ogievskiy
2017-02-13  9:54 ` [Qemu-devel] [PATCH 16/17] iotests: add dirty bitmap migration test Vladimir Sementsov-Ogievskiy
2017-02-07 15:05 [Qemu-devel] [PATCH v5 00/17] Dirty bitmaps postcopy migration Vladimir Sementsov-Ogievskiy
2017-02-07 15:05 ` [Qemu-devel] [PATCH 16/17] iotests: add dirty bitmap migration test Vladimir Sementsov-Ogievskiy
2016-11-21 15:29 [Qemu-devel] [PATCH v3 00/17] Dirty bitmaps postcopy migration Vladimir Sementsov-Ogievskiy
2016-11-21 15:29 ` [Qemu-devel] [PATCH 16/17] iotests: add dirty bitmap migration test Vladimir Sementsov-Ogievskiy

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=08110a70-355b-acb6-8a65-fd13528d4989@redhat.com \
    --to=mreitz@redhat.com \
    --cc=amit.shah@redhat.com \
    --cc=armbru@redhat.com \
    --cc=den@openvz.org \
    --cc=dgilbert@redhat.com \
    --cc=eblake@redhat.com \
    --cc=famz@redhat.com \
    --cc=jsnow@redhat.com \
    --cc=kwolf@redhat.com \
    --cc=lirans@il.ibm.com \
    --cc=pbonzini@redhat.com \
    --cc=peter.maydell@linaro.org \
    --cc=qemu-block@nongnu.org \
    --cc=qemu-devel@nongnu.org \
    --cc=quintela@redhat.com \
    --cc=stefanha@redhat.com \
    --cc=vsementsov@virtuozzo.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).