[Qemu-devel] [PULL 00/12] migration queue

[Qemu-devel] [PULL 00/12] migration queue

[Juan Quintela]

Hi

Anthony,  please pull.

- improve error message (Alon)
- Make zero pages to work again (Peter Lieven)
- First 10 patches of RDMA support

Thanks,  Juan.



The following changes since commit 3e5087329489e0beceecf3426f1216619821937f:

  Merge remote-tracking branch 'pmaydell/arm-devs.for-upstream' into staging (2013-06-25 14:14:13 -0500)

are available in the git repository at:


  git://github.com/juanquintela/qemu.git migration.next

for you to fetch changes up to 60d9222c8f50c3e5dd3df9ee84ddd1d1c4b35389:

  rdma: introduce capability x-rdma-pin-all (2013-06-27 02:38:36 +0200)

----------------------------------------------------------------
Alon Levy (1):
      arch_init/ram_load: add error message for block length mismatch

Michael R. Hines (9):
      rdma: add documentation
      rdma: introduce qemu_update_position()
      rdma: export yield_until_fd_readable()
      rdma: export throughput w/ MigrationStats QMP
      rdma: introduce qemu_file_mode_is_not_valid()
      rdma: export qemu_fflush()
      rdma: introduce qemu_ram_foreach_block()
      rdma: new QEMUFileOps hooks
      rdma: introduce capability x-rdma-pin-all

Peter Lieven (2):
      Revert "migration: do not sent zero pages in bulk stage"
      migration: do not overwrite zero pages

 arch_init.c                   |  42 +++--
 docs/rdma.txt                 | 415 ++++++++++++++++++++++++++++++++++++++++++
 exec.c                        |   9 +
 hmp.c                         |   2 +
 include/block/coroutine.h     |   6 +
 include/exec/cpu-common.h     |   5 +
 include/migration/migration.h |  25 +++
 include/migration/qemu-file.h |  32 ++++
 migration.c                   |  15 ++
 qapi-schema.json              |  12 +-
 qemu-coroutine-io.c           |  23 +++
 savevm.c                      | 114 ++++++++----
 12 files changed, 647 insertions(+), 53 deletions(-)
 create mode 100644 docs/rdma.txt

Re: [Qemu-devel] [PULL 00/12] migration queue

[Peter Maydell]

On 27 June 2013 11:37, Juan Quintela <quintela@redhat.com> wrote:
> Anthony,  please pull.
>
> - improve error message (Alon)
> - Make zero pages to work again (Peter Lieven)
> - First 10 patches of RDMA support

Hi. I'm afraid this broke compilation of linux-user targets:

  CC    arm-linux-user/exec.o
In file included from
/home/petmay01/linaro/qemu-from-laptop/qemu/include/hw/hw.h:14:0,
                 from /home/petmay01/linaro/qemu-from-laptop/qemu/exec.c:30:
/home/petmay01/linaro/qemu-from-laptop/qemu/include/migration/qemu-file.h:80:32:
error: unknown type name ‘ram_addr_t’
/home/petmay01/linaro/qemu-from-laptop/qemu/include/migration/qemu-file.h:81:32:
error: unknown type name ‘ram_addr_t’
/home/petmay01/linaro/qemu-from-laptop/qemu/include/migration/qemu-file.h:94:5:
error: unknown type name ‘QEMURamSaveFunc’
/home/petmay01/linaro/qemu-from-laptop/qemu/exec.c:2634:29: error:
unknown type name ‘RAMBlockIterFunc’
make[1]: *** [exec.o] Error 1

git bisect says the offending commit is bd2fa51fcd (and then
43487c67 adds further errors).

thanks
-- PMM

Re: [Qemu-devel] [PULL 00/12] migration queue

[Peter Maydell]

On 27 June 2013 11:37, Juan Quintela <quintela@redhat.com> wrote:
> Anthony,  please pull.
>
> - improve error message (Alon)
> - Make zero pages to work again (Peter Lieven)
> - First 10 patches of RDMA support

Hi; could you adjust your pullrequest scripts to retransmit
the patches as followup emails to the pullreq mail, please?
It makes it easier to follow up when patches within a merge
turn out to have issues.

(cf http://wiki.qemu.org/Contribute/SubmitAPullRequest
and previous on-list discussion.)

thanks
-- PMM

Re: [Qemu-devel] [PULL 00/12] migration queue

[Michael R. Hines]

On 06/27/2013 03:20 PM, Peter Maydell wrote:
> On 27 June 2013 11:37, Juan Quintela <quintela@redhat.com> wrote:
>> Anthony,  please pull.
>>
>> - improve error message (Alon)
>> - Make zero pages to work again (Peter Lieven)
>> - First 10 patches of RDMA support
> Hi; could you adjust your pullrequest scripts to retransmit
> the patches as followup emails to the pullreq mail, please?
> It makes it easier to follow up when patches within a merge
> turn out to have issues.
>
> (cf http://wiki.qemu.org/Contribute/SubmitAPullRequest
> and previous on-list discussion.)
>
> thanks
> -- PMM
>

Ooops..... forgot to move the #endif in the patch - I never tried any of 
the other compilation targets before = )

Will send a fix ASAP in the next patch series.

- Michael

Re: [Qemu-devel] [PULL 00/12] migration queue

[Peter Maydell]

On 28 June 2013 06:27, Juan Quintela <quintela@redhat.com> wrote:
> Sorry,  actually my problem was dtc,  that for some reason got wrong :-(
>
> $ time make -j3 -C /scratch/tmp/all/make: Entering directory `/scratch/tmp/all'
> config-host.mak is out-of-date, running configure
>
> ERROR: DTC not present. Your options:
>          (1) Preferred: Install the DTC devel package
>          (2) Fetch the DTC submodule, using:
>              git submodule update --init dtc

> It used to compile on this machine (I had installed the dtc package,  as
> this used to work,  something else got broken).

Yeah, there's been a recent change that means we no longer
treat most system dtc as valid (because they don't ship
libfdt_env.h); you need to either upgrade your libfdt,
or just use the submodule.

thanks
-- PMM

Re: [Qemu-devel] [PULL 00/12] migration queue

[Juan Quintela]

Peter Maydell <peter.maydell@linaro.org> wrote:
> On 27 June 2013 11:37, Juan Quintela <quintela@redhat.com> wrote:
>> Anthony,  please pull.
>>
>> - improve error message (Alon)
>> - Make zero pages to work again (Peter Lieven)
>> - First 10 patches of RDMA support
>
> Hi; could you adjust your pullrequest scripts to retransmit
> the patches as followup emails to the pullreq mail, please?
> It makes it easier to follow up when patches within a merge
> turn out to have issues.
>
> (cf http://wiki.qemu.org/Contribute/SubmitAPullRequest
> and previous on-list discussion.)

Sorry,  actually my problem was dtc,  that for some reason got wrong :-(

$ time make -j3 -C /scratch/tmp/all/make: Entering directory `/scratch/tmp/all'
config-host.mak is out-of-date, running configure

ERROR: DTC not present. Your options:
         (1) Preferred: Install the DTC devel package
         (2) Fetch the DTC submodule, using:
             git submodule update --init dtc

make: *** [config-host.mak] Error 1
make: Leaving directory `/scratch/tmp/all'

real	0m4.273s
user	0m2.568s
sys	0m1.044s


It used to compile on this machine (I had installed the dtc package,  as
this used to work,  something else got broken).

Sorry about this.

Later,  Juan.

Re: [Qemu-devel] [PULL 00/12] migration queue

[Juan Quintela]

Juan Quintela <quintela@redhat.com> wrote:
> Peter Maydell <peter.maydell@linaro.org> wrote:
>> On 27 June 2013 11:37, Juan Quintela <quintela@redhat.com> wrote:
>>> Anthony,  please pull.
>>>
>>> - improve error message (Alon)
>>> - Make zero pages to work again (Peter Lieven)
>>> - First 10 patches of RDMA support
>>
>> Hi; could you adjust your pullrequest scripts to retransmit
>> the patches as followup emails to the pullreq mail, please?
>> It makes it easier to follow up when patches within a merge
>> turn out to have issues.
>>
>> (cf http://wiki.qemu.org/Contribute/SubmitAPullRequest
>> and previous on-list discussion.)
>
> Sorry,  actually my problem was dtc,  that for some reason got wrong :-(
>
> $ time make -j3 -C /scratch/tmp/all/make: Entering directory `/scratch/tmp/all'
> config-host.mak is out-of-date, running configure
>
> ERROR: DTC not present. Your options:
>          (1) Preferred: Install the DTC devel package
>          (2) Fetch the DTC submodule, using:
>              git submodule update --init dtc
>
> make: *** [config-host.mak] Error 1
> make: Leaving directory `/scratch/tmp/all'
>
> real	0m4.273s
> user	0m2.568s
> sys	0m1.044s
>
>
> It used to compile on this machine (I had installed the dtc package,  as
> this used to work,  something else got broken).
>
> Sorry about this.

I mean that I didn't compile all arches due to this other error.

Re: [Qemu-devel] [PULL 00/12] migration queue

[Paolo Bonzini]

Il 27/06/2013 12:37, Juan Quintela ha scritto:
> Peter Lieven (2):
>       Revert "migration: do not sent zero pages in bulk stage"
>       migration: do not overwrite zero pages

These have to go to 1.5.2.

Paolo

[Qemu-devel] [PULL 00/12] Migration queue

[Juan Quintela]

The following changes since commit 19b599f7664b2ebfd0f405fb79c14dd241557452:

  Merge remote-tracking branch 'remotes/armbru/tags/pull-error-2018-08-27-v2' into staging (2018-08-27 16:44:20 +0100)

are available in the Git repository at:

  git://github.com/juanquintela/qemu.git tags/migration/20180913

for you to fetch changes up to 418fe4f69648b4f3f0afd2588926deafac81cfe8:

  tests/migration: Enable the migration test on s390x, too (2018-09-13 14:06:26 +0200)

----------------------------------------------------------------
migration/next for 20180913

Hi this patchset has all pending migration queue that I have (It
superceedes the previous one).

- fix rdma_return_path (david)

- s390 migration-test (thomas)
  I ported it to the nema Makefile architecuter
  Please thomas, confirm that you agree with my changes

- aarch64 migration-test (wei)
- lots of compression fixes (xiao)

Please, apply.

----------------------------------------------------------------
Dr. David Alan Gilbert (1):
      migration/rdma: Fix uninitialised rdma_return_path

Jose Ricardo Ziviani (1):
      Add a hint message to loadvm and exits on failure

Thomas Huth (1):
      tests/migration: Enable the migration test on s390x, too

Wei Huang (4):
      tests/migration: Convert x86 boot block compilation script into Makefile
      tests/migration: Support cross compilation in generating boot header file
      tests/migration: Add migration-test header file
      tests: Add migration test for aarch64

Xiao Guangrong (5):
      migration: fix calculating xbzrle_counters.cache_miss_rate
      migration: handle the error condition properly
      migration: do not flush_compressed_data at the end of iteration
      migration: show the statistics of compression
      migration: use save_page_use_compression in flush_compressed_data

 hmp.c                                              |  13 +
 migration/migration.c                              |  12 +
 migration/ram.c                                    | 103 +++--
 migration/ram.h                                    |   1 +
 migration/rdma.c                                   |   2 +-
 migration/savevm.c                                 |   4 +-
 qapi/migration.json                                |  26 +-
 tests/Makefile.include                             |   2 +
 tests/migration-test.c                             |  83 +++-
 tests/migration/Makefile                           |  35 ++
 tests/migration/aarch64/Makefile                   |  20 +
 tests/migration/aarch64/a-b-kernel.S               |  75 ++++
 tests/migration/aarch64/a-b-kernel.h               |  19 +
 tests/migration/i386/Makefile                      |  22 ++
 .../{x86-a-b-bootblock.s => i386/a-b-bootblock.S}  |   4 -
 .../{x86-a-b-bootblock.h => i386/a-b-bootblock.h}  |   8 +-
 tests/migration/migration-test.h                   |  34 ++
 tests/migration/rebuild-x86-bootblock.sh           |  33 --
 tests/migration/s390x/Makefile                     |  22 ++
 tests/migration/s390x/a-b-bios.c                   |  35 ++
 tests/migration/s390x/a-b-bios.h                   | 427 +++++++++++++++++++++
 vl.c                                               |   1 +
 22 files changed, 899 insertions(+), 82 deletions(-)
 create mode 100644 tests/migration/Makefile
 create mode 100644 tests/migration/aarch64/Makefile
 create mode 100644 tests/migration/aarch64/a-b-kernel.S
 create mode 100644 tests/migration/aarch64/a-b-kernel.h
 create mode 100644 tests/migration/i386/Makefile
 rename tests/migration/{x86-a-b-bootblock.s => i386/a-b-bootblock.S} (93%)
 rename tests/migration/{x86-a-b-bootblock.h => i386/a-b-bootblock.h} (92%)
 create mode 100644 tests/migration/migration-test.h
 delete mode 100755 tests/migration/rebuild-x86-bootblock.sh
 create mode 100644 tests/migration/s390x/Makefile
 create mode 100644 tests/migration/s390x/a-b-bios.c
 create mode 100644 tests/migration/s390x/a-b-bios.h

[Qemu-devel] [PULL 00/12] migration queue

[Dr. David Alan Gilbert (git)]

From: "Dr. David Alan Gilbert" <dgilbert@redhat.com>

The following changes since commit 89ea03a7dc83ca36b670ba7f787802791fcb04b1:

  Merge remote-tracking branch 'remotes/huth-gitlab/tags/m68k-pull-2019-09-07' into staging (2019-09-09 09:48:34 +0100)

are available in the Git repository at:

  git://github.com/dagrh/qemu.git tags/pull-migration-20190912a

for you to fetch changes up to 268dcd46ae6d608a4ce93b191b51a318504bf1fb:

  migration: fix one typo in comment of function migration_total_bytes() (2019-09-12 11:25:06 +0100)

----------------------------------------------------------------
Migration pull 2019-09-12

New feature:
  UUID validation check from Yury Kotov

plus a bunch of fixes.

----------------------------------------------------------------
Dr. David Alan Gilbert (3):
      hw/net/vmxnet3: Fix leftover unregister_savevm
      migration: register_savevm_live doesn't need dev
      qemu-file: Rework old qemu_fflush comment

Ivan Ren (1):
      migration: multifd_send_thread always post p->sem_sync when error happen

Peter Xu (1):
      migration: Fix postcopy bw for recovery

Wei Yang (4):
      migration: cleanup check on ops in savevm.handlers iterations
      migration/qemu-file: remove check on writev_buffer in qemu_put_compression_data
      migration/qemu-file: fix potential buf waste for extra buf_index adjustment
      migration: fix one typo in comment of function migration_total_bytes()

Yury Kotov (3):
      migration: Add validate-uuid capability
      tests/libqtest: Allow setting expected exit status
      tests/migration: Add a test for validate-uuid capability

 docs/devel/migration.rst       |   3 +-
 hw/net/vmxnet3.c               |   3 -
 hw/ppc/spapr.c                 |   2 +-
 hw/s390x/s390-skeys.c          |   2 +-
 hw/s390x/s390-stattrib.c       |   2 +-
 hw/s390x/tod.c                 |   2 +-
 include/migration/register.h   |   3 +-
 migration/block-dirty-bitmap.c |   2 +-
 migration/block.c              |   2 +-
 migration/migration.c          |  14 ++++-
 migration/migration.h          |   1 +
 migration/qemu-file.c          |  50 ++++++++-------
 migration/ram.c                |   7 +--
 migration/savevm.c             |  80 ++++++++++++++---------
 net/slirp.c                    |   2 +-
 qapi/migration.json            |   5 +-
 tests/libqtest.c               |  36 ++++++-----
 tests/libqtest.h               |   9 +++
 tests/migration-test.c         | 140 ++++++++++++++++++++++++++++++++---------
 19 files changed, 249 insertions(+), 116 deletions(-)

Re: [Qemu-devel] [PULL 00/12] migration queue

[Peter Maydell]

On Thu, 12 Sep 2019 at 15:10, Dr. David Alan Gilbert (git)
<dgilbert@redhat.com> wrote:
>
> From: "Dr. David Alan Gilbert" <dgilbert@redhat.com>
>
> The following changes since commit 89ea03a7dc83ca36b670ba7f787802791fcb04b1:
>
>   Merge remote-tracking branch 'remotes/huth-gitlab/tags/m68k-pull-2019-09-07' into staging (2019-09-09 09:48:34 +0100)
>
> are available in the Git repository at:
>
>   git://github.com/dagrh/qemu.git tags/pull-migration-20190912a
>
> for you to fetch changes up to 268dcd46ae6d608a4ce93b191b51a318504bf1fb:
>
>   migration: fix one typo in comment of function migration_total_bytes() (2019-09-12 11:25:06 +0100)
>
> ----------------------------------------------------------------
> Migration pull 2019-09-12
>
> New feature:
>   UUID validation check from Yury Kotov
>
> plus a bunch of fixes.
>


Applied, thanks.

Please update the changelog at https://wiki.qemu.org/ChangeLog/4.2
for any user-visible changes.

-- PMM