[Qemu-devel] [PULL v2 00/20] testing/next for 4.1

[Qemu-devel] [PULL v2 00/20] testing/next for 4.1

[Alex Bennée]

The following changes since commit 7d0e02405fc02a181319b1ab8681d2f72246b7c6:

  Merge remote-tracking branch 'remotes/vivier2/tags/trivial-patches-pull-request' into staging (2019-07-01 17:40:32 +0100)

are available in the Git repository at:

  https://github.com/stsquad/qemu.git tags/pull-testing-next-020719-2

for you to fetch changes up to 83fb8fd71de2f80afd4ec83761357d5f0dacd9c9:

  migration: move port_attr inside CONFIG_LINUX (2019-07-02 07:52:35 +0100)

----------------------------------------------------------------
Various testing fixes:

   - tests/vm updates and clean-ups
   - tests/vm serial autobuild on host
   - ensure MacOS builds do "brew update"
   - ensure we test --static user builds
   - fix hyperv compile failure
   - fix missing var warning for OpenBSD (v2)

This brings my testing back to green on all CI services. Please note
the BSD installs will throw out some warnings during the setup phase.
They shouldn't re-occur once the images are built.

----------------------------------------------------------------
Alex Bennée (4):
      .travis.yml: default the --disable-system build to --static
      .travis.yml: force a brew update for MacOS builds
      target/i386: fix feature check in hyperv-stub.c
      migration: move port_attr inside CONFIG_LINUX

Cleber Rosa (4):
      tests/vm: avoid extra compressed image copy
      tests/vm: avoid image presence check and removal
      tests/vm: pin ubuntu.i386 image
      tests/vm: add source repos on ubuntu.i386

Gerd Hoffmann (11):
      tests/vm: send proxy environment variables over ssh
      tests/vm: use ssh with pty unconditionally
      tests/vm: run test builds on snapshot
      tests/vm: proper guest shutdown
      tests/vm: add vm-boot-{ssh,serial}-<guest> targets
      tests/vm: serial console support helpers
      tests/vm: openbsd autoinstall, using serial console
      tests/vm: freebsd autoinstall, using serial console
      tests/vm: netbsd autoinstall, using serial console
      tests/vm: fedora autoinstall, using serial console
      tests/vm: ubuntu.i386: apt proxy setup

Philippe Mathieu-Daudé (1):
      Makefile: Rename the 'vm-test' target as 'vm-help'

 .travis.yml               |   3 +-
 Makefile                  |   4 +-
 docs/devel/testing.rst    |   4 +-
 migration/rdma.c          |   3 +-
 target/i386/hyperv-stub.c |   2 +-
 tests/vm/Makefile.include |  28 ++++++-
 tests/vm/basevm.py        | 135 ++++++++++++++++++++++++++++-----
 tests/vm/centos           |   6 +-
 tests/vm/fedora           | 189 ++++++++++++++++++++++++++++++++++++++++++++++
 tests/vm/freebsd          | 180 ++++++++++++++++++++++++++++++++++++++++---
 tests/vm/netbsd           | 187 ++++++++++++++++++++++++++++++++++++++++++---
 tests/vm/openbsd          | 159 ++++++++++++++++++++++++++++++++++----
 tests/vm/ubuntu.i386      |  11 ++-
 13 files changed, 842 insertions(+), 69 deletions(-)
 create mode 100755 tests/vm/fedora

-- 
2.20.1

Re: [Qemu-devel] [PULL v2 00/20] testing/next for 4.1

[Peter Maydell]

On Tue, 2 Jul 2019 at 11:25, Alex Bennée <alex.bennee@linaro.org> wrote:
>
> The following changes since commit 7d0e02405fc02a181319b1ab8681d2f72246b7c6:
>
>   Merge remote-tracking branch 'remotes/vivier2/tags/trivial-patches-pull-request' into staging (2019-07-01 17:40:32 +0100)
>
> are available in the Git repository at:
>
>   https://github.com/stsquad/qemu.git tags/pull-testing-next-020719-2
>
> for you to fetch changes up to 83fb8fd71de2f80afd4ec83761357d5f0dacd9c9:
>
>   migration: move port_attr inside CONFIG_LINUX (2019-07-02 07:52:35 +0100)
>
> ----------------------------------------------------------------
> Various testing fixes:
>
>    - tests/vm updates and clean-ups
>    - tests/vm serial autobuild on host
>    - ensure MacOS builds do "brew update"
>    - ensure we test --static user builds
>    - fix hyperv compile failure
>    - fix missing var warning for OpenBSD (v2)
>
> This brings my testing back to green on all CI services. Please note
> the BSD installs will throw out some warnings during the setup phase.
> They shouldn't re-occur once the images are built.
>

NetBSD vm run seemed to get stuck. Last thing in the log I have is
con recv: Jul  2 19:34:02 localhost savecore: /dev/rld0b: Device not configured
con recv: Starting local daemons:.
con recv: Updating motd.
con recv: Starting powerd.
con recv: Starting sshd.
con recv: Starting inetd.
con recv: Starting cron.
con recv: The following components reported failures:
con recv:     /etc/rc.d/swap2
con recv: See /var/run/rc.log for more information.
con recv: Tue Jul  2 19:34:03 UTC 2019
con recv: NetBSD/amd64 (localhost) (console)
con recv: login:
DEBUG:root:ssh_cmd: ssh -q -t -o StrictHostKeyChecking=no -o
UserKnownHostsFile=/dev/null -o ConnectTimeout=1 -p 33857 -i
/home/peter.maydell/qemu-netbsd/build/vm-test-9eyth5v7.tmp/id_rsa -o
SendEnv=https_proxy -o SendEnv=http_proxy -o SendEnv=ftp_proxy -o
SendEnv=no_proxy qemu@127.0.0.1 exit 0
### Installing packages ...
DEBUG:root:ssh_cmd: ssh -q -t -o StrictHostKeyChecking=no -o
UserKnownHostsFile=/dev/null -o ConnectTimeout=1 -p 33857 -i
/home/peter.maydell/qemu-netbsd/build/vm-test-9eyth5v7.tmp/id_rsa -o
SendEnv=https_proxy -o SendEnv=http_proxy -o SendEnv=ftp_proxy -o
SendEnv=no_proxy root@127.0.0.1 pkgin update

processing remote summary
(http://ftp.NetBSD.org/pub/pkgsrc/packages/NetBSD/amd64/8.0/All)...
database for http://ftp.NetBSD.org/pub/pkgsrc/packages/NetBSD/amd64/8.0/All
is up-to-date
DEBUG:root:ssh_cmd: ssh -q -t -o StrictHostKeyChecking=no -o
UserKnownHostsFile=/dev/null -o ConnectTimeout=1 -p 33857 -i
/home/peter.maydell/qemu-netbsd/build/vm-test-9eyth5v7.tmp/id_rsa -o
SendEnv=https_proxy -o SendEnv=http_proxy -o SendEnv=ftp_proxy -o
SendEnv=no_proxy root@127.0.0.1 pkgin -y install git-base pkgconf xz
python37 bash gmake gsed flex bison gnutls jpeg png SDL2 gtk3+
libxkbcommon

and then nothing more. I might try it again later.

thanks
-- PMM

Re: [Qemu-devel] [PULL v2 00/20] testing/next for 4.1

[Alex Bennée]

Peter Maydell <peter.maydell@linaro.org> writes:

> On Tue, 2 Jul 2019 at 11:25, Alex Bennée <alex.bennee@linaro.org> wrote:
>>
>> The following changes since commit 7d0e02405fc02a181319b1ab8681d2f72246b7c6:
>>
>>   Merge remote-tracking branch 'remotes/vivier2/tags/trivial-patches-pull-request' into staging (2019-07-01 17:40:32 +0100)
>>
>> are available in the Git repository at:
>>
>>   https://github.com/stsquad/qemu.git tags/pull-testing-next-020719-2
>>
>> for you to fetch changes up to 83fb8fd71de2f80afd4ec83761357d5f0dacd9c9:
>>
>>   migration: move port_attr inside CONFIG_LINUX (2019-07-02 07:52:35 +0100)
>>
>> ----------------------------------------------------------------
>> Various testing fixes:
>>
>>    - tests/vm updates and clean-ups
>>    - tests/vm serial autobuild on host
>>    - ensure MacOS builds do "brew update"
>>    - ensure we test --static user builds
>>    - fix hyperv compile failure
>>    - fix missing var warning for OpenBSD (v2)
>>
>> This brings my testing back to green on all CI services. Please note
>> the BSD installs will throw out some warnings during the setup phase.
>> They shouldn't re-occur once the images are built.
>>
>
> NetBSD vm run seemed to get stuck. Last thing in the log I have is
> con recv: Jul  2 19:34:02 localhost savecore: /dev/rld0b: Device not configured
> con recv: Starting local daemons:.
> con recv: Updating motd.
> con recv: Starting powerd.
> con recv: Starting sshd.
> con recv: Starting inetd.
> con recv: Starting cron.
> con recv: The following components reported failures:
> con recv:     /etc/rc.d/swap2
> con recv: See /var/run/rc.log for more information.
> con recv: Tue Jul  2 19:34:03 UTC 2019
> con recv: NetBSD/amd64 (localhost) (console)
> con recv: login:
> DEBUG:root:ssh_cmd: ssh -q -t -o StrictHostKeyChecking=no -o
> UserKnownHostsFile=/dev/null -o ConnectTimeout=1 -p 33857 -i
> /home/peter.maydell/qemu-netbsd/build/vm-test-9eyth5v7.tmp/id_rsa -o
> SendEnv=https_proxy -o SendEnv=http_proxy -o SendEnv=ftp_proxy -o
> SendEnv=no_proxy qemu@127.0.0.1 exit 0
> ### Installing packages ...
> DEBUG:root:ssh_cmd: ssh -q -t -o StrictHostKeyChecking=no -o
> UserKnownHostsFile=/dev/null -o ConnectTimeout=1 -p 33857 -i
> /home/peter.maydell/qemu-netbsd/build/vm-test-9eyth5v7.tmp/id_rsa -o
> SendEnv=https_proxy -o SendEnv=http_proxy -o SendEnv=ftp_proxy -o
> SendEnv=no_proxy root@127.0.0.1 pkgin update
>
> processing remote summary
> (http://ftp.NetBSD.org/pub/pkgsrc/packages/NetBSD/amd64/8.0/All)...
> database for http://ftp.NetBSD.org/pub/pkgsrc/packages/NetBSD/amd64/8.0/All
> is up-to-date
> DEBUG:root:ssh_cmd: ssh -q -t -o StrictHostKeyChecking=no -o
> UserKnownHostsFile=/dev/null -o ConnectTimeout=1 -p 33857 -i
> /home/peter.maydell/qemu-netbsd/build/vm-test-9eyth5v7.tmp/id_rsa -o
> SendEnv=https_proxy -o SendEnv=http_proxy -o SendEnv=ftp_proxy -o
> SendEnv=no_proxy root@127.0.0.1 pkgin -y install git-base pkgconf xz
> python37 bash gmake gsed flex bison gnutls jpeg png SDL2 gtk3+
> libxkbcommon
>
> and then nothing more. I might try it again later.

Mines currently slowly working it's way through the install I don't know
if the server is slow or netbsd is just idling too much but it is
getting through it.

--
Alex Bennée

Re: [Qemu-devel] [PULL v2 00/20] testing/next for 4.1

[Alex Bennée]

Alex Bennée <alex.bennee@linaro.org> writes:

> Peter Maydell <peter.maydell@linaro.org> writes:
>
>> On Tue, 2 Jul 2019 at 11:25, Alex Bennée <alex.bennee@linaro.org> wrote:
>>>
>>> The following changes since commit 7d0e02405fc02a181319b1ab8681d2f72246b7c6:
>>>
>>>   Merge remote-tracking branch 'remotes/vivier2/tags/trivial-patches-pull-request' into staging (2019-07-01 17:40:32 +0100)
>>>
>>> are available in the Git repository at:
>>>
>>>   https://github.com/stsquad/qemu.git tags/pull-testing-next-020719-2
>>>
>>> for you to fetch changes up to 83fb8fd71de2f80afd4ec83761357d5f0dacd9c9:
>>>
>>>   migration: move port_attr inside CONFIG_LINUX (2019-07-02 07:52:35 +0100)
>>>
>>> ----------------------------------------------------------------
>>> Various testing fixes:
>>>
>>>    - tests/vm updates and clean-ups
>>>    - tests/vm serial autobuild on host
>>>    - ensure MacOS builds do "brew update"
>>>    - ensure we test --static user builds
>>>    - fix hyperv compile failure
>>>    - fix missing var warning for OpenBSD (v2)
>>>
>>> This brings my testing back to green on all CI services. Please note
>>> the BSD installs will throw out some warnings during the setup phase.
>>> They shouldn't re-occur once the images are built.
>>>
>>
>> NetBSD vm run seemed to get stuck. Last thing in the log I have is
>> con recv: Jul  2 19:34:02 localhost savecore: /dev/rld0b: Device not configured
>> con recv: Starting local daemons:.
>> con recv: Updating motd.
>> con recv: Starting powerd.
>> con recv: Starting sshd.
>> con recv: Starting inetd.
>> con recv: Starting cron.
>> con recv: The following components reported failures:
>> con recv:     /etc/rc.d/swap2
>> con recv: See /var/run/rc.log for more information.
>> con recv: Tue Jul  2 19:34:03 UTC 2019
>> con recv: NetBSD/amd64 (localhost) (console)
>> con recv: login:
>> DEBUG:root:ssh_cmd: ssh -q -t -o StrictHostKeyChecking=no -o
>> UserKnownHostsFile=/dev/null -o ConnectTimeout=1 -p 33857 -i
>> /home/peter.maydell/qemu-netbsd/build/vm-test-9eyth5v7.tmp/id_rsa -o
>> SendEnv=https_proxy -o SendEnv=http_proxy -o SendEnv=ftp_proxy -o
>> SendEnv=no_proxy qemu@127.0.0.1 exit 0
>> ### Installing packages ...
>> DEBUG:root:ssh_cmd: ssh -q -t -o StrictHostKeyChecking=no -o
>> UserKnownHostsFile=/dev/null -o ConnectTimeout=1 -p 33857 -i
>> /home/peter.maydell/qemu-netbsd/build/vm-test-9eyth5v7.tmp/id_rsa -o
>> SendEnv=https_proxy -o SendEnv=http_proxy -o SendEnv=ftp_proxy -o
>> SendEnv=no_proxy root@127.0.0.1 pkgin update
>>
>> processing remote summary
>> (http://ftp.NetBSD.org/pub/pkgsrc/packages/NetBSD/amd64/8.0/All)...
>> database for http://ftp.NetBSD.org/pub/pkgsrc/packages/NetBSD/amd64/8.0/All
>> is up-to-date
>> DEBUG:root:ssh_cmd: ssh -q -t -o StrictHostKeyChecking=no -o
>> UserKnownHostsFile=/dev/null -o ConnectTimeout=1 -p 33857 -i
>> /home/peter.maydell/qemu-netbsd/build/vm-test-9eyth5v7.tmp/id_rsa -o
>> SendEnv=https_proxy -o SendEnv=http_proxy -o SendEnv=ftp_proxy -o
>> SendEnv=no_proxy root@127.0.0.1 pkgin -y install git-base pkgconf xz
>> python37 bash gmake gsed flex bison gnutls jpeg png SDL2 gtk3+
>> libxkbcommon
>>
>> and then nothing more. I might try it again later.
>
> Mines currently slowly working it's way through the install I don't know
> if the server is slow or netbsd is just idling too much but it is
> getting through it.

FWIW it did complete and now runs fine.

--
Alex Bennée

Re: [Qemu-devel] [PULL v2 00/20] testing/next for 4.1

[Peter Maydell]

On Wed, 3 Jul 2019 at 00:02, Peter Maydell <peter.maydell@linaro.org> wrote:
> NetBSD vm run seemed to get stuck.

I tired a rerun, but it got stuck again on the
"pkgin -y install git-base pkgconf xz python37 bash gmake gsed flex
bison gnutls jpeg png SDL2 gtk3+ libxkbcommon" step.

thanks
-- PMM