Re: [PULL 00/18] testing, docs, semihosting move and guest-loader

["Alex Bennée" <alex.bennee@linaro.org>]

Peter Maydell <peter.maydell@linaro.org> writes:

> On Mon, 8 Mar 2021 at 13:51, Alex Bennée <alex.bennee@linaro.org> wrote:
>>
>> The following changes since commit 91e92cad67caca3bc4b8e920ddb5c8ca64aac9e1:
>>
>>   Merge remote-tracking branch 'remotes/cohuck-gitlab/tags/s390x-20210305' into staging (2021-03-05 19:04:47 +0000)
>>
>> are available in the Git repository at:
>>
>>   https://github.com/stsquad/qemu.git tags/pull-testing-docs-xen-updates-080321-1
>>
>> for you to fetch changes up to 8109b8cadf5979a29b4b6e1ca7288bc0ee676426:
>>
>>   semihosting: Move hw/semihosting/ -> semihosting/ (2021-03-08 12:15:05 +0000)
>>
>> ----------------------------------------------------------------
>> Testing, guest-loader and other misc tweaks
>>
>>   - add warning text to quickstart example
>>   - add support for hexagon check-tcg tests
>>   - add CFI tests to CI
>>   - use --arch-only for docker pre-requisites
>>   - fix .editorconfig for emacs
>>   - add guest-loader for Xen-like hypervisor testing
>>   - move generic-loader docs into manual proper
>>   - move semihosting out of hw/
>
> Fails on x86-64 trying to do something with docker:
>
> make: Entering directory
> '/home/petmay01/linaro/qemu-for-merges/build/all-linux-static'
> /home/petmay01/linaro/qemu-for-merges/tests/docker/docker.py --engine
> auto build -t qemu/debian-hexagon-cross -f
> /home/petmay01/linaro/qemu-for-merges/tests/docker/dockerfiles/debian-hexagon-cross.docker
>   --registry registry.gitlab.com/qemu-project/qemu --add-current-user
> --extra-files /home/petmay01/linaro/qemu-for-merges/tests/docker/dockerfiles/debian-hexagon-cross.docker.d/build-toolchain.sh
> Using default tag: latest
> latest: Pulling from qemu-project/qemu/qemu/debian10
> Digest: sha256:4f96b88d2c3cf59d46d6173d86f240ef7b4f2b68509e6e5eec7b179aa1bfbf74
> Status: Image is up to date for
> registry.gitlab.com/qemu-project/qemu/qemu/debian10:latest
> Using default tag: latest
> latest: Pulling from qemu-project/qemu/qemu/debian-hexagon-cross
> 45b42c59be33: Already exists
> 7a55fd5ded7c: Already exists
> [...]
>
> 40ae5f465547: Pull complete
> Digest: sha256:c5f3e6f6a761c17570945059e60297352380379f9222fe444f998c6ea7e9d4ce
> Status: Downloaded newer image for
> registry.gitlab.com/qemu-project/qemu/qemu/debian-hexagon-cross:latest
>
> #1 [internal] load build definition from tmplp8d2u1p.docker
> #1       digest:
> sha256:639f37ba0ced2cf59254e62ec107d1d7ccd627d6876fb2b465f50c88c4baa44d
> #1         name: "[internal] load build definition from tmplp8d2u1p.docker"
> #1      started: 2021-03-09 16:53:55.092177401 +0000 UTC
> #1    completed: 2021-03-09 16:53:55.092271396 +0000 UTC
> #1     duration: 93.995µs
> #1      started: 2021-03-09 16:53:55.092598107 +0000 UTC
> #1    completed: 2021-03-09 16:53:55.188002068 +0000 UTC
> #1     duration: 95.403961ms
> #1 transferring dockerfile: 1.26kB done
>
> [...]
> #9 [internal] load build context
> #9      started: 2021-03-09 16:53:56.338003711 +0000 UTC
> #9    completed: 2021-03-09 16:53:56.42858509 +0000 UTC
> #9     duration: 90.581379ms
> #9 transferring context: 4.19kB done
>
>
> #7 [2/6] RUN apt update &&     DEBIAN_FRONTEND=noninteractive eatmydata    ...
> #7       digest:
> sha256:d73bbaa9b5d86f286257ada3d545250e61e000c22c1f971f003578dc00661346
> #7         name: "[2/6] RUN apt update &&
> DEBIAN_FRONTEND=noninteractive eatmydata     apt build-dep -yy qemu"
> #7      started: 2021-03-09 16:53:56.338854291 +0000 UTC
> #7 0.553
> #7 0.553 WARNING: apt does not have a stable CLI interface. Use with
> caution in scripts.
> #7 0.553
> #7    completed: 2021-03-09 16:54:00.554068941 +0000 UTC
> #7     duration: 4.21521465s
> #7        error: "executor failed running [/bin/sh -c apt update &&
>  DEBIAN_FRONTEND=noninteractive eatmydata     apt build-dep -yy qemu]:
> exit code: 137: context canceled: context canceled"
>
> error on cache query: invalid build cache from
> {MediaType:application/vnd.docker.distribution.manifest.v2+json
> Digest:sha256:c5f3e6f6a761c17570945059e60297352380379f9222fe444f998c6ea7e9d4ce
> Size:2009 URLs:[] Annotations:map[] Platform:<nil>}
> Traceback (most recent call last):
>   File "/home/petmay01/linaro/qemu-for-merges/tests/docker/docker.py",
> line 720, in <module>
>     sys.exit(main())
>   File "/home/petmay01/linaro/qemu-for-merges/tests/docker/docker.py",
> line 716, in main
>     return args.cmdobj.run(args, argv)
>   File "/home/petmay01/linaro/qemu-for-merges/tests/docker/docker.py",
> line 512, in run
>     extra_files_cksum=cksum)
>   File "/home/petmay01/linaro/qemu-for-merges/tests/docker/docker.py",
> line 360, in build_image
>     quiet=quiet)
>   File "/home/petmay01/linaro/qemu-for-merges/tests/docker/docker.py",
> line 250, in _do_check
>     return subprocess.check_call(self._command + cmd, **kwargs)
>   File "/usr/lib/python3.6/subprocess.py", line 311, in check_call
>     raise CalledProcessError(retcode, cmd)
> subprocess.CalledProcessError: Command '['docker', 'build', '-t',
> 'qemu/debian-hexagon-cross', '-f',
> '/tmp/docker_buildpuzztpb1/tmplp8d2u1p.docker', '--build-arg',
> 'BUILDKIT_INLINE_CACHE=1', '--cache-from',
> 'registry.gitlab.com/qemu-project/qemu/qemu/debian-hexagon-cross',
> '/tmp/docker_buildpuzztpb1']' returned non-zero exit status 1.
> /home/petmay01/linaro/qemu-for-merges/tests/docker/Makefile.include:59:
> recipe for target 'docker-image-debian-hexagon-cross' failed
> make: *** [docker-image-debian-hexagon-cross] Error 1

I think something has changed on Ubuntu, my system didn't have docker
but after auto-updating it appeared and was a snap:

  10:40 alex@bionic/x86_64  [user.static/testing/next] >which docker
  /snap/bin/docker

I had to pull the usual group shenanigans to enable:

   sudo addgroup --system docker
   sudo adduser $USER docker
   newgrp docker

And then restart it:

   snap disable docker
   snap enable docker

And then I get the same failure as you. Can you confirm the docker
version you have now?

  10:39 alex@bionic/x86_64  [user.static/testing/next] >docker version
  Client:
   Version:           19.03.13
   API version:       1.40
   Go version:        go1.13.15
   Git commit:        cd8016b6bc
   Built:             Fri Feb  5 15:56:39 2021
   OS/Arch:           linux/amd64
   Experimental:      false

  Server:
   Engine:
    Version:          19.03.13
    API version:      1.40 (minimum version 1.12)
    Go version:       go1.13.15
    Git commit:       bd33bbf
    Built:            Fri Feb  5 15:58:24 2021
    OS/Arch:          linux/amd64
    Experimental:     false
   containerd:
    Version:          v1.3.7
    GitCommit:        8fba4e9a7d01810a393d5d25a3621dc101981175
   runc:
    Version:          1.0.0-rc10
    GitCommit:
   docker-init:
    Version:          0.18.0
    GitCommit:        fec3683

-- 
Alex Bennée