From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-lj1-f195.google.com (mail-lj1-f195.google.com [209.85.208.195]) by mail.openembedded.org (Postfix) with ESMTP id E902E7C164 for ; Thu, 17 Jan 2019 16:40:24 +0000 (UTC) Received: by mail-lj1-f195.google.com with SMTP id k15-v6so9111527ljc.8 for ; Thu, 17 Jan 2019 08:40:26 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:subject:date:message-id; bh=hmVhoCaywMHTr/UeSXU4QjtKRZvHz/Ip43V+o/+wKJU=; b=RH3A5ABRH6sbaaSJktOlIrE6NLAdutjk5Goi9KxmPXus+8LX6yl9RR7reTlswnSw7f OCqQZkCJcYMkyDcKd5oW6soL3w4O6wB9OhLjfbaLIvFV7igaWRtX5VjtulaY09/YijEV 6lVSho2knQxNpqUp/HQ1IxknyWkp5WPxVsgVDva8/jRDFmUSphFyMey6d02UK7saXR7v 8dDi3LYn/BZLMvOHsS9pFkkOVlRSYS0OaRFQrIk+wfVf1m6EFL94khw1VRDzStW+3sHO I47DI6/iVLkdhWw+hZ/1dsRoFtKNFyTvgKrfBxz5TQS3G909VmkI4ll3tEK/9jX2TtN0 ZWSA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:date:message-id; bh=hmVhoCaywMHTr/UeSXU4QjtKRZvHz/Ip43V+o/+wKJU=; b=C8cp5px2mQ1NWzWUIMQU8xORCQBTrp6iIRm7nnaMzn44r5dcadut5u3uT9EalRr/S7 HxIcu3Q6iBmZOKWwzUYoSARD262271k/wgsVWNnkRVkyWkqyZW0x7TUetG+RHt832wIm BVLNWCoNWSzRfEGGL6Qc+dBYL2JzFXU7B35OZ5Cceh8ytZBFuzfIrjmeq5QO8KK610mg k06Ccae56qps3MkDdpOs7a8tebtilcj3DGiwExWxAZxlZJhcqvls2Kbj2XgFSyQPPsZB l1noMN/a8zpx6bXH1Q/ekC2gZXX+b6K8zL8iEI8ETeCyNcMM8bWUpwxhOLtEaXfM+usV 8Jnw== X-Gm-Message-State: AJcUukfagyyI+4Dq5yEn+c25HRnoGGOV5O/8p+AL5d5gx2EXzo7wAUbt dkqMMyNhJ2p3OefL6f/mphTcuRGF X-Google-Smtp-Source: ALg8bN4eSUznLzYEpy/8Scj7+65yPcRA4m3UVTN5la5yM/s27873bazdpMVxdqAIfaJNEYAQO4TEJA== X-Received: by 2002:a2e:9b84:: with SMTP id z4-v6mr10152755lji.93.1547743224500; Thu, 17 Jan 2019 08:40:24 -0800 (PST) Received: from alexander-box.luxoft.com ([62.96.135.139]) by smtp.gmail.com with ESMTPSA id k14sm373098lfc.70.2019.01.17.08.40.23 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 17 Jan 2019 08:40:23 -0800 (PST) From: Alexander Kanavin To: openembedded-core@lists.openembedded.org Date: Thu, 17 Jan 2019 17:39:45 +0100 Message-Id: X-Mailer: git-send-email 2.17.1 Subject: [PATCHv3 00/27] Enable accelerated OpenGL in qemu X-BeenThere: openembedded-core@lists.openembedded.org X-Mailman-Version: 2.1.12 Precedence: list List-Id: Patches and discussions about the oe-core layer List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Jan 2019 16:40:25 -0000 V2 changes: addressed feedback from the first review round V3 changes: - better fix for missing qemu X11 include, as discussed with upstream - maintainers.inc entry for virglrenderer - egl-headless support (see below for details) - improvements to kmscube recipe - fix to vte-native to allow building it with gcc 4.8 Why this? Why now? 1. I think we are heading towards a reality where some kind of working GL is a 'must' for any kind of UI work. 2. Typically people build images and then transfer them to the NUC or even target boards for testing - using qemu would be less awkward. 3. Current qemu configuration is basically useless here, as it only provides a very slow software GL driver from mesa. 0. TLDR: a) Gtk UI frontend $ . oe-init-build-env build-virgl $ bitbake core-image-sato-sdk $ runqemu kvm gl $$ run glxgears or any other GL-capable binary inside qemu b) egl-headless $ . oe-init-build-env build-virgl $ bitbake core-image-sato-sdk $ runqemu kvm egl-headless publicvnc $ $$ run glxgears or any other GL-capable binary inside qemu 1. For the local UI, qemu is switched over to use gtk frontend. I simply couldn't get SDL frontend to work properly, it only displays a blank black window or doesn't start at all. Same thing happens with qemu binaries provided by Fedora and opensuse (Ubuntu's qemu lacks virgl support). Seems like SDL support has regressed. 2. What is egl-headless? In this variant, Qemu does not open a UI window at all. Instead, it renders all graphics, including GL, into a memory buffer, which can be seen with a vnc or spice client (over a TCP socket). This has the following advantages: - no need to be physically present at the host machine, output (including GL bits!) can be seen remotely - no need for the host machine to run an X session 3. While the components are built against the most minimum necessary mesa-native set (gbm, egl, dri with no drivers), libepoxy loads and uses the host GL implementation (through a chrpath hack). This is both to save build times, and because the host is likely to have a set of drivers more appropriate for the physical machine (e.g. proprietary nvidia stack, although I didn't test that). 4. I tested this with - glamor X server - weston compositor with drm backend (build core-image-weston, then edit weston.ini in the image to use drm backed instead of fbdev). - kmscube - glxgears - https://www.geeks3d.com/gputest/ The latter two show FPS that is similar to running them directly on the host. 5. Some things I am not sure about: - how much of a 'default' should this be for running qemu. It works for me, but other people might find it less stable compared to the existing sdl-vmware-swrast setup. - what other tests and demos could be run - how could this be tested on the autobuilder. I wrote two oe-selftests for this (gtk, egl-headless), but one of them does require an X session, and both require ability to create opengl contexts on the host. The following changes since commit 4211a7497886561e9607f18dd4d81d0d41eaadfa: dev-manual: Added some clarification for nographic qemu option. (2019-01-16 15:35:57 +0000) are available in the Git repository at: git://git.yoctoproject.org/poky-contrib akanavin/virgl-gtk http://git.yoctoproject.org/cgit.cgi/poky-contrib/log/?h=akanavin/virgl-gtk Alexander Kanavin (27): gtk+3: enable native/nativesdk variant gtk+3: remove the gtk-icon-utils-native recipe shared-mime-info: update the database also in native builds pixbufcache.bbclass: remove a dependency loop introduced by enabling gtk+3-native meta: add native and nativesdk variants to various recipes to enable gtk+3-native/nativesdk libepoxy: enable native/nativesdk variants mesa: enable native and nativesdk variants virglrenderer: add a recipe qemu: enable virglrenderer and glx options for native/nativesdk builds qemu: drop --with-gtkabi option, as it is no longer supported mesa-gl: do not enable nativesdk variant to avoid clashes with main mesa recipe local.conf.sample: adjust the qemu config to enable gtk+ instead of sdl qemu: build target variant with gtk+, and nativesdk variant without sdl qemu: remove support for building against host sdl atk: disable gobject-introspection for nativesdk qemu: add a gettext-native dependency to gtk option libjpeg-turbo: fix nativesdk build in same way as native builds are qemu: add a patch to avoid a missing definition error qemu: add environment variable wrappers to make qemu look good with gtk frontend qemu: add a backported patch to fix egl-headless support runqemu: add support for virgl GL acceleration runqemu: do not check for GL libraries testimage.bbclass: add support for passing runqemu params selftest: add tests for virgl GL acceleration kmscobe: update to latest commit, switch over to meson kmscube: make gstreamer dependency optional vte: allow building vte-native with gcc 4.8 meta-poky/conf/local.conf.sample | 9 +- meta-selftest/lib/oeqa/runtime/cases/virgl.py | 17 +++ meta/classes/pixbufcache.bbclass | 2 +- meta/classes/testimage.bbclass | 4 +- meta/conf/distro/include/maintainers.inc | 1 + meta/conf/machine/include/qemuboot-x86.inc | 2 +- meta/lib/oeqa/core/target/qemu.py | 4 +- meta/lib/oeqa/selftest/cases/runtime_test.py | 44 ++++++++ meta/recipes-devtools/qemu/qemu.inc | 38 ++++--- .../qemu/0001-Add-a-missing-X11-include.patch | 65 +++++++++++ ...-egl-headless-add-egl_create_context.patch | 50 +++++++++ ...x-libcap-header-issue-on-some-distro.patch | 2 +- ...-messages-when-qemi_cpu_kick_thread-.patch | 2 +- meta/recipes-devtools/qemu/qemu_3.1.0.bb | 2 + .../gdk-pixbuf/gdk-pixbuf_2.36.11.bb | 2 +- .../gnome/adwaita-icon-theme_3.28.0.bb | 2 + meta/recipes-gnome/gtk+/gtk+3.inc | 31 +++++- .../gtk+/gtk-icon-utils-native_3.22.30.bb | 63 ----------- ...endency-from-gtk-encode-symbolic-svg.patch | 102 ------------------ .../hicolor-icon-theme_0.17.bb | 2 + meta/recipes-graphics/cairo/cairo_1.14.12.bb | 2 +- .../harfbuzz/harfbuzz_2.2.0.bb | 2 +- .../jpeg/libjpeg-turbo_2.0.1.bb | 3 +- meta/recipes-graphics/kmscube/kmscube_git.bb | 9 +- .../libepoxy/libepoxy_1.5.3.bb | 16 +++ meta/recipes-graphics/mesa/mesa-gl_18.1.9.bb | 2 + meta/recipes-graphics/mesa/mesa.inc | 12 ++- meta/recipes-graphics/pango/pango_1.42.4.bb | 2 +- .../ttf-fonts/liberation-fonts_2.00.1.bb | 2 + .../virglrenderer/virglrenderer_git.bb | 17 +++ .../xorg-lib/libxcomposite_0.4.4.bb | 2 +- .../xorg-lib/libxdamage_1.1.4.bb | 2 +- meta/recipes-graphics/xorg-lib/libxi_1.7.9.bb | 2 + .../xorg-lib/libxtst_1.2.3.bb | 1 + .../recipes-support/atk/at-spi2-atk_2.30.0.bb | 2 + .../atk/at-spi2-core_2.30.0.bb | 1 + meta/recipes-support/atk/atk_2.30.0.bb | 4 +- .../shared-mime-info/shared-mime-info.inc | 2 + ...chool-asignment-to-avoid-gcc-4.8-err.patch | 27 +++++ meta/recipes-support/vte/vte_0.52.2.bb | 7 +- scripts/runqemu | 60 +++++------ 41 files changed, 378 insertions(+), 243 deletions(-) create mode 100644 meta-selftest/lib/oeqa/runtime/cases/virgl.py create mode 100644 meta/recipes-devtools/qemu/qemu/0001-Add-a-missing-X11-include.patch create mode 100644 meta/recipes-devtools/qemu/qemu/0001-egl-headless-add-egl_create_context.patch delete mode 100644 meta/recipes-gnome/gtk+/gtk-icon-utils-native_3.22.30.bb delete mode 100644 meta/recipes-gnome/gtk+/gtk-icon-utils/Remove-Gdk-dependency-from-gtk-encode-symbolic-svg.patch create mode 100644 meta/recipes-graphics/virglrenderer/virglrenderer_git.bb create mode 100644 meta/recipes-support/vte/vte/0001-app.cc-use-old-school-asignment-to-avoid-gcc-4.8-err.patch -- 2.17.1