From mboxrd@z Thu Jan 1 00:00:00 1970 Return-path: Received: from mail-lf0-f43.google.com ([209.85.215.43]:35289 "EHLO mail-lf0-f43.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752245AbcFTMjO (ORCPT ); Mon, 20 Jun 2016 08:39:14 -0400 Received: by mail-lf0-f43.google.com with SMTP id l188so36734944lfe.2 for ; Mon, 20 Jun 2016 05:37:47 -0700 (PDT) Date: Mon, 20 Jun 2016 15:37:42 +0300 From: Pekka Paalanen To: Rob Clark Cc: Tom Cooksey , "linaro-mm-sig@lists.linaro.org" , "mesa-dev@lists.freedesktop.org" , "dri-devel@lists.freedesktop.org" , "linux-media@vger.kernel.org" , Daniel Stone , Emil Velikov , Louis-Francis =?UTF-8?B?UmF0dMOp?= =?UTF-8?B?LUJvdWxpYW5uZQ==?= Subject: Re: [Mesa-dev] [RFC] New dma_buf -> EGLImage EGL extension - Final spec published! Message-ID: <20160620153742.75b3e45b@eldfell> In-Reply-To: References: <512b52ab.02de420a.7040.7417SMTPIN_ADDED_BROKEN@mx.google.com> <20160617105950.1a909309@eldfell> <20160617163109.68945359@eldfell> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; boundary="Sig_/db_YP5KGUL6/d7Ux9spgVe7"; protocol="application/pgp-signature" Sender: linux-media-owner@vger.kernel.org List-ID: --Sig_/db_YP5KGUL6/d7Ux9spgVe7 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable On Fri, 17 Jun 2016 11:44:34 -0400 Rob Clark wrote: > On Fri, Jun 17, 2016 at 9:31 AM, Pekka Paalanen wro= te: > > On Fri, 17 Jun 2016 08:26:04 -0400 > > Rob Clark wrote: > > =20 > >> On Fri, Jun 17, 2016 at 3:59 AM, Pekka Paalanen = wrote: =20 > >> > On Thu, 16 Jun 2016 10:40:51 -0400 > >> > Rob Clark wrote: > >> > =20 > >> >> So, if we wanted to extend this to support the fourcc-modifiers that > >> >> we have on the kernel side for compressed/tiled/etc formats, what > >> >> would be the right approach? > >> >> > >> >> A new version of the existing extension or a new > >> >> EGL_EXT_image_dma_buf_import2 extension, or ?? =20 > >> > > >> > Hi Rob, > >> > > >> > there are actually several things it might be nice to add: > >> > > >> > - a fourth plane, to match what DRM AddFB2 supports > >> > > >> > - the 64-bit fb modifiers > >> > > >> > - queries for which pixel formats are supported by EGL, so a display > >> > server can tell the applications that before the application goes = and > >> > tries with a random bunch of them, shooting in the dark > >> > > >> > - queries for which modifiers are supported for each pixel format, d= itto > >> > > >> > I discussed these with Emil in the past, and it seems an appropriate > >> > approach might be the following. > >> > > >> > Adding the 4th plane can be done as revising the existing > >> > EGL_EXT_image_dma_buf_import extension. The plane count is tied to > >> > pixel formats (and modifiers?), so the user does not need to know > >> > specifically whether the EGL implementation could handle a 4th plane= or > >> > not. It is implied by the pixel format. > >> > > >> > Adding the fb modifiers needs to be a new extension, so that users c= an > >> > tell if they are supported or not. This is to avoid the following fa= lse > >> > failure: if user assumes modifiers are always supported, it will (ma= y?) > >> > provide zero modifiers explicitly. If EGL implementation does not > >> > handle modifiers this would be rejected as unrecognized attributes, > >> > while if the zero modifiers were not given explicitly, everything wo= uld > >> > just work. =20 > >> > >> hmm, if we design it as "not passing modifier" =3D=3D "zero modifier",= and > >> "never explicitly pass a zero modifier" then modifiers could be added > >> without a new extension. Although I agree that queries would need a > >> new extension.. so perhaps not worth being clever. =20 > > > > Indeed. > > =20 > >> > The queries obviously(?) need a new extension. It might make sense > >> > to bundle both modifier support and the queries in the same new > >> > extension. > >> > > >> > We have some rough old WIP code at > >> > https://git.collabora.com/cgit/user/lfrb/mesa.git/log/?h=3DT1410-mod= ifiers > >> > https://git.collabora.com/cgit/user/lfrb/egl-specs.git/log/?h=3DT1410 > >> > > >> > =20 > >> >> On Mon, Feb 25, 2013 at 6:54 AM, Tom Cooksey = wrote: =20 > >> >> > Hi All, > >> >> > > >> >> > The final spec has had enum values assigned and been published on= Khronos: > >> >> > > >> >> > http://www.khronos.org/registry/egl/extensions/EXT/EGL_EXT_image_= dma_buf_import.txt > >> >> > > >> >> > Thanks to all who've provided input. =20 > >> > > >> > May I also pull your attention to a detail with the existing spec and > >> > Mesa behaviour I am asking about in > >> > https://lists.freedesktop.org/archives/mesa-dev/2016-June/120249.html > >> > "What is EGL_EXT_image_dma_buf_import image orientation as a GL text= ure?" > >> > Doing a dmabuf import seems to imply an y-flip AFAICT. =20 > >> > >> I would have expected that *any* egl external image (dma-buf or > >> otherwise) should have native orientation rather than gl orientation. > >> It's somewhat useless otherwise. =20 > > > > In that case importing dmabuf works differently than importing a > > wl_buffer (wl_drm), because for the latter, the y-invert flag is > > returned such that the orientation will match GL. And the direct > > scanout path goes through GBM since you have to import a wl_buffer, and > > I haven't looked what GBM does wrt. y-flip if anything. > > =20 > >> I didn't read it carefully yet (would need caffeine first ;-)) but > >> EGL_KHR_image_base does say "This extension defines a new EGL resource > >> type that is suitable for sharing 2D arrays of image data between > >> client APIs" which to me implies native orientation. So that just > >> sounds like a mesa bug somehow? =20 > > > > That specific sentence implies nothing about orientation to me. > > Furthermore, the paragraph continues: > > > > "Although the intended purpose is sharing 2D image data, the > > underlying interface makes no assumptions about the format or > > purpose of the resource being shared, leaving those decisions > > to the application and associated client APIs." > > > > Might "format" include orientation? > > > > How does "native orientation" connect with "GL texture coordinates"? > > The latter have explicitly defined orientation and origin. For use in > > GL, the right way up image is having the origin in the bottom-left > > corner. An image right way up is an image right way up, regardless > > which corner is the origin. The problem comes when you start using > > coordinates. > > =20 > >> Do you just get that w/ i965? I know some linaro folks have been > >> using this extension to import buffers from video decoder with > >> freedreno/gallium and no one mentioned the video being upside down. =20 > > > > Intel, yes, but since this happens *only* for the GL import path and > > direct scanout is fine without y-flipping, I bet people just flipped y > > and did not think twice, if there even was a problem. I just have a > > habit of asking "why". ;-) =20 >=20 > well, if possible, try with one of the gallium drivers? >=20 > I'm honestly not 100% sure what it is supposed to be according to the > spec, but I do know some of the linaro folks were doing v4l2dec -> > glimagesink with dmabuf with both mali (I think some ST platform?) and > freedreno (snapdragon db410c), and no one complained to me that the > video was upside down for one or the other. So I guess at least > gallium and mali are doing the same thing. No idea if that is the > same thing that i965 does. Hi, Quentin did some tests for me, and the results are... not what I would have expected: https://phabricator.freedesktop.org/T7475#88454 RadeonSI works like Intel, but Nouveau does the opposite. I think the Nouveau way is correct by the spec, which makes everyone else (intel, radeonsi, weston-simple-dmabuf-v4l) get it wrong. Unfortunately, two wrongs make a right, so when weston-simple-dmabuf-v4l hardcodes Y_INVERT as set, it'll come out the right way on intel and radeon. And it is wrong for weston-simple-dmabuf-v4l to set Y_INVERT, that I believe is clear. It is only there because of the "oops, it's upside-down" syndrome, AFAIK. > > After all, using GL with windows and FBOs and stuff you very often find > > yourself upside down, and I suspect people have got the habit of just > > flipping it if it does not look right the first time. See e.g. the > > row-order of data going into glTexImage2D... > > > > If the answer is "oops, well, dmabuf import is semantically y-flipping > > when it should not, but we cannot fix it because that would break > > everyone", I would be happy with that. I just want confirmation before > > flipping the flip flag. :-) So many bugs that accidentally counter each other... Thanks, pq --Sig_/db_YP5KGUL6/d7Ux9spgVe7 Content-Type: application/pgp-signature Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIVAwUBV2fjliNf5bQRqqqnAQihtw/8C82LMaNtHWgehjo4JcPOe6cSIZIqXiqr xo9Fexeo2j/DbaPd4T0aQ529cTGHuzyESonTUMyMX84DwFYGklqwU3PFUzHnBSgP oLJZNgRnRx67zn9RhjbNq6gH3axOlegv0qvKKIFDonuIt7nRnXqn+w+ptYc1Y+Mo Kd3bH33fTu+C1SKhIrXfxi8jfHlI8HThPDoQsRhy372tau526PHBSWbpeNT7ULte w1OKqu6P4EpOOYcPC1whVx96h+cBgo05erC9MMwDASmpgkU212osurSNQz8lCprM ldRpzdd+TR5Pq7/cFMkvheo6AOLbBNzkNpW9/fBvpFXjGJqpM976ANUkAkckLgDN oJC6cu9BJZATN1ZhreSnJyfLlDWiBGW3guZ0Q6tCACbIno70IHj2iQdThjD/q+Ol QkNxgTm1IRmlG8vvGnZGtMMUSbIpeT97xq0NzEox3FQBUdDsb+8SBCp5p/xPlvss McWhijlpIO1XqHWSMq8eyr48qn6OjwnGHo9NpWNY2MUUlD527Qs+auoC78aM6gk5 g8YtPhb4h+JQPWq59wtfjmgjVD4zOxp4PMPaVBMDCp53fsFxDZK3rJLw0/0Rq49P LuvOCDFz0iy/ZXS3DIGjJN4thuv1jH2WZAB7sOoi93siiVqg8L7lvfw9T/G+V9oX g/H+REalCBs= =yzD/ -----END PGP SIGNATURE----- --Sig_/db_YP5KGUL6/d7Ux9spgVe7--