| Bug ID | 92309 |
|---|---|
| Summary | Box drawn around cursor in multiple 3D games |
| Product | Mesa |
| Version | git |
| Hardware | x86-64 (AMD64) |
| OS | Linux (All) |
| Status | NEW |
| Severity | normal |
| Priority | medium |
| Component | Drivers/Gallium/radeonsi |
| Assignee | dri-devel@lists.freedesktop.org |
| Reporter | acutiator@outlook.com |
| QA Contact | dri-devel@lists.freedesktop.org |
When playing Legend of Grimrock or Natural Selection 2 on the radeonsi drivers on Cape Verde there is a box drawn around the cursor. This does not occur in other games such as Risk of Rain, Starbound, and Left 4 Dead 2. This is when running Mesa 11.1.0-devel on Fedora 22, git 9932142.
Created attachment 118696 [details]
Natural Selection 2 cursor corruption
| What | Removed | Added |
|---|---|---|
| Attachment #118696 mime type | text/plain | image/png |
Reminds me of bug 91641, which turned out to be a= game bug.
Indeed looks to be a game specific bug: http://www.grimrock.net/forum/viewtopic.php?f=12&t=4583 Should I just close this with a NOTOURBUG or what's the procedure?
And same for Natural Selection 2: http://forums.unknownworlds.com/discussion/131798/linux-mouse-cursor-has-a-rectangle-around-it
There are 10 people who reported it for Grimrock and 3 in Natural Selection 2, all but 1 who are running AMD drivers open and closed. I'd like to use apitrace to look at the texture used for the cursor to confirm it's a game bug for both of these games, but I can't get apitrace to work with Steam games for me and the internet is being little help.
This is also happening on an HD5770 card (Juniper XT) I have with the R600 driver.
I see the same problem with Natural Selection 2, Legend of Gri= mrock, Kingdom Rush and some other games I already forgot. It's not rare. Attaching screenshots. I managed to capture apitrace for all three games (my first time working wi= th apitrace), the problem is that if I replay them, the cursor is not shown in= the replay. Also when I inspect it using qapitrace, the cursor is now visible in the thumbnails/screenshots. So I don't know if the traces will be even usef= ul. The traces are 20MB, 20MB and 70MB, I can temporarily host them somewhere if needed. I experimented with some other games (where I see no cursor corruption), an= d in some games the cursor is recorded and replayed, in some games it is not. Do= es anybody know what the reason is and how to make sure the cursor is included? My system: 01:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Curacao PRO [Radeon R7 370 / R9 270/370 OEM] [1002:6811] kernel-4.2.3-300.fc23.x86_64 mesa-dri-drivers-11.0.3-1.20151012.fc23.x86_64 xorg-x11-server-Xorg-1.18.0-0.5.20150907.fc23.x86_64 xorg-x11-drv-ati-7.6.0-0.4.20150729git5510cd6.fc23.x86_64 Fedora 23 (In reply to acutiator from comment = #5) > I can't get apitrace to > work with Steam games for me and the internet is being little help. This worked for me: https://github.= com/apitrace/apitrace/wiki/Steam
Created att=
achment 119183 [details]
Legend of Grimrock cursor corruption
Created attachmen=
t 119184 [details]
Kingdom Rush cursor corruption
The cursor is in upper left corner, the corruption is a bit harder to see
(similar colors).
Presumably the cursor isn't captured by apitrace because it's = not rendered using OpenGL but uses the Xcursor* APIs. The artifacts are most likely due = to the cursor image not using proper pre-mulitplied alpha data as expected by those APIs, which apparently happens to "work" to some degree wit= h other drivers / hardware.
Thanks, Michel, that sounds plausible. In that case it seems w= e can close this bug and the only thing to do here is to ask the developers to fix their gam= es.
I'd like to start contacting these game developers to tell them about the issue, but I'd like to be quite specific about what they need to do to fix it. Can anyone provide some more insight on this so I know what to tell them?
acutiator, thanks in advanced for the effort. I have zero know= ledge about all of this, but this wikipedia article seems to be comprehensible: https://en.wiki= pedia.org/wiki/Alpha_compositing The important part: ~~~~~~~ If an alpha channel is used in an image, it is common to also multiply the color by the alpha value, to save on additional multiplications during compositing. This is usually referred to as premultiplied alpha. Assuming that the pixel color is expressed using straight (non-premultiplie= d) RGBA tuples, a pixel value of (0.0, 0.5, 0.0, 0.5) implies a pixel that has= 50% of the maximum green intensity and 50% opacity. If the color were fully gre= en, its RGBA would be (0, 1, 0, 0.5). However, if this pixel uses premultiplied alpha, all of the RGB values (0, = 1, 0) are multiplied by 0.5 and then the alpha is appended to the end to yield= (0, 0.5, 0, 0.5). In this case, the 0.5 value for the G channel actually indica= tes 100% green intensity (with 50% opacity). For this reason, knowing whether a file uses premultiplied or straight alpha is essential to correctly process= or composite it. ~~~~~~~ I've also found the following howtos when searching for this: http://www.gamedev.net/topic/623481-how-to-cre= ate-pre-multiplied-alpha-for-use-with-opengl/ http://= blog.qythyx.com/2014/01/premultiplied-alpha.html Hope that helps a bit. You might wait a while whether someone more knowledgeable gives you a better advice.
Kamil is spot on. In particular, this means that the only way to encode a fully transparent p= ixel with premultiplied alpha is using (0, 0, 0, 0). Which is obviously not the = case for the cursors on the attached screenshots, so those cursors don't use val= id premultiplied alpha encoding.
Based on what you said, I would think that it should be possible to detect when an invalid pre-multiplied alpha bitmap is in use. Is that true in all circumstances or is there more nuance to that? If it is true, I would think it'd be worth correcting for this error on the library side, though the problem is actually in the games.
(In reply to acutiator from comment #15) > Based on what you said, I would think that it should be possible to detect > when an invalid pre-multiplied alpha bitmap is in use. Is that true in all > circumstances or is there more nuance to that? If it is true, I would think > it'd be worth correcting for this error on the library side, though the > problem is actually in the games. How would the xserver know what the game intends in the cursor image?
> How would the xserver know what the game intends in the cursor image?
This is what I'm asking you, actually. I don't know if it's possible. I'm
asking if it is. From what I understand based on the comments by Michel and
Kamil it sounds like it should be possible. So I wanted to clarify on whether
or not it is. The comment about a (0,0,0,0) pixel being a clear indicator that
something is wrong is what triggered my question. If it can be clearly detected
that it's a premultiplied alpha, even when the program doesn't indicate this, I
would think that should be implemented. Now the question is if that can be
easily detected without human intervention. But based on your question to me it
doesn't sound like it is. Is that correct?
(In reply to acutiator from comment #17) > This is what I'm asking you, actually. I don't know if it's possible. I'm > asking if it is. From what I understand based on the comments by Michel and > Kamil it sounds like it should be possible. So I wanted to clarify on > whether or not it is. The comment about a (0,0,0,0) pixel being a clear > indicator that something is wrong is what triggered my question. If it can > be clearly detected that it's a premultiplied alpha, even when the program > doesn't indicate this, I would think that should be implemented. Now the > question is if that can be easily detected without human intervention. But > based on your question to me it doesn't sound like it is. Is that correct? Correct. I don't think it's possible. We just get the raw image. How do you determine the indent of a specific pixel based on the pixel value? Did the provider intend it to be clear or did they indent it to be some specific color?
I believe you can automatically detect invalid input in some c= ases. If you receive an image in which R or G or B value is higher than A value, for any available pixel, you can be certain that the image does not have premultipl= ied alpha but straight alpha (this situation can never happen with premultiplied alpha, by definition). You can then assume a developer mistake and "fi= x" the image automatically. It might even resolve most of the usual cursor-related mistakes (we can clearly see colored boxes, while it's expected to be transparent, so those images have RGB>A for some pixels). However, this has downsides as well. It does not cover all cases (for images where all RGB are lower or equal to their respective A, you can't decide whether it is premultiplied or straight). The automatic detection and conversion might involve some performance hit. And it might not be a good A= PI design, because trying to be overly helpful often leads to lowered predictability and more difficult debugging. But that would be someone else= 's call. I might also be talking utter nonsense because I have no expertise in graph= ics.
| What | Removed | Added |
|---|---|---|
| Status | NEW | RESOLVED |
| Resolution | --- | FIXED |
commit 401a8d6e1379133863e3271374dc21850d0d3cab Author: Michel D=C3=A4nzer <michel.daenzer@amd.com> Date: Tue Jun 28 17:22:47 2016 +0900 dix: Work around non-premultiplied ARGB cursor data