Nevermind. This series should fix it for VDPAU and VAAPI: https://patchwork.freedesktop.org/series/17480/