i.MX6 mfw_isink is not working with X11 "Nitrogen"

i.MX6 mfw_isink is not working with X11 "Nitrogen"

[Tarek El-Sherbiny]

[-- Attachment #1: Type: text/plain, Size: 2097 bytes --]

Hi,

I have compiled X11 image based on core-image-x11.bb for the Nitrogen6x
MACHINE. This is my image bb file:

-------------------------------------------------------------
include recipes-graphics/images/core-image-x11.bb


IMAGE_FEATURES += "debug-tweaks"
DISTRO_FEATURES += "pulseaudio"


SOC_EXTRA_IMAGE_FEATURES ?= "tools-testapps"
# mesa-demos is currently broken when building with other GL library
# so we avoid it by now and tools-testapps includes it.
SOC_EXTRA_IMAGE_FEATURES_mx6 = ""


# Add extra image features
EXTRA_IMAGE_FEATURES += " \
    ${SOC_EXTRA_IMAGE_FEATURES} \
    tools-debug \
    tools-profile \
"

SOC_IMAGE_INSTALL = ""

IMAGE_INSTALL += " \
    ${SOC_IMAGE_INSTALL} \
    cpufrequtils \
    packagegroup-fsl-gstreamer \
    packagegroup-fsl-tools-testapps \
    packagegroup-fsl-tools-benchmark \
    qt4-plugin-phonon-backend-gstreamer \
    fsl-gui-extrafiles \
    "

# Adh Console applications
IMAGE_INSTALL += " \
dropbear \
"


export IMAGE_BASENAME = "adh-image-x11"
-------------------------------------------------------------

The gstreamer runs perfectly well with mfw_v4lsink using this command:
gst-launch playbin2 uri=
file:///home/root/mmfiles/clipcanvas_14348_offline.mp4<file:///%5C%5Chome%5Croot%5Cmmfiles%5Cclipcanvas_14348_offline.mp4>

I need to use mfw_isink to scale and convert the output so I use the
following command which doesn't work:
gst-launch playbin2 uri=
file:///home/root/mmfiles/clipcanvas_14348_offline.mp4<file:///%5C%5Chome%5Croot%5Cmmfiles%5Cclipcanvas_14348_offline.mp4>video-sink="mfw_isink
axis-top=0 axis-left=0 disp-width=512 disp-height=384"

So I disabled the x11 flag for gst-fsl-plugin by
creating gst-fsl-plugin_3.0.1.bbappend:
PRINC := "${@int(PRINC) + 1}"

EXTRA_OECONF += "--enable-x11=no --disable-x11"


Now the mfw_isink is working!!!!???

Can someone please try the mfw_isink command on his target?

I would like to know if it is the Nitrogen board or something else that
makes gst-fsl-plugin not compatible with X11.

Thanks,
Tarek

[-- Attachment #2: Type: text/html, Size: 3217 bytes --]

Re: i.MX6 mfw_isink is not working with X11 "Nitrogen"

[Eric Nelson]

Hi Tarek,

On 12/17/2012 05:32 AM, Tarek El-Sherbiny wrote:
> Hi,
>
> I have compiled X11 image based on core-image-x11.bb for the Nitrogen6x
> MACHINE. This is my image bb file:
>
> -------------------------------------------------------------
> include recipes-graphics/images/core-image-x11.bb
 >
> IMAGE_FEATURES += "debug-tweaks"
> DISTRO_FEATURES += "pulseaudio"
>
>
 > <snip>
>
> The gstreamer runs perfectly well with mfw_v4lsink using this command:
> gst-launch playbin2 uri=
> file:///home/root/mmfiles/clipcanvas_14348_offline.mp4<file:///%5C%5Chome%5Croot%5Cmmfiles%5Cclipcanvas_14348_offline.mp4>
>
> I need to use mfw_isink to scale and convert the output so I use the
> following command which doesn't work:
> gst-launch playbin2 uri=
> file:///home/root/mmfiles/clipcanvas_14348_offline.mp4 video-sink="mfw_isink
> axis-top=0 axis-left=0 disp-width=512 disp-height=384"
>
> So I disabled the x11 flag for gst-fsl-plugin by
> creating gst-fsl-plugin_3.0.1.bbappend:
> PRINC := "${@int(PRINC) + 1}"
>
> EXTRA_OECONF += "--enable-x11=no --disable-x11"
>
> Now the mfw_isink is working!!!!???
>
> Can someone please try the mfw_isink command on his target?
>

Thanks for the note. We thought that mfw_isink was completely broken
on i.MX6.

> I would like to know if it is the Nitrogen board or something else that
> makes gst-fsl-plugin not compatible with X11.
>

There is absolutely no difference in this area (IPU) between the
SABRE Lite board and Nitrogen6X. I suspect that those with SABRE SD
boards can also confirm that mfw_isink fails in the same way with the
default compilation.

We noticed it in LTIB builds.

Regards,


Eric

Re: i.MX6 mfw_isink is not working with X11 "Nitrogen"

[Tarek El-Sherbiny]

[-- Attachment #1: Type: text/plain, Size: 2186 bytes --]

Hi Eric,

I think it's not the mfw_isink but X11 itself.

I have confirmed that by running the unit test:
/unit_tests/mxc_epdc_x11_fb_test.out
Error: unable to open X display

Do you get the same error with LTIB?

Thanks,
Tarek

On Mon, Dec 17, 2012 at 3:19 PM, Eric Nelson <
eric.nelson@boundarydevices.com> wrote:

> Hi Tarek,
>
>
> On 12/17/2012 05:32 AM, Tarek El-Sherbiny wrote:
>
>> Hi,
>>
>> I have compiled X11 image based on core-image-x11.bb for the Nitrogen6x
>> MACHINE. This is my image bb file:
>>
>> ------------------------------**------------------------------**-
>> include recipes-graphics/images/core-**image-x11.bb<http://core-image-x11.bb>
>>
> >
>
>> IMAGE_FEATURES += "debug-tweaks"
>> DISTRO_FEATURES += "pulseaudio"
>>
>>
>>  > <snip>
>
>>
>> The gstreamer runs perfectly well with mfw_v4lsink using this command:
>> gst-launch playbin2 uri=
>> file:///home/root/mmfiles/**clipcanvas_14348_offline.mp4<**
>> file:///%5C%5Chome%5Croot%**5Cmmfiles%5Cclipcanvas_14348_**offline.mp4>
>>
>>
>> I need to use mfw_isink to scale and convert the output so I use the
>> following command which doesn't work:
>> gst-launch playbin2 uri=
>> file:///home/root/mmfiles/**clipcanvas_14348_offline.mp4
>> video-sink="mfw_isink
>> axis-top=0 axis-left=0 disp-width=512 disp-height=384"
>>
>> So I disabled the x11 flag for gst-fsl-plugin by
>> creating gst-fsl-plugin_3.0.1.bbappend:
>> PRINC := "${@int(PRINC) + 1}"
>>
>> EXTRA_OECONF += "--enable-x11=no --disable-x11"
>>
>> Now the mfw_isink is working!!!!???
>>
>> Can someone please try the mfw_isink command on his target?
>>
>>
> Thanks for the note. We thought that mfw_isink was completely broken
> on i.MX6.
>
>
>  I would like to know if it is the Nitrogen board or something else that
>> makes gst-fsl-plugin not compatible with X11.
>>
>>
> There is absolutely no difference in this area (IPU) between the
> SABRE Lite board and Nitrogen6X. I suspect that those with SABRE SD
> boards can also confirm that mfw_isink fails in the same way with the
> default compilation.
>
> We noticed it in LTIB builds.
>
> Regards,
>
>
> Eric
>

[-- Attachment #2: Type: text/html, Size: 3427 bytes --]

Re: i.MX6 mfw_isink is not working with X11 "Nitrogen"

[Daiane Angolini]

On 12/17/2012 01:31 PM, Tarek El-Sherbiny wrote:
> Hi Eric,
>
> I think it's not the mfw_isink but X11 itself.
>
> I have confirmed that by running the unit test:

Try

DISPLAY=:0 /unit_tests/mxc_epdc_x11_fb_test.out

Daiane

Re: i.MX6 mfw_isink is not working with X11 "Nitrogen"

[Tarek El-Sherbiny]

[-- Attachment #1: Type: text/plain, Size: 511 bytes --]

Same problem
root@nitrogen6x:~# DISPLAY=:0 /unit_tests/mxc_epdc_x11_fb_test.out

Error: unable to open X display

Does work for you Daiane?


On Mon, Dec 17, 2012 at 3:36 PM, Daiane Angolini <
daiane.angolini@freescale.com> wrote:

> On 12/17/2012 01:31 PM, Tarek El-Sherbiny wrote:
>
>> Hi Eric,
>>
>> I think it's not the mfw_isink but X11 itself.
>>
>> I have confirmed that by running the unit test:
>>
>
> Try
>
> DISPLAY=:0 /unit_tests/mxc_epdc_x11_fb_**test.out
>
> Daiane
>
>

[-- Attachment #2: Type: text/html, Size: 1137 bytes --]

Re: i.MX6 mfw_isink is not working with X11 "Nitrogen"

[Daiane Angolini]

On Mon, Dec 17, 2012 at 1:42 PM, Tarek El-Sherbiny
<tarek.elsherbiny@gmail.com> wrote:
> Same problem
> root@nitrogen6x:~# DISPLAY=:0 /unit_tests/mxc_epdc_x11_fb_test.out
>
> Error: unable to open X display
>
> Does work for you Daiane?
I haven´t tried.

I´m booting my board and I will test everything, but For X11 you
always need to tell which display you´re using (when starting anything
from console).

And, I don´t have epdc (the e-ink panel for imx5)

Otavio, would be better to remove this unit_test for imx6 boards?
(sorry, I just realized it)


Daiane

Re: i.MX6 mfw_isink is not working with X11 "Nitrogen"

[Otavio Salvador]

On Mon, Dec 17, 2012 at 2:01 PM, Daiane Angolini <daiane.list@gmail.com> wrote:
> On Mon, Dec 17, 2012 at 1:42 PM, Tarek El-Sherbiny
> <tarek.elsherbiny@gmail.com> wrote:
>> Same problem
>> root@nitrogen6x:~# DISPLAY=:0 /unit_tests/mxc_epdc_x11_fb_test.out
>>
>> Error: unable to open X display
>>
>> Does work for you Daiane?
> I haven´t tried.
>
> I´m booting my board and I will test everything, but For X11 you
> always need to tell which display you´re using (when starting anything
> from console).
>
> And, I don´t have epdc (the e-ink panel for imx5)
>
> Otavio, would be better to remove this unit_test for imx6 boards?
> (sorry, I just realized it)

Yes; if those are not supported we ought to drop them :-)

--
Otavio Salvador                             O.S. Systems
E-mail: otavio@ossystems.com.br  http://www.ossystems.com.br
Mobile: +55 53 9981-7854              http://projetos.ossystems.com.br

Re: i.MX6 mfw_isink is not working with X11 "Nitrogen"

[Daiane Angolini]

On Mon, Dec 17, 2012 at 2:01 PM, Daiane Angolini <daiane.list@gmail.com> wrote:
> On Mon, Dec 17, 2012 at 1:42 PM, Tarek El-Sherbiny
> <tarek.elsherbiny@gmail.com> wrote:
>> Same problem
>> root@nitrogen6x:~# DISPLAY=:0 /unit_tests/mxc_epdc_x11_fb_test.out
>>
>> Error: unable to open X display
>>
>> Does work for you Daiane?
> I haven´t tried.
>
> I´m booting my board and I will test everything, but For X11 you
> always need to tell which display you´re using (when starting anything
> from console).

mfw_isink plays the movie, but I cannot see it (what is your behavior?
Do you get any error?)

And, for isink you need to take care of vssconfig file and kernel
command line. It does not work "out of box" as v4lsink does.

See at /usr/share/vssconfig*

I´m not familiar with isink behavior for imx6 yet, but for imx53, if
you don´t configure it properly, it won´t work.


Daiane

Re: i.MX6 mfw_isink is not working with X11 "Nitrogen"

[Tarek El-Sherbiny]

[-- Attachment #1: Type: text/plain, Size: 1474 bytes --]

I get the same behaviour I can't see the output.

Here is my vssconfig. I'm using HDMI TV for display

root@nitrogen6x:~# cat /usr/share/vssconfig
# vss device definition
# Master=DVI, Slave=TV
# please add "video=video=mxcdi1fb:YUV444,720P60
video=mxcdi0fb:RGB24,1024x768M-16@60" to kernel startup command line

# master display
[master]
type = framebuffer
format = RGBP
fb_num = 1
main_fb_num = 0




On Mon, Dec 17, 2012 at 4:19 PM, Daiane Angolini <daiane.list@gmail.com>wrote:

> On Mon, Dec 17, 2012 at 2:01 PM, Daiane Angolini <daiane.list@gmail.com>
> wrote:
> > On Mon, Dec 17, 2012 at 1:42 PM, Tarek El-Sherbiny
> > <tarek.elsherbiny@gmail.com> wrote:
> >> Same problem
> >> root@nitrogen6x:~# DISPLAY=:0 /unit_tests/mxc_epdc_x11_fb_test.out
> >>
> >> Error: unable to open X display
> >>
> >> Does work for you Daiane?
> > I haven´t tried.
> >
> > I´m booting my board and I will test everything, but For X11 you
> > always need to tell which display you´re using (when starting anything
> > from console).
>
> mfw_isink plays the movie, but I cannot see it (what is your behavior?
> Do you get any error?)
>
> And, for isink you need to take care of vssconfig file and kernel
> command line. It does not work "out of box" as v4lsink does.
>
> See at /usr/share/vssconfig*
>
> I´m not familiar with isink behavior for imx6 yet, but for imx53, if
> you don´t configure it properly, it won´t work.
>
>
> Daiane
>

[-- Attachment #2: Type: text/html, Size: 2275 bytes --]

Re: i.MX6 mfw_isink is not working with X11 "Nitrogen"

[Daiane Angolini]

On 12/17/2012 02:40 PM, Tarek El-Sherbiny wrote:
> I get the same behaviour I can't see the output.
>
> Here is my vssconfig. I'm using HDMI TV for display
>
> root@nitrogen6x:~# cat /usr/share/vssconfig
> # vss device definition
> # Master=DVI, Slave=TV
> # please add "video=video=mxcdi1fb:YUV444,720P60
> video=mxcdi0fb:RGB24,1024x768M-16@60" to kernel startup command line
>
> # master display
> [master]
> type = framebuffer
> format = RGBP

Change:

  fb_num = 0

It still "blended" but it plays and shows the movie


Daiane

> main_fb_num = 0

Re: i.MX6 mfw_isink is not working with X11 "Nitrogen"

[Tarek El-Sherbiny]

[-- Attachment #1: Type: text/plain, Size: 1734 bytes --]

Hi Daiane,

Yes, This change improved things.

I can play video but only once!  the second time I run the same command I
get this error:

[INFO] bitstreamMode 1, chromaInterleave 1, mapType 0, tiled2LinearEnable 0
hwbuf allocator zone(356352) created
can not create threadmfw_gst_isink_setcaps:1489
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
VS0 created. in fmt[NV12] win(0,0-640,360:640x360) out
win(0,0-512,384:512x384)
New clock: GstAudioSinkClock
vss/mfw_gst_vss_common.c:701 ioctl error, return -1
vss/mfw_gst_vss_common.c:726 ioctl error, return -1
set deinterlace mode 0
Can not open dll, libgstfsl-0.10.so: cannot open shared object file: No
such file or directory.
Caught SIGSEGV accessing address (nil)
#0  0x4e2979a4 in ?? ()
#1  0x4e297994 in ?? ()
#2  0x4e297994 in ?? ()
Spinning.  Please run 'gdb gst-launch 1856' to continue debugging, Ctrl-C
to quit, or Ctrl-\ to dump core.

Do you have any suggestions to solve this problem?

Thanks,
Tarek



On Mon, Dec 17, 2012 at 5:00 PM, Daiane Angolini <
daiane.angolini@freescale.com> wrote:

> On 12/17/2012 02:40 PM, Tarek El-Sherbiny wrote:
>
>> I get the same behaviour I can't see the output.
>>
>> Here is my vssconfig. I'm using HDMI TV for display
>>
>> root@nitrogen6x:~# cat /usr/share/vssconfig
>> # vss device definition
>> # Master=DVI, Slave=TV
>> # please add "video=video=mxcdi1fb:YUV444,**720P60
>> video=mxcdi0fb:RGB24,**1024x768M-16@60" to kernel startup command line
>>
>> # master display
>> [master]
>> type = framebuffer
>> format = RGBP
>>
>
> Change:
>
>  fb_num = 0
>
> It still "blended" but it plays and shows the movie
>
>
> Daiane
>
>  main_fb_num = 0
>>
>
>
>

[-- Attachment #2: Type: text/html, Size: 2726 bytes --]

Re: i.MX6 mfw_isink is not working with X11 "Nitrogen"

[Daiane Angolini]

On Mon, Dec 17, 2012 at 3:59 PM, Tarek El-Sherbiny
<tarek.elsherbiny@gmail.com> wrote:
> Hi Daiane,
>
> Yes, This change improved things.
>
> I can play video but only once!  the second time I run the same command I
> get this error:
>
> [INFO] bitstreamMode 1, chromaInterleave 1, mapType 0, tiled2LinearEnable 0
> hwbuf allocator zone(356352) created
> can not create threadmfw_gst_isink_setcaps:1489
> Pipeline is PREROLLED ...
> Setting pipeline to PLAYING ...
> VS0 created. in fmt[NV12] win(0,0-640,360:640x360) out
> win(0,0-512,384:512x384)
> New clock: GstAudioSinkClock
> vss/mfw_gst_vss_common.c:701 ioctl error, return -1
> vss/mfw_gst_vss_common.c:726 ioctl error, return -1
> set deinterlace mode 0
> Can not open dll, libgstfsl-0.10.so: cannot open shared object file: No such
> file or directory.
> Caught SIGSEGV accessing address (nil)
> #0  0x4e2979a4 in ?? ()
> #1  0x4e297994 in ?? ()
> #2  0x4e297994 in ?? ()
> Spinning.  Please run 'gdb gst-launch 1856' to continue debugging, Ctrl-C to
> quit, or Ctrl-\ to dump core.
>
> Do you have any suggestions to solve this problem?

Yes, please submit a bug here:
https://bugzilla.yoctoproject.org/enter_bug.cgi?product=BSPs


It´s a .so missing.

I tried to reproduce the same on LTIB rootfs and I was not able to reproduce.


Let´s work to fix that ;-)
(And thanks for discovering that)

Daiane

Re: i.MX6 mfw_isink is not working with X11 "Nitrogen"

[Tarek El-Sherbiny]

[-- Attachment #1: Type: text/plain, Size: 1657 bytes --]

Filed one:
https://bugzilla.yoctoproject.org/show_bug.cgi?id=3617


On Mon, Dec 17, 2012 at 6:33 PM, Daiane Angolini <daiane.list@gmail.com>wrote:

> On Mon, Dec 17, 2012 at 3:59 PM, Tarek El-Sherbiny
> <tarek.elsherbiny@gmail.com> wrote:
> > Hi Daiane,
> >
> > Yes, This change improved things.
> >
> > I can play video but only once!  the second time I run the same command I
> > get this error:
> >
> > [INFO] bitstreamMode 1, chromaInterleave 1, mapType 0,
> tiled2LinearEnable 0
> > hwbuf allocator zone(356352) created
> > can not create threadmfw_gst_isink_setcaps:1489
> > Pipeline is PREROLLED ...
> > Setting pipeline to PLAYING ...
> > VS0 created. in fmt[NV12] win(0,0-640,360:640x360) out
> > win(0,0-512,384:512x384)
> > New clock: GstAudioSinkClock
> > vss/mfw_gst_vss_common.c:701 ioctl error, return -1
> > vss/mfw_gst_vss_common.c:726 ioctl error, return -1
> > set deinterlace mode 0
> > Can not open dll, libgstfsl-0.10.so: cannot open shared object file: No
> such
> > file or directory.
> > Caught SIGSEGV accessing address (nil)
> > #0  0x4e2979a4 in ?? ()
> > #1  0x4e297994 in ?? ()
> > #2  0x4e297994 in ?? ()
> > Spinning.  Please run 'gdb gst-launch 1856' to continue debugging,
> Ctrl-C to
> > quit, or Ctrl-\ to dump core.
> >
> > Do you have any suggestions to solve this problem?
>
> Yes, please submit a bug here:
> https://bugzilla.yoctoproject.org/enter_bug.cgi?product=BSPs
>
>
> It´s a .so missing.
>
> I tried to reproduce the same on LTIB rootfs and I was not able to
> reproduce.
>
>
> Let´s work to fix that ;-)
> (And thanks for discovering that)
>
> Daiane
>

[-- Attachment #2: Type: text/html, Size: 2492 bytes --]

Re: i.MX6 mfw_isink is not working with X11 "Nitrogen"

[Eric Nelson]

Hi Tarek,

Note that the code in /unit_tests doesn't involve gstreamer...

It does use the ipu_lib, but you confirmed that this worked
already, by testing the non-X gstreamer plugin.

Regards,


Eric

On 12/17/2012 08:31 AM, Tarek El-Sherbiny wrote:
> Hi Eric,
>
> I think it's not the mfw_isink but X11 itself.
>
> I have confirmed that by running the unit test:
> /unit_tests/mxc_epdc_x11_fb_test.out
> Error: unable to open X display
>
> Do you get the same error with LTIB?
>
> Thanks,
> Tarek
>
> On Mon, Dec 17, 2012 at 3:19 PM, Eric Nelson <
> eric.nelson@boundarydevices.com> wrote:
>
>> Hi Tarek,
>>
>>
>> On 12/17/2012 05:32 AM, Tarek El-Sherbiny wrote:
>>
>>> Hi,
>>>
>>> I have compiled X11 image based on core-image-x11.bb for the Nitrogen6x
>>> MACHINE. This is my image bb file:
>>>
>>> ------------------------------**------------------------------**-
>>> include recipes-graphics/images/core-**image-x11.bb<http://core-image-x11.bb>
>>>
>>>
>>
>>> IMAGE_FEATURES += "debug-tweaks"
>>> DISTRO_FEATURES += "pulseaudio"
>>>
>>>
>>>   > <snip>
>>
>>>
>>> The gstreamer runs perfectly well with mfw_v4lsink using this command:
>>> gst-launch playbin2 uri=
>>> file:///home/root/mmfiles/**clipcanvas_14348_offline.mp4<**
>>> file:///%5C%5Chome%5Croot%**5Cmmfiles%5Cclipcanvas_14348_**offline.mp4>
>>>
>>>
>>> I need to use mfw_isink to scale and convert the output so I use the
>>> following command which doesn't work:
>>> gst-launch playbin2 uri=
>>> file:///home/root/mmfiles/**clipcanvas_14348_offline.mp4
>>> video-sink="mfw_isink
>>> axis-top=0 axis-left=0 disp-width=512 disp-height=384"
>>>
>>> So I disabled the x11 flag for gst-fsl-plugin by
>>> creating gst-fsl-plugin_3.0.1.bbappend:
>>> PRINC := "${@int(PRINC) + 1}"
>>>
>>> EXTRA_OECONF += "--enable-x11=no --disable-x11"
>>>
>>> Now the mfw_isink is working!!!!???
>>>
>>> Can someone please try the mfw_isink command on his target?
>>>
>>>
>> Thanks for the note. We thought that mfw_isink was completely broken
>> on i.MX6.
>>
>>
>>   I would like to know if it is the Nitrogen board or something else that
>>> makes gst-fsl-plugin not compatible with X11.
>>>
>>>
>> There is absolutely no difference in this area (IPU) between the
>> SABRE Lite board and Nitrogen6X. I suspect that those with SABRE SD
>> boards can also confirm that mfw_isink fails in the same way with the
>> default compilation.
>>
>> We noticed it in LTIB builds.
>>
>> Regards,
>>
>>
>> Eric
>>
>