gstreamer 1.x freescale plugings

gstreamer 1.x freescale plugings

[Alok Kumar]

[-- Attachment #1: Type: text/plain, Size: 495 bytes --]

Hi,
I am very new to yoctoprojects git. I have been using timesys imx6 build for my project, but running in road block for getting freescale gstreamer 1.x plugins.

My questions is where to start if I want to use freescale gstreamer 1.x plugins with timesys build. I am interested in vpu related and streaming related plugins (like RTSP, RTP, RTMP etc).

I want to get latest freescale gstreamer 1.x plugins and cross compile with my build environment.

Thanks for the help

-Alok



[-- Attachment #2: Type: text/html, Size: 2577 bytes --]

Re: gstreamer 1.x freescale plugings

[Daiane Angolini]

On 10/15/2013 10:30 AM, Alok Kumar wrote:
> Hi,
>
> I am very new to yoctoprojects git. I have been using timesys imx6 build
> for my project, but running in road block for getting freescale
> gstreamer 1.x plugins.

I'm not aware of any gstreamer 1.x plugins from Freescale. Do you know 
the release number?

>
> My questions is where to start if I want to use freescale gstreamer 1.x
> plugins with timesys build. I am interested in vpu related and streaming
> related plugins (like RTSP, RTP, RTMP etc).

I would say "with timesys" as i have no idea what timesys does provide.

>
> I want to get latest freescale gstreamer 1.x plugins and cross compile
> with my build environment.
>
> Thanks for the help
>
> -Alok
>
>
>
> _______________________________________________
> meta-freescale mailing list
> meta-freescale@yoctoproject.org
> https://lists.yoctoproject.org/listinfo/meta-freescale
>


-- 
Daiane

Re: gstreamer 1.x freescale plugings

[Alok Kumar]

My apology for not being clear. 
I want to use gstreamer 1.x, but it seems it appears I cannot use HW acceleration (vpudec etc)  provided by free scale plugins. We wanted to use RTMP and dash features from latest gstreamer.

So, the question: How can I use imx6 HW acceleration with gstreamer 1.x ?

Thanks
Alok

-----Original Message-----
From: Daiane Angolini [mailto:daiane.angolini@freescale.com] 
Sent: Tuesday, October 15, 2013 1:03 PM
To: Alok Kumar; meta-freescale@yoctoproject.org
Subject: Re: [meta-freescale] gstreamer 1.x freescale plugings

On 10/15/2013 10:30 AM, Alok Kumar wrote:
> Hi,
>
> I am very new to yoctoprojects git. I have been using timesys imx6 
> build for my project, but running in road block for getting freescale 
> gstreamer 1.x plugins.

I'm not aware of any gstreamer 1.x plugins from Freescale. Do you know the release number?

>
> My questions is where to start if I want to use freescale gstreamer 
> 1.x plugins with timesys build. I am interested in vpu related and 
> streaming related plugins (like RTSP, RTP, RTMP etc).

I would say "with timesys" as i have no idea what timesys does provide.

>
> I want to get latest freescale gstreamer 1.x plugins and cross compile 
> with my build environment.
>
> Thanks for the help
>
> -Alok
>
>
>
> _______________________________________________
> meta-freescale mailing list
> meta-freescale@yoctoproject.org
> https://lists.yoctoproject.org/listinfo/meta-freescale
>


--
Daiane

Re: gstreamer 1.x freescale plugings

[Daiane Angolini]

On 10/15/2013 02:13 PM, Alok Kumar wrote:
> My apology for not being clear.
> I want to use gstreamer 1.x, but it seems it appears I cannot use HW acceleration (vpudec etc)  provided by free scale plugins. We wanted to use RTMP and dash features from latest gstreamer.
>
> So, the question: How can I use imx6 HW acceleration with gstreamer 1.x ?

I'm not aware any way. a new vpuenc plugin should be implememnted, I think



>
> Thanks
> Alok
>
> -----Original Message-----
> From: Daiane Angolini [mailto:daiane.angolini@freescale.com]
> Sent: Tuesday, October 15, 2013 1:03 PM
> To: Alok Kumar; meta-freescale@yoctoproject.org
> Subject: Re: [meta-freescale] gstreamer 1.x freescale plugings
>
> On 10/15/2013 10:30 AM, Alok Kumar wrote:
>> Hi,
>>
>> I am very new to yoctoprojects git. I have been using timesys imx6
>> build for my project, but running in road block for getting freescale
>> gstreamer 1.x plugins.
>
> I'm not aware of any gstreamer 1.x plugins from Freescale. Do you know the release number?
>
>>
>> My questions is where to start if I want to use freescale gstreamer
>> 1.x plugins with timesys build. I am interested in vpu related and
>> streaming related plugins (like RTSP, RTP, RTMP etc).
>
> I would say "with timesys" as i have no idea what timesys does provide.
>
>>
>> I want to get latest freescale gstreamer 1.x plugins and cross compile
>> with my build environment.
>>
>> Thanks for the help
>>
>> -Alok
>>
>>
>>
>> _______________________________________________
>> meta-freescale mailing list
>> meta-freescale@yoctoproject.org
>> https://lists.yoctoproject.org/listinfo/meta-freescale
>>
>
>
> --
> Daiane
>
>


-- 
Daiane

Re: gstreamer 1.x freescale plugings

[Eric Nelson]

Hi Daiane,

On 10/15/2013 10:44 AM, Daiane Angolini wrote:
> On 10/15/2013 02:13 PM, Alok Kumar wrote:
>> My apology for not being clear.
>> I want to use gstreamer 1.x, but it seems it appears I cannot use HW
>> acceleration (vpudec etc)  provided by free scale plugins. We wanted
>> to use RTMP and dash features from latest gstreamer.
>>
>> So, the question: How can I use imx6 HW acceleration with gstreamer 1.x ?
>
> I'm not aware any way. a new vpuenc plugin should be implememnted, I think
>

It seems that you forgot this thread:
	https://lists.yoctoproject.org/pipermail/meta-freescale/2013-August/004094.html

Ashwin indicated that he was going to try, and I thought Philip
published some code.

Since gstreamer-1.0 is supported in the Dora branch of Poky, integrating
should be easier.

Philip, is this still something you're working on, or have you
abandoned the effort?

Please advise,


Eric

Re: gstreamer 1.x freescale plugings

[Daiane Angolini]

On 10/15/2013 03:19 PM, Eric Nelson wrote:
> Hi Daiane,
>
> On 10/15/2013 10:44 AM, Daiane Angolini wrote:
>> On 10/15/2013 02:13 PM, Alok Kumar wrote:
>>> My apology for not being clear.
>>> I want to use gstreamer 1.x, but it seems it appears I cannot use HW
>>> acceleration (vpudec etc)  provided by free scale plugins. We wanted
>>> to use RTMP and dash features from latest gstreamer.
>>>
>>> So, the question: How can I use imx6 HW acceleration with gstreamer
>>> 1.x ?
>>
>> I'm not aware any way. a new vpuenc plugin should be implememnted, I
>> think
>>
>
> It seems that you forgot this thread:
>      https://lists.yoctoproject.org/pipermail/meta-freescale/2013-August/004094.html

Thanks Eric.

>
> Ashwin indicated that he was going to try, and I thought Philip
> published some code.
>
> Since gstreamer-1.0 is supported in the Dora branch of Poky, integrating
> should be easier.
>
> Philip, is this still something you're working on, or have you
> abandoned the effort?
>
> Please advise,
>
>
> Eric
>
>


-- 
Daiane

Re: gstreamer 1.x freescale plugings

[Otavio Salvador]

Hello,

Carlos been working on it for some time.

On Tue, Oct 15, 2013 at 3:20 PM, Daiane Angolini
<daiane.angolini@freescale.com> wrote:
> On 10/15/2013 03:19 PM, Eric Nelson wrote:
...
>>> It seems that you forgot this thread:
>>
>> https://lists.yoctoproject.org/pipermail/meta-freescale/2013-August/004094.html
...
>> Ashwin indicated that he was going to try, and I thought Philip
>> published some code.
>>
>> Since gstreamer-1.0 is supported in the Dora branch of Poky, integrating
>> should be easier.
>>
>> Philip, is this still something you're working on, or have you
>> abandoned the effort?

He pushed his work at:

https://github.com/Freescale/gstreamer-imx

And I know he will be happy to share some more information about this ...

Carlos?

-- 
Otavio Salvador                             O.S. Systems
http://www.ossystems.com.br        http://code.ossystems.com.br
Mobile: +55 (53) 9981-7854            Mobile: +1 (347) 903-9750

Re: gstreamer 1.x freescale plugings

[Carlos Rafael Giani]

Hi,

I have been working on these plugins in my spare time. Currently, there 
are two IPU plugins (a videotransform element and a sink), a GLES based 
sink using Vivante's direct textures (for smooth HD playback), a VPU 
decoder plugin, and several VPU encoder plugins. These work, but there 
are several things left to do. The encoders are relatively unfinished 
(they can encode, but need coniderably more testing), and h264 
reordering and input<->output frame association is not established yet, 
potentially messing up the timestamps.

That said, I can reliably playback 1080p video with this. This is _not_ 
a port of the existing 0.10 plugins, but written from scratch. The 0.10 
plugins have several conceptual flaws, and most importantly, are not 
built on top of the GStreamer video en/decoder base classes. A rewrite 
was just easier.

One detail that was very important to me was to avoid buffer copies as 
much as possible. With GStreamer 1.0 , defining custom allocators and 
attaching metadata to buffers is much easier to do. So for example a 
pipeline which decodes MPEG2, rotates the frame with the IPU, and 
encodes this to h264 automatically ensures the data is not unnecessarily 
copied around by the CPU. It directly wanders from VPU to IPU and VPU 
again through DMA.

I am running into problems with the existing VPU wrapper library there 
(I am not directly using imx-lib). I need some way to pass user data 
through the VPU en- and decoder. That is, when I for example specify 
input data for the decoder, I need a way to also give it a user-defined 
void pointer, that is then passed through and placed into the output 
frame that corresponds to the input frame I just specified. If the 
authors of the VPU wrapper could be contacted, it would be ideal. I 
hesitate to fork it and make my fork a dependency.

Also, a documentation for the VPU wrapper would be very welcome :)

cheers,
   Carlos

On 2013-10-15 20:39, Otavio Salvador wrote:
> Hello,
>
> Carlos been working on it for some time.
>
> On Tue, Oct 15, 2013 at 3:20 PM, Daiane Angolini
> <daiane.angolini@freescale.com> wrote:
>> On 10/15/2013 03:19 PM, Eric Nelson wrote:
> ...
>>>> It seems that you forgot this thread:
>>> https://lists.yoctoproject.org/pipermail/meta-freescale/2013-August/004094.html
> ...
>>> Ashwin indicated that he was going to try, and I thought Philip
>>> published some code.
>>>
>>> Since gstreamer-1.0 is supported in the Dora branch of Poky, integrating
>>> should be easier.
>>>
>>> Philip, is this still something you're working on, or have you
>>> abandoned the effort?
> He pushed his work at:
>
> https://github.com/Freescale/gstreamer-imx
>
> And I know he will be happy to share some more information about this ...
>
> Carlos?
>

Re: gstreamer 1.x freescale plugings

[Eric Nelson]

Thanks for the update Carlos,

On 10/15/2013 11:49 AM, Carlos Rafael Giani wrote:
> Hi,
>
> I have been working on these plugins in my spare time. Currently, there
> are two IPU plugins (a videotransform element and a sink), a GLES based
> sink using Vivante's direct textures (for smooth HD playback), a VPU
> decoder plugin, and several VPU encoder plugins. These work, but there
> are several things left to do. The encoders are relatively unfinished
> (they can encode, but need coniderably more testing), and h264
> reordering and input<->output frame association is not established yet,
> potentially messing up the timestamps.
>
Nice work getting this far!

> That said, I can reliably playback 1080p video with this. This is _not_
> a port of the existing 0.10 plugins, but written from scratch. The 0.10
> plugins have several conceptual flaws, and most importantly, are not
> built on top of the GStreamer video en/decoder base classes. A rewrite
> was just easier.
>
It's funny how that works.

> One detail that was very important to me was to avoid buffer copies as
> much as possible. With GStreamer 1.0 , defining custom allocators and
> attaching metadata to buffers is much easier to do. So for example a
> pipeline which decodes MPEG2, rotates the frame with the IPU, and
> encodes this to h264 automatically ensures the data is not unnecessarily
> copied around by the CPU. It directly wanders from VPU to IPU and VPU
> again through DMA.
>
> I am running into problems with the existing VPU wrapper library there
> (I am not directly using imx-lib). I need some way to pass user data
> through the VPU en- and decoder. That is, when I for example specify
> input data for the decoder, I need a way to also give it a user-defined
> void pointer, that is then passed through and placed into the output
> frame that corresponds to the input frame I just specified. If the
> authors of the VPU wrapper could be contacted, it would be ideal. I
> hesitate to fork it and make my fork a dependency.
>
> Also, a documentation for the VPU wrapper would be very welcome :)
>

Have you seen the file "i.MX_6Dual6Quad_VPU_API_Reference_Manual.pdf"
within the 'docs' package here (item #1):
	https://community.freescale.com/docs/DOC-94809

Re: gstreamer 1.x freescale plugings

[Carlos Rafael Giani]

On 2013-10-15 21:16, Eric Nelson wrote:
> Nice work getting this far!

Thanks :)

>
>> That said, I can reliably playback 1080p video with this. This is _not_
>> a port of the existing 0.10 plugins, but written from scratch. The 0.10
>> plugins have several conceptual flaws, and most importantly, are not
>> built on top of the GStreamer video en/decoder base classes. A rewrite
>> was just easier.
>>
> It's funny how that works.

Indeed. Although this is rather common if the previous version of the 
plugins isn't based on the GStreamer base classes. A rewrite is then 
often the better option, since elements based on GstElement tend to have 
significantly different structures that do not map well to the base classes.

>> Also, a documentation for the VPU wrapper would be very welcome :)
>>
>
> Have you seen the file "i.MX_6Dual6Quad_VPU_API_Reference_Manual.pdf"
> within the 'docs' package here (item #1):
>     https://community.freescale.com/docs/DOC-94809
>

Yes, I have seen and used it. However, this documentation covers the VPU 
portion of the imx-lib. The VPU wrapper is a layer on top of the 
imx-lib, which abstracts away differences between i.MX versions. Many 
parameters and functions of the VPU wrappers are similar to the ones 
from imx-lib, but there are some parts which have no equivalent in the 
imx-lib.
(Using the VPU wrapper has been recommended to me, since it seems the 
imx-lib will be refactored in the near future, with its VPU parts 
extracted into a separate library.)

cheers

Re: gstreamer 1.x freescale plugings

[Philip Craig]

On Wed, Oct 16, 2013 at 4:19 AM, Eric Nelson
<eric.nelson@boundarydevices.com> wrote:
> Ashwin indicated that he was going to try, and I thought Philip
> published some code.
>
> Since gstreamer-1.0 is supported in the Dora branch of Poky, integrating
> should be easier.
>
> Philip, is this still something you're working on, or have you
> abandoned the effort?

I got it to a state where it did what I needed, and haven't worked on
it since. It's definitely not in a state that anyone else will want to
use.

However, Carlos has done a much better job, so I'll be switching to
use his code instead in the near future.

Re: gstreamer 1.x freescale plugings

[Haakon Stende]

[-- Attachment #1: Type: text/plain, Size: 1274 bytes --]

Perhaps a post in the https://community.freescale.com/community/imx would
give you the answers.
I can see that eagle (peng zhou?)  is on of the authors of the the vpu
wrapper when looking into the sourcecode
http://repository.timesys.com/buildsources/l/libfslvpuwrap/libfslvpuwrap-1.0.35/
 and he also has answered some questions in imx-community about vpu.

hste


2013/10/16 Philip Craig <phil@blackmoth.com.au>

> On Wed, Oct 16, 2013 at 4:19 AM, Eric Nelson
> <eric.nelson@boundarydevices.com> wrote:
> > Ashwin indicated that he was going to try, and I thought Philip
> > published some code.
> >
> > Since gstreamer-1.0 is supported in the Dora branch of Poky, integrating
> > should be easier.
> >
> > Philip, is this still something you're working on, or have you
> > abandoned the effort?
>
> I got it to a state where it did what I needed, and haven't worked on
> it since. It's definitely not in a state that anyone else will want to
> use.
>
> However, Carlos has done a much better job, so I'll be switching to
> use his code instead in the near future.
> _______________________________________________
> meta-freescale mailing list
> meta-freescale@yoctoproject.org
> https://lists.yoctoproject.org/listinfo/meta-freescale
>

[-- Attachment #2: Type: text/html, Size: 2130 bytes --]