How to use linux-firmware to install single firmware package? #kirkstone

How to use linux-firmware to install single firmware package? #kirkstone

[Livius]

[-- Attachment #1: Type: text/plain, Size: 683 bytes --]

Hi,

I would like to install linux-firmware-ath10k and linux-firmware-imx-sdma-imx7d firmware package to my image recipe in kirkstone release but when i append them to IMAGE_INSTALL somewhy each pack from linux-firmware recipe installs itself. It is extramly large in size about 500 MB, it is totaly not accaptable for me, it is too large.

I am using the following syntax to install them:

IMAGE_INSTALL:append = " linux-firmware-imx-sdma-imx7d linux-firmware-ath10k"

If i remove them, there are no any linux-firmware in my deployed image, it means somehow they trigger to install the full linux-firmware pack, how can i use it to install only some single linux-firmware?

[-- Attachment #2: Type: text/html, Size: 755 bytes --]

Re: [OE-core] How to use linux-firmware to install single firmware package? #kirkstone

[Quentin Schulz]

Hi Livius,

On 11/4/22 00:07, Livius wrote:
> Hi,
> 
> I would like to install linux-firmware-ath10k and linux-firmware-imx-sdma-imx7d firmware package to my image recipe in kirkstone release but when i append them to IMAGE_INSTALL somewhy each pack from linux-firmware recipe installs itself. It is extramly large in size about 500 MB, it is totaly not accaptable for me, it is too large.
> 
> I am using the following syntax to install them:
> 
> IMAGE_INSTALL:append = " linux-firmware-imx-sdma-imx7d linux-firmware-ath10k"
> 

This seems correct to me.

> If i remove them, there are no any linux-firmware in my deployed image, it means somehow they trigger to install the full linux-firmware pack, how can i use it to install only some single linux-firmware?
> 

There might be an issue somewhere, we need to debug this. Can you 
reproduce this with only poky?

Which version of oe-core/yocto are you using?

Can you run bitbake -g <your-image>? Check that only your 
linux-firmwasre packages are installed in the image. You can also check 
that the linux-firmware packages don't contain more files than they 
should (either look into the .rpm/.deb/.ipk packages in tmp/deploy or in 
WORKDIR/packages/ of linux-firmware). Also look at the .dot files with 
your favorite text editor and check what does linux-firmware-ath10k 
bring in as a dependency, maybe there's a bad dependency somewhere that 
brings some other packages in.

Cheers,
Quentin

Re: How to use linux-firmware to install single firmware package? #kirkstone

[Livius]

[-- Attachment #1: Type: text/plain, Size: 796 bytes --]

In my tmp/deploy/rpm/noarch folder i can see many-many other firmware .rpm files like linux-firmware-bcm43xx, linux-firmware-nvidia-tegra and so on, these were not planed to be installed. It seems to me, the full linux-firmware package was deployed somehow. I think i am using poky now, this is my path for linux-firmware: PROJECT/sources/poky/meta/recipes-kernel/linux-firmware/linux-firmware_20220913.bb

So, my poky come from git.yoctoproject.org ( https://git.yoctoproject.org/poky/log/?h=kirkstone ) , i use latest kirkstone commit ( https://git.yoctoproject.org/poky/commit/?h=kirkstone&id=2e79b199114b25d81bfaa029ccfb17676946d20d ).

In pn-buildlist and task-depends.dot i can see only linux-firmware, i have no any listed single package like should be linux-firmware-imx-sdma-imx7d.

[-- Attachment #2: Type: text/html, Size: 904 bytes --]

Re: [OE-core] How to use linux-firmware to install single firmware package? #kirkstone

[Quentin Schulz]

Hi Livius,

On 11/4/22 13:42, Livius wrote:
> In my tmp/deploy/rpm/noarch folder i can see many-many other firmware .rpm files like linux-firmware-bcm43xx, linux-firmware-nvidia-tegra and so on, these were not planed to be installed. It seems to me, the full linux-firmware package was deployed somehow.

Yes, that's normal. When a recipe is built, all its packages are created 
and put into that directory. It's not because the package is created 
that it's installed in the final rootfs.

 > I think i am using poky now, this is my path for linux-firmware: 
PROJECT/sources/poky/meta/recipes-kernel/linux-firmware/linux-firmware_20220913.bb
> 
> So, my poky come from git.yoctoproject.org ( https://urldefense.com/v3/__https://git.yoctoproject.org/poky/log/?h=kirkstone__;!!OOPJP91ZZw!iE35Nh5nRc3nFT6cCWMcIbXJsRTSva3-k0ELYN7qrnPobvaTVmufMXyu6PTsr_2phXtEqT4WAHAyDmU3tfm0A0o7KOuVycOZZMX2Wg$  ) , i use latest kirkstone commit ( https://urldefense.com/v3/__https://git.yoctoproject.org/poky/commit/?h=kirkstone&id=2e79b199114b25d81bfaa029ccfb17676946d20d__;!!OOPJP91ZZw!iE35Nh5nRc3nFT6cCWMcIbXJsRTSva3-k0ELYN7qrnPobvaTVmufMXyu6PTsr_2phXtEqT4WAHAyDmU3tfm0A0o7KOuVycMxLdUTqg$  ).
> 

And there's no bbappend for linux-firmware anywhere?
Run:
bitbake-layers show-appends linux-firmware

> In pn-buildlist and task-depends.dot i can see only linux-firmware, i have no any listed single package like should be linux-firmware-imx-sdma-imx7d.
> 

Mmm indeed, less helpful than I had imagined. I think you can figure out 
which packages are installed by adding INHERIT += "buildhistory". It 
should create an installed-packages.txt file after a build.

Cheers,
Quentin

Re: How to use linux-firmware to install single firmware package? #kirkstone

[Vincent Davis Jr]

[-- Attachment #1: Type: text/plain, Size: 393 bytes --]

I can confirm I'm seeing something similar with MACHINE_ESSENTIAL_EXTRA_RDEPENDS = "linux-firmware-amdgpu"

I use with OE-core kirkstone HEAD + custom distro config. Was wondering of the best way to debug why issue occurs.

Is there anything else besides bitbake -g <your-image> and INHERIT += "buildhistory" that I can try?
How would one best check what happens during rootfs creation?

[-- Attachment #2: Type: text/html, Size: 419 bytes --]

Re: [OE-core] How to use linux-firmware to install single firmware package? #kirkstone

[Alexander Kanavin]

On Fri, 4 Nov 2022 at 15:59, Vincent Davis Jr <vince@underview.tech> wrote:
> I can confirm I'm seeing something similar with MACHINE_ESSENTIAL_EXTRA_RDEPENDS = "linux-firmware-amdgpu"
>
> I use with OE-core kirkstone HEAD + custom distro config. Was wondering of the best way to debug why issue occurs.
>
> Is there anything else besides bitbake -g <your-image> and INHERIT += "buildhistory" that I can try?
> How would one best check what happens during rootfs creation?

There is a log for it like for any other task - look in
WORKDIR/temp/log.do_rootfs for it. You'll see exact commands issued to
the package manager for one thing. That may help pinpoint where
unwanted packages are being requested and installed.

Alex

Re: How to use linux-firmware to install single firmware package? #kirkstone

[Livius]

[-- Attachment #1: Type: text/plain, Size: 461 bytes --]

I have a linux-firmware_%.bbappend ( https://github.com/Freescale/meta-freescale-3rdparty/blob/kirkstone/recipes-kernel/linux-firmware/linux-firmware_%25.bbappend ) from meta-freescale-3rdparty layer. I think, it is too simple, it can not cause the problem. In my local.conf I set up to generate buildhistory (i used the following commands), soon my next image build is ready an i can share the results.

INHERIT += "buildhistory"
BUILDHISTORY_COMMIT = "0"

[-- Attachment #2: Type: text/html, Size: 552 bytes --]

Re: How to use linux-firmware to install single firmware package? #kirkstone

[Livius]

[-- Attachment #1: Type: text/plain, Size: 477 bytes --]

What should i check in buildhistory? In my buildhistory folder linux-firmware folder contains all packages as a subfolders, like was in my tmp/deploy/rpm/noarch. Following content is in my linux-firmware/linux-firmware-imx-sdma-imx7d/latest text file.

PE = 1
PV = 20220913
PR = r0
RPROVIDES =
RDEPENDS = linux-firmware-imx-sdma-license
RRECOMMENDS =
PKGSIZE = 2862
FILES = /lib/firmware/imx/sdma/sdma-imx7d.bin
FILELIST = /lib/firmware/imx/sdma/sdma-imx7d.bin

[-- Attachment #2: Type: text/html, Size: 618 bytes --]

Re: [OE-core] How to use linux-firmware to install single firmware package? #kirkstone

[Quentin Schulz]

Hi,

On 11/4/22 19:44, Livius wrote:
> What should i check in buildhistory? In my buildhistory folder linux-firmware folder contains all packages as a subfolders, like was in my tmp/deploy/rpm/noarch. Following content is in my linux-firmware/linux-firmware-imx-sdma-imx7d/latest text file.
> 
> PE = 1
> PV = 20220913
> PR = r0
> RPROVIDES =
> RDEPENDS = linux-firmware-imx-sdma-license
> RRECOMMENDS =
> PKGSIZE = 2862
> FILES = /lib/firmware/imx/sdma/sdma-imx7d.bin
> FILELIST = /lib/firmware/imx/sdma/sdma-imx7d.bin
> 

The installed-packages.txt would probably list all linux-firmware 
packages I assume?

Could you also check the 
linux-firmware/linux-firmware-imx-sdma-license/latest text file and tell 
us what it contains? Because the content of 
linux-firmware/linux-firmware-imx-sdma-imx7d/latest seems to be fine.

Cheers,
Quentin

How to use linux-firmware to install single firmware package? #kirkstone

[Yang, Wilson]

[-- Attachment #1: Type: text/plain, Size: 1255 bytes --]

Hi,

We ran into same issue described in https://lore.kernel.org/all/CGDd.1667516824130158087.aCkO@lists.openembedded.org/t/

Not sure if any solutions/workarounds available to share?

We only want two linux-firmware packages, linux-firmware-imx-sdma-imx6q and linux-firmware-imx-sdma-imx7d which are removed from IMAGE_INSTALL:append from our core-image.bb file. Also add IMAGE_INSTALL:remove = "linux-firmware" in same .bb file to remove it.
Unfortunately, the installed-packages.txt still shows the complete list of linux-firmware packages installed that results much larger binary size than ideal.

Thanks in advance for your info/help.

Wilson Yang

** Statement from Terumo BCT, Inc. **

Confidential and/or privileged information may be contained in this message and any attachments. If you are not the intended recipient you should not copy or forward this message and should destroy it immediately. Any disclosure, copying, distribution and/or any other use of this communication by anyone other than the intended recipient is strictly prohibited and may be unlawful. The opinions, conclusions and other information in this message do not necessarily represent the views and/or opinions of the employer.

** End of statement **

[-- Attachment #2: Type: text/html, Size: 3049 bytes --]

Re: How to use linux-firmware to install single firmware package? #kirkstone

[Vincent Davis Jr]

[-- Attachment #1: Type: text/plain, Size: 481 bytes --]

Same problem as above

https://lists.openembedded.org/g/openembedded-core/topic/94795411#172656

Maybe try MACHINE_ESSENTIAL_EXTRA_RDEPENDS with OE core master.

For me it only includes specified linux-firmware package.

I had a similar issue awhile back, but I think a solution landed in OE core master.
Although from commit message seems unrelated. I believe this is what solved
the problem for me.

https://lists.openembedded.org/g/openembedded-core/message/173867

[-- Attachment #2: Type: text/html, Size: 764 bytes --]