Is There a Package Limit to use of Smart / RPM?

Is There a Package Limit to use of Smart / RPM?

[Darcy Watkins]

[-- Attachment #1: Type: text/plain, Size: 1289 bytes --]

Hi,

In my project, we have exceeded 700 packages and have run into numerous issues using smart with rpm handling large transactions on the target (e.g. update from a non-PR service build to a PR-service build resulting in all RPMs being updated, though most are just version/release 'bumped' by the PR service).

Before I dig too deep, I figured I would see if anyone recognizes this signature as a known issue.

1.  Are there any hard coded limits to number of packages that can be handled in a smart/rpm transaction?  (Particularly around 700)?
2.  Are there known issues related to when 'smart' updates itself and/or 'rpm'?

Daisy branch
Layerscape (ARM) architecture
Kernel 3.19 (yocto-linux + BSP patches)
Installing on ext3 rootfs
Building on CentOS7

All appeared to work fine until recently when a bunch of added kernel modules and other firmware packages were added, which makes me wonder about a magic limit of 700.

Thanks in advance for your insights.




Regards,

Darcy

Darcy Watkins :: Staff Engineer, Firmware

SIERRA WIRELESS
Direct +1 604 233 7989 :: Fax +1 604 231 1109 :: Main +1 604 231 1100
13811 Wireless Way :: Richmond, BC Canada V6V 3A4
[M1]
dwatkins@sierrawireless.com :: www.sierrawireless.com :: www.inmotiontechnology.com


[-- Attachment #2: Type: text/html, Size: 3189 bytes --]

Re: Is There a Package Limit to use of Smart / RPM?

[Mike Looijmans]

We've seen similar effects with IPK packages and opkg, but the problem then 
isn't so much the package manager, but it's just that some packages don't 
upgrade properly when bunched together with some others. For example, two 
packages A and B which individually upgrade just fine, but if you try to 
upgrade them both, something in their pre/post-install/remove actions messes 
things up and causes one or both of them to fail.

Also, things like upgrading network components while using ssh to start the 
upgrade, or upgrading parts of the package manager can also cause strange 
upgrade problems.

I doubt there's some magic "maximum number of packages" in any package manager.


On 28-05-16 21:16, Darcy Watkins wrote:
> Hi,
>
> In my project, we have exceeded 700 packages and have run into numerous issues
> using smart with rpm handling large transactions on the target (e.g. update
> from a non-PR service build to a PR-service build resulting in all RPMs being
> updated, though most are just version/release 'bumped' by the PR service).
>
> Before I dig too deep, I figured I would see if anyone recognizes this
> signature as a known issue.
>
> 1.  Are there any hard coded limits to number of packages that can be handled
> in a smart/rpm transaction?  (Particularly around 700)?
>
> 2.  Are there known issues related to when 'smart' updates itself and/or 'rpm'?
>
> Daisy branch
>
> Layerscape (ARM) architecture
>
> Kernel 3.19 (yocto-linux + BSP patches)
>
> Installing on ext3 rootfs
>
> Building on CentOS7
>
> All appeared to work fine until recently when a bunch of added kernel modules
> and other firmware packages were added, which makes me wonder about a magic
> limit of 700.
>
> Thanks in advance for your insights.
>
>
>
> Regards,
>
> Darcy
>
> Darcy Watkins :: Staff Engineer, Firmware
>
> SIERRA WIRELESS
> Direct +1 604 233 7989 :: Fax +1 604 231 1109 :: Main +1 604 231 1100
> 13811 Wireless Way :: Richmond, BC Canada V6V 3A4
> [M1]
> dwatkins@sierrawireless.com :: www.sierrawireless.com ::
> www.inmotiontechnology.com
>
>
>



Kind regards,

Mike Looijmans
System Expert

TOPIC Embedded Products
Eindhovenseweg 32-C, NL-5683 KH Best
Postbus 440, NL-5680 AK Best
Telefoon: +31 (0) 499 33 69 79
E-mail: mike.looijmans@topicproducts.com
Website: www.topicproducts.com

Please consider the environment before printing this e-mail

Re: Is There a Package Limit to use of Smart / RPM?

[Darcy Watkins]

Thanks!

I think what was happening in my case was some post install scriptlets triggered activity that in turned killed an upgrade service that was running.

We handle the upgrades with the system in sort of an offline state so we don't want the RPM installs / upgrades launching things.  Since manually installing an RPM is not a normal use case in our design, what I wound up having to do was to override the update-rc.d.bbclass to remove the "-s" option passed when installing an RPM on the target.

The result of this was all RPMs to install OK without inadvertently launching the services.  Then we launch the services afterwards.


----------------

Another question: If I want to install RPMs onto my file system offline, but mounted onto a ramdisk boot so that I can run smart/rpm in a chroot scheme, will this work?  I see that in the build system, it relies on '$D' being set to indicate an alternate path.  This handles alternate paths, and usually bypasses stop/start of services.  Do I need to set '$D' up in a similar way on the target?  I am thinking of an offline upgrade scheme on the target similar in intent to say 'fedup' so that I don't have to worry about an RPM upgrade to say 'db' package or 'rpm' pulling the rug out from under the upgrade.  In this case, my offline rootfs may be mounted say at /mnt/...

Thanks!


Regards,

Darcy

Darcy Watkins ::  Staff Engineer, Firmware

SIERRA WIRELESS
Direct  +1 604 233 7989   ::  Fax  +1 604 231 1109  ::  Main  +1 604 231 1100
13811 Wireless Way  :: Richmond, BC Canada V6V 3A4
[P2]
dwatkins@sierrawireless.com :: www.sierrawireless.com :: www.inmotiontechnology.com 

-----Original Message-----
From: Mike Looijmans [mailto:mike.looijmans@topic.nl] 
Sent: May-30-16 12:18 AM
To: yocto@yoctoproject.org
Cc: Darcy Watkins <dwatkins@sierrawireless.com>
Subject: Re: [yocto] Is There a Package Limit to use of Smart / RPM?

We've seen similar effects with IPK packages and opkg, but the problem then isn't so much the package manager, but it's just that some packages don't upgrade properly when bunched together with some others. For example, two packages A and B which individually upgrade just fine, but if you try to upgrade them both, something in their pre/post-install/remove actions messes things up and causes one or both of them to fail.

Also, things like upgrading network components while using ssh to start the upgrade, or upgrading parts of the package manager can also cause strange upgrade problems.

I doubt there's some magic "maximum number of packages" in any package manager.


On 28-05-16 21:16, Darcy Watkins wrote:
> Hi,
---snip!---