* opkg-make-index cache failing
@ 2011-11-25 15:38 Koen Kooi
2011-11-25 16:53 ` Richard Purdie
0 siblings, 1 reply; 7+ messages in thread
From: Koen Kooi @ 2011-11-25 15:38 UTC (permalink / raw)
To: Patches and discussions about the oe-core layer
[-- Attachment #1: Type: text/plain, Size: 636 bytes --]
Hi,
In OE-classic the opkg-make-index cache was working pretty well, do_rootfs only spent a few seconds doing opkg-make-index on incremental builds. In the OE-core world the situation is different, opkg-make-index will reindex every package on each do_rootfs run, so after a while building images starts taking *really* long, on my systemd (work/ on ssd, deploy on rotating media) it now takes ±7minutes just do refresh the opkg indices.
Since I can't blame sstate for this I suspect that pseudo gets in the way of the naive caching logic. Is there a simple way to turn off pseudo when running opkg-make-index?
regards,
Koen
[-- Attachment #2: Message signed with OpenPGP using GPGMail --]
[-- Type: application/pgp-signature, Size: 169 bytes --]
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: opkg-make-index cache failing
2011-11-25 15:38 opkg-make-index cache failing Koen Kooi
@ 2011-11-25 16:53 ` Richard Purdie
2011-11-25 18:15 ` Koen Kooi
0 siblings, 1 reply; 7+ messages in thread
From: Richard Purdie @ 2011-11-25 16:53 UTC (permalink / raw)
To: Patches and discussions about the oe-core layer
On Fri, 2011-11-25 at 16:38 +0100, Koen Kooi wrote:
> In OE-classic the opkg-make-index cache was working pretty well,
> do_rootfs only spent a few seconds doing opkg-make-index on
> incremental builds. In the OE-core world the situation is different,
> opkg-make-index will reindex every package on each do_rootfs run, so
> after a while building images starts taking *really* long, on my
> systemd (work/ on ssd, deploy on rotating media) it now takes
> ±7minutes just do refresh the opkg indices.
>
> Since I can't blame sstate for this I suspect that pseudo gets in the
> way of the naive caching logic. Is there a simple way to turn off
> pseudo when running opkg-make-index?
You could try:
PSEUDO_DISABLED=1 opkg-make-index
or even
PSEUDO_UNLOAD=1 opkg-make-index
although the latter is a sledge hammer to crack a nut approach...
Cheers,
Richard
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: opkg-make-index cache failing
2011-11-25 16:53 ` Richard Purdie
@ 2011-11-25 18:15 ` Koen Kooi
2011-11-25 19:59 ` Koen Kooi
0 siblings, 1 reply; 7+ messages in thread
From: Koen Kooi @ 2011-11-25 18:15 UTC (permalink / raw)
To: Patches and discussions about the oe-core layer
[-- Attachment #1: Type: text/plain, Size: 1238 bytes --]
Op 25 nov. 2011, om 17:53 heeft Richard Purdie het volgende geschreven:
> On Fri, 2011-11-25 at 16:38 +0100, Koen Kooi wrote:
>> In OE-classic the opkg-make-index cache was working pretty well,
>> do_rootfs only spent a few seconds doing opkg-make-index on
>> incremental builds. In the OE-core world the situation is different,
>> opkg-make-index will reindex every package on each do_rootfs run, so
>> after a while building images starts taking *really* long, on my
>> systemd (work/ on ssd, deploy on rotating media) it now takes
>> ±7minutes just do refresh the opkg indices.
>>
>> Since I can't blame sstate for this I suspect that pseudo gets in the
>> way of the naive caching logic. Is there a simple way to turn off
>> pseudo when running opkg-make-index?
With a relatively small deploy:
real 6m14.611s
user 2m45.909s
sys 0m43.674s
> You could try:
>
> PSEUDO_DISABLED=1 opkg-make-index
real 5m25.920s
user 2m41.279s
sys 0m41.681s
> or even
>
> PSEUDO_UNLOAD=1 opkg-make-index
real 5m5.699s
user 2m37.283s
sys 0m37.508s
Now I need to double check to see if the patches are really having effect on the opkg caching instead of just not having pseudo overhead.
regards,
Koen
[-- Attachment #2: Message signed with OpenPGP using GPGMail --]
[-- Type: application/pgp-signature, Size: 169 bytes --]
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: opkg-make-index cache failing
2011-11-25 18:15 ` Koen Kooi
@ 2011-11-25 19:59 ` Koen Kooi
2011-11-29 11:40 ` Martin Jansa
0 siblings, 1 reply; 7+ messages in thread
From: Koen Kooi @ 2011-11-25 19:59 UTC (permalink / raw)
To: Patches and discussions about the oe-core layer
[-- Attachment #1: Type: text/plain, Size: 1496 bytes --]
Op 25 nov. 2011, om 19:15 heeft Koen Kooi het volgende geschreven:
>
> Op 25 nov. 2011, om 17:53 heeft Richard Purdie het volgende geschreven:
>
>> On Fri, 2011-11-25 at 16:38 +0100, Koen Kooi wrote:
>>> In OE-classic the opkg-make-index cache was working pretty well,
>>> do_rootfs only spent a few seconds doing opkg-make-index on
>>> incremental builds. In the OE-core world the situation is different,
>>> opkg-make-index will reindex every package on each do_rootfs run, so
>>> after a while building images starts taking *really* long, on my
>>> systemd (work/ on ssd, deploy on rotating media) it now takes
>>> ±7minutes just do refresh the opkg indices.
>>>
>>> Since I can't blame sstate for this I suspect that pseudo gets in the
>>> way of the naive caching logic. Is there a simple way to turn off
>>> pseudo when running opkg-make-index?
>
> With a relatively small deploy:
>
> real 6m14.611s
> user 2m45.909s
> sys 0m43.674s
>
>> You could try:
>>
>> PSEUDO_DISABLED=1 opkg-make-index
>
> real 5m25.920s
> user 2m41.279s
> sys 0m41.681s
>
>> or even
>>
>> PSEUDO_UNLOAD=1 opkg-make-index
>
> real 5m5.699s
> user 2m37.283s
> sys 0m37.508s
>
> Now I need to double check to see if the patches are really having effect on the opkg caching instead of just not having pseudo overhead.
Retesting without PSEUDO changes:
real 5m18.412s
user 2m40.736s
sys 0m41.374s
So the PSEUDO changes don't seem to do much :(
[-- Attachment #2: Message signed with OpenPGP using GPGMail --]
[-- Type: application/pgp-signature, Size: 169 bytes --]
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: opkg-make-index cache failing
2011-11-25 19:59 ` Koen Kooi
@ 2011-11-29 11:40 ` Martin Jansa
2012-03-29 7:58 ` Martin Jansa
0 siblings, 1 reply; 7+ messages in thread
From: Martin Jansa @ 2011-11-29 11:40 UTC (permalink / raw)
To: Patches and discussions about the oe-core layer
[-- Attachment #1: Type: text/plain, Size: 6641 bytes --]
On Fri, Nov 25, 2011 at 08:59:06PM +0100, Koen Kooi wrote:
>
> Op 25 nov. 2011, om 19:15 heeft Koen Kooi het volgende geschreven:
>
> >
> > Op 25 nov. 2011, om 17:53 heeft Richard Purdie het volgende geschreven:
> >
> >> On Fri, 2011-11-25 at 16:38 +0100, Koen Kooi wrote:
> >>> In OE-classic the opkg-make-index cache was working pretty well,
> >>> do_rootfs only spent a few seconds doing opkg-make-index on
> >>> incremental builds. In the OE-core world the situation is different,
> >>> opkg-make-index will reindex every package on each do_rootfs run, so
> >>> after a while building images starts taking *really* long, on my
> >>> systemd (work/ on ssd, deploy on rotating media) it now takes
> >>> ±7minutes just do refresh the opkg indices.
> >>>
> >>> Since I can't blame sstate for this I suspect that pseudo gets in the
> >>> way of the naive caching logic. Is there a simple way to turn off
> >>> pseudo when running opkg-make-index?
> >
> > With a relatively small deploy:
> >
> > real 6m14.611s
> > user 2m45.909s
> > sys 0m43.674s
> >
> >> You could try:
> >>
> >> PSEUDO_DISABLED=1 opkg-make-index
> >
> > real 5m25.920s
> > user 2m41.279s
> > sys 0m41.681s
> >
> >> or even
> >>
> >> PSEUDO_UNLOAD=1 opkg-make-index
> >
> > real 5m5.699s
> > user 2m37.283s
> > sys 0m37.508s
> >
> > Now I need to double check to see if the patches are really having effect on the opkg caching instead of just not having pseudo overhead.
>
> Retesting without PSEUDO changes:
>
> real 5m18.412s
> user 2m40.736s
> sys 0m41.374s
>
> So the PSEUDO changes don't seem to do much :(
I can confirm this change here too:
OE om-gta02@shr ~/shr-core $ time /usr/bin/python2.7 \
/OE/shr-core/tmp/sysroots/x86_64-linux/usr/bin/opkg-make-index \
-r /OE/shr-core/tmp/deploy/ipk/armv4t/Packages \
-p /OE/shr-core/tmp/deploy/ipk/armv4t/Packages \
-l /OE/shr-core/tmp/deploy/ipk/armv4t/Packages.filelist \
-m /OE/shr-core/tmp/deploy/ipk/armv4t/
real 11m47.949s
user 4m13.848s
sys 0m17.917s
It hurts even more when someone is building ie for spitz and
linux-kexecboot depends on initramfs image which calls another
opkg-make-index with every image build.
If I replace opkg-make-index from oe-core with old oe-classic version, I
get a lot of messages like:
"Lost field license, MIT-X"
but the time is similar
real 10m23.953s
user 4m10.940s
sys 0m15.833s
And if I do the same completely in shr-unstable (based on OE-classic)
OE om-gta02@shr ~/shr-unstable $ time /usr/bin/python2.7 \
/OE/shr-unstable/tmp/sysroots/x86_64-linux/usr/bin/opkg-make-index \
-r /OE/shr-unstable/tmp/deploy/ipk/armv4t/Packages \
-p /OE/shr-unstable/tmp/deploy/ipk/armv4t/Packages \
-l /OE/shr-unstable/tmp/deploy/ipk/armv4t/Packages.filelist \
-m /OE/shr-unstable/tmp/deploy/ipk/armv4t/
real 0m6.469s
user 0m6.056s
sys 0m0.400s
Another difference seems to be in Packages.filelist which were empty in
OE-classic:
OE om-gta02@shr ~/shr-core $ find tmp/deploy/ipk/ -name Packages.filelist -exec wc -l {} \;
1173 tmp/deploy/ipk/palmpre2/Packages.filelist
1254 tmp/deploy/ipk/palmpre/Packages.filelist
107346 tmp/deploy/ipk/armv4t/Packages.filelist
110557 tmp/deploy/ipk/armv7a-vfp-neon/Packages.filelist
0 tmp/deploy/ipk/Packages.filelist
1365 tmp/deploy/ipk/nokia900/Packages.filelist
812 tmp/deploy/ipk/all/Packages.filelist
1643 tmp/deploy/ipk/om_gta02/Packages.filelist
OE om-gta02@shr ~/shr-core $ cd ../shr-unstable/
OE om-gta02@shr ~/shr-unstable $ find tmp/deploy/ipk/ -name Packages.filelist -exec wc -l {} \;
0 tmp/deploy/ipk/armv7a/Packages.filelist
0 tmp/deploy/ipk/om-gta01/Packages.filelist
0 tmp/deploy/ipk/om-gta02/Packages.filelist
0 tmp/deploy/ipk/palmpre2/Packages.filelist
0 tmp/deploy/ipk/armv6/Packages.filelist
0 tmp/deploy/ipk/palmpre/Packages.filelist
0 tmp/deploy/ipk/armv4t/Packages.filelist
0 tmp/deploy/ipk/armv4/Packages.filelist
0 tmp/deploy/ipk/armv6-novfp/Packages.filelist
0 tmp/deploy/ipk/Packages.filelist
0 tmp/deploy/ipk/htcdream/Packages.filelist
0 tmp/deploy/ipk/nokia900/Packages.filelist
0 tmp/deploy/ipk/all/Packages.filelist
0 tmp/deploy/ipk/armv7/Packages.filelist
But that's not the cause, because even without Packages.filelist
generation it takes about 3 min (better but it still writes info for
every package).
Weird is that there is only small diff between new and old opkg.py/opkg-make-index
--- /OE/shr-unstable/tmp/sysroots/x86_64-linux/usr/bin/opkg.py 2011-05-27 18:35:03.000000000 +0200
+++ /OE/shr-core/tmp/sysroots/x86_64-linux/usr/bin/opkg.py 2011-09-01 16:36:35.000000000 +0200
@@ -145,6 +145,7 @@
self.priority = None
self.tags = None
self.fn = fn
+ self.license = None
if fn:
# see if it is deb format
@@ -319,6 +320,12 @@
def get_section(self, section):
return self.section
+ def set_license(self, license):
+ self.license = license
+
+ def get_license(self, license):
+ return self.license
+
def get_file_list(self):
if not self.fn:
return []
@@ -425,6 +432,7 @@
if self.description: out = out + "Description: %s\n" % (self.description)
if self.oe: out = out + "OE: %s\n" % (self.oe)
if self.homepage: out = out + "HomePage: %s\n" % (self.homepage)
+ if self.license: out = out + "License: %s\n" % (self.license)
if self.priority: out = out + "Priority: %s\n" % (self.priority)
if self.tags: out = out + "Tags: %s\n" % (self.tags)
out = out + "\n"
(reverse-i-search)`uNr': diff -^Cr ~/common/conf/shr-core/ conf/
--- /OE/shr-unstable/tmp/sysroots/x86_64-linux/usr/bin/opkg-make-index 2011-05-27 18:35:03.000000000 +0200
+++ /OE/shr-core/tmp/sysroots/x86_64-linux/usr/bin/opkg-make-index 2011-11-29 12:32:39.000000000 +0100
@@ -197,7 +197,15 @@
names = packages.packages.keys()
names.sort()
for name in names:
- for fn in packages[name].get_file_list():
+ try:
+ fnlist = packages[name].get_file_list()
+ except OSError, e:
+ sys.stderr.write("Package %s disappeared on us!\n" % (name))
+ continue
+ except IOError, e:
+ sys.stderr.write("Package %s disappeared on us!\n" % (name))
+ continue
+ for fn in fnlist:
(h,t) = os.path.split(fn)
if not t: continue
if not files.has_key(t): files[t] = name+':'+fn
Regards,
--
Martin 'JaMa' Jansa jabber: Martin.Jansa@gmail.com
[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 205 bytes --]
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: opkg-make-index cache failing
2011-11-29 11:40 ` Martin Jansa
@ 2012-03-29 7:58 ` Martin Jansa
2012-03-29 8:59 ` Richard Purdie
0 siblings, 1 reply; 7+ messages in thread
From: Martin Jansa @ 2012-03-29 7:58 UTC (permalink / raw)
To: Patches and discussions about the oe-core layer
[-- Attachment #1: Type: text/plain, Size: 8268 bytes --]
On Tue, Nov 29, 2011 at 12:40:52PM +0100, Martin Jansa wrote:
> On Fri, Nov 25, 2011 at 08:59:06PM +0100, Koen Kooi wrote:
> >
> > Op 25 nov. 2011, om 19:15 heeft Koen Kooi het volgende geschreven:
> >
> > >
> > > Op 25 nov. 2011, om 17:53 heeft Richard Purdie het volgende geschreven:
> > >
> > >> On Fri, 2011-11-25 at 16:38 +0100, Koen Kooi wrote:
> > >>> In OE-classic the opkg-make-index cache was working pretty well,
> > >>> do_rootfs only spent a few seconds doing opkg-make-index on
> > >>> incremental builds. In the OE-core world the situation is different,
> > >>> opkg-make-index will reindex every package on each do_rootfs run, so
> > >>> after a while building images starts taking *really* long, on my
> > >>> systemd (work/ on ssd, deploy on rotating media) it now takes
> > >>> ±7minutes just do refresh the opkg indices.
> > >>>
> > >>> Since I can't blame sstate for this I suspect that pseudo gets in the
> > >>> way of the naive caching logic. Is there a simple way to turn off
> > >>> pseudo when running opkg-make-index?
> > >
> > > With a relatively small deploy:
> > >
> > > real 6m14.611s
> > > user 2m45.909s
> > > sys 0m43.674s
> > >
> > >> You could try:
> > >>
> > >> PSEUDO_DISABLED=1 opkg-make-index
> > >
> > > real 5m25.920s
> > > user 2m41.279s
> > > sys 0m41.681s
> > >
> > >> or even
> > >>
> > >> PSEUDO_UNLOAD=1 opkg-make-index
> > >
> > > real 5m5.699s
> > > user 2m37.283s
> > > sys 0m37.508s
> > >
> > > Now I need to double check to see if the patches are really having effect on the opkg caching instead of just not having pseudo overhead.
> >
> > Retesting without PSEUDO changes:
> >
> > real 5m18.412s
> > user 2m40.736s
> > sys 0m41.374s
> >
> > So the PSEUDO changes don't seem to do much :(
>
> I can confirm this change here too:
> OE om-gta02@shr ~/shr-core $ time /usr/bin/python2.7 \
> /OE/shr-core/tmp/sysroots/x86_64-linux/usr/bin/opkg-make-index \
> -r /OE/shr-core/tmp/deploy/ipk/armv4t/Packages \
> -p /OE/shr-core/tmp/deploy/ipk/armv4t/Packages \
> -l /OE/shr-core/tmp/deploy/ipk/armv4t/Packages.filelist \
> -m /OE/shr-core/tmp/deploy/ipk/armv4t/
>
>
> real 11m47.949s
> user 4m13.848s
> sys 0m17.917s
>
> It hurts even more when someone is building ie for spitz and
> linux-kexecboot depends on initramfs image which calls another
> opkg-make-index with every image build.
>
> If I replace opkg-make-index from oe-core with old oe-classic version, I
> get a lot of messages like:
> "Lost field license, MIT-X"
>
> but the time is similar
> real 10m23.953s
> user 4m10.940s
> sys 0m15.833s
>
> And if I do the same completely in shr-unstable (based on OE-classic)
> OE om-gta02@shr ~/shr-unstable $ time /usr/bin/python2.7 \
> /OE/shr-unstable/tmp/sysroots/x86_64-linux/usr/bin/opkg-make-index \
> -r /OE/shr-unstable/tmp/deploy/ipk/armv4t/Packages \
> -p /OE/shr-unstable/tmp/deploy/ipk/armv4t/Packages \
> -l /OE/shr-unstable/tmp/deploy/ipk/armv4t/Packages.filelist \
> -m /OE/shr-unstable/tmp/deploy/ipk/armv4t/
>
>
> real 0m6.469s
> user 0m6.056s
> sys 0m0.400s
>
> Another difference seems to be in Packages.filelist which were empty in
> OE-classic:
>
> OE om-gta02@shr ~/shr-core $ find tmp/deploy/ipk/ -name Packages.filelist -exec wc -l {} \;
> 1173 tmp/deploy/ipk/palmpre2/Packages.filelist
> 1254 tmp/deploy/ipk/palmpre/Packages.filelist
> 107346 tmp/deploy/ipk/armv4t/Packages.filelist
> 110557 tmp/deploy/ipk/armv7a-vfp-neon/Packages.filelist
> 0 tmp/deploy/ipk/Packages.filelist
> 1365 tmp/deploy/ipk/nokia900/Packages.filelist
> 812 tmp/deploy/ipk/all/Packages.filelist
> 1643 tmp/deploy/ipk/om_gta02/Packages.filelist
> OE om-gta02@shr ~/shr-core $ cd ../shr-unstable/
> OE om-gta02@shr ~/shr-unstable $ find tmp/deploy/ipk/ -name Packages.filelist -exec wc -l {} \;
> 0 tmp/deploy/ipk/armv7a/Packages.filelist
> 0 tmp/deploy/ipk/om-gta01/Packages.filelist
> 0 tmp/deploy/ipk/om-gta02/Packages.filelist
> 0 tmp/deploy/ipk/palmpre2/Packages.filelist
> 0 tmp/deploy/ipk/armv6/Packages.filelist
> 0 tmp/deploy/ipk/palmpre/Packages.filelist
> 0 tmp/deploy/ipk/armv4t/Packages.filelist
> 0 tmp/deploy/ipk/armv4/Packages.filelist
> 0 tmp/deploy/ipk/armv6-novfp/Packages.filelist
> 0 tmp/deploy/ipk/Packages.filelist
> 0 tmp/deploy/ipk/htcdream/Packages.filelist
> 0 tmp/deploy/ipk/nokia900/Packages.filelist
> 0 tmp/deploy/ipk/all/Packages.filelist
> 0 tmp/deploy/ipk/armv7/Packages.filelist
>
> But that's not the cause, because even without Packages.filelist
> generation it takes about 3 min (better but it still writes info for
> every package).
>
> Weird is that there is only small diff between new and old opkg.py/opkg-make-index
> --- /OE/shr-unstable/tmp/sysroots/x86_64-linux/usr/bin/opkg.py 2011-05-27 18:35:03.000000000 +0200
> +++ /OE/shr-core/tmp/sysroots/x86_64-linux/usr/bin/opkg.py 2011-09-01 16:36:35.000000000 +0200
> @@ -145,6 +145,7 @@
> self.priority = None
> self.tags = None
> self.fn = fn
> + self.license = None
>
> if fn:
> # see if it is deb format
> @@ -319,6 +320,12 @@
> def get_section(self, section):
> return self.section
>
> + def set_license(self, license):
> + self.license = license
> +
> + def get_license(self, license):
> + return self.license
> +
> def get_file_list(self):
> if not self.fn:
> return []
> @@ -425,6 +432,7 @@
> if self.description: out = out + "Description: %s\n" % (self.description)
> if self.oe: out = out + "OE: %s\n" % (self.oe)
> if self.homepage: out = out + "HomePage: %s\n" % (self.homepage)
> + if self.license: out = out + "License: %s\n" % (self.license)
> if self.priority: out = out + "Priority: %s\n" % (self.priority)
> if self.tags: out = out + "Tags: %s\n" % (self.tags)
> out = out + "\n"
> (reverse-i-search)`uNr': diff -^Cr ~/common/conf/shr-core/ conf/
>
> --- /OE/shr-unstable/tmp/sysroots/x86_64-linux/usr/bin/opkg-make-index 2011-05-27 18:35:03.000000000 +0200
> +++ /OE/shr-core/tmp/sysroots/x86_64-linux/usr/bin/opkg-make-index 2011-11-29 12:32:39.000000000 +0100
> @@ -197,7 +197,15 @@
> names = packages.packages.keys()
> names.sort()
> for name in names:
> - for fn in packages[name].get_file_list():
> + try:
> + fnlist = packages[name].get_file_list()
> + except OSError, e:
> + sys.stderr.write("Package %s disappeared on us!\n" % (name))
> + continue
> + except IOError, e:
> + sys.stderr.write("Package %s disappeared on us!\n" % (name))
> + continue
> + for fn in fnlist:
> (h,t) = os.path.split(fn)
> if not t: continue
> if not files.has_key(t): files[t] = name+':'+fn
>
>
> Regards,
> --
> Martin 'JaMa' Jansa jabber: Martin.Jansa@gmail.com
Today I did some more tests and started using simple bash script to
reindex all Packages files just once (instead of rebuilding common arch
many times with bitbake package-index).
OPKG_MAKE_INDEX=~/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/bin/opkg-make-index
DEPLOY_IPK=~/shr-core/tmp-eglibc/deploy/ipk/
for PACKAGE_FILE in `find ${DEPLOY_IPK} -name Packages`; do
PACKAGE_DIR=`dirname ${PACKAGE_FILE}`
touch ${PACKAGE_FILE}
echo "Regenerating ${PACKAGE_FILE}"
time flock ${PACKAGE_FILE}.flock -c "${OPKG_MAKE_INDEX} -r ${PACKAGE_FILE} -p ${PACKAGE_FILE} -l ${PACKAGE_FILE}.filelist -m ${PACKAGE_DIR}/"
done
And on my machine it takes really long to finish
real 26m40.108s
user 23m6.673s
sys 0m14.464s
So I'll look into opkg-make-index changes again and to make it easier I would like
to move all oe-core local patches:
http://git.openembedded.org/openembedded-core/tree/meta/recipes-devtools/opkg-utils/opkg-utils
to yocto git repo:
http://git.yoctoproject.org/cgit/cgit.cgi/opkg-utils/
should I send pull-request for opkg-utils repo here or somewhere else? e.g. yocto ML?
Cheers,
--
Martin 'JaMa' Jansa jabber: Martin.Jansa@gmail.com
[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 205 bytes --]
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: opkg-make-index cache failing
2012-03-29 7:58 ` Martin Jansa
@ 2012-03-29 8:59 ` Richard Purdie
0 siblings, 0 replies; 7+ messages in thread
From: Richard Purdie @ 2012-03-29 8:59 UTC (permalink / raw)
To: Patches and discussions about the oe-core layer
On Thu, 2012-03-29 at 09:58 +0200, Martin Jansa wrote:
> Today I did some more tests and started using simple bash script to
> reindex all Packages files just once (instead of rebuilding common arch
> many times with bitbake package-index).
>
> OPKG_MAKE_INDEX=~/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/bin/opkg-make-index
> DEPLOY_IPK=~/shr-core/tmp-eglibc/deploy/ipk/
> for PACKAGE_FILE in `find ${DEPLOY_IPK} -name Packages`; do
> PACKAGE_DIR=`dirname ${PACKAGE_FILE}`
> touch ${PACKAGE_FILE}
> echo "Regenerating ${PACKAGE_FILE}"
> time flock ${PACKAGE_FILE}.flock -c "${OPKG_MAKE_INDEX} -r ${PACKAGE_FILE} -p ${PACKAGE_FILE} -l ${PACKAGE_FILE}.filelist -m ${PACKAGE_DIR}/"
> done
>
> And on my machine it takes really long to finish
> real 26m40.108s
> user 23m6.673s
> sys 0m14.464s
>
> So I'll look into opkg-make-index changes again and to make it easier I would like
> to move all oe-core local patches:
> http://git.openembedded.org/openembedded-core/tree/meta/recipes-devtools/opkg-utils/opkg-utils
> to yocto git repo:
> http://git.yoctoproject.org/cgit/cgit.cgi/opkg-utils/
> should I send pull-request for opkg-utils repo here or somewhere else? e.g. yocto ML?
I've been advising people to do that kind of thing on the Yocto mailing
list since there is already lots of patch traffic on OE-Core...
Cheers,
Richard
^ permalink raw reply [flat|nested] 7+ messages in thread
end of thread, other threads:[~2012-03-29 9:08 UTC | newest]
Thread overview: 7+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2011-11-25 15:38 opkg-make-index cache failing Koen Kooi
2011-11-25 16:53 ` Richard Purdie
2011-11-25 18:15 ` Koen Kooi
2011-11-25 19:59 ` Koen Kooi
2011-11-29 11:40 ` Martin Jansa
2012-03-29 7:58 ` Martin Jansa
2012-03-29 8:59 ` Richard Purdie
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox