I need your number(s), BitBake/OE parsing speed

I need your number(s), BitBake/OE parsing speed

[Holger Freyther]

Hey,

if I got through your spam filter here is what I want you to do

1.) time bitbake -p opie-image   and do that three times and save the  
numbers
2.) apply the oe_less_anon.patch to OpenEmbedded
3.) time bitbake -p opie-image and do that three times and save the  
numbers
4.) apply the BitBake patch (it should apply to 1.6 as well)
5.) time bitbake -p opie-image and do that three times and save the  
numbers

6.) send me either a postcard with the numbers on it, or use email to  
transport the numbers

z.


--
Holger Freyther
freyther@inf.fu-berlin.de

Re: I need your number(s), BitBake/OE parsing speed

[Holger Freyther]

Am 18.11.2006 um 11:52 schrieb Holger Freyther:

> Hey,

that file might be missing...


--
Holger 'zecke' Freyther
geek, QA monkey, OpenEmbedded Engineer

Me http://www.openembedded.org/~zecke
Blog http://zecke.blogspot.com




--
Holger Freyther
freyther@inf.fu-berlin.de

Re: I need your number(s), BitBake/OE parsing speed

[Holger Freyther]

Am 18.11.2006 um 12:19 schrieb Holger Freyther:

>
> Am 18.11.2006 um 11:52 schrieb Holger Freyther:
>
>> Hey,
>
> that file might be missing...

hehe,
and as pointed out the ml filters the attachment so get them at

http://www.openembedded.org/~zecke/patches/

--
Holger 'zecke' Freyther
geek, QA monkey, OpenEmbedded Engineer

Me http://www.openembedded.org/~zecke
Blog http://zecke.blogspot.com

Re: I need your number(s), BitBake/OE parsing speed

[Marcin Juszkiewicz]

Dnia sobota, 18 listopada 2006 11:52, Holger Freyther napisał:

Athlon64 3200+ 64bit:

> 1.) time bitbake -p opie-image   and do that three times and save the
> numbers

14:37 hrw@home:umbaumba$ for f in `seq 1 3`;do time bitbake -p 
opie-image;done
NOTE: Psyco JIT Compiler (http://psyco.sf.net) not available.
NOTE: Handling BitBake files: \ (4043/4043) [100 %]
NOTE: Parsing finished. 3885 cached, 0 parsed, 158 skipped, 0 masked.

NOTE: Requested parsing .bb files only.  Exiting.

real    0m11.991s
user    0m9.832s
sys     0m0.553s
NOTE: Psyco JIT Compiler (http://psyco.sf.net) not available.
NOTE: Handling BitBake files: \ (4043/4043) [100 %]
NOTE: Parsing finished. 3885 cached, 0 parsed, 158 skipped, 0 masked.

NOTE: Requested parsing .bb files only.  Exiting.

real    0m12.177s
user    0m9.797s
sys     0m0.577s
NOTE: Psyco JIT Compiler (http://psyco.sf.net) not available.
NOTE: Handling BitBake files: \ (4043/4043) [100 %]
NOTE: Parsing finished. 3885 cached, 0 parsed, 158 skipped, 0 masked.

NOTE: Requested parsing .bb files only.  Exiting.

real    0m11.711s
user    0m9.707s
sys     0m0.582s


> 2.) apply the oe_less_anon.patch to OpenEmbedded

and copy glib-2.0.inc into packages/glib-2.0/

> 3.) time bitbake -p opie-image and do that three times and save the
> numbers

14:51 hrw@home:umbaumba$  for f in `seq 1 3`;do time bitbake -p 
opie-image;done
NOTE: Psyco JIT Compiler (http://psyco.sf.net) not available.
NOTE: Handling BitBake files: \ (4043/4043) [100 %]
NOTE: Parsing finished. 3870 cached, 15 parsed, 158 skipped, 0 masked.

NOTE: Requested parsing .bb files only.  Exiting.

real    0m12.251s
user    0m10.686s
sys     0m0.566s
NOTE: Psyco JIT Compiler (http://psyco.sf.net) not available.
NOTE: Handling BitBake files: \ (4043/4043) [100 %]
NOTE: Parsing finished. 3885 cached, 0 parsed, 158 skipped, 0 masked.

NOTE: Requested parsing .bb files only.  Exiting.

real    0m11.041s
user    0m9.583s
sys     0m0.538s
NOTE: Psyco JIT Compiler (http://psyco.sf.net) not available.
NOTE: Handling BitBake files: \ (4043/4043) [100 %]
NOTE: Parsing finished. 3885 cached, 0 parsed, 158 skipped, 0 masked.

NOTE: Requested parsing .bb files only.  Exiting.

real    0m11.208s
user    0m9.640s
sys     0m0.585s
14:54 hrw@home:umbaumba$ 


> 4.) apply the BitBake patch (it should apply to 1.6 as well)

> 5.) time bitbake -p opie-image and do that three times and save the
> numbers

14:54 hrw@home:umbaumba$  for f in `seq 1 3`;do time bitbake -p 
opie-image;done
NOTE: Psyco JIT Compiler (http://psyco.sf.net) not available.
NOTE: Handling BitBake files: \ (4043/4043) [100 %]
NOTE: Parsing finished. 3885 cached, 0 parsed, 158 skipped, 0 masked.

NOTE: Requested parsing .bb files only.  Exiting.

real    0m11.052s
user    0m9.561s
sys     0m0.521s
NOTE: Psyco JIT Compiler (http://psyco.sf.net) not available.
NOTE: Handling BitBake files: \ (4043/4043) [100 %]
NOTE: Parsing finished. 3885 cached, 0 parsed, 158 skipped, 0 masked.

NOTE: Requested parsing .bb files only.  Exiting.

real    0m10.978s
user    0m9.483s
sys     0m0.550s
NOTE: Psyco JIT Compiler (http://psyco.sf.net) not available. 
NOTE: Handling BitBake files: \ (4043/4043) [100 %]
NOTE: Parsing finished. 3885 cached, 0 parsed, 158 skipped, 0 masked.

NOTE: Requested parsing .bb files only.  Exiting.

real    0m11.020s
user    0m9.505s
sys     0m0.571s
14:56 hrw@home:umbaumba$


> 6.) send me either a postcard with the numbers on it, or use email to
> transport the numbers

This time I choose email.

-- 
JID: hrw-jabber.org
OpenEmbedded developer/consultant

       I'm broken. Please show this to someone who can fix me [TeX]

Re: I need your number(s), BitBake/OE parsing speed

[Holger Freyther]

Am 18.11.2006 um 14:58 schrieb Marcin Juszkiewicz:
Thanks,

please do it again an put CACHE=""  in your local.conf...

h.

Re: I need your number(s), BitBake/OE parsing speed

[Marcin Juszkiewicz]

Dnia sobota, 18 listopada 2006 11:52, Holger Freyther napisał:

> 1.) time bitbake -p opie-image   and do that three times and save the
> numbers

15:30 hrw@home:umbaumba$  for f in `seq 1 3`;do touch conf/local.conf; 
time bitbake -p opie-image;done
NOTE: Psyco JIT Compiler (http://psyco.sf.net) not available.
NOTE: Handling BitBake files: \ (4043/4043) [100 %]
NOTE: Parsing finished. 0 cached, 3885 parsed, 158 skipped, 0 masked.

NOTE: Requested parsing .bb files only.  Exiting.

real    6m2.803s
user    5m9.364s
sys     0m9.919s
NOTE: Psyco JIT Compiler (http://psyco.sf.net) not available.
NOTE: Handling BitBake files: \ (4043/4043) [100 %]
NOTE: Parsing finished. 0 cached, 3885 parsed, 158 skipped, 0 masked.

NOTE: Requested parsing .bb files only.  Exiting.

real    5m55.859s
user    5m2.017s
sys     0m9.308s
NOTE: Psyco JIT Compiler (http://psyco.sf.net) not available. 
NOTE: Handling BitBake files: \ (4043/4043) [100 %]
NOTE: Parsing finished. 0 cached, 3885 parsed, 158 skipped, 0 masked.

NOTE: Requested parsing .bb files only.  Exiting.

real    5m42.314s
user    5m1.642s
sys     0m9.346s


> 2.) apply the oe_less_anon.patch to OpenEmbedded
> 3.) time bitbake -p opie-image and do that three times and save the
> numbers

15:48 hrw@home:umbaumba$  for f in `seq 1 3`;do touch conf/local.conf; 
time bitbake -p opie-image;done
NOTE: Psyco JIT Compiler (http://psyco.sf.net) not available. Install it 
to increase performance.
NOTE: Handling BitBake files: \ (4043/4043) [100 %][[D
NOTE: Parsing finished. 0 cached, 3885 parsed, 158 skipped, 0 masked.

NOTE: Requested parsing .bb files only.  Exiting.

real    5m39.058s
user    4m47.243s
sys     0m9.186s
NOTE: Psyco JIT Compiler (http://psyco.sf.net) not available. Install it 
to increase performance.
NOTE: Handling BitBake files: \ (4043/4043) [100 %]
NOTE: Parsing finished. 0 cached, 3885 parsed, 158 skipped, 0 masked.

NOTE: Requested parsing .bb files only.  Exiting.

real    5m34.047s
user    4m46.000s
sys     0m8.915s
NOTE: Psyco JIT Compiler (http://psyco.sf.net) not available. Install it 
to increase performance.
NOTE: Handling BitBake files: \ (4043/4043) [100 %]
NOTE: Parsing finished. 0 cached, 3885 parsed, 158 skipped, 0 masked.

NOTE: Requested parsing .bb files only.  Exiting.

real    5m40.806s
user    4m45.463s
sys     0m8.957s
16:12 hrw@home:umbaumba$

> 4.) apply the BitBake patch (it should apply to 1.6 as well)
> 5.) time bitbake -p opie-image and do that three times and save the
> numbers

16:57 hrw@home:umbaumba$  for f in `seq 1 3`;do touch conf/local.conf; 
time bitbake -p opie-image;done
NOTE: Psyco JIT Compiler (http://psyco.sf.net) not available. Install it 
to increase performance.
NOTE: Handling BitBake files: \ (4043/4043) [100 %]
NOTE: Parsing finished. 0 cached, 3885 parsed, 158 skipped, 0 masked.

NOTE: Requested parsing .bb files only.  Exiting.

real    6m19.770s
user    4m38.340s
sys     0m9.419s
NOTE: Psyco JIT Compiler (http://psyco.sf.net) not available. Install it 
to increase performance.
NOTE: Handling BitBake files: \ (4043/4043) [100 %]
NOTE: Parsing finished. 0 cached, 3885 parsed, 158 skipped, 0 masked.

NOTE: Requested parsing .bb files only.  Exiting.

real    5m15.508s
user    4m36.294s
sys     0m8.546s
NOTE: Psyco JIT Compiler (http://psyco.sf.net) not available. Install it 
to increase performance.
NOTE: Handling BitBake files: \ (4043/4043) [100 %]
NOTE: Parsing finished. 0 cached, 3885 parsed, 158 skipped, 0 masked.

NOTE: Requested parsing .bb files only.  Exiting.

real    5m40.875s
user    4m37.985s
sys     0m8.901s
17:14 hrw@home:umbaumba$


-- 
JID: hrw-jabber.org
OpenEmbedded developer/consultant

    42? 7 and a half million years and all you can come up with is 42?!

Re: I need your number(s), BitBake/OE parsing speed

[Paul Sokolovsky]

Hello Holger,

Saturday, November 18, 2006, 4:23:53 PM, you wrote:

> Am 18.11.2006 um 14:58 schrieb Marcin Juszkiewicz:
> Thanks,

> please do it again an put CACHE=""  in your local.conf...

  I knew it's no that easy ;-)

1. Unpatched, cache is being killed before each run:

$ time ~/linux-ppc/bitbake/bin/bitbake -p opie-image

real    5m55.958s
user    0m20.940s
sys     5m31.190s

real    5m33.998s
user    0m18.310s
sys     5m10.850s

real    5m39.153s
user    0m18.140s
sys     5m16.650s

2. Applied oe_less_anons.patch and glib-2.0.inc

real    5m18.270s
user    0m24.590s
sys     4m50.210s

real    5m18.651s
user    0m17.270s
sys     4m58.080s

real    5m26.934s
user    0m16.670s
sys     5m5.440s

3. Applied bitbake_one_queue.patch

real    5m22.281s
user    0m17.420s
sys     5m1.330s

real    5m12.338s
user    0m24.290s
sys     4m44.470s

real    5m12.112s
user    0m16.080s
sys     4m52.810s


> h.


-- 
Best regards,
 Paul                            mailto:pmiscml@gmail.com