linux-arm-kernel.lists.infradead.org archive mirror
 help / color / mirror / Atom feed
* OMAP baseline test results for v3.17-rc7
@ 2014-09-29 17:13 Paul Walmsley
  2014-09-29 17:20 ` Tony Lindgren
  0 siblings, 1 reply; 4+ messages in thread
From: Paul Walmsley @ 2014-09-29 17:13 UTC (permalink / raw)
  To: linux-arm-kernel


Here are some basic OMAP test results for Linux v3.17-rc7.
Logs and other details at:

    http://www.pwsan.com/omap/testlogs/test_v3.17-rc7/20140928222901/


Test summary
------------

Build: uImage:
    Pass ( 3/ 3): omap1_defconfig, omap1_defconfig_1510innovator_only,
		  omap1_defconfig_5912osk_only

Build: uImage+dtb:
    Pass (13/13): omap2plus_defconfig_am33xx_only/am335x-bone,
		  omap2plus_defconfig/omap4-panda,
		  omap2plus_defconfig/omap4-panda-es,
		  omap2plus_defconfig/omap4-var-som,
		  omap2plus_defconfig/omap3-evm-37xx,
		  omap2plus_defconfig_n800_only_a/omap2420-n800,
		  omap2plus_defconfig/omap2430-sdp,
		  omap2plus_defconfig/am3517-evm,
		  omap2plus_defconfig/omap3-beagle,
		  omap2plus_defconfig/omap3-beagle-xm,
		  omap2plus_defconfig/omap3-sbc-t3517,
		  omap2plus_defconfig/omap5-uevm,
		  omap2plus_defconfig/omap5-sbc-t54

Build: zImage:
    Pass (17/17): omap2plus_defconfig, omap2plus_defconfig_am33xx_only,
		  omap2plus_defconfig_n800_only_a,
		  omap2plus_defconfig_n800_multi_omap2xxx,
		  omap2plus_defconfig_2430sdp_only,
		  omap2plus_defconfig_cpupm, omap2plus_defconfig_no_pm,
		  omap2plus_defconfig_omap2_4_only,
		  omap2plus_defconfig_omap3_4_only,
		  omap2plus_defconfig_omap5_only,
		  omap2plus_defconfig_dra7xx_only,
		  omap2plus_defconfig_am43xx_only,
		  rmk_omap3430_ldp_oldconfig,
		  rmk_omap3430_ldp_allnoconfig,
		  rmk_omap4430_sdp_oldconfig,
		  rmk_omap4430_sdp_allnoconfig, multi_v7_defconfig

Boot to userspace:
    FAIL ( 1/17): 2430sdp
    skip ( 3/17): 5912osk, 4430es2panda, 3517evm
    Pass (13/17): am335xbonelt, am335xbone, 4460pandaes, 4460varsomom,
		  37xxevm, 3530es3beagle, 3530es31beagle, 3730beaglexm,
		  3730es12beaglexm, cmt3517, 5430es2uevm,
		  5430es2sbct54, 2420n800

PM: chip retention via suspend:
    skip ( 1/12): 4430es2panda
    FAIL ( 5/12): am335xbonelt, 4460varsomom, 2430sdp, 5430es2uevm,
		  5430es2sbct54
    Pass ( 6/12): 4460pandaes, 37xxevm, 3530es3beagle, 3530es31beagle,
		  3730beaglexm, 3730es12beaglexm

PM: chip retention via dynamic idle:
    skip ( 1/12): 4430es2panda
    FAIL ( 6/12): am335xbonelt, 4460pandaes, 4460varsomom, 2430sdp,
		  5430es2uevm, 5430es2sbct54
    Pass ( 5/12): 37xxevm, 3530es3beagle, 3530es31beagle, 3730beaglexm,
		  3730es12beaglexm

PM: chip off except CORE via suspend:
    Pass ( 1/ 1): 3730beaglexm

PM: chip off except CORE via dynamic idle:
    Pass ( 1/ 1): 3730beaglexm

PM: chip off via suspend:
    Pass ( 4/ 4): 37xxevm, 3530es3beagle, 3530es31beagle,
		  3730es12beaglexm

PM: chip off via dynamic idle:
    Pass ( 4/ 4): 37xxevm, 3530es3beagle, 3530es31beagle,
		  3730es12beaglexm


vmlinux object size
(delta in bytes from test_v3.17-rc6 (0f33be009b89d2268e94194dc4fd01a7851b6d51)):
   text     data      bss    total  kernel
    -53        0        0      -53  omap1_defconfig
    +11      +32        0      +43  omap1_defconfig_1510innovator_only
    -21        0        0      -21  omap1_defconfig_5912osk_only
   +775       -8        0     +767  multi_v7_defconfig
   +551        0        0     +551  omap2plus_defconfig
     -5        0        0       -5  omap2plus_defconfig_2430sdp_only
   +391        0        0     +391  omap2plus_defconfig_am33xx_only
    +79        0        0      +79  omap2plus_defconfig_am43xx_only
   +551        0        0     +551  omap2plus_defconfig_cpupm
   +151        0        0     +151  omap2plus_defconfig_dra7xx_only
   -159        0        0     -159  omap2plus_defconfig_n800_multi_omap2xxx
   -159       +8        0     -151  omap2plus_defconfig_n800_only_a
   +547        0        0     +547  omap2plus_defconfig_no_pm
    +79        0        0      +79  omap2plus_defconfig_omap2_4_only
   +227        0        0     +227  omap2plus_defconfig_omap3_4_only
    +79        0        0      +79  omap2plus_defconfig_omap5_only
   +260        0      -60     +200  rmk_omap3430_ldp_allnoconfig
    +99       -8        0      +91  rmk_omap3430_ldp_oldconfig
    +48        0       +4      +52  rmk_omap4430_sdp_allnoconfig
    -23       -8        0      -31  rmk_omap4430_sdp_oldconfig

Boot-time memory difference
(delta in bytes from test_v3.17-rc6 (0f33be009b89d2268e94194dc4fd01a7851b6d51))
  avail  rsrvd   high  freed  board          kconfig
 -224768k -36352k      .  -404k  3517evm        omap2plus_defconfig
 -484604k -38660k      .  -404k  4430es2panda   omap2plus_defconfig
    -4k     4k      .      .  am335xbonelt   omap2plus_defconfig


The 4430 Pandaboard and the 3517EVM have gone offline.  These boards will 
require some additional investigation which probably won't happen until 
November.  In the meantime, they've been moved to the "skip" column in the 
test results.

^ permalink raw reply	[flat|nested] 4+ messages in thread

* OMAP baseline test results for v3.17-rc7
  2014-09-29 17:13 OMAP baseline test results for v3.17-rc7 Paul Walmsley
@ 2014-09-29 17:20 ` Tony Lindgren
  2014-10-02 15:10   ` Paul Walmsley
  0 siblings, 1 reply; 4+ messages in thread
From: Tony Lindgren @ 2014-09-29 17:20 UTC (permalink / raw)
  To: linux-arm-kernel

* Paul Walmsley <paul@pwsan.com> [140929 10:14]:
>
> PM: chip off except CORE via suspend:
>     Pass ( 1/ 1): 3730beaglexm
> 
> PM: chip off except CORE via dynamic idle:
>     Pass ( 1/ 1): 3730beaglexm

Most likely the two tests above should now also work also for 37xxevm,
3530es3beagle and 3530es31beagle in case you want to enable that.
 
> PM: chip off via suspend:
>     Pass ( 4/ 4): 37xxevm, 3530es3beagle, 3530es31beagle,
> 		  3730es12beaglexm
> 
> PM: chip off via dynamic idle:
>     Pass ( 4/ 4): 37xxevm, 3530es3beagle, 3530es31beagle,
> 		  3730es12beaglexm

Since looks like these are working finally :)

Regards,

Tony

^ permalink raw reply	[flat|nested] 4+ messages in thread

* OMAP baseline test results for v3.17-rc7
  2014-09-29 17:20 ` Tony Lindgren
@ 2014-10-02 15:10   ` Paul Walmsley
  2014-10-02 16:17     ` Tony Lindgren
  0 siblings, 1 reply; 4+ messages in thread
From: Paul Walmsley @ 2014-10-02 15:10 UTC (permalink / raw)
  To: linux-arm-kernel

Hi Tony,

On Mon, 29 Sep 2014, Tony Lindgren wrote:

> * Paul Walmsley <paul@pwsan.com> [140929 10:14]:
> >
> > PM: chip off except CORE via suspend:
> >     Pass ( 1/ 1): 3730beaglexm
> > 
> > PM: chip off except CORE via dynamic idle:
> >     Pass ( 1/ 1): 3730beaglexm
> 
> Most likely the two tests above should now also work also for 37xxevm,
> 3530es3beagle and 3530es31beagle in case you want to enable that.

I think this might be an issue of my own inability to communicate clearly 
what's being tested here and why :-)

That "chip off except CORE" PM validation test is only needed due to the 
3630/37xx ES1.0 errata that forces us to disable CORE off-mode on that 
revision:

----------
echo 1 > /debug/pm_debug/enable_off_mode
[   60.351837] omap3_pm_off_mode_enable: Core OFF disabled due to errata i583
----------

(from 
http://www.pwsan.com/omap/testlogs/test_v3.17-rc6/20140921213558/pm/3730beaglexm/3730beaglexm_log.txt)

If we were to enable that test for the other four OMAP3 boards, they would 
probably all show up as failing, since they are all able to enter core-off 
mode successfully :-)

Maybe you have some ideas for how this can be communicated better in the 
test results?  One thing that would probably help is if the board was 
renamed to "3730es10beaglexm" or something like that.  Also maybe 
mentioning the fact that the test is only needed due to errata, like:

-----------
PM: chip off (except CORE, due to errata) via dynamic idle:
    Pass ( 1/ 1): 3730es10beaglexm
-----------

At some point, will probably also generate an HTML version of the summary, 
where the test name and board names can link to some explanatory 
information about what is being tested, and why.

Anyway, any thoughts are welcome.

> > PM: chip off via suspend:
> >     Pass ( 4/ 4): 37xxevm, 3530es3beagle, 3530es31beagle,
> > 		  3730es12beaglexm
> > 
> > PM: chip off via dynamic idle:
> >     Pass ( 4/ 4): 37xxevm, 3530es3beagle, 3530es31beagle,
> > 		  3730es12beaglexm
> 
> Since looks like these are working finally :)

Thanks largely to your hard work!  Hooray!


- Paul

^ permalink raw reply	[flat|nested] 4+ messages in thread

* OMAP baseline test results for v3.17-rc7
  2014-10-02 15:10   ` Paul Walmsley
@ 2014-10-02 16:17     ` Tony Lindgren
  0 siblings, 0 replies; 4+ messages in thread
From: Tony Lindgren @ 2014-10-02 16:17 UTC (permalink / raw)
  To: linux-arm-kernel

* Paul Walmsley <paul@pwsan.com> [141002 08:11]:
> 
> Maybe you have some ideas for how this can be communicated better in the 
> test results?  One thing that would probably help is if the board was 
> renamed to "3730es10beaglexm" or something like that.  Also maybe 
> mentioning the fact that the test is only needed due to errata, like:
> 
> -----------
> PM: chip off (except CORE, due to errata) via dynamic idle:
>     Pass ( 1/ 1): 3730es10beaglexm
> -----------

Oh OK, yeah I did not read the actual test :) The above description
makes it clear at least for me.

Regards,

Tony 

^ permalink raw reply	[flat|nested] 4+ messages in thread

end of thread, other threads:[~2014-10-02 16:17 UTC | newest]

Thread overview: 4+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2014-09-29 17:13 OMAP baseline test results for v3.17-rc7 Paul Walmsley
2014-09-29 17:20 ` Tony Lindgren
2014-10-02 15:10   ` Paul Walmsley
2014-10-02 16:17     ` Tony Lindgren

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).