[PATCH] ci: Tune config

[PATCH] ci: Tune config

[Jan Kiszka]

From: Jan Kiszka <jan.kiszka@siemens.com>

- disable DEBUG_INFO which bloats the build out and, thus, the ccache
- grant more size to the ccache, specifically for arm64

Signed-off-by: Jan Kiszka <jan.kiszka@siemens.com>
---
 .travis.yml | 8 +++++++-
 1 file changed, 7 insertions(+), 1 deletion(-)

diff --git a/.travis.yml b/.travis.yml
index 2139e499e4..32ae8d2b1c 100644
--- a/.travis.yml
+++ b/.travis.yml
@@ -14,7 +14,7 @@ env:
   global:
     - KDIR=/tmp/kernel
     - USE_CCACHE=1
-    - CCACHE_MAXSIZE=400M
+    - CCACHE_MAXSIZE=1G
 
 install:
   - git clone --depth 1 --branch ${IPIPE_REV} ${IPIPE_KERNEL} ${KDIR}
@@ -40,6 +40,11 @@ before_script:
   - export PATH=~/ccache:$PATH
   - pushd ${KDIR}
   - make -j $(nproc) ${KERNEL_DEFCONFIG}
+
+  # Generic settings
+  - ./scripts/config -d DEBUG_INFO
+
+  # I-pipe and Xenomai settings
   - ./scripts/config -e IPIPE
   - ./scripts/config -e XENOMAI
   - ./scripts/config -e XENO_OPT_SCHED_CLASSES
@@ -135,6 +140,7 @@ script:
   - scripts/bootstrap
   - ./configure --enable-smp ${CONFIGURE_OPTS}
   - make -j $(nproc)
+
   - ccache -s
 
 matrix:
-- 
2.16.4

Re: [PATCH] ci: Tune config

[Roman Stratiienko]

I have similar issue some time ago on another project, but due to lack of
time and low priority it was unsolved.
And you've found the root cause and it is great, thanks!.

I did some measurements of ccache size, and results is following:
- 4.14 arm64 - cache size - 232.7 MB
- 4.19 arm - cache size - 246.4 MB
- Others are even less.

So I suggest to left it 400MB, thus not to use too much disk space of
travis's servers.



On Tue, Apr 9, 2019 at 10:37 PM Jan Kiszka <jan.kiszka@siemens.com> wrote:

> From: Jan Kiszka <jan.kiszka@siemens.com>
>
> - disable DEBUG_INFO which bloats the build out and, thus, the ccache
> - grant more size to the ccache, specifically for arm64
>
> Signed-off-by: Jan Kiszka <jan.kiszka@siemens.com>
> ---
>  .travis.yml | 8 +++++++-
>  1 file changed, 7 insertions(+), 1 deletion(-)
>
> diff --git a/.travis.yml b/.travis.yml
> index 2139e499e4..32ae8d2b1c 100644
> --- a/.travis.yml
> +++ b/.travis.yml
> @@ -14,7 +14,7 @@ env:
>    global:
>      - KDIR=/tmp/kernel
>      - USE_CCACHE=1
> -    - CCACHE_MAXSIZE=400M
> +    - CCACHE_MAXSIZE=1G
>
>  install:
>    - git clone --depth 1 --branch ${IPIPE_REV} ${IPIPE_KERNEL} ${KDIR}
> @@ -40,6 +40,11 @@ before_script:
>    - export PATH=~/ccache:$PATH
>    - pushd ${KDIR}
>    - make -j $(nproc) ${KERNEL_DEFCONFIG}
> +
> +  # Generic settings
> +  - ./scripts/config -d DEBUG_INFO
> +
> +  # I-pipe and Xenomai settings
>    - ./scripts/config -e IPIPE
>    - ./scripts/config -e XENOMAI
>    - ./scripts/config -e XENO_OPT_SCHED_CLASSES
> @@ -135,6 +140,7 @@ script:
>    - scripts/bootstrap
>    - ./configure --enable-smp ${CONFIGURE_OPTS}
>    - make -j $(nproc)
> +
>    - ccache -s
>
>  matrix:
> --
> 2.16.4
>


-- 
Best regards,
Roman Stratiienko
Global Logic
ADIT Team

Re: [PATCH] ci: Tune config

[Jan Kiszka]

On 09.04.19 22:47, Roman Stratiienko wrote:
> 
> I have similar issue some time ago on another project, but due to lack of time 
> and low priority it was unsolved.
> And you've found the root cause and it is great, thanks!.

At least it looks like as the rebuild no only takes 15 minutes.

> 
> I did some measurements of ccache size, and results is following:
> - 4.14 arm64 - cache size - 232.7 MB
> - 4.19 arm - cache size - 246.4 MB
> - Others are even less.
> 
> So I suggest to left it 400MB, thus not to use too much disk space of travis's 
> servers.

Look at the statistics you added to our build:

4.14 arm64: 601.6 MB
4.19 arm:   557.7 MB
4.14 x86:   292.5 MB

If you cap the size, ccache may drop artifacts during the build, then refill, 
but may stay below the limit at the end. Still, the cache will be incomplete.

Jan

-- 
Siemens AG, Corporate Technology, CT RDA IOT SES-DE
Corporate Competence Center Embedded Linux

Re: [PATCH] ci: Tune config

[Roman Stratiienko]

I did measurements after clearing cache 'ccache -C'

I assume that 600mb in current statistic is due to multiple build of
different source dependencies due to enabled DEBUG INFO config. Old cache
should be invalidated and cleaned automatically as size goes up to the
limit.


ср, 10 апр. 2019 г., 08:34 Jan Kiszka <jan.kiszka@siemens.com>:

> On 09.04.19 22:47, Roman Stratiienko wrote:
> >
> > I have similar issue some time ago on another project, but due to lack
> of time
> > and low priority it was unsolved.
> > And you've found the root cause and it is great, thanks!.
>
> At least it looks like as the rebuild no only takes 15 minutes.
>
> >
> > I did some measurements of ccache size, and results is following:
> > - 4.14 arm64 - cache size - 232.7 MB
> > - 4.19 arm - cache size - 246.4 MB
> > - Others are even less.
> >
> > So I suggest to left it 400MB, thus not to use too much disk space of
> travis's
> > servers.
>
> Look at the statistics you added to our build:
>
> 4.14 arm64: 601.6 MB
> 4.19 arm:   557.7 MB
> 4.14 x86:   292.5 MB
>
> If you cap the size, ccache may drop artifacts during the build, then
> refill,
> but may stay below the limit at the end. Still, the cache will be
> incomplete.
>
> Jan
>
> --
> Siemens AG, Corporate Technology, CT RDA IOT SES-DE
> Corporate Competence Center Embedded Linux
>

Re: [PATCH] ci: Tune config

[Jan Kiszka]

On 10.04.19 10:42, Roman Stratiienko wrote:
> I did measurements after clearing cache 'ccache -C'
> 
> I assume that 600mb in current statistic is due to multiple build of different 
> source dependencies due to enabled DEBUG INFO config. Old cache should be 
> invalidated and cleaned automatically as size goes up to the limit.
> 

Indeed, things piled up.

We can keep the lower limit for now and see how this evolve.

Jan

> 
> ср, 10 апр. 2019 г., 08:34 Jan Kiszka <jan.kiszka@siemens.com 
> <mailto:jan.kiszka@siemens.com>>:
> 
>     On 09.04.19 22:47, Roman Stratiienko wrote:
>      >
>      > I have similar issue some time ago on another project, but due to lack of
>     time
>      > and low priority it was unsolved.
>      > And you've found the root cause and it is great, thanks!.
> 
>     At least it looks like as the rebuild no only takes 15 minutes.
> 
>      >
>      > I did some measurements of ccache size, and results is following:
>      > - 4.14 arm64 - cache size - 232.7 MB
>      > - 4.19 arm - cache size - 246.4 MB
>      > - Others are even less.
>      >
>      > So I suggest to left it 400MB, thus not to use too much disk space of
>     travis's
>      > servers.
> 
>     Look at the statistics you added to our build:
> 
>     4.14 arm64: 601.6 MB
>     4.19 arm:   557.7 MB
>     4.14 x86:   292.5 MB
> 
>     If you cap the size, ccache may drop artifacts during the build, then refill,
>     but may stay below the limit at the end. Still, the cache will be incomplete.
> 
>     Jan
> 
>     -- 
>     Siemens AG, Corporate Technology, CT RDA IOT SES-DE
>     Corporate Competence Center Embedded Linux
> 

-- 
Siemens AG, Corporate Technology, CT RDA IOT SES-DE
Corporate Competence Center Embedded Linux