Re: [bitbake-devel] [PATCH] bitbake: Add task timeout support

[Mikko Rapeli <mikko.rapeli@linaro.org>]

Hi,

On Thu, May 25, 2023 at 02:13:10PM +0200, Tomasz Dziendzielski wrote:
> >Yocto has a download cache mechanism, so you should not have to fetch
> >more than once. Are you throwing away that cache between builds?
> 
> Do you mean the DL_DIR or something else as cache mechanism? We do keep
> DL_DIR between builds, but we're talking about cases where there was a
> change in the repository.
> 
> >the actual problem is slow gerrit/artifactory instances, not
> >stuck fetch tasks
> Totally agree, but we're not able to fix the slow gerrit/artifactory in a
> short term.
> 
> >The idea of 'retrying' the fetch
> Well, it's  not like I'm saying this as a solution, usually we just
> disable jobs until the slowness is gone. But isn't that what we already do
> with wget in bitbake?
> "wget -t 2 -T 30" from bitbake/lib/bb/fetch2/wget.py, where -t is tries,
> and -T is timeout
> Problem is that we get the slowness for git repositories and git does not
> support such a thing.

git uses curl, can't we shorten the timeouts or even add retries there? Maybe even
specific ones for the lfs support?

I've also seen a lot of problematic artifactory and gerrit instances, in addition
to maven, npm etc...

Cheers,

-Mikko