Re: [bitbake-devel] [PATCH v3 1/4] fetch2/git: Add support for fast initial shallow fetch

["Mathieu Dubois-Briand" <mathieu.dubois-briand@bootlin.com>]

On Mon Feb 24, 2025 at 2:11 PM CET, Stefan Koch wrote:
> On Mon, 2025-02-24 at 13:55 +0100, Stefan Koch wrote:
> > On Mon, 2025-02-24 at 12:58 +0100, Mathieu Dubois-Briand wrote:
> > > On Thu Feb 20, 2025 at 6:27 PM CET, Stefan via
> > > lists.openembedded.org
> > > Koch wrote:
> > > > When `ud.shallow == 1`:
> > > > - Prefer an initial shallow clone over an initial full bare
> > > > clone,
> > > >   while still utilizing any already existing full bare clones.
> > > >
> > > > This improves:
> > > > - Resolve timeout issues during initial clones on slow internet
> > > > connections
> > > >   by reducing the amount of data transferred.
> > > > - Eliminate the need to use an HTTPS tarball `SRC_URI`
> > > >   to reduce data transfer.
> > > > - Allow SSH-based authentication (e.g. cert and agent-based) when
> > > >   using non-public repos, so additional HTTPS tokens may not be
> > > > required.
> > > >
> > > > Signed-off-by: Stefan Koch <stefan-koch@siemens.com>
> > > > ---
> > >
> > > Hi Stefan,
> > >
> > > Thanks for your patch.
> > >
> > > We got a new failure on the autobuilder, specifically with the
> > > oe-selftest-ubuntu build. I'm not entirely sure this comes from
> > > this
> > > series, so I will try a build without it to confirm.
> > >
> > > Here is the error:
> > >
> > > NOTE: Running task 2 of 4 (/srv/pokybuild/yocto-worker/oe-selftest-
> > > ubuntu/build/build-st-3502943/meta-selftest/recipes-test/git-
> > > submodule-test/git-submodule-test.bb:do_fetch)
> > > NOTE: recipe git-submodule-test-1.0-r0: task do_fetch: Started
> > > WARNING: git-submodule-test-1.0-r0 do_fetch: Creating fast initial
> > > shallow clone failed, try initial regular clone now.
> > > WARNING: git-submodule-test-1.0-r0 do_fetch: Failed to fetch URL
> > > gitsm://git.openembedded.org/bitbake;protocol=git;name=bitbake;subp
> > > at
> > > h=bitbake;nobranch=1;lfs=False;bareclone=1;nobranch=1, attempting
> > > MIRRORS if available
> > > ERROR: git-submodule-test-1.0-r0 do_fetch: Fetcher failure: Fetch
> > > command export PSEUDO_DISABLED=1; export
> > > PATH="/srv/pokybuild/yocto-
> > > worker/oe-selftest-ubuntu/build/build-st-3502943/tmp/sysroots-
> > > uninative/x86_64-linux/usr/bin:/srv/pokybuild/yocto-worker/oe-
> > > selftest-ubuntu/build/scripts:/srv/pokybuild/yocto-worker/oe-
> > > selftest-ubuntu/build/build-st-3502943/tmp/work/core2-64-poky-
> > > linux/git-submodule-test/1.0/recipe-sysroot-native/usr/bin/x86_64-
> > > poky-linux:/srv/pokybuild/yocto-worker/oe-selftest-
> > > ubuntu/build/build-st-3502943/tmp/work/core2-64-poky-linux/git-
> > > submodule-test/1.0/recipe-
> > > sysroot/usr/bin/crossscripts:/srv/pokybuild/yocto-worker/oe-
> > > selftest-
> > > ubuntu/build/build-st-3502943/tmp/work/core2-64-poky-linux/git-
> > > submodule-test/1.0/recipe-sysroot-
> > > native/usr/sbin:/srv/pokybuild/yocto-worker/oe-selftest-
> > > ubuntu/build/build-st-3502943/tmp/work/core2-64-poky-linux/git-
> > > submodule-test/1.0/recipe-sysroot-
> > > native/usr/bin:/srv/pokybuild/yocto-worker/oe-selftest-
> > > ubuntu/build/build-st-3502943/tmp/work/core2-64-poky-linux/git-
> > > submodule-test/1.0/recipe-sysroot-native/sbin:/srv/pokybuild/yocto-
> > > worker/oe-selftest-ubuntu/build/build-st-3502943/tmp/work/core2-64-
> > > poky-linux/git-submodule-test/1.0/recipe-sysroot-
> > > native/bin:/srv/pokybuild/yocto-worker/oe-selftest-
> > > ubuntu/build/bitbake/bin:/srv/pokybuild/yocto-worker/oe-selftest-
> > > ubuntu/build/build-st-3502943/tmp/hosttools"; export
> > > HOME="/srv/pokybuild"; git -c gc.autoDetach=false -c core.pager=cat
> > > -
> > > c safe.bareRepository=all -c clone.defaultRemoteName=origin fetch
> > > origin 52a144a7daa94b2bd239d582cb71d1f03119918f --depth 1 failed
> > > with
> > > exit code 1, output:
> > > error: Server does not allow request for unadvertised object
> > > 52a144a7daa94b2bd239d582cb71d1f03119918f
> > >
> > > https://autobuilder.yoctoproject.org/valkyrie/#/builders/54/builds/1031/steps/14/logs/stdio
> > >
> > > Can you have a look at this issue please?
> > Do you using 1716ad67bbe9f4cecf1e3bcfc2007b150ba77741 from bitbakes
> > master-next branch? Because that is PATCH v2 with that issue
> > specially
> > on ubuntu 20.04...
> Sorry, v3 is meant.
> v4 PATCH from Friday should fix this.
> > >
> >

Sorry, I sent this in the wrong mail thread, but I confirm I was indeed
using the v4.

-- 
Mathieu Dubois-Briand, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com