Git development
 help / color / mirror / Atom feed
From: Patrick Steinhardt <ps@pks.im>
To: Tamir Duberstein <tamird@gmail.com>
Cc: git@vger.kernel.org, Junio C Hamano <gitster@pobox.com>
Subject: Re: [PATCH 2/2] ci: match Linux jobs to available CPUs
Date: Thu, 24 Sep 2026 08:13:48 +0200	[thread overview]
Message-ID: <arS_nA3g-on2RdIL@pks.im> (raw)
In-Reply-To: <20260923-ci-large-test-resources-v1-2-c28416d59475@gmail.com>

On Wed, Sep 23, 2026 at 01:13:29PM -0400, Tamir Duberstein wrote:
> GitHub Actions runs ten Make test suites concurrently even on private
> Linux runners with two CPUs. Pull request runs enable the long tests.
> These runs hit ENOSPC while multiple multi-gigabyte clone and repack
> fixtures were active.

Again, a link would be appreciated that demonstrates this.

> Use nproc to choose Make and prove parallelism, as the GitLab CI path
> already does. This reduces overlapping fixtures on small Linux runners
> while keeping the long tests enabled.

It may avoid overlapping fixtures. But what does CI runtime look like
before and after this change? Does it improve? Does it regress? Would it
maybe make sense to oversubscribe at least a bit?

> diff --git a/ci/lib.sh b/ci/lib.sh
> index c6ccbf8c17..0855026dad 100755
> --- a/ci/lib.sh
> +++ b/ci/lib.sh
> @@ -228,6 +228,10 @@ then
>  
>  	GIT_TEST_OPTS="--github-workflow-markup"
>  	JOBS=10
> +	if test linux = "$CI_OS_NAME"
> +	then
> +		JOBS=$(nproc)
> +	fi

Makes me wonder whether we should have the same logic on both GitLab and
GitHub going forward. There probably isn't a good reason why these two
should differ from one another.

Patrick

  reply	other threads:[~2026-09-24  6:13 UTC|newest]

Thread overview: 25+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-09-23 17:13 [PATCH 0/2] ci: reduce pressure from large test fixtures Tamir Duberstein
2026-09-23 17:13 ` [PATCH 1/2] t4205: compare huge output without diff Tamir Duberstein
2026-09-24  6:13   ` Patrick Steinhardt
2026-09-24 20:41     ` Tamir Duberstein
2026-09-25  0:13       ` Jeff King
2026-09-25  6:41         ` Junio C Hamano
2026-09-28  6:36       ` Patrick Steinhardt
2026-09-23 17:13 ` [PATCH 2/2] ci: match Linux jobs to available CPUs Tamir Duberstein
2026-09-24  6:13   ` Patrick Steinhardt [this message]
2026-09-25 15:03     ` Tamir Duberstein
2026-09-23 18:36 ` [PATCH 0/2] ci: reduce pressure from large test fixtures Tamir Duberstein
2026-09-25 16:35 ` [PATCH v2 0/2] ci: use cmp and align job-count selection Tamir Duberstein
2026-09-25 16:35   ` [PATCH v2 1/2] t4205: compare huge output without diff Tamir Duberstein
2026-09-28  6:36     ` Patrick Steinhardt
2026-09-25 16:35   ` [PATCH v2 2/2] ci: align job counts across CI providers Tamir Duberstein
2026-09-28  6:36     ` Patrick Steinhardt
2026-09-28 10:16       ` Tamir Duberstein
2026-09-28 11:14         ` Patrick Steinhardt
2026-09-30 14:20   ` [PATCH v3 0/2] ci: use cmp and align job-count selection Tamir Duberstein
2026-09-30 14:20     ` [PATCH v3 1/2] t4205: compare huge output without diff Tamir Duberstein
2026-09-30 14:20     ` [PATCH v3 2/2] ci: use twice the CPU count on both providers Tamir Duberstein
2026-09-30 14:45       ` Patrick Steinhardt
2026-09-30 14:45     ` [PATCH v3 0/2] ci: use cmp and align job-count selection Patrick Steinhardt
2026-09-30 14:58       ` Tamir Duberstein
2026-09-30 18:04         ` Junio C Hamano

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=arS_nA3g-on2RdIL@pks.im \
    --to=ps@pks.im \
    --cc=git@vger.kernel.org \
    --cc=gitster@pobox.com \
    --cc=tamird@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox