From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from list by lists.gnu.org with archive (Exim 4.90_1) id 1lCw1T-00061h-JU for mharc-grub-devel@gnu.org; Thu, 18 Feb 2021 22:00:03 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:38038) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lCw1P-0005yw-LP for grub-devel@gnu.org; Thu, 18 Feb 2021 21:59:59 -0500 Received: from mail-qk1-x72b.google.com ([2607:f8b0:4864:20::72b]:43260) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1lCw1N-0005Pv-Jd for grub-devel@gnu.org; Thu, 18 Feb 2021 21:59:59 -0500 Received: by mail-qk1-x72b.google.com with SMTP id m144so4315216qke.10 for ; Thu, 18 Feb 2021 18:59:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=efficientek-com.20150623.gappssmtp.com; s=20150623; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=FZhVDJ3+7FS2vBQ97QtU6a7ygjJFEYA/IXuswOav0Ys=; b=kz8PHxLQkOr2046tuElJq8B0rGcN87F2xtnOf28dxID9CczlP2/phb5RKa6JA14SFk MP2yH6IrYca/pYzX7xnRDs1+1GkriImT8i+K1rdN0BL8kTrC63WQTFgrzj7+aBqHEE7J B8ry8XZra1q95p0sc2SKTn6ZA8K78jsO7gFy1FXb6EqGHVZf30YWgvUOVdFwOmmWYm44 0K3A1Ecr9oFAIjrmcWbswfT5BrO7PC6FYsd6yuIdLrOzhmGRd11CVf5LgBuco1/ghNbU RtZNszUC1pxAVEUoBPf8fT4XjgP3tPZul4w7R9gXKQ5y0XmouKBNdnULwvT+ajUGaIYd kx+w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=FZhVDJ3+7FS2vBQ97QtU6a7ygjJFEYA/IXuswOav0Ys=; b=KMdgCf6MPSH/BijjkDnX9MUXViH3y+FXjX//sucGX9LM5ez5bA6/joaveYTphDfz+/ 51NHSJyOPw3z+QHWtvPjyi/TYjbMuA8FUDAOVYxQP0aupItmJc/EKL9CHQeeRdtZnUoa TAxnUxkHBfycNYsTHWGnK3t0DPCVUQP+NtVi+wMFTb/Au1til9VruPFtPgcEC4KATA11 rfVpuoy88WkJe75KsJ8ub5qMUx3Hvp1Yla4+1ErU8krCXIEBoVk2fW1K91UeaA+DA94V JbxjV9IzhQu0LcyLv9Lt2B0Y8yVxCUiMEqkIiL04wYVYsL4yEbWA88e8x1d2mwcf0rXv ulDg== X-Gm-Message-State: AOAM5301ImfVpnTKtgJZVPMmgrkylmAK5yNN5iIeZmiFa0Ptu3JQVCI+ wI2mEM0cfegfYoq0+FpWGv3n3AxA6wtL+Q== X-Google-Smtp-Source: ABdhPJx607jeQ8heRETzCfO4eP7r98Kx1DHTMXSqIV/KANLhxa+mQ50wIQrm0UizOfh5ahlJCr3Iwg== X-Received: by 2002:a05:620a:2041:: with SMTP id d1mr7543862qka.326.1613703596125; Thu, 18 Feb 2021 18:59:56 -0800 (PST) Received: from localhost.localdomain ([2605:a601:aac5:3700:c323:c101:d96b:34f1]) by smtp.gmail.com with ESMTPSA id b17sm2468294qtq.56.2021.02.18.18.59.55 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 18 Feb 2021 18:59:55 -0800 (PST) From: Glenn Washburn To: grub-devel@gnu.org Cc: Daniel Kiper , Glenn Washburn Subject: [CI 00/17] Gitlab CI and test framework improvements Date: Thu, 18 Feb 2021 20:59:19 -0600 Message-Id: X-Mailer: git-send-email 2.27.0 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Received-SPF: pass client-ip=2607:f8b0:4864:20::72b; envelope-from=development@efficientek.com; helo=mail-qk1-x72b.google.com X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: grub-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: The development of GNU GRUB List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Feb 2021 02:59:59 -0000 This patch series is divided into roughly three sections: modifications of tests, improvements to grub-shell, and the CI patch itself. I have other improvements to testing coming, but I consider these more essential to the quality of the CI tests, or highly desirable. Aside from modification of qemu firmware paths to make them more generic, the changes should not be visible to current testers. The CI change is the addition of a .gitlab-ci.yml file which is the GitLab specific CI config file and a .ci directory with scripts used by the CI config. The scripts in the .ci dir are meant to be generic and thus usable by other CI platforms. There is probably more that can be pulled out of the .gitlab-ci.yml file for use in common with other CI configs, but I decided those can be pulled out as needed. The successful CI run can be viewed here: https://gitlab.com/gnu-grub/grub/-/pipelines/258485608 Glenn Glenn Washburn (17): tests: Make sure LANG is set properly for iso9660_test tests: Fix partmap_test for arm*-efi, disk numbering has changed tests: When checking squashfs fstime, use superblock last modified time tests: Fail immediately when grub-shell fails and do not occlude the error code grub-shell: Allow specifying non-default trim line contents grub-shell: Trim line should always be matched from the beginning of the line grub-shell: Only show grub-mkrescue output if it returns an error grub-shell: Allow setting default timeout via GRUB_SHELL_DEFAULT_TIMEOUT envvar grub-shell: Put all generated files into working dir and use better file names grub-shell: Add grub output logfile with grub-shell --debug grub-shell: Set exit status to qemu exit status tests: Allow turning on shell tracing from environment variables grub-shell: Add --verbose to mkrescue when $debug is greater than 2 grub-shell: Use malta qemu-mips machine type instead off non-existant indy grub-shell: Update qemu UEFI firmware names to be more generic ci: Add .gitlab-ci.yml for continuous integration with Gitlab CI keep: remove a lot of cruft that we probably want to reuse at some point .ci/build.sh | 56 +++ .ci/functions.gitlab.sh | 30 ++ .ci/functions.sh | 30 ++ .ci/make-images.sh | 71 ++++ .ci/process-tests.sh | 97 +++++ .ci/test.sh | 98 +++++ .gitlab-ci.yml | 632 +++++++++++++++++++++++++++++++++ tests/ahci_test.in | 6 +- tests/cdboot_test.in | 3 +- tests/core_compress_test.in | 6 +- tests/ehci_test.in | 6 +- tests/fddboot_test.in | 3 +- tests/grub_cmd_date.in | 3 +- tests/grub_cmd_test.in | 1 + tests/grub_script_blockarg.in | 2 +- tests/grub_script_expansion.in | 3 +- tests/gzcompress_test.in | 3 +- tests/hddboot_test.in | 3 +- tests/iso9660_test.in | 6 + tests/lzocompress_test.in | 3 +- tests/netboot_test.in | 3 +- tests/ohci_test.in | 6 +- tests/partmap_test.in | 6 +- tests/pata_test.in | 3 +- tests/test_sha512sum.in | 1 + tests/uhci_test.in | 6 +- tests/util/grub-fs-tester.in | 8 + tests/util/grub-shell.in | 87 +++-- tests/xzcompress_test.in | 3 +- 29 files changed, 1138 insertions(+), 47 deletions(-) create mode 100755 .ci/build.sh create mode 100644 .ci/functions.gitlab.sh create mode 100644 .ci/functions.sh create mode 100755 .ci/make-images.sh create mode 100755 .ci/process-tests.sh create mode 100755 .ci/test.sh create mode 100644 .gitlab-ci.yml -- 2.27.0