From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from list by lists.gnu.org with archive (Exim 4.90_1) id 1kqZGW-0006Tk-Am for mharc-grub-devel@gnu.org; Sat, 19 Dec 2020 05:15:08 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:45384) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kqZGU-0006TS-RZ for grub-devel@gnu.org; Sat, 19 Dec 2020 05:15:06 -0500 Received: from mail-io1-xd29.google.com ([2607:f8b0:4864:20::d29]:33431) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1kqZGS-0001xQ-Lx for grub-devel@gnu.org; Sat, 19 Dec 2020 05:15:06 -0500 Received: by mail-io1-xd29.google.com with SMTP id w18so4482423iot.0 for ; Sat, 19 Dec 2020 02:15:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=efficientek-com.20150623.gappssmtp.com; s=20150623; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=tubkGK+TDv/efuqtmXUegWs1f9p8Hqm9U28YTgm0hsU=; b=fSNxjF68MMnIXvgrFnbEu6GSV45MlIB+CKd0eXib++P4EMpUoTYrm3O/2QEWnQGOHQ nQaHDNE6+RimWMh7yCkksOaV1ICQK0uZQqLjeXm7P1+zoMtV0XA+Ie7YB8TwLdqjm148 S9k4qlFv/S3QNVhihv6AYyuIkTCkgeqOaW3ySdXfmZXJ/rg7b1cIlrXTzwATNskwiSJI 65EL0GtL42VNC4jTfnY86XNI19cioRJL85l7zX/Me/CfJy7ZDz4o5nlI1vbnjEHFRP+9 2/rwAi+ksJ5eiFjBXaOdSkS38XpK8ex3THvEQoJ6A76dnBpbFcJdwR+Q8IiVomeWR9UE SJ2A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=tubkGK+TDv/efuqtmXUegWs1f9p8Hqm9U28YTgm0hsU=; b=twS/PvXB22uzKe5KPYiCGfENEGesq90F/daFlcbPvn0Afq3ajuWWaC3U2aOfpyixVA yIviE/ucFEdOi75aGPIN/xsfq1WMcrew6rA5nZNxUDs4Uhcz8gpj0xk/QOwUTKYke005 GmfAQNA/hdaEl5b8Y/h4yFilEb+n68dh41cEcFTf/taUmXDAVQL0iiZ+xc+6dkvrQ8ug o18QZoAwyl/bHhok7InuYXf2KGj0HCROf3WjJTQZ5bxXwAIQcb7qN9ozm//SuYBwJfEr lUHQVdQ1UBYtOztE2UZKR8pcZM9z8xqOLToE821WUfodkrkNjLSpEunM6NLPoq4e/gre BH4A== X-Gm-Message-State: AOAM530MgYpGWdxk6R5gN3jnboHWeb1CIKmakGwi0j91q8itCxro2Vzy yJjOD0jaUR6hbvX6gjvymEdTkCRwOThqqg== X-Google-Smtp-Source: ABdhPJzsQZMuwMyCkgxMXYqgnlAHVl2ecpVcSgXvtFWagBWsFWgC40bQPK1GpS2eOArDo25UuYXiJw== X-Received: by 2002:a5d:994c:: with SMTP id v12mr7654842ios.201.1608372902655; Sat, 19 Dec 2020 02:15:02 -0800 (PST) Received: from localhost.localdomain ([136.49.211.192]) by smtp.gmail.com with ESMTPSA id o195sm8821542ila.38.2020.12.19.02.15.01 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 19 Dec 2020 02:15:01 -0800 (PST) From: Glenn Washburn To: grub-devel@gnu.org Cc: Daniel Kiper , Glenn Washburn Subject: [PATCH 0/5] Testing improvements Date: Sat, 19 Dec 2020 04:14:35 -0600 Message-Id: X-Mailer: git-send-email 2.27.0 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Received-SPF: pass client-ip=2607:f8b0:4864:20::d29; envelope-from=development@efficientek.com; helo=mail-io1-xd29.google.com X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: grub-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: The development of GNU GRUB List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Dec 2020 10:15:07 -0000 I've been working on getting continuous integration working in gitlab where testing is being done in an Ubuntu image. This patch series improves various tests. I've ordered the patches starting with the least controversial patches. The last two patches I suspect may have some deserve some attention. Patch 4 allows the partmap_test to pass. I'm not sure why the number of the device has changed from the setup this test was previously working on. I suspect it could be either because I'm using a newer qemu or because I'm using a new firmware/bios. Patch 5 disables functional tests that have been failing for a long time, by commenting them out. When someone gets around to fixing them, they can be uncommented. But as it is, they've been failing for some time and people ignore those failures. This isn't so nice with a continuous integration system that largely expects tests to be passing, so it can detect when there are new failures. Glenn Glenn Washburn (5): tests: Exit with skipped exit code when test not performed tests: Make sure LANG is set properly for iso9660_test tests: Make setup errors in grub-fs-tester hard errors tests: Fix partmap_test for arm*-efi, disk numbering has changed tests: Comment failing functional tests until we can get them working again grub-core/tests/lib/functional_test.c | 6 +++--- tests/core_compress_test.in | 2 +- tests/iso9660_test.in | 6 ++++++ tests/partmap_test.in | 2 +- tests/pseries_test.in | 2 +- tests/util/grub-fs-tester.in | 11 ++++++----- 6 files changed, 18 insertions(+), 11 deletions(-) -- 2.27.0