From: Cleber Rosa <crosa@redhat.com>
To: "Alex Bennée" <alex.bennee@linaro.org>,
qemu-devel@nongnu.org, "Peter Maydell" <peter.maydell@linaro.org>
Cc: "Thomas Huth" <thuth@redhat.com>,
"Daniel P. Berrangé" <berrange@redhat.com>,
"Beraldo Leal" <bleal@redhat.com>,
"Erik Skultety" <eskultet@redhat.com>,
"Wainer dos Santos Moschetta" <wainersm@redhat.com>,
"Willian Rampazzo" <wrampazz@redhat.com>,
"Cleber Rosa" <crosa@redhat.com>,
"Philippe Mathieu-Daudé" <philmd@redhat.com>,
"Eduardo Habkost" <ehabkost@redhat.com>
Subject: [PATCH v2 1/2] GitLab Gating CI: introduce pipeline-status contrib script
Date: Wed, 8 Jul 2020 22:46:56 -0400 [thread overview]
Message-ID: <20200709024657.2500558-2-crosa@redhat.com> (raw)
In-Reply-To: <20200709024657.2500558-1-crosa@redhat.com>
This script is intended to be used right after a push to a branch.
By default, it will look for the pipeline associated with the commit
that is the HEAD of the *local* staging branch. It can be used as a
one time check, or with the `--wait` option to wait until the pipeline
completes.
If the pipeline is successful, then a merge of the staging branch into
the master branch should be the next step.
Signed-off-by: Cleber Rosa <crosa@redhat.com>
---
scripts/ci/gitlab-pipeline-status | 156 ++++++++++++++++++++++++++++++
1 file changed, 156 insertions(+)
create mode 100755 scripts/ci/gitlab-pipeline-status
diff --git a/scripts/ci/gitlab-pipeline-status b/scripts/ci/gitlab-pipeline-status
new file mode 100755
index 0000000000..4a9de39872
--- /dev/null
+++ b/scripts/ci/gitlab-pipeline-status
@@ -0,0 +1,156 @@
+#!/usr/bin/env python3
+#
+# Copyright (c) 2019-2020 Red Hat, Inc.
+#
+# Author:
+# Cleber Rosa <crosa@redhat.com>
+#
+# This work is licensed under the terms of the GNU GPL, version 2 or
+# later. See the COPYING file in the top-level directory.
+
+"""
+Checks the GitLab pipeline status for a given commit commit
+"""
+
+# pylint: disable=C0103
+
+import argparse
+import http.client
+import json
+import os
+import subprocess
+import time
+import sys
+
+
+def get_local_staging_branch_commit():
+ """
+ Returns the commit sha1 for the *local* branch named "staging"
+ """
+ result = subprocess.run(['git', 'rev-parse', 'staging'],
+ stdin=subprocess.DEVNULL,
+ stdout=subprocess.PIPE,
+ stderr=subprocess.DEVNULL,
+ cwd=os.path.dirname(__file__),
+ universal_newlines=True).stdout.strip()
+ if result == 'staging':
+ raise ValueError("There's no local staging branch")
+ if len(result) != 40:
+ raise ValueError("Branch staging HEAD doesn't look like a sha1")
+ return result
+
+
+def get_pipeline_status(project_id, commit_sha1):
+ """
+ Returns the JSON content of the pipeline status API response
+ """
+ url = '/api/v4/projects/{}/pipelines?sha={}'.format(project_id,
+ commit_sha1)
+ connection = http.client.HTTPSConnection('gitlab.com')
+ connection.request('GET', url=url)
+ response = connection.getresponse()
+ if response.code != http.HTTPStatus.OK:
+ raise ValueError("Failed to receive a successful response")
+ json_response = json.loads(response.read())
+ # afaict, there should one one pipeline for the same project + commit
+ # if this assumption is false, we can add further filters to the
+ # url, such as username, and order_by.
+ if not json_response:
+ raise ValueError("No pipeline found")
+ return json_response[0]
+
+
+def wait_on_pipeline_success(timeout, interval,
+ project_id, commit_sha):
+ """
+ Waits for the pipeline to end up to the timeout given
+ """
+ start = time.time()
+ while True:
+ if time.time() >= (start + timeout):
+ print("Waiting on the pipeline success timed out")
+ return False
+
+ status = get_pipeline_status(project_id, commit_sha)
+ if status['status'] == 'running':
+ time.sleep(interval)
+ print('running...')
+ continue
+
+ if status['status'] == 'success':
+ return True
+
+ msg = "Pipeline ended unsuccessfully, check: %s" % status['web_url']
+ print(msg)
+ return False
+
+
+def main():
+ """
+ Script entry point
+ """
+ parser = argparse.ArgumentParser(
+ prog='pipeline-status',
+ description='check or wait on a pipeline status')
+
+ parser.add_argument('-t', '--timeout', type=int, default=7200,
+ help=('Amount of time (in seconds) to wait for the '
+ 'pipeline to complete. Defaults to '
+ '%(default)s'))
+ parser.add_argument('-i', '--interval', type=int, default=60,
+ help=('Amount of time (in seconds) to wait between '
+ 'checks of the pipeline status. Defaults '
+ 'to %(default)s'))
+ parser.add_argument('-w', '--wait', action='store_true', default=False,
+ help=('Wether to wait, instead of checking only once '
+ 'the status of a pipeline'))
+ parser.add_argument('-p', '--project-id', type=int, default=11167699,
+ help=('The GitLab project ID. Defaults to the project '
+ 'for https://gitlab.com/qemu-project/qemu, that '
+ 'is, "%(default)s"'))
+ try:
+ default_commit = get_local_staging_branch_commit()
+ commit_required = False
+ except ValueError:
+ default_commit = ''
+ commit_required = True
+ parser.add_argument('-c', '--commit', required=commit_required,
+ default=default_commit,
+ help=('Look for a pipeline associated with the given '
+ 'commit. If one is not explicitly given, the '
+ 'commit associated with the local branch named '
+ '"staging" is used. Default: %(default)s'))
+ parser.add_argument('--verbose', action='store_true', default=False,
+ help=('A minimal verbosity level that prints the '
+ 'overall result of the check/wait'))
+
+ args = parser.parse_args()
+
+ try:
+ if args.wait:
+ success = wait_on_pipeline_success(
+ args.timeout,
+ args.interval,
+ args.project_id,
+ args.commit)
+ else:
+ status = get_pipeline_status(args.project_id,
+ args.commit)
+ success = status['status'] == 'success'
+ except Exception as error: # pylint: disable=W0703
+ success = False
+ if args.verbose:
+ print("ERROR: %s" % error.args[0])
+
+ if success:
+ if args.verbose:
+ print('success')
+ sys.exit(0)
+ else:
+ if args.verbose:
+ print('failure')
+ sys.exit(1)
+
+
+if __name__ == '__main__':
+ main()
--
2.25.4
next prev parent reply other threads:[~2020-07-09 2:49 UTC|newest]
Thread overview: 39+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-07-09 2:46 [PATCH v2 0/2] QEMU Gating CI Cleber Rosa
2020-07-09 2:46 ` Cleber Rosa [this message]
2020-07-09 8:55 ` [PATCH v2 1/2] GitLab Gating CI: introduce pipeline-status contrib script Erik Skultety
2020-07-09 10:13 ` Philippe Mathieu-Daudé
2020-07-13 7:20 ` Thomas Huth
2020-09-02 22:09 ` Cleber Rosa
2020-09-02 22:01 ` Cleber Rosa
2020-07-09 11:50 ` Thomas Huth
2020-07-09 2:46 ` [PATCH v2 2/2] GitLab Gating CI: initial set of jobs, documentation and scripts Cleber Rosa
2020-07-09 8:55 ` Erik Skultety
2020-09-03 21:12 ` Cleber Rosa
2020-09-04 9:11 ` Andrea Bolognani
2020-09-04 14:27 ` Cleber Rosa
2020-07-09 10:07 ` Philippe Mathieu-Daudé
2020-09-03 23:17 ` Cleber Rosa
2020-07-09 10:30 ` Daniel P. Berrangé
2020-07-09 11:28 ` Andrea Bolognani
2020-09-04 0:18 ` Cleber Rosa
2020-09-04 8:23 ` Daniel P. Berrangé
2020-09-04 14:40 ` Cleber Rosa
2020-09-04 0:11 ` Cleber Rosa
2020-09-04 8:18 ` Daniel P. Berrangé
2020-09-04 15:10 ` Cleber Rosa
2020-09-04 9:53 ` Gerd Hoffmann
2020-07-29 10:16 ` Stefan Hajnoczi
2020-09-04 0:36 ` Cleber Rosa
2020-09-04 9:47 ` Philippe Mathieu-Daudé
2020-07-20 16:18 ` [PATCH v2 0/2] QEMU Gating CI Peter Maydell
2020-07-20 17:22 ` Cleber Rosa
2020-07-28 14:48 ` Peter Maydell
2020-07-28 14:51 ` Daniel P. Berrangé
2020-07-28 16:13 ` Cleber Rosa
2020-07-28 16:15 ` Daniel P. Berrangé
2020-07-28 16:24 ` Cleber Rosa
2020-07-28 15:50 ` Cleber Rosa
2020-07-28 16:08 ` Peter Maydell
2020-07-28 16:33 ` Cleber Rosa
2020-07-28 16:41 ` Philippe Mathieu-Daudé
2020-07-28 16:54 ` Peter Maydell
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20200709024657.2500558-2-crosa@redhat.com \
--to=crosa@redhat.com \
--cc=alex.bennee@linaro.org \
--cc=berrange@redhat.com \
--cc=bleal@redhat.com \
--cc=ehabkost@redhat.com \
--cc=eskultet@redhat.com \
--cc=peter.maydell@linaro.org \
--cc=philmd@redhat.com \
--cc=qemu-devel@nongnu.org \
--cc=thuth@redhat.com \
--cc=wainersm@redhat.com \
--cc=wrampazz@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).