From: Alexandre Belloni <alexandre.belloni@bootlin.com>
To: Joshua Watt <JPEWhacker@gmail.com>
Cc: bitbake-devel@lists.openembedded.org
Subject: Re: [bitbake-devel][RFC 0/5] Bitbake Hash Server WebSockets Implementation
Date: Fri, 29 Sep 2023 08:33:36 +0200 [thread overview]
Message-ID: <20230929063336632d758d@mail.local> (raw)
In-Reply-To: <20230928170551.4193224-1-JPEWhacker@gmail.com>
Hi Joshua,
I was curious and gave it a shot, this seems to break prserv:
https://autobuilder.yoctoproject.org/typhoon/#/builders/86/builds/5820/steps/14/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/127/builds/2170/steps/15/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/5828/steps/15/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/87/builds/5845/steps/14/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/80/builds/5779/steps/14/logs/stdio
On 28/09/2023 11:05:46-0600, Joshua Watt wrote:
> This patch series implements a websockets transport protocol for the
> bitbake hash equivalence client. Note that while this uses the
> websockets 3rd party python module, its use should only be actually
> required if the user wants to use the websocket transport mechanism.
>
> A websocket implementation is not added on the server side, as it is not
> desired to add the websocket dependency there. In addition, there are
> other server improvements that are desired, such as the ability to use
> different database backends which also require other python modules. As
> such, the websockets client can be test with the websocket hash
> equivalence server implemented here:
> https://github.com/JoshuaWatt/bb-hashserver
>
> Joshua Watt (5):
> asyncrpc: Abstract client socket
> hashserv: Add remove API
> bitbake-hashclient: Add remove subcommand
> hashserv: tests: Add external database tests
> hashserv: Add websocket connection implementation
>
> bitbake/bin/bitbake-hashclient | 13 +++
> bitbake/lib/bb/asyncrpc/client.py | 173 ++++++++++++++++++++----------
> bitbake/lib/hashserv/__init__.py | 9 ++
> bitbake/lib/hashserv/client.py | 30 +++---
> bitbake/lib/hashserv/server.py | 29 +++++
> bitbake/lib/hashserv/tests.py | 82 ++++++++++++--
> bitbake/lib/prserv/client.py | 8 +-
> 7 files changed, 262 insertions(+), 82 deletions(-)
>
> --
> 2.34.1
>
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#15142): https://lists.openembedded.org/g/bitbake-devel/message/15142
> Mute This Topic: https://lists.openembedded.org/mt/101641857/3617179
> Group Owner: bitbake-devel+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/bitbake-devel/unsub [alexandre.belloni@bootlin.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>
--
Alexandre Belloni, co-owner and COO, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com
next prev parent reply other threads:[~2023-09-29 6:33 UTC|newest]
Thread overview: 138+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-09-28 17:05 [bitbake-devel][RFC 0/5] Bitbake Hash Server WebSockets Implementation Joshua Watt
2023-09-28 17:05 ` [bitbake-devel][RFC 1/5] asyncrpc: Abstract client socket Joshua Watt
2023-09-28 17:05 ` [bitbake-devel][RFC 2/5] hashserv: Add remove API Joshua Watt
2023-09-28 17:05 ` [bitbake-devel][RFC 3/5] bitbake-hashclient: Add remove subcommand Joshua Watt
2023-09-28 17:05 ` [bitbake-devel][RFC 4/5] hashserv: tests: Add external database tests Joshua Watt
2023-09-28 17:05 ` [bitbake-devel][RFC 5/5] hashserv: Add websocket connection implementation Joshua Watt
2023-09-29 6:33 ` Alexandre Belloni [this message]
2023-10-03 14:52 ` [bitbake-devel][RFC v2 00/12] Bitbake Hash Server WebSockets and Alternate Database Backend Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 01/12] asyncrpc: Abstract sockets Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 02/12] hashserv: Add remove API Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 03/12] bitbake-hashclient: Add remove subcommand Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 04/12] hashserv: Add websocket connection implementation Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 05/12] asyncrpc: Add context manager API Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 06/12] hashserv: tests: Add external database tests Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 07/12] asyncrpc: Prefix log messages with client info Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 08/12] bitbake-hashserv: Allow arguments from environment Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 09/12] hashserv: Abstract database Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 10/12] hashserv: Add SQLalchemy backend Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 11/12] contrib: Update hashserv Dockerfile Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 12/12] contrib: hashserv: Add docker-compose Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 00/18] Bitbake Hash Server WebSockets, Alternate Database Backend, and User Management Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 01/18] asyncrpc: Abstract sockets Joshua Watt
2023-10-17 9:06 ` [RFC v2 11/18] hashserv: Implement read-only version of "report" Karim Ben Houcine
2023-10-12 22:16 ` [bitbake-devel][RFC v2 02/18] hashserv: Add websocket connection implementation Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 03/18] asyncrpc: Add context manager API Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 04/18] hashserv: tests: Add external database tests Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 05/18] asyncrpc: Prefix log messages with client info Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 06/18] bitbake-hashserv: Allow arguments from environment Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 07/18] hashserv: Abstract database Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 08/18] hashserv: Add SQLalchemy backend Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 09/18] contrib: Update hashserv Dockerfile Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 10/18] contrib: hashserv: Add docker-compose Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 11/18] hashserv: Implement read-only version of "report" RPC Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 12/18] asyncrpc: Add InvokeError Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 13/18] asyncrpc: client: Prevent double closing of loop Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 14/18] asyncrpc: client: Add disconnect API Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 15/18] hashserv: Add user permissions Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 16/18] hashserv: Add become-user API Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 17/18] hashserv: Add db-usage API Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 18/18] hashserv: Add database column query API Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 00/22] Bitbake Hash Server WebSockets, Alternate Database Backend, and User Management Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 01/22] asyncrpc: Abstract sockets Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 02/22] hashserv: Add websocket connection implementation Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 03/22] asyncrpc: Add context manager API Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 04/22] hashserv: tests: Add external database tests Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 05/22] asyncrpc: Prefix log messages with client info Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 06/22] bitbake-hashserv: Allow arguments from environment Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 07/22] hashserv: Abstract database Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 08/22] hashserv: Add SQLalchemy backend Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 09/22] hashserv: Implement read-only version of "report" RPC Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 10/22] asyncrpc: Add InvokeError Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 11/22] asyncrpc: client: Prevent double closing of loop Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 12/22] asyncrpc: client: Add disconnect API Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 13/22] hashserv: Add user permissions Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 14/22] hashserv: Add become-user API Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 15/22] hashserv: Add db-usage API Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 16/22] hashserv: Add database column query API Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 17/22] hashserv: test: Add bitbake-hashclient tests Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 18/22] bitbake-hashclient: Output stats in JSON format Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 19/22] bitbake-hashserver: Allow anonymous permissions to be space separated Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 20/22] hashserv: tests: Allow authentication for external server tests Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 21/22] hashserv: Allow self-service deletion Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 22/22] hashserv: server: Add owner if user is logged in Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 00/22] Bitbake Hash Server WebSockets, Alternate Database Backend, and User Management Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 01/22] asyncrpc: Abstract sockets Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 02/22] hashserv: Add websocket connection implementation Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 03/22] asyncrpc: Add context manager API Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 04/22] hashserv: tests: Add external database tests Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 05/22] asyncrpc: Prefix log messages with client info Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 06/22] bitbake-hashserv: Allow arguments from environment Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 07/22] hashserv: Abstract database Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 08/22] hashserv: Add SQLalchemy backend Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 09/22] hashserv: Implement read-only version of "report" RPC Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 10/22] asyncrpc: Add InvokeError Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 11/22] asyncrpc: client: Prevent double closing of loop Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 12/22] asyncrpc: client: Add disconnect API Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 13/22] hashserv: Add user permissions Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 14/22] hashserv: Add become-user API Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 15/22] hashserv: Add db-usage API Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 16/22] hashserv: Add database column query API Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 17/22] hashserv: test: Add bitbake-hashclient tests Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 18/22] bitbake-hashclient: Output stats in JSON format Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 19/22] bitbake-hashserver: Allow anonymous permissions to be space separated Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 20/22] hashserv: tests: Allow authentication for external server tests Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 21/22] hashserv: Allow self-service deletion Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 22/22] hashserv: server: Add owner if user is logged in Joshua Watt
2023-11-01 13:17 ` [bitbake-devel][PATCH v4 00/22] Bitbake Hash Server WebSockets, Alternate Database Backend, and User Management Alexandre Belloni
2023-11-01 13:29 ` Alexandre Belloni
2023-11-01 15:41 ` [bitbake-devel][PATCH v5 " Joshua Watt
2023-11-01 15:41 ` [bitbake-devel][PATCH v5 01/22] asyncrpc: Abstract sockets Joshua Watt
2023-11-01 15:41 ` [bitbake-devel][PATCH v5 02/22] hashserv: Add websocket connection implementation Joshua Watt
2023-11-01 15:41 ` [bitbake-devel][PATCH v5 03/22] asyncrpc: Add context manager API Joshua Watt
2023-11-01 15:41 ` [bitbake-devel][PATCH v5 04/22] hashserv: tests: Add external database tests Joshua Watt
2023-11-01 15:41 ` [bitbake-devel][PATCH v5 05/22] asyncrpc: Prefix log messages with client info Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 06/22] bitbake-hashserv: Allow arguments from environment Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 07/22] hashserv: Abstract database Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 08/22] hashserv: Add SQLalchemy backend Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 09/22] hashserv: Implement read-only version of "report" RPC Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 10/22] asyncrpc: Add InvokeError Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 11/22] asyncrpc: client: Prevent double closing of loop Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 12/22] asyncrpc: client: Add disconnect API Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 13/22] hashserv: Add user permissions Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 14/22] hashserv: Add become-user API Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 15/22] hashserv: Add db-usage API Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 16/22] hashserv: Add database column query API Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 17/22] hashserv: test: Add bitbake-hashclient tests Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 18/22] bitbake-hashclient: Output stats in JSON format Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 19/22] bitbake-hashserver: Allow anonymous permissions to be space separated Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 20/22] hashserv: tests: Allow authentication for external server tests Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 21/22] hashserv: Allow self-service deletion Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 22/22] hashserv: server: Add owner if user is logged in Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 00/22] Bitbake Hash Server WebSockets, Alternate Database Backend, and User Management Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 01/22] asyncrpc: Abstract sockets Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 02/22] hashserv: Add websocket connection implementation Joshua Watt
2023-11-10 12:03 ` Matthias Schnelte
2023-11-10 14:11 ` Joshua Watt
2023-11-15 7:44 ` Matthias Schnelte
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 03/22] asyncrpc: Add context manager API Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 04/22] hashserv: tests: Add external database tests Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 05/22] asyncrpc: Prefix log messages with client info Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 06/22] bitbake-hashserv: Allow arguments from environment Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 07/22] hashserv: Abstract database Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 08/22] hashserv: Add SQLalchemy backend Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 09/22] hashserv: Implement read-only version of "report" RPC Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 10/22] asyncrpc: Add InvokeError Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 11/22] asyncrpc: client: Prevent double closing of loop Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 12/22] asyncrpc: client: Add disconnect API Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 13/22] hashserv: Add user permissions Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 14/22] hashserv: Add become-user API Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 15/22] hashserv: Add db-usage API Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 16/22] hashserv: Add database column query API Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 17/22] hashserv: test: Add bitbake-hashclient tests Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 18/22] bitbake-hashclient: Output stats in JSON format Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 19/22] bitbake-hashserver: Allow anonymous permissions to be space separated Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 20/22] hashserv: tests: Allow authentication for external server tests Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 21/22] hashserv: Allow self-service deletion Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 22/22] hashserv: server: Add owner if user is logged in Joshua Watt
2023-11-09 10:23 ` [bitbake-devel][PATCH v6 00/22] Bitbake Hash Server WebSockets, Alternate Database Backend, and User Management Alexandre Belloni
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20230929063336632d758d@mail.local \
--to=alexandre.belloni@bootlin.com \
--cc=JPEWhacker@gmail.com \
--cc=bitbake-devel@lists.openembedded.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.