From: Alexandre Belloni <alexandre.belloni@bootlin.com>
To: Joshua Watt <JPEWhacker@gmail.com>
Cc: bitbake-devel@lists.openembedded.org
Subject: Re: [bitbake-devel][RFC 0/5] Bitbake Hash Server WebSockets Implementation
Date: Fri, 29 Sep 2023 08:33:36 +0200 [thread overview]
Message-ID: <20230929063336632d758d@mail.local> (raw)
In-Reply-To: <20230928170551.4193224-1-JPEWhacker@gmail.com>
Hi Joshua,
I was curious and gave it a shot, this seems to break prserv:
https://autobuilder.yoctoproject.org/typhoon/#/builders/86/builds/5820/steps/14/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/127/builds/2170/steps/15/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/5828/steps/15/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/87/builds/5845/steps/14/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/80/builds/5779/steps/14/logs/stdio
On 28/09/2023 11:05:46-0600, Joshua Watt wrote:
> This patch series implements a websockets transport protocol for the
> bitbake hash equivalence client. Note that while this uses the
> websockets 3rd party python module, its use should only be actually
> required if the user wants to use the websocket transport mechanism.
>
> A websocket implementation is not added on the server side, as it is not
> desired to add the websocket dependency there. In addition, there are
> other server improvements that are desired, such as the ability to use
> different database backends which also require other python modules. As
> such, the websockets client can be test with the websocket hash
> equivalence server implemented here:
> https://github.com/JoshuaWatt/bb-hashserver
>
> Joshua Watt (5):
> asyncrpc: Abstract client socket
> hashserv: Add remove API
> bitbake-hashclient: Add remove subcommand
> hashserv: tests: Add external database tests
> hashserv: Add websocket connection implementation
>
> bitbake/bin/bitbake-hashclient | 13 +++
> bitbake/lib/bb/asyncrpc/client.py | 173 ++++++++++++++++++++----------
> bitbake/lib/hashserv/__init__.py | 9 ++
> bitbake/lib/hashserv/client.py | 30 +++---
> bitbake/lib/hashserv/server.py | 29 +++++
> bitbake/lib/hashserv/tests.py | 82 ++++++++++++--
> bitbake/lib/prserv/client.py | 8 +-
> 7 files changed, 262 insertions(+), 82 deletions(-)
>
> --
> 2.34.1
>
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#15142): https://lists.openembedded.org/g/bitbake-devel/message/15142
> Mute This Topic: https://lists.openembedded.org/mt/101641857/3617179
> Group Owner: bitbake-devel+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/bitbake-devel/unsub [alexandre.belloni@bootlin.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>
--
Alexandre Belloni, co-owner and COO, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com
next prev parent reply other threads:[~2023-09-29 6:33 UTC|newest]
Thread overview: 138+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-09-28 17:05 [bitbake-devel][RFC 0/5] Bitbake Hash Server WebSockets Implementation Joshua Watt
2023-09-28 17:05 ` [bitbake-devel][RFC 1/5] asyncrpc: Abstract client socket Joshua Watt
2023-09-28 17:05 ` [bitbake-devel][RFC 2/5] hashserv: Add remove API Joshua Watt
2023-09-28 17:05 ` [bitbake-devel][RFC 3/5] bitbake-hashclient: Add remove subcommand Joshua Watt
2023-09-28 17:05 ` [bitbake-devel][RFC 4/5] hashserv: tests: Add external database tests Joshua Watt
2023-09-28 17:05 ` [bitbake-devel][RFC 5/5] hashserv: Add websocket connection implementation Joshua Watt
2023-09-29 6:33 ` Alexandre Belloni [this message]
2023-10-03 14:52 ` [bitbake-devel][RFC v2 00/12] Bitbake Hash Server WebSockets and Alternate Database Backend Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 01/12] asyncrpc: Abstract sockets Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 02/12] hashserv: Add remove API Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 03/12] bitbake-hashclient: Add remove subcommand Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 04/12] hashserv: Add websocket connection implementation Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 05/12] asyncrpc: Add context manager API Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 06/12] hashserv: tests: Add external database tests Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 07/12] asyncrpc: Prefix log messages with client info Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 08/12] bitbake-hashserv: Allow arguments from environment Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 09/12] hashserv: Abstract database Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 10/12] hashserv: Add SQLalchemy backend Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 11/12] contrib: Update hashserv Dockerfile Joshua Watt
2023-10-03 14:52 ` [bitbake-devel][RFC v2 12/12] contrib: hashserv: Add docker-compose Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 00/18] Bitbake Hash Server WebSockets, Alternate Database Backend, and User Management Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 01/18] asyncrpc: Abstract sockets Joshua Watt
2023-10-17 9:06 ` [RFC v2 11/18] hashserv: Implement read-only version of "report" Karim Ben Houcine
2023-10-12 22:16 ` [bitbake-devel][RFC v2 02/18] hashserv: Add websocket connection implementation Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 03/18] asyncrpc: Add context manager API Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 04/18] hashserv: tests: Add external database tests Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 05/18] asyncrpc: Prefix log messages with client info Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 06/18] bitbake-hashserv: Allow arguments from environment Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 07/18] hashserv: Abstract database Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 08/18] hashserv: Add SQLalchemy backend Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 09/18] contrib: Update hashserv Dockerfile Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 10/18] contrib: hashserv: Add docker-compose Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 11/18] hashserv: Implement read-only version of "report" RPC Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 12/18] asyncrpc: Add InvokeError Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 13/18] asyncrpc: client: Prevent double closing of loop Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 14/18] asyncrpc: client: Add disconnect API Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 15/18] hashserv: Add user permissions Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 16/18] hashserv: Add become-user API Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 17/18] hashserv: Add db-usage API Joshua Watt
2023-10-12 22:16 ` [bitbake-devel][RFC v2 18/18] hashserv: Add database column query API Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 00/22] Bitbake Hash Server WebSockets, Alternate Database Backend, and User Management Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 01/22] asyncrpc: Abstract sockets Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 02/22] hashserv: Add websocket connection implementation Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 03/22] asyncrpc: Add context manager API Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 04/22] hashserv: tests: Add external database tests Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 05/22] asyncrpc: Prefix log messages with client info Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 06/22] bitbake-hashserv: Allow arguments from environment Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 07/22] hashserv: Abstract database Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 08/22] hashserv: Add SQLalchemy backend Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 09/22] hashserv: Implement read-only version of "report" RPC Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 10/22] asyncrpc: Add InvokeError Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 11/22] asyncrpc: client: Prevent double closing of loop Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 12/22] asyncrpc: client: Add disconnect API Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 13/22] hashserv: Add user permissions Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 14/22] hashserv: Add become-user API Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 15/22] hashserv: Add db-usage API Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 16/22] hashserv: Add database column query API Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 17/22] hashserv: test: Add bitbake-hashclient tests Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 18/22] bitbake-hashclient: Output stats in JSON format Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 19/22] bitbake-hashserver: Allow anonymous permissions to be space separated Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 20/22] hashserv: tests: Allow authentication for external server tests Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 21/22] hashserv: Allow self-service deletion Joshua Watt
2023-10-30 19:17 ` [bitbake-devel][PATCH v3 22/22] hashserv: server: Add owner if user is logged in Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 00/22] Bitbake Hash Server WebSockets, Alternate Database Backend, and User Management Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 01/22] asyncrpc: Abstract sockets Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 02/22] hashserv: Add websocket connection implementation Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 03/22] asyncrpc: Add context manager API Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 04/22] hashserv: tests: Add external database tests Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 05/22] asyncrpc: Prefix log messages with client info Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 06/22] bitbake-hashserv: Allow arguments from environment Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 07/22] hashserv: Abstract database Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 08/22] hashserv: Add SQLalchemy backend Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 09/22] hashserv: Implement read-only version of "report" RPC Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 10/22] asyncrpc: Add InvokeError Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 11/22] asyncrpc: client: Prevent double closing of loop Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 12/22] asyncrpc: client: Add disconnect API Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 13/22] hashserv: Add user permissions Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 14/22] hashserv: Add become-user API Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 15/22] hashserv: Add db-usage API Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 16/22] hashserv: Add database column query API Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 17/22] hashserv: test: Add bitbake-hashclient tests Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 18/22] bitbake-hashclient: Output stats in JSON format Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 19/22] bitbake-hashserver: Allow anonymous permissions to be space separated Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 20/22] hashserv: tests: Allow authentication for external server tests Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 21/22] hashserv: Allow self-service deletion Joshua Watt
2023-10-31 17:21 ` [bitbake-devel][PATCH v4 22/22] hashserv: server: Add owner if user is logged in Joshua Watt
2023-11-01 13:17 ` [bitbake-devel][PATCH v4 00/22] Bitbake Hash Server WebSockets, Alternate Database Backend, and User Management Alexandre Belloni
2023-11-01 13:29 ` Alexandre Belloni
2023-11-01 15:41 ` [bitbake-devel][PATCH v5 " Joshua Watt
2023-11-01 15:41 ` [bitbake-devel][PATCH v5 01/22] asyncrpc: Abstract sockets Joshua Watt
2023-11-01 15:41 ` [bitbake-devel][PATCH v5 02/22] hashserv: Add websocket connection implementation Joshua Watt
2023-11-01 15:41 ` [bitbake-devel][PATCH v5 03/22] asyncrpc: Add context manager API Joshua Watt
2023-11-01 15:41 ` [bitbake-devel][PATCH v5 04/22] hashserv: tests: Add external database tests Joshua Watt
2023-11-01 15:41 ` [bitbake-devel][PATCH v5 05/22] asyncrpc: Prefix log messages with client info Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 06/22] bitbake-hashserv: Allow arguments from environment Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 07/22] hashserv: Abstract database Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 08/22] hashserv: Add SQLalchemy backend Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 09/22] hashserv: Implement read-only version of "report" RPC Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 10/22] asyncrpc: Add InvokeError Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 11/22] asyncrpc: client: Prevent double closing of loop Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 12/22] asyncrpc: client: Add disconnect API Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 13/22] hashserv: Add user permissions Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 14/22] hashserv: Add become-user API Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 15/22] hashserv: Add db-usage API Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 16/22] hashserv: Add database column query API Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 17/22] hashserv: test: Add bitbake-hashclient tests Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 18/22] bitbake-hashclient: Output stats in JSON format Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 19/22] bitbake-hashserver: Allow anonymous permissions to be space separated Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 20/22] hashserv: tests: Allow authentication for external server tests Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 21/22] hashserv: Allow self-service deletion Joshua Watt
2023-11-01 15:42 ` [bitbake-devel][PATCH v5 22/22] hashserv: server: Add owner if user is logged in Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 00/22] Bitbake Hash Server WebSockets, Alternate Database Backend, and User Management Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 01/22] asyncrpc: Abstract sockets Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 02/22] hashserv: Add websocket connection implementation Joshua Watt
2023-11-10 12:03 ` Matthias Schnelte
2023-11-10 14:11 ` Joshua Watt
2023-11-15 7:44 ` Matthias Schnelte
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 03/22] asyncrpc: Add context manager API Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 04/22] hashserv: tests: Add external database tests Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 05/22] asyncrpc: Prefix log messages with client info Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 06/22] bitbake-hashserv: Allow arguments from environment Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 07/22] hashserv: Abstract database Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 08/22] hashserv: Add SQLalchemy backend Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 09/22] hashserv: Implement read-only version of "report" RPC Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 10/22] asyncrpc: Add InvokeError Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 11/22] asyncrpc: client: Prevent double closing of loop Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 12/22] asyncrpc: client: Add disconnect API Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 13/22] hashserv: Add user permissions Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 14/22] hashserv: Add become-user API Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 15/22] hashserv: Add db-usage API Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 16/22] hashserv: Add database column query API Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 17/22] hashserv: test: Add bitbake-hashclient tests Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 18/22] bitbake-hashclient: Output stats in JSON format Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 19/22] bitbake-hashserver: Allow anonymous permissions to be space separated Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 20/22] hashserv: tests: Allow authentication for external server tests Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 21/22] hashserv: Allow self-service deletion Joshua Watt
2023-11-03 14:26 ` [bitbake-devel][PATCH v6 22/22] hashserv: server: Add owner if user is logged in Joshua Watt
2023-11-09 10:23 ` [bitbake-devel][PATCH v6 00/22] Bitbake Hash Server WebSockets, Alternate Database Backend, and User Management Alexandre Belloni
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20230929063336632d758d@mail.local \
--to=alexandre.belloni@bootlin.com \
--cc=JPEWhacker@gmail.com \
--cc=bitbake-devel@lists.openembedded.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox