Openembedded Bitbake Development
 help / color / mirror / Atom feed
From: Alexandre Belloni <alexandre.belloni@bootlin.com>
To: Joshua Watt <JPEWhacker@gmail.com>
Cc: bitbake-devel@lists.openembedded.org
Subject: Re: [bitbake-devel][RFC 0/5] Bitbake Hash Server WebSockets Implementation
Date: Fri, 29 Sep 2023 08:33:36 +0200	[thread overview]
Message-ID: <20230929063336632d758d@mail.local> (raw)
In-Reply-To: <20230928170551.4193224-1-JPEWhacker@gmail.com>

Hi Joshua,

I was curious and gave it a shot, this seems to break prserv:

https://autobuilder.yoctoproject.org/typhoon/#/builders/86/builds/5820/steps/14/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/127/builds/2170/steps/15/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/5828/steps/15/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/87/builds/5845/steps/14/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/80/builds/5779/steps/14/logs/stdio

On 28/09/2023 11:05:46-0600, Joshua Watt wrote:
> This patch series implements a websockets transport protocol for the
> bitbake hash equivalence client. Note that while this uses the
> websockets 3rd party python module, its use should only be actually
> required if the user wants to use the websocket transport mechanism.
> 
> A websocket implementation is not added on the server side, as it is not
> desired to add the websocket dependency there. In addition, there are
> other server improvements that are desired, such as the ability to use
> different database backends which also require other python modules. As
> such, the websockets client can be test with the websocket hash
> equivalence server implemented here:
> https://github.com/JoshuaWatt/bb-hashserver
> 
> Joshua Watt (5):
>   asyncrpc: Abstract client socket
>   hashserv: Add remove API
>   bitbake-hashclient: Add remove subcommand
>   hashserv: tests: Add external database tests
>   hashserv: Add websocket connection implementation
> 
>  bitbake/bin/bitbake-hashclient    |  13 +++
>  bitbake/lib/bb/asyncrpc/client.py | 173 ++++++++++++++++++++----------
>  bitbake/lib/hashserv/__init__.py  |   9 ++
>  bitbake/lib/hashserv/client.py    |  30 +++---
>  bitbake/lib/hashserv/server.py    |  29 +++++
>  bitbake/lib/hashserv/tests.py     |  82 ++++++++++++--
>  bitbake/lib/prserv/client.py      |   8 +-
>  7 files changed, 262 insertions(+), 82 deletions(-)
> 
> -- 
> 2.34.1
> 

> 
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#15142): https://lists.openembedded.org/g/bitbake-devel/message/15142
> Mute This Topic: https://lists.openembedded.org/mt/101641857/3617179
> Group Owner: bitbake-devel+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/bitbake-devel/unsub [alexandre.belloni@bootlin.com]
> -=-=-=-=-=-=-=-=-=-=-=-
> 


-- 
Alexandre Belloni, co-owner and COO, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com


  parent reply	other threads:[~2023-09-29  6:33 UTC|newest]

Thread overview: 138+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2023-09-28 17:05 [bitbake-devel][RFC 0/5] Bitbake Hash Server WebSockets Implementation Joshua Watt
2023-09-28 17:05 ` [bitbake-devel][RFC 1/5] asyncrpc: Abstract client socket Joshua Watt
2023-09-28 17:05 ` [bitbake-devel][RFC 2/5] hashserv: Add remove API Joshua Watt
2023-09-28 17:05 ` [bitbake-devel][RFC 3/5] bitbake-hashclient: Add remove subcommand Joshua Watt
2023-09-28 17:05 ` [bitbake-devel][RFC 4/5] hashserv: tests: Add external database tests Joshua Watt
2023-09-28 17:05 ` [bitbake-devel][RFC 5/5] hashserv: Add websocket connection implementation Joshua Watt
2023-09-29  6:33 ` Alexandre Belloni [this message]
2023-10-03 14:52 ` [bitbake-devel][RFC v2 00/12] Bitbake Hash Server WebSockets and Alternate Database Backend Joshua Watt
2023-10-03 14:52   ` [bitbake-devel][RFC v2 01/12] asyncrpc: Abstract sockets Joshua Watt
2023-10-03 14:52   ` [bitbake-devel][RFC v2 02/12] hashserv: Add remove API Joshua Watt
2023-10-03 14:52   ` [bitbake-devel][RFC v2 03/12] bitbake-hashclient: Add remove subcommand Joshua Watt
2023-10-03 14:52   ` [bitbake-devel][RFC v2 04/12] hashserv: Add websocket connection implementation Joshua Watt
2023-10-03 14:52   ` [bitbake-devel][RFC v2 05/12] asyncrpc: Add context manager API Joshua Watt
2023-10-03 14:52   ` [bitbake-devel][RFC v2 06/12] hashserv: tests: Add external database tests Joshua Watt
2023-10-03 14:52   ` [bitbake-devel][RFC v2 07/12] asyncrpc: Prefix log messages with client info Joshua Watt
2023-10-03 14:52   ` [bitbake-devel][RFC v2 08/12] bitbake-hashserv: Allow arguments from environment Joshua Watt
2023-10-03 14:52   ` [bitbake-devel][RFC v2 09/12] hashserv: Abstract database Joshua Watt
2023-10-03 14:52   ` [bitbake-devel][RFC v2 10/12] hashserv: Add SQLalchemy backend Joshua Watt
2023-10-03 14:52   ` [bitbake-devel][RFC v2 11/12] contrib: Update hashserv Dockerfile Joshua Watt
2023-10-03 14:52   ` [bitbake-devel][RFC v2 12/12] contrib: hashserv: Add docker-compose Joshua Watt
2023-10-12 22:16   ` [bitbake-devel][RFC v2 00/18] Bitbake Hash Server WebSockets, Alternate Database Backend, and User Management Joshua Watt
2023-10-12 22:16     ` [bitbake-devel][RFC v2 01/18] asyncrpc: Abstract sockets Joshua Watt
2023-10-17  9:06       ` [RFC v2 11/18] hashserv: Implement read-only version of "report" Karim Ben Houcine
2023-10-12 22:16     ` [bitbake-devel][RFC v2 02/18] hashserv: Add websocket connection implementation Joshua Watt
2023-10-12 22:16     ` [bitbake-devel][RFC v2 03/18] asyncrpc: Add context manager API Joshua Watt
2023-10-12 22:16     ` [bitbake-devel][RFC v2 04/18] hashserv: tests: Add external database tests Joshua Watt
2023-10-12 22:16     ` [bitbake-devel][RFC v2 05/18] asyncrpc: Prefix log messages with client info Joshua Watt
2023-10-12 22:16     ` [bitbake-devel][RFC v2 06/18] bitbake-hashserv: Allow arguments from environment Joshua Watt
2023-10-12 22:16     ` [bitbake-devel][RFC v2 07/18] hashserv: Abstract database Joshua Watt
2023-10-12 22:16     ` [bitbake-devel][RFC v2 08/18] hashserv: Add SQLalchemy backend Joshua Watt
2023-10-12 22:16     ` [bitbake-devel][RFC v2 09/18] contrib: Update hashserv Dockerfile Joshua Watt
2023-10-12 22:16     ` [bitbake-devel][RFC v2 10/18] contrib: hashserv: Add docker-compose Joshua Watt
2023-10-12 22:16     ` [bitbake-devel][RFC v2 11/18] hashserv: Implement read-only version of "report" RPC Joshua Watt
2023-10-12 22:16     ` [bitbake-devel][RFC v2 12/18] asyncrpc: Add InvokeError Joshua Watt
2023-10-12 22:16     ` [bitbake-devel][RFC v2 13/18] asyncrpc: client: Prevent double closing of loop Joshua Watt
2023-10-12 22:16     ` [bitbake-devel][RFC v2 14/18] asyncrpc: client: Add disconnect API Joshua Watt
2023-10-12 22:16     ` [bitbake-devel][RFC v2 15/18] hashserv: Add user permissions Joshua Watt
2023-10-12 22:16     ` [bitbake-devel][RFC v2 16/18] hashserv: Add become-user API Joshua Watt
2023-10-12 22:16     ` [bitbake-devel][RFC v2 17/18] hashserv: Add db-usage API Joshua Watt
2023-10-12 22:16     ` [bitbake-devel][RFC v2 18/18] hashserv: Add database column query API Joshua Watt
2023-10-30 19:17     ` [bitbake-devel][PATCH v3 00/22] Bitbake Hash Server WebSockets, Alternate Database Backend, and User Management Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 01/22] asyncrpc: Abstract sockets Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 02/22] hashserv: Add websocket connection implementation Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 03/22] asyncrpc: Add context manager API Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 04/22] hashserv: tests: Add external database tests Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 05/22] asyncrpc: Prefix log messages with client info Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 06/22] bitbake-hashserv: Allow arguments from environment Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 07/22] hashserv: Abstract database Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 08/22] hashserv: Add SQLalchemy backend Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 09/22] hashserv: Implement read-only version of "report" RPC Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 10/22] asyncrpc: Add InvokeError Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 11/22] asyncrpc: client: Prevent double closing of loop Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 12/22] asyncrpc: client: Add disconnect API Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 13/22] hashserv: Add user permissions Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 14/22] hashserv: Add become-user API Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 15/22] hashserv: Add db-usage API Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 16/22] hashserv: Add database column query API Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 17/22] hashserv: test: Add bitbake-hashclient tests Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 18/22] bitbake-hashclient: Output stats in JSON format Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 19/22] bitbake-hashserver: Allow anonymous permissions to be space separated Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 20/22] hashserv: tests: Allow authentication for external server tests Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 21/22] hashserv: Allow self-service deletion Joshua Watt
2023-10-30 19:17       ` [bitbake-devel][PATCH v3 22/22] hashserv: server: Add owner if user is logged in Joshua Watt
2023-10-31 17:21       ` [bitbake-devel][PATCH v4 00/22] Bitbake Hash Server WebSockets, Alternate Database Backend, and User Management Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 01/22] asyncrpc: Abstract sockets Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 02/22] hashserv: Add websocket connection implementation Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 03/22] asyncrpc: Add context manager API Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 04/22] hashserv: tests: Add external database tests Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 05/22] asyncrpc: Prefix log messages with client info Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 06/22] bitbake-hashserv: Allow arguments from environment Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 07/22] hashserv: Abstract database Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 08/22] hashserv: Add SQLalchemy backend Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 09/22] hashserv: Implement read-only version of "report" RPC Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 10/22] asyncrpc: Add InvokeError Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 11/22] asyncrpc: client: Prevent double closing of loop Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 12/22] asyncrpc: client: Add disconnect API Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 13/22] hashserv: Add user permissions Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 14/22] hashserv: Add become-user API Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 15/22] hashserv: Add db-usage API Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 16/22] hashserv: Add database column query API Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 17/22] hashserv: test: Add bitbake-hashclient tests Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 18/22] bitbake-hashclient: Output stats in JSON format Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 19/22] bitbake-hashserver: Allow anonymous permissions to be space separated Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 20/22] hashserv: tests: Allow authentication for external server tests Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 21/22] hashserv: Allow self-service deletion Joshua Watt
2023-10-31 17:21         ` [bitbake-devel][PATCH v4 22/22] hashserv: server: Add owner if user is logged in Joshua Watt
2023-11-01 13:17         ` [bitbake-devel][PATCH v4 00/22] Bitbake Hash Server WebSockets, Alternate Database Backend, and User Management Alexandre Belloni
2023-11-01 13:29           ` Alexandre Belloni
2023-11-01 15:41         ` [bitbake-devel][PATCH v5 " Joshua Watt
2023-11-01 15:41           ` [bitbake-devel][PATCH v5 01/22] asyncrpc: Abstract sockets Joshua Watt
2023-11-01 15:41           ` [bitbake-devel][PATCH v5 02/22] hashserv: Add websocket connection implementation Joshua Watt
2023-11-01 15:41           ` [bitbake-devel][PATCH v5 03/22] asyncrpc: Add context manager API Joshua Watt
2023-11-01 15:41           ` [bitbake-devel][PATCH v5 04/22] hashserv: tests: Add external database tests Joshua Watt
2023-11-01 15:41           ` [bitbake-devel][PATCH v5 05/22] asyncrpc: Prefix log messages with client info Joshua Watt
2023-11-01 15:42           ` [bitbake-devel][PATCH v5 06/22] bitbake-hashserv: Allow arguments from environment Joshua Watt
2023-11-01 15:42           ` [bitbake-devel][PATCH v5 07/22] hashserv: Abstract database Joshua Watt
2023-11-01 15:42           ` [bitbake-devel][PATCH v5 08/22] hashserv: Add SQLalchemy backend Joshua Watt
2023-11-01 15:42           ` [bitbake-devel][PATCH v5 09/22] hashserv: Implement read-only version of "report" RPC Joshua Watt
2023-11-01 15:42           ` [bitbake-devel][PATCH v5 10/22] asyncrpc: Add InvokeError Joshua Watt
2023-11-01 15:42           ` [bitbake-devel][PATCH v5 11/22] asyncrpc: client: Prevent double closing of loop Joshua Watt
2023-11-01 15:42           ` [bitbake-devel][PATCH v5 12/22] asyncrpc: client: Add disconnect API Joshua Watt
2023-11-01 15:42           ` [bitbake-devel][PATCH v5 13/22] hashserv: Add user permissions Joshua Watt
2023-11-01 15:42           ` [bitbake-devel][PATCH v5 14/22] hashserv: Add become-user API Joshua Watt
2023-11-01 15:42           ` [bitbake-devel][PATCH v5 15/22] hashserv: Add db-usage API Joshua Watt
2023-11-01 15:42           ` [bitbake-devel][PATCH v5 16/22] hashserv: Add database column query API Joshua Watt
2023-11-01 15:42           ` [bitbake-devel][PATCH v5 17/22] hashserv: test: Add bitbake-hashclient tests Joshua Watt
2023-11-01 15:42           ` [bitbake-devel][PATCH v5 18/22] bitbake-hashclient: Output stats in JSON format Joshua Watt
2023-11-01 15:42           ` [bitbake-devel][PATCH v5 19/22] bitbake-hashserver: Allow anonymous permissions to be space separated Joshua Watt
2023-11-01 15:42           ` [bitbake-devel][PATCH v5 20/22] hashserv: tests: Allow authentication for external server tests Joshua Watt
2023-11-01 15:42           ` [bitbake-devel][PATCH v5 21/22] hashserv: Allow self-service deletion Joshua Watt
2023-11-01 15:42           ` [bitbake-devel][PATCH v5 22/22] hashserv: server: Add owner if user is logged in Joshua Watt
2023-11-03 14:26         ` [bitbake-devel][PATCH v6 00/22] Bitbake Hash Server WebSockets, Alternate Database Backend, and User Management Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 01/22] asyncrpc: Abstract sockets Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 02/22] hashserv: Add websocket connection implementation Joshua Watt
2023-11-10 12:03             ` Matthias Schnelte
2023-11-10 14:11               ` Joshua Watt
2023-11-15  7:44                 ` Matthias Schnelte
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 03/22] asyncrpc: Add context manager API Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 04/22] hashserv: tests: Add external database tests Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 05/22] asyncrpc: Prefix log messages with client info Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 06/22] bitbake-hashserv: Allow arguments from environment Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 07/22] hashserv: Abstract database Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 08/22] hashserv: Add SQLalchemy backend Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 09/22] hashserv: Implement read-only version of "report" RPC Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 10/22] asyncrpc: Add InvokeError Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 11/22] asyncrpc: client: Prevent double closing of loop Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 12/22] asyncrpc: client: Add disconnect API Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 13/22] hashserv: Add user permissions Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 14/22] hashserv: Add become-user API Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 15/22] hashserv: Add db-usage API Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 16/22] hashserv: Add database column query API Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 17/22] hashserv: test: Add bitbake-hashclient tests Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 18/22] bitbake-hashclient: Output stats in JSON format Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 19/22] bitbake-hashserver: Allow anonymous permissions to be space separated Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 20/22] hashserv: tests: Allow authentication for external server tests Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 21/22] hashserv: Allow self-service deletion Joshua Watt
2023-11-03 14:26           ` [bitbake-devel][PATCH v6 22/22] hashserv: server: Add owner if user is logged in Joshua Watt
2023-11-09 10:23           ` [bitbake-devel][PATCH v6 00/22] Bitbake Hash Server WebSockets, Alternate Database Backend, and User Management Alexandre Belloni

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20230929063336632d758d@mail.local \
    --to=alexandre.belloni@bootlin.com \
    --cc=JPEWhacker@gmail.com \
    --cc=bitbake-devel@lists.openembedded.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox