Re: [kernelci-members] Working with the KernelCI project

Dmitry Vyukov
2020-09-28T12:48:27Z

On Fri, Aug 21, 2020 at 12:10 PM Nikolai Kondrashov
<Nikolai.Kondrashov@redhat.com> wrote:
>
> Hi Dmitry,
>
> On 8/5/20 9:44 PM, Dmitry Vyukov wrote:
> > On Mon, Aug 3, 2020 at 11:25 AM Nikolai Kondrashov
> >> Did you have time to take a look at my mock-up? It probably looks like too
> >> much text, but please don't hesitate to reach me with any questions or
> >> suggestions you have as you look through it, if you haven't already.
> >>
> >> Please note that you don't have to start with sending all this data. In fact,
> >> only a few structural fields are required and we can start with the absolute
> >> minimum. The mock-up is showing what you *could* already send, but you don't
> >> have to go that far.
> >>
> >> I'd like to schedule a hacking session at Plumbers where we go and try to get
> >> some data out of participants' systems and into KCIDB. Would you be interested
> >> to attend, perhaps?
> >
> > Hi Nick,
> >
> > I've seen your reply and seen that you provided an example of how to
> > fill in the data. I was starred in my inbox, but I did not have time
> > to look at the details yet (we have somewhat crazy intern season). I
> > still want to do this.
>
> Glad to hear that, and I understand about the time.
>
> > I am not sure how a remote virtual hacking session is different from
> > just doing this normally and some email exchange :)
>
> I would say the low response latency helps move faster :)
>
> We could have a video call in background and/or share a screen or a tmate
> session, as we try to make things work. Even just having someone available in
> an IRC chat for quick responses helps, I'd say.
>
> Everyone has their own preferences, of course, I'm just offering to be there
> and discuss things and maybe work on something :)
>
> As I just wrote to Philip, I've finally published the schema introduction
> article:
>
> https://foundation.kernelci.org/blog/2020/08/21/introducing-common-reporting/
>
> Here's our talk, same MC as yours, but later:
>
> https://linuxplumbersconf.org/event/7/contributions/730/
>
> and the BoF session next day:
>
> https://linuxplumbersconf.org/event/7/contributions/731/
>
> Will be glad to meet you there, even though we won't be able to do
> much in the 45 minutes we were allocated.
>
> So please also drop by our "hallway chat", whenever you have time:
>
> https://chat.2020.linuxplumbersconf.org/channel/kcidb
>
> I'll be there every day of the conference, during Europe's working hours.

Hi Nikolai,

The examples are helpful. I think this should be doable. The ability
to send everything in a single request is handy, and since we don't
send bulky data (only links), should not cause any issues.

I need an API key, right? How are they distributed? Could you send me
one to my email privately?

However, we don't use any Python and use of kcidb-submit will be
problematic as the app is a Go App Engine app.
I looked what's the actual protocol and got to here:
https://github.com/kernelci/kcidb/blob/master/kcidb/mq/__init__.py#L69
and this "client" seems to come from google.cloud.pubsub.

Go has https://pkg.go.dev/cloud.google.com/go/pubsub package as well,
it would be much more practical for syzbot to use that directly. But
what exactly is the protocol? I assume it's that JSON, but is it
wrapped into some other layers? What's the topic name to publish? Is
there description/example on this level?

Also, how can I test things? Is there a test instance? Or if I push
something, can I observe it on the KernelCI dashboard or something?
What would be the procedure for deploying it on the syzbot side?

Thanks