linux-trace-kernel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Gabriele Monaco <gmonaco@redhat.com>
To: Nam Cao <namcao@linutronix.de>
Cc: linux-kernel@vger.kernel.org,
	Steven Rostedt <rostedt@goodmis.org>,
	 linux-trace-kernel@vger.kernel.org,
	Tomas Glozar <tglozar@redhat.com>, Juri Lelli <jlelli@redhat.com>,
	Clark Williams <williams@redhat.com>,
	John Kacur <jkacur@redhat.com>
Subject: Re: [RFC PATCH 10/17] verification/rvgen: Add support for Hybrid Automata
Date: Mon, 25 Aug 2025 16:24:13 +0200	[thread overview]
Message-ID: <6e84cdfe17492f31be8e4373fef7b3e1a37a6779.camel@redhat.com> (raw)
In-Reply-To: <20250825095554.NrT5tNY8@linutronix.de>

On Mon, 2025-08-25 at 11:55 +0200, Nam Cao wrote:
> On Thu, Aug 14, 2025 at 05:08:02PM +0200, Gabriele Monaco wrote:
> >                  for i in event.split("\\n"):
> > +                    if ";" in i:
> > +                        # if the event contains a constraint
> > (hybrid automata),
> > +                        # it will be separated by a ";":
> > +                        # "sched_switch;x<1000;reset(x)"
> > +                        line = i.split(";")
> > +                        i = line.pop(0)
> > +                        if len(line) > 2:
> > +                            raise ValueError("Only 1 constraint
> > and 1 reset are supported")
> > +                        envs += self.__extract_env_var(line)
> >                      events.append(i)
> 
> How about we get rid of the (if ";"), and just split it:
> 
> for i in event.split("\\n"):
>     # if the event contains a constraint (hybrid automata),
>     # it will be separated by a ";":
>     # "sched_switch;x<1000;reset(x)"
>     line = i.split(";")
>     events.append(line.pop(0))
>     if len(line) > 2:
>             raise ValueError("Only 1 constraint and 1 reset are
> supported")
>         envs += self.__extract_env_var(line)
> 

Right, that's neater, thanks.

> > +            else:
> > +                # state labels have the format:
> > +                # "enable_fired" [label =
> > "enable_fired\ncondition"];
> > +                #  ----- label is here -----^^^^^
> > +                # label and node name must be the same, condition
> > is optional
> > +                state =
> > self.__dot_lines[cursor].split("label")[1].split('"')[1]
> 
> I know I complained about regex last week, but for this case I think
> regex is more suitable:
> 
> state = re.findall(r'".*?" \[label = "([^"]*)"\]',
> self.__dot_lines[cursor])[0]
> 

Yeah I guess I opened the pandora box already..
Also thinking about the ply parser, it'd probably end up relying on
regex too.
I may just set up the things in this patch (use regex where too complex
without) and re-evaluate the whole things with ply later on.

> > +                if "\\n" in state:
> > +                    line = state.split("\\n")
> > +                    line.pop(0)
> > +                    if len(line) > 1:
> > +                        raise ValueError("Only 1 constraint is
> > supported in the state")
> > +                    envs +=
> > self.__extract_env_var([line[0].replace(" ", "")])
> 
> Same as above, I think we can just split without the if check.
> 
> >              cursor += 1
> >  
> > -        return sorted(set(events))
> > -
> > -    def __create_matrix(self):
> > +        return sorted(set(events)), sorted(set(envs))
> > +
> > +    def _split_constraint_expr(self, constr: list[str]) ->
> > Iterator[tuple[str,
> > +                                                                  
> >         str | None]]:
> > +        """
> > +        Get a list of strings of the type constr1 && constr2 and
> > returns a list of
> > +        constraints and separators:
> > [[constr1,"&&"],[constr2,None]]
> > +        """
> > +        exprs = []
> > +        seps = []
> > +        for c in constr:
> > +            while "&&" in c or "||" in c:
> > +                a = c.find("&&")
> > +                o = c.find("||")
> > +                pos = a if o < 0 or 0 < a < o else o
> > +                exprs.append(c[:pos].replace(" ", ""))
> > +                seps.append(c[pos:pos+2].replace(" ", ""))
> > +                c = c[pos+2:].replace(" ", "")
> > +            exprs.append(c)
> > +            seps.append(None)
> > +        return zip(exprs, seps)
> 
> If && and || are the only things you intend to support, then this is
> probably okay. But if the syntax will ever be extended (e.g.
> brackets),
> this becomes unreadable really fast.
> 
> Perhaps a "real" parser which converts the input string into abstract
> syntax tree is something worth considering.

Yeah totally, I'm going to stick to the "simple" syntax for now and
then rewrite the whole thing with a proper parser.

> 
> > +    def is_event_constraint(self, key: tuple[int, int] | int) ->
> > bool:
> > +        """
> > +        Given the key in self.constraints return true if it is an
> > event
> > +        constraint, false if it is a state constraint
> > +        """
> > +        return isinstance(key, tuple)
> 
> I don't love this. A few years from now, someone could change state
> constraint to be a tuple, or change event contraint to not be tuple,
> and things break in confusing ways.
> 
> Perhaps an explicit variable to store contraint type information
> instead?

Mmh good point, I'll look into that.

> 
> > -    def __get_enum_states_content(self):
> > +    def __get_enum_states_content(self) -> list[str]:
> >          buff = []
> >          buff.append("\t%s%s = 0," % (self.initial_state,
> > self.enum_suffix))
> >          for state in self.states:
> > @@ -36,7 +37,7 @@ class Dot2c(Automata):
> >  
> >          return buff
> >  
> > -    def format_states_enum(self):
> > +    def format_states_enum(self) -> list[str]:
> >          buff = []
> >          buff.append("enum %s {" % self.enum_states_def)
> >          buff += self.__get_enum_states_content()
> > @@ -58,7 +59,7 @@ class Dot2c(Automata):
> >  
> >          return buff
> >  
> > -    def format_events_enum(self):
> > +    def format_events_enum(self) -> list[str]:
> 
> These changes should be in your type annotation patch?

Right, probably coming from yet another rebase, having a look.

> 
> >          buff = []
> >          buff.append("enum %s {" % self.enum_events_def)
> >          buff += self.__get_enum_events_content()
> > @@ -66,7 +67,43 @@ class Dot2c(Automata):
> >  
> >          return buff
> >  
> > -    def get_minimun_type(self):
> > +    def __get_non_stored_envs(self) -> list[str]:
> > +        return [ e for e in self.envs if e not in self.env_stored
> > ]
> > +
> > +    def __get_enum_envs_content(self) -> list[str]:
> > +        buff = []
> > +        first = True
> > +        # We first place env variables that have a u64 storage.
> > +        # Those are limited by MAX_HA_ENV_LEN, other variables
> > +        # are read only and don't require a storage.
> > +        unstored = self.__get_non_stored_envs()
> > +        for env in list(self.env_stored) + unstored:
> > +            if first:
> > +                buff.append("\t%s%s = 0," % (env,
> > self.enum_suffix))
> > +                first = False
> > +            else:
> > +                buff.append("\t%s%s," % (env, self.enum_suffix))
> 
> The "= 0" assignment for the first enum is not required right?
> Perhaps you can get rid of the 'first" thingy, and just do
> 
> for env in list(self.env_stored) + unstored:
>     buff.append("\t%s%s," % (env, self.enum_suffix))
> 

Right, that's covered by the standard, we could just remove it.

> > +        match unit:
> > +            case "us":
> > +                value *= 1000
> > +            case "ms":
> > +                value *= 1000000
> > +            case "s":
> > +                value *= 1000000000
> 
> Since when did Python have this? Nice!

I think it was 3.10 . Honestly, it hasn't had it for way too long!

Thanks,
Gabriele

  reply	other threads:[~2025-08-25 14:24 UTC|newest]

Thread overview: 60+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2025-08-14 15:07 [RFC PATCH 00/17] rv: Add Hybrid Automata monitor type, per-object and deadline monitors Gabriele Monaco
2025-08-14 15:07 ` [RFC PATCH 01/17] rv: Refactor da_monitor to minimise macros Gabriele Monaco
2025-08-21  8:14   ` Nam Cao
2025-08-21  8:49     ` Gabriele Monaco
2025-08-25  8:02       ` Gabriele Monaco
2025-08-25  8:03       ` Nam Cao
2025-08-14 15:07 ` [RFC PATCH 02/17] rv: Cleanup da_monitor after refactor Gabriele Monaco
2025-08-14 15:07 ` [RFC PATCH 03/17] Documentation/rv: Adapt documentation after da_monitor refactoring Gabriele Monaco
2025-08-14 15:07 ` [RFC PATCH 04/17] verification/rvgen: Adapt dot2k and templates after refactoring da_monitor.h Gabriele Monaco
2025-08-14 15:07 ` [RFC PATCH 05/17] verification/rvgen: Annotate DA functions with types Gabriele Monaco
2025-08-21  8:29   ` Nam Cao
2025-08-21  8:51     ` Gabriele Monaco
2025-08-14 15:07 ` [RFC PATCH 06/17] verification/dot2c: Remove __buff_to_string() and cleanup Gabriele Monaco
2025-08-21  8:32   ` Nam Cao
2025-08-14 15:07 ` [RFC PATCH 07/17] verification/rvgen: Remove unused variable declaration from containers Gabriele Monaco
2025-08-21  8:33   ` Nam Cao
2025-08-14 15:08 ` [RFC PATCH 08/17] rv: Add Hybrid Automata monitor type Gabriele Monaco
2025-08-19  9:18   ` Juri Lelli
2025-08-19  9:48     ` Gabriele Monaco
2025-08-19 10:08       ` Juri Lelli
2025-08-19 10:53         ` Gabriele Monaco
2025-08-21 12:18   ` Nam Cao
2025-08-25  7:48     ` Gabriele Monaco
2025-08-25  8:13       ` Nam Cao
2025-08-25  8:32         ` Gabriele Monaco
2025-08-14 15:08 ` [RFC PATCH 09/17] verification/rvgen: Allow spaces in and events strings Gabriele Monaco
2025-08-21 12:22   ` Nam Cao
2025-08-21 13:22     ` Gabriele Monaco
2025-08-21 15:15       ` Nam Cao
2025-08-21 15:58         ` Gabriele Monaco
2025-08-14 15:08 ` [RFC PATCH 10/17] verification/rvgen: Add support for Hybrid Automata Gabriele Monaco
2025-08-21 12:38   ` Nam Cao
2025-08-21 13:15     ` Gabriele Monaco
2025-08-25  9:55   ` Nam Cao
2025-08-25 14:24     ` Gabriele Monaco [this message]
2025-08-25 10:06   ` Nam Cao
2025-08-25 14:02     ` Gabriele Monaco
2025-08-14 15:08 ` [RFC PATCH 11/17] Documentation/rv: Add documentation about hybrid automata Gabriele Monaco
2025-08-19  8:53   ` Juri Lelli
2025-08-19  9:14     ` Juri Lelli
2025-08-19 10:46       ` Gabriele Monaco
2025-08-19 10:40     ` Gabriele Monaco
2025-08-14 15:08 ` [RFC PATCH 12/17] rv: Add sample hybrid monitors stall Gabriele Monaco
2025-08-14 15:08 ` [RFC PATCH 13/17] rv: Convert the opid monitor to a hybrid automaton Gabriele Monaco
2025-09-02  9:28   ` Nam Cao
2025-08-14 15:08 ` [RFC PATCH 14/17] sched: Add deadline tracepoints Gabriele Monaco
2025-08-19  9:56   ` Juri Lelli
2025-08-19 10:12     ` Peter Zijlstra
2025-08-19 10:34       ` Gabriele Monaco
2025-08-19 14:02         ` Juri Lelli
2025-08-19 14:21           ` Gabriele Monaco
2025-08-19 14:38           ` Phil Auld
2025-08-20  5:20             ` Juri Lelli
2025-09-02 14:55           ` Juri Lelli
2025-08-14 15:08 ` [RFC PATCH 15/17] rv: Add support for per-object monitors in DA/HA Gabriele Monaco
2025-08-14 15:08 ` [RFC PATCH 16/17] verification/rvgen: Add support for per-obj monitors Gabriele Monaco
2025-09-04  8:20   ` Nam Cao
2025-09-04  8:39     ` Gabriele Monaco
2025-09-04  8:58       ` Nam Cao
2025-08-14 15:08 ` [RFC PATCH 17/17] rv: Add deadline monitors Gabriele Monaco

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=6e84cdfe17492f31be8e4373fef7b3e1a37a6779.camel@redhat.com \
    --to=gmonaco@redhat.com \
    --cc=jkacur@redhat.com \
    --cc=jlelli@redhat.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-trace-kernel@vger.kernel.org \
    --cc=namcao@linutronix.de \
    --cc=rostedt@goodmis.org \
    --cc=tglozar@redhat.com \
    --cc=williams@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).