All of lore.kernel.org
 help / color / mirror / Atom feed
From: Sasha Levin <sashal@kernel.org>
To: Theodore Tso <tytso@mit.edu>
Cc: Linux Kernel Developers List <linux-kernel@vger.kernel.org>,
	Jonathan Corbet <corbet@lwn.net>
Subject: Re: How should we handle using AI for reviewing commits?
Date: Thu, 12 Mar 2026 12:57:25 -0400	[thread overview]
Message-ID: <abLwdassQDhAA_Re@laps> (raw)
In-Reply-To: <20260312164509.GB4689@macsyma-wired.lan>

On Thu, Mar 12, 2026 at 12:45:09PM -0400, Theodore Tso wrote:
>We recently used an AI review bot while applying an LTS backport to an
>internal kernel tree at $WORK.  While doing the review, it flagged a
>set of concerns which resulted in my creating a patch[1] to address
>the issues that it found in the kernel commit.
>
>[1] https://lore.kernel.org/all/20260310122806.1277631-1-tytso@mit.edu/
>
>In this commit there is no LLM generated output in the code, but there
>*is* LLM generated output in the commit description, since I quoted
>the concerns raised by the LLM.  Per the our new coding-assistants
>process document[2], "When AI tools contribute to kernel development,
>proper attribution helps track the evolving role of AI in the
>development process. Contributions should include an Assisted-by tag..."
>
>[2] https://www.kernel.org/doc/html/latest/process/coding-assistants.html
>
>When I was considering whether I should add something like:
>
>Assisted-by: Gemini:Gemini-3.1-Pro [TOOL]
>
>There was a couple of things that came to mind.  First, should we make
>some kind of distintion between exactly how the AI tool assisted in
>the development of the commit?  There's a big difference between using
>an AI assistant to find a potential issue, to an AI assistant which
>created new code out of whole cloth, with a spectrum of changes in
>between.  Given that the stated code was to "track the evolving role
>of AI", it occured to me that perhaps we should add some indication
>about exactly what was the nature of assistance that was provided.

Why not use Reported-by for these? We already use it for tools (like syzbot),
so this would just be a natural extension.

	Reported-by: Gemini:Gemini-3.1-Pro

>The second observation that I had was that example set of tools for
>[TOOL] was "specialized analysis tools": coccinelle, sparse, smatch,
>clang-tidy.  I assume the intent was if an AI bot started using tools
>like sparse, coccinelle, as an agent?w

Yup, both that as well as just space to list additional tools that the human
used too without adding multiple Assisted-by: lines.

>If there is a set of LLM prompts which has a name, would that also be
>appropriate for TOOL?  Chris Mason's repo has a fairly non-descriptive
>name, "review-prompts", but in the future when companies start making
>their internal review prompts public, some of them may have more
>evocative names that might be more unique and more marketing friendly.  :-)

Something like:

	Reported-by: Gemini:Gemini-3.1-Pro # https://example.com/my-magical-prompt

?

-- 
Thanks,
Sasha

      reply	other threads:[~2026-03-12 16:57 UTC|newest]

Thread overview: 2+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-03-12 16:45 How should we handle using AI for reviewing commits? Theodore Tso
2026-03-12 16:57 ` Sasha Levin [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=abLwdassQDhAA_Re@laps \
    --to=sashal@kernel.org \
    --cc=corbet@lwn.net \
    --cc=linux-kernel@vger.kernel.org \
    --cc=tytso@mit.edu \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.