From: "Alex Bennée" <alex.bennee@linaro.org>
To: Peter Maydell <peter.maydell@linaro.org>
Cc: "Philippe Mathieu-Daudé" <philmd@linaro.org>,
qemu-devel@nongnu.org, "Cleber Rosa" <crosa@redhat.com>,
"John Snow" <jsnow@redhat.com>,
"Daniel P. Berrangé" <berrange@redhat.com>,
"Alexander Graf" <graf@amazon.com>,
"Pedro Barbuda" <pbarbuda@microsoft.com>,
"Mohamed Mediouni" <mohamed@unpredictable.fr>,
"Reinoud Zandijk" <reinoud@netbsd.org>,
"Magnus Kulke" <magnuskulke@linux.microsoft.com>,
"Doru Blânzeanu" <dblanzeanu@linux.microsoft.com>,
"Wei Liu" <wei.liu@kernel.org>, "Paul Durrant" <paul@xen.org>,
"Anthony PERARD" <anthony@xenproject.org>,
"Stefano Stabellini" <sstabellini@kernel.org>,
"Roman Bolshakov" <rbolshakov@ddn.com>,
"Phil Dennis-Jordan" <phil@philjordan.eu>
Subject: Re: [RFC PATCH v3 01/11] AGENTS.md: introduce a very basic guide for AI agents
Date: Mon, 18 May 2026 10:59:19 +0100 [thread overview]
Message-ID: <87v7cl6nt4.fsf@draig.linaro.org> (raw)
In-Reply-To: <CAFEAcA-DS3k-7SEFMASa4ncpuZmX07A2n66quSEG4R_VYq+AHg@mail.gmail.com> (Peter Maydell's message of "Mon, 18 May 2026 09:47:48 +0100")
Peter Maydell <peter.maydell@linaro.org> writes:
> On Sat, 16 May 2026 at 11:09, Philippe Mathieu-Daudé <philmd@linaro.org> wrote:
>>
>> On 15/5/26 18:30, Alex Bennée wrote:
>> > AGENTS.md is the agent agnostic place for placing instructions for
>> > agents. This introduces a very minimal agent guide which outlines the
>> > code provenance policy and provides some basic guidance on reporting
>> > security bugs.
>> >
>> > As Gemini doesn't look at AGENTS.md even as a fallback option I've
>> > included a symlink.
>> >
>> > Signed-off-by: Alex Bennée <alex.bennee@linaro.org>
>
>> > +## Security Policy (see `docs/system/security.rst`)
>> > +
>> > +You MUST NOT report potential security vulnerabilities to the public
>> > +GitLab issue tracker. They should be reported privately to
>> > +`qemu-security@nongnu.org`.
>> > +
>> > +**Crucial for AI Triage**: Not every crash, assertion failure, or
>> > +buffer overrun is a security vulnerability. Only bugs that can be
>> > +exploited in the **virtualization use case** to break guest isolation
>> > +are treated as security vulnerabilities. In brief these are:
>> > +- **Hardware Accelerators**: e.g. KVM, HVF and others, TCG is explicitly excluded.
>>
>> HVF isn't withing security boundary:
>> https://lore.kernel.org/qemu-devel/abAcaahy_FsBonZ7@redhat.com/
>>
>> For the "other accelerators" we should ask confirmation for respective
>> maintainers. AFAICT only KVM and Xen are expected to be secure;
>> MSHV, WHPX, nvmm and nitro didn't opted in yet (Cc'ing respective
>> maintainers).
>>
>> Wouldn't it be better to have a document describing the security code
>> boundary and have the AGENT.md refer to it?
>
> We do have such a document:
> https://qemu-project.gitlab.io/qemu/system/security.html
> and the AGENTS.md does tell the LLM about it.
>
> It puts all the virtualization accelerators within the
> security use case boundary. Personally I think this is
> reasonable -- the main reasons for having TCG outside it are
> (1) the TCG emulation itself is a lot of code and
> (2) it is a convenient way to rule out an enormous amount
> of old board and device model code in one go.
> This applies much less to the hvf, whpx, etc cases as they are
> using almost exactly the same board/device/core code as KVM.
>
> The idea as I understand it here is that by giving a very
> brief summary of the other document you make sure that the
> important parts we want to emphasize are in the agent's context
> and clearly stated. But I'm no expert on how to craft these
> files...
Yeah compared to normal programming its a bit imprecise - almost like
natural language is full of ambiguity and ad-hoc grammar ;-)
There is essentially a trade off about how many tokens you commit to the
permanent context (system prompt + agents.md + list of skills/rules) so the
agent will load stuff when needed but you don't pay an excessive token
cost for every query. Also while the frontier models have quite large
context windows (200K to 1M tokens) the local open weight models often
have much smaller windows so you need some free for the actual query and
response.
I did "test" this by asking the model how it would route a bunch of
theoretical vulnerabilities and it generally reasoned and "did" the
right thing.
Some of the TUI tools (Claude Code for example) have skill creators that
include evaluations which are then run with and without the additional
context. Another LLM then evaluates the response and scores the response
to give some sort of qualitative indication on if the additional context
is useful. However the workflow for these evaluations is currently tied
to specific providers and I don't think we want to favour one over
another.
However going through this process was one reason I didn't include a git
skill because it doesn't add much, the base models generally already
know how to drive git pretty well. In the end I've just added (to my
local config):
When applying patches you should assume the user is happy building on top of the current branch.
You MUST always ask the user (using the eca__ask_user tool) before changing branches or resetting the git tree state.
to encode my local workflow in the agent and not bothered with any more
details on how to drive git. The same is true for the code explorer
which drops all the gtags and git-grep stuff as having the semcode MCP
provides a much richer set of tools for exploring the code. Instead it
now just focuses on the QEMU specific idiosyncrasies of how our code is
organised.
>
> thanks
> -- PMM
--
Alex Bennée
Virtualisation Tech Lead @ Linaro
next prev parent reply other threads:[~2026-05-18 10:00 UTC|newest]
Thread overview: 22+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-05-15 16:30 [RFC PATCH v3 00/11] AGENTS.md and associated skills Alex Bennée
2026-05-15 16:30 ` [RFC PATCH v3 01/11] AGENTS.md: introduce a very basic guide for AI agents Alex Bennée
2026-05-16 10:08 ` Philippe Mathieu-Daudé
2026-05-16 10:20 ` Mohamed Mediouni
2026-05-16 16:44 ` Philippe Mathieu-Daudé
2026-05-17 21:11 ` Demi Marie Obenour
2026-05-17 21:13 ` Demi Marie Obenour
2026-05-18 6:17 ` Philippe Mathieu-Daudé
2026-05-18 8:30 ` Alex Bennée
2026-05-18 8:47 ` Peter Maydell
2026-05-18 9:59 ` Alex Bennée [this message]
2026-05-20 13:51 ` Chao Liu
2026-05-15 16:30 ` [RFC PATCH v3 02/11] AGENTS.md: expand with information on skills, layout and style Alex Bennée
2026-05-15 16:30 ` [RFC PATCH v3 03/11] scripts/expand-macro.py: helper script exploding macros Alex Bennée
2026-05-15 16:30 ` [RFC PATCH v3 04/11] .agents/skills: add qemu-code-explorer skill Alex Bennée
2026-05-15 16:30 ` [RFC PATCH v3 05/11] .agents/skills: add qemu-build skill Alex Bennée
2026-05-15 16:30 ` [RFC PATCH v3 06/11] .agents/skills: add qemu-testing skill Alex Bennée
2026-05-15 16:30 ` [RFC PATCH v3 07/11] .agents/skills: add qemu-code-reviewer skill Alex Bennée
2026-05-15 16:30 ` [RFC PATCH v3 08/11] .agents/skills: add qemu-mail-thread skill Alex Bennée
2026-05-15 16:30 ` [RFC PATCH v3 09/11] .agents/skills: add qemu-issue-helper skill Alex Bennée
2026-05-15 16:30 ` [RFC PATCH v3 10/11] .agents/skills: add qemu-issue-triage agent skill Alex Bennée
2026-05-15 16:30 ` [RFC PATCH v3 11/11] MAINTAINERS: add a section for AI agents Alex Bennée
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=87v7cl6nt4.fsf@draig.linaro.org \
--to=alex.bennee@linaro.org \
--cc=anthony@xenproject.org \
--cc=berrange@redhat.com \
--cc=crosa@redhat.com \
--cc=dblanzeanu@linux.microsoft.com \
--cc=graf@amazon.com \
--cc=jsnow@redhat.com \
--cc=magnuskulke@linux.microsoft.com \
--cc=mohamed@unpredictable.fr \
--cc=paul@xen.org \
--cc=pbarbuda@microsoft.com \
--cc=peter.maydell@linaro.org \
--cc=phil@philjordan.eu \
--cc=philmd@linaro.org \
--cc=qemu-devel@nongnu.org \
--cc=rbolshakov@ddn.com \
--cc=reinoud@netbsd.org \
--cc=sstabellini@kernel.org \
--cc=wei.liu@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.