All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Daniel P. Berrangé" <berrange@redhat.com>
To: "Alex Bennée" <alex.bennee@linaro.org>
Cc: qemu-devel@nongnu.org, Paolo Bonzini <pbonzini@redhat.com>,
	Thomas Huth <thuth@redhat.com>
Subject: Re: [qemu-web PATCH] contribute: define clear limits on bug report volume
Date: Thu, 24 Sep 2026 16:29:53 +0100	[thread overview]
Message-ID: <arVB8e0Rzuiu6ZT7@redhat.com> (raw)
In-Reply-To: <877bkaznst.fsf@draig.linaro.org>

On Thu, Sep 24, 2026 at 04:12:02PM +0100, Alex Bennée wrote:
> Daniel P. Berrangé <berrange@redhat.com> writes:
> 
> > Recently QEMU has received a denial of service attack on
> > its bug tracker in the form of 120 reports in 10 minutes,
> > and now repeated by another reporter in the form of 50
> > reports in the same day.
> >
> > Prior to switching security disclosures to the bug tracker,
> > single reporters have submited 18, 22, and 114 bug reports.
> >
> > None of this is sustainable. It is an effective denial of
> > service attack on the project maintainers' time. Every bug
> > report is a TODO item added to someone's workload.
> >
> > It is time to put hard limits on how many bugs, discovered
> > with assitance of automated tools, we are willing to accept
> > in a givenm time frame.
> >
> > This patch proposal suggests
> >
> >  * No more than 5 bugs per week, per reporter
> >  * No more than 10 bugs are permitted to be open at any
> >    time, per reporter.
> >
> > This is explicitly scoped to bugs discovered with the assistance
> > of automated tools. Bugs where a human puts in exclusively
> > personal time / effort to discover a problem are not limited.
> >
> > Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
> > ---
> >  contribute/report-a-bug.md | 37 +++++++++++++++++++++++++++++++++++++
> >  1 file changed, 37 insertions(+)
> >
> > diff --git a/contribute/report-a-bug.md b/contribute/report-a-bug.md
> > index b506f9f..8fb7b0b 100644
> > --- a/contribute/report-a-bug.md
> > +++ b/contribute/report-a-bug.md
> > @@ -32,6 +32,43 @@ on GitLab, taking into account the following guidance.
> >    triage of their output to validate all findings and reproducer
> >    scenarios prior to submitting a bug report.
> >  
> > +* QEMU policy forbids the bulk filing of large numbers of
> > +  bug disclosures that were generated with automated tools
> > +  (AI/LLM, static analysis, fuzers). Such actions are not
> > +  a benefit to the project, placing an unsustainable burden
> > +  on maintainers.
> > +
> > +  * **No more than 5 bug/security reports, discovered
> > +    with assistance of automated tools, are permitted
> > +    to be filed per week, per reporter.**
> > +  * **No more than 10 bug/security reports, discovered
> > +    with assistance of automated tools are permitted
> > +    to be open at any time, per reporter.**
> > +  * Reporters must refrain from filing any reports
> > +    that would cause these thresholds to be exceeded
> > +    without first obtaining explicit prior permission
> > +    from project maintainers.
> > +  * Reporters are **required** to respond to triage
> > +    comments from maintainers on bugs related to
> > +    automated tools on a timely basis.
> > +  * If at any time, the project maintainers request
> > +    the reporter to stop filing bug reports discovered
> > +    with assistance of automated tools, this must be
> > +    honoured.
> > +
> > +  Ignoring any of the above rules may lead to the bugs being
> > +  mass closed without further triage, even if valid reports.
> > +  In cases where the filing limits are grossly exceeded,
> > +  the reporter's GitLab account may be reported for abuse
> > +  (spam), potentially leading to termination.
> > +
> > +  If intending to file large numbers of bug disclosures
> > +  in aggregate, reporters are expected to invest their
> > +  time in writing patches, providing the patches for
> > +  review, and then further responding to feedback and
> > +  iterating on the patches until a maintainer accepts
> > +  them for it.
> > +
> >  * Reproduce the problem directly with a QEMU command-line. Avoid
> >    frontends and management stacks, to ensure that the bug is in
> >    QEMU itself and not in a frontend and make it easier for
> 
> It comes across as quite a draconian limit but to be honest after a 6
> months of dealing with this flood I'm less inclined to be polite about
> it:

Yes it is draconian.  Aside from the periodic "mass filing"
incidents, what prompted me is seeing the graph you produced
at:

https://www.qemu.org/screenshots/2026-09-culm-issues.svg

We see the increasing gap between open & closed bugs from
March, where we failed to keep up with the flow arriving
on qemu-security@nongnu.org

In July we bulk imported the mails to gitlab, and between
many maintainers we resolved alot over a month. After that
first month though, we reverted to the widening gap, at
the same rate we saw when triage was limited to just
qemu-security@nongnu.org

My reading of that is that even opening up triage to all
QEMU maintainers has not fixed our scaling problem. We
already burnt people out from dealing with these reports
from automated tools.


Ideally I would like reporters to put in more personal effort
beyond the initial bug filing. If they do that then bugs might
get through triage and patch review more effectively and get
closed quicker, allowing filing of more reports.

If reporters put in that more sustained patch curation effort
instead of fire-and-forget, then I expect they wouldn't have
time for filing so many bugs to begin with, making the limit
less of a problem.

Also if they're putting in greater effort, I'd be amenable to
granting them an exception to exceed the limits on bug filing.
IMHO any regular maintainers are implicitly exempt from the
limits given their ongoing beneficial work for the project.

IOW, the bug limit should be a problem primarily for people
working on a "file-and-forget" basis.


Still, I welcome suggestions for other ideas, or if we should
have different limits in some level ? 


With regards,
Daniel
-- 
|: https://berrange.com       ~~        https://hachyderm.io/@berrange :|
|: https://libvirt.org          ~~          https://entangle-photo.org :|
|: https://pixelfed.art/berrange   ~~    https://fstop138.berrange.com :|



  reply	other threads:[~2026-09-24 15:30 UTC|newest]

Thread overview: 10+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-09-24 13:56 [qemu-web PATCH] contribute: define clear limits on bug report volume Daniel P. Berrangé
2026-09-24 15:12 ` Alex Bennée
2026-09-24 15:29   ` Daniel P. Berrangé [this message]
2026-10-02 11:12     ` Markus Armbruster
2026-09-25  7:51 ` Thomas Huth
2026-09-25 16:08   ` Richard Henderson
2026-09-30  8:57     ` Thomas Huth
2026-10-02 10:46 ` Markus Armbruster
2026-10-02 10:57 ` Mark Cave-Ayland
2026-10-02 11:20   ` Markus Armbruster

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=arVB8e0Rzuiu6ZT7@redhat.com \
    --to=berrange@redhat.com \
    --cc=alex.bennee@linaro.org \
    --cc=pbonzini@redhat.com \
    --cc=qemu-devel@nongnu.org \
    --cc=thuth@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.