public inbox for qemu-rust@nongnu.org
 help / color / mirror / Atom feed
From: "Daniel P. Berrangé" <berrange@redhat.com>
To: Markus Armbruster <armbru@redhat.com>
Cc: qemu-devel@nongnu.org,
	"Philippe Mathieu-Daudé" <philmd@linaro.org>,
	"Manos Pitsidianakis" <manos.pitsidianakis@linaro.org>,
	"Hanna Reitz" <hreitz@redhat.com>,
	"Gerd Hoffmann" <kraxel@redhat.com>,
	"Paolo Bonzini" <pbonzini@redhat.com>,
	"Christian Schoenebeck" <qemu_oss@crudebyte.com>,
	"Dr. David Alan Gilbert" <dave@treblig.org>,
	"Marc-André Lureau" <marcandre.lureau@redhat.com>,
	devel@lists.libvirt.org, qemu-block@nongnu.org,
	qemu-rust@nongnu.org, "Stefan Weil" <sw@weilnetz.de>,
	"Kevin Wolf" <kwolf@redhat.com>,
	"Richard Henderson" <richard.henderson@linaro.org>
Subject: Re: [PATCH v5 09/24] util: introduce some API docs for logging APIs
Date: Tue, 13 Jan 2026 10:49:01 +0000	[thread overview]
Message-ID: <aWYjHQYYeEqpnnQh@redhat.com> (raw)
In-Reply-To: <87ms2hal4a.fsf@pond.sub.org>

On Tue, Jan 13, 2026 at 10:59:49AM +0100, Markus Armbruster wrote:
> Daniel P. Berrangé <berrange@redhat.com> writes:
> 
> > There is a gotcha with qemu_log() usage in a threaded process.
> > If fragments of a log message are output via qemu_log() it is
> > possible for messages from two threads to get mixed up. To
> > prevent this qemu_log_trylock() should be used, along with
> > fprintf(f) calls.
> >
> > This is a subtle problem that needs to be explained in the
> > API docs to ensure correct usage.
> >
> > Reported-by: Markus Armbruster <armbru@redhat.com>
> > Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
> > ---
> >  include/qemu/log-for-trace.h | 17 ++++++++++++++++-
> >  include/qemu/log.h           | 31 +++++++++++++++++++++++++++++++
> >  rust/util/src/log.rs         |  6 ++++++
> >  3 files changed, 53 insertions(+), 1 deletion(-)
> >
> > diff --git a/include/qemu/log-for-trace.h b/include/qemu/log-for-trace.h
> > index f3a8791f1d..6861a1a4b7 100644
> > --- a/include/qemu/log-for-trace.h
> > +++ b/include/qemu/log-for-trace.h
> > @@ -29,7 +29,22 @@ static inline bool qemu_loglevel_mask(int mask)
> >      return (qemu_loglevel & mask) != 0;
> >  }
> >  
> > -/* main logging function */
> > +/**
> > + * qemu_log: report a log message
> > + * @fmt: the format string for the message
> > + * @...: the format string arguments
> > + *
> > + * This will emit a log message to the current output stream.
> > + *
> > + * The @fmt string should normally represent a complete line
> > + * of text, and thus end with a newline character.
> 
> Note for later: "should normally".
> 
> > + *
> > + * While it is possible to incrementally output fragments of
> > + * a complete line using qemu_log, this is inefficient and
> > + * races with other threads. For outputting fragments it is
> > + * strongly preferred to use the qemu_log_trylock() method
> > + * combined with fprintf().
> > + */
> >  void G_GNUC_PRINTF(1, 2) qemu_log(const char *fmt, ...);
> >  
> >  #endif
> > diff --git a/include/qemu/log.h b/include/qemu/log.h
> > index 7effba4da4..e9d3c6806b 100644
> > --- a/include/qemu/log.h
> > +++ b/include/qemu/log.h
> > @@ -41,7 +41,38 @@ bool qemu_log_separate(void);
> >  
> >  /* Lock/unlock output. */
> >  
> > +/**
> > + * Acquires a lock on the current log output stream.
> > + * The returned FILE object should be used with the
> > + * fprintf() function to output the log message, and
> > + * then qemu_log_unlock() called to release the lock.
> > + *
> > + * The primary use case is to be able to incrementally
> > + * output fragments of a complete log message in an
> > + * efficient and race free manner.
> > + *
> > + * The simpler qemu_log() method must only be used
> > + * to output complete log messages.
> 
> "must".
> 
> > + *
> > + * A typical usage pattern would be
> > + *
> > + *    FILE *f = qemu_log_trylock()
> > + *
> > + *    fprintf(f, "Something ");
> > + *    fprintf(f, "Something ");
> > + *    fprintf(f, "Something ");
> > + *    fprintf(f, "The end\n");
> > + *
> > + *    qemu_log_unlock(f);
> > + *
> > + * Returns: the current FILE if available, NULL on error
> > + */
> >  FILE *qemu_log_trylock(void) G_GNUC_WARN_UNUSED_RESULT;
> > +
> > +/**
> > + * Releases the lock on the log output, previously
> > + * acquired by qemu_log_trylock().
> > + */
> >  void qemu_log_unlock(FILE *fd);
> >  
> >  /* Logging functions: */
> > diff --git a/rust/util/src/log.rs b/rust/util/src/log.rs
> > index 0a4bc4249a..6a3a30d8d8 100644
> > --- a/rust/util/src/log.rs
> > +++ b/rust/util/src/log.rs
> > @@ -134,6 +134,12 @@ fn drop(&mut self) {
> >  ///     "Address 0x{:x} out of range",
> >  ///     error_address,
> >  /// );
> > +///
> > +/// The `log_mask_ln` macro should only be used for emitting complete
> 
> "should only".
> 
> > +/// log messages. Where it is required to incrementally output string
> > +/// fragments to construct a complete message, `LogGuard::new()` should
> > +/// be directly used in combination with `writeln()` to avoid output
> > +/// races with other QEMU threads.
> >  /// ```
> >  #[macro_export]
> >  macro_rules! log_mask_ln {
> 
> "Should normally" suggests there are exceptions.
> 
> "Should only" does not.
> 
> "Must" is a bit stronger still.
> 
> Which of the three do we want?

The "Should" usage was reflecting the reality that we have quite alot
of code using qemu_log_trylock + qemu_log, instead of qemu_log_trylock
+ fprintf.

I didn't feel it appropriate to use 'must' unless we explicitly make
qemu_log() fail when used inside the scope of a qemu_log_trylock().

So "Should normally" is the best fit

With regards,
Daniel
-- 
|: https://berrange.com      -o-    https://www.flickr.com/photos/dberrange :|
|: https://libvirt.org         -o-            https://fstop138.berrange.com :|
|: https://entangle-photo.org    -o-    https://www.instagram.com/dberrange :|



  reply	other threads:[~2026-01-13 10:49 UTC|newest]

Thread overview: 72+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-01-08 17:03 [PATCH v5 00/24] util: sync error_report & qemu_log output more closely Daniel P. Berrangé
2026-01-08 17:03 ` [PATCH v5 01/24] qemu-options: remove extraneous [] around arg values Daniel P. Berrangé
2026-01-13  7:47   ` Markus Armbruster
2026-01-08 17:03 ` [PATCH v5 02/24] include: define constant for early constructor priority Daniel P. Berrangé
2026-01-09 11:39   ` Paolo Bonzini
2026-01-09 11:46     ` Daniel P. Berrangé
2026-01-09 12:09       ` Paolo Bonzini
2026-01-13  9:04         ` Markus Armbruster
2026-01-13  9:32           ` Paolo Bonzini
2026-01-14 11:20             ` Daniel P. Berrangé
2026-01-08 17:03 ` [PATCH v5 03/24] monitor: initialize global data from a constructor Daniel P. Berrangé
2026-01-08 17:03 ` [PATCH v5 04/24] system: unconditionally enable thread naming Daniel P. Berrangé
2026-01-08 17:03 ` [PATCH v5 05/24] util: expose qemu_thread_set_name Daniel P. Berrangé
2026-01-13  9:16   ` Markus Armbruster
2026-01-13 10:41     ` Daniel P. Berrangé
2026-02-10 17:13     ` Daniel P. Berrangé
2026-02-11  5:56       ` Markus Armbruster
2026-01-08 17:03 ` [PATCH v5 06/24] audio: make jackaudio use qemu_thread_set_name Daniel P. Berrangé
2026-01-08 17:03 ` [PATCH v5 07/24] util: set the name for the 'main' thread Daniel P. Berrangé
2026-01-09 11:45   ` Paolo Bonzini
2026-01-09 11:52     ` Daniel P. Berrangé
2026-01-09 12:04       ` Paolo Bonzini
2026-01-08 17:03 ` [PATCH v5 08/24] util: add API to fetch the current thread name Daniel P. Berrangé
2026-01-09 11:49   ` Paolo Bonzini
2026-01-09 11:56     ` Daniel P. Berrangé
2026-01-09 12:11       ` Paolo Bonzini
2026-01-13  9:27   ` Markus Armbruster
2026-01-13 10:00     ` Daniel P. Berrangé
2026-01-13 13:00       ` Markus Armbruster
2026-01-13 15:49         ` Paolo Bonzini
2026-01-14 11:28           ` Daniel P. Berrangé
2026-01-14 11:27         ` Daniel P. Berrangé
2026-01-08 17:03 ` [PATCH v5 09/24] util: introduce some API docs for logging APIs Daniel P. Berrangé
2026-01-13  9:59   ` Markus Armbruster
2026-01-13 10:49     ` Daniel P. Berrangé [this message]
2026-01-13 10:52       ` Daniel P. Berrangé
2026-01-13 13:04         ` Markus Armbruster
2026-01-08 17:03 ` [PATCH v5 10/24] util: avoid repeated prefix on incremental qemu_log calls Daniel P. Berrangé
2026-01-13 10:19   ` Markus Armbruster
2026-01-13 11:56     ` Daniel P. Berrangé
2026-01-08 17:03 ` [PATCH v5 11/24] ui/vnc: remove use of error_printf_unless_qmp() Daniel P. Berrangé
2026-01-13 13:11   ` Markus Armbruster
2026-01-13 14:44   ` Markus Armbruster
2026-01-08 17:03 ` [PATCH v5 12/24] monitor: remove redundant error_[v]printf_unless_qmp Daniel P. Berrangé
2026-01-08 17:03 ` [PATCH v5 13/24] monitor: refactor error_vprintf() Daniel P. Berrangé
2026-01-13 13:17   ` Markus Armbruster
2026-01-14 11:34   ` Markus Armbruster
2026-01-14 12:01     ` Daniel P. Berrangé
2026-01-08 17:03 ` [PATCH v5 14/24] monitor: move error_vprintf back to error-report.c Daniel P. Berrangé
2026-01-13 13:38   ` Markus Armbruster
2026-01-14 12:09     ` Daniel P. Berrangé
2026-01-14 13:13       ` Markus Armbruster
2026-01-08 17:03 ` [PATCH v5 15/24] monitor: introduce monitor_cur_is_hmp() helper Daniel P. Berrangé
2026-01-13 14:57   ` Markus Armbruster
2026-01-14 12:46     ` Daniel P. Berrangé
2026-01-08 17:03 ` [PATCH v5 16/24] util: don't skip error prefixes when QMP is active Daniel P. Berrangé
2026-01-11 22:25   ` Richard Henderson
2026-01-13 15:19   ` Markus Armbruster
2026-01-14 12:53   ` Markus Armbruster
2026-01-08 17:03 ` [PATCH v5 17/24] util: fix interleaving of error & trace output Daniel P. Berrangé
2026-01-11 22:28   ` Richard Henderson
2026-01-14 13:00   ` Markus Armbruster
2026-01-08 17:03 ` [PATCH v5 18/24] util: fix interleaving of error prefixes Daniel P. Berrangé
2026-01-14 14:00   ` Markus Armbruster
2026-01-08 17:03 ` [PATCH v5 19/24] util: introduce common helper for error-report & log code Daniel P. Berrangé
2026-01-08 17:03 ` [PATCH v5 20/24] util: convert error-report & log to message API for timestamp Daniel P. Berrangé
2026-01-08 17:03 ` [PATCH v5 21/24] util: add support for formatting a workload name in messages Daniel P. Berrangé
2026-01-08 17:03 ` [PATCH v5 22/24] util: add support for formatting a program " Daniel P. Berrangé
2026-01-11 22:31   ` Richard Henderson
2026-01-08 17:03 ` [PATCH v5 23/24] util: add support for formatting thread info " Daniel P. Berrangé
2026-01-11 22:32   ` Richard Henderson
2026-01-08 17:03 ` [PATCH v5 24/24] util: add brackets around guest name in message context Daniel P. Berrangé

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=aWYjHQYYeEqpnnQh@redhat.com \
    --to=berrange@redhat.com \
    --cc=armbru@redhat.com \
    --cc=dave@treblig.org \
    --cc=devel@lists.libvirt.org \
    --cc=hreitz@redhat.com \
    --cc=kraxel@redhat.com \
    --cc=kwolf@redhat.com \
    --cc=manos.pitsidianakis@linaro.org \
    --cc=marcandre.lureau@redhat.com \
    --cc=pbonzini@redhat.com \
    --cc=philmd@linaro.org \
    --cc=qemu-block@nongnu.org \
    --cc=qemu-devel@nongnu.org \
    --cc=qemu-rust@nongnu.org \
    --cc=qemu_oss@crudebyte.com \
    --cc=richard.henderson@linaro.org \
    --cc=sw@weilnetz.de \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox