All of lore.kernel.org
 help / color / mirror / Atom feed
* [PATCH v3 00/35] monitor: turn QMP and HMP into QOM objects
@ 2026-06-18 10:58 Daniel P. Berrangé
  2026-06-18 10:58 ` [PATCH v3 01/35] qom: replace 'can_be_deleted' with 'prepare_delete' Daniel P. Berrangé
                   ` (34 more replies)
  0 siblings, 35 replies; 43+ messages in thread
From: Daniel P. Berrangé @ 2026-06-18 10:58 UTC (permalink / raw)
  To: qemu-devel
  Cc: devel, Alex Bennée, Christian Brauner, Markus Armbruster,
	Marc-André Lureau, Dr. David Alan Gilbert, Paolo Bonzini,
	Philippe Mathieu-Daudé, Daniel P. Berrangé

Conceptually -object and object_add/object_del should be sufficient
for essentially all QEMU configuration....if only we ported all our
internal custom backends/devices/etc to QOM. That is of course a big
job which is why it hasn't happened.

This series started with the premise that the monitor is one of the
easier areas to convert since we have no more than three classes,
a common base, and QMP and HMP subclasses[1]. So why not give it a
go and thus unlock the ability to dynamically create/delete monitors
in QMP/HMP.

This series does the conversion in a great many small steps to better
understand the implications at each stage.

The high level outcome of this series is

 * HMP and QMP monitors are QOM objects, 'monitor-hmp' and
   'monitor-qmp' respectively

 * Both can be cold plugged and hot plugged. QMP only, can
   also be hot unplugged.

 * '-mon' is obsolete, deprecated and replaced by '-object',
   but -monitor, -qmp and kept  as high level syntax sugar

 * QMP gains a concept of "close-action" which makes it
   possible to mark a monitor for auto-delete.

The monitor hot-unplug code and the qtest and functional testing
code is heavily derived from a series sent by Christian Brauner
which proposed new monitor_add/monitor_del commands:

  https://lists.nongnu.org/archive/html/qemu-devel/2026-04/msg01349.html

I left Christian's authorship & SoB on the patches which were
derived from his code, though the code has been refactored quite
a bit in places, so bugs are quite possibly my own.

Note that Christian's series allowed the use of "monitor_del"
commands against the current monitor session. ie a client could
delete the very monitor it was using. This is an awkward concept
as it needs special casing to delay the deletion to happen in
the background, such that that the QMP response to 'monitor_del'
could still be sent back. This also left the chardev was orphaned
as there's no way to run 'chardev_dev' in that usage pattern.

To provide an alternative mechanism to address the same use case,
this series introduces the 'close-action' concept mentioned above,
that allows hotplugging a monitor to service a specific task,
with the monitor being purged when the script closes its connection.
This avoids the special casing that an explicit "self deletion"
paradigm required.

While supporting hotplug of HMP was trivial, I didn't do any work
to think about hotunplug of HMP, since IMHO it is of limited value
given HMP's typical use cases.

[1] ~~~ we did all this not because it was easy,
        but because we thought it would be easy ~~~

Changed in v3:

 - Removed unused 'dead' struct field
 - Make use of 'setup_pending' struct field across BH
 - Add missing free of chardev_id
 - Add missnig ERRP_GUARD in monitor_new_qmp
 - Misc docs typos / rephrasing
 - Moved docs patch to the end
 - Fixed docs about the default QOM ID naming for legacy
   monitor syntax
 - Fixed random sleep time calculation in tests

Christian Brauner (6):
  monitor: convert from oneshot BH to persistent BH
  monitor: reject attempts to delete the current monitor
  monitor: protect qemu_chr_fe_accept_input with monitor lock
  monitor: implement support for deleting QMP objects
  tests/qtest: add tests for dynamic monitor add/remove
  tests/functional: add e2e test for dynamic QMP monitor hotplug

Daniel P. Berrangé (29):
  qom: replace 'can_be_deleted' with 'prepare_delete'
  monitor: replace 'common' with 'parent_obj' in MonitorHMP
  monitor: replace 'common' with 'parent_obj' in MonitorQMP
  monitor: rename monitor_init* to monitor_new*
  monitor: minimal conversion of monitors to QOM
  monitor: add 'chardev' property to Monitor base class
  monitor: add 'readline' property to HMP Monitor class
  monitor: add 'pretty' property to QMP Monitor class
  monitor: remove 'skip_flush' field
  monitor: move monitor_data_(init|destroy) into QOM init/finalize
  monitor: use class methods for monitor_vprintf
  monitor: use class methods for monitor_qapi_event_emit
  monitor: use class methods for monitor_accept_input
  monitor: use class method for I/O thread request
  monitor: use dynamic cast in monitor_qmp_requests_pop_any_with_lock
  util: use dynamic cast in error vreport
  monitor: drop unused monitor_cur_is_qmp
  monitor: use dynamic cast in QMP commands
  monitor: use dynamic cast in monitor_is_hmp_non_interactive
  monitor: drop unused monitor_is_qmp method
  monitor: eliminate monitor_is_hmp_non_interactive method
  monitor: implement "user creatable" interface for adding monitors
  tests/functional: add a stress test for monitor hot unplug
  qom: add method for getting the "id" of a QOM object
  qom: add trace events for user creatable create/delete APIs
  monitor: add support for auto-deleting monitors upon close
  tests: switch from -mon to -object monitor-qmp
  qemu-options: document new monitor-hmp and monitor-qmp objects
  docs: mark '-mon' as deprecated in favour of -object

 MAINTAINERS                                   |   1 +
 backends/cryptodev.c                          |  10 +-
 backends/hostmem.c                            |   5 +-
 backends/iommufd.c                            |  10 +-
 block/throttle-groups.c                       |  10 +-
 chardev/char.c                                |   3 +-
 docs/about/deprecated.rst                     |  10 +
 docs/devel/writing-monitor-commands.rst       |   4 +-
 docs/system/arm/xenpvh.rst                    |   4 +-
 docs/system/i386/xen.rst                      |   3 +-
 docs/system/i386/xenpvh.rst                   |   4 +-
 event-loop-base.c                             |   8 +-
 gdbstub/system.c                              |   4 +-
 include/monitor/monitor.h                     |  23 +-
 include/qom/object.h                          |  10 +
 include/qom/object_interfaces.h               |  26 +-
 include/system/event-loop-base.h              |   2 +-
 migration/migration-hmp-cmds.c                |   5 +-
 monitor/hmp-cmds.c                            |   7 +-
 monitor/hmp.c                                 | 181 +++++++++--
 monitor/monitor-internal.h                    |  73 +++--
 monitor/monitor.c                             | 262 +++++++--------
 monitor/qmp-cmds-control.c                    |  12 +-
 monitor/qmp-cmds.c                            |  14 +-
 monitor/qmp.c                                 | 303 +++++++++++++++---
 net/can/can_core.c                            |   5 +-
 python/qemu/machine/machine.py                |   4 +-
 qapi/qom.json                                 |  62 ++++
 qemu-options.hx                               |  57 +++-
 qom/object.c                                  |  17 +
 qom/object_interfaces.c                       |  20 +-
 qom/trace-events                              |   5 +
 storage-daemon/qemu-storage-daemon.c          |   2 +-
 stubs/monitor-core.c                          |   5 -
 stubs/monitor-internal.c                      |   3 +-
 system/vl.c                                   |  12 +-
 tests/functional/generic/meson.build          |   1 +
 .../generic/test_monitor_hotplug.py           | 277 ++++++++++++++++
 tests/qemu-iotests/245                        |   4 +-
 tests/qtest/libqtest.c                        |   2 +-
 tests/qtest/qmp-test.c                        | 174 ++++++++++
 tests/unit/test-util-sockets.c                |   1 -
 tools/qemu-vnc/stubs.c                        |   5 -
 ui/ui-hmp-cmds.c                              |   2 +-
 util/error-report.c                           |  13 +-
 util/main-loop.c                              |   5 +-
 46 files changed, 1343 insertions(+), 327 deletions(-)
 create mode 100755 tests/functional/generic/test_monitor_hotplug.py

-- 
2.54.0



^ permalink raw reply	[flat|nested] 43+ messages in thread

end of thread, other threads:[~2026-06-18 11:56 UTC | newest]

Thread overview: 43+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2026-06-18 10:58 [PATCH v3 00/35] monitor: turn QMP and HMP into QOM objects Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 01/35] qom: replace 'can_be_deleted' with 'prepare_delete' Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 02/35] monitor: replace 'common' with 'parent_obj' in MonitorHMP Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 03/35] monitor: replace 'common' with 'parent_obj' in MonitorQMP Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 04/35] monitor: rename monitor_init* to monitor_new* Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 05/35] monitor: minimal conversion of monitors to QOM Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 06/35] monitor: add 'chardev' property to Monitor base class Daniel P. Berrangé
2026-06-18 11:54   ` marcandre.lureau
2026-06-18 10:58 ` [PATCH v3 07/35] monitor: add 'readline' property to HMP Monitor class Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 08/35] monitor: add 'pretty' property to QMP " Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 09/35] monitor: remove 'skip_flush' field Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 10/35] monitor: move monitor_data_(init|destroy) into QOM init/finalize Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 11/35] monitor: use class methods for monitor_vprintf Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 12/35] monitor: use class methods for monitor_qapi_event_emit Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 13/35] monitor: use class methods for monitor_accept_input Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 14/35] monitor: use class method for I/O thread request Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 15/35] monitor: use dynamic cast in monitor_qmp_requests_pop_any_with_lock Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 16/35] util: use dynamic cast in error vreport Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 17/35] monitor: drop unused monitor_cur_is_qmp Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 18/35] monitor: use dynamic cast in QMP commands Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 19/35] monitor: use dynamic cast in monitor_is_hmp_non_interactive Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 20/35] monitor: drop unused monitor_is_qmp method Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 21/35] monitor: eliminate monitor_is_hmp_non_interactive method Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 22/35] monitor: implement "user creatable" interface for adding monitors Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 23/35] monitor: convert from oneshot BH to persistent BH Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 24/35] monitor: reject attempts to delete the current monitor Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 25/35] monitor: protect qemu_chr_fe_accept_input with monitor lock Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 26/35] monitor: implement support for deleting QMP objects Daniel P. Berrangé
2026-06-18 11:54   ` marcandre.lureau
2026-06-18 10:58 ` [PATCH v3 27/35] tests/qtest: add tests for dynamic monitor add/remove Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 28/35] tests/functional: add e2e test for dynamic QMP monitor hotplug Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 29/35] tests/functional: add a stress test for monitor hot unplug Daniel P. Berrangé
2026-06-18 11:54   ` marcandre.lureau
2026-06-18 10:58 ` [PATCH v3 30/35] qom: add method for getting the "id" of a QOM object Daniel P. Berrangé
2026-06-18 11:54   ` marcandre.lureau
2026-06-18 10:58 ` [PATCH v3 31/35] qom: add trace events for user creatable create/delete APIs Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 32/35] monitor: add support for auto-deleting monitors upon close Daniel P. Berrangé
2026-06-18 11:54   ` marcandre.lureau
2026-06-18 10:58 ` [PATCH v3 33/35] tests: switch from -mon to -object monitor-qmp Daniel P. Berrangé
2026-06-18 10:58 ` [PATCH v3 34/35] qemu-options: document new monitor-hmp and monitor-qmp objects Daniel P. Berrangé
2026-06-18 11:54   ` marcandre.lureau
2026-06-18 10:58 ` [PATCH v3 35/35] docs: mark '-mon' as deprecated in favour of -object Daniel P. Berrangé
2026-06-18 11:54   ` marcandre.lureau

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.