All of lore.kernel.org
 help / color / mirror / Atom feed
* [Qemu-devel] [Minios-devel] [PATCH v6 0/<VARIOUS>] Begin to disentangle libxenctrl and provide some stable libraries
@ 2015-12-03 11:21 Ian Campbell
  2015-12-03 11:21 ` [PATCH XEN v6 00/32] " Ian Campbell
                   ` (6 more replies)
  0 siblings, 7 replies; 134+ messages in thread
From: Ian Campbell @ 2015-12-03 11:21 UTC (permalink / raw)
  To: xen-devel
  Cc: Wei Liu, Stefano Stabellini, Ian Jackson, qemu-devel,
	minios-devel, samuel.thibault, Roger Pau Monne

In <1431963008.4944.80.camel@citrix.com> I proposed stabilising some
parts of the libxenctrl API/ABI by disaggregating into separate
libraries.

This is v6 of that set of series against:
    xen
    qemu-xen
    qemu-xen-traditional
    mini-os

NB: Samuel+minios-devel will only get the mini-os side and Stefano+qemu
-devel the qemu-xen side.

The code for all repos can be found in:

git://xenbits.xen.org/people/ianc/libxenctrl-split/xen.git                  v6
git://xenbits.xen.org/people/ianc/libxenctrl-split/qemu-xen.git             v6
git://xenbits.xen.org/people/ianc/libxenctrl-split/qemu-xen-traditional.git v6
git://xenbits.xen.org/people/ianc/libxenctrl-split/mini-os.git              v6

The tip of the xen.git branch contains an extra patch hacking Config.mk
to point to all the others above, which should get the correct things for
the HEAD of the branch, but not further back in time.

The new libraries here are:

 * libxentoollog: Common logging infrastructure
 * libxenevtchn: Userspace access to evtchns (via /dev/xen/evtchn etc)
 * libxengnttab: Userspace access to grant tables (via /dev/xen/gnt??? etc)
 * libxencall: Making hypercalls (i.e. the IOCTL_PRIVCMD_HYPERCALL type
   functionality)
 * libxenforeignmemory: Privileged mappings of foreign memory
   (IOCTL_PRIVCMD_MMAP et al)

The first three were actually pretty distinct within libxenctrl already and
have not changed in quite some time.

Although the other two are somewhat new they are based on top of long
standing stable ioctls, which gives me some confidence.

Nonetheless I would appreciate extra review of at least the interface
headers of all of these with a particular eye to the suitability of these
interfaces being maintained in an ABI (_B_, not _P_) stable way going
forward.

Still to come would be libraries for specific out of tree purposes
(device model, kexec), which would be adding new library at the same
level as libxc I think, rather than underneath, i.e. also using the
libraries split out here, but hopefully not libxenctrl itself.

The new libraries use linker version-scripts to hopefully make future
ABI changes be possible in a compatible way.

Since last time:

 * Major changes to the libxenforeignmemory interface, which necessitated
   some changes on the qemu-xen side too, invalidating various
   (Ack|Review)ed-by.
    * Reordered the arguments to make the use of VLA possible in the future
      
    * Allow err==NULL, this in turn lead to the realisation that the error
      handling for a bunch of the xc_map_foreign_* functions which
      transition => xc_map_foreign_bulk => xenforeigmemory_map in this
      series was all wrong in expecting a NULL return on error when errors
      can also be signalled in err[]. This lead to most of the dropped acks
      and various reorderings/restructuring of changes 
 * Lots of docs updates based on feedback given, especially to the gnttab
   interface.

Even with the dropped acks mini-os and qemu-xen-trad are fully acked, while
qemu-xen and xen are mostly acked (but had a few dropped acks since last
time).

The whole thing has been build tested on Linux (incl stubdoms), and on
FreeBSD. I have runtime on Linux with qemu-xen, qemu-xen-trad and stubdoms.

Neither NetBSD nor Solaris have been tested at all. It's certainly not
impossible that I've not got the #includes in the new files quite right.

http://xenbits.xen.org/people/ianc/libxenctrl-split/v6.html is the document
I've been using to try and track what I'm doing. It may not be all that
useful. The history of it is in the v6-with-doc branch of the xen.git
linked to above.

Last time  proposed that these precursors (and the corresponding qemu-xen-
traditional + mini-os patches) should go in now:

    tools/Rules.mk: Properly handle libraries with recursive dependencies.
    tools: Refactor "xentoollog" into its own library

But I subsequently found a couple of build issues, which are addressed by
two new patches at the head of the xen series.

Note also that I've picked up "x86/libxc: add an arch domain config
parameter to xc_domain_create" into my xen branch, in order that I can work
against qemu mainline, I expect that to go in shortly and be dropped here
(just waiting on a qemu-xen-upstream-unstable osstest pass).

Ian.

^ permalink raw reply	[flat|nested] 134+ messages in thread

end of thread, other threads:[~2015-12-14 14:07 UTC | newest]

Thread overview: 134+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2015-12-03 11:21 [Qemu-devel] [Minios-devel] [PATCH v6 0/<VARIOUS>] Begin to disentangle libxenctrl and provide some stable libraries Ian Campbell
2015-12-03 11:21 ` [PATCH XEN v6 00/32] " Ian Campbell
2015-12-03 11:21   ` [PATCH XEN v6 01/32] x86/libxc: add an arch domain config parameter to xc_domain_create Ian Campbell
2015-12-09 12:21     ` Wei Liu
2015-12-03 11:21   ` [PATCH XEN v6 02/32] mce-test: do not include libxenguest internal headers Ian Campbell
2015-12-03 12:48     ` Andrew Cooper
2015-12-09 12:22     ` Wei Liu
2015-12-03 11:22   ` [PATCH XEN v6 03/32] tools/ocaml: simplify compile/link of test apps Ian Campbell
2015-12-03 11:59     ` David Scott
2015-12-09 12:22     ` Wei Liu
2015-12-03 11:22   ` [PATCH XEN v6 04/32] tools/Rules.mk: Properly handle libraries with recursive dependencies Ian Campbell
2015-12-03 11:22   ` [PATCH XEN v6 05/32] tools: Refactor "xentoollog" into its own library Ian Campbell
2015-12-03 11:22   ` [PATCH XEN v6 06/32] tools/libxc: Remove osdep indirection for xc_evtchn Ian Campbell
2015-12-03 11:22   ` [PATCH XEN v6 07/32] tools: Refactor /dev/xen/evtchn wrappers into libxenevtchn Ian Campbell
2015-12-03 11:22   ` [PATCH XEN v6 08/32] tools: Arrange to check public headers for ANSI compatiblity Ian Campbell
2015-12-03 11:22   ` [PATCH XEN v6 09/32] tools/libxc: Remove osdep indirection for xc_gnt{shr, tab} Ian Campbell
2015-12-03 11:22   ` [PATCH XEN v6 10/32] tools: Refactor /dev/xen/gnt{dev, shr} wrappers into libxengnttab Ian Campbell
2015-12-14 14:07     ` Ian Campbell
2015-12-03 11:22   ` [PATCH XEN v6 11/32] tools/libxc: Remove osdep indirection for privcmd Ian Campbell
2015-12-03 11:22   ` [PATCH XEN v6 12/32] tools: Refactor hypercall calling wrappers into libxencall Ian Campbell
2015-12-03 11:22   ` [PATCH XEN v6 13/32] tools/libxc: drop xc_map_foreign_bulk_compat wrappers Ian Campbell
2015-12-03 11:22   ` [PATCH XEN v6 14/32] tools: Remove xc_map_foreign_batch Ian Campbell
2015-12-09 12:22     ` Wei Liu
2015-12-10 15:21     ` George Dunlap
2015-12-11 15:42       ` Ian Campbell
2015-12-11 16:04         ` George Dunlap
2015-12-03 11:22   ` [PATCH XEN v6 15/32] tools: Implement xc_map_foreign_range(s) in terms of common helper Ian Campbell
2015-12-03 11:22   ` [PATCH XEN v6 16/32] tools: Refactor foreign memory mapping into libxenforeignmemory Ian Campbell
2015-12-09 15:38     ` Ian Jackson
2015-12-03 11:22   ` [PATCH XEN v6 17/32] tools/libs/foreignmemory: provide xenforeignmemory_unmap Ian Campbell
2015-12-09 15:38     ` Ian Jackson
2015-12-03 11:22   ` [PATCH XEN v6 18/32] tools/libs/foreignmemory: use size_t for size arguments Ian Campbell
2015-12-03 11:22   ` [PATCH XEN v6 19/32] tools/libs/foreignmemory: Mention restrictions on fork in docs Ian Campbell
2015-12-03 11:22   ` [PATCH XEN v6 20/32] tools/libs/foreignmemory: Support err == NULL to map Ian Campbell
2015-12-09 12:22     ` Wei Liu
2015-12-09 12:31       ` Egger, Christoph
2015-12-09 12:45         ` Ian Campbell
2015-12-09 12:41       ` Ian Campbell
2015-12-09 12:56         ` Wei Liu
2015-12-09 13:15           ` Ian Campbell
2015-12-09 16:16             ` Wei Liu
2015-12-09 15:40     ` Ian Jackson
2015-12-03 11:22   ` [PATCH XEN v6 21/32] tools/libs/foreignmemory: pull array length argument to map forward Ian Campbell
2015-12-09 12:22     ` Wei Liu
2015-12-09 15:41     ` Ian Jackson
2015-12-03 11:22   ` [PATCH XEN v6 22/32] tools/libs/foreignmemory: optimise map(num==1, err==NULL) case Ian Campbell
2015-12-09 15:42     ` Ian Jackson
2015-12-11 15:56       ` Ian Campbell
2015-12-03 11:22   ` [PATCH XEN v6 23/32] tools/libs/evtchn: Review and update doc comments Ian Campbell
2015-12-03 11:22   ` [PATCH XEN v6 24/32] tools/libs: Clean up hard tabs Ian Campbell
2015-12-03 11:22   ` [PATCH XEN v6 25/32] tools/libs/gnttab: Extensive updates to API documentation Ian Campbell
2015-12-03 18:08     ` Daniel De Graaf
2015-12-04 10:06       ` Ian Campbell
2015-12-09 12:41     ` Wei Liu
2015-12-09 13:00       ` Ian Campbell
2015-12-09 13:37         ` Wei Liu
2015-12-09 13:50         ` Andrew Cooper
2015-12-09 14:03           ` Ian Campbell
2015-12-09 16:14             ` Ian Jackson
2015-12-09 16:09     ` Ian Jackson
2015-12-09 16:25       ` Ian Campbell
2015-12-09 16:28         ` Ian Jackson
2015-12-09 17:08           ` Ian Campbell
2015-12-11 17:14             ` Ian Campbell
2015-12-11 17:19               ` Ian Jackson
2015-12-11 17:35                 ` Ian Campbell
2015-12-14 11:29                   ` Ian Campbell
2015-12-14 11:55                     ` Ian Jackson
2015-12-03 11:22   ` [PATCH XEN v6 26/32] tools/libs/call: Update some log messages to not refer to xc Ian Campbell
2015-12-03 11:22   ` [PATCH XEN v6 27/32] tools/libs/call: Describe return values and error semantics for xencall* Ian Campbell
2015-12-09 12:22     ` Wei Liu
2015-12-09 16:15     ` Ian Jackson
2015-12-03 11:22   ` [PATCH XEN v6 28/32] tools/libs/call: Avoid xc_memalign in netbsd and solaris backends Ian Campbell
2015-12-03 11:22   ` [PATCH XEN v6 29/32] tools/libs/call: Use O_CLOEXEC when opening /dev/xen/privcmd on Linux Ian Campbell
2015-12-09 12:22     ` Wei Liu
2015-12-09 16:17     ` Ian Jackson
2015-12-11 17:22       ` Ian Campbell
2015-12-12 10:55         ` Roger Pau Monné
2015-12-03 11:22   ` [PATCH XEN v6 30/32] tools/libs/call: linux: avoid forking between mmap and madvise Ian Campbell
2015-12-09 12:22     ` Wei Liu
2015-12-09 16:18     ` Ian Jackson
2015-12-11 17:16       ` Ian Campbell
2015-12-03 11:22   ` [PATCH XEN v6 31/32] tools: Update CFLAGS for qemu-xen to allow it to use new libraries Ian Campbell
2015-12-03 11:22   ` [PATCH XEN v6 32/32] HACK: Update Config.mk to pull all the right bits from my xenbits trees Ian Campbell
2015-12-03 11:23 ` [Qemu-devel] [PATCH QEMU-XEN v6 0/8] Begin to disentangle libxenctrl and provide some stable libraries Ian Campbell
2015-12-03 11:23   ` [Qemu-devel] [PATCH QEMU-XEN v6 1/8] xen_console: correctly cleanup primary console on teardown Ian Campbell
2015-12-03 11:23   ` Ian Campbell
2015-12-03 11:23   ` [Qemu-devel] [PATCH QEMU-XEN v6 2/8] xen: Switch to libxenevtchn interface for compat shims Ian Campbell
2015-12-03 11:23   ` Ian Campbell
2015-12-03 11:23   ` [Qemu-devel] [PATCH QEMU-XEN v6 3/8] xen: Switch to libxengnttab " Ian Campbell
2015-12-03 11:23     ` Ian Campbell
2015-12-03 11:23   ` [Qemu-devel] [PATCH QEMU-XEN v6 4/8] xen: Switch uses of xc_map_foreign_range into xc_map_foreign_pages Ian Campbell
2015-12-03 11:23     ` Ian Campbell
2015-12-04 15:26     ` Stefano Stabellini
2015-12-04 15:26     ` [Qemu-devel] " Stefano Stabellini
2015-12-09 13:41     ` Ian Campbell
2015-12-09 13:56       ` [Qemu-devel] [Xen-devel] " Andrew Cooper
2015-12-09 14:05         ` Ian Campbell
2015-12-09 14:05         ` Ian Campbell
2015-12-09 13:56       ` Andrew Cooper
2015-12-11 14:26       ` Stefano Stabellini
2015-12-11 14:26       ` [Qemu-devel] " Stefano Stabellini
2015-12-11 15:23         ` Ian Campbell
2015-12-11 15:23           ` Ian Campbell
2015-12-11 16:42           ` [Qemu-devel] " Stefano Stabellini
2015-12-11 16:42           ` Stefano Stabellini
2015-12-09 13:41     ` Ian Campbell
2015-12-03 11:23   ` [Qemu-devel] [PATCH QEMU-XEN v6 5/8] xen: Switch uses of xc_map_foreign_{pages, bulk} to use libxenforeignmemory API Ian Campbell
2015-12-03 11:23     ` Ian Campbell
2015-12-04 15:26     ` Stefano Stabellini
2015-12-04 15:26     ` [Qemu-devel] " Stefano Stabellini
2015-12-03 11:23   ` [Qemu-devel] [PATCH QEMU-XEN v6 6/8] xen: Use stable library interfaces when they are available Ian Campbell
2015-12-04 15:31     ` Stefano Stabellini
2015-12-04 15:31     ` [Qemu-devel] " Stefano Stabellini
2015-12-03 11:23   ` Ian Campbell
2015-12-03 11:23   ` [Qemu-devel] [PATCH QEMU-XEN v6 7/8] xen: domainbuild: reopen libxenctrl interface after forking for domain watcher Ian Campbell
2015-12-03 11:23     ` Ian Campbell
2015-12-03 11:23   ` [Qemu-devel] [PATCH QEMU-XEN v6 8/8] xen: make it possible to build without the Xen PV domain builder Ian Campbell
2015-12-03 11:23     ` Ian Campbell
2015-12-03 11:23 ` [PATCH QEMU-XEN v6 0/8] Begin to disentangle libxenctrl and provide some stable libraries Ian Campbell
2015-12-03 11:23 ` [PATCH QEMU-XEN-TRADITIONAL v6 0/5] " Ian Campbell
2015-12-03 11:23   ` [PATCH QEMU-XEN-TRADITIONAL v6 1/5] qemu-xen-traditional: Use xentoollog as a separate library Ian Campbell
2015-12-03 11:23   ` [PATCH QEMU-XEN-TRADITIONAL v6 2/5] qemu-xen-traditional: Use libxenevtchn Ian Campbell
2015-12-03 11:23   ` [PATCH QEMU-XEN-TRADITIONAL v6 3/5] qemu-xen-traditional: Use libxengnttab Ian Campbell
2015-12-03 11:23   ` [PATCH QEMU-XEN-TRADITIONAL v6 4/5] qemu-xen-traditional: Add libxencall to rpath-link Ian Campbell
2015-12-03 11:23   ` [PATCH QEMU-XEN-TRADITIONAL v6 5/5] qemu-xen-traditional: Add libxenforeignmemory " Ian Campbell
2015-12-03 11:23 ` [PATCH MINI-OS v6 0/5] Begin to disentangle libxenctrl and provide some stable libraries Ian Campbell
2015-12-03 11:23   ` [PATCH MINI-OS v6 1/5] mini-os: Include libxentoollog with libxc Ian Campbell
2015-12-03 11:23   ` [PATCH MINI-OS v6 2/5] mini-os: Include libxenevtchn " Ian Campbell
2015-12-03 11:23   ` [PATCH MINI-OS v6 3/5] mini-os: Include libxengnttab " Ian Campbell
2015-12-03 11:23   ` [PATCH MINI-OS v6 4/5] mini-os: Include libxencall " Ian Campbell
2015-12-03 11:23   ` [PATCH MINI-OS v6 5/5] mini-os: Include libxenforeignmemory " Ian Campbell
2015-12-09 12:37 ` [Minios-devel] [PATCH v6 0/<VARIOUS>] Begin to disentangle libxenctrl and provide some stable libraries Ian Campbell
2015-12-09 12:37 ` [Qemu-devel] " Ian Campbell

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.