public inbox for kdevops@lists.linux.dev
 help / color / mirror / Atom feed
* [PATCH kdevops v2 0/4] guestfs: replacement for vagrant in kdevops
@ 2023-12-08 15:01 Jeff Layton
  2023-12-08 15:01 ` [PATCH kdevops v2 1/4] Kconfig: s/VAGRANT_LIBVIRT/LIBVIRT/ Jeff Layton
                   ` (3 more replies)
  0 siblings, 4 replies; 12+ messages in thread
From: Jeff Layton @ 2023-12-08 15:01 UTC (permalink / raw)
  To: Luis Chamberlain; +Cc: kdevops, Jeff Layton

As we discussed recently at LPC, Vagrant is unmaintained and needs
replacement. This patchset implements a new "bringup" method alongside
Vagrant and Terraform, that uses libguestfs tools to create an image and
then has libvirt launch them directly:

    https://libguestfs.org/

The first 3 patches are cleanup patches that try to rework various
variable names to not have "VAGRANT" or "vagrant" embedded in them.
The last patch implements the new bringup method.

There may be some (hopefully minor) breakage to existing .config files
due to the first patch. I detailed the reasons why I think it's benign
in the changelog, but there is some risk there.

guestfs is not yet at feature parity yet with Vagrant:

- Fedora works for me, but the Debian image is _very_ minimal and seems
  to lack some things that kdevops expects. I haven't tested opensuse
  either.
- The XML template needs more work, particularly to handle more complex
  setups like PCI passthrough and CXL. Only the basic storage options
  currently work. Things like ZNS or large storage options haven't
  been implemented yet.
- I didn't try to convert the maze of menus for the distro selection. You
  have to set the os-version string for virt-builder in a single option.
  I tend to think of this as a feature, but I'm open to other opinions.
- It needs "firstrun" work to help the user ensure that the correct
  packages are installed for new bringup method.

Patches from others are welcome for all of the above.

Signed-off-by: Jeff Layton <jlayton@kernel.org>
---
Changes in v2:
- give guestfs its own makefile instead of piggybacking on vagrant's
- do a more thorough conversion to remove VAGRANT from various variable
  names in kconfigs and makefiles

---
Jeff Layton (4):
      Kconfig: s/VAGRANT_LIBVIRT/LIBVIRT/
      nfsd: key off of LIBVIRT instead of VAGRANT for storage config
      vagrant: rename the RHEL registration settings
      guestfs: add a new local guest management variant

 Makefile                                           |   4 +
 Makefile.kdevops                                   |  14 +-
 defconfigs/cxl-switch                              |   2 +-
 kconfigs/Kconfig.bringup                           |   6 +
 kconfigs/Kconfig.nfsd                              |  12 +-
 kconfigs/workflows/Kconfig.data_partition          |   2 +
 playbooks/roles/devconfig/defaults/main.yml        |   4 +-
 .../devconfig/tasks/install-deps/redhat/main.yml   |   8 +-
 playbooks/roles/gen_nodes/defaults/main.yml        |   1 +
 playbooks/roles/gen_nodes/tasks/main.yml           |  30 +++
 .../roles/gen_nodes/templates/guestfs_nodes.j2     |   3 +
 .../roles/gen_nodes/templates/guestfs_q35.j2.xml   | 228 +++++++++++++++++++++
 .../roles/pynfs/tasks/install-deps/redhat/main.yml |   4 +-
 scripts/bringup.Makefile                           |   7 +-
 scripts/bringup_guestfs.sh                         |  92 +++++++++
 scripts/bringup_vagrant.sh                         |   6 +-
 scripts/destroy_guestfs.sh                         |  29 +++
 scripts/gen-nodes.Makefile                         |   2 +-
 scripts/guestfs.Makefile                           |  88 ++++++++
 scripts/prune_stale_vagrant.sh                     |   2 +-
 scripts/update_ssh_config_guestfs.py               |  94 +++++++++
 scripts/vagrant.Makefile                           |  22 +-
 vagrant/Kconfig                                    |  95 +++++----
 vagrant/Kconfig.fedora                             |  10 +-
 .../xfs/unassigned/fstests-next-20230515           |  10 +-
 .../libvirt-qemu/20231003-huge/kdevops.config      |  10 +-
 .../kdevops-dagmcr-lbs-shmem-write-v6.6-rc4.config |  10 +-
 .../tmpfs/libvirt-qemu/20231003/kdevops.config     |  10 +-
 .../tmpfs/libvirt-qemu/20231004/kdevops.config     |  10 +-
 .../tmpfs/libvirt-qemu/20231006/kdevops.config     |  10 +-
 .../tmpfs/libvirt-qemu/20231009/kdevops.config     |  10 +-
 .../tmpfs/libvirt-qemu/20231011/kdevops.config     |  10 +-
 .../tmpfs/libvirt-qemu/20231012/kdevops.config     |  10 +-
 .../xfs/libvirt-qemu/20230522/kdevops.config       |  10 +-
 .../xfs/libvirt-qemu/20230725/kdevops.config       |  10 +-
 .../xfs/libvirt-qemu/20230727/kdevops.config       |  10 +-
 .../xfs/libvirt-qemu/20230728/kdevops.config       |  10 +-
 .../xfs/libvirt-qemu/20230731/kdevops.config       |  10 +-
 .../xfs/libvirt-qemu/20230807/kdevops.config       |  10 +-
 .../xfs/libvirt-qemu/20230811/kdevops.config       |  10 +-
 .../xfs/libvirt-qemu/20230817/kdevops.config       |  10 +-
 .../xfs/libvirt-qemu/20230825/kdevops.config       |  10 +-
 .../xfs/libvirt-qemu/20230828/kdevops.config       |  10 +-
 .../xfs/libvirt-qemu/20230829/kdevops.config       |  10 +-
 .../xfs/libvirt-qemu/20230903/kdevops.config       |  10 +-
 .../xfs/libvirt-qemu/20230909/kdevops.config       |  10 +-
 .../xfs/libvirt-qemu/20231023-0001/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231023/kdevops.config       |  10 +-
 .../xfs/libvirt-qemu/20231024-0001/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231024-0002/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231026-0001/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231026-0002/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231027-0001/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231030-0001/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231030-0002/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231030-0003/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231101-0001/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231101-0002/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231101-0003/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231102-0001/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231102-0002/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231103-0001/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231103-0002/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231104-0001/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231105-0001/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231106-0001/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231106-0002/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231106-0003/kdevops.config  |  10 +-
 .../xfs/libvirt-qemu/20231108-0001/kdevops.config  |  10 +-
 .../tmpfs/libvirt-qemu/20231025/kdevops.config     |  10 +-
 workflows/linux/Kconfig                            |   2 +-
 workflows/linux/Kconfig.kdevops                    |   2 +-
 workflows/linux/Kconfig.linus                      |   4 +-
 workflows/linux/Kconfig.mcgrof                     |   4 +-
 workflows/linux/Kconfig.next                       |   4 +-
 workflows/linux/Kconfig.stable                     |   4 +-
 76 files changed, 921 insertions(+), 324 deletions(-)
---
base-commit: aa502131273a3d5c8f975e4777519edd7ade59de
change-id: 20231206-guestfs-6b1c230f6b6f

Best regards,
-- 
Jeff Layton <jlayton@kernel.org>


^ permalink raw reply	[flat|nested] 12+ messages in thread
end of thread, other threads:[~2023-12-09 12:25 UTC | newest]

Thread overview: 12+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2023-12-08 15:01 [PATCH kdevops v2 0/4] guestfs: replacement for vagrant in kdevops Jeff Layton
2023-12-08 15:01 ` [PATCH kdevops v2 1/4] Kconfig: s/VAGRANT_LIBVIRT/LIBVIRT/ Jeff Layton
2023-12-09  2:05   ` Luis Chamberlain
2023-12-09  2:06     ` Luis Chamberlain
2023-12-09  2:08       ` Luis Chamberlain
2023-12-09 12:07     ` Jeff Layton
2023-12-08 15:01 ` [PATCH kdevops v2 2/4] nfsd: key off of LIBVIRT instead of VAGRANT for storage config Jeff Layton
2023-12-08 15:01 ` [PATCH kdevops v2 3/4] vagrant: rename the RHEL registration settings Jeff Layton
2023-12-08 15:23   ` Jeff Layton
2023-12-08 15:01 ` [PATCH kdevops v2 4/4] guestfs: add a new local guest management variant Jeff Layton
2023-12-09  2:14   ` Luis Chamberlain
2023-12-09 12:25     ` Jeff Layton

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox