All of lore.kernel.org
 help / color / mirror / Atom feed
* [PATCH v4 0/8] aws: add dynamic kconfig support
@ 2025-09-17  0:34 Luis Chamberlain
  2025-09-17  0:34 ` [PATCH v4 1/8] aws: prevent SSH key conflicts across multiple kdevops directories Luis Chamberlain
                   ` (7 more replies)
  0 siblings, 8 replies; 13+ messages in thread
From: Luis Chamberlain @ 2025-09-17  0:34 UTC (permalink / raw)
  To: Chuck Lever, Daniel Gomez, kdevops; +Cc: Luis Chamberlain

Chuck, in hopes to help move forward faster, I've taken your scripts
and tried to base the idea on it instead.

Changes on this v4:

  - Adopt Chuck's script
  - Make AWS ssh keys unique to avoid clashes
  - Use a ~/.cache/ for json data
  - Uber optimize for speed

This shaves down generation by *a lot*.

If you want to test:

https://github.com/linux-kdevops/kdevops/tree/mcgrof/aws-dynamic-cloud-config-v4

If you agree to it, please just merge :)

Chuck Lever (1):
  terraform/aws: Add scripts to gather provider resource information

Luis Chamberlain (7):
  aws: prevent SSH key conflicts across multiple kdevops directories
  aws: add optimized Kconfig generator using Chuck's scripts
  aws: integrate dynamic Kconfig generation with make targets
  aws: add cloud billing support with make cloud-bill
  aws: replace static Kconfig files with dynamically generated ones
  aws: add GPU instance defconfigs for AI/ML workloads
  docs: add documentation for dynamic cloud configuration

 defconfigs/aws-gpu-g5-xlarge                  |  36 +
 defconfigs/aws-gpu-p5-48xlarge                |  36 +
 docs/cloud-dynamic-config.md                  | 272 ++++++
 playbooks/roles/gen_tfvars/defaults/main.yml  |   2 +
 .../templates/aws/terraform.tfvars.j2         |   3 +-
 scripts/aws-costs.sh                          |  39 +
 scripts/aws-parse-costs.py                    |  98 +++
 scripts/aws_ssh_key_name.py                   | 165 ++++
 scripts/dynamic-cloud-kconfig.Makefile        |  60 +-
 scripts/generate_cloud_configs.py             |  78 +-
 terraform/Kconfig.ssh                         |  14 +-
 terraform/aws/Kconfig                         |   5 +-
 terraform/aws/kconfigs/Kconfig.compute        | 118 ---
 terraform/aws/kconfigs/Kconfig.location       | 679 ---------------
 terraform/aws/kconfigs/Kconfig.ssh            |  79 ++
 .../aws/kconfigs/instance-types/Kconfig.c7a   |  28 -
 .../aws/kconfigs/instance-types/Kconfig.i4i   |  33 -
 .../aws/kconfigs/instance-types/Kconfig.im4gn |  25 -
 .../kconfigs/instance-types/Kconfig.is4gen    |  25 -
 .../aws/kconfigs/instance-types/Kconfig.m5    |  48 --
 .../aws/kconfigs/instance-types/Kconfig.m7a   |  57 --
 terraform/aws/scripts/aws_ami_info.py         | 771 ++++++++++++++++++
 terraform/aws/scripts/aws_regions_info.py     | 371 +++++++++
 terraform/aws/scripts/ec2_instance_info.py    | 540 ++++++++++++
 terraform/aws/scripts/generate_aws_kconfig.py | 474 +++++++++++
 25 files changed, 3027 insertions(+), 1029 deletions(-)
 create mode 100644 defconfigs/aws-gpu-g5-xlarge
 create mode 100644 defconfigs/aws-gpu-p5-48xlarge
 create mode 100644 docs/cloud-dynamic-config.md
 create mode 100755 scripts/aws-costs.sh
 create mode 100755 scripts/aws-parse-costs.py
 create mode 100755 scripts/aws_ssh_key_name.py
 delete mode 100644 terraform/aws/kconfigs/Kconfig.compute
 delete mode 100644 terraform/aws/kconfigs/Kconfig.location
 create mode 100644 terraform/aws/kconfigs/Kconfig.ssh
 delete mode 100644 terraform/aws/kconfigs/instance-types/Kconfig.c7a
 delete mode 100644 terraform/aws/kconfigs/instance-types/Kconfig.i4i
 delete mode 100644 terraform/aws/kconfigs/instance-types/Kconfig.im4gn
 delete mode 100644 terraform/aws/kconfigs/instance-types/Kconfig.is4gen
 delete mode 100644 terraform/aws/kconfigs/instance-types/Kconfig.m5
 delete mode 100644 terraform/aws/kconfigs/instance-types/Kconfig.m7a
 create mode 100755 terraform/aws/scripts/aws_ami_info.py
 create mode 100755 terraform/aws/scripts/aws_regions_info.py
 create mode 100755 terraform/aws/scripts/ec2_instance_info.py
 create mode 100755 terraform/aws/scripts/generate_aws_kconfig.py

-- 
2.51.0


^ permalink raw reply	[flat|nested] 13+ messages in thread

end of thread, other threads:[~2025-09-17  7:05 UTC | newest]

Thread overview: 13+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2025-09-17  0:34 [PATCH v4 0/8] aws: add dynamic kconfig support Luis Chamberlain
2025-09-17  0:34 ` [PATCH v4 1/8] aws: prevent SSH key conflicts across multiple kdevops directories Luis Chamberlain
2025-09-17  3:36   ` Chuck Lever
2025-09-17  0:34 ` [PATCH v4 2/8] terraform/aws: Add scripts to gather provider resource information Luis Chamberlain
2025-09-17  0:34 ` [PATCH v4 3/8] aws: add optimized Kconfig generator using Chuck's scripts Luis Chamberlain
2025-09-17  3:58   ` Chuck Lever
2025-09-17  0:34 ` [PATCH v4 4/8] aws: integrate dynamic Kconfig generation with make targets Luis Chamberlain
2025-09-17  3:40   ` Chuck Lever
2025-09-17  7:05     ` Luis Chamberlain
2025-09-17  0:34 ` [PATCH v4 5/8] aws: add cloud billing support with make cloud-bill Luis Chamberlain
2025-09-17  0:34 ` [PATCH v4 6/8] aws: replace static Kconfig files with dynamically generated ones Luis Chamberlain
2025-09-17  0:34 ` [PATCH v4 7/8] aws: add GPU instance defconfigs for AI/ML workloads Luis Chamberlain
2025-09-17  0:34 ` [PATCH v4 8/8] docs: add documentation for dynamic cloud configuration Luis Chamberlain

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.