public inbox for kdevops@lists.linux.dev
 help / color / mirror / Atom feed
* [PATCH v4 0/8] aws: add dynamic kconfig support
@ 2025-09-17  0:34 Luis Chamberlain
  2025-09-17  0:34 ` [PATCH v4 1/8] aws: prevent SSH key conflicts across multiple kdevops directories Luis Chamberlain
                   ` (7 more replies)
  0 siblings, 8 replies; 13+ messages in thread
From: Luis Chamberlain @ 2025-09-17  0:34 UTC (permalink / raw)
  To: Chuck Lever, Daniel Gomez, kdevops; +Cc: Luis Chamberlain

Chuck, in hopes to help move forward faster, I've taken your scripts
and tried to base the idea on it instead.

Changes on this v4:

  - Adopt Chuck's script
  - Make AWS ssh keys unique to avoid clashes
  - Use a ~/.cache/ for json data
  - Uber optimize for speed

This shaves down generation by *a lot*.

If you want to test:

https://github.com/linux-kdevops/kdevops/tree/mcgrof/aws-dynamic-cloud-config-v4

If you agree to it, please just merge :)

Chuck Lever (1):
  terraform/aws: Add scripts to gather provider resource information

Luis Chamberlain (7):
  aws: prevent SSH key conflicts across multiple kdevops directories
  aws: add optimized Kconfig generator using Chuck's scripts
  aws: integrate dynamic Kconfig generation with make targets
  aws: add cloud billing support with make cloud-bill
  aws: replace static Kconfig files with dynamically generated ones
  aws: add GPU instance defconfigs for AI/ML workloads
  docs: add documentation for dynamic cloud configuration

 defconfigs/aws-gpu-g5-xlarge                  |  36 +
 defconfigs/aws-gpu-p5-48xlarge                |  36 +
 docs/cloud-dynamic-config.md                  | 272 ++++++
 playbooks/roles/gen_tfvars/defaults/main.yml  |   2 +
 .../templates/aws/terraform.tfvars.j2         |   3 +-
 scripts/aws-costs.sh                          |  39 +
 scripts/aws-parse-costs.py                    |  98 +++
 scripts/aws_ssh_key_name.py                   | 165 ++++
 scripts/dynamic-cloud-kconfig.Makefile        |  60 +-
 scripts/generate_cloud_configs.py             |  78 +-
 terraform/Kconfig.ssh                         |  14 +-
 terraform/aws/Kconfig                         |   5 +-
 terraform/aws/kconfigs/Kconfig.compute        | 118 ---
 terraform/aws/kconfigs/Kconfig.location       | 679 ---------------
 terraform/aws/kconfigs/Kconfig.ssh            |  79 ++
 .../aws/kconfigs/instance-types/Kconfig.c7a   |  28 -
 .../aws/kconfigs/instance-types/Kconfig.i4i   |  33 -
 .../aws/kconfigs/instance-types/Kconfig.im4gn |  25 -
 .../kconfigs/instance-types/Kconfig.is4gen    |  25 -
 .../aws/kconfigs/instance-types/Kconfig.m5    |  48 --
 .../aws/kconfigs/instance-types/Kconfig.m7a   |  57 --
 terraform/aws/scripts/aws_ami_info.py         | 771 ++++++++++++++++++
 terraform/aws/scripts/aws_regions_info.py     | 371 +++++++++
 terraform/aws/scripts/ec2_instance_info.py    | 540 ++++++++++++
 terraform/aws/scripts/generate_aws_kconfig.py | 474 +++++++++++
 25 files changed, 3027 insertions(+), 1029 deletions(-)
 create mode 100644 defconfigs/aws-gpu-g5-xlarge
 create mode 100644 defconfigs/aws-gpu-p5-48xlarge
 create mode 100644 docs/cloud-dynamic-config.md
 create mode 100755 scripts/aws-costs.sh
 create mode 100755 scripts/aws-parse-costs.py
 create mode 100755 scripts/aws_ssh_key_name.py
 delete mode 100644 terraform/aws/kconfigs/Kconfig.compute
 delete mode 100644 terraform/aws/kconfigs/Kconfig.location
 create mode 100644 terraform/aws/kconfigs/Kconfig.ssh
 delete mode 100644 terraform/aws/kconfigs/instance-types/Kconfig.c7a
 delete mode 100644 terraform/aws/kconfigs/instance-types/Kconfig.i4i
 delete mode 100644 terraform/aws/kconfigs/instance-types/Kconfig.im4gn
 delete mode 100644 terraform/aws/kconfigs/instance-types/Kconfig.is4gen
 delete mode 100644 terraform/aws/kconfigs/instance-types/Kconfig.m5
 delete mode 100644 terraform/aws/kconfigs/instance-types/Kconfig.m7a
 create mode 100755 terraform/aws/scripts/aws_ami_info.py
 create mode 100755 terraform/aws/scripts/aws_regions_info.py
 create mode 100755 terraform/aws/scripts/ec2_instance_info.py
 create mode 100755 terraform/aws/scripts/generate_aws_kconfig.py

-- 
2.51.0


^ permalink raw reply	[flat|nested] 13+ messages in thread

end of thread, other threads:[~2025-09-17  7:05 UTC | newest]

Thread overview: 13+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2025-09-17  0:34 [PATCH v4 0/8] aws: add dynamic kconfig support Luis Chamberlain
2025-09-17  0:34 ` [PATCH v4 1/8] aws: prevent SSH key conflicts across multiple kdevops directories Luis Chamberlain
2025-09-17  3:36   ` Chuck Lever
2025-09-17  0:34 ` [PATCH v4 2/8] terraform/aws: Add scripts to gather provider resource information Luis Chamberlain
2025-09-17  0:34 ` [PATCH v4 3/8] aws: add optimized Kconfig generator using Chuck's scripts Luis Chamberlain
2025-09-17  3:58   ` Chuck Lever
2025-09-17  0:34 ` [PATCH v4 4/8] aws: integrate dynamic Kconfig generation with make targets Luis Chamberlain
2025-09-17  3:40   ` Chuck Lever
2025-09-17  7:05     ` Luis Chamberlain
2025-09-17  0:34 ` [PATCH v4 5/8] aws: add cloud billing support with make cloud-bill Luis Chamberlain
2025-09-17  0:34 ` [PATCH v4 6/8] aws: replace static Kconfig files with dynamically generated ones Luis Chamberlain
2025-09-17  0:34 ` [PATCH v4 7/8] aws: add GPU instance defconfigs for AI/ML workloads Luis Chamberlain
2025-09-17  0:34 ` [PATCH v4 8/8] docs: add documentation for dynamic cloud configuration Luis Chamberlain

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox