From: Luis Chamberlain <mcgrof@kernel.org>
To: Chuck Lever <cel@kernel.org>, Daniel Gomez <da.gomez@kruces.com>,
kdevops@lists.linux.dev
Cc: Luis Chamberlain <mcgrof@kernel.org>
Subject: [PATCH v4 0/8] aws: add dynamic kconfig support
Date: Tue, 16 Sep 2025 17:34:41 -0700 [thread overview]
Message-ID: <20250917003451.2318229-1-mcgrof@kernel.org> (raw)
Chuck, in hopes to help move forward faster, I've taken your scripts
and tried to base the idea on it instead.
Changes on this v4:
- Adopt Chuck's script
- Make AWS ssh keys unique to avoid clashes
- Use a ~/.cache/ for json data
- Uber optimize for speed
This shaves down generation by *a lot*.
If you want to test:
https://github.com/linux-kdevops/kdevops/tree/mcgrof/aws-dynamic-cloud-config-v4
If you agree to it, please just merge :)
Chuck Lever (1):
terraform/aws: Add scripts to gather provider resource information
Luis Chamberlain (7):
aws: prevent SSH key conflicts across multiple kdevops directories
aws: add optimized Kconfig generator using Chuck's scripts
aws: integrate dynamic Kconfig generation with make targets
aws: add cloud billing support with make cloud-bill
aws: replace static Kconfig files with dynamically generated ones
aws: add GPU instance defconfigs for AI/ML workloads
docs: add documentation for dynamic cloud configuration
defconfigs/aws-gpu-g5-xlarge | 36 +
defconfigs/aws-gpu-p5-48xlarge | 36 +
docs/cloud-dynamic-config.md | 272 ++++++
playbooks/roles/gen_tfvars/defaults/main.yml | 2 +
.../templates/aws/terraform.tfvars.j2 | 3 +-
scripts/aws-costs.sh | 39 +
scripts/aws-parse-costs.py | 98 +++
scripts/aws_ssh_key_name.py | 165 ++++
scripts/dynamic-cloud-kconfig.Makefile | 60 +-
scripts/generate_cloud_configs.py | 78 +-
terraform/Kconfig.ssh | 14 +-
terraform/aws/Kconfig | 5 +-
terraform/aws/kconfigs/Kconfig.compute | 118 ---
terraform/aws/kconfigs/Kconfig.location | 679 ---------------
terraform/aws/kconfigs/Kconfig.ssh | 79 ++
.../aws/kconfigs/instance-types/Kconfig.c7a | 28 -
.../aws/kconfigs/instance-types/Kconfig.i4i | 33 -
.../aws/kconfigs/instance-types/Kconfig.im4gn | 25 -
.../kconfigs/instance-types/Kconfig.is4gen | 25 -
.../aws/kconfigs/instance-types/Kconfig.m5 | 48 --
.../aws/kconfigs/instance-types/Kconfig.m7a | 57 --
terraform/aws/scripts/aws_ami_info.py | 771 ++++++++++++++++++
terraform/aws/scripts/aws_regions_info.py | 371 +++++++++
terraform/aws/scripts/ec2_instance_info.py | 540 ++++++++++++
terraform/aws/scripts/generate_aws_kconfig.py | 474 +++++++++++
25 files changed, 3027 insertions(+), 1029 deletions(-)
create mode 100644 defconfigs/aws-gpu-g5-xlarge
create mode 100644 defconfigs/aws-gpu-p5-48xlarge
create mode 100644 docs/cloud-dynamic-config.md
create mode 100755 scripts/aws-costs.sh
create mode 100755 scripts/aws-parse-costs.py
create mode 100755 scripts/aws_ssh_key_name.py
delete mode 100644 terraform/aws/kconfigs/Kconfig.compute
delete mode 100644 terraform/aws/kconfigs/Kconfig.location
create mode 100644 terraform/aws/kconfigs/Kconfig.ssh
delete mode 100644 terraform/aws/kconfigs/instance-types/Kconfig.c7a
delete mode 100644 terraform/aws/kconfigs/instance-types/Kconfig.i4i
delete mode 100644 terraform/aws/kconfigs/instance-types/Kconfig.im4gn
delete mode 100644 terraform/aws/kconfigs/instance-types/Kconfig.is4gen
delete mode 100644 terraform/aws/kconfigs/instance-types/Kconfig.m5
delete mode 100644 terraform/aws/kconfigs/instance-types/Kconfig.m7a
create mode 100755 terraform/aws/scripts/aws_ami_info.py
create mode 100755 terraform/aws/scripts/aws_regions_info.py
create mode 100755 terraform/aws/scripts/ec2_instance_info.py
create mode 100755 terraform/aws/scripts/generate_aws_kconfig.py
--
2.51.0
next reply other threads:[~2025-09-17 0:34 UTC|newest]
Thread overview: 13+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-09-17 0:34 Luis Chamberlain [this message]
2025-09-17 0:34 ` [PATCH v4 1/8] aws: prevent SSH key conflicts across multiple kdevops directories Luis Chamberlain
2025-09-17 3:36 ` Chuck Lever
2025-09-17 0:34 ` [PATCH v4 2/8] terraform/aws: Add scripts to gather provider resource information Luis Chamberlain
2025-09-17 0:34 ` [PATCH v4 3/8] aws: add optimized Kconfig generator using Chuck's scripts Luis Chamberlain
2025-09-17 3:58 ` Chuck Lever
2025-09-17 0:34 ` [PATCH v4 4/8] aws: integrate dynamic Kconfig generation with make targets Luis Chamberlain
2025-09-17 3:40 ` Chuck Lever
2025-09-17 7:05 ` Luis Chamberlain
2025-09-17 0:34 ` [PATCH v4 5/8] aws: add cloud billing support with make cloud-bill Luis Chamberlain
2025-09-17 0:34 ` [PATCH v4 6/8] aws: replace static Kconfig files with dynamically generated ones Luis Chamberlain
2025-09-17 0:34 ` [PATCH v4 7/8] aws: add GPU instance defconfigs for AI/ML workloads Luis Chamberlain
2025-09-17 0:34 ` [PATCH v4 8/8] docs: add documentation for dynamic cloud configuration Luis Chamberlain
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20250917003451.2318229-1-mcgrof@kernel.org \
--to=mcgrof@kernel.org \
--cc=cel@kernel.org \
--cc=da.gomez@kruces.com \
--cc=kdevops@lists.linux.dev \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.