From: Luis Chamberlain <mcgrof@kernel.org>
To: Chuck Lever <cel@kernel.org>, Daniel Gomez <da.gomez@kruces.com>,
kdevops@lists.linux.dev
Cc: Luis Chamberlain <mcgrof@kernel.org>
Subject: [PATCH v3 00/10] terraform: add Lambda Labs cloud provider support
Date: Sat, 30 Aug 2025 20:59:54 -0700 [thread overview]
Message-ID: <20250831040004.2159779-1-mcgrof@kernel.org> (raw)
This v3 takes up the idea shared by Chuck to implement a CLI tool
and make the dynamic kconfig use it instead. We also add documentation
about this. This should hopefully pave the way for other cloud provider
support to leverage this more easily, AIs can just read the docs and
go to town.
Luis Chamberlain (10):
gitignore: add entries for Lambda Labs dynamic configuration
scripts: add Lambda Labs Python API library
scripts: add Lambda Labs testing and debugging utilities
scripts: add Lambda Labs credentials management
scripts: add Lambda Labs SSH key management utilities
kconfig: add dynamic cloud provider configuration infrastructure
terraform/lambdalabs: add Kconfig structure for Lambda Labs
terraform/lambdalabs: add terraform provider implementation
ansible/terraform: integrate Lambda Labs into build system
kconfigs: enable Lambda Labs cloud provider in menus
.gitignore | 9 +
PROMPTS.md | 56 ++
defconfigs/lambdalabs | 15 +
defconfigs/lambdalabs-gpu-1x-a10 | 9 +
defconfigs/lambdalabs-gpu-1x-a100 | 8 +
defconfigs/lambdalabs-gpu-1x-h100 | 8 +
defconfigs/lambdalabs-gpu-8x-a100 | 8 +
defconfigs/lambdalabs-gpu-8x-h100 | 8 +
defconfigs/lambdalabs-shared-key | 11 +
defconfigs/lambdalabs-smart | 10 +
docs/dynamic-cloud-kconfig.md | 461 +++++++++++++
docs/lambda-cli.1 | 245 +++++++
kconfigs/Kconfig.bringup | 5 +
playbooks/roles/gen_tfvars/defaults/main.yml | 23 +
.../templates/lambdalabs/terraform.tfvars.j2 | 18 +
playbooks/roles/terraform/tasks/main.yml | 85 +++
scripts/cloud_list_all.sh | 152 +++++
scripts/dynamic-cloud-kconfig.Makefile | 44 ++
scripts/dynamic-kconfig.Makefile | 2 +
scripts/generate_cloud_configs.py | 113 ++++
scripts/lambda-cli | 639 ++++++++++++++++++
scripts/lambdalabs_api.py | 556 +++++++++++++++
scripts/lambdalabs_credentials.py | 242 +++++++
scripts/lambdalabs_infer_region.py | 61 ++
scripts/lambdalabs_smart_inference.py | 62 ++
scripts/lambdalabs_ssh_key_name.py | 135 ++++
scripts/lambdalabs_ssh_keys.py | 358 ++++++++++
scripts/ssh_config_file_name.py | 79 +++
scripts/terraform.Makefile | 108 ++-
scripts/update_ssh_config_lambdalabs.py | 110 +++
terraform/Kconfig.providers | 10 +
terraform/Kconfig.ssh | 37 +-
terraform/lambdalabs/Kconfig | 33 +
terraform/lambdalabs/README.md | 349 ++++++++++
terraform/lambdalabs/SET_API_KEY.sh | 20 +
.../lambdalabs/ansible_provision_cmd.tpl | 1 +
terraform/lambdalabs/extract_api_key.py | 40 ++
terraform/lambdalabs/kconfigs/Kconfig.compute | 48 ++
.../lambdalabs/kconfigs/Kconfig.identity | 76 +++
.../lambdalabs/kconfigs/Kconfig.location | 73 ++
terraform/lambdalabs/kconfigs/Kconfig.smart | 25 +
terraform/lambdalabs/kconfigs/Kconfig.storage | 12 +
terraform/lambdalabs/main.tf | 154 +++++
terraform/lambdalabs/output.tf | 51 ++
terraform/lambdalabs/provider.tf | 19 +
terraform/lambdalabs/shared.tf | 1 +
terraform/lambdalabs/vars.tf | 65 ++
terraform/shared.tf | 14 +-
48 files changed, 4656 insertions(+), 12 deletions(-)
create mode 100644 defconfigs/lambdalabs
create mode 100644 defconfigs/lambdalabs-gpu-1x-a10
create mode 100644 defconfigs/lambdalabs-gpu-1x-a100
create mode 100644 defconfigs/lambdalabs-gpu-1x-h100
create mode 100644 defconfigs/lambdalabs-gpu-8x-a100
create mode 100644 defconfigs/lambdalabs-gpu-8x-h100
create mode 100644 defconfigs/lambdalabs-shared-key
create mode 100644 defconfigs/lambdalabs-smart
create mode 100644 docs/dynamic-cloud-kconfig.md
create mode 100644 docs/lambda-cli.1
create mode 100644 playbooks/roles/gen_tfvars/templates/lambdalabs/terraform.tfvars.j2
create mode 100755 scripts/cloud_list_all.sh
create mode 100644 scripts/dynamic-cloud-kconfig.Makefile
create mode 100755 scripts/generate_cloud_configs.py
create mode 100755 scripts/lambda-cli
create mode 100755 scripts/lambdalabs_api.py
create mode 100755 scripts/lambdalabs_credentials.py
create mode 100755 scripts/lambdalabs_infer_region.py
create mode 100755 scripts/lambdalabs_smart_inference.py
create mode 100755 scripts/lambdalabs_ssh_key_name.py
create mode 100755 scripts/lambdalabs_ssh_keys.py
create mode 100755 scripts/ssh_config_file_name.py
create mode 100755 scripts/update_ssh_config_lambdalabs.py
create mode 100644 terraform/lambdalabs/Kconfig
create mode 100644 terraform/lambdalabs/README.md
create mode 100644 terraform/lambdalabs/SET_API_KEY.sh
create mode 120000 terraform/lambdalabs/ansible_provision_cmd.tpl
create mode 100755 terraform/lambdalabs/extract_api_key.py
create mode 100644 terraform/lambdalabs/kconfigs/Kconfig.compute
create mode 100644 terraform/lambdalabs/kconfigs/Kconfig.identity
create mode 100644 terraform/lambdalabs/kconfigs/Kconfig.location
create mode 100644 terraform/lambdalabs/kconfigs/Kconfig.smart
create mode 100644 terraform/lambdalabs/kconfigs/Kconfig.storage
create mode 100644 terraform/lambdalabs/main.tf
create mode 100644 terraform/lambdalabs/output.tf
create mode 100644 terraform/lambdalabs/provider.tf
create mode 120000 terraform/lambdalabs/shared.tf
create mode 100644 terraform/lambdalabs/vars.tf
--
2.50.1
next reply other threads:[~2025-08-31 4:00 UTC|newest]
Thread overview: 12+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-08-31 3:59 Luis Chamberlain [this message]
2025-08-31 3:59 ` [PATCH v3 01/10] gitignore: add entries for Lambda Labs dynamic configuration Luis Chamberlain
2025-08-31 3:59 ` [PATCH v3 02/10] scripts: add Lambda Labs Python API library Luis Chamberlain
2025-08-31 3:59 ` [PATCH v3 03/10] scripts: add Lambda Labs testing and debugging utilities Luis Chamberlain
2025-08-31 3:59 ` [PATCH v3 04/10] scripts: add Lambda Labs credentials management Luis Chamberlain
2025-08-31 3:59 ` [PATCH v3 05/10] scripts: add Lambda Labs SSH key management utilities Luis Chamberlain
2025-08-31 4:00 ` [PATCH v3 06/10] kconfig: add dynamic cloud provider configuration infrastructure Luis Chamberlain
2025-08-31 4:00 ` [PATCH v3 07/10] terraform/lambdalabs: add Kconfig structure for Lambda Labs Luis Chamberlain
2025-08-31 4:00 ` [PATCH v3 08/10] terraform/lambdalabs: add terraform provider implementation Luis Chamberlain
2025-08-31 4:00 ` [PATCH v3 09/10] ansible/terraform: integrate Lambda Labs into build system Luis Chamberlain
2025-08-31 4:00 ` [PATCH v3 10/10] kconfigs: enable Lambda Labs cloud provider in menus Luis Chamberlain
2025-09-01 1:10 ` [PATCH v3 00/10] terraform: add Lambda Labs cloud provider support Luis Chamberlain
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20250831040004.2159779-1-mcgrof@kernel.org \
--to=mcgrof@kernel.org \
--cc=cel@kernel.org \
--cc=da.gomez@kruces.com \
--cc=kdevops@lists.linux.dev \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox