AIR CLI Integration: Scaffold experimental AIR CLI command package by riddhibhagwat-db · Pull Request #5564 · databricks/cli

riddhibhagwat-db · 2026-06-11T21:29:34Z

Changes

New cmd/experimental/air/ package containing an air parent command plus 7 stub subcommands: run, status, list, logs, cancel, register-image
currently, all subcommands return an air is not implemented yet error with representative flags mapped from the Python CLI. Registered under the hidden experimental group.
tools/list_embeds.py: text=True was changed to universal_newlines=True so the acceptance harness runs on Python 3.6. General tooling fix.

Why

The AI runtime CLI ships today as a separately installed Python wheel with its own auth, output, and packaging. Folding it into the main Go CLI gives users one databricks install with consistent profiles, authentication, and -o json output, and removes a parallel toolchain to maintain. Landing the package scaffold first lets the individual commands be ported in small, reviewable PRs (status is next) instead of one large drop. Every stub is wired and navigable, so the command tree and registration are reviewable now without functional code.

Tests

Unit (cmd/experimental/air/): New() registers all six subcommands; each stub returns the not-implemented error.
Acceptance (acceptance/experimental/air/unimplemented/): runs every stub end-to-end and asserts the message + non-zero exit.

test with:
go test ./cmd/experimental/air/...
go test ./acceptance -run 'TestAccept/experimental/air'

github-actions · 2026-06-11T21:30:09Z

Approval status: pending

`/acceptance/experimental/air/` - approved by `@maggiewang-db`

8 files changed

`/experimental/air/` - approved by `@maggiewang-db`

9 files changed

General files (require maintainer)

Files: Taskfile.yml, cmd/experimental/experimental.go
Based on git history:

@pietern -- recent work in ./

_{Any maintainer (@andrewnester, @anton-107, @denik, @pietern, @shreyas-goenka, @simonfaltum, @renaudhartert-db) can approve all areas.

See OWNERS for ownership rules.}

eng-dev-ecosystem-bot · 2026-06-11T22:18:16Z

Integration test report

Commit: e04b698

Run: 27646673676

	Env	🟨KNOWN	💚RECOVERED	🙈SKIP	✅pass	🙈skip	Time
💚	aws linux		7	15	264	996	6:11
🟨	aws windows	7		15	266	994	12:17
💚	aws-ucws linux		7	15	360	910	7:55
💚	aws-ucws windows		7	15	362	908	8:56
💚	azure linux		1	17	267	994	5:51
💚	azure windows		1	17	269	992	9:03
💚	azure-ucws linux		1	17	365	906	7:05
💚	azure-ucws windows		1	17	367	904	9:34
💚	gcp linux		1	17	263	997	6:14
💚	gcp windows		1	17	265	995	8:46

22 interesting tests: 15 SKIP, 7 KNOWN

	Test Name	aws linux	aws windows	aws-ucws linux	aws-ucws windows	azure linux	azure windows	azure-ucws linux	azure-ucws windows	gcp linux	gcp windows
🟨	TestAccept	💚R	🟨K	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
🙈	TestAccept/bundle/invariant/no_drift	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/permissions	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions	💚R	🟨K	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=direct	💚R	🟨K	💚R	💚R
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	💚R	🟨K	💚R	💚R
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions	💚R	🟨K	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=direct	💚R	🟨K	💚R	💚R
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	💚R	🟨K	💚R	💚R
🙈	TestAccept/bundle/resources/postgres_branches/basic	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_branches/recreate	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_branches/replace_existing	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_branches/update_protected	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_branches/without_branch_id	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_endpoints/basic	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_endpoints/recreate	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_projects/update_display_name	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/synced_database_tables/basic	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/vector_search_endpoints/drift/recreated_same_name	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/vector_search_indexes/basic	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/vector_search_indexes/grants/select	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/ssh/connection	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S

Top 24 slowest tests (at least 2 minutes):

duration	env	testname
4:52	gcp windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
4:39	gcp windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
4:32	gcp linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
4:30	gcp linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:43	azure-ucws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:26	aws-ucws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:24	azure windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:21	gcp windows	TestAccept
3:20	azure windows	TestAccept
3:18	aws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:06	azure-ucws windows	TestAccept
3:02	azure-ucws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:02	azure windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:55	aws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:54	aws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:48	azure linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:43	azure linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:43	azure-ucws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:40	aws-ucws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:38	azure-ucws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:32	aws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:31	aws-ucws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:31	aws-ucws windows	TestAccept
2:29	aws-ucws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct

simonfaltum

Thanks for the scaffold. The Go code itself is in good shape and the acceptance setup follows the existing patterns (the EnvMatrix override and the committed out.test.toml are exactly right). Requesting changes for three things:

The tools/list_embeds.py change needs to come out, see the inline comment. It's unrelated to this PR and the stated rationale doesn't match the repo.
Package location should follow the established experimental layout (experimental/air/cmd), see the inline comment.
The description needs fixing: it says 7 stub subcommands but lists and implements 6 (your own Tests section says six). Also drop the list_embeds.py bullet together with that change.

Two questions:

Which Python air CLI source/version were the flags mapped from? Please link it in the description; flag parity isn't verifiable from this repo.
Was a seventh subcommand intentionally dropped, or is "7" a typo?

The remaining inline comments (test assertion, help case, --retry help text, cancel args, test.toml defaults) are all quick fixes.

Add the experimental `air` command group as the Go port surface for the Python `air` CLI. Every subcommand (run, status, list, logs, cancel, register-image) is registered as a stub that returns a not-implemented error; the real implementations land in later milestones. The package lives under experimental/air/cmd (imported as aircmd), matching the layout of the other experimental features (aitools, genie, postgres); cmd/experimental/ keeps only the dispatcher. TEST_PACKAGES in Taskfile.yml gains ./experimental/air/... so the unit tests keep running after the move. Includes unit tests for the command-tree wiring and the not-implemented stubs, plus an acceptance test exercising the stubs end-to-end. Co-authored-by: Isaac

riddhibhagwat-db · 2026-06-12T22:58:20Z

Thanks for the review, I have made the changes and updated the branch with the changes. Regarding your questions:

Which Python air CLI source/version were the flags mapped from? Please link it in the description; flag parity isn't verifiable from this repo.

Individual command flags:

Global flags:

Was a seventh subcommand intentionally dropped, or is "7" a typo?

Yes, the seventh subcommand in the original air CLI is the version command that we decided to drop. This is why the description said 7 rather than 6, which was a mistype on my part while opening this PR.

One more thing I updated: the latest name for the status command is get, so just adding in that renaming in the latest commit.

Rename the run-details subcommand from `status` to `get`, matching the Python air CLI's current `air get run` naming (it replaced `get status`). Renames the file, constructor, command name, and updates the stub/help/unimplemented tests and goldens accordingly. Co-authored-by: Isaac

ben-hansen-db

LGTM with one nit that affects a couple places

ben-hansen-db · 2026-06-15T21:47:36Z

+	cmd.Args = func(cmd *cobra.Command, args []string) error {
+		switch {
+		case all && len(args) > 0:
+			return &root.InvalidArgsError{Command: cmd, Message: "cannot combine RUN_ID arguments with --all"}


nit: to disambiguate with mlflow run ID say JOB_RUN_ID here and below

fixed, thanks!

pardis-beikzadeh-db · 2026-06-16T11:32:39Z

+	cmd.Flags().IntVar(&lines, "lines", 10000, "For completed runs, print the last N lines")
+	cmd.Flags().IntVar(&retry, "retry", -1, "View logs from a specific retry attempt; -1 means latest")
+	cmd.Flags().StringVar(&downloadTo, "download-to", "", "Download all logs to this directory instead of printing")
+	cmd.Flags().BoolVar(&review, "review", false, "Download logs from all nodes and filter for error signatures")


--review is hidden in the Python CLI (help=argparse.SUPPRESS). If it's meant to stay internal, add cmd.Flags().MarkHidden("review") to match.

fixed, thanks for the catch!

pardis-beikzadeh-db · 2026-06-16T11:32:39Z

+
+	cmd.Flags().StringVar(&scope, "scope", "", "Databricks secret scope holding registry credentials")
+	cmd.Flags().StringVar(&key, "key", "", "Databricks secret key holding registry credentials")
+	cmd.Flags().BoolVar(&interactiveAuth, "interactive-authenticate", false, "Prompt for registry credentials and store them as a secret")


Python exposes both -i and --interactive-authenticate; the -i short alias was dropped here. Consider BoolVarP(&interactiveAuth, "interactive-authenticate", "i", ...).

fixed, thanks for the catch!

Rename the RUN_ID arg placeholder to JOB_RUN_ID across get/logs/cancel to disambiguate it from other run identifiers. Hide the `logs --review` flag to match the Python CLI (help=argparse.SUPPRESS), and add the `-i` shorthand for `register-image --interactive-authenticate`. Co-authored-by: Isaac

riddhibhagwat-db requested review from maggiewang-db and simonfaltum June 11, 2026 21:29

riddhibhagwat-db temporarily deployed to test-trigger-is June 11, 2026 21:30 — with GitHub Actions Inactive

maggiewang-db approved these changes Jun 12, 2026

View reviewed changes

simonfaltum requested changes Jun 12, 2026

View reviewed changes

riddhibhagwat-db force-pushed the air-integration-m0 branch from 0474207 to 3ff5a77 Compare June 12, 2026 18:18

riddhibhagwat-db temporarily deployed to test-trigger-is June 12, 2026 18:18 — with GitHub Actions Inactive

riddhibhagwat-db force-pushed the air-integration-m0 branch from 3ff5a77 to 30d284d Compare June 12, 2026 18:52

riddhibhagwat-db temporarily deployed to test-trigger-is June 12, 2026 18:53 — with GitHub Actions Inactive

riddhibhagwat-db force-pushed the air-integration-m0 branch from 30d284d to d8652c2 Compare June 12, 2026 19:03

riddhibhagwat-db temporarily deployed to test-trigger-is June 12, 2026 19:04 — with GitHub Actions Inactive

riddhibhagwat-db force-pushed the air-integration-m0 branch from d8652c2 to 8462709 Compare June 12, 2026 19:07

riddhibhagwat-db temporarily deployed to test-trigger-is June 12, 2026 19:08 — with GitHub Actions Inactive

riddhibhagwat-db force-pushed the air-integration-m0 branch from 8462709 to 80144e6 Compare June 12, 2026 19:08

riddhibhagwat-db temporarily deployed to test-trigger-is June 12, 2026 19:09 — with GitHub Actions Inactive

riddhibhagwat-db force-pushed the air-integration-m0 branch from 80144e6 to d96e64f Compare June 12, 2026 20:35

riddhibhagwat-db temporarily deployed to test-trigger-is June 12, 2026 20:36 — with GitHub Actions Inactive

riddhibhagwat-db force-pushed the air-integration-m0 branch from d96e64f to 6c80f23 Compare June 12, 2026 20:41

riddhibhagwat-db temporarily deployed to test-trigger-is June 12, 2026 20:41 — with GitHub Actions Inactive

riddhibhagwat-db requested a review from simonfaltum June 12, 2026 21:53

riddhibhagwat-db temporarily deployed to test-trigger-is June 12, 2026 23:14 — with GitHub Actions Inactive

riddhibhagwat-db requested a review from ben-hansen-db June 15, 2026 18:11

ben-hansen-db approved these changes Jun 15, 2026

View reviewed changes

pardis-beikzadeh-db reviewed Jun 16, 2026

View reviewed changes

riddhibhagwat-db temporarily deployed to test-trigger-is June 16, 2026 18:30 — with GitHub Actions Inactive

Merge branch 'main' into air-integration-m0

8a97e0f

riddhibhagwat-db temporarily deployed to test-trigger-is June 16, 2026 18:37 — with GitHub Actions Inactive

riddhibhagwat-db enabled auto-merge June 16, 2026 18:38

Merge branch 'main' into air-integration-m0

e04b698

riddhibhagwat-db temporarily deployed to test-trigger-is June 16, 2026 20:39 — with GitHub Actions Inactive

Conversation

riddhibhagwat-db commented Jun 11, 2026

Changes

Why

Tests

Uh oh!

github-actions Bot commented Jun 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Approval status: pending

/acceptance/experimental/air/ - approved by @maggiewang-db

/experimental/air/ - approved by @maggiewang-db

General files (require maintainer)

Uh oh!

eng-dev-ecosystem-bot commented Jun 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Integration test report

Uh oh!

simonfaltum left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

riddhibhagwat-db commented Jun 12, 2026

Uh oh!

ben-hansen-db left a comment

Choose a reason for hiding this comment

Uh oh!

ben-hansen-db Jun 15, 2026

Choose a reason for hiding this comment

Uh oh!

riddhibhagwat-db Jun 16, 2026

Choose a reason for hiding this comment

Uh oh!

pardis-beikzadeh-db Jun 16, 2026

Choose a reason for hiding this comment

Uh oh!

riddhibhagwat-db Jun 16, 2026

Choose a reason for hiding this comment

Uh oh!

pardis-beikzadeh-db Jun 16, 2026

Choose a reason for hiding this comment

Uh oh!

riddhibhagwat-db Jun 16, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

github-actions Bot commented Jun 11, 2026 •

edited

Loading

`/acceptance/experimental/air/` - approved by `@maggiewang-db`

`/experimental/air/` - approved by `@maggiewang-db`

eng-dev-ecosystem-bot commented Jun 11, 2026 •

edited

Loading