Skip to content
This repository was archived by the owner on Oct 13, 2026. It is now read-only.

fix: Adding Cloud Build Python Integration Tests - #1082

Merged
sundar-mudupalli-work merged 20 commits into
mainfrom
issue-1081-use-cloud-build-python
Nov 8, 2025
Merged

sundar-mudupalli-work merged 20 commits into
mainfrom
issue-1081-use-cloud-build-python

Conversation

@sundar-mudupalli-work

@sundar-mudupalli-work sundar-mudupalli-work commented Nov 7, 2025 •

Copy link
Copy Markdown
Contributor

Hi,

This change implements Python Integration Tests using CloudBuild.yaml. There are 17 templates that have tests and the jdbc templates have tests using and not using secrets. They all pass, see build output.

In addition Cloud build has a few other enhancements:

  1. Use of environment variable - GCS_DEPS_BUCKET that is used as a temporary bucket and as the --deps-bucket parameter to gcloud dataproc batches submit command
  2. All other references to locations in Cloud Storage are in one bucket - gs://dataproc-templates_cloudbuild/ with prefixes like jars, conf, integration-testing-python.

Once this is merged into main a nightly trigger can be set up to run these tests.

Sundar Mudupalli

@shashank-google shashank-google self-assigned this Nov 8, 2025
@shashank-google
shashank-google self-requested a review November 8, 2025 05:28
@shashank-google shashank-google removed their assignment Nov 8, 2025
@sundar-mudupalli-work
sundar-mudupalli-work merged commit 2d12000 into main Nov 8, 2025
12 checks passed
@sundar-mudupalli-work
sundar-mudupalli-work deleted the issue-1081-use-cloud-build-python branch November 8, 2025 05:48
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants