Skip to content

Conversation

@googlyrahman
Copy link
Member

Automated: Migrate paths from gsutil to gcloud storage

This CL is part of the on going effort to migrate from the legacy gsutil tool to the new and improved gcloud storage command-line interface. gcloud storage is the recommended and modern tool for interacting with Google Cloud Storage, offering better performance, unified authentication, and a more consistent command structure with other gcloud components. 🚀

Automation Details

This change was generated automatically by an agent that targets users of gsutil.
The transformations applied are based on the gsutil to gcloud storage migration guide.

⚠️ Action Required: Please Review and Test Carefully

While we have based the automation on the migration guide, every use case is unique.
It is crucial that you thoroughly test these changes in environments appropriate to your use-case before merging.
Be aware of potential differences between gsutil and gcloud storage that could impact your workflows.
For instance, the structure of command output may have changed, requiring updates to any scripts that parse it. Similarly, command behavior can differ subtly; the gcloud storage rsync command has a different file deletion logic than gsutil rsync, which could lead to unintended file deletions.

Our migration guides can help guide you through a list of mappings and some notable differences between the two tools.

Standard presubmit tests are run as part of this CL's workflow. If you need to target an additional test workflow or require assistance with testing, please let us know.

Please verify that all your Cloud Storage operations continue to work as expected to avoid any potential disruptions in production.

Support and Collaboration

The GCS CLI team is here to help! If you encounter any issues, have a complex use case that this automated change doesn't cover, or face any other blockers, please don't hesitate to reach out.
We are happy to work with you to test and adjust these changes as needed.

Contact: [email protected]

We appreciate your partnership in this important migration effort!

cc: @sushantkhanna

@googlyrahman
Copy link
Member Author

Hi @jlpalomino, Can we get your review on this PR? Thanks!

@googlyrahman
Copy link
Member Author

Here are comments from Mike about these files:For courses/machine_learning/asl/open_project/cloud_composer_automated_ml_pipeline_taxifare/airflow/dags/subdag/preprocess.py: ASL (reassign if necessary)

For courses/machine_learning/asl/open_project/cloud_composer_automated_ml_pipeline_taxifare/airflow/dags/subdag/training.py: ASL (reassign if necessary)

For courses/machine_learning/asl/open_project/ASL_youtube8m_models/video/youtube_8m_video_level.ipynb: ASL (reassign if necessary)

For courses/machine_learning/asl/open_project/ASL_youtube8m_models/frame/youtube_8m_frame_level.ipynb: ASL (reassign if necessary)

For courses/machine_learning/asl/open_project/ASL_youtube8m_models/video_using_datasets/youtube_8m_video_level_datasets.ipynb: ASL (reassign if necessary)

For courses/machine_learning/feateng/feateng.ipynb: ASL?

For courses/machine_learning/feateng/asl_2.0_feat_eng-old.ipynb: ASL?

For courses/machine_learning/feateng/tftransform.ipynb: ASL?

For courses/machine_learning/feateng/hyperparam.ipynb: ASL?

For courses/machine_learning/feateng/asl_2.0_feat_eng.ipynb: ASL?

@googlyrahman
Copy link
Member Author

Category: High Risk

Reason: #2970 (comment)

@googlyrahman googlyrahman force-pushed the refactor-ai-migration-4ed02b871c934d25a7fb7f673f4ec1c2 branch from eaf2a9a to 41c4dac Compare October 31, 2025 06:50
@googlyrahman googlyrahman force-pushed the refactor-ai-migration-4ed02b871c934d25a7fb7f673f4ec1c2 branch from f21a8c9 to 3100296 Compare October 31, 2025 07:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant