Back up and restore files by using Cloud Storage
This page describes how to use Cloud Storage to back up and restore files on your Vertex AI Workbench instance.
Overview
This guide describes two ways to use Cloud Storage to help you back up and restore files on your Vertex AI Workbench instance:
Mount a Cloud Storage bucket to your Vertex AI Workbench instance.
Export your files to Cloud Storage and then restore them.
Before you begin
- Sign in to your Google Cloud account. If you're new to Google Cloud, create an account to evaluate how our products perform in real-world scenarios. New customers also get $300 in free credits to run, test, and deploy workloads.
-
In the Google Cloud console, on the project selector page, select or create a Google Cloud project.
-
Make sure that billing is enabled for your Google Cloud project.
-
Enable the Notebooks API.
-
In the Google Cloud console, on the project selector page, select or create a Google Cloud project.
-
Make sure that billing is enabled for your Google Cloud project.
-
Enable the Notebooks API.
Required roles
To get the permissions that you need to mount a Cloud Storage bucket to a Vertex AI Workbench instance, ask your administrator to grant you the following IAM roles on the project:
-
Notebooks Runner (
roles/notebooks.runner
) -
Storage Object User (
roles/storage.objectUser
)
For more information about granting roles, see Manage access to projects, folders, and organizations.
You might also be able to get the required permissions through custom roles or other predefined roles.
Mount a Cloud Storage bucket
Vertex AI Workbench instances include a Cloud Storage integration that lets you mount a Cloud Storage bucket. This means you can browse the contents of the bucket and work with compatible files from within the JupyterLab interface.
You can access any of the Cloud Storage buckets and files that your instance has access to within the same project as your Vertex AI Workbench instance.
Required permission for enabling shared storage mounting
To enable shared storage mounting in your Vertex AI Workbench instance,
ask your administrator to grant your Vertex AI Workbench instance's
service account the storage.buckets.list
permission on the project.
The storage.buckets.list
permission is required for the
Mount shared storage button to appear in the JupyterLab interface of your
Vertex AI Workbench instance.
Create a bucket and a Vertex AI Workbench instance
You must have access to at least one Cloud Storage bucket in the same project as your Vertex AI Workbench instance.- If you need to create a Cloud Storage bucket, see Create a bucket.
- If you haven't already, create a Vertex AI Workbench instance in the same project as your Cloud Storage bucket.
Open JupyterLab
-
In the Google Cloud console, go to the Instances page.
-
Next to your Vertex AI Workbench instance's name, click Open JupyterLab.
Your Vertex AI Workbench instance opens JupyterLab.
Mount the Cloud Storage bucket
To mount and then access a Cloud Storage bucket, do the following:
-
In JupyterLab, make sure the
File Browser tab is selected. -
In the left sidebar, click the
Mount shared storage button. If you don't see the button, drag the right side of the sidebar to expand the sidebar until you see the button. -
In the Bucket name field, enter the Cloud Storage bucket name that you want to mount.
-
Click Mount.
-
Your Cloud Storage bucket appears as a folder in the File browser tab of the left sidebar. Double-click the folder to open it and browse the contents.
Export to and restore files from Cloud Storage
This section describes how to export files to Cloud Storage and restore files located in a Cloud Storage bucket.
Export to Cloud Storage
-
In the Google Cloud console, go to the Instances page.
-
Next to your Vertex AI Workbench instance's name, click Open JupyterLab.
Your Vertex AI Workbench instance opens JupyterLab.
-
In JupyterLab, make sure the
File Browser tab is selected. -
In the left sidebar, click the
Export to GCS button. If you don't see the button, drag the right side of the sidebar to expand the sidebar until you see the button. -
In the Provide export location dialog, enter a Cloud Storage bucket name that you want to export files to. If you need to create a Cloud Storage bucket, see Create a bucket.
Vertex AI Workbench opens a new notebook that includes code for exporting your instance's files to Cloud Storage.
-
Run the code in this cell.
Restore files from Cloud Storage
To restore a file to your Vertex AI Workbench instance, you can use gcloud storage cp to copy the file.
Run the following code in a cell of one of your instance's notebooks:
!gcloud storage cp URI /home/jupyter/FILE_NAME
Replace the following:
URI
: the gsutil URI of the file that you want to copy, for example: gs://BUCKET_NAME/ZONE/INSTANCE_ID/FILE_NAMEFILE_NAME
: the name of the file to copy
For more information, see Download the object from your bucket.