After you define, build, and run a pipeline, you can view and query log entries for your pipeline job and pipeline tasks. Learn more about log entries for the Vertex AI API.
This feature has costs associated with it. Learn more about Cloud Logging pricing.
View Vertex AI logs for pipeline jobs
Use the following instructions to view logs for your Vertex AI Pipelines jobs in the Google Cloud console or the Google Cloud CLI.
Console
Enable the Cloud Logging API:
In the Google Cloud console, go to the Logs Explorer:
Select an existing Vertex AI project at the top of the page.
In the Query builder, add the following:
- Resource: Select Vertex Pipelines Job. In the dialog, select a Vertex AI Pipelines job.
- Log names: In the Vertex AI section, select
aiplatform.googlapis.com/pipeline_job_events. - Severity: Select a log level.
- Time range: Select a preset range or create a custom range.
gcloud
Run the following command to enable the Cloud Logging API:
gcloud services enable logging.googleapis.comExecute the gcloud logging read command:
Linux, macOS, or Cloud Shell
gcloud logging read "projects/PROJECT_ID/logs/aiplatform.googleapis.com/pipeline_job_events" \ --limit=LIMIT
Windows (PowerShell)
gcloud logging read "projects/PROJECT_ID/logs/aiplatform.googleapis.com/pipeline_job_events" ` --limit=LIMIT
Windows (cmd.exe)
gcloud logging read "projects/PROJECT_ID/logs/aiplatform.googleapis.com/pipeline_job_events" ^ --limit=LIMIT
View Vertex AI logs for pipeline tasks
Use the following instructions to view logs for your Vertex AI Pipelines tasks in the Google Cloud console or the Google Cloud CLI.
Console
Enable the Cloud Logging API:
In the Google Cloud console, go to the Logs Explorer:
Select an existing Vertex AI project at the top of the page.
In the Query builder, add the following:
- Resource: Select Vertex Pipelines Job. In the dialog, select a Vertex AI Pipelines job.
- Log names: In the Vertex AI section, select
aiplatform.googlapis.com/pipeline_job_task_events. - Severity: Select a log level.
- Time range: Select a preset range or create a custom range.
gcloud
Run the following command to enable the Cloud Logging API:
gcloud services enable logging.googleapis.comExecute the gcloud logging read command:
Linux, macOS, or Cloud Shell
gcloud logging read "projects/PROJECT_ID/logs/aiplatform.googleapis.com/pipeline_job_task_events" \ --limit=LIMIT
Windows (PowerShell)
gcloud logging read "projects/PROJECT_ID/logs/aiplatform.googleapis.com/pipeline_job_task_events" ` --limit=LIMIT
Windows (cmd.exe)
gcloud logging read "projects/PROJECT_ID/logs/aiplatform.googleapis.com/pipeline_job_task_events" ^ --limit=LIMIT
What's next
Learn how to view pipeline metrics.
Learn how to create custom metrics in the Logs Explorer to monitor the pipeline job failure rate.
Learn how to configure email notifications.