This document describes how to integrate data sources with BigQuery universal catalog. Dataplex can import and maintain up-to-date universal catalog metadata from Google Cloud data sources.
With metadata ingested, Dataplex does the following:
- Makes the existing metadata discoverable through search. For more information, see Search for data assets in universal catalog.
- Allows the members of your organization to enrich your data with additional business metadata by using aspects. For more information, see Manage aspects and enrich metadata.
Before you begin
- Sign in to your Google Cloud account. If you're new to Google Cloud, create an account to evaluate how our products perform in real-world scenarios. New customers also get $300 in free credits to run, test, and deploy workloads.
-
In the Google Cloud console, on the project selector page, select or create a Google Cloud project.
-
Make sure that billing is enabled for your Google Cloud project.
-
Enable the Dataplex API.
-
In the Google Cloud console, on the project selector page, select or create a Google Cloud project.
-
Make sure that billing is enabled for your Google Cloud project.
-
Enable the Dataplex API.
Integrate Cloud SQL
After you enable the universal catalog integration on your Cloud SQL instance, universal catalog automatically retrieves metadata from Cloud SQL resources, including instances, databases, tables, columns, and views.
Universal catalog retrieves metadata only from Cloud SQL primary instances and not from read replicas.
For more information, see Manage your Cloud SQL resources using BigQuery universal catalog.
What's next
- Learn how to search for resources in universal catalog.
- Learn more about universal catalog.
- Learn how to enrich entries with metadata by using aspects.
- Learn how to manage entries and ingest custom sources.