Google Cloud provides open source Dataflow templates that you can use to create Dataflow jobs. These jobs are based on prebuilt Docker images for common use cases using the Google Cloud console, the Google Cloud CLI, or REST API calls. This page lists the available, Spanner-related Dataflow templates.
Batch templates
Use the following templates to process data in bulk:
- Any source database to Spanner
- Cloud Storage Avro to Spanner
- Cloud Storage Text to Spanner
- Spanner to BigQuery
- Spanner to Cloud Storage Avro
- Spanner to Cloud Storage Text
- Spanner to Vertex AI Vector Search files on Cloud Storage
For more information about using these templates, see Import, export, and modify data using Dataflow.
Streaming templates
Use the following templates to process data continuously:
- Datastream to Spanner
- Spanner change streams to any source database
- Spanner change streams to BigQuery
- Spanner change streams to Cloud Storage
- Spanner change streams to Pub/Sub
For more information about using these templates, see Build change streams connections using Dataflow.