Stay organized with collections
Save and categorize content based on your preferences.
Google Cloud provides open source Dataflow templates
that you can use to create Dataflow jobs. These jobs are based on
prebuilt Docker images for common use cases using the
Google Cloud console, the Google Cloud CLI, or REST API calls. This page lists the
available, Spanner-related Dataflow templates.
Batch templates
Use the following templates to process data in bulk:
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-08-07 UTC."],[],[],null,["# Dataflow templates\n\nGoogle Cloud provides [open source Dataflow templates](https://github.com/GoogleCloudPlatform/DataflowTemplates)\nthat you can use to create Dataflow jobs. These jobs are based on\nprebuilt Docker images for common use cases using the\nGoogle Cloud console, the Google Cloud CLI, or REST API calls. This page lists the\navailable, Spanner-related Dataflow templates.\n\nBatch templates\n---------------\n\nUse the following templates to process data in bulk:\n\n- [Any source database to Spanner](/dataflow/docs/guides/templates/provided/sourcedb-to-spanner)\n- [Cloud Storage Avro to Spanner](/dataflow/docs/guides/templates/provided/avro-to-cloud-spanner)\n- [Cloud Storage Text to Spanner](/dataflow/docs/guides/templates/provided/cloud-storage-to-cloud-spanner)\n- [Spanner to BigQuery](/dataflow/docs/guides/templates/provided/cloud-spanner-to-bigquery)\n- [Spanner to Cloud Storage Avro](/dataflow/docs/guides/templates/provided/cloud-spanner-to-avro)\n- [Spanner to Cloud Storage Text](/dataflow/docs/guides/templates/provided/cloud-spanner-to-cloud-storage)\n- [Spanner to Vertex AI Vector Search files on Cloud Storage](/dataflow/docs/guides/templates/provided/cloud-spanner-to-vertex-vector-search)\n\nFor more information about using these templates, see\n[Import, export, and modify data using Dataflow](/spanner/docs/dataflow-connector).\n\nStreaming templates\n-------------------\n\nUse the following templates to process data continuously:\n\n- [Datastream to Spanner](/dataflow/docs/guides/templates/provided/datastream-to-cloud-spanner)\n- [Spanner change streams to any source database](/dataflow/docs/guides/templates/provided/spanner-to-sourcedb)\n- [Spanner change streams to BigQuery](/dataflow/docs/guides/templates/provided/cloud-spanner-change-streams-to-bigquery)\n- [Spanner change streams to Cloud Storage](/dataflow/docs/guides/templates/provided/cloud-spanner-change-streams-to-cloud-storage)\n- [Spanner change streams to Pub/Sub](/dataflow/docs/guides/templates/provided/cloud-spanner-change-streams-to-pubsub)\n\nFor more information about using these templates, see\n[Build change streams connections using Dataflow](/spanner/docs/change-streams/use-dataflow).\n\nWhat's next\n-----------\n\n- [View the complete list of Google-provided templates.](/dataflow/docs/guides/templates/provided-templates)\n- [Learn more about Spanner change streams.](/spanner/docs/change-streams)"]]
