Google Cloud Dataflow V1beta3 Client - Class StreamingMode (0.8.1)

Reference documentation and code samples for the Google Cloud Dataflow V1beta3 Client class StreamingMode.

Specifies the Streaming Engine message processing guarantees. Reduces cost and latency but might result in duplicate messages written to storage.

Designed to run simple mapping streaming ETL jobs at the lowest cost. For example, Change Data Capture (CDC) to BigQuery is a canonical use case. For more information, see Set the pipeline streaming mode.

Protobuf type google.dataflow.v1beta3.StreamingMode

Namespace

Google \ Cloud \ Dataflow \ V1beta3

Methods

static::name

Parameter
Name	Description
`value`	`mixed`

static::value

Parameter
Name	Description
`name`	`mixed`

Constants

STREAMING_MODE_UNSPECIFIED

Value: 0

Run in the default mode.

Generated from protobuf enum STREAMING_MODE_UNSPECIFIED = 0;

STREAMING_MODE_EXACTLY_ONCE

Value: 1

In this mode, message deduplication is performed against persistent state to make sure each message is processed and committed to storage exactly once.

Generated from protobuf enum STREAMING_MODE_EXACTLY_ONCE = 1;

STREAMING_MODE_AT_LEAST_ONCE

Value: 2

Message deduplication is not performed. Messages might be processed multiple times, and the results are applied multiple times.

Note: Setting this value also enables Streaming Engine and Streaming Engine resource-based billing.

Generated from protobuf enum STREAMING_MODE_AT_LEAST_ONCE = 2;