You can modify the following information about a stream:
- High-level information, such as the display name and labels for the stream.
Configuration information for the source database and the destination, such as the tables and schemas in the source database that Datastream will either transfer to the destination or will be restricted from transferring into the destination. Datastream uses this configuration information to transfer the correct data from the source database to the destination.
Modify high-level information
Go to the Streams page in the Google Cloud Console.
Click the stream that you want to modify.
On the Stream details page, click EDIT.
Select Edit stream settings from the menu that appears.
Modify the display name or labels for the stream.
After making your changes, click SAVE.
Modify configuration information about the source database
Go to the Streams page in the Google Cloud Console.
Click the stream that you want to modify.
On the Stream details page, click EDIT.
Select Edit source configuration from the menu that appears.
In the Select objects to include section, use the Objects to include drop-down menu to change the tables and schemas in the source database that Datastream will transfer to the destination.
Optionally, expand the Select objects to exclude node. In the Objects to exclude field, modify the tables and schemas in the source database that you want to restrict Datastream from transferring into the destination. If tables are added to this list, then they're no longer pulled into the destination. However, they're not removed from the destination.
Note that for Oracle sources, you can't modify the CDC method. However, you can change the database directories details, if you selected this log file access type.
Optionally, expand the Choose backfill mode for historical data node to modify whether Datastream backfills the destination with current and future data from the source, or streams only changes to this data.
Select the Automatic option to stream all existing data, in addition to changes to the data, from the source into the destination.
If you select this option, then in the Objects excluded from automatic backfill field, you can modify the tables and schemas in the source database that you want to restrict Datastream from backfilling into the destination.
Select the Manual option to stream only changes to the data.
After making your changes, click SAVE.
Modify configuration information about the destination
Go to the Streams page in the Google Cloud Console.
Click the stream that you want to modify.
On the Stream details page, click EDIT.
Select Edit destination configuration from the menu that appears.
Depending on the destination that you selected, adjust the following settings as required:
BigQuery destinations:
- Under Encryption, change the type of encryption that you want to use: Google-managed encryption key or Cloud Key Management Service key.
- Under Balance data staleness and BigQuery costs, change the Staleness limit option.
BigLake Iceberg tables destinations:
- Under Encryption, change the type of encryption that you want to use: Google-managed encryption key or Cloud Key Management Service key.
Cloud Storage destinations:
- In the Stream path prefix field, modify the folder of the destination into which Datastream will transfer schemas, tables, and data from the source database.
- From the Output format menu:
- Choose the format of files written to Cloud Storage. Datastream supports two output formats: Avro and JSON.
- If you select the JSON format, then select or clear the Include a Unified Types schema file in the file path and Enable gzip compression check boxes.
Click SAVE to apply your changes and start your stream. Any modifications that you make to streams that are running are updated by Datastream automatically.
What's next
- To learn more about streams, see Stream lifecycle.
- To learn how to monitor a stream, see Monitor a stream.
- To learn how to view information about your stream, see View a stream.
- To learn how to recover a failed stream, see Recover a stream.
- To learn how to delete an existing stream, see Delete a stream.