TaskRunnerSettings(mapping=None, *, ignore_unknown_fields=False, **kwargs)Taskrunner configuration settings.
Attributes |
|
|---|---|
| Name | Description |
task_user |
str
The UNIX user ID on the worker VM to use for tasks launched by taskrunner; e.g. "root". |
task_group |
str
The UNIX group ID on the worker VM to use for tasks launched by taskrunner; e.g. "wheel". |
oauth_scopes |
MutableSequence[str]
The OAuth2 scopes to be requested by the taskrunner in order to access the Cloud Dataflow API. |
base_url |
str
The base URL for the taskrunner to use when accessing Google Cloud APIs. When workers access Google Cloud APIs, they logically do so via relative URLs. If this field is specified, it supplies the base URL to use for resolving these relative URLs. The normative algorithm used is defined by RFC 1808, "Relative Uniform Resource Locators". If not specified, the default value is "http://www.googleapis.com/". |
dataflow_api_version |
str
The API version of endpoint, e.g. "v1b3". |
parallel_worker_settings |
google.cloud.dataflow_v1beta3.types.WorkerSettings
The settings to pass to the parallel worker harness. |
base_task_dir |
str
The location on the worker for task-specific subdirectories. |
continue_on_exception |
bool
Whether to continue taskrunner if an exception is hit. |
log_to_serialconsole |
bool
Whether to send taskrunner log info to Google Compute Engine VM serial console. |
alsologtostderr |
bool
Whether to also send taskrunner log info to stderr. |
log_upload_location |
str
Indicates where to put logs. If this is not specified, the logs will not be uploaded. The supported resource type is: Google Cloud Storage: storage.googleapis.com/{bucket}/{object} bucket.storage.googleapis.com/{object} |
log_dir |
str
The directory on the VM to store logs. |
temp_storage_prefix |
str
The prefix of the resources the taskrunner should use for temporary storage. The supported resource type is: Google Cloud Storage: storage.googleapis.com/{bucket}/{object} bucket.storage.googleapis.com/{object} |
harness_command |
str
The command to launch the worker harness. |
workflow_file_name |
str
The file to store the workflow in. |
commandlines_file_name |
str
The file to store preprocessing commands in. |
vm_id |
str
The ID string of the VM. |
language_hint |
str
The suggested backend language. |
streaming_worker_main_class |
str
The streaming worker main class name. |