Class Task.SparkTaskConfig.Builder (0.16.0)

public static final class Task.SparkTaskConfig.Builder extends GeneratedMessageV3.Builder<Task.SparkTaskConfig.Builder> implements Task.SparkTaskConfigOrBuilder

User-specified config for running a Spark task.

Protobuf type google.events.cloud.dataplex.v1.Task.SparkTaskConfig

Static Methods

getDescriptor()

public static final Descriptors.Descriptor getDescriptor()
Returns
Type Description
Descriptor

Methods

addAllArchiveUris(Iterable<String> values)

public Task.SparkTaskConfig.Builder addAllArchiveUris(Iterable<String> values)

Optional. Cloud Storage URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

repeated string archive_uris = 4;

Parameter
Name Description
values Iterable<String>

The archiveUris to add.

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

addAllFileUris(Iterable<String> values)

public Task.SparkTaskConfig.Builder addAllFileUris(Iterable<String> values)

Optional. Cloud Storage URIs of files to be placed in the working directory of each executor.

repeated string file_uris = 3;

Parameter
Name Description
values Iterable<String>

The fileUris to add.

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

addArchiveUris(String value)

public Task.SparkTaskConfig.Builder addArchiveUris(String value)

Optional. Cloud Storage URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

repeated string archive_uris = 4;

Parameter
Name Description
value String

The archiveUris to add.

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

addArchiveUrisBytes(ByteString value)

public Task.SparkTaskConfig.Builder addArchiveUrisBytes(ByteString value)

Optional. Cloud Storage URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

repeated string archive_uris = 4;

Parameter
Name Description
value ByteString

The bytes of the archiveUris to add.

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

addFileUris(String value)

public Task.SparkTaskConfig.Builder addFileUris(String value)

Optional. Cloud Storage URIs of files to be placed in the working directory of each executor.

repeated string file_uris = 3;

Parameter
Name Description
value String

The fileUris to add.

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

addFileUrisBytes(ByteString value)

public Task.SparkTaskConfig.Builder addFileUrisBytes(ByteString value)

Optional. Cloud Storage URIs of files to be placed in the working directory of each executor.

repeated string file_uris = 3;

Parameter
Name Description
value ByteString

The bytes of the fileUris to add.

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

addRepeatedField(Descriptors.FieldDescriptor field, Object value)

public Task.SparkTaskConfig.Builder addRepeatedField(Descriptors.FieldDescriptor field, Object value)
Parameters
Name Description
field FieldDescriptor
value Object
Returns
Type Description
Task.SparkTaskConfig.Builder
Overrides

build()

public Task.SparkTaskConfig build()
Returns
Type Description
Task.SparkTaskConfig

buildPartial()

public Task.SparkTaskConfig buildPartial()
Returns
Type Description
Task.SparkTaskConfig

clear()

public Task.SparkTaskConfig.Builder clear()
Returns
Type Description
Task.SparkTaskConfig.Builder
Overrides

clearArchiveUris()

public Task.SparkTaskConfig.Builder clearArchiveUris()

Optional. Cloud Storage URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

repeated string archive_uris = 4;

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

clearDriver()

public Task.SparkTaskConfig.Builder clearDriver()
Returns
Type Description
Task.SparkTaskConfig.Builder

clearField(Descriptors.FieldDescriptor field)

public Task.SparkTaskConfig.Builder clearField(Descriptors.FieldDescriptor field)
Parameter
Name Description
field FieldDescriptor
Returns
Type Description
Task.SparkTaskConfig.Builder
Overrides

clearFileUris()

public Task.SparkTaskConfig.Builder clearFileUris()

Optional. Cloud Storage URIs of files to be placed in the working directory of each executor.

repeated string file_uris = 3;

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

clearInfrastructureSpec()

public Task.SparkTaskConfig.Builder clearInfrastructureSpec()

Optional. Infrastructure specification for the execution.

.google.events.cloud.dataplex.v1.Task.InfrastructureSpec infrastructure_spec = 6;

Returns
Type Description
Task.SparkTaskConfig.Builder

clearMainClass()

public Task.SparkTaskConfig.Builder clearMainClass()

The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in jar_file_uris. The execution args are passed in as a sequence of named process arguments (--key=value).

string main_class = 101;

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

clearMainJarFileUri()

public Task.SparkTaskConfig.Builder clearMainJarFileUri()

The Cloud Storage URI of the jar file that contains the main class. The execution args are passed in as a sequence of named process arguments (--key=value).

string main_jar_file_uri = 100;

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

clearOneof(Descriptors.OneofDescriptor oneof)

public Task.SparkTaskConfig.Builder clearOneof(Descriptors.OneofDescriptor oneof)
Parameter
Name Description
oneof OneofDescriptor
Returns
Type Description
Task.SparkTaskConfig.Builder
Overrides

clearPythonScriptFile()

public Task.SparkTaskConfig.Builder clearPythonScriptFile()

The Gcloud Storage URI of the main Python file to use as the driver. Must be a .py file. The execution args are passed in as a sequence of named process arguments (--key=value).

string python_script_file = 102;

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

clearSqlScript()

public Task.SparkTaskConfig.Builder clearSqlScript()

The query text. The execution args are used to declare a set of script variables (set key="value";).

string sql_script = 105;

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

clearSqlScriptFile()

public Task.SparkTaskConfig.Builder clearSqlScriptFile()

A reference to a query file. This can be the Cloud Storage URI of the query file or it can the path to a SqlScript Content. The execution args are used to declare a set of script variables (set key="value";).

string sql_script_file = 104;

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

clone()

public Task.SparkTaskConfig.Builder clone()
Returns
Type Description
Task.SparkTaskConfig.Builder
Overrides

getArchiveUris(int index)

public String getArchiveUris(int index)

Optional. Cloud Storage URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

repeated string archive_uris = 4;

Parameter
Name Description
index int

The index of the element to return.

Returns
Type Description
String

The archiveUris at the given index.

getArchiveUrisBytes(int index)

public ByteString getArchiveUrisBytes(int index)

Optional. Cloud Storage URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

repeated string archive_uris = 4;

Parameter
Name Description
index int

The index of the value to return.

Returns
Type Description
ByteString

The bytes of the archiveUris at the given index.

getArchiveUrisCount()

public int getArchiveUrisCount()

Optional. Cloud Storage URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

repeated string archive_uris = 4;

Returns
Type Description
int

The count of archiveUris.

getArchiveUrisList()

public ProtocolStringList getArchiveUrisList()

Optional. Cloud Storage URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

repeated string archive_uris = 4;

Returns
Type Description
ProtocolStringList

A list containing the archiveUris.

getDefaultInstanceForType()

public Task.SparkTaskConfig getDefaultInstanceForType()
Returns
Type Description
Task.SparkTaskConfig

getDescriptorForType()

public Descriptors.Descriptor getDescriptorForType()
Returns
Type Description
Descriptor
Overrides

getDriverCase()

public Task.SparkTaskConfig.DriverCase getDriverCase()
Returns
Type Description
Task.SparkTaskConfig.DriverCase

getFileUris(int index)

public String getFileUris(int index)

Optional. Cloud Storage URIs of files to be placed in the working directory of each executor.

repeated string file_uris = 3;

Parameter
Name Description
index int

The index of the element to return.

Returns
Type Description
String

The fileUris at the given index.

getFileUrisBytes(int index)

public ByteString getFileUrisBytes(int index)

Optional. Cloud Storage URIs of files to be placed in the working directory of each executor.

repeated string file_uris = 3;

Parameter
Name Description
index int

The index of the value to return.

Returns
Type Description
ByteString

The bytes of the fileUris at the given index.

getFileUrisCount()

public int getFileUrisCount()

Optional. Cloud Storage URIs of files to be placed in the working directory of each executor.

repeated string file_uris = 3;

Returns
Type Description
int

The count of fileUris.

getFileUrisList()

public ProtocolStringList getFileUrisList()

Optional. Cloud Storage URIs of files to be placed in the working directory of each executor.

repeated string file_uris = 3;

Returns
Type Description
ProtocolStringList

A list containing the fileUris.

getInfrastructureSpec()

public Task.InfrastructureSpec getInfrastructureSpec()

Optional. Infrastructure specification for the execution.

.google.events.cloud.dataplex.v1.Task.InfrastructureSpec infrastructure_spec = 6;

Returns
Type Description
Task.InfrastructureSpec

The infrastructureSpec.

getInfrastructureSpecBuilder()

public Task.InfrastructureSpec.Builder getInfrastructureSpecBuilder()

Optional. Infrastructure specification for the execution.

.google.events.cloud.dataplex.v1.Task.InfrastructureSpec infrastructure_spec = 6;

Returns
Type Description
Task.InfrastructureSpec.Builder

getInfrastructureSpecOrBuilder()

public Task.InfrastructureSpecOrBuilder getInfrastructureSpecOrBuilder()

Optional. Infrastructure specification for the execution.

.google.events.cloud.dataplex.v1.Task.InfrastructureSpec infrastructure_spec = 6;

Returns
Type Description
Task.InfrastructureSpecOrBuilder

getMainClass()

public String getMainClass()

The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in jar_file_uris. The execution args are passed in as a sequence of named process arguments (--key=value).

string main_class = 101;

Returns
Type Description
String

The mainClass.

getMainClassBytes()

public ByteString getMainClassBytes()

The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in jar_file_uris. The execution args are passed in as a sequence of named process arguments (--key=value).

string main_class = 101;

Returns
Type Description
ByteString

The bytes for mainClass.

getMainJarFileUri()

public String getMainJarFileUri()

The Cloud Storage URI of the jar file that contains the main class. The execution args are passed in as a sequence of named process arguments (--key=value).

string main_jar_file_uri = 100;

Returns
Type Description
String

The mainJarFileUri.

getMainJarFileUriBytes()

public ByteString getMainJarFileUriBytes()

The Cloud Storage URI of the jar file that contains the main class. The execution args are passed in as a sequence of named process arguments (--key=value).

string main_jar_file_uri = 100;

Returns
Type Description
ByteString

The bytes for mainJarFileUri.

getPythonScriptFile()

public String getPythonScriptFile()

The Gcloud Storage URI of the main Python file to use as the driver. Must be a .py file. The execution args are passed in as a sequence of named process arguments (--key=value).

string python_script_file = 102;

Returns
Type Description
String

The pythonScriptFile.

getPythonScriptFileBytes()

public ByteString getPythonScriptFileBytes()

The Gcloud Storage URI of the main Python file to use as the driver. Must be a .py file. The execution args are passed in as a sequence of named process arguments (--key=value).

string python_script_file = 102;

Returns
Type Description
ByteString

The bytes for pythonScriptFile.

getSqlScript()

public String getSqlScript()

The query text. The execution args are used to declare a set of script variables (set key="value";).

string sql_script = 105;

Returns
Type Description
String

The sqlScript.

getSqlScriptBytes()

public ByteString getSqlScriptBytes()

The query text. The execution args are used to declare a set of script variables (set key="value";).

string sql_script = 105;

Returns
Type Description
ByteString

The bytes for sqlScript.

getSqlScriptFile()

public String getSqlScriptFile()

A reference to a query file. This can be the Cloud Storage URI of the query file or it can the path to a SqlScript Content. The execution args are used to declare a set of script variables (set key="value";).

string sql_script_file = 104;

Returns
Type Description
String

The sqlScriptFile.

getSqlScriptFileBytes()

public ByteString getSqlScriptFileBytes()

A reference to a query file. This can be the Cloud Storage URI of the query file or it can the path to a SqlScript Content. The execution args are used to declare a set of script variables (set key="value";).

string sql_script_file = 104;

Returns
Type Description
ByteString

The bytes for sqlScriptFile.

hasInfrastructureSpec()

public boolean hasInfrastructureSpec()

Optional. Infrastructure specification for the execution.

.google.events.cloud.dataplex.v1.Task.InfrastructureSpec infrastructure_spec = 6;

Returns
Type Description
boolean

Whether the infrastructureSpec field is set.

hasMainClass()

public boolean hasMainClass()

The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in jar_file_uris. The execution args are passed in as a sequence of named process arguments (--key=value).

string main_class = 101;

Returns
Type Description
boolean

Whether the mainClass field is set.

hasMainJarFileUri()

public boolean hasMainJarFileUri()

The Cloud Storage URI of the jar file that contains the main class. The execution args are passed in as a sequence of named process arguments (--key=value).

string main_jar_file_uri = 100;

Returns
Type Description
boolean

Whether the mainJarFileUri field is set.

hasPythonScriptFile()

public boolean hasPythonScriptFile()

The Gcloud Storage URI of the main Python file to use as the driver. Must be a .py file. The execution args are passed in as a sequence of named process arguments (--key=value).

string python_script_file = 102;

Returns
Type Description
boolean

Whether the pythonScriptFile field is set.

hasSqlScript()

public boolean hasSqlScript()

The query text. The execution args are used to declare a set of script variables (set key="value";).

string sql_script = 105;

Returns
Type Description
boolean

Whether the sqlScript field is set.

hasSqlScriptFile()

public boolean hasSqlScriptFile()

A reference to a query file. This can be the Cloud Storage URI of the query file or it can the path to a SqlScript Content. The execution args are used to declare a set of script variables (set key="value";).

string sql_script_file = 104;

Returns
Type Description
boolean

Whether the sqlScriptFile field is set.

internalGetFieldAccessorTable()

protected GeneratedMessageV3.FieldAccessorTable internalGetFieldAccessorTable()
Returns
Type Description
FieldAccessorTable
Overrides

isInitialized()

public final boolean isInitialized()
Returns
Type Description
boolean
Overrides

mergeFrom(Task.SparkTaskConfig other)

public Task.SparkTaskConfig.Builder mergeFrom(Task.SparkTaskConfig other)
Parameter
Name Description
other Task.SparkTaskConfig
Returns
Type Description
Task.SparkTaskConfig.Builder

mergeFrom(CodedInputStream input, ExtensionRegistryLite extensionRegistry)

public Task.SparkTaskConfig.Builder mergeFrom(CodedInputStream input, ExtensionRegistryLite extensionRegistry)
Parameters
Name Description
input CodedInputStream
extensionRegistry ExtensionRegistryLite
Returns
Type Description
Task.SparkTaskConfig.Builder
Overrides
Exceptions
Type Description
IOException

mergeFrom(Message other)

public Task.SparkTaskConfig.Builder mergeFrom(Message other)
Parameter
Name Description
other Message
Returns
Type Description
Task.SparkTaskConfig.Builder
Overrides

mergeInfrastructureSpec(Task.InfrastructureSpec value)

public Task.SparkTaskConfig.Builder mergeInfrastructureSpec(Task.InfrastructureSpec value)

Optional. Infrastructure specification for the execution.

.google.events.cloud.dataplex.v1.Task.InfrastructureSpec infrastructure_spec = 6;

Parameter
Name Description
value Task.InfrastructureSpec
Returns
Type Description
Task.SparkTaskConfig.Builder

mergeUnknownFields(UnknownFieldSet unknownFields)

public final Task.SparkTaskConfig.Builder mergeUnknownFields(UnknownFieldSet unknownFields)
Parameter
Name Description
unknownFields UnknownFieldSet
Returns
Type Description
Task.SparkTaskConfig.Builder
Overrides

setArchiveUris(int index, String value)

public Task.SparkTaskConfig.Builder setArchiveUris(int index, String value)

Optional. Cloud Storage URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

repeated string archive_uris = 4;

Parameters
Name Description
index int

The index to set the value at.

value String

The archiveUris to set.

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

setField(Descriptors.FieldDescriptor field, Object value)

public Task.SparkTaskConfig.Builder setField(Descriptors.FieldDescriptor field, Object value)
Parameters
Name Description
field FieldDescriptor
value Object
Returns
Type Description
Task.SparkTaskConfig.Builder
Overrides

setFileUris(int index, String value)

public Task.SparkTaskConfig.Builder setFileUris(int index, String value)

Optional. Cloud Storage URIs of files to be placed in the working directory of each executor.

repeated string file_uris = 3;

Parameters
Name Description
index int

The index to set the value at.

value String

The fileUris to set.

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

setInfrastructureSpec(Task.InfrastructureSpec value)

public Task.SparkTaskConfig.Builder setInfrastructureSpec(Task.InfrastructureSpec value)

Optional. Infrastructure specification for the execution.

.google.events.cloud.dataplex.v1.Task.InfrastructureSpec infrastructure_spec = 6;

Parameter
Name Description
value Task.InfrastructureSpec
Returns
Type Description
Task.SparkTaskConfig.Builder

setInfrastructureSpec(Task.InfrastructureSpec.Builder builderForValue)

public Task.SparkTaskConfig.Builder setInfrastructureSpec(Task.InfrastructureSpec.Builder builderForValue)

Optional. Infrastructure specification for the execution.

.google.events.cloud.dataplex.v1.Task.InfrastructureSpec infrastructure_spec = 6;

Parameter
Name Description
builderForValue Task.InfrastructureSpec.Builder
Returns
Type Description
Task.SparkTaskConfig.Builder

setMainClass(String value)

public Task.SparkTaskConfig.Builder setMainClass(String value)

The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in jar_file_uris. The execution args are passed in as a sequence of named process arguments (--key=value).

string main_class = 101;

Parameter
Name Description
value String

The mainClass to set.

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

setMainClassBytes(ByteString value)

public Task.SparkTaskConfig.Builder setMainClassBytes(ByteString value)

The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in jar_file_uris. The execution args are passed in as a sequence of named process arguments (--key=value).

string main_class = 101;

Parameter
Name Description
value ByteString

The bytes for mainClass to set.

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

setMainJarFileUri(String value)

public Task.SparkTaskConfig.Builder setMainJarFileUri(String value)

The Cloud Storage URI of the jar file that contains the main class. The execution args are passed in as a sequence of named process arguments (--key=value).

string main_jar_file_uri = 100;

Parameter
Name Description
value String

The mainJarFileUri to set.

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

setMainJarFileUriBytes(ByteString value)

public Task.SparkTaskConfig.Builder setMainJarFileUriBytes(ByteString value)

The Cloud Storage URI of the jar file that contains the main class. The execution args are passed in as a sequence of named process arguments (--key=value).

string main_jar_file_uri = 100;

Parameter
Name Description
value ByteString

The bytes for mainJarFileUri to set.

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

setPythonScriptFile(String value)

public Task.SparkTaskConfig.Builder setPythonScriptFile(String value)

The Gcloud Storage URI of the main Python file to use as the driver. Must be a .py file. The execution args are passed in as a sequence of named process arguments (--key=value).

string python_script_file = 102;

Parameter
Name Description
value String

The pythonScriptFile to set.

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

setPythonScriptFileBytes(ByteString value)

public Task.SparkTaskConfig.Builder setPythonScriptFileBytes(ByteString value)

The Gcloud Storage URI of the main Python file to use as the driver. Must be a .py file. The execution args are passed in as a sequence of named process arguments (--key=value).

string python_script_file = 102;

Parameter
Name Description
value ByteString

The bytes for pythonScriptFile to set.

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

setRepeatedField(Descriptors.FieldDescriptor field, int index, Object value)

public Task.SparkTaskConfig.Builder setRepeatedField(Descriptors.FieldDescriptor field, int index, Object value)
Parameters
Name Description
field FieldDescriptor
index int
value Object
Returns
Type Description
Task.SparkTaskConfig.Builder
Overrides

setSqlScript(String value)

public Task.SparkTaskConfig.Builder setSqlScript(String value)

The query text. The execution args are used to declare a set of script variables (set key="value";).

string sql_script = 105;

Parameter
Name Description
value String

The sqlScript to set.

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

setSqlScriptBytes(ByteString value)

public Task.SparkTaskConfig.Builder setSqlScriptBytes(ByteString value)

The query text. The execution args are used to declare a set of script variables (set key="value";).

string sql_script = 105;

Parameter
Name Description
value ByteString

The bytes for sqlScript to set.

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

setSqlScriptFile(String value)

public Task.SparkTaskConfig.Builder setSqlScriptFile(String value)

A reference to a query file. This can be the Cloud Storage URI of the query file or it can the path to a SqlScript Content. The execution args are used to declare a set of script variables (set key="value";).

string sql_script_file = 104;

Parameter
Name Description
value String

The sqlScriptFile to set.

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

setSqlScriptFileBytes(ByteString value)

public Task.SparkTaskConfig.Builder setSqlScriptFileBytes(ByteString value)

A reference to a query file. This can be the Cloud Storage URI of the query file or it can the path to a SqlScript Content. The execution args are used to declare a set of script variables (set key="value";).

string sql_script_file = 104;

Parameter
Name Description
value ByteString

The bytes for sqlScriptFile to set.

Returns
Type Description
Task.SparkTaskConfig.Builder

This builder for chaining.

setUnknownFields(UnknownFieldSet unknownFields)

public final Task.SparkTaskConfig.Builder setUnknownFields(UnknownFieldSet unknownFields)
Parameter
Name Description
unknownFields UnknownFieldSet
Returns
Type Description
Task.SparkTaskConfig.Builder
Overrides