Package com.google.events.cloud.dataplex.v1 (0.15.0)

Classes

Asset

An asset represents a cloud resource that is being managed within a lake as a member of a zone.

Protobuf type google.events.cloud.dataplex.v1.Asset

Asset.Builder

An asset represents a cloud resource that is being managed within a lake as a member of a zone.

Protobuf type google.events.cloud.dataplex.v1.Asset

Asset.DiscoverySpec

Settings to manage the metadata discovery and publishing for an asset.

Protobuf type google.events.cloud.dataplex.v1.Asset.DiscoverySpec

Asset.DiscoverySpec.Builder

Settings to manage the metadata discovery and publishing for an asset.

Protobuf type google.events.cloud.dataplex.v1.Asset.DiscoverySpec

Asset.DiscoverySpec.CsvOptions

Describe CSV and similar semi-structured data formats.

Protobuf type google.events.cloud.dataplex.v1.Asset.DiscoverySpec.CsvOptions

Asset.DiscoverySpec.CsvOptions.Builder

Describe CSV and similar semi-structured data formats.

Protobuf type google.events.cloud.dataplex.v1.Asset.DiscoverySpec.CsvOptions

Asset.DiscoverySpec.JsonOptions

Describe JSON data format.

Protobuf type google.events.cloud.dataplex.v1.Asset.DiscoverySpec.JsonOptions

Asset.DiscoverySpec.JsonOptions.Builder

Describe JSON data format.

Protobuf type google.events.cloud.dataplex.v1.Asset.DiscoverySpec.JsonOptions

Asset.DiscoveryStatus

Status of discovery for an asset.

Protobuf type google.events.cloud.dataplex.v1.Asset.DiscoveryStatus

Asset.DiscoveryStatus.Builder

Status of discovery for an asset.

Protobuf type google.events.cloud.dataplex.v1.Asset.DiscoveryStatus

Asset.DiscoveryStatus.Stats

The aggregated data statistics for the asset reported by discovery.

Protobuf type google.events.cloud.dataplex.v1.Asset.DiscoveryStatus.Stats

Asset.DiscoveryStatus.Stats.Builder

The aggregated data statistics for the asset reported by discovery.

Protobuf type google.events.cloud.dataplex.v1.Asset.DiscoveryStatus.Stats

Asset.ResourceSpec

Identifies the cloud resource that is referenced by this asset.

Protobuf type google.events.cloud.dataplex.v1.Asset.ResourceSpec

Asset.ResourceSpec.Builder

Identifies the cloud resource that is referenced by this asset.

Protobuf type google.events.cloud.dataplex.v1.Asset.ResourceSpec

Asset.ResourceStatus

Status of the resource referenced by an asset.

Protobuf type google.events.cloud.dataplex.v1.Asset.ResourceStatus

Asset.ResourceStatus.Builder

Status of the resource referenced by an asset.

Protobuf type google.events.cloud.dataplex.v1.Asset.ResourceStatus

Asset.SecurityStatus

Security policy status of the asset. Data security policy, i.e., readers, writers & owners, should be specified in the lake/zone/asset IAM policy.

Protobuf type google.events.cloud.dataplex.v1.Asset.SecurityStatus

Asset.SecurityStatus.Builder

Security policy status of the asset. Data security policy, i.e., readers, writers & owners, should be specified in the lake/zone/asset IAM policy.

Protobuf type google.events.cloud.dataplex.v1.Asset.SecurityStatus

AssetEventData

The data within all Asset events.

Protobuf type google.events.cloud.dataplex.v1.AssetEventData

AssetEventData.Builder

The data within all Asset events.

Protobuf type google.events.cloud.dataplex.v1.AssetEventData

AssetStatus

Aggregated status of the underlying assets of a lake or zone.

Protobuf type google.events.cloud.dataplex.v1.AssetStatus

AssetStatus.Builder

Aggregated status of the underlying assets of a lake or zone.

Protobuf type google.events.cloud.dataplex.v1.AssetStatus

Data

DataAccessSpec

DataAccessSpec holds the access control configuration to be enforced on data stored within resources (eg: rows, columns in BigQuery Tables). When associated with data, the data is only accessible to principals explicitly granted access through the DataAccessSpec. Principals with access to the containing resource are not implicitly granted access.

Protobuf type google.events.cloud.dataplex.v1.DataAccessSpec

DataAccessSpec.Builder

DataAccessSpec holds the access control configuration to be enforced on data stored within resources (eg: rows, columns in BigQuery Tables). When associated with data, the data is only accessible to principals explicitly granted access through the DataAccessSpec. Principals with access to the containing resource are not implicitly granted access.

Protobuf type google.events.cloud.dataplex.v1.DataAccessSpec

DataAttribute

Denotes one dataAttribute in a dataTaxonomy, for example, PII. DataAttribute resources can be defined in a hierarchy. A single dataAttribute resource can contain specs of multiple types ` PII

  • ResourceAccessSpec :
    • readers :foo@bar.com
  • DataAccessSpec :
    • readers :bar@foo.com
`

Protobuf type google.events.cloud.dataplex.v1.DataAttribute

DataAttribute.Builder

Denotes one dataAttribute in a dataTaxonomy, for example, PII. DataAttribute resources can be defined in a hierarchy. A single dataAttribute resource can contain specs of multiple types ` PII

  • ResourceAccessSpec :
    • readers :foo@bar.com
  • DataAccessSpec :
    • readers :bar@foo.com
`

Protobuf type google.events.cloud.dataplex.v1.DataAttribute

DataAttributeBinding

DataAttributeBinding represents binding of attributes to resources. Eg: Bind 'CustomerInfo' entity with 'PII' attribute.

Protobuf type google.events.cloud.dataplex.v1.DataAttributeBinding

DataAttributeBinding.Builder

DataAttributeBinding represents binding of attributes to resources. Eg: Bind 'CustomerInfo' entity with 'PII' attribute.

Protobuf type google.events.cloud.dataplex.v1.DataAttributeBinding

DataAttributeBinding.Path

Represents a subresource of a given resource, and associated bindings with it.

Protobuf type google.events.cloud.dataplex.v1.DataAttributeBinding.Path

DataAttributeBinding.Path.Builder

Represents a subresource of a given resource, and associated bindings with it.

Protobuf type google.events.cloud.dataplex.v1.DataAttributeBinding.Path

DataAttributeBindingEventData

The data within all DataAttributeBinding events.

Protobuf type google.events.cloud.dataplex.v1.DataAttributeBindingEventData

DataAttributeBindingEventData.Builder

The data within all DataAttributeBinding events.

Protobuf type google.events.cloud.dataplex.v1.DataAttributeBindingEventData

DataAttributeEventData

The data within all DataAttribute events.

Protobuf type google.events.cloud.dataplex.v1.DataAttributeEventData

DataAttributeEventData.Builder

The data within all DataAttribute events.

Protobuf type google.events.cloud.dataplex.v1.DataAttributeEventData

DataProfileResult

DataProfileResult defines the output of DataProfileScan. Each field of the table will have field type specific profile result.

Protobuf type google.events.cloud.dataplex.v1.DataProfileResult

DataProfileResult.Builder

DataProfileResult defines the output of DataProfileScan. Each field of the table will have field type specific profile result.

Protobuf type google.events.cloud.dataplex.v1.DataProfileResult

DataProfileResult.Profile

Contains name, type, mode and field type specific profile information.

Protobuf type google.events.cloud.dataplex.v1.DataProfileResult.Profile

DataProfileResult.Profile.Builder

Contains name, type, mode and field type specific profile information.

Protobuf type google.events.cloud.dataplex.v1.DataProfileResult.Profile

DataProfileResult.Profile.Field

A field within a table.

Protobuf type google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field

DataProfileResult.Profile.Field.Builder

A field within a table.

Protobuf type google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field

DataProfileResult.Profile.Field.ProfileInfo

The profile information for each field type.

Protobuf type google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field.ProfileInfo

DataProfileResult.Profile.Field.ProfileInfo.Builder

The profile information for each field type.

Protobuf type google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field.ProfileInfo

DataProfileResult.Profile.Field.ProfileInfo.DoubleFieldInfo

The profile information for a double type field.

Protobuf type google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field.ProfileInfo.DoubleFieldInfo

DataProfileResult.Profile.Field.ProfileInfo.DoubleFieldInfo.Builder

The profile information for a double type field.

Protobuf type google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field.ProfileInfo.DoubleFieldInfo

DataProfileResult.Profile.Field.ProfileInfo.IntegerFieldInfo

The profile information for an integer type field.

Protobuf type google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field.ProfileInfo.IntegerFieldInfo

DataProfileResult.Profile.Field.ProfileInfo.IntegerFieldInfo.Builder

The profile information for an integer type field.

Protobuf type google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field.ProfileInfo.IntegerFieldInfo

DataProfileResult.Profile.Field.ProfileInfo.StringFieldInfo

The profile information for a string type field.

Protobuf type google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field.ProfileInfo.StringFieldInfo

DataProfileResult.Profile.Field.ProfileInfo.StringFieldInfo.Builder

The profile information for a string type field.

Protobuf type google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field.ProfileInfo.StringFieldInfo

DataProfileResult.Profile.Field.ProfileInfo.TopNValue

Top N non-null values in the scanned data.

Protobuf type google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field.ProfileInfo.TopNValue

DataProfileResult.Profile.Field.ProfileInfo.TopNValue.Builder

Top N non-null values in the scanned data.

Protobuf type google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field.ProfileInfo.TopNValue

DataProfileSpec

DataProfileScan related setting.

Protobuf type google.events.cloud.dataplex.v1.DataProfileSpec

DataProfileSpec.Builder

DataProfileScan related setting.

Protobuf type google.events.cloud.dataplex.v1.DataProfileSpec

DataQualityDimensionResult

DataQualityDimensionResult provides a more detailed, per-dimension view of the results.

Protobuf type google.events.cloud.dataplex.v1.DataQualityDimensionResult

DataQualityDimensionResult.Builder

DataQualityDimensionResult provides a more detailed, per-dimension view of the results.

Protobuf type google.events.cloud.dataplex.v1.DataQualityDimensionResult

DataQualityResult

The output of a DataQualityScan.

Protobuf type google.events.cloud.dataplex.v1.DataQualityResult

DataQualityResult.Builder

The output of a DataQualityScan.

Protobuf type google.events.cloud.dataplex.v1.DataQualityResult

DataQualityRule

A rule captures data quality intent about a data source.

Protobuf type google.events.cloud.dataplex.v1.DataQualityRule

DataQualityRule.Builder

A rule captures data quality intent about a data source.

Protobuf type google.events.cloud.dataplex.v1.DataQualityRule

DataQualityRule.NonNullExpectation

Evaluates whether each column value is null.

Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.NonNullExpectation

DataQualityRule.NonNullExpectation.Builder

Evaluates whether each column value is null.

Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.NonNullExpectation

DataQualityRule.RangeExpectation

Evaluates whether each column value lies between a specified range.

Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.RangeExpectation

DataQualityRule.RangeExpectation.Builder

Evaluates whether each column value lies between a specified range.

Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.RangeExpectation

DataQualityRule.RegexExpectation

Evaluates whether each column value matches a specified regex.

Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.RegexExpectation

DataQualityRule.RegexExpectation.Builder

Evaluates whether each column value matches a specified regex.

Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.RegexExpectation

DataQualityRule.RowConditionExpectation

Evaluates whether each row passes the specified condition. The SQL expression needs to use BigQuery standard SQL syntax and should produce a boolean value per row as the result. Example: col1 >= 0 AND col2 < 10

Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.RowConditionExpectation

DataQualityRule.RowConditionExpectation.Builder

Evaluates whether each row passes the specified condition. The SQL expression needs to use BigQuery standard SQL syntax and should produce a boolean value per row as the result. Example: col1 >= 0 AND col2 < 10

Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.RowConditionExpectation

DataQualityRule.SetExpectation

Evaluates whether each column value is contained by a specified set.

Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.SetExpectation

DataQualityRule.SetExpectation.Builder

Evaluates whether each column value is contained by a specified set.

Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.SetExpectation

DataQualityRule.StatisticRangeExpectation

Evaluates whether the column aggregate statistic lies between a specified range.

Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.StatisticRangeExpectation

DataQualityRule.StatisticRangeExpectation.Builder

Evaluates whether the column aggregate statistic lies between a specified range.

Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.StatisticRangeExpectation

DataQualityRule.TableConditionExpectation

Evaluates whether the provided expression is true. The SQL expression needs to use BigQuery standard SQL syntax and should produce a scalar boolean result. Example: MIN(col1) >= 0

Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.TableConditionExpectation

DataQualityRule.TableConditionExpectation.Builder

Evaluates whether the provided expression is true. The SQL expression needs to use BigQuery standard SQL syntax and should produce a scalar boolean result. Example: MIN(col1) >= 0

Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.TableConditionExpectation

DataQualityRule.UniquenessExpectation

Evaluates whether the column has duplicates.

Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.UniquenessExpectation

DataQualityRule.UniquenessExpectation.Builder

Evaluates whether the column has duplicates.

Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.UniquenessExpectation

DataQualityRuleResult

DataQualityRuleResult provides a more detailed, per-rule view of the results.

Protobuf type google.events.cloud.dataplex.v1.DataQualityRuleResult

DataQualityRuleResult.Builder

DataQualityRuleResult provides a more detailed, per-rule view of the results.

Protobuf type google.events.cloud.dataplex.v1.DataQualityRuleResult

DataQualitySpec

DataQualityScan related setting.

Protobuf type google.events.cloud.dataplex.v1.DataQualitySpec

DataQualitySpec.Builder

DataQualityScan related setting.

Protobuf type google.events.cloud.dataplex.v1.DataQualitySpec

DataScan

Represents a user-visible job which provides the insights for the related data source. For example:

  • Data Quality: generates queries based on the rules and runs against the data to get data quality check results.
  • Data Profile: analyzes the data in table(s) and generates insights about the structure, content and relationships (such as null percent, cardinality, min/max/mean, etc).

Protobuf type google.events.cloud.dataplex.v1.DataScan

DataScan.Builder

Represents a user-visible job which provides the insights for the related data source. For example:

  • Data Quality: generates queries based on the rules and runs against the data to get data quality check results.
  • Data Profile: analyzes the data in table(s) and generates insights about the structure, content and relationships (such as null percent, cardinality, min/max/mean, etc).

Protobuf type google.events.cloud.dataplex.v1.DataScan

DataScan.ExecutionSpec

DataScan execution settings.

Protobuf type google.events.cloud.dataplex.v1.DataScan.ExecutionSpec

DataScan.ExecutionSpec.Builder

DataScan execution settings.

Protobuf type google.events.cloud.dataplex.v1.DataScan.ExecutionSpec

DataScan.ExecutionStatus

Status of the data scan execution.

Protobuf type google.events.cloud.dataplex.v1.DataScan.ExecutionStatus

DataScan.ExecutionStatus.Builder

Status of the data scan execution.

Protobuf type google.events.cloud.dataplex.v1.DataScan.ExecutionStatus

DataScanEventData

The data within all DataScan events.

Protobuf type google.events.cloud.dataplex.v1.DataScanEventData

DataScanEventData.Builder

The data within all DataScan events.

Protobuf type google.events.cloud.dataplex.v1.DataScanEventData

DataSource

The data source for DataScan.

Protobuf type google.events.cloud.dataplex.v1.DataSource

DataSource.Builder

The data source for DataScan.

Protobuf type google.events.cloud.dataplex.v1.DataSource

DataTaxonomy

DataTaxonomy represents a set of hierarchical DataAttributes resources, grouped with a common theme Eg: 'SensitiveDataTaxonomy' can have attributes to manage PII data. It is defined at project level.

Protobuf type google.events.cloud.dataplex.v1.DataTaxonomy

DataTaxonomy.Builder

DataTaxonomy represents a set of hierarchical DataAttributes resources, grouped with a common theme Eg: 'SensitiveDataTaxonomy' can have attributes to manage PII data. It is defined at project level.

Protobuf type google.events.cloud.dataplex.v1.DataTaxonomy

DataTaxonomyEventData

The data within all DataTaxonomy events.

Protobuf type google.events.cloud.dataplex.v1.DataTaxonomyEventData

DataTaxonomyEventData.Builder

The data within all DataTaxonomy events.

Protobuf type google.events.cloud.dataplex.v1.DataTaxonomyEventData

Environment

Environment represents a user-visible compute infrastructure for analytics within a lake.

Protobuf type google.events.cloud.dataplex.v1.Environment

Environment.Builder

Environment represents a user-visible compute infrastructure for analytics within a lake.

Protobuf type google.events.cloud.dataplex.v1.Environment

Environment.Endpoints

URI Endpoints to access sessions associated with the Environment.

Protobuf type google.events.cloud.dataplex.v1.Environment.Endpoints

Environment.Endpoints.Builder

URI Endpoints to access sessions associated with the Environment.

Protobuf type google.events.cloud.dataplex.v1.Environment.Endpoints

Environment.InfrastructureSpec

Configuration for the underlying infrastructure used to run workloads.

Protobuf type google.events.cloud.dataplex.v1.Environment.InfrastructureSpec

Environment.InfrastructureSpec.Builder

Configuration for the underlying infrastructure used to run workloads.

Protobuf type google.events.cloud.dataplex.v1.Environment.InfrastructureSpec

Environment.InfrastructureSpec.ComputeResources

Compute resources associated with the analyze interactive workloads.

Protobuf type google.events.cloud.dataplex.v1.Environment.InfrastructureSpec.ComputeResources

Environment.InfrastructureSpec.ComputeResources.Builder

Compute resources associated with the analyze interactive workloads.

Protobuf type google.events.cloud.dataplex.v1.Environment.InfrastructureSpec.ComputeResources

Environment.InfrastructureSpec.OsImageRuntime

Software Runtime Configuration to run Analyze.

Protobuf type google.events.cloud.dataplex.v1.Environment.InfrastructureSpec.OsImageRuntime

Environment.InfrastructureSpec.OsImageRuntime.Builder

Software Runtime Configuration to run Analyze.

Protobuf type google.events.cloud.dataplex.v1.Environment.InfrastructureSpec.OsImageRuntime

Environment.SessionSpec

Configuration for sessions created for this environment.

Protobuf type google.events.cloud.dataplex.v1.Environment.SessionSpec

Environment.SessionSpec.Builder

Configuration for sessions created for this environment.

Protobuf type google.events.cloud.dataplex.v1.Environment.SessionSpec

Environment.SessionStatus

Status of sessions created for this environment.

Protobuf type google.events.cloud.dataplex.v1.Environment.SessionStatus

Environment.SessionStatus.Builder

Status of sessions created for this environment.

Protobuf type google.events.cloud.dataplex.v1.Environment.SessionStatus

EnvironmentEventData

The data within all Environment events.

Protobuf type google.events.cloud.dataplex.v1.EnvironmentEventData

EnvironmentEventData.Builder

The data within all Environment events.

Protobuf type google.events.cloud.dataplex.v1.EnvironmentEventData

Job

A job represents an instance of a task.

Protobuf type google.events.cloud.dataplex.v1.Job

Job.Builder

A job represents an instance of a task.

Protobuf type google.events.cloud.dataplex.v1.Job

Lake

A lake is a centralized repository for managing enterprise data across the organization distributed across many cloud projects, and stored in a variety of storage services such as Google Cloud Storage and BigQuery. The resources attached to a lake are referred to as managed resources. Data within these managed resources can be structured or unstructured. A lake provides data admins with tools to organize, secure and manage their data at scale, and provides data scientists and data engineers an integrated experience to easily search, discover, analyze and transform data and associated metadata.

Protobuf type google.events.cloud.dataplex.v1.Lake

Lake.Builder

A lake is a centralized repository for managing enterprise data across the organization distributed across many cloud projects, and stored in a variety of storage services such as Google Cloud Storage and BigQuery. The resources attached to a lake are referred to as managed resources. Data within these managed resources can be structured or unstructured. A lake provides data admins with tools to organize, secure and manage their data at scale, and provides data scientists and data engineers an integrated experience to easily search, discover, analyze and transform data and associated metadata.

Protobuf type google.events.cloud.dataplex.v1.Lake

Lake.Metastore

Settings to manage association of Dataproc Metastore with a lake.

Protobuf type google.events.cloud.dataplex.v1.Lake.Metastore

Lake.Metastore.Builder

Settings to manage association of Dataproc Metastore with a lake.

Protobuf type google.events.cloud.dataplex.v1.Lake.Metastore

Lake.MetastoreStatus

Status of Lake and Dataproc Metastore service instance association.

Protobuf type google.events.cloud.dataplex.v1.Lake.MetastoreStatus

Lake.MetastoreStatus.Builder

Status of Lake and Dataproc Metastore service instance association.

Protobuf type google.events.cloud.dataplex.v1.Lake.MetastoreStatus

LakeEventData

The data within all Lake events.

Protobuf type google.events.cloud.dataplex.v1.LakeEventData

LakeEventData.Builder

The data within all Lake events.

Protobuf type google.events.cloud.dataplex.v1.LakeEventData

ResourceAccessSpec

ResourceAccessSpec holds the access control configuration to be enforced on the resources, for example, Cloud Storage bucket, BigQuery dataset, BigQuery table.

Protobuf type google.events.cloud.dataplex.v1.ResourceAccessSpec

ResourceAccessSpec.Builder

ResourceAccessSpec holds the access control configuration to be enforced on the resources, for example, Cloud Storage bucket, BigQuery dataset, BigQuery table.

Protobuf type google.events.cloud.dataplex.v1.ResourceAccessSpec

ScannedData

The data scanned during processing (e.g. in incremental DataScan)

Protobuf type google.events.cloud.dataplex.v1.ScannedData

ScannedData.Builder

The data scanned during processing (e.g. in incremental DataScan)

Protobuf type google.events.cloud.dataplex.v1.ScannedData

ScannedData.IncrementalField

A data range denoted by a pair of start/end values of a field.

Protobuf type google.events.cloud.dataplex.v1.ScannedData.IncrementalField

ScannedData.IncrementalField.Builder

A data range denoted by a pair of start/end values of a field.

Protobuf type google.events.cloud.dataplex.v1.ScannedData.IncrementalField

Task

A task represents a user-visible job.

Protobuf type google.events.cloud.dataplex.v1.Task

Task.Builder

A task represents a user-visible job.

Protobuf type google.events.cloud.dataplex.v1.Task

Task.ExecutionSpec

Execution related settings, like retry and service_account.

Protobuf type google.events.cloud.dataplex.v1.Task.ExecutionSpec

Task.ExecutionSpec.Builder

Execution related settings, like retry and service_account.

Protobuf type google.events.cloud.dataplex.v1.Task.ExecutionSpec

Task.ExecutionStatus

Status of the task execution (e.g. Jobs).

Protobuf type google.events.cloud.dataplex.v1.Task.ExecutionStatus

Task.ExecutionStatus.Builder

Status of the task execution (e.g. Jobs).

Protobuf type google.events.cloud.dataplex.v1.Task.ExecutionStatus

Task.InfrastructureSpec

Configuration for the underlying infrastructure used to run workloads.

Protobuf type google.events.cloud.dataplex.v1.Task.InfrastructureSpec

Task.InfrastructureSpec.BatchComputeResources

Batch compute resources associated with the task.

Protobuf type google.events.cloud.dataplex.v1.Task.InfrastructureSpec.BatchComputeResources

Task.InfrastructureSpec.BatchComputeResources.Builder

Batch compute resources associated with the task.

Protobuf type google.events.cloud.dataplex.v1.Task.InfrastructureSpec.BatchComputeResources

Task.InfrastructureSpec.Builder

Configuration for the underlying infrastructure used to run workloads.

Protobuf type google.events.cloud.dataplex.v1.Task.InfrastructureSpec

Task.InfrastructureSpec.ContainerImageRuntime

Container Image Runtime Configuration used with Batch execution.

Protobuf type google.events.cloud.dataplex.v1.Task.InfrastructureSpec.ContainerImageRuntime

Task.InfrastructureSpec.ContainerImageRuntime.Builder

Container Image Runtime Configuration used with Batch execution.

Protobuf type google.events.cloud.dataplex.v1.Task.InfrastructureSpec.ContainerImageRuntime

Task.InfrastructureSpec.VpcNetwork

Cloud VPC Network used to run the infrastructure.

Protobuf type google.events.cloud.dataplex.v1.Task.InfrastructureSpec.VpcNetwork

Task.InfrastructureSpec.VpcNetwork.Builder

Cloud VPC Network used to run the infrastructure.

Protobuf type google.events.cloud.dataplex.v1.Task.InfrastructureSpec.VpcNetwork

Task.NotebookTaskConfig

Config for running scheduled notebooks.

Protobuf type google.events.cloud.dataplex.v1.Task.NotebookTaskConfig

Task.NotebookTaskConfig.Builder

Config for running scheduled notebooks.

Protobuf type google.events.cloud.dataplex.v1.Task.NotebookTaskConfig

Task.SparkTaskConfig

User-specified config for running a Spark task.

Protobuf type google.events.cloud.dataplex.v1.Task.SparkTaskConfig

Task.SparkTaskConfig.Builder

User-specified config for running a Spark task.

Protobuf type google.events.cloud.dataplex.v1.Task.SparkTaskConfig

Task.TriggerSpec

Task scheduling and trigger settings.

Protobuf type google.events.cloud.dataplex.v1.Task.TriggerSpec

Task.TriggerSpec.Builder

Task scheduling and trigger settings.

Protobuf type google.events.cloud.dataplex.v1.Task.TriggerSpec

TaskEventData

The data within all Task events.

Protobuf type google.events.cloud.dataplex.v1.TaskEventData

TaskEventData.Builder

The data within all Task events.

Protobuf type google.events.cloud.dataplex.v1.TaskEventData

Trigger

DataScan scheduling and trigger settings.

Protobuf type google.events.cloud.dataplex.v1.Trigger

Trigger.Builder

DataScan scheduling and trigger settings.

Protobuf type google.events.cloud.dataplex.v1.Trigger

Trigger.OnDemand

The scan runs once via RunDataScan API.

Protobuf type google.events.cloud.dataplex.v1.Trigger.OnDemand

Trigger.OnDemand.Builder

The scan runs once via RunDataScan API.

Protobuf type google.events.cloud.dataplex.v1.Trigger.OnDemand

Trigger.Schedule

The scan is scheduled to run periodically.

Protobuf type google.events.cloud.dataplex.v1.Trigger.Schedule

Trigger.Schedule.Builder

The scan is scheduled to run periodically.

Protobuf type google.events.cloud.dataplex.v1.Trigger.Schedule

Zone

A zone represents a logical group of related assets within a lake. A zone can be used to map to organizational structure or represent stages of data readiness from raw to curated. It provides managing behavior that is shared or inherited by all contained assets.

Protobuf type google.events.cloud.dataplex.v1.Zone

Zone.Builder

A zone represents a logical group of related assets within a lake. A zone can be used to map to organizational structure or represent stages of data readiness from raw to curated. It provides managing behavior that is shared or inherited by all contained assets.

Protobuf type google.events.cloud.dataplex.v1.Zone

Zone.DiscoverySpec

Settings to manage the metadata discovery and publishing in a zone.

Protobuf type google.events.cloud.dataplex.v1.Zone.DiscoverySpec

Zone.DiscoverySpec.Builder

Settings to manage the metadata discovery and publishing in a zone.

Protobuf type google.events.cloud.dataplex.v1.Zone.DiscoverySpec

Zone.DiscoverySpec.CsvOptions

Describe CSV and similar semi-structured data formats.

Protobuf type google.events.cloud.dataplex.v1.Zone.DiscoverySpec.CsvOptions

Zone.DiscoverySpec.CsvOptions.Builder

Describe CSV and similar semi-structured data formats.

Protobuf type google.events.cloud.dataplex.v1.Zone.DiscoverySpec.CsvOptions

Zone.DiscoverySpec.JsonOptions

Describe JSON data format.

Protobuf type google.events.cloud.dataplex.v1.Zone.DiscoverySpec.JsonOptions

Zone.DiscoverySpec.JsonOptions.Builder

Describe JSON data format.

Protobuf type google.events.cloud.dataplex.v1.Zone.DiscoverySpec.JsonOptions

Zone.ResourceSpec

Settings for resources attached as assets within a zone.

Protobuf type google.events.cloud.dataplex.v1.Zone.ResourceSpec

Zone.ResourceSpec.Builder

Settings for resources attached as assets within a zone.

Protobuf type google.events.cloud.dataplex.v1.Zone.ResourceSpec

ZoneEventData

The data within all Zone events.

Protobuf type google.events.cloud.dataplex.v1.ZoneEventData

ZoneEventData.Builder

The data within all Zone events.

Protobuf type google.events.cloud.dataplex.v1.ZoneEventData

Interfaces

Asset.DiscoverySpec.CsvOptionsOrBuilder

Asset.DiscoverySpec.JsonOptionsOrBuilder

Asset.DiscoverySpecOrBuilder

Asset.DiscoveryStatus.StatsOrBuilder

Asset.DiscoveryStatusOrBuilder

Asset.ResourceSpecOrBuilder

Asset.ResourceStatusOrBuilder

Asset.SecurityStatusOrBuilder

AssetEventDataOrBuilder

AssetOrBuilder

AssetStatusOrBuilder

DataAccessSpecOrBuilder

DataAttributeBinding.PathOrBuilder

DataAttributeBindingEventDataOrBuilder

DataAttributeBindingOrBuilder

DataAttributeEventDataOrBuilder

DataAttributeOrBuilder

DataProfileResult.Profile.Field.ProfileInfo.DoubleFieldInfoOrBuilder

DataProfileResult.Profile.Field.ProfileInfo.IntegerFieldInfoOrBuilder

DataProfileResult.Profile.Field.ProfileInfo.StringFieldInfoOrBuilder

DataProfileResult.Profile.Field.ProfileInfo.TopNValueOrBuilder

DataProfileResult.Profile.Field.ProfileInfoOrBuilder

DataProfileResult.Profile.FieldOrBuilder

DataProfileResult.ProfileOrBuilder

DataProfileResultOrBuilder

DataProfileSpecOrBuilder

DataQualityDimensionResultOrBuilder

DataQualityResultOrBuilder

DataQualityRule.NonNullExpectationOrBuilder

DataQualityRule.RangeExpectationOrBuilder

DataQualityRule.RegexExpectationOrBuilder

DataQualityRule.RowConditionExpectationOrBuilder

DataQualityRule.SetExpectationOrBuilder

DataQualityRule.StatisticRangeExpectationOrBuilder

DataQualityRule.TableConditionExpectationOrBuilder

DataQualityRule.UniquenessExpectationOrBuilder

DataQualityRuleOrBuilder

DataQualityRuleResultOrBuilder

DataQualitySpecOrBuilder

DataScan.ExecutionSpecOrBuilder

DataScan.ExecutionStatusOrBuilder

DataScanEventDataOrBuilder

DataScanOrBuilder

DataSourceOrBuilder

DataTaxonomyEventDataOrBuilder

DataTaxonomyOrBuilder

Environment.EndpointsOrBuilder

Environment.InfrastructureSpec.ComputeResourcesOrBuilder

Environment.InfrastructureSpec.OsImageRuntimeOrBuilder

Environment.InfrastructureSpecOrBuilder

Environment.SessionSpecOrBuilder

Environment.SessionStatusOrBuilder

EnvironmentEventDataOrBuilder

EnvironmentOrBuilder

JobOrBuilder

Lake.MetastoreOrBuilder

Lake.MetastoreStatusOrBuilder

LakeEventDataOrBuilder

LakeOrBuilder

ResourceAccessSpecOrBuilder

ScannedData.IncrementalFieldOrBuilder

ScannedDataOrBuilder

Task.ExecutionSpecOrBuilder

Task.ExecutionStatusOrBuilder

Task.InfrastructureSpec.BatchComputeResourcesOrBuilder

Task.InfrastructureSpec.ContainerImageRuntimeOrBuilder

Task.InfrastructureSpec.VpcNetworkOrBuilder

Task.InfrastructureSpecOrBuilder

Task.NotebookTaskConfigOrBuilder

Task.SparkTaskConfigOrBuilder

Task.TriggerSpecOrBuilder

TaskEventDataOrBuilder

TaskOrBuilder

Trigger.OnDemandOrBuilder

Trigger.ScheduleOrBuilder

TriggerOrBuilder

Zone.DiscoverySpec.CsvOptionsOrBuilder

Zone.DiscoverySpec.JsonOptionsOrBuilder

Zone.DiscoverySpecOrBuilder

Zone.ResourceSpecOrBuilder

ZoneEventDataOrBuilder

ZoneOrBuilder

Enums

Asset.DiscoverySpec.TriggerCase

Asset.DiscoveryStatus.State

Current state of discovery.

Protobuf enum google.events.cloud.dataplex.v1.Asset.DiscoveryStatus.State

Asset.ResourceSpec.AccessMode

Access Mode determines how data stored within the resource is read. This is only applicable to storage bucket assets.

Protobuf enum google.events.cloud.dataplex.v1.Asset.ResourceSpec.AccessMode

Asset.ResourceSpec.Type

Type of resource.

Protobuf enum google.events.cloud.dataplex.v1.Asset.ResourceSpec.Type

Asset.ResourceStatus.State

The state of a resource.

Protobuf enum google.events.cloud.dataplex.v1.Asset.ResourceStatus.State

Asset.SecurityStatus.State

The state of the security policy.

Protobuf enum google.events.cloud.dataplex.v1.Asset.SecurityStatus.State

DataAttributeBinding.ResourceReferenceCase

DataProfileResult.Profile.Field.ProfileInfo.FieldInfoCase

DataQualityRule.RuleTypeCase

DataQualityRule.StatisticRangeExpectation.ColumnStatistic

Protobuf enum google.events.cloud.dataplex.v1.DataQualityRule.StatisticRangeExpectation.ColumnStatistic

DataScan.ExecutionSpec.IncrementalCase

DataScan.ResultCase

DataScan.SpecCase

DataScanType

The type of DataScan.

Protobuf enum google.events.cloud.dataplex.v1.DataScanType

DataSource.SourceCase

Environment.InfrastructureSpec.ResourcesCase

Environment.InfrastructureSpec.RuntimeCase

Job.Service

Protobuf enum google.events.cloud.dataplex.v1.Job.Service

Job.State

Protobuf enum google.events.cloud.dataplex.v1.Job.State

Lake.MetastoreStatus.State

Current state of association.

Protobuf enum google.events.cloud.dataplex.v1.Lake.MetastoreStatus.State

ScannedData.DataRangeCase

State

State of a resource.

Protobuf enum google.events.cloud.dataplex.v1.State

Task.ConfigCase

Task.InfrastructureSpec.NetworkCase

Task.InfrastructureSpec.ResourcesCase

Task.InfrastructureSpec.RuntimeCase

Task.InfrastructureSpec.VpcNetwork.NetworkNameCase

Task.SparkTaskConfig.DriverCase

Task.TriggerSpec.TriggerCase

Task.TriggerSpec.Type

Determines how often and when the job will run.

Protobuf enum google.events.cloud.dataplex.v1.Task.TriggerSpec.Type

Trigger.ModeCase

Zone.DiscoverySpec.TriggerCase

Zone.ResourceSpec.LocationType

Location type of the resources attached to a zone.

Protobuf enum google.events.cloud.dataplex.v1.Zone.ResourceSpec.LocationType

Zone.Type

Type of zone.

Protobuf enum google.events.cloud.dataplex.v1.Zone.Type