Class DiscoverySpec (2.5.0)

DiscoverySpec(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Settings to manage the metadata discovery and publishing for an asset.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Attributes

Name Description
enabled bool
Optional. Whether discovery is enabled.
include_patterns MutableSequence[str]
Optional. The list of patterns to apply for selecting data to include during discovery if only a subset of the data should considered. For Cloud Storage bucket assets, these are interpreted as glob patterns used to match object names. For BigQuery dataset assets, these are interpreted as patterns to match table names.
exclude_patterns MutableSequence[str]
Optional. The list of patterns to apply for selecting data to exclude during discovery. For Cloud Storage bucket assets, these are interpreted as glob patterns used to match object names. For BigQuery dataset assets, these are interpreted as patterns to match table names.
csv_options google.cloud.dataplex_v1.types.Asset.DiscoverySpec.CsvOptions
Optional. Configuration for CSV data.
json_options google.cloud.dataplex_v1.types.Asset.DiscoverySpec.JsonOptions
Optional. Configuration for Json data.
schedule str
Optional. Cron schedule (https://en.wikipedia.org/wiki/Cron) for running discovery periodically. Successive discovery runs must be scheduled at least 60 minutes apart. The default value is to run discovery every 60 minutes. To explicitly set a timezone to the cron tab, apply a prefix in the cron tab: "CRON_TZ=${IANA_TIME_ZONE}" or TZ=${IANA_TIME_ZONE}". The ${IANA_TIME_ZONE} may only be a valid string from IANA time zone database. For example, \`CRON_TZ=America/New_York 1 - - - \*\ , or\ TZ=America/New_York 1 \* \* \* \*`. This field is a member of oneof_ trigger.

Classes

CsvOptions

CsvOptions(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Describe CSV and similar semi-structured data formats.

JsonOptions

JsonOptions(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Describe JSON data format.