Resource: Zone
A zone represents a logical group of related assets within a lake. A zone can be used to map to organizational structure or represent stages of data readiness from raw to curated. It provides managing behavior that is shared or inherited by all contained assets.
JSON representation |
---|
{ "name": string, "displayName": string, "uid": string, "createTime": string, "updateTime": string, "labels": { string: string, ... }, "description": string, "state": enum ( |
Fields | |
---|---|
name |
Output only. The relative resource name of the zone, of the form: |
display |
Optional. User friendly display name. |
uid |
Output only. System generated globally unique ID for the zone. This ID will be different if the zone is deleted and re-created with the same name. |
create |
Output only. The time when the zone was created. A timestamp in RFC3339 UTC "Zulu" format, with nanosecond resolution and up to nine fractional digits. Examples: |
update |
Output only. The time when the zone was last updated. A timestamp in RFC3339 UTC "Zulu" format, with nanosecond resolution and up to nine fractional digits. Examples: |
labels |
Optional. User defined labels for the zone. An object containing a list of |
description |
Optional. Description of the zone. |
state |
Output only. Current state of the zone. |
type |
Required. Immutable. The type of the zone. |
discovery |
Optional. Specification of the discovery feature applied to data in this zone. |
resource |
Required. Specification of the resources that are referenced by the assets within this zone. |
asset |
Output only. Aggregated status of the underlying assets of the zone. |
Type
Type of zone.
Enums | |
---|---|
TYPE_UNSPECIFIED |
Zone type not specified. |
RAW |
A zone that contains data that needs further processing before it is considered generally ready for consumption and analytics workloads. |
CURATED |
A zone that contains data that is considered to be ready for broader consumption and analytics workloads. Curated structured data stored in Cloud Storage must conform to certain file formats (parquet, avro and orc) and organized in a hive-compatible directory layout. |
DiscoverySpec
Settings to manage the metadata discovery and publishing in a zone.
JSON representation |
---|
{ "enabled": boolean, "includePatterns": [ string ], "excludePatterns": [ string ], "csvOptions": { object ( |
Fields | |
---|---|
enabled |
Required. Whether discovery is enabled. |
include |
Optional. The list of patterns to apply for selecting data to include during discovery if only a subset of the data should considered. For Cloud Storage bucket assets, these are interpreted as glob patterns used to match object names. For BigQuery dataset assets, these are interpreted as patterns to match table names. |
exclude |
Optional. The list of patterns to apply for selecting data to exclude during discovery. For Cloud Storage bucket assets, these are interpreted as glob patterns used to match object names. For BigQuery dataset assets, these are interpreted as patterns to match table names. |
csv |
Optional. Configuration for CSV data. |
json |
Optional. Configuration for Json data. |
Union field trigger . Determines when discovery is triggered. trigger can be only one of the following: |
|
schedule |
Optional. Cron schedule (https://en.wikipedia.org/wiki/Cron) for running discovery periodically. Successive discovery runs must be scheduled at least 60 minutes apart. The default value is to run discovery every 60 minutes. To explicitly set a timezone to the cron tab, apply a prefix in the cron tab: "CRON_TZ=${IANA_TIME_ZONE}" or TZ=${IANA_TIME_ZONE}". The ${IANA_TIME_ZONE} may only be a valid string from IANA time zone database. For example, |
CsvOptions
Describe CSV and similar semi-structured data formats.
JSON representation |
---|
{ "headerRows": integer, "delimiter": string, "encoding": string, "disableTypeInference": boolean } |
Fields | |
---|---|
header |
Optional. The number of rows to interpret as header rows that should be skipped when reading data rows. |
delimiter |
Optional. The delimiter being used to separate values. This defaults to ','. |
encoding |
Optional. The character encoding of the data. The default is UTF-8. |
disable |
Optional. Whether to disable the inference of data type for CSV data. If true, all columns will be registered as strings. |
JsonOptions
Describe JSON data format.
JSON representation |
---|
{ "encoding": string, "disableTypeInference": boolean } |
Fields | |
---|---|
encoding |
Optional. The character encoding of the data. The default is UTF-8. |
disable |
Optional. Whether to disable the inference of data type for Json data. If true, all columns will be registered as their primitive types (strings, number or boolean). |
ResourceSpec
Settings for resources attached as assets within a zone.
JSON representation |
---|
{
"locationType": enum ( |
Fields | |
---|---|
location |
Required. Immutable. The location type of the resources that are allowed to be attached to the assets within this zone. |
LocationType
Location type of the resources attached to a zone.
Enums | |
---|---|
LOCATION_TYPE_UNSPECIFIED |
Unspecified location type. |
SINGLE_REGION |
Resources that are associated with a single region. |
MULTI_REGION |
Resources that are associated with a multi-region location. |
Methods |
|
---|---|
|
Creates a zone resource within a lake. |
|
Deletes a zone resource. |
|
Retrieves a zone resource. |
|
Gets the access control policy for a resource. |
|
Lists zone resources in a lake. |
|
Updates a zone resource. |
|
Sets the access control policy on the specified resource. |
|
Returns permissions that a caller has on the specified resource. |