ImportJobSpec(mapping=None, *, ignore_unknown_fields=False, **kwargs)
Job specification for a metadata import job.
You can run the following kinds of metadata import jobs:
- Full sync of entries with incremental import of their aspects. Supported for custom entries.
- Incremental import of aspects only. Supported for aspects that belong to custom entries and system entries. For custom entries, you can modify both optional aspects and required aspects. For system entries, you can modify optional aspects.
Attributes |
|
---|---|
Name | Description |
source_storage_uri |
str
Optional. The URI of a Cloud Storage bucket or folder (beginning with gs:// and ending with / ) that
contains the metadata import files for this job.
A metadata import file defines the values to set for each of
the entries and aspects in a metadata job. For more
information about how to create a metadata import file and
the file requirements, see `Metadata import
file |
source_create_time |
google.protobuf.timestamp_pb2.Timestamp
Optional. The time when the process that created the metadata import files began. |
scope |
google.cloud.dataplex_v1.types.MetadataJob.ImportJobSpec.ImportJobScope
Required. A boundary on the scope of impact that the metadata import job can have. |
entry_sync_mode |
google.cloud.dataplex_v1.types.MetadataJob.ImportJobSpec.SyncMode
Required. The sync mode for entries. |
aspect_sync_mode |
google.cloud.dataplex_v1.types.MetadataJob.ImportJobSpec.SyncMode
Required. The sync mode for aspects. |
log_level |
google.cloud.dataplex_v1.types.MetadataJob.ImportJobSpec.LogLevel
Optional. The level of logs to write to Cloud Logging for this job. Debug-level logs provide highly-detailed information for troubleshooting, but their increased verbosity could incur `additional costs |
Classes
ImportJobScope
ImportJobScope(mapping=None, *, ignore_unknown_fields=False, **kwargs)
A boundary on the scope of impact that the metadata import job can have.
LogLevel
LogLevel(value)
The level of logs to write to Cloud Logging for this job.
Depending on the size of your metadata job and the number of
logs that are generated, debug-level logging might incur
`additional
costs <https://cloud.google.com/stackdriver/pricing>`__.
INFO (2):
Info-level logging. Captures logs at the
overall job level. Includes aggregate logs about
import items, but doesn't specify which import
item has an error.
SyncMode
SyncMode(value)
Specifies how the entries and aspects in a metadata job are updated.
For more information, see Sync
mode <https://cloud.google.com/dataplex/docs/import-metadata#sync-mode>
__.
This sync mode is supported for entries.
INCREMENTAL (2):
Only the resources that are explicitly
included in the metadata import file are
modified. Use this mode to modify a subset of
resources while leaving unreferenced resources
unchanged.
This sync mode is supported for aspects.
NONE (3):
If entry sync mode is `NONE`, then aspects are modified
according to the aspect sync mode. Other metadata that
belongs to entries in the job's scope isn't modified.
This sync mode is supported for entries.