CloudStorageOptions(mapping=None, *, ignore_unknown_fields=False, **kwargs)
Options defining a file or a set of files within a Google Cloud Storage bucket.
Attributes | |
---|---|
Name | Description |
file_set |
The set of one or more files to scan. |
bytes_limit_per_file |
int
Max number of bytes to scan from a file. If a scanned file's size is bigger than this value then the rest of the bytes are omitted. Only one of bytes_limit_per_file and bytes_limit_per_file_percent can be specified. |
bytes_limit_per_file_percent |
int
Max percentage of bytes to scan from a file. The rest are omitted. The number of bytes scanned is rounded down. Must be between 0 and 100, inclusively. Both 0 and 100 means no limit. Defaults to 0. Only one of bytes_limit_per_file and bytes_limit_per_file_percent can be specified. |
file_types |
Sequence[
List of file type groups to include in the scan. If empty, all files are scanned and available data format processors are applied. In addition, the binary content of the selected files is always scanned as well. Images are scanned only as binary if the specified region does not support image inspection and no file_types were specified. Image inspection is restricted to 'global', 'us', 'asia', and 'europe'. |
files_limit_percent |
int
Limits the number of files to scan to this percentage of the input FileSet. Number of files scanned is rounded down. Must be between 0 and 100, inclusively. Both 0 and 100 means no limit. Defaults to 0. |
Classes
FileSet
FileSet(mapping=None, *, ignore_unknown_fields=False, **kwargs)
Set of files to scan.
SampleMethod
SampleMethod(value)
How to sample bytes if not all bytes are scanned. Meaningful only when used in conjunction with bytes_limit_per_file. If not specified, scanning would start from the top.