GkeNodePoolTarget(mapping=None, *, ignore_unknown_fields=False, **kwargs)
GKE node pools that Dataproc workloads run on.
Attributes |
|
---|---|
Name | Description |
node_pool |
str
Required. The target GKE node pool. Format: 'projects/{project}/locations/{location}/clusters/{cluster}/nodePools/{node_pool}' |
roles |
MutableSequence[google.cloud.dataproc_v1.types.GkeNodePoolTarget.Role]
Required. The roles associated with the GKE node pool. |
node_pool_config |
google.cloud.dataproc_v1.types.GkeNodePoolConfig
Input only. The configuration for the GKE node pool. If specified, Dataproc attempts to create a node pool with the specified shape. If one with the same name already exists, it is verified against all specified fields. If a field differs, the virtual cluster creation will fail. If omitted, any node pool with the specified name is used. If a node pool with the specified name does not exist, Dataproc create a node pool with default values. This is an input only field. It will not be returned by the API. |
Classes
Role
Role(value)
Role
specifies the tasks that will run on the node pool. Roles
can be specific to workloads. Exactly one
GkeNodePoolTarget
within the virtual cluster must have the DEFAULT
role, which is
used to run all workloads that are not associated with a node pool.
Values:
ROLE_UNSPECIFIED (0):
Role is unspecified.
DEFAULT (1):
At least one node pool must have the DEFAULT
role. Work
assigned to a role that is not associated with a node pool
is assigned to the node pool with the DEFAULT
role. For
example, work assigned to the CONTROLLER
role will be
assigned to the node pool with the DEFAULT
role if no
node pool has the CONTROLLER
role.
CONTROLLER (2):
Run work associated with the Dataproc control
plane (for example, controllers and webhooks).
Very low resource requirements.
SPARK_DRIVER (3):
Run work associated with a Spark driver of a
job.
SPARK_EXECUTOR (4):
Run work associated with a Spark executor of
a job.