Class RoutingConfig (1.66.0)

RoutingConfig(mapping=None, *, ignore_unknown_fields=False, **kwargs)

The configuration for routing the request to a specific model.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Attributes

Name Description
auto_mode google.cloud.aiplatform_v1beta1.types.GenerationConfig.RoutingConfig.AutoRoutingMode
Automated routing. This field is a member of oneof_ routing_config.
manual_mode google.cloud.aiplatform_v1beta1.types.GenerationConfig.RoutingConfig.ManualRoutingMode
Manual routing. This field is a member of oneof_ routing_config.

Classes

AutoRoutingMode

AutoRoutingMode(mapping=None, *, ignore_unknown_fields=False, **kwargs)

When automated routing is specified, the routing will be determined by the pretrained routing model and customer provided model routing preference.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

ManualRoutingMode

ManualRoutingMode(mapping=None, *, ignore_unknown_fields=False, **kwargs)

When manual routing is set, the specified model will be used directly.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Methods

RoutingConfig

RoutingConfig(mapping=None, *, ignore_unknown_fields=False, **kwargs)

The configuration for routing the request to a specific model.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields