Send feedback
Class RoutingConfig (1.68.0)
Stay organized with collections
Save and categorize content based on your preferences.
RoutingConfig (
* ,
routing_config : typing . Union [
vertexai . generative_models . _generative_models . GenerationConfig . RoutingConfig . AutoRoutingMode ,
vertexai . generative_models . _generative_models . GenerationConfig . RoutingConfig . ManualRoutingMode ,
]
)
The configuration for model router requests.
The routing config is either one of the two nested classes:
AutoRoutingMode: Automated routing.
ManualRoutingMode: Manual routing.
Usage:
AutoRoutingMode:
routing_config=generative_models.RoutingConfig(
routing_config=generative_models.RoutingConfig.AutoRoutingMode(
model_routing_preference=generative_models.RoutingConfig.AutoRoutingMode.ModelRoutingPreference.BALANCED,
),
)
ManualRoutingMode:
routing_config=generative_models.RoutingConfig(
routing_config=generative_models.RoutingConfig.ManutalRoutingMode(
model_name="gemini-1.5-pro-001",
),
)
Classes
AutoRoutingMode
AutoRoutingMode (
* ,
model_routing_preference : google . cloud . aiplatform_v1beta1 . types . content . GenerationConfig . RoutingConfig . AutoRoutingMode . ModelRoutingPreference
)
When automated routing is specified, the routing will be
determined by the routing model predicted quality and customer provided
model routing preference.
ManualRoutingMode
ManualRoutingMode ( * , model_name : str )
When manual routing is set, the specified model will be used
directly.
Send feedback
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License , and code samples are licensed under the Apache 2.0 License . For details, see the Google Developers Site Policies . Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2024-09-24 UTC.
[{
"type": "thumb-down",
"id": "hardToUnderstand",
"label":"Hard to understand"
},{
"type": "thumb-down",
"id": "incorrectInformationOrSampleCode",
"label":"Incorrect information or sample code"
},{
"type": "thumb-down",
"id": "missingTheInformationSamplesINeed",
"label":"Missing the information/samples I need"
},{
"type": "thumb-down",
"id": "otherDown",
"label":"Other"
}]
[{
"type": "thumb-up",
"id": "easyToUnderstand",
"label":"Easy to understand"
},{
"type": "thumb-up",
"id": "solvedMyProblem",
"label":"Solved my problem"
},{
"type": "thumb-up",
"id": "otherUp",
"label":"Other"
}]
Need to tell us more?
{"lastModified": "Last updated 2024-09-24 UTC."}
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2024-09-24 UTC."]]