Class GenerationConfig (1.95.1)
Stay organized with collections
Save and categorize content based on your preferences.
GenerationConfig(
*,
temperature: typing.Optional[float] = None,
top_p: typing.Optional[float] = None,
top_k: typing.Optional[int] = None,
candidate_count: typing.Optional[int] = None,
max_output_tokens: typing.Optional[int] = None,
stop_sequences: typing.Optional[typing.List[str]] = None,
presence_penalty: typing.Optional[float] = None,
frequency_penalty: typing.Optional[float] = None,
response_mime_type: typing.Optional[str] = None,
response_schema: typing.Optional[typing.Dict[str, typing.Any]] = None,
seed: typing.Optional[int] = None,
audio_timestamp: typing.Optional[bool] = None,
routing_config: typing.Optional[RoutingConfig] = None,
logprobs: typing.Optional[int] = None,
response_logprobs: typing.Optional[bool] = None,
response_modalities: typing.Optional[typing.List[GenerationConfig.Modality]] = None,
model_config: typing.Optional[GenerationConfig.ModelConfig] = None
)
Parameters for the generation.
Classes
Modality
The modalities of the response.
ModelConfig
ModelConfig(mapping=None, *, ignore_unknown_fields=False, **kwargs)
Config for model selection.
RoutingConfig
RoutingConfig(
*,
routing_config: typing.Union[
vertexai.generative_models._generative_models.GenerationConfig.RoutingConfig.AutoRoutingMode,
vertexai.generative_models._generative_models.GenerationConfig.RoutingConfig.ManualRoutingMode,
]
)
The configuration for model router requests.
Deprecated, please use ModelConfig to set routing preference instead.
The routing config is either one of the two nested classes:
- AutoRoutingMode: Automated routing.
- ManualRoutingMode: Manual routing.
Usage:
AutoRoutingMode:
routing_config=generative_models.RoutingConfig(
routing_config=generative_models.RoutingConfig.AutoRoutingMode(
model_routing_preference=generative_models.RoutingConfig.AutoRoutingMode.ModelRoutingPreference.BALANCED,
),
)
ManualRoutingMode:
routing_config=generative_models.RoutingConfig(
routing_config=generative_models.RoutingConfig.ManutalRoutingMode(
model_name="gemini-1.5-pro-001",
),
)
Methods
GenerationConfig
GenerationConfig(
*,
temperature: typing.Optional[float] = None,
top_p: typing.Optional[float] = None,
top_k: typing.Optional[int] = None,
candidate_count: typing.Optional[int] = None,
max_output_tokens: typing.Optional[int] = None,
stop_sequences: typing.Optional[typing.List[str]] = None,
presence_penalty: typing.Optional[float] = None,
frequency_penalty: typing.Optional[float] = None,
response_mime_type: typing.Optional[str] = None,
response_schema: typing.Optional[typing.Dict[str, typing.Any]] = None,
seed: typing.Optional[int] = None,
audio_timestamp: typing.Optional[bool] = None,
routing_config: typing.Optional[RoutingConfig] = None,
logprobs: typing.Optional[int] = None,
response_logprobs: typing.Optional[bool] = None,
response_modalities: typing.Optional[typing.List[GenerationConfig.Modality]] = None,
model_config: typing.Optional[GenerationConfig.ModelConfig] = None
)
Constructs a GenerationConfig object.
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2025-08-07 UTC.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-08-07 UTC."],[],[],null,["# Class GenerationConfig (1.95.1)\n\nVersion latestkeyboard_arrow_down\n\n- [1.95.1 (latest)](/python/docs/reference/vertexai/latest/vertexai.generative_models.GenerationConfig)\n- [1.94.0](/python/docs/reference/vertexai/1.94.0/vertexai.generative_models.GenerationConfig)\n- [1.93.1](/python/docs/reference/vertexai/1.93.1/vertexai.generative_models.GenerationConfig)\n- [1.92.0](/python/docs/reference/vertexai/1.92.0/vertexai.generative_models.GenerationConfig)\n- [1.91.0](/python/docs/reference/vertexai/1.91.0/vertexai.generative_models.GenerationConfig)\n- [1.90.0](/python/docs/reference/vertexai/1.90.0/vertexai.generative_models.GenerationConfig)\n- [1.89.0](/python/docs/reference/vertexai/1.89.0/vertexai.generative_models.GenerationConfig)\n- [1.88.0](/python/docs/reference/vertexai/1.88.0/vertexai.generative_models.GenerationConfig)\n- [1.87.0](/python/docs/reference/vertexai/1.87.0/vertexai.generative_models.GenerationConfig)\n- [1.86.0](/python/docs/reference/vertexai/1.86.0/vertexai.generative_models.GenerationConfig)\n- [1.85.0](/python/docs/reference/vertexai/1.85.0/vertexai.generative_models.GenerationConfig)\n- [1.84.0](/python/docs/reference/vertexai/1.84.0/vertexai.generative_models.GenerationConfig)\n- [1.83.0](/python/docs/reference/vertexai/1.83.0/vertexai.generative_models.GenerationConfig)\n- [1.82.0](/python/docs/reference/vertexai/1.82.0/vertexai.generative_models.GenerationConfig)\n- [1.81.0](/python/docs/reference/vertexai/1.81.0/vertexai.generative_models.GenerationConfig)\n- [1.80.0](/python/docs/reference/vertexai/1.80.0/vertexai.generative_models.GenerationConfig)\n- [1.79.0](/python/docs/reference/vertexai/1.79.0/vertexai.generative_models.GenerationConfig)\n- [1.78.0](/python/docs/reference/vertexai/1.78.0/vertexai.generative_models.GenerationConfig)\n- [1.77.0](/python/docs/reference/vertexai/1.77.0/vertexai.generative_models.GenerationConfig)\n- [1.76.0](/python/docs/reference/vertexai/1.76.0/vertexai.generative_models.GenerationConfig)\n- [1.75.0](/python/docs/reference/vertexai/1.75.0/vertexai.generative_models.GenerationConfig)\n- [1.74.0](/python/docs/reference/vertexai/1.74.0/vertexai.generative_models.GenerationConfig)\n- [1.73.0](/python/docs/reference/vertexai/1.73.0/vertexai.generative_models.GenerationConfig)\n- [1.72.0](/python/docs/reference/vertexai/1.72.0/vertexai.generative_models.GenerationConfig)\n- [1.71.1](/python/docs/reference/vertexai/1.71.1/vertexai.generative_models.GenerationConfig)\n- [1.70.0](/python/docs/reference/vertexai/1.70.0/vertexai.generative_models.GenerationConfig)\n- [1.69.0](/python/docs/reference/vertexai/1.69.0/vertexai.generative_models.GenerationConfig)\n- [1.68.0](/python/docs/reference/vertexai/1.68.0/vertexai.generative_models.GenerationConfig)\n- [1.67.1](/python/docs/reference/vertexai/1.67.1/vertexai.generative_models.GenerationConfig)\n- [1.66.0](/python/docs/reference/vertexai/1.66.0/vertexai.generative_models.GenerationConfig)\n- [1.65.0](/python/docs/reference/vertexai/1.65.0/vertexai.generative_models.GenerationConfig)\n- [1.63.0](/python/docs/reference/vertexai/1.63.0/vertexai.generative_models.GenerationConfig)\n- [1.62.0](/python/docs/reference/vertexai/1.62.0/vertexai.generative_models.GenerationConfig)\n- [1.60.0](/python/docs/reference/vertexai/1.60.0/vertexai.generative_models.GenerationConfig)\n- [1.59.0](/python/docs/reference/vertexai/1.59.0/vertexai.generative_models.GenerationConfig) \n\n GenerationConfig(\n *,\n temperature: typing.Optional[float] = None,\n top_p: typing.Optional[float] = None,\n top_k: typing.Optional[int] = None,\n candidate_count: typing.Optional[int] = None,\n max_output_tokens: typing.Optional[int] = None,\n stop_sequences: typing.Optional[typing.List[str]] = None,\n presence_penalty: typing.Optional[float] = None,\n frequency_penalty: typing.Optional[float] = None,\n response_mime_type: typing.Optional[str] = None,\n response_schema: typing.Optional[typing.Dict[str, typing.Any]] = None,\n seed: typing.Optional[int] = None,\n audio_timestamp: typing.Optional[bool] = None,\n routing_config: typing.Optional[RoutingConfig] = None,\n logprobs: typing.Optional[int] = None,\n response_logprobs: typing.Optional[bool] = None,\n response_modalities: typing.Optional[typing.List[GenerationConfig.Modality]] = None,\n model_config: typing.Optional[GenerationConfig.ModelConfig] = None\n )\n\nParameters for the generation.\n\nClasses\n-------\n\n### Modality\n\n Modality(value)\n\nThe modalities of the response.\n\n### ModelConfig\n\n ModelConfig(mapping=None, *, ignore_unknown_fields=False, **kwargs)\n\nConfig for model selection.\n\n### RoutingConfig\n\n RoutingConfig(\n *,\n routing_config: typing.Union[\n vertexai.generative_models._generative_models.GenerationConfig.RoutingConfig.AutoRoutingMode,\n vertexai.generative_models._generative_models.GenerationConfig.RoutingConfig.ManualRoutingMode,\n ]\n )\n\nThe configuration for model router requests.\nDeprecated, please use ModelConfig to set routing preference instead.\n\nThe routing config is either one of the two nested classes:\n\n- AutoRoutingMode: Automated routing.\n- ManualRoutingMode: Manual routing.\n\nUsage:\n\n- AutoRoutingMode:\n\n routing_config=generative_models.RoutingConfig(\n routing_config=generative_models.RoutingConfig.AutoRoutingMode(\n model_routing_preference=generative_models.RoutingConfig.AutoRoutingMode.ModelRoutingPreference.BALANCED,\n ),\n )\n\n- ManualRoutingMode:\n\n routing_config=generative_models.RoutingConfig(\n routing_config=generative_models.RoutingConfig.ManutalRoutingMode(\n model_name=\"gemini-1.5-pro-001\",\n ),\n )\n\nMethods\n-------\n\n### GenerationConfig\n\n GenerationConfig(\n *,\n temperature: typing.Optional[float] = None,\n top_p: typing.Optional[float] = None,\n top_k: typing.Optional[int] = None,\n candidate_count: typing.Optional[int] = None,\n max_output_tokens: typing.Optional[int] = None,\n stop_sequences: typing.Optional[typing.List[str]] = None,\n presence_penalty: typing.Optional[float] = None,\n frequency_penalty: typing.Optional[float] = None,\n response_mime_type: typing.Optional[str] = None,\n response_schema: typing.Optional[typing.Dict[str, typing.Any]] = None,\n seed: typing.Optional[int] = None,\n audio_timestamp: typing.Optional[bool] = None,\n routing_config: typing.Optional[RoutingConfig] = None,\n logprobs: typing.Optional[int] = None,\n response_logprobs: typing.Optional[bool] = None,\n response_modalities: typing.Optional[typing.List[GenerationConfig.Modality]] = None,\n model_config: typing.Optional[GenerationConfig.ModelConfig] = None\n )\n\nConstructs a GenerationConfig object."]]