Class GenerationSpec (0.12.3)

GenerationSpec(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Attributes

Name Description
model_id str
Specifies which Vertex model id to use for generation.
language_code str
Language code for content. Use language tags defined by BCP47 __.
temperature float
If specified, custom value for the temperature will be used. This field is a member of oneof_ _temperature.
top_p float
If specified, custom value for nucleus sampling will be used. This field is a member of oneof_ _top_p.
top_k int
If specified, custom value for top-k sampling will be used. This field is a member of oneof_ _top_k.
frequency_penalty float
If specified, custom value for frequency penalty will be used. This field is a member of oneof_ _frequency_penalty.
presence_penalty float
If specified, custom value for presence penalty will be used. This field is a member of oneof_ _presence_penalty.
max_output_tokens int
If specified, custom value for max output tokens will be used. This field is a member of oneof_ _max_output_tokens.