Starting April 29, 2025, Gemini 1.5 Pro and Gemini 1.5 Flash models are not available in projects that have no prior usage of these models, including new projects. For details, see
Model versions and lifecycle .
Send feedback
Class SpeculativeDecodingSpec.NgramSpeculation.Builder (1.22.0)
Stay organized with collections
Save and categorize content based on your preferences.
public static final class SpeculativeDecodingSpec . NgramSpeculation . Builder extends GeneratedMessageV3 . Builder<SpeculativeDecodingSpec . NgramSpeculation . Builder > implements SpeculativeDecodingSpec . NgramSpeculationOrBuilder
N-Gram speculation works by trying to find matching tokens in the
previous prompt sequence and use those as speculation for generating
new tokens.
Protobuf type google.cloud.vertexai.v1.SpeculativeDecodingSpec.NgramSpeculation
Inherited Members
com.google.protobuf.GeneratedMessageV3.Builder.getUnknownFieldSetBuilder()
com.google.protobuf.GeneratedMessageV3.Builder.internalGetMapFieldReflection(int)
com.google.protobuf.GeneratedMessageV3.Builder.internalGetMutableMapFieldReflection(int)
com.google.protobuf.GeneratedMessageV3.Builder.mergeUnknownLengthDelimitedField(int,com.google.protobuf.ByteString)
com.google.protobuf.GeneratedMessageV3.Builder.mergeUnknownVarintField(int,int)
com.google.protobuf.GeneratedMessageV3.Builder.parseUnknownField(com.google.protobuf.CodedInputStream,com.google.protobuf.ExtensionRegistryLite,int)
com.google.protobuf.GeneratedMessageV3.Builder.setUnknownFieldSetBuilder(com.google.protobuf.UnknownFieldSet.Builder)
Static Methods
getDescriptor()
public static final Descriptors . Descriptor getDescriptor ()
Methods
addRepeatedField(Descriptors.FieldDescriptor field, Object value)
public SpeculativeDecodingSpec . NgramSpeculation . Builder addRepeatedField ( Descriptors . FieldDescriptor field , Object value )
Overrides
build()
public SpeculativeDecodingSpec . NgramSpeculation build ()
buildPartial()
public SpeculativeDecodingSpec . NgramSpeculation buildPartial ()
clear()
public SpeculativeDecodingSpec . NgramSpeculation . Builder clear ()
Overrides
clearField(Descriptors.FieldDescriptor field)
public SpeculativeDecodingSpec . NgramSpeculation . Builder clearField ( Descriptors . FieldDescriptor field )
Overrides
clearNgramSize()
public SpeculativeDecodingSpec . NgramSpeculation . Builder clearNgramSize ()
The number of last N input tokens used as ngram to search/match
against the previous prompt sequence.
This is equal to the N in N-Gram.
The default value is 3 if not specified.
int32 ngram_size = 1;
clearOneof(Descriptors.OneofDescriptor oneof)
public SpeculativeDecodingSpec . NgramSpeculation . Builder clearOneof ( Descriptors . OneofDescriptor oneof )
Overrides
clone()
public SpeculativeDecodingSpec . NgramSpeculation . Builder clone ()
Overrides
getDefaultInstanceForType()
public SpeculativeDecodingSpec . NgramSpeculation getDefaultInstanceForType ()
getDescriptorForType()
public Descriptors . Descriptor getDescriptorForType ()
Overrides
getNgramSize()
public int getNgramSize ()
The number of last N input tokens used as ngram to search/match
against the previous prompt sequence.
This is equal to the N in N-Gram.
The default value is 3 if not specified.
int32 ngram_size = 1;
Returns
Type Description
int The ngramSize.
internalGetFieldAccessorTable()
protected GeneratedMessageV3 . FieldAccessorTable internalGetFieldAccessorTable ()
Overrides
isInitialized()
public final boolean isInitialized ()
Overrides
mergeFrom(SpeculativeDecodingSpec.NgramSpeculation other)
public SpeculativeDecodingSpec . NgramSpeculation . Builder mergeFrom ( SpeculativeDecodingSpec . NgramSpeculation other )
public SpeculativeDecodingSpec . NgramSpeculation . Builder mergeFrom ( CodedInputStream input , ExtensionRegistryLite extensionRegistry )
Overrides
mergeFrom(Message other)
public SpeculativeDecodingSpec . NgramSpeculation . Builder mergeFrom ( Message other )
Parameter
Name Description
otherMessage
Overrides
mergeUnknownFields(UnknownFieldSet unknownFields)
public final SpeculativeDecodingSpec . NgramSpeculation . Builder mergeUnknownFields ( UnknownFieldSet unknownFields )
Overrides
setField(Descriptors.FieldDescriptor field, Object value)
public SpeculativeDecodingSpec . NgramSpeculation . Builder setField ( Descriptors . FieldDescriptor field , Object value )
Overrides
setNgramSize(int value)
public SpeculativeDecodingSpec . NgramSpeculation . Builder setNgramSize ( int value )
The number of last N input tokens used as ngram to search/match
against the previous prompt sequence.
This is equal to the N in N-Gram.
The default value is 3 if not specified.
int32 ngram_size = 1;
Parameter
Name Description
valueint The ngramSize to set.
setRepeatedField(Descriptors.FieldDescriptor field, int index, Object value)
public SpeculativeDecodingSpec . NgramSpeculation . Builder setRepeatedField ( Descriptors . FieldDescriptor field , int index , Object value )
Overrides
setUnknownFields(UnknownFieldSet unknownFields)
public final SpeculativeDecodingSpec . NgramSpeculation . Builder setUnknownFields ( UnknownFieldSet unknownFields )
Overrides
Send feedback
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License , and code samples are licensed under the Apache 2.0 License . For details, see the Google Developers Site Policies . Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2025-05-14 UTC.
Need to tell us more?
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-05-14 UTC."],[],[]]
