Cloud AI Platform v1 API - Class SpeculativeDecodingSpec (3.15.0)

public sealed class SpeculativeDecodingSpec : IMessage<SpeculativeDecodingSpec>, IEquatable<SpeculativeDecodingSpec>, IDeepCloneable<SpeculativeDecodingSpec>, IBufferMessage, IMessage

Reference documentation and code samples for the Cloud AI Platform v1 API class SpeculativeDecodingSpec.

Configuration for Speculative Decoding.

Inheritance

object > SpeculativeDecodingSpec

Implements

IMessage SpeculativeDecodingSpec, IEquatable SpeculativeDecodingSpec, IDeepCloneable SpeculativeDecodingSpec, IBufferMessage, IMessage

Inherited Members

object.GetHashCode()

object.GetType()

object.ToString()

Namespace

Google.Cloud.AIPlatform.V1

Assembly

Google.Cloud.AIPlatform.V1.dll

Constructors

SpeculativeDecodingSpec()

public SpeculativeDecodingSpec()

SpeculativeDecodingSpec(SpeculativeDecodingSpec)

public SpeculativeDecodingSpec(SpeculativeDecodingSpec other)

Parameter
Name	Description
`other`	`SpeculativeDecodingSpec`

Properties

DraftModelSpeculation

public SpeculativeDecodingSpec.Types.DraftModelSpeculation DraftModelSpeculation { get; set; }

draft model speculation.

Property Value
Type	Description
`SpeculativeDecodingSpecTypesDraftModelSpeculation`

NgramSpeculation

public SpeculativeDecodingSpec.Types.NgramSpeculation NgramSpeculation { get; set; }

N-Gram speculation.

Property Value
Type	Description
`SpeculativeDecodingSpecTypesNgramSpeculation`

SpeculationCase

public SpeculativeDecodingSpec.SpeculationOneofCase SpeculationCase { get; }

Property Value
Type	Description
`SpeculativeDecodingSpecSpeculationOneofCase`

SpeculativeTokenCount

public int SpeculativeTokenCount { get; set; }

The number of speculative tokens to generate at each step.

Property Value
Type	Description
`int`