Cloud AI Platform v1 API - Class SpeculativeDecodingSpec.Types.DraftModelSpeculation (3.15.0)

public sealed class SpeculativeDecodingSpec.Types.DraftModelSpeculation : IMessage<SpeculativeDecodingSpec.Types.DraftModelSpeculation>, IEquatable<SpeculativeDecodingSpec.Types.DraftModelSpeculation>, IDeepCloneable<SpeculativeDecodingSpec.Types.DraftModelSpeculation>, IBufferMessage, IMessage

Reference documentation and code samples for the Cloud AI Platform v1 API class SpeculativeDecodingSpec.Types.DraftModelSpeculation.

Draft model speculation works by using the smaller model to generate candidate tokens for speculative decoding.

Inheritance

object > SpeculativeDecodingSpec.Types.DraftModelSpeculation

Implements

IMessage SpeculativeDecodingSpec Types DraftModelSpeculation, IEquatable SpeculativeDecodingSpec Types DraftModelSpeculation, IDeepCloneable SpeculativeDecodingSpec Types DraftModelSpeculation, IBufferMessage, IMessage

Inherited Members

object.GetHashCode()

object.GetType()

object.ToString()

Namespace

Google.Cloud.AIPlatform.V1

Assembly

Google.Cloud.AIPlatform.V1.dll

Constructors

DraftModelSpeculation()

public DraftModelSpeculation()

DraftModelSpeculation(DraftModelSpeculation)

public DraftModelSpeculation(SpeculativeDecodingSpec.Types.DraftModelSpeculation other)

Parameter
Name	Description
`other`	`SpeculativeDecodingSpecTypesDraftModelSpeculation`

Properties

DraftModel

public string DraftModel { get; set; }

Required. The resource name of the draft model.

Property Value
Type	Description
`string`

DraftModelAsModelName

public ModelName DraftModelAsModelName { get; set; }

ModelName-typed view over the DraftModel resource name property.

Property Value
Type	Description
`ModelName`