Vertex AI v1beta1 API - Class SpeculativeDecodingSpec.Types.DraftModelSpeculation (1.0.0-beta38) 

public sealed class SpeculativeDecodingSpec.Types.DraftModelSpeculation : IMessage<SpeculativeDecodingSpec.Types.DraftModelSpeculation>, IEquatable<SpeculativeDecodingSpec.Types.DraftModelSpeculation>, IDeepCloneable<SpeculativeDecodingSpec.Types.DraftModelSpeculation>, IBufferMessage, IMessage

Reference documentation and code samples for the Vertex AI v1beta1 API class SpeculativeDecodingSpec.Types.DraftModelSpeculation.

Draft model speculation works by using the smaller model to generate candidate tokens for speculative decoding.

Inheritance

object > SpeculativeDecodingSpec.Types.DraftModelSpeculation

Namespace

Google.Cloud.AIPlatform.V1Beta1

Assembly

Google.Cloud.AIPlatform.V1Beta1.dll

Constructors

DraftModelSpeculation()

public DraftModelSpeculation()

DraftModelSpeculation(DraftModelSpeculation)

public DraftModelSpeculation(SpeculativeDecodingSpec.Types.DraftModelSpeculation other)
Parameter
Name Description
other SpeculativeDecodingSpecTypesDraftModelSpeculation

Properties

DraftModel

public string DraftModel { get; set; }

Required. The resource name of the draft model.

Property Value
Type Description
string

DraftModelAsModelName

public ModelName DraftModelAsModelName { get; set; }

ModelName-typed view over the DraftModel resource name property.

Property Value
Type Description
ModelName