Vertex AI v1 API - Class CountTokensRequest (3.50.0) 

public sealed class CountTokensRequest : IMessage<CountTokensRequest>, IEquatable<CountTokensRequest>, IDeepCloneable<CountTokensRequest>, IBufferMessage, IMessage

Reference documentation and code samples for the Vertex AI v1 API class CountTokensRequest.

Request message for [PredictionService.CountTokens][].

Inheritance

object > CountTokensRequest

Namespace

Google.Cloud.AIPlatform.V1

Assembly

Google.Cloud.AIPlatform.V1.dll

Constructors

CountTokensRequest()

public CountTokensRequest()

CountTokensRequest(CountTokensRequest)

public CountTokensRequest(CountTokensRequest other)
Parameter
Name Description
other CountTokensRequest

Properties

Contents

public RepeatedField<Content> Contents { get; }

Optional. Input content.

Property Value
Type Description
RepeatedFieldContent

Endpoint

public string Endpoint { get; set; }

Required. The name of the Endpoint requested to perform token counting. Format: projects/{project}/locations/{location}/endpoints/{endpoint}

Property Value
Type Description
string

EndpointAsEndpointName

public EndpointName EndpointAsEndpointName { get; set; }

EndpointName-typed view over the Endpoint resource name property.

Property Value
Type Description
EndpointName

GenerationConfig

public GenerationConfig GenerationConfig { get; set; }

Optional. Generation config that the model will use to generate the response.

Property Value
Type Description
GenerationConfig

Instances

public RepeatedField<Value> Instances { get; }

Optional. The instances that are the input to token counting call. Schema is identical to the prediction schema of the underlying model.

Property Value
Type Description
RepeatedFieldValue

Model

public string Model { get; set; }

Optional. The name of the publisher model requested to serve the prediction. Format: projects/{project}/locations/{location}/publishers/*/models/*

Property Value
Type Description
string

SystemInstruction

public Content SystemInstruction { get; set; }

Optional. The user provided system instructions for the model. Note: only text should be used in parts and content in each part will be in a separate paragraph.

Property Value
Type Description
Content

Tools

public RepeatedField<Tool> Tools { get; }

Optional. A list of Tools the model may use to generate the next response.

A Tool is a piece of code that enables the system to interact with external systems to perform an action, or set of actions, outside of knowledge and scope of the model.

Property Value
Type Description
RepeatedFieldTool