Vertex AI v1 API - Class LlmUtilityServiceClientImpl (3.50.0)

public sealed class LlmUtilityServiceClientImpl : LlmUtilityServiceClient

Reference documentation and code samples for the Vertex AI v1 API class LlmUtilityServiceClientImpl.

LlmUtilityService client wrapper implementation, for convenient use.

Inheritance

object > LlmUtilityServiceClient > LlmUtilityServiceClientImpl

Inherited Members

LlmUtilityServiceClient.DefaultEndpoint

LlmUtilityServiceClient.DefaultScopes

LlmUtilityServiceClient.ServiceMetadata

LlmUtilityServiceClient.CreateAsync(CancellationToken)

LlmUtilityServiceClient.Create()

LlmUtilityServiceClient.ShutdownDefaultChannelsAsync()

LlmUtilityServiceClient.CountTokensAsync(CountTokensRequest, CancellationToken)

LlmUtilityServiceClient.CountTokens(string, IEnumerable<Value>, CallSettings)

LlmUtilityServiceClient.CountTokensAsync(string, IEnumerable<Value>, CallSettings)

LlmUtilityServiceClient.CountTokensAsync(string, IEnumerable<Value>, CancellationToken)

LlmUtilityServiceClient.CountTokens(EndpointName, IEnumerable<Value>, CallSettings)

LlmUtilityServiceClient.CountTokensAsync(EndpointName, IEnumerable<Value>, CallSettings)

LlmUtilityServiceClient.CountTokensAsync(EndpointName, IEnumerable<Value>, CancellationToken)

LlmUtilityServiceClient.ComputeTokensAsync(ComputeTokensRequest, CancellationToken)

LlmUtilityServiceClient.ComputeTokens(string, IEnumerable<Value>, CallSettings)

LlmUtilityServiceClient.ComputeTokensAsync(string, IEnumerable<Value>, CallSettings)

LlmUtilityServiceClient.ComputeTokensAsync(string, IEnumerable<Value>, CancellationToken)

LlmUtilityServiceClient.ComputeTokens(EndpointName, IEnumerable<Value>, CallSettings)

LlmUtilityServiceClient.ComputeTokensAsync(EndpointName, IEnumerable<Value>, CallSettings)

LlmUtilityServiceClient.ComputeTokensAsync(EndpointName, IEnumerable<Value>, CancellationToken)

object.GetHashCode()

object.GetType()

object.ToString()

Namespace

Google.Cloud.AIPlatform.V1

Assembly

Google.Cloud.AIPlatform.V1.dll

Remarks

Service for LLM related utility functions.

Constructors

LlmUtilityServiceClientImpl(LlmUtilityServiceClient, LlmUtilityServiceSettings, ILogger)

public LlmUtilityServiceClientImpl(LlmUtilityService.LlmUtilityServiceClient grpcClient, LlmUtilityServiceSettings settings, ILogger logger)

Constructs a client wrapper for the LlmUtilityService service, with the specified gRPC client and settings.

Parameters
Name	Description
`grpcClient`	`LlmUtilityServiceLlmUtilityServiceClient` The underlying gRPC client.
`settings`	`LlmUtilityServiceSettings` The base LlmUtilityServiceSettings used within this client.
`logger`	`ILogger` Optional ILogger to use within this client.

Properties

GrpcClient

public override LlmUtilityService.LlmUtilityServiceClient GrpcClient { get; }

The underlying gRPC LlmUtilityService client

Property Value
Type	Description
`LlmUtilityServiceLlmUtilityServiceClient`

Overrides

LlmUtilityServiceClient.GrpcClient

IAMPolicyClient

public override IAMPolicyClient IAMPolicyClient { get; }

The IAMPolicyClient associated with this client.

Property Value
Type	Description
`IAMPolicyClient`

Overrides

LlmUtilityServiceClient.IAMPolicyClient

LocationsClient

public override LocationsClient LocationsClient { get; }

The LocationsClient associated with this client.

Property Value
Type	Description
`LocationsClient`

Overrides

LlmUtilityServiceClient.LocationsClient

Methods

ComputeTokens(ComputeTokensRequest, CallSettings)

public override ComputeTokensResponse ComputeTokens(ComputeTokensRequest request, CallSettings callSettings = null)

Return a list of tokens based on the input text.

Parameters
Name	Description
`request`	`ComputeTokensRequest` The request object containing all of the parameters for the API call.
`callSettings`	`CallSettings` If not null, applies overrides to this RPC call.

Returns
Type	Description
`ComputeTokensResponse`	The RPC response.

Overrides

LlmUtilityServiceClient.ComputeTokens(ComputeTokensRequest, CallSettings)

ComputeTokensAsync(ComputeTokensRequest, CallSettings)

public override Task<ComputeTokensResponse> ComputeTokensAsync(ComputeTokensRequest request, CallSettings callSettings = null)

Return a list of tokens based on the input text.

Parameters
Name	Description
`request`	`ComputeTokensRequest` The request object containing all of the parameters for the API call.
`callSettings`	`CallSettings` If not null, applies overrides to this RPC call.

Returns
Type	Description
`TaskComputeTokensResponse`	A Task containing the RPC response.

Overrides

LlmUtilityServiceClient.ComputeTokensAsync(ComputeTokensRequest, CallSettings)

CountTokens(CountTokensRequest, CallSettings)

public override CountTokensResponse CountTokens(CountTokensRequest request, CallSettings callSettings = null)

Perform a token counting.

Parameters
Name	Description
`request`	`CountTokensRequest` The request object containing all of the parameters for the API call.
`callSettings`	`CallSettings` If not null, applies overrides to this RPC call.

Returns
Type	Description
`CountTokensResponse`	The RPC response.

Overrides

LlmUtilityServiceClient.CountTokens(CountTokensRequest, CallSettings)

CountTokensAsync(CountTokensRequest, CallSettings)

public override Task<CountTokensResponse> CountTokensAsync(CountTokensRequest request, CallSettings callSettings = null)

Perform a token counting.

Parameters
Name	Description
`request`	`CountTokensRequest` The request object containing all of the parameters for the API call.
`callSettings`	`CallSettings` If not null, applies overrides to this RPC call.

Returns
Type	Description
`TaskCountTokensResponse`	A Task containing the RPC response.

Overrides

LlmUtilityServiceClient.CountTokensAsync(CountTokensRequest, CallSettings)