[BindServiceMethod(typeof(LlmUtilityService), "BindService")]
public abstract class LlmUtilityService.LlmUtilityServiceBase
Reference documentation and code samples for the Cloud AI Platform v1beta1 API class LlmUtilityService.LlmUtilityServiceBase.
Base class for server-side implementations of LlmUtilityService
Namespace
Google.Cloud.AIPlatform.V1Beta1Assembly
Google.Cloud.AIPlatform.V1Beta1.dll
Methods
ComputeTokens(ComputeTokensRequest, ServerCallContext)
public virtual Task<ComputeTokensResponse> ComputeTokens(ComputeTokensRequest request, ServerCallContext context)
Return a list of tokens based on the input text.
Parameters | |
---|---|
Name | Description |
request |
ComputeTokensRequest The request received from the client. |
context |
ServerCallContext The context of the server-side call handler being invoked. |
Returns | |
---|---|
Type | Description |
TaskComputeTokensResponse |
The response to send back to the client (wrapped by a task). |