Class LlmUtilityServiceGrpc.LlmUtilityServiceBlockingV2Stub (1.20.0)

public static final class LlmUtilityServiceGrpc.LlmUtilityServiceBlockingV2Stub extends AbstractBlockingStub<LlmUtilityServiceGrpc.LlmUtilityServiceBlockingV2Stub>

A stub to allow clients to do synchronous rpc calls to service LlmUtilityService.

Service for LLM related utility functions.

Inheritance

java.lang.Object > io.grpc.stub.AbstractStub > io.grpc.stub.AbstractBlockingStub > LlmUtilityServiceGrpc.LlmUtilityServiceBlockingV2Stub

Methods

build(Channel channel, CallOptions callOptions)

protected LlmUtilityServiceGrpc.LlmUtilityServiceBlockingV2Stub build(Channel channel, CallOptions callOptions)
Parameters
Name Description
channel io.grpc.Channel
callOptions io.grpc.CallOptions
Returns
Type Description
LlmUtilityServiceGrpc.LlmUtilityServiceBlockingV2Stub
Overrides
io.grpc.stub.AbstractStub.build(io.grpc.Channel,io.grpc.CallOptions)

computeTokens(ComputeTokensRequest request)

public ComputeTokensResponse computeTokens(ComputeTokensRequest request)

Return a list of tokens based on the input text.

Parameter
Name Description
request ComputeTokensRequest
Returns
Type Description
ComputeTokensResponse

countTokens(CountTokensRequest request)

public CountTokensResponse countTokens(CountTokensRequest request)

Perform a token counting.

Parameter
Name Description
request CountTokensRequest
Returns
Type Description
CountTokensResponse