Class LlmUtilityServiceGrpc.LlmUtilityServiceStub (3.37.0) 

public static final class LlmUtilityServiceGrpc.LlmUtilityServiceStub extends AbstractAsyncStub<LlmUtilityServiceGrpc.LlmUtilityServiceStub>

A stub to allow clients to do asynchronous rpc calls to service LlmUtilityService.

Service for LLM related utility functions.

Inheritance

java.lang.Object > io.grpc.stub.AbstractStub > io.grpc.stub.AbstractAsyncStub > LlmUtilityServiceGrpc.LlmUtilityServiceStub

Methods

build(Channel channel, CallOptions callOptions)

protected LlmUtilityServiceGrpc.LlmUtilityServiceStub build(Channel channel, CallOptions callOptions)
Parameters
NameDescription
channelio.grpc.Channel
callOptionsio.grpc.CallOptions
Returns
TypeDescription
LlmUtilityServiceGrpc.LlmUtilityServiceStub
Overrides
io.grpc.stub.AbstractStub.build(io.grpc.Channel,io.grpc.CallOptions)

computeTokens(ComputeTokensRequest request, StreamObserver<ComputeTokensResponse> responseObserver)

public void computeTokens(ComputeTokensRequest request, StreamObserver<ComputeTokensResponse> responseObserver)

Return a list of tokens based on the input text.

Parameters
NameDescription
requestComputeTokensRequest
responseObserverio.grpc.stub.StreamObserver<ComputeTokensResponse>

countTokens(CountTokensRequest request, StreamObserver<CountTokensResponse> responseObserver)

public void countTokens(CountTokensRequest request, StreamObserver<CountTokensResponse> responseObserver)

Perform a token counting.

Parameters
NameDescription
requestCountTokensRequest
responseObserverio.grpc.stub.StreamObserver<CountTokensResponse>