- 3.71.0 (latest)
- 3.69.0
- 3.68.0
- 3.65.0
- 3.64.0
- 3.63.0
- 3.61.0
- 3.60.0
- 3.59.0
- 3.58.0
- 3.57.0
- 3.56.0
- 3.55.0
- 3.54.0
- 3.53.0
- 3.52.0
- 3.50.0
- 3.49.0
- 3.48.0
- 3.47.0
- 3.46.0
- 3.45.0
- 3.44.0
- 3.43.0
- 3.42.0
- 3.41.0
- 3.40.0
- 3.38.0
- 3.37.0
- 3.36.0
- 3.35.0
- 3.34.0
- 3.33.0
- 3.32.0
- 3.31.0
- 3.30.0
- 3.29.0
- 3.28.0
- 3.25.0
- 3.24.0
- 3.23.0
- 3.22.0
- 3.21.0
- 3.20.0
- 3.19.0
- 3.18.0
- 3.17.0
- 3.16.0
- 3.15.0
- 3.14.0
- 3.13.0
- 3.12.0
- 3.11.0
- 3.10.0
- 3.9.0
- 3.8.0
- 3.7.0
- 3.6.0
- 3.5.0
- 3.4.2
- 3.3.0
- 3.2.0
- 3.0.0
- 2.9.8
- 2.8.9
- 2.7.4
- 2.5.3
- 2.4.0
public static interface LlmUtilityServiceGrpc.AsyncServiceService for LLM related utility functions.
Methods
computeTokens(ComputeTokensRequest request, StreamObserver<ComputeTokensResponse> responseObserver)
public default void computeTokens(ComputeTokensRequest request, StreamObserver<ComputeTokensResponse> responseObserver)Return a list of tokens based on the input text.
| Parameters | |
|---|---|
| Name | Description |
request |
ComputeTokensRequest |
responseObserver |
io.grpc.stub.StreamObserver<ComputeTokensResponse> |
countTokens(CountTokensRequest request, StreamObserver<CountTokensResponse> responseObserver)
public default void countTokens(CountTokensRequest request, StreamObserver<CountTokensResponse> responseObserver)Perform a token counting.
| Parameters | |
|---|---|
| Name | Description |
request |
CountTokensRequest |
responseObserver |
io.grpc.stub.StreamObserver<CountTokensResponse> |