- 1.63.0 (latest)
- 1.62.0
- 1.60.0
- 1.59.0
- 1.58.0
- 1.57.0
- 1.56.0
- 1.55.0
- 1.54.1
- 1.53.0
- 1.52.0
- 1.51.0
- 1.50.0
- 1.49.0
- 1.48.0
- 1.47.0
- 1.46.0
- 1.45.0
- 1.44.0
- 1.43.0
- 1.39.0
- 1.38.1
- 1.37.0
- 1.36.4
- 1.35.0
- 1.34.0
- 1.33.1
- 1.32.0
- 1.31.1
- 1.30.1
- 1.29.0
- 1.28.1
- 1.27.1
- 1.26.1
- 1.25.0
- 1.24.1
- 1.23.0
- 1.22.1
- 1.21.0
- 1.20.0
- 1.19.1
- 1.18.3
- 1.17.1
- 1.16.1
- 1.15.1
- 1.14.0
- 1.13.1
- 1.12.1
- 1.11.0
- 1.10.0
- 1.9.0
- 1.8.1
- 1.7.1
- 1.6.2
- 1.5.0
- 1.4.3
- 1.3.0
- 1.2.0
- 1.1.1
- 1.0.1
- 0.9.0
- 0.8.0
- 0.7.1
- 0.6.0
- 0.5.1
- 0.4.0
- 0.3.1
EvaluateInstancesResponse(mapping=None, *, ignore_unknown_fields=False, **kwargs)
Response message for EvaluationService.EvaluateInstances.
This message has oneof
_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
Attributes |
|
---|---|
Name | Description |
exact_match_results |
google.cloud.aiplatform_v1beta1.types.ExactMatchResults
Auto metric evaluation results. Results for exact match metric. This field is a member of oneof _ evaluation_results .
|
bleu_results |
google.cloud.aiplatform_v1beta1.types.BleuResults
Results for bleu metric. This field is a member of oneof _ evaluation_results .
|
rouge_results |
google.cloud.aiplatform_v1beta1.types.RougeResults
Results for rouge metric. This field is a member of oneof _ evaluation_results .
|
fluency_result |
google.cloud.aiplatform_v1beta1.types.FluencyResult
LLM-based metric evaluation result. General text generation metrics, applicable to other categories. Result for fluency metric. This field is a member of oneof _ evaluation_results .
|
coherence_result |
google.cloud.aiplatform_v1beta1.types.CoherenceResult
Result for coherence metric. This field is a member of oneof _ evaluation_results .
|
safety_result |
google.cloud.aiplatform_v1beta1.types.SafetyResult
Result for safety metric. This field is a member of oneof _ evaluation_results .
|
groundedness_result |
google.cloud.aiplatform_v1beta1.types.GroundednessResult
Result for groundedness metric. This field is a member of oneof _ evaluation_results .
|
fulfillment_result |
google.cloud.aiplatform_v1beta1.types.FulfillmentResult
Result for fulfillment metric. This field is a member of oneof _ evaluation_results .
|
summarization_quality_result |
google.cloud.aiplatform_v1beta1.types.SummarizationQualityResult
Summarization only metrics. Result for summarization quality metric. This field is a member of oneof _ evaluation_results .
|
pairwise_summarization_quality_result |
google.cloud.aiplatform_v1beta1.types.PairwiseSummarizationQualityResult
Result for pairwise summarization quality metric. This field is a member of oneof _ evaluation_results .
|
summarization_helpfulness_result |
google.cloud.aiplatform_v1beta1.types.SummarizationHelpfulnessResult
Result for summarization helpfulness metric. This field is a member of oneof _ evaluation_results .
|
summarization_verbosity_result |
google.cloud.aiplatform_v1beta1.types.SummarizationVerbosityResult
Result for summarization verbosity metric. This field is a member of oneof _ evaluation_results .
|
question_answering_quality_result |
google.cloud.aiplatform_v1beta1.types.QuestionAnsweringQualityResult
Question answering only metrics. Result for question answering quality metric. This field is a member of oneof _ evaluation_results .
|
pairwise_question_answering_quality_result |
google.cloud.aiplatform_v1beta1.types.PairwiseQuestionAnsweringQualityResult
Result for pairwise question answering quality metric. This field is a member of oneof _ evaluation_results .
|
question_answering_relevance_result |
google.cloud.aiplatform_v1beta1.types.QuestionAnsweringRelevanceResult
Result for question answering relevance metric. This field is a member of oneof _ evaluation_results .
|
question_answering_helpfulness_result |
google.cloud.aiplatform_v1beta1.types.QuestionAnsweringHelpfulnessResult
Result for question answering helpfulness metric. This field is a member of oneof _ evaluation_results .
|
question_answering_correctness_result |
google.cloud.aiplatform_v1beta1.types.QuestionAnsweringCorrectnessResult
Result for question answering correctness metric. This field is a member of oneof _ evaluation_results .
|
tool_call_valid_results |
google.cloud.aiplatform_v1beta1.types.ToolCallValidResults
Tool call metrics. Results for tool call valid metric. This field is a member of oneof _ evaluation_results .
|
tool_name_match_results |
google.cloud.aiplatform_v1beta1.types.ToolNameMatchResults
Results for tool name match metric. This field is a member of oneof _ evaluation_results .
|
tool_parameter_key_match_results |
google.cloud.aiplatform_v1beta1.types.ToolParameterKeyMatchResults
Results for tool parameter key match metric. This field is a member of oneof _ evaluation_results .
|
tool_parameter_kv_match_results |
google.cloud.aiplatform_v1beta1.types.ToolParameterKVMatchResults
Results for tool parameter key value match metric. This field is a member of oneof _ evaluation_results .
|
Methods
EvaluateInstancesResponse
EvaluateInstancesResponse(mapping=None, *, ignore_unknown_fields=False, **kwargs)
Response message for EvaluationService.EvaluateInstances.
This message has oneof
_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields