- 1.89.0 (latest)
- 1.88.0
- 1.87.0
- 1.86.0
- 1.85.0
- 1.84.0
- 1.83.0
- 1.82.0
- 1.81.0
- 1.80.0
- 1.79.0
- 1.78.0
- 1.77.0
- 1.76.0
- 1.75.0
- 1.74.0
- 1.73.0
- 1.72.0
- 1.71.1
- 1.70.0
- 1.69.0
- 1.68.0
- 1.67.1
- 1.66.0
- 1.65.0
- 1.63.0
- 1.62.0
- 1.60.0
- 1.59.0
- 1.58.0
- 1.57.0
- 1.56.0
- 1.55.0
- 1.54.1
- 1.53.0
- 1.52.0
- 1.51.0
- 1.50.0
- 1.49.0
- 1.48.0
- 1.47.0
- 1.46.0
- 1.45.0
- 1.44.0
- 1.43.0
- 1.39.0
- 1.38.1
- 1.37.0
- 1.36.4
- 1.35.0
- 1.34.0
- 1.33.1
- 1.32.0
- 1.31.1
- 1.30.1
- 1.29.0
- 1.28.1
- 1.27.1
- 1.26.1
- 1.25.0
- 1.24.1
- 1.23.0
- 1.22.1
- 1.21.0
- 1.20.0
- 1.19.1
- 1.18.3
- 1.17.1
- 1.16.1
- 1.15.1
- 1.14.0
- 1.13.1
- 1.12.1
- 1.11.0
- 1.10.0
- 1.9.0
- 1.8.1
- 1.7.1
- 1.6.2
- 1.5.0
- 1.4.3
- 1.3.0
- 1.2.0
- 1.1.1
- 1.0.1
- 0.9.0
- 0.8.0
- 0.7.1
- 0.6.0
- 0.5.1
- 0.4.0
- 0.3.1
EvaluateInstancesResponse(mapping=None, *, ignore_unknown_fields=False, **kwargs)Response message for EvaluationService.EvaluateInstances.
This message has oneof_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
Attributes |
|
|---|---|
| Name | Description |
exact_match_results |
google.cloud.aiplatform_v1beta1.types.ExactMatchResults
Auto metric evaluation results. Results for exact match metric. This field is a member of oneof_ evaluation_results.
|
bleu_results |
google.cloud.aiplatform_v1beta1.types.BleuResults
Results for bleu metric. This field is a member of oneof_ evaluation_results.
|
rouge_results |
google.cloud.aiplatform_v1beta1.types.RougeResults
Results for rouge metric. This field is a member of oneof_ evaluation_results.
|
fluency_result |
google.cloud.aiplatform_v1beta1.types.FluencyResult
LLM-based metric evaluation result. General text generation metrics, applicable to other categories. Result for fluency metric. This field is a member of oneof_ evaluation_results.
|
coherence_result |
google.cloud.aiplatform_v1beta1.types.CoherenceResult
Result for coherence metric. This field is a member of oneof_ evaluation_results.
|
safety_result |
google.cloud.aiplatform_v1beta1.types.SafetyResult
Result for safety metric. This field is a member of oneof_ evaluation_results.
|
groundedness_result |
google.cloud.aiplatform_v1beta1.types.GroundednessResult
Result for groundedness metric. This field is a member of oneof_ evaluation_results.
|
fulfillment_result |
google.cloud.aiplatform_v1beta1.types.FulfillmentResult
Result for fulfillment metric. This field is a member of oneof_ evaluation_results.
|
summarization_quality_result |
google.cloud.aiplatform_v1beta1.types.SummarizationQualityResult
Summarization only metrics. Result for summarization quality metric. This field is a member of oneof_ evaluation_results.
|
pairwise_summarization_quality_result |
google.cloud.aiplatform_v1beta1.types.PairwiseSummarizationQualityResult
Result for pairwise summarization quality metric. This field is a member of oneof_ evaluation_results.
|
summarization_helpfulness_result |
google.cloud.aiplatform_v1beta1.types.SummarizationHelpfulnessResult
Result for summarization helpfulness metric. This field is a member of oneof_ evaluation_results.
|
summarization_verbosity_result |
google.cloud.aiplatform_v1beta1.types.SummarizationVerbosityResult
Result for summarization verbosity metric. This field is a member of oneof_ evaluation_results.
|
question_answering_quality_result |
google.cloud.aiplatform_v1beta1.types.QuestionAnsweringQualityResult
Question answering only metrics. Result for question answering quality metric. This field is a member of oneof_ evaluation_results.
|
pairwise_question_answering_quality_result |
google.cloud.aiplatform_v1beta1.types.PairwiseQuestionAnsweringQualityResult
Result for pairwise question answering quality metric. This field is a member of oneof_ evaluation_results.
|
question_answering_relevance_result |
google.cloud.aiplatform_v1beta1.types.QuestionAnsweringRelevanceResult
Result for question answering relevance metric. This field is a member of oneof_ evaluation_results.
|
question_answering_helpfulness_result |
google.cloud.aiplatform_v1beta1.types.QuestionAnsweringHelpfulnessResult
Result for question answering helpfulness metric. This field is a member of oneof_ evaluation_results.
|
question_answering_correctness_result |
google.cloud.aiplatform_v1beta1.types.QuestionAnsweringCorrectnessResult
Result for question answering correctness metric. This field is a member of oneof_ evaluation_results.
|
pointwise_metric_result |
google.cloud.aiplatform_v1beta1.types.PointwiseMetricResult
Generic metrics. Result for pointwise metric. This field is a member of oneof_ evaluation_results.
|
pairwise_metric_result |
google.cloud.aiplatform_v1beta1.types.PairwiseMetricResult
Result for pairwise metric. This field is a member of oneof_ evaluation_results.
|
tool_call_valid_results |
google.cloud.aiplatform_v1beta1.types.ToolCallValidResults
Tool call metrics. Results for tool call valid metric. This field is a member of oneof_ evaluation_results.
|
tool_name_match_results |
google.cloud.aiplatform_v1beta1.types.ToolNameMatchResults
Results for tool name match metric. This field is a member of oneof_ evaluation_results.
|
tool_parameter_key_match_results |
google.cloud.aiplatform_v1beta1.types.ToolParameterKeyMatchResults
Results for tool parameter key match metric. This field is a member of oneof_ evaluation_results.
|
tool_parameter_kv_match_results |
google.cloud.aiplatform_v1beta1.types.ToolParameterKVMatchResults
Results for tool parameter key value match metric. This field is a member of oneof_ evaluation_results.
|
comet_result |
google.cloud.aiplatform_v1beta1.types.CometResult
Translation metrics. Result for Comet metric. This field is a member of oneof_ evaluation_results.
|
metricx_result |
google.cloud.aiplatform_v1beta1.types.MetricxResult
Result for Metricx metric. This field is a member of oneof_ evaluation_results.
|
trajectory_exact_match_results |
google.cloud.aiplatform_v1beta1.types.TrajectoryExactMatchResults
Result for trajectory exact match metric. This field is a member of oneof_ evaluation_results.
|
trajectory_in_order_match_results |
google.cloud.aiplatform_v1beta1.types.TrajectoryInOrderMatchResults
Result for trajectory in order match metric. This field is a member of oneof_ evaluation_results.
|
trajectory_any_order_match_results |
google.cloud.aiplatform_v1beta1.types.TrajectoryAnyOrderMatchResults
Result for trajectory any order match metric. This field is a member of oneof_ evaluation_results.
|
trajectory_precision_results |
google.cloud.aiplatform_v1beta1.types.TrajectoryPrecisionResults
Result for trajectory precision metric. This field is a member of oneof_ evaluation_results.
|
trajectory_recall_results |
google.cloud.aiplatform_v1beta1.types.TrajectoryRecallResults
Results for trajectory recall metric. This field is a member of oneof_ evaluation_results.
|
trajectory_single_tool_use_results |
google.cloud.aiplatform_v1beta1.types.TrajectorySingleToolUseResults
Results for trajectory single tool use metric. This field is a member of oneof_ evaluation_results.
|
rubric_based_instruction_following_result |
google.cloud.aiplatform_v1beta1.types.RubricBasedInstructionFollowingResult
Result for rubric based instruction following metric. This field is a member of oneof_ evaluation_results.
|
Methods
EvaluateInstancesResponse
EvaluateInstancesResponse(mapping=None, *, ignore_unknown_fields=False, **kwargs)Response message for EvaluationService.EvaluateInstances.
This message has oneof_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields