- 0.64.0 (latest)
- 0.63.0
- 0.62.0
- 0.61.0
- 0.60.0
- 0.59.0
- 0.58.0
- 0.57.0
- 0.56.0
- 0.55.0
- 0.54.0
- 0.53.0
- 0.52.0
- 0.51.0
- 0.50.0
- 0.49.0
- 0.48.0
- 0.47.0
- 0.46.0
- 0.45.0
- 0.44.0
- 0.43.0
- 0.42.0
- 0.41.0
- 0.40.0
- 0.39.0
- 0.38.0
- 0.37.0
- 0.36.0
- 0.35.0
- 0.34.0
- 0.33.0
- 0.32.0
- 0.31.0
- 0.30.0
- 0.29.0
- 0.28.0
- 0.27.0
- 0.26.0
- 0.25.0
- 0.24.0
- 0.23.0
- 0.22.0
- 0.21.0
- 0.20.0
- 0.19.0
- 0.18.0
- 0.17.0
- 0.16.0
- 0.15.0
- 0.14.0
- 0.13.0
- 0.12.0
- 0.11.0
- 0.10.0
- 0.9.1
- 0.8.0
- 0.7.0
- 0.6.0
- 0.5.0
- 0.4.0
- 0.3.0
- 0.2.0
- 0.1.0
Reference documentation and code samples for the Vertex AI V1 API class Google::Cloud::AIPlatform::V1::EvaluationService::Rest::Client.
REST client for the EvaluationService service.
Vertex AI Online Evaluation Service.
Inherits
- Object
Methods
.configure
def self.configure() { |config| ... } -> Client::Configuration
Configure the EvaluationService Client class.
See Configuration for a description of the configuration fields.
- (config) — Configure the Client client.
- config (Client::Configuration)
# Modify the configuration for all EvaluationService clients ::Google::Cloud::AIPlatform::V1::EvaluationService::Rest::Client.configure do |config| config.timeout = 10.0 end
#configure
def configure() { |config| ... } -> Client::Configuration
Configure the EvaluationService Client instance.
The configuration is set to the derived mode, meaning that values can be changed, but structural changes (adding new fields, etc.) are not allowed. Structural changes should be made on Client.configure.
See Configuration for a description of the configuration fields.
- (config) — Configure the Client client.
- config (Client::Configuration)
#evaluate_instances
def evaluate_instances(request, options = nil) -> ::Google::Cloud::AIPlatform::V1::EvaluateInstancesResponse
def evaluate_instances(exact_match_input: nil, bleu_input: nil, rouge_input: nil, fluency_input: nil, coherence_input: nil, safety_input: nil, groundedness_input: nil, fulfillment_input: nil, summarization_quality_input: nil, pairwise_summarization_quality_input: nil, summarization_helpfulness_input: nil, summarization_verbosity_input: nil, question_answering_quality_input: nil, pairwise_question_answering_quality_input: nil, question_answering_relevance_input: nil, question_answering_helpfulness_input: nil, question_answering_correctness_input: nil, pointwise_metric_input: nil, pairwise_metric_input: nil, tool_call_valid_input: nil, tool_name_match_input: nil, tool_parameter_key_match_input: nil, tool_parameter_kv_match_input: nil, comet_input: nil, metricx_input: nil, location: nil) -> ::Google::Cloud::AIPlatform::V1::EvaluateInstancesResponse
Evaluates instances based on a given metric.
def evaluate_instances(request, options = nil) -> ::Google::Cloud::AIPlatform::V1::EvaluateInstancesResponse
evaluate_instances
via a request object, either of type
Google::Cloud::AIPlatform::V1::EvaluateInstancesRequest or an equivalent Hash.
- request (::Google::Cloud::AIPlatform::V1::EvaluateInstancesRequest, ::Hash) — A request object representing the call parameters. Required. To specify no parameters, or to keep all the default parameter values, pass an empty Hash.
- options (::Gapic::CallOptions, ::Hash) — Overrides the default settings for this call, e.g, timeout, retries etc. Optional.
def evaluate_instances(exact_match_input: nil, bleu_input: nil, rouge_input: nil, fluency_input: nil, coherence_input: nil, safety_input: nil, groundedness_input: nil, fulfillment_input: nil, summarization_quality_input: nil, pairwise_summarization_quality_input: nil, summarization_helpfulness_input: nil, summarization_verbosity_input: nil, question_answering_quality_input: nil, pairwise_question_answering_quality_input: nil, question_answering_relevance_input: nil, question_answering_helpfulness_input: nil, question_answering_correctness_input: nil, pointwise_metric_input: nil, pairwise_metric_input: nil, tool_call_valid_input: nil, tool_name_match_input: nil, tool_parameter_key_match_input: nil, tool_parameter_kv_match_input: nil, comet_input: nil, metricx_input: nil, location: nil) -> ::Google::Cloud::AIPlatform::V1::EvaluateInstancesResponse
evaluate_instances
via keyword arguments. Note that at
least one keyword argument is required. To specify no parameters, or to keep all
the default parameter values, pass an empty Hash as a request object (see above).
-
exact_match_input (::Google::Cloud::AIPlatform::V1::ExactMatchInput, ::Hash) — Auto metric instances.
Instances and metric spec for exact match metric.
Note: The following fields are mutually exclusive:
exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
bleu_input (::Google::Cloud::AIPlatform::V1::BleuInput, ::Hash) — Instances and metric spec for bleu metric.
Note: The following fields are mutually exclusive:
bleu_input
,exact_match_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
rouge_input (::Google::Cloud::AIPlatform::V1::RougeInput, ::Hash) — Instances and metric spec for rouge metric.
Note: The following fields are mutually exclusive:
rouge_input
,exact_match_input
,bleu_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
fluency_input (::Google::Cloud::AIPlatform::V1::FluencyInput, ::Hash) — LLM-based metric instance.
General text generation metrics, applicable to other categories.
Input for fluency metric.
Note: The following fields are mutually exclusive:
fluency_input
,exact_match_input
,bleu_input
,rouge_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
coherence_input (::Google::Cloud::AIPlatform::V1::CoherenceInput, ::Hash) — Input for coherence metric.
Note: The following fields are mutually exclusive:
coherence_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
safety_input (::Google::Cloud::AIPlatform::V1::SafetyInput, ::Hash) — Input for safety metric.
Note: The following fields are mutually exclusive:
safety_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
groundedness_input (::Google::Cloud::AIPlatform::V1::GroundednessInput, ::Hash) — Input for groundedness metric.
Note: The following fields are mutually exclusive:
groundedness_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
fulfillment_input (::Google::Cloud::AIPlatform::V1::FulfillmentInput, ::Hash) — Input for fulfillment metric.
Note: The following fields are mutually exclusive:
fulfillment_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
summarization_quality_input (::Google::Cloud::AIPlatform::V1::SummarizationQualityInput, ::Hash) — Input for summarization quality metric.
Note: The following fields are mutually exclusive:
summarization_quality_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
pairwise_summarization_quality_input (::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityInput, ::Hash) — Input for pairwise summarization quality metric.
Note: The following fields are mutually exclusive:
pairwise_summarization_quality_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
summarization_helpfulness_input (::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessInput, ::Hash) — Input for summarization helpfulness metric.
Note: The following fields are mutually exclusive:
summarization_helpfulness_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
summarization_verbosity_input (::Google::Cloud::AIPlatform::V1::SummarizationVerbosityInput, ::Hash) — Input for summarization verbosity metric.
Note: The following fields are mutually exclusive:
summarization_verbosity_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
question_answering_quality_input (::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityInput, ::Hash) — Input for question answering quality metric.
Note: The following fields are mutually exclusive:
question_answering_quality_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
pairwise_question_answering_quality_input (::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityInput, ::Hash) — Input for pairwise question answering quality metric.
Note: The following fields are mutually exclusive:
pairwise_question_answering_quality_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
question_answering_relevance_input (::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceInput, ::Hash) — Input for question answering relevance metric.
Note: The following fields are mutually exclusive:
question_answering_relevance_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
question_answering_helpfulness_input (::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessInput, ::Hash) — Input for question answering helpfulness
metric.
Note: The following fields are mutually exclusive:
question_answering_helpfulness_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
question_answering_correctness_input (::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessInput, ::Hash) — Input for question answering correctness
metric.
Note: The following fields are mutually exclusive:
question_answering_correctness_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
pointwise_metric_input (::Google::Cloud::AIPlatform::V1::PointwiseMetricInput, ::Hash) — Input for pointwise metric.
Note: The following fields are mutually exclusive:
pointwise_metric_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
pairwise_metric_input (::Google::Cloud::AIPlatform::V1::PairwiseMetricInput, ::Hash) — Input for pairwise metric.
Note: The following fields are mutually exclusive:
pairwise_metric_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
tool_call_valid_input (::Google::Cloud::AIPlatform::V1::ToolCallValidInput, ::Hash) — Tool call metric instances.
Input for tool call valid metric.
Note: The following fields are mutually exclusive:
tool_call_valid_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
tool_name_match_input (::Google::Cloud::AIPlatform::V1::ToolNameMatchInput, ::Hash) — Input for tool name match metric.
Note: The following fields are mutually exclusive:
tool_name_match_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
tool_parameter_key_match_input (::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchInput, ::Hash) — Input for tool parameter key match metric.
Note: The following fields are mutually exclusive:
tool_parameter_key_match_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
tool_parameter_kv_match_input (::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchInput, ::Hash) — Input for tool parameter key value match metric.
Note: The following fields are mutually exclusive:
tool_parameter_kv_match_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
comet_input (::Google::Cloud::AIPlatform::V1::CometInput, ::Hash) — Translation metrics.
Input for Comet metric.
Note: The following fields are mutually exclusive:
comet_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
metricx_input (::Google::Cloud::AIPlatform::V1::MetricxInput, ::Hash) — Input for Metricx metric.
Note: The following fields are mutually exclusive:
metricx_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
. If a field in that set is populated, all other fields in the set will automatically be cleared. -
location (::String) — Required. The resource name of the Location to evaluate the instances.
Format:
projects/{project}/locations/{location}
- (result, operation) — Access the result along with the TransportOperation object
- result (::Google::Cloud::AIPlatform::V1::EvaluateInstancesResponse)
- operation (::Gapic::Rest::TransportOperation)
- (::Google::Cloud::Error) — if the REST call is aborted.
Basic example
require "google/cloud/ai_platform/v1" # Create a client object. The client can be reused for multiple calls. client = Google::Cloud::AIPlatform::V1::EvaluationService::Rest::Client.new # Create a request. To set request fields, pass in keyword arguments. request = Google::Cloud::AIPlatform::V1::EvaluateInstancesRequest.new # Call the evaluate_instances method. result = client.evaluate_instances request # The returned object is of type Google::Cloud::AIPlatform::V1::EvaluateInstancesResponse. p result
#iam_policy_client
def iam_policy_client() -> Google::Iam::V1::IAMPolicy::Rest::Client
Get the associated client for mix-in of the IAMPolicy.
- (Google::Iam::V1::IAMPolicy::Rest::Client)
#initialize
def initialize() { |config| ... } -> Client
Create a new EvaluationService REST client object.
- (config) — Configure the EvaluationService client.
- config (Client::Configuration)
- (Client) — a new instance of Client
# Create a client using the default configuration client = ::Google::Cloud::AIPlatform::V1::EvaluationService::Rest::Client.new # Create a client using a custom configuration client = ::Google::Cloud::AIPlatform::V1::EvaluationService::Rest::Client.new do |config| config.timeout = 10.0 end
#location_client
def location_client() -> Google::Cloud::Location::Locations::Rest::Client
Get the associated client for mix-in of the Locations.
- (Google::Cloud::Location::Locations::Rest::Client)
#logger
def logger() -> Logger
The logger used for request/response debug logging.
- (Logger)
#universe_domain
def universe_domain() -> String
The effective universe domain
- (String)