Vertex AI V1 API - Class Google::Cloud::AIPlatform::V1::EvaluationService::Client (v1.18.0)

Reference documentation and code samples for the Vertex AI V1 API class Google::Cloud::AIPlatform::V1::EvaluationService::Client.

Client for the EvaluationService service.

Vertex AI Online Evaluation Service.

Inherits

  • Object

Includes

Methods

.configure

def self.configure() { |config| ... } -> Client::Configuration

Configure the EvaluationService Client class.

See Configuration for a description of the configuration fields.

Yields
  • (config) — Configure the Client client.
Yield Parameter
Returns
Example 
# Modify the configuration for all EvaluationService clients
::Google::Cloud::AIPlatform::V1::EvaluationService::Client.configure do |config|
  config.timeout = 10.0
end

#configure

def configure() { |config| ... } -> Client::Configuration

Configure the EvaluationService Client instance.

The configuration is set to the derived mode, meaning that values can be changed, but structural changes (adding new fields, etc.) are not allowed. Structural changes should be made on Client.configure.

See Configuration for a description of the configuration fields.

Yields
  • (config) — Configure the Client client.
Yield Parameter
Returns

#evaluate_instances

def evaluate_instances(request, options = nil) -> ::Google::Cloud::AIPlatform::V1::EvaluateInstancesResponse
def evaluate_instances(exact_match_input: nil, bleu_input: nil, rouge_input: nil, fluency_input: nil, coherence_input: nil, safety_input: nil, groundedness_input: nil, fulfillment_input: nil, summarization_quality_input: nil, pairwise_summarization_quality_input: nil, summarization_helpfulness_input: nil, summarization_verbosity_input: nil, question_answering_quality_input: nil, pairwise_question_answering_quality_input: nil, question_answering_relevance_input: nil, question_answering_helpfulness_input: nil, question_answering_correctness_input: nil, pointwise_metric_input: nil, pairwise_metric_input: nil, tool_call_valid_input: nil, tool_name_match_input: nil, tool_parameter_key_match_input: nil, tool_parameter_kv_match_input: nil, comet_input: nil, metricx_input: nil, location: nil) -> ::Google::Cloud::AIPlatform::V1::EvaluateInstancesResponse

Evaluates instances based on a given metric.

Overloads 
def evaluate_instances(request, options = nil) -> ::Google::Cloud::AIPlatform::V1::EvaluateInstancesResponse
Pass arguments to evaluate_instances via a request object, either of type Google::Cloud::AIPlatform::V1::EvaluateInstancesRequest or an equivalent Hash.
Parameters
  • request (::Google::Cloud::AIPlatform::V1::EvaluateInstancesRequest, ::Hash) — A request object representing the call parameters. Required. To specify no parameters, or to keep all the default parameter values, pass an empty Hash.
  • options (::Gapic::CallOptions, ::Hash) — Overrides the default settings for this call, e.g, timeout, retries, etc. Optional. 
def evaluate_instances(exact_match_input: nil, bleu_input: nil, rouge_input: nil, fluency_input: nil, coherence_input: nil, safety_input: nil, groundedness_input: nil, fulfillment_input: nil, summarization_quality_input: nil, pairwise_summarization_quality_input: nil, summarization_helpfulness_input: nil, summarization_verbosity_input: nil, question_answering_quality_input: nil, pairwise_question_answering_quality_input: nil, question_answering_relevance_input: nil, question_answering_helpfulness_input: nil, question_answering_correctness_input: nil, pointwise_metric_input: nil, pairwise_metric_input: nil, tool_call_valid_input: nil, tool_name_match_input: nil, tool_parameter_key_match_input: nil, tool_parameter_kv_match_input: nil, comet_input: nil, metricx_input: nil, location: nil) -> ::Google::Cloud::AIPlatform::V1::EvaluateInstancesResponse
Pass arguments to evaluate_instances via keyword arguments. Note that at least one keyword argument is required. To specify no parameters, or to keep all the default parameter values, pass an empty Hash as a request object (see above).
Parameters
  • exact_match_input (::Google::Cloud::AIPlatform::V1::ExactMatchInput, ::Hash) — Auto metric instances. Instances and metric spec for exact match metric.

    Note: The following parameters are mutually exclusive: exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • bleu_input (::Google::Cloud::AIPlatform::V1::BleuInput, ::Hash) — Instances and metric spec for bleu metric.

    Note: The following parameters are mutually exclusive: bleu_input, exact_match_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • rouge_input (::Google::Cloud::AIPlatform::V1::RougeInput, ::Hash) — Instances and metric spec for rouge metric.

    Note: The following parameters are mutually exclusive: rouge_input, exact_match_input, bleu_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • fluency_input (::Google::Cloud::AIPlatform::V1::FluencyInput, ::Hash) — LLM-based metric instance. General text generation metrics, applicable to other categories. Input for fluency metric.

    Note: The following parameters are mutually exclusive: fluency_input, exact_match_input, bleu_input, rouge_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • coherence_input (::Google::Cloud::AIPlatform::V1::CoherenceInput, ::Hash) — Input for coherence metric.

    Note: The following parameters are mutually exclusive: coherence_input, exact_match_input, bleu_input, rouge_input, fluency_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • safety_input (::Google::Cloud::AIPlatform::V1::SafetyInput, ::Hash) — Input for safety metric.

    Note: The following parameters are mutually exclusive: safety_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • groundedness_input (::Google::Cloud::AIPlatform::V1::GroundednessInput, ::Hash) — Input for groundedness metric.

    Note: The following parameters are mutually exclusive: groundedness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • fulfillment_input (::Google::Cloud::AIPlatform::V1::FulfillmentInput, ::Hash) — Input for fulfillment metric.

    Note: The following parameters are mutually exclusive: fulfillment_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • summarization_quality_input (::Google::Cloud::AIPlatform::V1::SummarizationQualityInput, ::Hash) — Input for summarization quality metric.

    Note: The following parameters are mutually exclusive: summarization_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • pairwise_summarization_quality_input (::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityInput, ::Hash) — Input for pairwise summarization quality metric.

    Note: The following parameters are mutually exclusive: pairwise_summarization_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • summarization_helpfulness_input (::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessInput, ::Hash) — Input for summarization helpfulness metric.

    Note: The following parameters are mutually exclusive: summarization_helpfulness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • summarization_verbosity_input (::Google::Cloud::AIPlatform::V1::SummarizationVerbosityInput, ::Hash) — Input for summarization verbosity metric.

    Note: The following parameters are mutually exclusive: summarization_verbosity_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • question_answering_quality_input (::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityInput, ::Hash) — Input for question answering quality metric.

    Note: The following parameters are mutually exclusive: question_answering_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • pairwise_question_answering_quality_input (::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityInput, ::Hash) — Input for pairwise question answering quality metric.

    Note: The following parameters are mutually exclusive: pairwise_question_answering_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • question_answering_relevance_input (::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceInput, ::Hash) — Input for question answering relevance metric.

    Note: The following parameters are mutually exclusive: question_answering_relevance_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • question_answering_helpfulness_input (::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessInput, ::Hash) — Input for question answering helpfulness metric.

    Note: The following parameters are mutually exclusive: question_answering_helpfulness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • question_answering_correctness_input (::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessInput, ::Hash) — Input for question answering correctness metric.

    Note: The following parameters are mutually exclusive: question_answering_correctness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • pointwise_metric_input (::Google::Cloud::AIPlatform::V1::PointwiseMetricInput, ::Hash) — Input for pointwise metric.

    Note: The following parameters are mutually exclusive: pointwise_metric_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • pairwise_metric_input (::Google::Cloud::AIPlatform::V1::PairwiseMetricInput, ::Hash) — Input for pairwise metric.

    Note: The following parameters are mutually exclusive: pairwise_metric_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • tool_call_valid_input (::Google::Cloud::AIPlatform::V1::ToolCallValidInput, ::Hash) — Tool call metric instances. Input for tool call valid metric.

    Note: The following parameters are mutually exclusive: tool_call_valid_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • tool_name_match_input (::Google::Cloud::AIPlatform::V1::ToolNameMatchInput, ::Hash) — Input for tool name match metric.

    Note: The following parameters are mutually exclusive: tool_name_match_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • tool_parameter_key_match_input (::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchInput, ::Hash) — Input for tool parameter key match metric.

    Note: The following parameters are mutually exclusive: tool_parameter_key_match_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • tool_parameter_kv_match_input (::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchInput, ::Hash) — Input for tool parameter key value match metric.

    Note: The following parameters are mutually exclusive: tool_parameter_kv_match_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, comet_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • comet_input (::Google::Cloud::AIPlatform::V1::CometInput, ::Hash) — Translation metrics. Input for Comet metric.

    Note: The following parameters are mutually exclusive: comet_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, metricx_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • metricx_input (::Google::Cloud::AIPlatform::V1::MetricxInput, ::Hash) — Input for Metricx metric.

    Note: The following parameters are mutually exclusive: metricx_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input. At most one of these parameters can be set. If more than one is set, only one will be used, and it is not defined which one.

  • location (::String) — Required. The resource name of the Location to evaluate the instances. Format: projects/{project}/locations/{location}
Yields
  • (response, operation) — Access the result along with the RPC operation
Yield Parameters
Returns
Raises
  • (::Google::Cloud::Error) — if the RPC is aborted.
Example

Basic example

require "google/cloud/ai_platform/v1"

# Create a client object. The client can be reused for multiple calls.
client = Google::Cloud::AIPlatform::V1::EvaluationService::Client.new

# Create a request. To set request fields, pass in keyword arguments.
request = Google::Cloud::AIPlatform::V1::EvaluateInstancesRequest.new

# Call the evaluate_instances method.
result = client.evaluate_instances request

# The returned object is of type Google::Cloud::AIPlatform::V1::EvaluateInstancesResponse.
p result

#iam_policy_client

def iam_policy_client() -> Google::Iam::V1::IAMPolicy::Client

Get the associated client for mix-in of the IAMPolicy.

Returns
  • (Google::Iam::V1::IAMPolicy::Client)

#initialize

def initialize() { |config| ... } -> Client

Create a new EvaluationService client object.

Yields
  • (config) — Configure the EvaluationService client.
Yield Parameter
Returns
  • (Client) — a new instance of Client
Example 
# Create a client using the default configuration
client = ::Google::Cloud::AIPlatform::V1::EvaluationService::Client.new

# Create a client using a custom configuration
client = ::Google::Cloud::AIPlatform::V1::EvaluationService::Client.new do |config|
  config.timeout = 10.0
end

#location_client

def location_client() -> Google::Cloud::Location::Locations::Client

Get the associated client for mix-in of the Locations.

Returns
  • (Google::Cloud::Location::Locations::Client)

#logger

def logger() -> Logger

The logger used for request/response debug logging.

Returns
  • (Logger)

#universe_domain

def universe_domain() -> String

The effective universe domain

Returns
  • (String)