Vertex AI v1 API - Class EvaluateInstancesRequest (3.50.0) 

public sealed class EvaluateInstancesRequest : IMessage<EvaluateInstancesRequest>, IEquatable<EvaluateInstancesRequest>, IDeepCloneable<EvaluateInstancesRequest>, IBufferMessage, IMessage

Reference documentation and code samples for the Vertex AI v1 API class EvaluateInstancesRequest.

Request message for EvaluationService.EvaluateInstances.

Inheritance

object > EvaluateInstancesRequest

Namespace

Google.Cloud.AIPlatform.V1

Assembly

Google.Cloud.AIPlatform.V1.dll

Constructors

EvaluateInstancesRequest()

public EvaluateInstancesRequest()

EvaluateInstancesRequest(EvaluateInstancesRequest)

public EvaluateInstancesRequest(EvaluateInstancesRequest other)
Parameter
Name Description
other EvaluateInstancesRequest

Properties

BleuInput

public BleuInput BleuInput { get; set; }

Instances and metric spec for bleu metric.

Property Value
Type Description
BleuInput

CoherenceInput

public CoherenceInput CoherenceInput { get; set; }

Input for coherence metric.

Property Value
Type Description
CoherenceInput

CometInput

public CometInput CometInput { get; set; }

Translation metrics. Input for Comet metric.

Property Value
Type Description
CometInput

ExactMatchInput

public ExactMatchInput ExactMatchInput { get; set; }

Auto metric instances. Instances and metric spec for exact match metric.

Property Value
Type Description
ExactMatchInput

FluencyInput

public FluencyInput FluencyInput { get; set; }

LLM-based metric instance. General text generation metrics, applicable to other categories. Input for fluency metric.

Property Value
Type Description
FluencyInput

FulfillmentInput

public FulfillmentInput FulfillmentInput { get; set; }

Input for fulfillment metric.

Property Value
Type Description
FulfillmentInput

GroundednessInput

public GroundednessInput GroundednessInput { get; set; }

Input for groundedness metric.

Property Value
Type Description
GroundednessInput

Location

public string Location { get; set; }

Required. The resource name of the Location to evaluate the instances. Format: projects/{project}/locations/{location}

Property Value
Type Description
string

LocationAsLocationName

public LocationName LocationAsLocationName { get; set; }

LocationName-typed view over the Location resource name property.

Property Value
Type Description
LocationName

MetricInputsCase

public EvaluateInstancesRequest.MetricInputsOneofCase MetricInputsCase { get; }
Property Value
Type Description
EvaluateInstancesRequestMetricInputsOneofCase

MetricxInput

public MetricxInput MetricxInput { get; set; }

Input for Metricx metric.

Property Value
Type Description
MetricxInput

PairwiseMetricInput

public PairwiseMetricInput PairwiseMetricInput { get; set; }

Input for pairwise metric.

Property Value
Type Description
PairwiseMetricInput

PairwiseQuestionAnsweringQualityInput

public PairwiseQuestionAnsweringQualityInput PairwiseQuestionAnsweringQualityInput { get; set; }

Input for pairwise question answering quality metric.

Property Value
Type Description
PairwiseQuestionAnsweringQualityInput

PairwiseSummarizationQualityInput

public PairwiseSummarizationQualityInput PairwiseSummarizationQualityInput { get; set; }

Input for pairwise summarization quality metric.

Property Value
Type Description
PairwiseSummarizationQualityInput

PointwiseMetricInput

public PointwiseMetricInput PointwiseMetricInput { get; set; }

Input for pointwise metric.

Property Value
Type Description
PointwiseMetricInput

QuestionAnsweringCorrectnessInput

public QuestionAnsweringCorrectnessInput QuestionAnsweringCorrectnessInput { get; set; }

Input for question answering correctness metric.

Property Value
Type Description
QuestionAnsweringCorrectnessInput

QuestionAnsweringHelpfulnessInput

public QuestionAnsweringHelpfulnessInput QuestionAnsweringHelpfulnessInput { get; set; }

Input for question answering helpfulness metric.

Property Value
Type Description
QuestionAnsweringHelpfulnessInput

QuestionAnsweringQualityInput

public QuestionAnsweringQualityInput QuestionAnsweringQualityInput { get; set; }

Input for question answering quality metric.

Property Value
Type Description
QuestionAnsweringQualityInput

QuestionAnsweringRelevanceInput

public QuestionAnsweringRelevanceInput QuestionAnsweringRelevanceInput { get; set; }

Input for question answering relevance metric.

Property Value
Type Description
QuestionAnsweringRelevanceInput

RougeInput

public RougeInput RougeInput { get; set; }

Instances and metric spec for rouge metric.

Property Value
Type Description
RougeInput

SafetyInput

public SafetyInput SafetyInput { get; set; }

Input for safety metric.

Property Value
Type Description
SafetyInput

SummarizationHelpfulnessInput

public SummarizationHelpfulnessInput SummarizationHelpfulnessInput { get; set; }

Input for summarization helpfulness metric.

Property Value
Type Description
SummarizationHelpfulnessInput

SummarizationQualityInput

public SummarizationQualityInput SummarizationQualityInput { get; set; }

Input for summarization quality metric.

Property Value
Type Description
SummarizationQualityInput

SummarizationVerbosityInput

public SummarizationVerbosityInput SummarizationVerbosityInput { get; set; }

Input for summarization verbosity metric.

Property Value
Type Description
SummarizationVerbosityInput

ToolCallValidInput

public ToolCallValidInput ToolCallValidInput { get; set; }

Tool call metric instances. Input for tool call valid metric.

Property Value
Type Description
ToolCallValidInput

ToolNameMatchInput

public ToolNameMatchInput ToolNameMatchInput { get; set; }

Input for tool name match metric.

Property Value
Type Description
ToolNameMatchInput

ToolParameterKeyMatchInput

public ToolParameterKeyMatchInput ToolParameterKeyMatchInput { get; set; }

Input for tool parameter key match metric.

Property Value
Type Description
ToolParameterKeyMatchInput

ToolParameterKvMatchInput

public ToolParameterKVMatchInput ToolParameterKvMatchInput { get; set; }

Input for tool parameter key value match metric.

Property Value
Type Description
ToolParameterKVMatchInput