Method: locations.evaluateDataset

Full name: projects.locations.evaluateDataset

Evaluates a dataset based on a set of given metrics.

Endpoint

post https://{service-endpoint}/v1beta1/{location}:evaluateDataset

Where {service-endpoint} is one of the supported service endpoints.

Path parameters

location string

Required. The resource name of the Location to evaluate the dataset. Format: projects/{project}/locations/{location}

Request body

The request body contains data with the following structure:

Fields
dataset object (EvaluationDataset)

Required. The dataset used for evaluation.

metrics[] object (Metric)

Required. The metrics used for evaluation.

outputConfig object (OutputConfig)

Required. Config for evaluation output.

autoraterConfig object (AutoraterConfig)

Optional. Autorater config used for evaluation. Currently only publisher Gemini models are supported. Format: projects/{PROJECT}/locations/{LOCATION}/publishers/google/models/{MODEL}.

Response body

If successful, the response body contains an instance of Operation.