Method: locations.evaluateDataset

Full name: projects.locations.evaluateDataset

Evaluates a dataset based on a set of given metrics.

Endpoint

post https://aiplatform.googleapis.com/v1beta1/{location}:evaluateDataset

Path parameters

location string

Required. The resource name of the Location to evaluate the dataset. Format: projects/{project}/locations/{location}

Request body

The request body contains data with the following structure:

Fields
dataset object (EvaluationDataset)

Required. The dataset used for evaluation.

metrics[] object (Metric)

Required. The metrics used for evaluation.

outputConfig object (OutputConfig)

Required. Config for evaluation output.

autoraterConfig object (AutoraterConfig)

Optional. Autorater config used for evaluation. Currently only publisher Gemini models are supported. Format: projects/{PROJECT}/locations/{LOCATION}/publishers/google/models/{MODEL}.

Response body

If successful, the response body contains an instance of Operation.

EvaluationDataset

The dataset used for evaluation.

Fields
source Union type
The source of the dataset. source can be only one of the following:
gcsSource object (GcsSource)

Cloud storage source holds the dataset. Currently only one Cloud Storage file path is supported.

bigquerySource object (BigQuerySource)

BigQuery source holds the dataset.

JSON representation 
{

  // source
  "gcsSource": {
    object (GcsSource)
  },
  "bigquerySource": {
    object (BigQuerySource)
  }
  // Union type
}

BigQuerySource

The BigQuery location for the input content.

Fields
inputUri string

Required. BigQuery URI to a table, up to 2000 characters long. Accepted forms:

  • BigQuery path. For example: bq://projectId.bqDatasetId.bqTableId.
JSON representation 
{
  "inputUri": string
}