Rubric

message representing a single testable criterion for evaluation. One input prompt could have multiple rubrics.

Fields
rubricId string

Unique identifier for the rubric. This id is used to refer to this rubric, e.g., in RubricVerdict.

content object (Content)

Required. The actual testable criteria for the rubric.

type string

Optional. A type designator for the rubric, which can inform how it's evaluated or interpreted by systems or users. It's recommended to use consistent, well-defined, upper snake_case strings. Examples: "SUMMARIZATION_QUALITY", "SAFETY_HARMFUL_CONTENT", "INSTRUCTION_ADHERENCE".

importance enum (Importance)

Optional. The relative importance of this rubric.

JSON representation 
{
  "rubricId": string,
  "content": {
    object (Content)
  },
  "type": string,
  "importance": enum (Importance)
}

Content

Content of the rubric, defining the testable criteria.

Fields
content_type Union type
content_type can be only one of the following:
property object (Property)

Evaluation criteria based on a specific property.

JSON representation 
{

  // content_type
  "property": {
    object (Property)
  }
  // Union type
}

Property

Defines criteria based on a specific property.

Fields
description string

description of the property being evaluated. Example: "The model's response is grammatically correct."

JSON representation 
{
  "description": string
}

Importance

Importance level of the rubric.

Enums
IMPORTANCE_UNSPECIFIED Importance is not specified.
HIGH High importance.
MEDIUM Medium importance.
LOW Low importance.