REST Resource: projects.locations.qaScorecards.revisions.qaQuestions

{
  "name": string,
  "abbreviation": string,
  "createTime": string,
  "updateTime": string,
  "questionBody": string,
  "answerInstructions": string,
  "answerChoices": [
    {
      object (AnswerChoice)
    }
  ],
  "tags": [
    string
  ],
  "order": integer,
  "metrics": {
    object (Metrics)
  },
  "tuningMetadata": {
    object (TuningMetadata)
  }
}

string

Identifier. The resource name of the question. Format: projects/{project}/locations/{location}/qaScorecards/{qaScorecard}/revisions/{revision}/qaQuestions/{qaQuestion}

string

Short, descriptive string, used in the UI where it's not practical to display the full question body. E.g., "Greeting".

string (Timestamp format)

Output only. The time at which this question was created.

A timestamp in RFC3339 UTC "Zulu" format, with nanosecond resolution and up to nine fractional digits. Examples: "2014-10-02T15:01:23Z" and "2014-10-02T15:01:23.045123456Z".

string (Timestamp format)

Output only. The most recent time at which the question was updated.

A timestamp in RFC3339 UTC "Zulu" format, with nanosecond resolution and up to nine fractional digits. Examples: "2014-10-02T15:01:23Z" and "2014-10-02T15:01:23.045123456Z".

string

Question text. E.g., "Did the agent greet the customer?"

string

Instructions describing how to determine the answer.

object (AnswerChoice)

A list of valid answers to the question, which the LLM must choose from.

string

User-defined list of arbitrary tags for the question. Used for grouping/organization and for weighting the score of each question.

integer

Defines the order of the question within its parent scorecard revision.

object (Metrics)

Metrics of the underlying tuned LLM over a holdout/test set while fine tuning the underlying LLM for the given question. This field will only be populated if and only if the question is part of a scorecard revision that has been tuned.

object (TuningMetadata)

Metadata about the tuning operation for the question.This field will only be populated if and only if the question is part of a scorecard revision that has been tuned.

{
  "key": string,

  // Union field value can be only one of the following:
  "strValue": string,
  "numValue": number,
  "boolValue": boolean,
  "naValue": boolean
  // End of list of possible types for union field value.
  "score": number
}

string

A short string used as an identifier.

string

String value.

number

Numerical value.

boolean

Boolean value.

boolean

A value of "Not Applicable (N/A)". If provided, this field may only be set to true. If a question receives this answer, it will be excluded from any score calculations.

number

Numerical score of the answer, used for generating the overall score of a QaScorecardResult. If the answer uses naValue, this field is unused.

{
  "accuracy": number
}

number

Output only. Accuracy of the model. Measures the percentage of correct answers the model gave on the test set.

{
  "totalValidLabelCount": string,
  "datasetValidationWarnings": [
    enum (DatasetValidationWarning)
  ],
  "tuningError": string
}

string (int64 format)

Total number of valid labels provided for the question at the time of tuining.

enum (DatasetValidationWarning)

A list of any applicable data validation warnings about the question's feedback labels.

string

Error status of the tuning operation for the question. Will only be set if the tuning operation failed.