Evaluation metrics when retrieving n smart replies with the
model.
Attributes
Name
Description
n
int
Number of retrieved smart replies. For example, when n
is 3, this evaluation contains metrics for when Dialogflow
retrieves 3 smart replies with the model.
recall
float
Defined as
number of queries whose top n smart replies have at least one similar (token match similarity above the defined threshold) reply as the real reply
divided by
number of queries with at least one smart reply. Value
ranges from 0.0 to 1.0 inclusive.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2024-11-19 UTC."],[],[]]
