DemosAmos says when it is unsure
Amos says when it is unsureEvery answer comes with a probability. Pick how sure Amos must be to handle a ticket on its own. Anything below goes to a person.
recorded run
recorded run · 145 tickets · answers as the API returned them
0.81
A ticket's confidence is the lowest of its answers' probabilities. At or above the cutoff, Amos acts on it. Below, a person reads it.
80%90%100%0%25%50%75%100%
Share of tickets Amos handles · cutoff 81%
A ticket counts as right when every graded answer matches its label. With no cutoff, Amos gets 97% of all 145 tickets fully right.