Amos

ModelsFour sizes, one API.

Every model reads the same request and answers in the same shape. Name one with the model field; leave it out and Amos 1 mini answers. Larger models take the harder calls, smaller ones the volume.

Side by side

Measured as served, on data none of them trained on. Typed decisions is its 2,000-decision test split; the Decision Index is the public part of edition 0.3, run with the board's own kit on every row.

Typed decisionsaccuracy, %

  1. Amos 1 large76.1
  2. Amos 1 medium76.5
  3. Amos 1 small69.5
  4. Amos 1 mini64.6

CalibrationKL to the gold, lower is better

  1. Amos 1 large0.126
  2. Amos 1 medium0.151
  3. Amos 1 small0.181
  4. Amos 1 mini0.225

Decision Index0.3, public part

  1. Amos 1 large65.11
  2. Amos 1 medium52.55
  3. Amos 1 small31.92
  4. Amos 1 mini17.35

Server timemedian, three questions

  1. Amos 1 large122 ms
  2. Amos 1 medium61 ms
  3. Amos 1 small48 ms
  4. Amos 1 mini27 ms

How they compare with other decision models is on the index.