01
Ticket Classification
jev primitiveChoice
labelsbillingtechnicalaccountsalesother
dataset20 labeled rows
tracingone call, not traced
Routes a support ticket to one team: billing, technical, account, sales, or other. Jev answers one Choice question and returns the team with a confidence. The baselines ask a fast LLM the same question twice: once in free text (then parsed), once forced into the five labels. Measured: accuracy, latency and cost per ticket. Look at Jev's confidence on the tickets it gets wrong.
With Jev
◐ ▮▮▮ ▦Without Jev
LLM · CODEExamples
Calls Jev and every baseline for real. Nothing is saved.
Runs every labeled row, one at a time: 20 rows × every variant, all real, paid calls. Rows run sequentially so latency measures the model, not a traffic jam. The run is saved as it goes and lands in History.