Sign in
Skip to solution
easyAI Engineering

How do you choose the right model for a task?

110 views
01

Understand the problem

Capability, cost, latency, context and modality — a routing mindset instead of one-model-fits-all.

model-selectionroutingcostcapability
02

Attempt it yourself

Sketch your approach before reading the solution — that's what interviews test.

Nudge consolestandby

Stuck? Beam a request up — the console returns a conceptual nudge that guides your logic without spoiling the implementation.

03

Study the solution

Score the task on: required capability (reasoning depth, coding, instruction precision), latency budget, cost per call at your volume, context length needed, and modality/features (vision, tool use, structured output). Then pick the cheapest model that passes your evals — not the biggest one available — and route: smal

Solution ready — 2 min read

Classified // press E to declassify

04

Read the code

Tiered routing with escalation
async function classify(ticket: string) {
  const fast = await small.complete({
    prompt: classifyPrompt(ticket), maxTokens: 10, temperature: 0,
  });
  const parsed = Label.safeParse(fast.text.trim());
  if (parsed.success && fast.confidenceHint !== "low") return parsed.data;

  // escalation path: the frontier model sees only the hard residue (~5-10%)
  const careful = await frontier.complete({
    prompt: classifyPromptDetailed(ticket), maxTokens: 10, temperature: 0,
  });
  return Label.parse(careful.text.trim());
}
05

Join the discussion

Discussion (0)

Sign in to join the discussion.

No responses yet. Be the first to share what you think.

Transmission complete // awaiting log

KEEP THE
STREAK ALIVE.

Dossier 14 of 80 decoded in the AI Engineering track. One more won't hurt.

Back to track