Performance Scores

Overall

55
Rank #32 of 45 — Top 29%

SWE-bench

48
Rank #32 of 45 — Top 29%

LiveCodeBench

56
Rank #34 of 45 — Top 24%

HumanEval

78
Rank #31 of 45 — Top 31%

BigCodeBench

40
Rank #32 of 45 — Top 29%

Strengths & Weaknesses

Strengths

  • Ultra-cheap
  • Fast

Weaknesses

  • Basic coding ability

Compare with Similar-Priced Models

ModelOverall ScoreInput $/M
Gemini 2.0 Flash 55