Skip to content
Axis

Math

Exact calculation and ballpark estimation without tools: how precise, and how wrong when it misses.

ScoreAccuracy95% interval
Rank#ModelScore
1GPT-6.1 SolScore 83.1, interval ±1.5, accuracy 95.0%83.1
2GPT-6 LunaScore 56.3, interval ±2.7, accuracy 80.7%56.3
Score ↑$/task · log ←↖ Better: higher score, lower cost$0.0010$0.00305060708090GPT-6 LunaGPT-6.1 Sol
ballpark

Ballpark

Twelve streams of calculation without tools (products, powers, long expressions, division, roots and logarithms, chained quotients, exponentials, real powers, factorials, binomial coefficients, trigonometry and generalized harmonic sums), growing in size. The reply is a number or a range: an exact answer scores highest, a correct range scores by its precision, and a miss costs more the further off it is.

ModelAxes score, λ = 12,200 itemsDetails →
ScoreAccuracy95% interval
Rank#ModelScore
1GPT-6.1 SolScore 83.1, interval ±1.5, accuracy 95.0%83.1
2GPT-6 LunaScore 56.3, interval ±2.7, accuracy 80.7%56.3
Score ↑$/task · log ←↖ Better: higher score, lower cost$0.0010$0.00305060708090GPT-6 LunaGPT-6.1 Sol