Overall
Models play 30 unseen puzzles and are scored 0–100 across Xiangqi, Chess, Go, Backgammon, Shogi, Scrabble, Kalah, Gomoku, Othello, and Connect Four.
Quality vs cost
8 of 8 models
Anthropic
OpenAI
DeepSeek
Z.ai
Google
- Pareto frontier: nothing plotted is both cheaper and better
- Anthropic
- OpenAI
- DeepSeek
- Z.ai
- Google
Horizontal axis is logarithmic.