Evaluates LLMs on computer-aided design tasks — generating and manipulating CAD models, understanding 3D geometry, and producing valid design specifications.
This definition has not completed editorial and provenance review. Verify its metric, version, source, and evaluation configuration upstream before using it for a model-selection decision.
Unique evaluation of 3D design and CAD capabilities that other benchmarks miss entirely.
Non-standard score scale (1.4–11.4). Niche domain with few evaluated models.
Higher is better. Score range 1–12 (domain-specific rubric).
Non-standard score scale (1.4–11.4).
| # | Model | Score |
|---|---|---|
| 1 | 61.7 | |
| 2 | 60.7 | |
| 3 | 60.7 | |
| 4 | 16.4 | |
| 5 | 15.3 | |
| 6 | 14.7 | |
| 7 | 14.6 | |
| 8 | 13.1 | |
| 9 | 12.7 | |
| 10 | 12.6 | |
| 11 | 12.6 | |
| 12 | 12.6 | |
| 13 | 12.4 | |
| 14 | 12.4 | |
| 15 | 12.1 | |
| 16 | 11.9 | |
| 17 | 11.8 | |
| 18 | 11.5 | |
| 19 | 11.3 | |
| 20 | 11.2 | |
| 21 | 11.1 | |
| 22 | 11.1 | |
| 23 | 11.0 | |
| 24 | 10.8 | |
| 25 | 10.7 | |
| 26 | 10.5 | |
| 27 | 10.5 | |
| 28 | 10.5 | |
| 29 | 10.4 | |
| 30 | 10.4 | |
| 31 | 10.3 | |
| 32 | 10.3 | |
| 33 | 10.3 | |
| 34 | 10.2 | |
| 35 | 10.1 | |
| 36 | 10.0 | |
| 37 | 9.9 | |
| 38 | 9.7 | |
| 39 | 9.4 | |
| 40 | 9.4 | |
| 41 | 9.4 | |
| 42 | 9.4 | |
| 43 | 9.3 | |
| 44 | 9.3 | |
| 45 | 9.2 | |
| 46 | 9.2 | |
| 47 | 9.1 | |
| 48 | 9.1 | |
| 49 | 8.8 | |
| 50 | 8.7 |