#1
98
Antigravity CLI
gemini-3_1-pro-preview
LLM Agent Evaluation Dashboard
Compare agent/model runs with deterministic scoring, token metrics, provider context, and links back to the full generated reports.
Reference Implementations
Known-good examples for visual comparison.
Total Runs26
Average Score61.4
Local Runs10
Cloud Runs5
Elevator Prompt Scores Scores prioritize working browser simulations. Runtime verification can contribute up to 40 points for zero startup errors, a nonblank canvas, animation frames, scene complexity, and visible changes over time. Prompt-specific implementation signals, required files, completion metadata, and efficiency make up the remaining points. Hard caps prevent browser-dead, blank, missing-file, or unverified runs from ranking as excellent.
Local-model focused elevator simulations, scored primarily by runtime viability, then file completeness, Three.js behavior cues, and efficiency.
#2
98
OpenCode CLI
muse-spark-1_2
#3
98
Pi Wiggum
agents-a1
#4
96
OpenCode CLI
agents-a1
#5
96
Pi Coding Agent
coder-next
#6
96
Qoder CLI
Qwen3_8-Max-Preview
Comparison Matrix
C=completion, F=files, I=implementation signals, R=runtime verification, E=efficiency.
| Score | Agent / Model | Provider | Tokens | Cost | Time | Breakdown | Links |
|---|---|---|---|---|---|---|---|
|
98
Excellent
|
Antigravity CLI
gemini-3_1-pro-preview
|
184,098 | - | 3.2m |
C 10
F 15
I 30
R 40
E 3
summary report present, artifact files present, machine-readable result metrics present
|
||
|
98
Excellent
|
OpenCode CLI
muse-spark-1_2
|
unknown | 46,219 | $0.10 | - |
C 8
F 15
I 30
R 40
E 5
summary report present, artifact files present, machine-readable result metrics present
|
|
|
98
Excellent
|
Pi Wiggum
agents-a1
|
Local-B70 | 39,312 | - | 3.7m |
C 10
F 15
I 30
R 40
E 3
summary report present, artifact files present, machine-readable result metrics present
|
|
|
96
Excellent
|
OpenCode CLI
agents-a1
|
unknown | 50,921 | - | - |
C 8
F 15
I 30
R 40
E 3
summary report present, artifact files present, machine-readable result metrics present
|
|
|
96
Excellent
|
Pi Coding Agent
coder-next
|
Local (LM Studio) | 23,464 | - | - |
C 8
F 15
I 30
R 40
E 3
summary report present, artifact files present, machine-readable result metrics present
|
|
|
96
Excellent
|
Qoder CLI
Qwen3_8-Max-Preview
|
Qoder | ≈891,371 | N/A | 6.4m |
C 10
F 15
I 30
R 40
E 1
summary report present, artifact files present, machine-readable result metrics present
|
|
|
95
Excellent
|
Claude Code
Opus_4_8
|
Anthropic | 2,409,128 | $3.99 | 18.6m |
C 10
F 15
I 30
R 40
E 0
summary report present, artifact files present, machine-readable result metrics present
|
|
|
93
Excellent
|
Mistral Vibe
mistral-medium-3_5
|
Mistral AI | 1,478,410 | $2.45 | - |
C 8
F 15
I 30
R 40
E 0
summary report present, artifact files present, machine-readable result metrics present
|
|
|
93
Excellent
|
OpenCode CLI
google_gemma-4-26b-a4b-qat
|
Local (LM Studio) | 575,839 | - | - |
C 8
F 15
I 30
R 40
E 0
summary report present, artifact files present, machine-readable result metrics present
|
|
|
93
Excellent
|
Pi Coding Agent
deepreinforce-ai_ornith-1_0-35b
|
Local (LM Studio) | 729,661 | - | - |
C 8
F 15
I 30
R 40
E 0
summary report present, artifact files present, machine-readable result metrics present
|
|
|
92
Excellent
|
Pi Wiggum
agents-a1
|
Local-B70 | 61,286 | - | 7.0m |
C 10
F 15
I 24
R 40
E 3
summary report present, artifact files present, machine-readable result metrics present
|
|
|
92
Excellent
|
Pi Wiggum
qwen3_6-35b-a3b
|
Local-B70 | 40,167 | - | 9.7m |
C 10
F 15
I 24
R 40
E 3
summary report present, artifact files present, machine-readable result metrics present
|
|
|
90
Excellent
|
Pi Wiggum
gemma-4-e4b
|
Local-B70 | 276,208 | - | 42.5m |
C 10
F 15
I 24
R 40
E 1
summary report present, artifact files present, machine-readable result metrics present
|
|
|
89
Excellent
|
Qoder CLI
Qwen3_8-Max
|
Qoder | ≈671,641 | N/A | 3.9m |
C 10
F 15
I 23
R 40
E 1
summary report present, artifact files present, machine-readable result metrics present
|
|
|
70
Strong
|
OpenCode CLI
zai-org_glm-4_7-flash
|
Local (LM Studio) | 118,994 | - | - |
C 8
F 15
I 30
R 35
E 4
summary report present, artifact files present, machine-readable result metrics present
No runtime motion detectedCapped at 70: no runtime motion detected
|
|
|
68
Partial
|
Pi Coding Agent
qwen3_6-35b-a3b
|
Local-B70 | 72,002 | - | - |
C 8
F 15
I 30
R 12
E 3
summary report present, artifact files present, machine-readable result metrics present
Runtime not verified
|
|
|
67
Partial
|
Pi Coding Agent
nemotron-3-nano-omni
|
Local-B70 | 23,229 | - | - |
C 8
F 15
I 27
R 12
E 5
summary report present, artifact files present, machine-readable result metrics present
Runtime not verified
|
|
|
8
Incomplete
|
Mistral Vibe
devstral-2-123b-instruct-2512
|
unknown | 0 | - | - |
C 1
F 0
I 0
R 5
E 2
no result error flag, static browser preflight: no ES module syntax
Runtime not verifiedMissing: index.html, person.js, elevator.jsNo runnable HTML previewNo summary report
|
No report |
|
8
Incomplete
|
Mistral Vibe
mistral-small-4-119b-2603
|
unknown | 0 | - | - |
C 1
F 0
I 0
R 5
E 2
no result error flag, static browser preflight: no ES module syntax
Runtime not verifiedMissing: index.html, person.js, elevator.jsNo runnable HTML previewNo summary report
|
No report |
|
8
Incomplete
|
Mistral Vibe
mistralaidevstral-small-2-2512
|
unknown | 0 | - | - |
C 1
F 0
I 0
R 5
E 2
no result error flag, static browser preflight: no ES module syntax
Runtime not verifiedMissing: index.html, person.js, elevator.jsNo runnable HTML previewNo summary report
|
No report |
|
8
Incomplete
|
OpenCode CLI
gemma-4-31b-it
|
unknown | 0 | - | - |
C 1
F 0
I 0
R 5
E 2
no result error flag, static browser preflight: no ES module syntax
Runtime not verifiedMissing: index.html, person.js, elevator.jsNo runnable HTML previewNo summary report
|
No report |
|
8
Incomplete
|
OpenCode CLI
nvidia-nemotron-3-super-120b-a12b
|
unknown | 0 | - | - |
C 1
F 0
I 0
R 5
E 2
no result error flag, static browser preflight: no ES module syntax
Runtime not verifiedMissing: index.html, person.js, elevator.jsNo runnable HTML previewNo summary report
|
No report |
|
8
Incomplete
|
OpenCode CLI
qwen35-122b-a10bq3_k_s
|
unknown | 0 | - | - |
C 1
F 0
I 0
R 5
E 2
no result error flag, static browser preflight: no ES module syntax
Runtime not verifiedMissing: index.html, person.js, elevator.jsNo runnable HTML previewNo summary report
|
No report |
|
8
Incomplete
|
Pi Coding Agent
gemma-4-31b-it
|
unknown | 0 | - | - |
C 1
F 0
I 0
R 5
E 2
no result error flag, static browser preflight: no ES module syntax
Runtime not verifiedMissing: index.html, person.js, elevator.jsNo runnable HTML previewNo summary report
|
No report |
|
8
Incomplete
|
Pi Coding Agent
glm-4_7-flash
|
unknown | 0 | - | - |
C 1
F 0
I 0
R 5
E 2
no result error flag, static browser preflight: no ES module syntax
Runtime not verifiedMissing: index.html, person.js, elevator.jsNo runnable HTML previewNo summary report
|
No report |
|
8
Incomplete
|
Pi Coding Agent
google_gemma-4-26b-a4b
|
unknown | 0 | - | - |
C 1
F 0
I 0
R 5
E 2
no result error flag, static browser preflight: no ES module syntax
Runtime not verifiedMissing: index.html, person.js, elevator.jsNo runnable HTML previewNo summary report
|
No report |
Total Runs21
Average Score87.1
Local Runs2
Cloud Runs15
Office Prompt Scores Scores prioritize working browser simulations. Runtime verification can contribute up to 40 points for zero startup errors, a nonblank canvas, animation frames, scene complexity, and visible changes over time. Prompt-specific implementation signals, required files, completion metadata, and efficiency make up the remaining points. Hard caps prevent browser-dead, blank, missing-file, or unverified runs from ranking as excellent.
Frontier/cloud office simulations, scored primarily by runtime viability, then office-world behavior, elevator scheduling cues, and efficiency.
#1
98
Antigravity CLI
gemini-3_6-flash-high
#2
96
Pi Wiggum
Agents-A1-MTPLX-Q4
#3
95
Claude Code
Fable_5
#4
95
Claude Code
Opus_5
#5
95
Claude Code
Sonnet
#6
95
Codex CLI
gpt-5_6-luna
Comparison Matrix
C=completion, F=files, I=implementation signals, R=runtime verification, E=efficiency.
| Score | Agent / Model | Provider | Tokens | Cost | Time | Breakdown | Links |
|---|---|---|---|---|---|---|---|
|
98
Excellent
|
Antigravity CLI
gemini-3_6-flash-high
|
48,809 | - | 1.9m |
C 10
F 15
I 30
R 40
E 3
summary report present, artifact files present, machine-readable result metrics present
|
||
|
96
Excellent
|
Pi Wiggum
Agents-A1-MTPLX-Q4
|
Local (LM Studio) | 401,670 | - | 1.0h |
C 10
F 15
I 30
R 40
E 1
summary report present, artifact files present, machine-readable result metrics present
|
|
|
95
Excellent
|
Claude Code
Fable_5
|
Anthropic | 4,268,781 | $18.20 | 53.1m |
C 10
F 15
I 30
R 40
E 0
summary report present, artifact files present, machine-readable result metrics present
|
|
|
95
Excellent
|
Claude Code
Opus_5
|
Anthropic | 11,452,403 | $13.93 | 47.3m |
C 10
F 15
I 30
R 40
E 0
summary report present, artifact files present, machine-readable result metrics present
|
|
|
95
Excellent
|
Claude Code
Sonnet
|
Anthropic | 15,683,159 | $11.32 | 48.4m |
C 10
F 15
I 30
R 40
E 0
summary report present, artifact files present, machine-readable result metrics present
|
|
|
95
Excellent
|
Codex CLI
gpt-5_6-luna
|
OpenAI | 1,487,407 | - | - |
C 8
F 15
I 30
R 40
E 2
summary report present, artifact files present, machine-readable result metrics present
|
|
|
95
Excellent
|
Codex CLI
gpt-5_6-sol
|
OpenAI | 2,184,142 | - | - |
C 8
F 15
I 30
R 40
E 2
summary report present, artifact files present, machine-readable result metrics present
|
|
|
95
Excellent
|
Codex CLI
gpt-5_6-terra
|
OpenAI | 2,965,162 | - | - |
C 8
F 15
I 30
R 40
E 2
summary report present, artifact files present, machine-readable result metrics present
|
|
|
95
Excellent
|
Qoder CLI
Cantus
|
Qoder | ≈4,644,975 | N/A | 19.4m |
C 10
F 15
I 30
R 40
E 0
summary report present, artifact files present, machine-readable result metrics present
|
|
|
95
Excellent
|
Qoder CLI
DeepSeek-V4-Flash
|
Qoder | ≈4,576,933 | N/A | 9.5m |
C 10
F 15
I 30
R 40
E 0
summary report present, artifact files present, machine-readable result metrics present
|
|
|
95
Excellent
|
Qoder CLI
GLM-5_2
|
Qoder | ≈14,532,447 | N/A | 22.2m |
C 10
F 15
I 30
R 40
E 0
summary report present, artifact files present, machine-readable result metrics present
|
|
|
95
Excellent
|
Qoder CLI
MiniMax-M3
|
Qoder | ≈6,168,387 | N/A | 11.3m |
C 10
F 15
I 30
R 40
E 0
summary report present, artifact files present, machine-readable result metrics present
|
|
|
95
Excellent
|
Qoder CLI
Qwen3_8-Max
|
Qoder | ≈20,936,897 | N/A | 1.0h |
C 10
F 15
I 30
R 40
E 0
summary report present, artifact files present, machine-readable result metrics present
|
|
|
95
Excellent
|
Qoder CLI
Qwen3_8-Max-Preview
|
Qoder | ≈13,626,252 | N/A | 40.1m |
C 10
F 15
I 30
R 40
E 0
summary report present, artifact files present, machine-readable result metrics present
|
|
|
94
Excellent
|
OpenCode CLI
moonshotai_kimi-k3
|
unknown | 225,317 | $4.43 | - |
C 8
F 15
I 30
R 40
E 1
summary report present, artifact files present, machine-readable result metrics present
|
|
|
90
Excellent
|
Pi Wiggum
agents-a1
|
Local (LM Studio) | 4,339,565 | - | 1.8h |
C 10
F 15
I 25
R 40
E 0
summary report present, artifact files present, machine-readable result metrics present
|
|
|
70
Strong
|
Qoder CLI
DeepSeek-V4-Pro
|
Qoder | ≈4,478,998 | N/A | 22.0m |
C 10
F 15
I 30
R 35
E 0
summary report present, artifact files present, machine-readable result metrics present
No runtime motion detectedCapped at 70: no runtime motion detected
|
|
|
66
Partial
|
OpenCode CLI
gemma-4-31b-qat
|
unknown | 336,888 | - | - |
C 8
F 15
I 30
R 12
E 1
summary report present, artifact files present, machine-readable result metrics present
Runtime not verified
|
|
|
65
Partial
|
OpenCode CLI
muse-spark-1_2
|
unknown | 526,497 | $1.00 | - |
C 8
F 15
I 30
R 12
E 0
summary report present, artifact files present, machine-readable result metrics present
Runtime not verified
|
|
|
55
Partial
|
Codex CLI
gpt-5_5
|
OpenAI | 448,065 | - | - |
C 8
F 15
I 30
R 25
E 3
summary report present, artifact files present, machine-readable result metrics present
Static JS reference check failedCapped at 55: static JS reference check failed
Runtime errorsevals/codex_gpt-5_5_office_prompt_v2/world.js:159:27 'sitTargets' is not definedevals/codex_gpt-5_5_office_prompt_v2/world.js:159:44 'desks' is not definedevals/codex_gpt-5_5_office_prompt_v2/world.js:212:9 'sitTargets' is not definedevals/codex_gpt-5_5_office_prompt_v2/world.js:213:9 'sitTargets' is not definedevals/codex_gpt-5_5_office_prompt_v2/world.js:214:9 'sitTargets' is not defined
|
|
|
55
Partial
|
OpenCode CLI
Kimi_K2_7_Code
|
unknown | 180,651 | $1.51 | - |
C 8
F 15
I 30
R 25
E 1
summary report present, artifact files present, machine-readable result metrics present
Static JS reference check failedCapped at 55: static JS reference check failed
Runtime errorsevals/opencode_Kimi_K2_7_Code_office_prompt_v2/elevator_logic.js:213:73 'e' is not definedevals/opencode_Kimi_K2_7_Code_office_prompt_v2/sim.js:925:38 'e' is not definedevals/opencode_Kimi_K2_7_Code_office_prompt_v2/sim.js:932:34 'e' is not defined
|
Antigravity CLI
2 evaluations
Google
98
gemini-3_1-pro-preview
Elevator Prompt V2
Google
98
gemini-3_6-flash-high
Office Prompt V3
Claude Code
4 evaluations
Anthropic
95
Fable_5
Office Prompt V3
Anthropic
95
Opus_4_8
Elevator Prompt V2
Anthropic
95
Opus_5
Office Prompt V3
Anthropic
95
Sonnet
Office Prompt V3
Codex CLI
4 evaluations
OpenAI
55
gpt-5_5
Office Prompt V2
OpenAI
95
gpt-5_6-luna
Office Prompt V3
OpenAI
95
gpt-5_6-sol
Office Prompt V3
OpenAI
95
gpt-5_6-terra
Office Prompt V3
Mistral Vibe
5 evaluations
Unknown
8
devstral-2-123b-instruct-2512
Elevator Prompt
Unknown
8
devstral-2-123b-instruct-2512
Fib Prompt
Mistral AI
93
mistral-medium-3_5
Elevator Prompt V2
Unknown
8
mistral-small-4-119b-2603
Elevator Prompt V3
Unknown
8
mistralaidevstral-small-2-2512
Elevator Prompt
OpenCode CLI
11 evaluations
Unknown
96
agents-a1
Elevator Prompt V3
Unknown
8
gemma-4-31b-it
Elevator Prompt
Unknown
66
gemma-4-31b-qat
Office Prompt V3
Local (LM Studio)
93
google_gemma-4-26b-a4b-qat
Elevator Prompt V3
Unknown
55
Kimi_K2_7_Code
Office Prompt V2
Unknown
94
moonshotai_kimi-k3
Office Prompt V3
Unknown
98
muse-spark-1_2
Elevator Prompt V3
Unknown
65
muse-spark-1_2
Office Prompt V3
Unknown
8
nvidia-nemotron-3-super-120b-a12b
Elevator Prompt
Unknown
8
qwen35-122b-a10bq3_k_s
Elevator Prompt
Local (LM Studio)
70
zai-org_glm-4_7-flash
Elevator Prompt V3
Pi Coding Agent
7 evaluations
Local (LM Studio)
96
coder-next
Elevator Prompt V3
Local (LM Studio)
93
deepreinforce-ai_ornith-1_0-35b
Elevator Prompt V3
Unknown
8
gemma-4-31b-it
Elevator Prompt
Unknown
8
glm-4_7-flash
Elevator Prompt
Unknown
8
google_gemma-4-26b-a4b
Elevator Prompt
Local-B70
67
nemotron-3-nano-omni
Elevator Prompt V3
Local-B70
68
qwen3_6-35b-a3b
Elevator Prompt V3
Pi Wiggum
6 evaluations
Local-B70
98
agents-a1
Elevator Prompt V3
Local-B70
92
agents-a1
Elevator Prompt Wiggum
Local (LM Studio)
90
agents-a1
Office Prompt Wiggum
Local (LM Studio)
96
Agents-A1-MTPLX-Q4
Office Prompt Wiggum
Local-B70
90
gemma-4-e4b
Elevator Prompt Wiggum
Local-B70
92
qwen3_6-35b-a3b
Elevator Prompt Wiggum
Qoder CLI
9 evaluations
Qoder
95
Cantus
Office Prompt V3
Qoder
95
DeepSeek-V4-Flash
Office Prompt V3
Qoder
70
DeepSeek-V4-Pro
Office Prompt V3
Qoder
95
GLM-5_2
Office Prompt V3
Qoder
95
MiniMax-M3
Office Prompt V3
Qoder
89
Qwen3_8-Max
Elevator Prompt V3
Qoder
95
Qwen3_8-Max
Office Prompt V3
Qoder
96
Qwen3_8-Max-Preview
Elevator Prompt V3
Qoder
95
Qwen3_8-Max-Preview
Office Prompt V3