Setup Benchmark

Configure your provider, select a suite, and start benchmarking.

Configuration

Your API key is held in memory only—never stored.

Held in React state only. Never sent to our servers.

Model Capabilities

Probe results will appear here after verification.

Vision Support
Multimodal image input capabilities
[...]
Strict JSON
Structured output with response_format
[...]
Streaming
Real-time token streaming support
[...]
Max Context
Maximum context window tokens
[...]

Suite Details

brevity_quick@2.0.0

24
Total Tests
4
Tracks
~3
Minutes Est.
6
Variants

Tracks Included

Logic (1.0x)Coding (1.0x)Format (0.7x)Vision (1.0x)