{} schema-comply

Does the model keep its JSON-schema promise?

Every major LLM advertises a "structured outputs" or "JSON schema" mode. They do not all keep their word. schema-comply probes the top models on OpenRouter every 4 hours with a fixed battery of five schemas and ranks them by how often their response actually parses and validates. No mock data. No seed rows.

Total probes
Models tracked
Spent today
Mode
Last refresh

Leaderboard

# Model Provider Mode Compliance Probes Avg latency Avg cost Last probe
Loading…