โš–CalibratedAI

Do AI models know what they don't know? 10 models on 100 Polymarket events.

0
Events Fetched
0
Resolved Events
0
Model Estimates
10
Models Compared
๐Ÿ“Š

No Data Yet

Fetches 100 Polymarket prediction events, then asks 10 models (Qwen 0.5B โ†’ GPT-4o Mini) to estimate each probability. Calibration metrics are computed against resolved outcomes.

Requires CALIBRATEDAI_OPENROUTER_API_KEY ยท ~1000 API calls

Data from Polymarket Gamma API ยท Models via OpenRouter ยท Part of the 216Labs portfolio