Getting Started

Quick Start

Get started with Caliber in just a few minutes. This guide will walk you through rating your first prediction market.


Rate a Market via API

Send a POST request to the ratings endpoint with your market definition:

curl -X POST https://api.caliberratings.xyz/v0/ratings/markets \
  -H "Content-Type: application/json" \
  -d '{
    "prompt": "Who won the 2026 Australian Grand Prix?",
    "answer_type": "string",
    "expected_results": ["Oscar Piastri", "Max Verstappen", "Lando Norris"],
    "comparison_operator": "==",
    "source_urls": [
      "https://www.formula1.com/en/results/2026/races/1279/australia/race-result",
      "https://racingnews365.com/2026-f1-australian-grand-prix-results"
    ],
    "min_agreement": 2,
    "resolution_start": "2026-03-23T00:00:00Z",
    "resolution_end": "2026-03-24T00:00:00Z"
  }'

Example Response

The API returns a comprehensive rating with a final score, rating band, and per-criterion breakdown:

{
  "id": "a1b2c3d4e5f67890a1b2c3d4e5f67890",
  "market_hash": "a1b2c3d4e5f67890a1b2c3d4e5f67890abcdef1234567890abcdef1234567890",
  "rated_at": "2026-03-23T16:20:00Z",
  "final_score": 72.5,
  "rating_band": {
    "rating": "A",
    "min_score": 70,
    "max_score": 79,
    "definition": "Strong; some limitations."
  },
  "criteria": [
    {
      "key": "source_reachability",
      "name": "Source Reachability",
      "criterion_type": "gate",
      "evaluation": "static",
      "status": "pass",
      "summary": "All source URLs are reachable."
    },
    {
      "key": "source_count",
      "name": "Source Count",
      "weight": 0.2,
      "score": 40,
      "weighted_score": 8,
      "criterion_type": "score",
      "evaluation": "static",
      "status": "pass",
      "summary": "Limited redundancy (2 sources)."
    },
    {
      "key": "source_relevancy",
      "name": "Source Relevancy",
      "weight": 0.2,
      "score": 85,
      "weighted_score": 17,
      "criterion_type": "score",
      "evaluation": "llm",
      "status": "pass",
      "summary": "Sources are highly relevant and authoritative."
    }
  ]
}

Understanding the Response

  • >id - Short identifier for retrieving this rating via GET /v0/ratings/markets/{id}
  • >final_score - Overall score from 0-100
  • >rating_band - Letter grade (Aaa to C) with definition
  • >criteria - Detailed breakdown of each criterion evaluated