Source Agreement

Description

Evaluates the agreement threshold required for resolution. Markets don't need 100% agreement to score perfectly — 80% is enough. This accounts for real-world reliability: if you have five sources, you can tolerate one being temporarily unavailable or returning stale data without it blocking resolution.

Scoring Formula

The score is based on the percentage of sources that must agree, with 80% agreement yielding a perfect score. This means requiring 4 out of 5 sources is just as good as requiring 5 out of 5 — the extra headroom lets resolution succeed even if one source is down. Below 80%, the score scales linearly.

agreement = (min_agreement / total_sources) × 100
score     = min(100, (agreement / 80) × 100)

Example:
  4 of 5 sources → 80% agreement → score 100
  2 of 3 sources → 67% agreement → score 83.3
  2 of 4 sources → 50% agreement → score 62.5
  1 of 5 sources → 20% agreement → score 25

Scoring Thresholds

Best Practices

• >Require 80%+ agreement for a perfect score
• >Use majority (67%+) for markets with redundant sources
• >Avoid low thresholds that allow outlier sources to determine outcome