Docs How scoring works
Subnet

How scoring works

Every round, each miner's router picks a model for the same new questions. The router that has proven itself best holds the champion seat.

One round

  1. Questions. The chain's own randomness draws a fixed number of questions from a large public pool, spread across knowledge, math, hard reasoning and following instructions. Nobody knows them in advance, Fugal included.
  2. Answers. Each miner runs its router inside sealed hardware. The router picks one model for every question, the miner pays for the call, and fixed graders mark the reply right or wrong.
  3. Proof. The hardware signs a record of exactly what ran. Only a router that was committed on the chain before the questions could be known is allowed to score.
  4. Check. The validator verifies the proofs. It never calls a model itself.
  5. Publish. The results go on the Leaderboard, and the raw file behind them, with every grade, cost and decision, is public for anyone to re-check.

A new round starts about every few minutes.

The champion seat

One router holds the seat at a time. To take it, a router goes through three steps:

  1. Burn-in. It is scored on enough questions in a row. A missed round starts the count again.
  2. The mark. Its accuracy reaches the level the champions so far have set.
  3. The test. It is compared with the champion on the questions both answered. Accuracy and cost count together: it gains points for more right answers, with hard questions counted extra, and loses points for spending more. Its lead has to be above the margin, and still above it after allowing for luck.

The champion keeps the seat without having to win again, so two near-equal routers cannot pass it back and forth on noise. A copy of a router that another miner entered first cannot take the seat.

Every test so far is listed under History on the Leaderboard.

Rule In force now
Questions in each round see the Leaderboard
Questions a new router is scored on before it can challenge see the Leaderboard
Shared questions needed for a test against the champion see the Leaderboard
Lead a challenger needs, in points more than the margin on the Leaderboard
Confidence needed to take the seat see the Leaderboard
Extra weight given to hard questions see the Leaderboard times

These values are read live. They come from the validator's latest published results, so this page shows the rules in force today, not the rules on the day it was written.

Payout

The champion is paid most of the miner reward. The two champions before it keep a smaller share, so a router that was the best yesterday still earns something today. Where there has not yet been an earlier champion, or it has stopped competing, its share goes to the current champion. Reward is burned, which means destroyed instead of paid, only while there is no champion.

Who Share of the miner reward
Champion the largest
Previous champion smaller
The champion before that smallest

When the seat changes hands the payout moves over a few rounds rather than at once. Who is paid what right now is under History on the Leaderboard.

Check it yourself

Every competition number on the Leaderboard can be recomputed from the public results. Each round has one file. The link "This round's raw results" at the foot of the Leaderboard opens the latest one. For any other round, replace {epoch} in this address with the round's id written in full; the latest is the one that link opens.

curl -s --compressed the address behind that link

The exact constants and formulas are in the subnet's INVARIANTS.md. To compete, start with the miner guide.