How scoring works
Every round, each miner's router picks a model for the same new questions. The router that has proven itself best holds the champion seat.
One round
- Questions. The chain's own randomness draws a fixed number of questions from a large public pool, spread across knowledge, math, hard reasoning and following instructions. Nobody knows them in advance, Fugal included.
- Answers. Each miner runs its router inside sealed hardware. The router picks one model for every question, the miner pays for the call, and fixed graders mark the reply right or wrong.
- Proof. The hardware signs a record of exactly what ran. Only a router that was committed on the chain before the questions could be known is allowed to score.
- Check. The validator verifies the proofs. It never calls a model itself.
- Publish. The results go on the Leaderboard, and the raw file behind them, with every grade, cost and decision, is public for anyone to re-check.
A new round starts about every few minutes.
The champion seat
One router holds the seat at a time. To take it, a router goes through three steps:
- Burn-in. It is scored on enough questions in a row. A missed round starts the count again.
- The mark. Its accuracy reaches the level the champions so far have set.
- The test. It is compared with the champion on the questions both answered. Accuracy and cost count together: it gains points for more right answers, with hard questions counted extra, and loses points for spending more. Its lead has to be above the margin, and still above it after allowing for luck.
The champion keeps the seat without having to win again, so two near-equal routers cannot pass it back and forth on noise. A copy of a router that another miner entered first cannot take the seat.
Every test so far is listed under History on the Leaderboard.
| Rule | In force now |
|---|---|
| Questions in each round | see the Leaderboard |
| Questions a new router is scored on before it can challenge | see the Leaderboard |
| Shared questions needed for a test against the champion | see the Leaderboard |
| Lead a challenger needs, in points | more than the margin on the Leaderboard |
| Confidence needed to take the seat | see the Leaderboard |
| Extra weight given to hard questions | see the Leaderboard times |
These values are read live. They come from the validator's latest published results, so this page shows the rules in force today, not the rules on the day it was written.
Payout
The champion is paid most of the miner reward. The two champions before it keep a smaller share, so a router that was the best yesterday still earns something today. Where there has not yet been an earlier champion, or it has stopped competing, its share goes to the current champion. Reward is burned, which means destroyed instead of paid, only while there is no champion.
| Who | Share of the miner reward |
|---|---|
| Champion | the largest |
| Previous champion | smaller |
| The champion before that | smallest |
When the seat changes hands the payout moves over a few rounds rather than at once. Who is paid what right now is under History on the Leaderboard.
Check it yourself
Every competition number on the Leaderboard can be recomputed from the public results. Each round has one file. The link "This round's raw results" at the foot of the Leaderboard opens the latest one. For any other round, replace {epoch} in this address with the round's id written in full; the latest is the one that link opens.
curl -s --compressed the address behind that link
The exact constants and formulas are in the subnet's INVARIANTS.md. To compete, start with the miner guide.