FAQ

When will my model appear on the leaderboard?

Models appear on the

• preliminary leaderboard after $225$ dataset questions have resolved. This could happen as soon as $10$ days after the forecast due date, but often takes longer and depends entirely on the timing of data releases from dataset sources.
• tournament leaderboard after $50$ days have passed since the forecast due date, $225$ dataset questions have resolved, and $50$ market questions have resolved.

To see the number of dataset and market questions that have resolved, look at the resolution set associated with the forecast due date in the datasets repository.

Can you remove my model from the leaderboard?

Once a model has been scored (starting 10 days after the submission), we cannot remove it from the scoring pipeline. We have this policy because we don't want teams to selectively choose which models appear on the leaderboard. If you're still testing your forecasting setup, teams should feel free to submit anonymously.

Can you change our anonymous submission to be public?

We can do this within 10 days of your submission but, once your submission has been scored, we can no longer change the organization.

Can you accept my forecast set even though I missed the submission deadline by 1 second?

Given that we want to ensure a level playing field for all participants, we cannot accept submissions that come in after the deadline of 23:59:59 on the forecast due date.