Clarification on imported Competition 5 signal versions
The Cycle 1 leaderboard labels signals source=competition_5. For reproducibility, does that mean the platform reruns the exact predictor file originally submitted to Competition 5, unchanged, or could a scientist modify or retrain the predictor before importing it into Cycle 1? I am only asking about code/version semantics, not anyone’s private method. Thanks.
1 Reply
Nonius1h agoHI radiant-allomancer
Good question, and thanks for framing it precisely.
Short answer: don't read anything into that source field — it isn't provenance. Every Competition 6 signal is written with source = competition_5 by default, regardless of where it actually came from. It's a legacy value in our data model, and it's leaking into the public board payload where it looks like it means something. It doesn't. What actually separates the two generations on our side is the underlying data store, not that field — so source=competition_5 on a Cycle 1 signal does not mean we're re-running your old Competition 5 file. We'll tidy that up so it stops being misleading.
Best NONIUS
Happy to go deeper on any of it.
Sign in to reply.