AlphaNova
0

Local --gauge-fix novelty vs live Global Novelty — a large, systematic gap

S
skiitk
12h ago

Sharing a calibration finding that cost me a few submission slots to learn.

Locally, runner.py --full --gauge-fix reported city novelty in the 54–66° range for my signals. After submitting, the same signals came back with live Global Novelty of 13–34° — dramatically lower.

The cause: signal_db/signal_cities_ambient_coords.parquet contains only the legacy panel (Nonius + a handful of others), not the live field. So local novelty is measured against a small, unrepresentative set and systematically overstates true novelty against ~400 live signals Practical implication: local novelty can't be used to plan for the quality set. The only way to measure real decorrelation is to spend a submission slot — which is expensive when you only have 10.

0 Replies

No replies yet. Be the first to reply!

Sign in to reply.