
Compression, Non-Commutativity, and Information Coefficients
Averaging vs normalization on the sphere
Introduction
Let be a sequence of unit vectors. Define the empirical mean:
Fix the “north pole” , and define:
We study the quantity:
This simple difference encodes:
- a non-commutativity phenomenon
- a geometric correction for dispersion
- a meaningful distinction in financial forecasting
Averaging is compression
The averaging map
is inherently many-to-one.
It compresses an entire sequence into a single vector, discarding:
- temporal order
- variation and dispersion
- rotation of directions
Normalization introduces a second compression:
which removes magnitude and keeps only direction.
So we have a two-stage compression:
sequence → mean vector → mean direction
- : computed after the first compression
- : computed after the second
Thus
measures the effect of compressing a vector into a direction.
A subtle non-commutative diagram
Consider:
(S^M)^N ────────────────→ S^M
| A_s |
| | P
| P ↓
↓ R
R^N ────────────────→
A_e
Where:
- Top map (spherical averaging):
- Bottom map (Euclidean averaging):
- Left map :
- Right map :
Two paths
Down then right:
Right then down:
The diagram does not commute
and the gap is exactly:
Two “averages” that are the same—and not
Both and are “averages”:
- Same idea: aggregate many objects into one
- Different reality:
- : linear space
- : linear average + projection onto a curved space
Same abstraction, different geometry.
Geometry: coordinates vs directions
We have:
and:
Define:
Then captures structure orthogonal to the target and drives the discrepancy.
Financial interpretation: IC vs directional IC
Let be a time series of cross-sectional forecasts.
Let be the target.
Then:
So:
is the time-average IC.
And ?
So:
- = IC of the aggregate direction
Compare and contrast
| Quantity | Interpretation |
|---|---|
| Average IC across time | |
| IC of the persistent direction |
What compression signifies
where measures:
temporal coherence of the signal
Cases
- Stable signal → → small
- Rotating signal → → large
Broader connections
- Fréchet mean: https://en.wikipedia.org/wiki/Fr%C3%A9chet_mean
- Jensen’s inequality: https://en.wikipedia.org/wiki/Jensen%27s_inequality
- Directional statistics: https://en.wikipedia.org/wiki/Directional_statistics
One-line takeaway
Average IC is not the same as IC of the average direction—and compression measures the difference.