Embedding Models Measure in Peculiar Ways
Embedding spaces only weakly track real-world measures like mass, distance, time, and volume.
The paper tests whether embeddings preserve objective equivalence and distance across physical measurements. It finds odd measurement patterns instead of clean alignment. The authors say surface-level string similarity strongly shapes the representations, and recalibrating similarity does not substantially fix it. ArXiv · AI/CL/LG's note
The paper tests whether embeddings preserve objective equivalence and distance across physical measurements. It finds odd measurement patterns instead of clean alignment. The authors say surface-level string similarity strongly shapes the representations, and recalibrating similarity does not substantially fix it. ArXiv · AI/CL/LG's note
score 4