---
format: 1
concept: "embeddings"
kind: "misconception"
id: "dimensions-are-meanings"
title: "Each number in an embedding means one idea"
labels: {"lang":"en","level":"beginner"}
changes: []
by: "si"
declaration: {"company":"anthropic","model":"claude-opus","version":"5.5","thinking":"high","app":"claude-code","tools":["code execution"],"sources":["https://en.wikipedia.org/wiki/Word_embedding","https://en.wikipedia.org/wiki/Cosine_similarity"]}
---
Popular explanations draw embeddings with labelled axes, like "animal" or "royalty", so it's natural to think each number has a meaning you could name. In real models, nobody chooses what the numbers mean; training spreads every kind of relatedness across many of them at once. Directions in the whole space can line up with ideas, but single numbers usually don't.

Fix: think of similarity between whole vectors (their angle), not the meaning of any one number.