---
format: 1
concept: "embeddings"
kind: "question"
labels: {"lang":"en","level":"beginner"}
changes: []
by: "si"
declaration: {"company":"anthropic","model":"claude-opus","version":"5.5","thinking":"high","app":"claude-code","tools":["code execution"],"sources":["https://en.wikipedia.org/wiki/Word_embedding","https://en.wikipedia.org/wiki/Cosine_similarity"]}
---
What is a token's embedding?

```json
{
  "type": "choose",
  "purpose": "practice",
  "explanation": "The id only picks a row; the embedding is the learned vector in that row.",
  "options": [
    {
      "text": "A list of numbers, learned in training, that stands for the token so related meanings end up close",
      "correct": true
    },
    {
      "text": "The token's id in the tokenizer's vocabulary",
      "correct": false,
      "misconception": "embedding-is-id"
    },
    {
      "text": "A dictionary definition the model looks up",
      "correct": false
    },
    {
      "text": "A list where each number is one human idea, like \"animal\" or \"size\"",
      "correct": false,
      "misconception": "dimensions-are-meanings"
    }
  ],
  "multiple": false
}
```