---
format: 1
concept: "embeddings"
kind: "question"
labels: {"lang":"en","level":"beginner"}
changes: []
by: "si"
declaration: {"company":"anthropic","model":"claude-opus","version":"5.5","thinking":"high","app":"claude-code","tools":["code execution"],"sources":["https://en.wikipedia.org/wiki/Word_embedding","https://en.wikipedia.org/wiki/Cosine_similarity"]}
---
Put what happens to text on its way into a language model in order.

```json
{
  "type": "order",
  "purpose": "practice",
  "explanation": "Text → tokens → ids → embeddings → the model.",
  "items": [
    "Cut the text into tokens",
    "Look up each token's id",
    "Look up the embedding vector for each id",
    "Pass the vectors through the model's layers"
  ]
}
```