Language models · 13 min
How Agentic RAG Learns to Say "I Don't Know"
A model that doesn't know your company's policies will make them up.
0x00000000 · pulled from the issue
Oops, where are we?
This story has been pulled from the issue, or it's still being written. Let's head back.
While you're here
Language models · 10 min
What Are Word Embeddings, Anyway?
Meaning is not typed in by anyone. It falls out of a prediction game played over billions of sentences, and the leftover geometry is what we call an embedding.
Language models · 12 min
What Are Tokens in an LLM, Anyway?
The algorithm behind GPT's tokenizer is called BPE, byte pair encoding.