Chunking

Embeddings have a token limit (typically 512-8k), so source documents have to be split into chunks before indexing. Naive chunking (every N characters) destroys meaning at the boundaries. Document-aware chunking respects natural structure — paragraphs, sections, code blocks, table rows — and preserves enough context that a retrieved chunk makes sense in isolation. Most RAG quality problems are chunking problems in disguise.