Concept · Building with AI

Chunking

Also called: chunks, chunk, text chunking, document chunking, chunk size

Splitting long documents into smaller passages before creating embeddings, so a search can return just the relevant part instead of a whole file.

For example: A 100-page manual is split into chunks of a few paragraphs, so a question about warranties retrieves only the warranty section.

Connects to 5

• RAG Concept
• Embedding Concept
• Vector database Concept
• Context window Concept
• Reranking Concept