Skip to main content

Overview

Character splitter splits text using a single, specified separator. Ideal for documents with clear and consistent delimiters. Uses a direct “Split and Merge” process for efficiency and positional integrity. Splitter Class: CharacterChunker Config Class: CharacterChunkingConfig

Dependencies

No additional dependencies required. Uses standard library.

Examples

Parameters

ParameterTypeDescriptionDefaultSource
chunk_sizeintTarget size of each chunk1024Base
chunk_overlapintOverlapping units between chunks200Base
min_chunk_sizeint | NoneMinimum size for a chunkNoneBase
length_functionCallable[[str], int]Function to measure text lengthlenBase
strip_whitespaceboolStrip leading/trailing whitespaceFalseBase
separatorstrSingle separator string or regex"\n\n"Specific
is_separator_regexboolTreat separator as regexFalseSpecific
keep_separatorboolKeep separator in chunksTrueSpecific