chunkipy.text_splitters

Public text splitter classes exposed by chunkipy.text_splitters.

class chunkipy.text_splitters.BaseTextSplitter[source]

Bases: ABC

Base class for splitter strategies that divide text into smaller pieces.

split(text)[source]

Template method for splitting text. Validates the input and delegates the actual splitting logic to the subclass.

class chunkipy.text_splitters.ColonTextSplitter[source]

Split text on ``: `` boundaries.

class chunkipy.text_splitters.CommaTextSplitter[source]

Split text on ``, `` boundaries.

class chunkipy.text_splitters.FullStopTextSplitter[source]

Split text on ``. `` sentence-like boundaries.

class chunkipy.text_splitters.NewlineTextSplitter[source]

Split text on newline boundaries.

class chunkipy.text_splitters.SemicolonTextSplitter[source]

Split text on ``; `` boundaries.

class chunkipy.text_splitters.SeparatorTextSplitter(separator)[source]

Split text using a fixed separator while preserving the separator.

class chunkipy.text_splitters.WordTextSplitter[source]

Split text on spaces while preserving trailing whitespace.

Modules

`base_text_splitter`
`basic_text_splitters`
`semantic`	Semantic splitter abstractions and implementations.