chunkipy.text_splitters

class chunkipy.text_splitters.BaseTextSplitter[source]

Bases: ABC

Base class for text splitters.

split(text)[source]

Template method for splitting text. Validates the input and delegates the actual splitting logic to the subclass.

Parameters:

text (str) – The text to be split.

Returns:

A list of text text parts.

Return type:

list[str]

class chunkipy.text_splitters.ColonTextSplitter[source]

Bases: SeparatorTextSplitter

class chunkipy.text_splitters.CommaTextSplitter[source]

Bases: SeparatorTextSplitter

class chunkipy.text_splitters.FullStopTextSplitter[source]

Bases: SeparatorTextSplitter

class chunkipy.text_splitters.NewlineTextSplitter[source]

Bases: SeparatorTextSplitter

class chunkipy.text_splitters.SemicolonTextSplitter[source]

Bases: SeparatorTextSplitter

class chunkipy.text_splitters.SeparatorTextSplitter(separator)[source]

Bases: BaseTextSplitter

Parameters:

separator (str)

property separator: str
class chunkipy.text_splitters.WordTextSplitter[source]

Bases: SeparatorTextSplitter

Modules

base_text_splitter

basic_text_splitters

semantic