langchain Architecture Docs
Home / File/ text_splitter.py — langchain Source File

text_splitter.py — langchain Source File

Architecture documentation for text_splitter.py, a python file in the langchain codebase. 12 imports, 0 dependents.

File python 12 imports

Entity Profile

Dependency Diagram

graph LR
  d77ad055_6529_8d51_4d45_a5dcee8cb260["text_splitter.py"]
  7c6676be_7003_53c4_f08f_05a4d67a1cee["langchain_text_splitters"]
  d77ad055_6529_8d51_4d45_a5dcee8cb260 --> 7c6676be_7003_53c4_f08f_05a4d67a1cee
  8dcf5d75_3e05_1e6b_3ce2_4d8907e376c0["langchain_text_splitters.base"]
  d77ad055_6529_8d51_4d45_a5dcee8cb260 --> 8dcf5d75_3e05_1e6b_3ce2_4d8907e376c0
  1f147eca_0e2e_9025_cd91_f3609fa7b93f["langchain_text_splitters.character"]
  d77ad055_6529_8d51_4d45_a5dcee8cb260 --> 1f147eca_0e2e_9025_cd91_f3609fa7b93f
  f70fd7d6_e7c1_df58_6c7d_f62fb1db58fc["langchain_text_splitters.html"]
  d77ad055_6529_8d51_4d45_a5dcee8cb260 --> f70fd7d6_e7c1_df58_6c7d_f62fb1db58fc
  969abd13_3c6d_1d62_9ee7_5aedd62aa0a2["langchain_text_splitters.json"]
  d77ad055_6529_8d51_4d45_a5dcee8cb260 --> 969abd13_3c6d_1d62_9ee7_5aedd62aa0a2
  f2f6b8bc_408a_6827_04fe_dfa7e5bc90b1["langchain_text_splitters.konlpy"]
  d77ad055_6529_8d51_4d45_a5dcee8cb260 --> f2f6b8bc_408a_6827_04fe_dfa7e5bc90b1
  2c3704bb_784d_0cc6_c5c2_c1fa4040dc77["langchain_text_splitters.latex"]
  d77ad055_6529_8d51_4d45_a5dcee8cb260 --> 2c3704bb_784d_0cc6_c5c2_c1fa4040dc77
  9c127e04_852f_7d1e_5a29_9f5434c33172["langchain_text_splitters.markdown"]
  d77ad055_6529_8d51_4d45_a5dcee8cb260 --> 9c127e04_852f_7d1e_5a29_9f5434c33172
  e763912b_9e7e_8cd9_29dd_62b413d3361c["langchain_text_splitters.nltk"]
  d77ad055_6529_8d51_4d45_a5dcee8cb260 --> e763912b_9e7e_8cd9_29dd_62b413d3361c
  efbfd7b0_5123_9628_3a67_f09b0ff9bc26["langchain_text_splitters.python"]
  d77ad055_6529_8d51_4d45_a5dcee8cb260 --> efbfd7b0_5123_9628_3a67_f09b0ff9bc26
  987e3c26_efbd_02f3_cc26_86775197f7ef["langchain_text_splitters.sentence_transformers"]
  d77ad055_6529_8d51_4d45_a5dcee8cb260 --> 987e3c26_efbd_02f3_cc26_86775197f7ef
  0840293a_3f96_a163_de03_c2b3e3b176c5["langchain_text_splitters.spacy"]
  d77ad055_6529_8d51_4d45_a5dcee8cb260 --> 0840293a_3f96_a163_de03_c2b3e3b176c5
  style d77ad055_6529_8d51_4d45_a5dcee8cb260 fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

"""Kept for backwards compatibility."""

from langchain_text_splitters import (
    Language,
    RecursiveCharacterTextSplitter,
    TextSplitter,
    Tokenizer,
    TokenTextSplitter,
)
from langchain_text_splitters.base import split_text_on_tokens
from langchain_text_splitters.character import CharacterTextSplitter
from langchain_text_splitters.html import ElementType, HTMLHeaderTextSplitter
from langchain_text_splitters.json import RecursiveJsonSplitter
from langchain_text_splitters.konlpy import KonlpyTextSplitter
from langchain_text_splitters.latex import LatexTextSplitter
from langchain_text_splitters.markdown import (
    HeaderType,
    LineType,
    MarkdownHeaderTextSplitter,
    MarkdownTextSplitter,
)
from langchain_text_splitters.nltk import NLTKTextSplitter
from langchain_text_splitters.python import PythonCodeTextSplitter
from langchain_text_splitters.sentence_transformers import (
    SentenceTransformersTokenTextSplitter,
)
from langchain_text_splitters.spacy import SpacyTextSplitter

__all__ = [
    "CharacterTextSplitter",
    "ElementType",
    "HTMLHeaderTextSplitter",
    "HeaderType",
    "KonlpyTextSplitter",
    "Language",
    "LatexTextSplitter",
    "LineType",
    "MarkdownHeaderTextSplitter",
    "MarkdownTextSplitter",
    "NLTKTextSplitter",
    "PythonCodeTextSplitter",
    "RecursiveCharacterTextSplitter",
    "RecursiveJsonSplitter",
    "SentenceTransformersTokenTextSplitter",
    "SpacyTextSplitter",
    "TextSplitter",
    "TokenTextSplitter",
    "Tokenizer",
    "split_text_on_tokens",
]

Dependencies

  • langchain_text_splitters
  • langchain_text_splitters.base
  • langchain_text_splitters.character
  • langchain_text_splitters.html
  • langchain_text_splitters.json
  • langchain_text_splitters.konlpy
  • langchain_text_splitters.latex
  • langchain_text_splitters.markdown
  • langchain_text_splitters.nltk
  • langchain_text_splitters.python
  • langchain_text_splitters.sentence_transformers
  • langchain_text_splitters.spacy

Source

Frequently Asked Questions

What does text_splitter.py do?
text_splitter.py is a source file in the langchain codebase, written in python.
What does text_splitter.py depend on?
text_splitter.py imports 12 module(s): langchain_text_splitters, langchain_text_splitters.base, langchain_text_splitters.character, langchain_text_splitters.html, langchain_text_splitters.json, langchain_text_splitters.konlpy, langchain_text_splitters.latex, langchain_text_splitters.markdown, and 4 more.
Where is text_splitter.py in the architecture?
text_splitter.py is located at libs/langchain/langchain_classic/text_splitter.py (directory: libs/langchain/langchain_classic).

Analyze Your Own Codebase

Get architecture documentation, dependency graphs, and domain analysis for your codebase in minutes.

Try Supermodel Free