test_recursive_character_text_splitter_keep_separators() — langchain Function Reference
Architecture documentation for the test_recursive_character_text_splitter_keep_separators() function in test_text_splitters.py from the langchain codebase.
Entity Profile
Dependency Diagram
graph TD 3a5274e7_e907_7aa3_f0ce_3151e4adc498["test_recursive_character_text_splitter_keep_separators()"] 6d6b8ad4_1cfe_fbb0_e58e_76a50487c135["test_text_splitters.py"] 3a5274e7_e907_7aa3_f0ce_3151e4adc498 -->|defined in| 6d6b8ad4_1cfe_fbb0_e58e_76a50487c135 style 3a5274e7_e907_7aa3_f0ce_3151e4adc498 fill:#6366f1,stroke:#818cf8,color:#fff
Relationship Graph
Source Code
libs/text-splitters/tests/unit_tests/test_text_splitters.py lines 242–263
def test_recursive_character_text_splitter_keep_separators() -> None:
split_tags = [",", "."]
query = "Apple,banana,orange and tomato."
# start
splitter = RecursiveCharacterTextSplitter(
chunk_size=10,
chunk_overlap=0,
separators=split_tags,
keep_separator="start",
)
result = splitter.split_text(query)
assert result == ["Apple", ",banana", ",orange and tomato", "."]
# end
splitter = RecursiveCharacterTextSplitter(
chunk_size=10,
chunk_overlap=0,
separators=split_tags,
keep_separator="end",
)
result = splitter.split_text(query)
assert result == ["Apple,", "banana,", "orange and tomato."]
Domain
Subdomains
Source
Frequently Asked Questions
What does test_recursive_character_text_splitter_keep_separators() do?
test_recursive_character_text_splitter_keep_separators() is a function in the langchain codebase, defined in libs/text-splitters/tests/unit_tests/test_text_splitters.py.
Where is test_recursive_character_text_splitter_keep_separators() defined?
test_recursive_character_text_splitter_keep_separators() is defined in libs/text-splitters/tests/unit_tests/test_text_splitters.py at line 242.
Analyze Your Own Codebase
Get architecture documentation, dependency graphs, and domain analysis for your codebase in minutes.
Try Supermodel Free