langchain Architecture Docs
Home / Function/ _initialize_chunk_configuration() — langchain Function Reference

_initialize_chunk_configuration() — langchain Function Reference

Architecture documentation for the _initialize_chunk_configuration() function in sentence_transformers.py from the langchain codebase.

Function python DataProcessing TextSplitters calls 1 called by 2

Entity Profile

Dependency Diagram

graph TD
  ebb3da73_ad87_a7f9_f2f7_2d72a26cbf90["_initialize_chunk_configuration()"]
  e67e8512_91e2_e59f_208a_86a9aef296a7["SentenceTransformersTokenTextSplitter"]
  ebb3da73_ad87_a7f9_f2f7_2d72a26cbf90 -->|defined in| e67e8512_91e2_e59f_208a_86a9aef296a7
  967804df_0a20_11c7_b284_11c972adc069["__init__()"]
  967804df_0a20_11c7_b284_11c972adc069 -->|calls| ebb3da73_ad87_a7f9_f2f7_2d72a26cbf90
  ebb3da73_ad87_a7f9_f2f7_2d72a26cbf90["_initialize_chunk_configuration()"]
  ebb3da73_ad87_a7f9_f2f7_2d72a26cbf90 -->|calls| ebb3da73_ad87_a7f9_f2f7_2d72a26cbf90
  ebb3da73_ad87_a7f9_f2f7_2d72a26cbf90["_initialize_chunk_configuration()"]
  ebb3da73_ad87_a7f9_f2f7_2d72a26cbf90 -->|calls| ebb3da73_ad87_a7f9_f2f7_2d72a26cbf90
  style ebb3da73_ad87_a7f9_f2f7_2d72a26cbf90 fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/text-splitters/langchain_text_splitters/sentence_transformers.py lines 57–72

    def _initialize_chunk_configuration(self, *, tokens_per_chunk: int | None) -> None:
        self.maximum_tokens_per_chunk = self._model.max_seq_length

        if tokens_per_chunk is None:
            self.tokens_per_chunk = self.maximum_tokens_per_chunk
        else:
            self.tokens_per_chunk = tokens_per_chunk

        if self.tokens_per_chunk > self.maximum_tokens_per_chunk:
            msg = (
                f"The token limit of the models '{self.model_name}'"
                f" is: {self.maximum_tokens_per_chunk}."
                f" Argument tokens_per_chunk={self.tokens_per_chunk}"
                f" > maximum token limit."
            )
            raise ValueError(msg)

Domain

Subdomains

Defined In

Calls

Called By

Source

Frequently Asked Questions

What does _initialize_chunk_configuration() do?
_initialize_chunk_configuration() is a function in the langchain codebase, defined in libs/text-splitters/langchain_text_splitters/sentence_transformers.py.
Where is _initialize_chunk_configuration() defined?
_initialize_chunk_configuration() is defined in libs/text-splitters/langchain_text_splitters/sentence_transformers.py at line 57.
What does _initialize_chunk_configuration() call?
_initialize_chunk_configuration() calls 1 function(s): _initialize_chunk_configuration.
What calls _initialize_chunk_configuration()?
_initialize_chunk_configuration() is called by 2 function(s): __init__, _initialize_chunk_configuration.

Analyze Your Own Codebase

Get architecture documentation, dependency graphs, and domain analysis for your codebase in minutes.

Try Supermodel Free