get_num_tokens() — langchain Function Reference

Architecture documentation for the get_num_tokens() function in llms.py from the langchain codebase.

Function python LangChainCore LanguageModelBase

Entity Profile

LangChainCore→ LanguageModelBase→ get_num_tokens() — langchain Function Reference

Dependency Diagram

graph TD
  f22814ab_3e23_f25b_63ba_713076c3395e["get_num_tokens()"]
  c95a497f_938f_2be9_842e_087a0766cf00["AnthropicLLM"]
  f22814ab_3e23_f25b_63ba_713076c3395e -->|defined in| c95a497f_938f_2be9_842e_087a0766cf00
  style f22814ab_3e23_f25b_63ba_713076c3395e fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/partners/anthropic/langchain_anthropic/llms.py lines 424–433

    def get_num_tokens(self, text: str) -> int:
        """Calculate number of tokens."""
        msg = (
            "Anthropic's legacy count_tokens method was removed in anthropic 0.39.0 "
            "and langchain-anthropic 0.3.0. Please use "
            "ChatAnthropic.get_num_tokens_from_messages instead."
        )
        raise NotImplementedError(
            msg,
        )