test_count_tokens_approximately_with_names() — langchain Function Reference

Architecture documentation for the test_count_tokens_approximately_with_names() function in test_utils.py from the langchain codebase.

Function python CoreAbstractions MessageSchema

Entity Profile

CoreAbstractions→ MessageSchema→ test_count_tokens_approximately_with_names() — langchain Function Reference

Dependency Diagram

graph TD
  12c995a4_ef97_cb1b_0844_2501a8edcd7f["test_count_tokens_approximately_with_names()"]
  ea3f8d89_f44b_6738_3cb9_a740a73cfca4["test_utils.py"]
  12c995a4_ef97_cb1b_0844_2501a8edcd7f -->|defined in| ea3f8d89_f44b_6738_3cb9_a740a73cfca4
  style 12c995a4_ef97_cb1b_0844_2501a8edcd7f fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/core/tests/unit_tests/messages/test_utils.py lines 1481–1495

def test_count_tokens_approximately_with_names() -> None:
    messages = [
        # 5 chars + 4 role chars -> 3 + 3 = 6 tokens
        # (with name: extra 4 name chars, so total = 4 + 3 = 7 tokens)
        HumanMessage(content="Hello", name="user"),
        # 8 chars + 9 role chars -> 5 + 3 = 8 tokens
        # (with name: extra 9 name chars, so total = 7 + 3 = 10 tokens)
        AIMessage(content="Hi there", name="assistant"),
    ]
    # With names included (default)
    assert count_tokens_approximately(messages) == 17

    # Without names
    without_names = count_tokens_approximately(messages, count_name=False)
    assert without_names == 14