test_openai_get_num_tokens() — langchain Function Reference

Architecture documentation for the test_openai_get_num_tokens() function in test_token_counts.py from the langchain codebase.

Function python LangChainCore Runnables

Entity Profile

LangChainCore→ Runnables→ test_openai_get_num_tokens() — langchain Function Reference

Dependency Diagram

graph TD
  f20669be_4d3a_0094_cb5a_c81c01bea8f5["test_openai_get_num_tokens()"]
  26daf711_efc7_fab6_8231_e7726e16731b["test_token_counts.py"]
  f20669be_4d3a_0094_cb5a_c81c01bea8f5 -->|defined in| 26daf711_efc7_fab6_8231_e7726e16731b
  style f20669be_4d3a_0094_cb5a_c81c01bea8f5 fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/partners/openai/tests/unit_tests/test_token_counts.py lines 24–27

def test_openai_get_num_tokens(model: str) -> None:
    """Test get_tokens."""
    llm = OpenAI(model=model)
    assert llm.get_num_tokens("表情符号是\n🦜🔗") == _EXPECTED_NUM_TOKENS[model]