test_chat_openai_get_num_tokens() — langchain Function Reference

Architecture documentation for the test_chat_openai_get_num_tokens() function in test_token_counts.py from the langchain codebase.

Function python LangChainCore LanguageModelBase

Entity Profile

LangChainCore→ LanguageModelBase→ test_chat_openai_get_num_tokens() — langchain Function Reference

Dependency Diagram

graph TD
  bca61122_1165_1e78_a7e5_5fb588dbb506["test_chat_openai_get_num_tokens()"]
  26daf711_efc7_fab6_8231_e7726e16731b["test_token_counts.py"]
  bca61122_1165_1e78_a7e5_5fb588dbb506 -->|defined in| 26daf711_efc7_fab6_8231_e7726e16731b
  style bca61122_1165_1e78_a7e5_5fb588dbb506 fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/partners/openai/tests/unit_tests/test_token_counts.py lines 31–34

def test_chat_openai_get_num_tokens(model: str) -> None:
    """Test get_tokens."""
    llm = ChatOpenAI(model=model)
    assert llm.get_num_tokens("表情符号是\n🦜🔗") == _EXPECTED_NUM_TOKENS[model]