on_llm_new_token() — langchain Function Reference

Architecture documentation for the on_llm_new_token() function in test_fake_chat_model.py from the langchain codebase.

Function python LangChainCore LanguageModelBase called by 1

Entity Profile

LangChainCore→ LanguageModelBase→ on_llm_new_token() — langchain Function Reference

Dependency Diagram

graph TD
  bfc942da_74ef_84cf_c17e_3eb9a75e609b["on_llm_new_token()"]
  5f53f77b_adda_976c_2a8f_56c041df7972["MyCustomAsyncHandler"]
  bfc942da_74ef_84cf_c17e_3eb9a75e609b -->|defined in| 5f53f77b_adda_976c_2a8f_56c041df7972
  af4e520f_33c0_5b8c_7bf9_9b0dd5cb04b9["test_callback_handlers()"]
  af4e520f_33c0_5b8c_7bf9_9b0dd5cb04b9 -->|calls| bfc942da_74ef_84cf_c17e_3eb9a75e609b
  style bfc942da_74ef_84cf_c17e_3eb9a75e609b fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/langchain/tests/unit_tests/llms/test_fake_chat_model.py lines 174–184

        async def on_llm_new_token(
            self,
            token: str,
            *,
            chunk: GenerationChunk | ChatGenerationChunk | None = None,
            run_id: UUID,
            parent_run_id: UUID | None = None,
            tags: list[str] | None = None,
            **kwargs: Any,
        ) -> None:
            self.store.append(token)