on_llm_new_token() — langchain Function Reference

Architecture documentation for the on_llm_new_token() function in test_fake_chat_model.py from the langchain codebase.

Function python LangChainCore LanguageModelBase called by 1

Entity Profile

LangChainCore→ LanguageModelBase→ on_llm_new_token() — langchain Function Reference

Dependency Diagram

graph TD
  2e077bb1_7a76_7fbc_b1df_bf6903ae16e1["on_llm_new_token()"]
  62e5cd38_3cf4_f6dc_d24f_67d0946e71d5["MyCustomAsyncHandler"]
  2e077bb1_7a76_7fbc_b1df_bf6903ae16e1 -->|defined in| 62e5cd38_3cf4_f6dc_d24f_67d0946e71d5
  14e65869_1f28_9025_bab4_7fa0e4fc9440["test_callback_handlers()"]
  14e65869_1f28_9025_bab4_7fa0e4fc9440 -->|calls| 2e077bb1_7a76_7fbc_b1df_bf6903ae16e1
  style 2e077bb1_7a76_7fbc_b1df_bf6903ae16e1 fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/core/tests/unit_tests/fake/test_fake_chat_model.py lines 183–193

        async def on_llm_new_token(
            self,
            token: str,
            *,
            chunk: GenerationChunk | ChatGenerationChunk | None = None,
            run_id: UUID,
            parent_run_id: UUID | None = None,
            tags: list[str] | None = None,
            **kwargs: Any,
        ) -> None:
            self.store.append(token)