on_llm_new_token() — langchain Function Reference

Architecture documentation for the on_llm_new_token() function in test_async_callbacks.py from the langchain codebase.

Function python LangChainCore ApiManagement

Entity Profile

LangChainCore→ ApiManagement→ on_llm_new_token() — langchain Function Reference

Dependency Diagram

graph TD
  fe20e017_8f46_e9e2_7b92_156ad8f09790["on_llm_new_token()"]
  48f040a3_2205_5d5a_3161_82a327c126cf["MyCustomAsyncHandler"]
  fe20e017_8f46_e9e2_7b92_156ad8f09790 -->|defined in| 48f040a3_2205_5d5a_3161_82a327c126cf
  style fe20e017_8f46_e9e2_7b92_156ad8f09790 fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/core/tests/benchmarks/test_async_callbacks.py lines 34–44

    async def on_llm_new_token(
        self,
        token: str,
        *,
        chunk: GenerationChunk | ChatGenerationChunk | None = None,
        run_id: UUID,
        parent_run_id: UUID | None = None,
        tags: list[str] | None = None,
        **kwargs: Any,
    ) -> None:
        await asyncio.sleep(0)