langchain Architecture Docs
Home / Function/ on_llm_new_token() — langchain Function Reference

on_llm_new_token() — langchain Function Reference

Architecture documentation for the on_llm_new_token() function in streaming_aiter.py from the langchain codebase.

Function python LangChainCore MessageInterface

Entity Profile

Dependency Diagram

graph TD
  46c8df54_8402_8bb7_a034_763228861a6b["on_llm_new_token()"]
  026a405e_b843_1fc9_0384_15895a6c1500["AsyncIteratorCallbackHandler"]
  46c8df54_8402_8bb7_a034_763228861a6b -->|defined in| 026a405e_b843_1fc9_0384_15895a6c1500
  style 46c8df54_8402_8bb7_a034_763228861a6b fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/langchain/langchain_classic/callbacks/streaming_aiter.py lines 42–44

    async def on_llm_new_token(self, token: str, **kwargs: Any) -> None:
        if token is not None and token != "":
            self.queue.put_nowait(token)

Domain

Subdomains

Defined In

Source

Frequently Asked Questions

What does on_llm_new_token() do?
on_llm_new_token() is a function in the langchain codebase, defined in libs/langchain/langchain_classic/callbacks/streaming_aiter.py.
Where is on_llm_new_token() defined?
on_llm_new_token() is defined in libs/langchain/langchain_classic/callbacks/streaming_aiter.py at line 42.

Analyze Your Own Codebase

Get architecture documentation, dependency graphs, and domain analysis for your codebase in minutes.

Try Supermodel Free