Home / Function/ generate_from_stream() — langchain Function Reference

generate_from_stream() — langchain Function Reference

Architecture documentation for the generate_from_stream() function in chat_models.py from the langchain codebase.

Entity Profile

Dependency Diagram

graph TD
  c17d81b4_b688_fefe_8223_a5273a015f2b["generate_from_stream()"]
  20f4116a_d26d_2a5f_4a10_67af6940e081["chat_models.py"]
  c17d81b4_b688_fefe_8223_a5273a015f2b -->|defined in| 20f4116a_d26d_2a5f_4a10_67af6940e081
  c75ce290_1863_e639_39d8_1d5eede2b115["_generate_with_cache()"]
  c75ce290_1863_e639_39d8_1d5eede2b115 -->|calls| c17d81b4_b688_fefe_8223_a5273a015f2b
  1444b9d3_5ad9_5b23_967b_eb8224746e4f["_agenerate_with_cache()"]
  1444b9d3_5ad9_5b23_967b_eb8224746e4f -->|calls| c17d81b4_b688_fefe_8223_a5273a015f2b
  style c17d81b4_b688_fefe_8223_a5273a015f2b fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/core/langchain_core/language_models/chat_models.py lines 182–208

def generate_from_stream(stream: Iterator[ChatGenerationChunk]) -> ChatResult:
    """Generate from a stream.

    Args:
        stream: Iterator of `ChatGenerationChunk`.

    Raises:
        ValueError: If no generations are found in the stream.

    Returns:
        Chat result.

    """
    generation = next(stream, None)
    if generation:
        generation += list(stream)
    if generation is None:
        msg = "No generations found in stream."
        raise ValueError(msg)
    return ChatResult(
        generations=[
            ChatGeneration(
                message=message_chunk_to_message(generation.message),
                generation_info=generation.generation_info,
            )
        ]
    )

Subdomains

Frequently Asked Questions

What does generate_from_stream() do?
generate_from_stream() is a function in the langchain codebase, defined in libs/core/langchain_core/language_models/chat_models.py.
Where is generate_from_stream() defined?
generate_from_stream() is defined in libs/core/langchain_core/language_models/chat_models.py at line 182.
What calls generate_from_stream()?
generate_from_stream() is called by 2 function(s): _agenerate_with_cache, _generate_with_cache.

Analyze Your Own Codebase

Get architecture documentation, dependency graphs, and domain analysis for your codebase in minutes.

Try Supermodel Free