_generate_helper() — langchain Function Reference

Architecture documentation for the _generate_helper() function in llms.py from the langchain codebase.

Function python LangChainCore LanguageModelBase calls 1 called by 1

Entity Profile

LangChainCore→ LanguageModelBase→ _generate_helper() — langchain Function Reference

Dependency Diagram

graph TD
  8ed672d1_e64a_9b66_6a84_5934f70d0441["_generate_helper()"]
  ce4aa464_3868_179e_5d99_df48bc307c5f["BaseLLM"]
  8ed672d1_e64a_9b66_6a84_5934f70d0441 -->|defined in| ce4aa464_3868_179e_5d99_df48bc307c5f
  3ab24a73_7222_b6b9_1708_d227f0b8a684["generate()"]
  3ab24a73_7222_b6b9_1708_d227f0b8a684 -->|calls| 8ed672d1_e64a_9b66_6a84_5934f70d0441
  41e472cf_86b5_9da0_e470_4a679091bba9["_generate()"]
  8ed672d1_e64a_9b66_6a84_5934f70d0441 -->|calls| 41e472cf_86b5_9da0_e470_4a679091bba9
  style 8ed672d1_e64a_9b66_6a84_5934f70d0441 fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/core/langchain_core/language_models/llms.py lines 804–838

    def _generate_helper(
        self,
        prompts: list[str],
        stop: list[str] | None,
        run_managers: list[CallbackManagerForLLMRun],
        *,
        new_arg_supported: bool,
        **kwargs: Any,
    ) -> LLMResult:
        try:
            output = (
                self._generate(
                    prompts,
                    stop=stop,
                    # TODO: support multiple run managers
                    run_manager=run_managers[0] if run_managers else None,
                    **kwargs,
                )
                if new_arg_supported
                else self._generate(prompts, stop=stop)
            )
        except BaseException as e:
            for run_manager in run_managers:
                run_manager.on_llm_error(e, response=LLMResult(generations=[]))
            raise
        flattened_outputs = output.flatten()
        for manager, flattened_output in zip(
            run_managers, flattened_outputs, strict=False
        ):
            manager.on_llm_end(flattened_output)
        if run_managers:
            output.run = [
                RunInfo(run_id=run_manager.run_id) for run_manager in run_managers
            ]
        return output