_generate() — langchain Function Reference

Architecture documentation for the _generate() function in llms.py from the langchain codebase.

Function python LangChainCore LanguageModelBase calls 1 called by 2

Entity Profile

LangChainCore→ LanguageModelBase→ _generate() — langchain Function Reference

Dependency Diagram

graph TD
  41e472cf_86b5_9da0_e470_4a679091bba9["_generate()"]
  ce4aa464_3868_179e_5d99_df48bc307c5f["BaseLLM"]
  41e472cf_86b5_9da0_e470_4a679091bba9 -->|defined in| ce4aa464_3868_179e_5d99_df48bc307c5f
  8ed672d1_e64a_9b66_6a84_5934f70d0441["_generate_helper()"]
  8ed672d1_e64a_9b66_6a84_5934f70d0441 -->|calls| 41e472cf_86b5_9da0_e470_4a679091bba9
  1958c025_da10_4021_3597_57eb74b3eae7["_generate()"]
  1958c025_da10_4021_3597_57eb74b3eae7 -->|calls| 41e472cf_86b5_9da0_e470_4a679091bba9
  1958c025_da10_4021_3597_57eb74b3eae7["_generate()"]
  41e472cf_86b5_9da0_e470_4a679091bba9 -->|calls| 1958c025_da10_4021_3597_57eb74b3eae7
  style 41e472cf_86b5_9da0_e470_4a679091bba9 fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/core/langchain_core/language_models/llms.py lines 648–669

    def _generate(
        self,
        prompts: list[str],
        stop: list[str] | None = None,
        run_manager: CallbackManagerForLLMRun | None = None,
        **kwargs: Any,
    ) -> LLMResult:
        """Run the LLM on the given prompts.

        Args:
            prompts: The prompts to generate from.
            stop: Stop words to use when generating.

                Model output is cut off at the first occurrence of any of these
                substrings.

                If stop tokens are not supported consider raising `NotImplementedError`.
            run_manager: Callback manager for the run.

        Returns:
            The LLM result.
        """