fake_llm_checker_chain() — langchain Function Reference

Architecture documentation for the fake_llm_checker_chain() function in test_llm_checker.py from the langchain codebase.

Function python LangChainCore Runnables

Entity Profile

LangChainCore→ Runnables→ fake_llm_checker_chain() — langchain Function Reference

Dependency Diagram

graph TD
  5904334d_5312_6d7f_c1cf_796923f0d563["fake_llm_checker_chain()"]
  c6652779_7c6d_bf04_cf9c_9c0bfee314ae["test_llm_checker.py"]
  5904334d_5312_6d7f_c1cf_796923f0d563 -->|defined in| c6652779_7c6d_bf04_cf9c_9c0bfee314ae
  style 5904334d_5312_6d7f_c1cf_796923f0d563 fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/langchain/tests/unit_tests/chains/test_llm_checker.py lines 16–42

def fake_llm_checker_chain() -> LLMCheckerChain:
    """Fake LLMCheckerChain for testing."""
    queries = {
        _CREATE_DRAFT_ANSWER_TEMPLATE.format(
            question="Which mammal lays the biggest eggs?",
        ): "I don't know which mammal layers the biggest eggs.",
        _LIST_ASSERTIONS_TEMPLATE.format(
            statement="I don't know which mammal layers the biggest eggs.",
        ): "1) I know that mammals lay eggs.\n"
        "2) I know that birds lay eggs.\n"
        "3) I know that birds are mammals.",
        _CHECK_ASSERTIONS_TEMPLATE.format(
            assertions="1) I know that mammals lay eggs.\n"
            "2) I know that birds lay eggs.\n"
            "3) I know that birds are mammals.",
        ): "1) I know that mammals lay eggs. TRUE\n"
        "2) I know that birds lay eggs. TRUE\n"
        "3) I know that birds are mammals. TRUE",
        _REVISED_ANSWER_TEMPLATE.format(
            checked_assertions="1) I know that mammals lay eggs. TRUE\n"
            "2) I know that birds lay eggs. TRUE\n"
            "3) I know that birds are mammals. TRUE",
            question="Which mammal lays the biggest eggs?",
        ): "I still don't know.",
    }
    fake_llm = FakeLLM(queries=queries)
    return LLMCheckerChain.from_llm(fake_llm, input_key="q", output_key="a")