langchain Architecture Docs
Home / Function/ test_evaluate_run() — langchain Function Reference

test_evaluate_run() — langchain Function Reference

Architecture documentation for the test_evaluate_run() function in test_string_run_evaluator.py from the langchain codebase.

Function python LangChainCore MessageInterface

Entity Profile

Dependency Diagram

graph TD
  770d4bd9_7705_eb15_d19a_96ca39e8ba5c["test_evaluate_run()"]
  83441cd0_9d98_cb1e_9a29_ac6f7cce8662["test_string_run_evaluator.py"]
  770d4bd9_7705_eb15_d19a_96ca39e8ba5c -->|defined in| 83441cd0_9d98_cb1e_9a29_ac6f7cce8662
  style 770d4bd9_7705_eb15_d19a_96ca39e8ba5c fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/langchain/tests/unit_tests/smith/evaluation/test_string_run_evaluator.py lines 13–26

def test_evaluate_run() -> None:
    run_mapper = ChainStringRunMapper()
    string_evaluator = criteria.CriteriaEvalChain.from_llm(fake_llm.FakeLLM())
    evaluator = StringRunEvaluatorChain(
        run_mapper=run_mapper,
        example_mapper=None,
        name="test_evaluator",
        string_evaluator=string_evaluator,
    )
    run = MagicMock()
    example = MagicMock()
    res = evaluator.evaluate_run(run, example)
    assert str(res.comment).startswith("Error evaluating run ")
    assert res.key == string_evaluator.evaluation_name

Domain

Subdomains

Defined In

Source

Frequently Asked Questions

What does test_evaluate_run() do?
test_evaluate_run() is a function in the langchain codebase, defined in libs/langchain/tests/unit_tests/smith/evaluation/test_string_run_evaluator.py.
Where is test_evaluate_run() defined?
test_evaluate_run() is defined in libs/langchain/tests/unit_tests/smith/evaluation/test_string_run_evaluator.py at line 13.

Analyze Your Own Codebase

Get architecture documentation, dependency graphs, and domain analysis for your codebase in minutes.

Try Supermodel Free