aevaluate_run() — langchain Function Reference

Architecture documentation for the aevaluate_run() function in string_run_evaluator.py from the langchain codebase.

Function python LangChainCore Runnables calls 1

Entity Profile

LangChainCore→ Runnables→ aevaluate_run() — langchain Function Reference

Dependency Diagram

graph TD
  06d50400_ec91_85cb_b31e_efcbb4a95671["aevaluate_run()"]
  96e174c1_4107_a88b_8d98_3f22e5d7fb20["StringRunEvaluatorChain"]
  06d50400_ec91_85cb_b31e_efcbb4a95671 -->|defined in| 96e174c1_4107_a88b_8d98_3f22e5d7fb20
  2029cd8d_b9d5_3985_a052_b3b4c7b21157["_prepare_evaluator_output()"]
  06d50400_ec91_85cb_b31e_efcbb4a95671 -->|calls| 2029cd8d_b9d5_3985_a052_b3b4c7b21157
  style 06d50400_ec91_85cb_b31e_efcbb4a95671 fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/langchain/langchain_classic/smith/evaluation/string_run_evaluator.py lines 385–403

    async def aevaluate_run(
        self,
        run: Run,
        example: Example | None = None,
        evaluator_run_id: uuid.UUID | None = None,
    ) -> EvaluationResult:
        """Evaluate an example."""
        try:
            result = await self.acall(
                {"run": run, "example": example},
                include_run_info=True,
            )
            return self._prepare_evaluator_output(result)
        except Exception as e:
            _logger.exception("Error evaluating run %s", run.id)
            return EvaluationResult(
                key=self.string_evaluator.evaluation_name,
                comment=f"Error evaluating run {run.id}: {e}",
            )