_aevaluate_strings() — langchain Function Reference

Architecture documentation for the _aevaluate_strings() function in eval_chain.py from the langchain codebase.

Function python LangChainCore Runnables calls 2 called by 1

Entity Profile

LangChainCore→ Runnables→ _aevaluate_strings() — langchain Function Reference

Dependency Diagram

graph TD
  0279c918_e577_ce74_974d_bdaf572cb688["_aevaluate_strings()"]
  cb20f5c6_80c7_fbed_b351_e0b3c9587d96["QAEvalChain"]
  0279c918_e577_ce74_974d_bdaf572cb688 -->|defined in| cb20f5c6_80c7_fbed_b351_e0b3c9587d96
  7a5c12d7_b3b4_1088_a716_41cad10390dc["_aevaluate_strings()"]
  7a5c12d7_b3b4_1088_a716_41cad10390dc -->|calls| 0279c918_e577_ce74_974d_bdaf572cb688
  c8ae767c_58c1_d764_8793_0d3dfcb69a27["_prepare_output()"]
  0279c918_e577_ce74_974d_bdaf572cb688 -->|calls| c8ae767c_58c1_d764_8793_0d3dfcb69a27
  7a5c12d7_b3b4_1088_a716_41cad10390dc["_aevaluate_strings()"]
  0279c918_e577_ce74_974d_bdaf572cb688 -->|calls| 7a5c12d7_b3b4_1088_a716_41cad10390dc
  style 0279c918_e577_ce74_974d_bdaf572cb688 fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/langchain/langchain_classic/evaluation/qa/eval_chain.py lines 201–216

    async def _aevaluate_strings(
        self,
        *,
        prediction: str,
        reference: str | None = None,
        input: str | None = None,
        callbacks: Callbacks = None,
        include_run_info: bool = False,
        **kwargs: Any,
    ) -> dict:
        result = await self.acall(
            inputs={"query": input, "answer": reference, "result": prediction},
            callbacks=callbacks,
            include_run_info=include_run_info,
        )
        return self._prepare_output(result)