parse() — langchain Function Reference

Architecture documentation for the parse() function in eval_chain.py from the langchain codebase.

Function python LangChainCore Runnables

Entity Profile

LangChainCore→ Runnables→ parse() — langchain Function Reference

Dependency Diagram

graph TD
  cad0954e_480f_0aad_2b15_e02453b8c257["parse()"]
  3f3ed158_53c1_18b9_92a1_d9692000f02d["PairwiseStringResultOutputParser"]
  cad0954e_480f_0aad_2b15_e02453b8c257 -->|defined in| 3f3ed158_53c1_18b9_92a1_d9692000f02d
  style cad0954e_480f_0aad_2b15_e02453b8c257 fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/langchain/langchain_classic/evaluation/comparison/eval_chain.py lines 117–153

    def parse(self, text: str) -> dict[str, Any]:
        """Parse the output text.

        Args:
            text: The output text to parse.

        Returns:
            The parsed output.

        Raises:
            ValueError: If the verdict is invalid.

        """
        match = _FIND_DOUBLE_BRACKETS.search(text)

        if match:
            verdict = match.group(1)

        if not match or verdict not in {"A", "B", "C"}:
            msg = (
                f"Invalid output: {text}. "
                "Output must contain a double bracketed string\
                 with the verdict 'A', 'B', or 'C'."
            )
            raise ValueError(msg)
        # C means the models are tied. Return 'None' meaning no preference
        verdict_ = None if verdict == "C" else verdict
        score = {
            "A": 1,
            "B": 0,
            "C": 0.5,
        }[verdict]
        return {
            "reasoning": text,
            "value": verdict_,
            "score": score,
        }