_determine_reference_key() — langchain Function Reference

Architecture documentation for the _determine_reference_key() function in runner_utils.py from the langchain codebase.

Function python LangChainCore Runnables called by 1

Entity Profile

LangChainCore→ Runnables→ _determine_reference_key() — langchain Function Reference

Dependency Diagram

graph TD
  158765b7_ac8a_8d5b_a33b_b569242a324c["_determine_reference_key()"]
  8253c602_7d0c_9195_a7e1_3e9b19304131["runner_utils.py"]
  158765b7_ac8a_8d5b_a33b_b569242a324c -->|defined in| 8253c602_7d0c_9195_a7e1_3e9b19304131
  a089196b_8c1b_51e2_42d9_a8bd76f8a276["_get_keys()"]
  a089196b_8c1b_51e2_42d9_a8bd76f8a276 -->|calls| 158765b7_ac8a_8d5b_a33b_b569242a324c
  style 158765b7_ac8a_8d5b_a33b_b569242a324c fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/langchain/langchain_classic/smith/evaluation/runner_utils.py lines 524–540

def _determine_reference_key(
    config: smith_eval.RunEvalConfig,
    example_outputs: list[str] | None,
) -> str | None:
    if config.reference_key:
        reference_key = config.reference_key
        if example_outputs and reference_key not in example_outputs:
            msg = (
                f"Reference key {reference_key} not in Dataset"
                f" example outputs: {example_outputs}"
            )
            raise ValueError(msg)
    elif example_outputs and len(example_outputs) == 1:
        reference_key = next(iter(example_outputs))
    else:
        reference_key = None
    return reference_key