LabeledCriteria Class — langchain Architecture

Architecture documentation for the LabeledCriteria class in config.py from the langchain codebase.

Class python

Entity Profile

Dependency Diagram

graph TD
  30587491_6def_80ae_fae0_9843bbf7f7fa["LabeledCriteria"]
  5528a09f_3682_a8b0_958b_cd9a898b6e3c["SingleKeyEvalConfig"]
  30587491_6def_80ae_fae0_9843bbf7f7fa -->|extends| 5528a09f_3682_a8b0_958b_cd9a898b6e3c
  ba7f9415_541a_d99f_0400_a688a10212b0["config.py"]
  30587491_6def_80ae_fae0_9843bbf7f7fa -->|defined in| ba7f9415_541a_d99f_0400_a688a10212b0

Relationship Graph

Source Code

libs/langchain/langchain_classic/smith/evaluation/config.py lines 135–145

    class LabeledCriteria(SingleKeyEvalConfig):
        """Configuration for a labeled (with references) criteria evaluator.

        Attributes:
            criteria: The criteria to evaluate.
            llm: The language model to use for the evaluation chain.
        """

        criteria: CRITERIA_TYPE | None = None
        llm: BaseLanguageModel | None = None
        evaluator_type: EvaluatorType = EvaluatorType.LABELED_CRITERIA