Home / File/ loading.py — langchain Source File

loading.py — langchain Source File

Architecture documentation for loading.py, a python file in the langchain codebase. 21 imports, 0 dependents.

File python CoreAbstractions Serialization 21 imports 3 functions

Entity Profile

Dependency Diagram

graph LR
  d2ef41dd_b6de_4c9c_d52b_51e17f41370b["loading.py"]
  cfe2bde5_180e_e3b0_df2b_55b3ebaca8e7["collections.abc"]
  d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> cfe2bde5_180e_e3b0_df2b_55b3ebaca8e7
  8e2034b7_ceb8_963f_29fc_2ea6b50ef9b3["typing"]
  d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> 8e2034b7_ceb8_963f_29fc_2ea6b50ef9b3
  ba43b74d_3099_7e1c_aac3_cf594720469e["langchain_core.language_models"]
  d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> ba43b74d_3099_7e1c_aac3_cf594720469e
  01158a5b_b299_f45d_92e9_2a7433a1a91a["langchain_classic.chains.base"]
  d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> 01158a5b_b299_f45d_92e9_2a7433a1a91a
  fdb0acc7_cf2c_216c_3883_cb3998e5987a["langchain_classic.evaluation.agents.trajectory_eval_chain"]
  d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> fdb0acc7_cf2c_216c_3883_cb3998e5987a
  9137ddde_1211_6098_7bf1_aa82346ddbc2["langchain_classic.evaluation.comparison"]
  d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> 9137ddde_1211_6098_7bf1_aa82346ddbc2
  a5103541_ff31_750f_9917_fde1aac0b5a9["langchain_classic.evaluation.comparison.eval_chain"]
  d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> a5103541_ff31_750f_9917_fde1aac0b5a9
  be300afc_e29c_5acc_fb97_ba6637c7d942["langchain_classic.evaluation.criteria.eval_chain"]
  d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> be300afc_e29c_5acc_fb97_ba6637c7d942
  68892868_921a_e8fd_5b13_7d44caac4e60["langchain_classic.evaluation.embedding_distance.base"]
  d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> 68892868_921a_e8fd_5b13_7d44caac4e60
  a94cdf35_05c9_9d85_1f1a_39899fc69053["langchain_classic.evaluation.exact_match.base"]
  d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> a94cdf35_05c9_9d85_1f1a_39899fc69053
  268b8cc1_3a7e_b36a_413b_50318a2651a8["langchain_classic.evaluation.parsing.base"]
  d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> 268b8cc1_3a7e_b36a_413b_50318a2651a8
  f721ab35_1d21_91a7_a332_319f19037e06["langchain_classic.evaluation.parsing.json_distance"]
  d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> f721ab35_1d21_91a7_a332_319f19037e06
  336e0f65_4cf1_dbeb_891f_4af4f4a0f295["langchain_classic.evaluation.parsing.json_schema"]
  d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> 336e0f65_4cf1_dbeb_891f_4af4f4a0f295
  99210861_db07_4ffe_7839_ae629eac4340["langchain_classic.evaluation.qa"]
  d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> 99210861_db07_4ffe_7839_ae629eac4340
  style d2ef41dd_b6de_4c9c_d52b_51e17f41370b fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

"""Loading datasets and evaluators."""

from collections.abc import Sequence
from typing import Any

from langchain_core.language_models import BaseLanguageModel

from langchain_classic.chains.base import Chain
from langchain_classic.evaluation.agents.trajectory_eval_chain import (
    TrajectoryEvalChain,
)
from langchain_classic.evaluation.comparison import PairwiseStringEvalChain
from langchain_classic.evaluation.comparison.eval_chain import (
    LabeledPairwiseStringEvalChain,
)
from langchain_classic.evaluation.criteria.eval_chain import (
    CriteriaEvalChain,
    LabeledCriteriaEvalChain,
)
from langchain_classic.evaluation.embedding_distance.base import (
    EmbeddingDistanceEvalChain,
    PairwiseEmbeddingDistanceEvalChain,
)
from langchain_classic.evaluation.exact_match.base import ExactMatchStringEvaluator
from langchain_classic.evaluation.parsing.base import (
    JsonEqualityEvaluator,
    JsonValidityEvaluator,
)
from langchain_classic.evaluation.parsing.json_distance import JsonEditDistanceEvaluator
from langchain_classic.evaluation.parsing.json_schema import JsonSchemaEvaluator
from langchain_classic.evaluation.qa import (
    ContextQAEvalChain,
    CotQAEvalChain,
    QAEvalChain,
)
from langchain_classic.evaluation.regex_match.base import RegexMatchStringEvaluator
from langchain_classic.evaluation.schema import (
    EvaluatorType,
    LLMEvalChain,
    StringEvaluator,
)
from langchain_classic.evaluation.scoring.eval_chain import (
    LabeledScoreStringEvalChain,
    ScoreStringEvalChain,
)
from langchain_classic.evaluation.string_distance.base import (
    PairwiseStringDistanceEvalChain,
    StringDistanceEvalChain,
)


def load_dataset(uri: str) -> list[dict]:
    """Load a dataset from the [LangChainDatasets on HuggingFace](https://huggingface.co/LangChainDatasets).

    Args:
        uri: The uri of the dataset to load.

    Returns:
        A list of dictionaries, each representing a row in the dataset.

// ... (160 more lines)

Subdomains

Dependencies

  • collections.abc
  • datasets
  • langchain_classic.chains.base
  • langchain_classic.evaluation.agents.trajectory_eval_chain
  • langchain_classic.evaluation.comparison
  • langchain_classic.evaluation.comparison.eval_chain
  • langchain_classic.evaluation.criteria.eval_chain
  • langchain_classic.evaluation.embedding_distance.base
  • langchain_classic.evaluation.exact_match.base
  • langchain_classic.evaluation.parsing.base
  • langchain_classic.evaluation.parsing.json_distance
  • langchain_classic.evaluation.parsing.json_schema
  • langchain_classic.evaluation.qa
  • langchain_classic.evaluation.regex_match.base
  • langchain_classic.evaluation.schema
  • langchain_classic.evaluation.scoring.eval_chain
  • langchain_classic.evaluation.string_distance.base
  • langchain_community.chat_models.openai
  • langchain_core.language_models
  • langchain_openai
  • typing

Frequently Asked Questions

What does loading.py do?
loading.py is a source file in the langchain codebase, written in python. It belongs to the CoreAbstractions domain, Serialization subdomain.
What functions are defined in loading.py?
loading.py defines 3 function(s): load_dataset, load_evaluator, load_evaluators.
What does loading.py depend on?
loading.py imports 21 module(s): collections.abc, datasets, langchain_classic.chains.base, langchain_classic.evaluation.agents.trajectory_eval_chain, langchain_classic.evaluation.comparison, langchain_classic.evaluation.comparison.eval_chain, langchain_classic.evaluation.criteria.eval_chain, langchain_classic.evaluation.embedding_distance.base, and 13 more.
Where is loading.py in the architecture?
loading.py is located at libs/langchain/langchain_classic/evaluation/loading.py (domain: CoreAbstractions, subdomain: Serialization, directory: libs/langchain/langchain_classic/evaluation).

Analyze Your Own Codebase

Get architecture documentation, dependency graphs, and domain analysis for your codebase in minutes.

Try Supermodel Free