loading.py — langchain Source File
Architecture documentation for loading.py, a python file in the langchain codebase. 21 imports, 0 dependents.
Entity Profile
Dependency Diagram
graph LR d2ef41dd_b6de_4c9c_d52b_51e17f41370b["loading.py"] cfe2bde5_180e_e3b0_df2b_55b3ebaca8e7["collections.abc"] d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> cfe2bde5_180e_e3b0_df2b_55b3ebaca8e7 8e2034b7_ceb8_963f_29fc_2ea6b50ef9b3["typing"] d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> 8e2034b7_ceb8_963f_29fc_2ea6b50ef9b3 ba43b74d_3099_7e1c_aac3_cf594720469e["langchain_core.language_models"] d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> ba43b74d_3099_7e1c_aac3_cf594720469e 01158a5b_b299_f45d_92e9_2a7433a1a91a["langchain_classic.chains.base"] d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> 01158a5b_b299_f45d_92e9_2a7433a1a91a fdb0acc7_cf2c_216c_3883_cb3998e5987a["langchain_classic.evaluation.agents.trajectory_eval_chain"] d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> fdb0acc7_cf2c_216c_3883_cb3998e5987a 9137ddde_1211_6098_7bf1_aa82346ddbc2["langchain_classic.evaluation.comparison"] d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> 9137ddde_1211_6098_7bf1_aa82346ddbc2 a5103541_ff31_750f_9917_fde1aac0b5a9["langchain_classic.evaluation.comparison.eval_chain"] d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> a5103541_ff31_750f_9917_fde1aac0b5a9 be300afc_e29c_5acc_fb97_ba6637c7d942["langchain_classic.evaluation.criteria.eval_chain"] d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> be300afc_e29c_5acc_fb97_ba6637c7d942 68892868_921a_e8fd_5b13_7d44caac4e60["langchain_classic.evaluation.embedding_distance.base"] d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> 68892868_921a_e8fd_5b13_7d44caac4e60 a94cdf35_05c9_9d85_1f1a_39899fc69053["langchain_classic.evaluation.exact_match.base"] d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> a94cdf35_05c9_9d85_1f1a_39899fc69053 268b8cc1_3a7e_b36a_413b_50318a2651a8["langchain_classic.evaluation.parsing.base"] d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> 268b8cc1_3a7e_b36a_413b_50318a2651a8 f721ab35_1d21_91a7_a332_319f19037e06["langchain_classic.evaluation.parsing.json_distance"] d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> f721ab35_1d21_91a7_a332_319f19037e06 336e0f65_4cf1_dbeb_891f_4af4f4a0f295["langchain_classic.evaluation.parsing.json_schema"] d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> 336e0f65_4cf1_dbeb_891f_4af4f4a0f295 99210861_db07_4ffe_7839_ae629eac4340["langchain_classic.evaluation.qa"] d2ef41dd_b6de_4c9c_d52b_51e17f41370b --> 99210861_db07_4ffe_7839_ae629eac4340 style d2ef41dd_b6de_4c9c_d52b_51e17f41370b fill:#6366f1,stroke:#818cf8,color:#fff
Relationship Graph
Source Code
"""Loading datasets and evaluators."""
from collections.abc import Sequence
from typing import Any
from langchain_core.language_models import BaseLanguageModel
from langchain_classic.chains.base import Chain
from langchain_classic.evaluation.agents.trajectory_eval_chain import (
TrajectoryEvalChain,
)
from langchain_classic.evaluation.comparison import PairwiseStringEvalChain
from langchain_classic.evaluation.comparison.eval_chain import (
LabeledPairwiseStringEvalChain,
)
from langchain_classic.evaluation.criteria.eval_chain import (
CriteriaEvalChain,
LabeledCriteriaEvalChain,
)
from langchain_classic.evaluation.embedding_distance.base import (
EmbeddingDistanceEvalChain,
PairwiseEmbeddingDistanceEvalChain,
)
from langchain_classic.evaluation.exact_match.base import ExactMatchStringEvaluator
from langchain_classic.evaluation.parsing.base import (
JsonEqualityEvaluator,
JsonValidityEvaluator,
)
from langchain_classic.evaluation.parsing.json_distance import JsonEditDistanceEvaluator
from langchain_classic.evaluation.parsing.json_schema import JsonSchemaEvaluator
from langchain_classic.evaluation.qa import (
ContextQAEvalChain,
CotQAEvalChain,
QAEvalChain,
)
from langchain_classic.evaluation.regex_match.base import RegexMatchStringEvaluator
from langchain_classic.evaluation.schema import (
EvaluatorType,
LLMEvalChain,
StringEvaluator,
)
from langchain_classic.evaluation.scoring.eval_chain import (
LabeledScoreStringEvalChain,
ScoreStringEvalChain,
)
from langchain_classic.evaluation.string_distance.base import (
PairwiseStringDistanceEvalChain,
StringDistanceEvalChain,
)
def load_dataset(uri: str) -> list[dict]:
"""Load a dataset from the [LangChainDatasets on HuggingFace](https://huggingface.co/LangChainDatasets).
Args:
uri: The uri of the dataset to load.
Returns:
A list of dictionaries, each representing a row in the dataset.
// ... (160 more lines)
Domain
Subdomains
Dependencies
- collections.abc
- datasets
- langchain_classic.chains.base
- langchain_classic.evaluation.agents.trajectory_eval_chain
- langchain_classic.evaluation.comparison
- langchain_classic.evaluation.comparison.eval_chain
- langchain_classic.evaluation.criteria.eval_chain
- langchain_classic.evaluation.embedding_distance.base
- langchain_classic.evaluation.exact_match.base
- langchain_classic.evaluation.parsing.base
- langchain_classic.evaluation.parsing.json_distance
- langchain_classic.evaluation.parsing.json_schema
- langchain_classic.evaluation.qa
- langchain_classic.evaluation.regex_match.base
- langchain_classic.evaluation.schema
- langchain_classic.evaluation.scoring.eval_chain
- langchain_classic.evaluation.string_distance.base
- langchain_community.chat_models.openai
- langchain_core.language_models
- langchain_openai
- typing
Source
Frequently Asked Questions
What does loading.py do?
loading.py is a source file in the langchain codebase, written in python. It belongs to the CoreAbstractions domain, Serialization subdomain.
What functions are defined in loading.py?
loading.py defines 3 function(s): load_dataset, load_evaluator, load_evaluators.
What does loading.py depend on?
loading.py imports 21 module(s): collections.abc, datasets, langchain_classic.chains.base, langchain_classic.evaluation.agents.trajectory_eval_chain, langchain_classic.evaluation.comparison, langchain_classic.evaluation.comparison.eval_chain, langchain_classic.evaluation.criteria.eval_chain, langchain_classic.evaluation.embedding_distance.base, and 13 more.
Where is loading.py in the architecture?
loading.py is located at libs/langchain/langchain_classic/evaluation/loading.py (domain: CoreAbstractions, subdomain: Serialization, directory: libs/langchain/langchain_classic/evaluation).
Analyze Your Own Codebase
Get architecture documentation, dependency graphs, and domain analysis for your codebase in minutes.
Try Supermodel Free