test_adeduplication() — langchain Function Reference

Architecture documentation for the test_adeduplication() function in test_indexing.py from the langchain codebase.

Function python LangChainCore MessageInterface

Entity Profile

LangChainCore→ MessageInterface→ test_adeduplication() — langchain Function Reference

Dependency Diagram

graph TD
  4fd39cbd_a04e_e00f_ffd5_4026dc8fb04e["test_adeduplication()"]
  a9fb4c74_0865_0941_ade3_563a79762cee["test_indexing.py"]
  4fd39cbd_a04e_e00f_ffd5_4026dc8fb04e -->|defined in| a9fb4c74_0865_0941_ade3_563a79762cee
  style 4fd39cbd_a04e_e00f_ffd5_4026dc8fb04e fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/core/tests/unit_tests/indexing/test_indexing.py lines 2027–2054

async def test_adeduplication(
    arecord_manager: InMemoryRecordManager, vector_store: VectorStore
) -> None:
    """Check edge case when loader returns no new docs."""
    docs = [
        Document(
            page_content="This is a test document.",
            metadata={"source": "1"},
        ),
        Document(
            page_content="This is a test document.",
            metadata={"source": "1"},
        ),
    ]

    # Should result in only a single document being added
    assert await aindex(
        docs,
        arecord_manager,
        vector_store,
        cleanup="full",
        key_encoder="sha256",
    ) == {
        "num_added": 1,
        "num_deleted": 0,
        "num_skipped": 1,
        "num_updated": 0,
    }