test_adeduplication() — langchain Function Reference

Architecture documentation for the test_adeduplication() function in test_indexing.py from the langchain codebase.

Function python LangChainCore Runnables

Entity Profile

LangChainCore→ Runnables→ test_adeduplication() — langchain Function Reference

Dependency Diagram

graph TD
  9b20357b_6898_c334_ad49_a8974f2e5fc1["test_adeduplication()"]
  9bc4e8b6_769a_ae11_3fc1_309cb678c248["test_indexing.py"]
  9b20357b_6898_c334_ad49_a8974f2e5fc1 -->|defined in| 9bc4e8b6_769a_ae11_3fc1_309cb678c248
  style 9b20357b_6898_c334_ad49_a8974f2e5fc1 fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/langchain/tests/unit_tests/indexes/test_indexing.py lines 1200–1222

async def test_adeduplication(
    arecord_manager: SQLRecordManager,
    vector_store: VectorStore,
) -> None:
    """Check edge case when loader returns no new docs."""
    docs = [
        Document(
            page_content="This is a test document.",
            metadata={"source": "1"},
        ),
        Document(
            page_content="This is a test document.",
            metadata={"source": "1"},
        ),
    ]

    # Should result in only a single document being added
    assert await aindex(docs, arecord_manager, vector_store, cleanup="full") == {
        "num_added": 1,
        "num_deleted": 0,
        "num_skipped": 1,
        "num_updated": 0,
    }