abatch_iterate() — langchain Function Reference

Architecture documentation for the abatch_iterate() function in aiter.py from the langchain codebase.

Function python CoreAbstractions RunnableInterface

Entity Profile

CoreAbstractions→ RunnableInterface→ abatch_iterate() — langchain Function Reference

Dependency Diagram

graph TD
  8263a870_4149_a760_a340_b19ee1f5beca["abatch_iterate()"]
  b33566b6_8971_bdf8_5db2_dd5a13740a1f["aiter.py"]
  8263a870_4149_a760_a340_b19ee1f5beca -->|defined in| b33566b6_8971_bdf8_5db2_dd5a13740a1f
  style 8263a870_4149_a760_a340_b19ee1f5beca fill:#6366f1,stroke:#818cf8,color:#fff

Relationship Graph

Source Code

libs/core/langchain_core/utils/aiter.py lines 325–347

async def abatch_iterate(
    size: int, iterable: AsyncIterable[T]
) -> AsyncIterator[list[T]]:
    """Utility batching function for async iterables.

    Args:
        size: The size of the batch.
        iterable: The async iterable to batch.

    Yields:
        The batches.
    """
    batch: list[T] = []
    async for element in iterable:
        if len(batch) < size:
            batch.append(element)

        if len(batch) >= size:
            yield batch
            batch = []

    if batch:
        yield batch