ToolsIntegrationTests Class — langchain Architecture

Architecture documentation for the ToolsIntegrationTests class in tools.py from the langchain codebase.

Class python

Entity Profile

Dependency Diagram

graph TD
  c2851f03_a416_684d_65c5_c6a3bf9ac9c0["ToolsIntegrationTests"]
  98288f9f_1f36_11e6_3122_c061243aebd9["ToolsTests"]
  c2851f03_a416_684d_65c5_c6a3bf9ac9c0 -->|extends| 98288f9f_1f36_11e6_3122_c061243aebd9
  8c4dfa14_067a_4070_1785_0b0b4e5920ea["tools.py"]
  c2851f03_a416_684d_65c5_c6a3bf9ac9c0 -->|defined in| 8c4dfa14_067a_4070_1785_0b0b4e5920ea
  7bab2cbd_6eec_f80f_ffa2_c098c54fbc54["test_invoke_matches_output_schema()"]
  c2851f03_a416_684d_65c5_c6a3bf9ac9c0 -->|method| 7bab2cbd_6eec_f80f_ffa2_c098c54fbc54
  c6b97e0f_e9a4_dcd6_77e4_de98e2d3b32d["test_async_invoke_matches_output_schema()"]
  c2851f03_a416_684d_65c5_c6a3bf9ac9c0 -->|method| c6b97e0f_e9a4_dcd6_77e4_de98e2d3b32d
  33ebfe89_513c_94f0_f070_3c1a40d2d735["test_invoke_no_tool_call()"]
  c2851f03_a416_684d_65c5_c6a3bf9ac9c0 -->|method| 33ebfe89_513c_94f0_f070_3c1a40d2d735
  0565fd9d_4467_3c65_e13e_5fc43076343f["test_async_invoke_no_tool_call()"]
  c2851f03_a416_684d_65c5_c6a3bf9ac9c0 -->|method| 0565fd9d_4467_3c65_e13e_5fc43076343f

Relationship Graph

Source Code

libs/standard-tests/langchain_tests/integration_tests/tools.py lines 9–94

class ToolsIntegrationTests(ToolsTests):
    """Base class for tools integration tests."""

    def test_invoke_matches_output_schema(self, tool: BaseTool) -> None:
        """Test invoke matches output schema.

        If invoked with a `ToolCall`, the tool should return a valid `ToolMessage`
        content.

        If you have followed the [custom tool guide](https://docs.langchain.com/oss/python/contributing/implement-langchain#tools),
        this test should always pass because `ToolCall` inputs are handled by the
        `langchain_core.tools.BaseTool` class.

        If you have not followed this guide, you should ensure that your tool's
        `invoke` method returns a valid ToolMessage content when it receives
        a `dict` representing a `ToolCall` as input (as opposed to distinct args).
        """
        tool_call = ToolCall(
            name=tool.name,
            args=self.tool_invoke_params_example,
            id="123",
            type="tool_call",
        )
        result = tool.invoke(tool_call)

        tool_message = result
        if tool.response_format == "content_and_artifact":
            # artifact can be anything, except none
            assert tool_message.artifact is not None

        # check content is a valid ToolMessage content
        assert isinstance(tool_message.content, str | list)
        if isinstance(tool_message.content, list):
            # content blocks must be str or dict
            assert all(isinstance(c, str | dict) for c in tool_message.content)

    async def test_async_invoke_matches_output_schema(self, tool: BaseTool) -> None:
        """Test async invoke matches output schema.

        If ainvoked with a `ToolCall`, the tool should return a valid `ToolMessage`
        content.

        For debugging tips, see `test_invoke_matches_output_schema`.
        """
        tool_call = ToolCall(
            name=tool.name,
            args=self.tool_invoke_params_example,
            id="123",
            type="tool_call",
        )
        result = await tool.ainvoke(tool_call)

        tool_message = result
        if tool.response_format == "content_and_artifact":
            # artifact can be anything, except none
            assert tool_message.artifact is not None

        # check content is a valid ToolMessage content
        assert isinstance(tool_message.content, str | list)
        if isinstance(tool_message.content, list):
            # content blocks must be str or dict
            assert all(isinstance(c, str | dict) for c in tool_message.content)

    def test_invoke_no_tool_call(self, tool: BaseTool) -> None:
        """Test invoke without `ToolCall`.

        If invoked without a `ToolCall`, the tool can return anything
        but it shouldn't throw an error.

        If this test fails, your tool may not be handling the input you defined
        in `tool_invoke_params_example` correctly, and it's throwing an error.

        This test doesn't have any checks. It's just to ensure that the tool
        doesn't throw an error when invoked with a `dict` of `**kwargs`.
        """
        tool.invoke(self.tool_invoke_params_example)

    async def test_async_invoke_no_tool_call(self, tool: BaseTool) -> None:
        """Test async invoke without `ToolCall`.

        If ainvoked without a `ToolCall`, the tool can return anything