如何使用 ToolNode 调用工具¶

本指南介绍如何使用 LangGraph 的预构建 ToolNode 进行工具调用。

ToolNode 是一个 LangChain 可运行程序，它以图状态（包含消息列表）作为输入，并输出包含工具调用结果的状态更新。它设计为与 LangGraph 的预构建 ReAct 代理 开箱即用，但只要其状态具有 messages 键和相应的 reducer（请参见 MessagesState），它也可以与任何 StateGraph 一起使用。

设置¶

首先，让我们安装所需的软件包并设置我们的 API 密钥

在 [1]

%%capture --no-stderr
%pip install --quiet -U langgraph langchain_anthropic

%%capture --no-stderr %pip install --quiet -U langgraph langchain_anthropic

在 [ ]

import getpass
import os


def _set_env(var: str):
    if not os.environ.get(var):
        os.environ[var] = getpass.getpass(f"{var}: ")


_set_env("ANTHROPIC_API_KEY")

import getpass import os def _set_env(var: str): if not os.environ.get(var): os.environ[var] = getpass.getpass(f"{var}: ") _set_env("ANTHROPIC_API_KEY")

为 LangGraph 开发设置 LangSmith

注册 LangSmith 以快速发现问题并提高 LangGraph 项目的性能。LangSmith 允许您使用跟踪数据来调试、测试和监控使用 LangGraph 构建的 LLM 应用程序 - 了解有关如何开始使用的更多信息 此处。

定义工具¶

在 [2]

from langchain_core.messages import AIMessage
from langchain_core.tools import tool

from langgraph.prebuilt import ToolNode

from langchain_core.messages import AIMessage from langchain_core.tools import tool from langgraph.prebuilt import ToolNode

在 [3]

@tool
def get_weather(location: str):
    """Call to get the current weather."""
    if location.lower() in ["sf", "san francisco"]:
        return "It's 60 degrees and foggy."
    else:
        return "It's 90 degrees and sunny."


@tool
def get_coolest_cities():
    """Get a list of coolest cities"""
    return "nyc, sf"

@tool def get_weather(location: str): """调用获取当前天气。""" if location.lower() in ["sf", "san francisco"]: return "温度为 60 度，有雾。" else: return "温度为 90 度，阳光明媚。" @tool def get_coolest_cities(): """获取最酷城市列表""" return "nyc, sf"

在 [4]

tools = [get_weather, get_coolest_cities]
tool_node = ToolNode(tools)

tools = [get_weather, get_coolest_cities] tool_node = ToolNode(tools)

手动调用 ToolNode¶

ToolNode 在包含消息列表的图状态上运行。它期望列表中的最后一条消息为 AIMessage，包含 tool_calls 参数。

让我们首先看看如何手动调用工具节点

在 [6]

message_with_single_tool_call = AIMessage(
    content="",
    tool_calls=[
        {
            "name": "get_weather",
            "args": {"location": "sf"},
            "id": "tool_call_id",
            "type": "tool_call",
        }
    ],
)

tool_node.invoke({"messages": [message_with_single_tool_call]})

message_with_single_tool_call = AIMessage( content="", tool_calls=[ { "name": "get_weather", "args": {"location": "sf"}, "id": "tool_call_id", "type": "tool_call", } ], ) tool_node.invoke({"messages": [message_with_single_tool_call]})

Out[6]

{'messages': [ToolMessage(content="It's 60 degrees and foggy.", name='get_weather', tool_call_id='tool_call_id')]}

请注意，通常您不需要手动创建 AIMessage，它将由任何支持工具调用的 LangChain 聊天模型自动生成。

您还可以使用 ToolNode 进行并行工具调用，方法是将多个工具调用传递给 AIMessage 的 tool_calls 参数

在 [7]

message_with_multiple_tool_calls = AIMessage(
    content="",
    tool_calls=[
        {
            "name": "get_coolest_cities",
            "args": {},
            "id": "tool_call_id_1",
            "type": "tool_call",
        },
        {
            "name": "get_weather",
            "args": {"location": "sf"},
            "id": "tool_call_id_2",
            "type": "tool_call",
        },
    ],
)

tool_node.invoke({"messages": [message_with_multiple_tool_calls]})

message_with_multiple_tool_calls = AIMessage( content="", tool_calls=[ { "name": "get_coolest_cities", "args": {}, "id": "tool_call_id_1", "type": "tool_call", }, { "name": "get_weather", "args": {"location": "sf"}, "id": "tool_call_id_2", "type": "tool_call", }, ], ) tool_node.invoke({"messages": [message_with_multiple_tool_calls]})

Out[7]

{'messages': [ToolMessage(content='nyc, sf', name='get_coolest_cities', tool_call_id='tool_call_id_1'),
  ToolMessage(content="It's 60 degrees and foggy.", name='get_weather', tool_call_id='tool_call_id_2')]}

与聊天模型一起使用¶

在我们的示例中，我们将使用来自 Anthropic 的小型聊天模型。要将聊天模型与工具调用一起使用，我们首先需要确保模型知道可用工具。我们通过在 ChatAnthropic 模型上调用 .bind_tools 方法来实现这一点

在 [5]

from typing import Literal

from langchain_anthropic import ChatAnthropic
from langgraph.graph import StateGraph, MessagesState
from langgraph.prebuilt import ToolNode


model_with_tools = ChatAnthropic(
    model="claude-3-haiku-20240307", temperature=0
).bind_tools(tools)

from typing import Literal from langchain_anthropic import ChatAnthropic from langgraph.graph import StateGraph, MessagesState from langgraph.prebuilt import ToolNode model_with_tools = ChatAnthropic( model="claude-3-haiku-20240307", temperature=0 ).bind_tools(tools)

在 [9]

model_with_tools.invoke("what's the weather in sf?").tool_calls

model_with_tools.invoke("sf 的天气怎么样？").tool_calls

Out[9]

[{'name': 'get_weather',
  'args': {'location': 'San Francisco'},
  'id': 'toolu_01Fwm7dg1mcJU43Fkx2pqgm8',
  'type': 'tool_call'}]

如您所见，由聊天模型生成的 AI 消息已经填充了 tool_calls，因此我们可以将其直接传递给 ToolNode

在 [10]

tool_node.invoke({"messages": [model_with_tools.invoke("what's the weather in sf?")]})

tool_node.invoke({"messages": [model_with_tools.invoke("sf 的天气怎么样？")]})

Out[10]

{'messages': [ToolMessage(content="It's 60 degrees and foggy.", name='get_weather', tool_call_id='toolu_01LFvAVT3xJMeZS6kbWwBGZK')]}

ReAct 代理¶

接下来，让我们看看如何在 LangGraph 图中使用 ToolNode。让我们设置 ReAct 代理 的图实现。该代理以一些查询作为输入，然后反复调用工具，直到它有足够的 information 来解决查询。我们将使用 ToolNode 和我们刚刚定义的包含工具的 Anthropic 模型

在 [6]

from typing import Literal

from langgraph.graph import StateGraph, MessagesState, START, END


def should_continue(state: MessagesState):
    messages = state["messages"]
    last_message = messages[-1]
    if last_message.tool_calls:
        return "tools"
    return END


def call_model(state: MessagesState):
    messages = state["messages"]
    response = model_with_tools.invoke(messages)
    return {"messages": [response]}


workflow = StateGraph(MessagesState)

# Define the two nodes we will cycle between
workflow.add_node("agent", call_model)
workflow.add_node("tools", tool_node)

workflow.add_edge(START, "agent")
workflow.add_conditional_edges("agent", should_continue, ["tools", END])
workflow.add_edge("tools", "agent")

app = workflow.compile()

from typing import Literal from langgraph.graph import StateGraph, MessagesState, START, END def should_continue(state: MessagesState): messages = state["messages"] last_message = messages[-1] if last_message.tool_calls: return "tools" return END def call_model(state: MessagesState): messages = state["messages"] response = model_with_tools.invoke(messages) return {"messages": [response]} workflow = StateGraph(MessagesState) # Define the two nodes we will cycle between workflow.add_node("agent", call_model) workflow.add_node("tools", tool_node) workflow.add_edge(START, "agent") workflow.add_conditional_edges("agent", should_continue, ["tools", END]) workflow.add_edge("tools", "agent") app = workflow.compile()

在 [7]

from IPython.display import Image, display

try:
    display(Image(app.get_graph().draw_mermaid_png()))
except Exception:
    # This requires some extra dependencies and is optional
    pass

from IPython.display import Image, display try: display(Image(app.get_graph().draw_mermaid_png())) except Exception: # This requires some extra dependencies and is optional pass

让我们试试吧！

在 [13]

# example with a single tool call
for chunk in app.stream(
    {"messages": [("human", "what's the weather in sf?")]}, stream_mode="values"
):
    chunk["messages"][-1].pretty_print()

# example with a single tool call for chunk in app.stream( {"messages": [("human", "sf 的天气怎么样？")]}, stream_mode="values" ): chunk["messages"][-1].pretty_print()

================================ Human Message =================================

what's the weather in sf?
================================== Ai Message ==================================

[{'text': "Okay, let's check the weather in San Francisco:", 'type': 'text'}, {'id': 'toolu_01LdmBXYeccWKdPrhZSwFCDX', 'input': {'location': 'San Francisco'}, 'name': 'get_weather', 'type': 'tool_use'}]
Tool Calls:
  get_weather (toolu_01LdmBXYeccWKdPrhZSwFCDX)
 Call ID: toolu_01LdmBXYeccWKdPrhZSwFCDX
  Args:
    location: San Francisco
================================= Tool Message =================================
Name: get_weather

It's 60 degrees and foggy.
================================== Ai Message ==================================

The weather in San Francisco is currently 60 degrees with foggy conditions.

在 [14]

# example with a multiple tool calls in succession

for chunk in app.stream(
    {"messages": [("human", "what's the weather in the coolest cities?")]},
    stream_mode="values",
):
    chunk["messages"][-1].pretty_print()

# example with a multiple tool calls in succession for chunk in app.stream( {"messages": [("human", "最酷城市的天气怎么样？")]}, stream_mode="values", ): chunk["messages"][-1].pretty_print()

================================ Human Message =================================

what's the weather in the coolest cities?
================================== Ai Message ==================================

[{'text': "Okay, let's find out the weather in the coolest cities:", 'type': 'text'}, {'id': 'toolu_01LFZUWTccyveBdaSAisMi95', 'input': {}, 'name': 'get_coolest_cities', 'type': 'tool_use'}]
Tool Calls:
  get_coolest_cities (toolu_01LFZUWTccyveBdaSAisMi95)
 Call ID: toolu_01LFZUWTccyveBdaSAisMi95
  Args:
================================= Tool Message =================================
Name: get_coolest_cities

nyc, sf
================================== Ai Message ==================================

[{'text': "Now let's get the weather for those cities:", 'type': 'text'}, {'id': 'toolu_01RHPQBhT1u6eDnPqqkGUpsV', 'input': {'location': 'nyc'}, 'name': 'get_weather', 'type': 'tool_use'}]
Tool Calls:
  get_weather (toolu_01RHPQBhT1u6eDnPqqkGUpsV)
 Call ID: toolu_01RHPQBhT1u6eDnPqqkGUpsV
  Args:
    location: nyc
================================= Tool Message =================================
Name: get_weather

It's 90 degrees and sunny.
================================== Ai Message ==================================

[{'id': 'toolu_01W5sFGF8PfgYzdY4CqT5c6e', 'input': {'location': 'sf'}, 'name': 'get_weather', 'type': 'tool_use'}]
Tool Calls:
  get_weather (toolu_01W5sFGF8PfgYzdY4CqT5c6e)
 Call ID: toolu_01W5sFGF8PfgYzdY4CqT5c6e
  Args:
    location: sf
================================= Tool Message =================================
Name: get_weather

It's 60 degrees and foggy.
================================== Ai Message ==================================

Based on the results, it looks like the weather in the coolest cities is:
- New York City: 90 degrees and sunny
- San Francisco: 60 degrees and foggy

So the weather in the coolest cities is a mix of warm and cool temperatures, with some sunny and some foggy conditions.

ToolNode 也可以处理工具执行期间的错误。您可以通过设置 handle_tool_errors=True（默认启用）来启用/禁用此功能。请参阅我们有关在 ToolNode 中处理错误的指南 此处

评论