Use Agent in flow

Agents are AI systems that use LLMs as a brain to analyze problems and select external tools.

Instead of developers having to create logical statements to direct every possible path of a program, an agent can operate with autonomy. An agent can leverage external tools and APIs to gather information and take action, demonstrate chain-of-thought reasoning, and generate tailored text for specific purposes.

To simplify the development of agents, BroxiAI created a custom Tool calling agent component that simplifies configuration and lets developers focus on solving problems with agents.

Tool calling agentcomponent

Developing agents in Langchain is complex.

The AgentComponent is a component for easily creating an AI agent capable of analyzing tasks using tools you provide.

The component contains all of the elements you'll need for creating an agent. Instead of managing LLM models and providers, pick your model and enter your API key. Instead of connecting a Prompt component, enter instructions in the component's Agent Instruction fields.

Prerequisites

• An OpenAI API key
• A Search API key

Create a problem-solving agent with AgentComponent​

Create a problem-solving agent in BroxiAI, starting with the Tool calling agent.

1. Click New Flow, and then click Blank Flow.

2. Click and drag an Agent component to your workspace. The default settings are acceptable for now, so this guide assumes you're using Open AI for the LLM.

3. Add your Open AI API Key to the Agent component.

4. Add Chat input and Chat output components to your flow, and connect them to the tool calling agent.

Chat with agent component

This basic flow enables you to chat with the agent with the Playground after you've connected some Tools.

1. Connect the Search API tool component to your agent.

2. Add your Search API key to the component. Your agent can now query the Search API for information.

3. Connect a Calculator tool for solving basic math problems.

4. Connect an API Request component to the agent. This component is not in the Tools category, but the agent can still use it as a tool by enabling Tool Mode. Tool Mode makes a component into a tool by adding a Toolset port that can be connected to an agent's Tools port. To enable Tool Mode on the component, click Tool Mode. The component's fields change dynamically based on the mode it's in.

Chat with agent component

Solve problems with the agent​

Your agent now has tools for performing a web search, doing basic math, and performing API requests. You can solve many problems with just these capabilities.

• Your tabletop game group cancelled, and you're stuck at home. Point API Request to an online rules document, tell your agent You are a fun game organizer who uses the tools at your disposal, and play a game.

• You need to learn a new software language quickly. Point API Request to some docs, tell your agent You are a knowledgeable software developer who uses the tools at your disposal, and start learning.

See what problems you can solve with this flow. As your problem becomes more specialized, add more tools. For example, add a Python REPL component to solve math problems that are too challenging for the calculator.

Edit a tool's metadata​

To edit a tool's metadata, click the Edit Tools button in the tool to modify its name or description metadata. These fields help connected agents understand how to use the tool, without having to modify the agent's prompt instructions.

For example, the URL component has three tools available when Tool Mode is enabled.

Tool Name	Description
URL-fetch_content	Use this tool to fetch and retrieve raw content from a URL, including HTML and other structured data. The full response content is returned.
URL-fetch_content_text	Use this tool to fetch and extract clean, readable text content from a webpage. Only plain text content is returned.
URL-as_dataframe	Use this tool to fetch structured data from a URL and convert it into a tabular format. Data is returned in a structured DataFrame table format.

A connected agent will have a clear idea of each tool's capabilities based on the name and description metadata. If you think the agent is using a tool incorrectly, edit a tool's metadata to help it understand the tool better.

Tool names and descriptions can be edited, but the default tool identifiers cannot be changed. If you want to change the tool identifier, create a custom component.

To see which tools the agent is using and how it's using them, ask the agent, What tools are you using to answer my questions?

Use an agent as a tool​

The agent component itself also supports Tool Mode for creating multi-agent flows.

Add an agent to your problem-solving flow that uses a different OpenAI model for more specialized problem solving.

1. Click and drag an Agent component to your workspace.

2. Add your Open AI API Key to the Agent component.

3. In the Model Name field, select gpt-4o.

4. Click Tool Mode to use this new agent as a tool.

5. Connect the new agent's Toolset port to the previously created agent's Tools port.

6. Connect Search API and API Request to the new agent. The new agent will use gpt-4o for the larger tasks of scraping and searching information that requires large context windows. The problem-solving agent will now use this agent as a tool, with its unique LLM and toolset.

The tool calling agent as a tool

1. The new agent's metadata can be edited to help the problem-solving agent understand how to use it. Click Edit Tools to modify the new agent's name or description metadata so its usage is clear to the problem-solving agent. For example, the default tool name is Agent. Edit the name to Agent-gpt-4o, and edit the description to Use the gpt-4o model for complex problem solving. The problem-solving agent will understand that this is the gpt-4o agent, and will use it for tasks requiring a larger context window.

Add custom components as tools​

An agent can use custom components as tools.

1. To add a custom component to the problem-solving agent flow, click New Custom Component.

2. Add custom Python code to the custom component. Here's an example text analyzer for sentiment analysis.

import re

class TextAnalyzerComponent(Component):
    display_name = "Text Analyzer"
    description = "Analyzes and transforms input text."
    documentation: str = "https://guidenai.gitbook.io/broxi"
    icon = "chart-bar"
    name = "TextAnalyzerComponent"

    inputs = [
        MessageTextInput(
            name="input_text",
            display_name="Input Text",
            info="Enter text to analyze",
            value="Hello, World!",
            tool_mode=True,
        ),
    ]

    outputs = [
        Output(display_name="Analysis Result", name="output", method="analyze_text"),
    ]

    def analyze_text(self) -> Data:
        text = self.input_text
        
        # Perform text analysis
        word_count = len(text.split())
        char_count = len(text)
        sentence_count = len(re.findall(r'\w+[.!?]', text))
        
        # Transform text
        reversed_text = text[::-1]
        uppercase_text = text.upper()
        
        analysis_result = {
            "original_text": text,
            "word_count": word_count,
            "character_count": char_count,
            "sentence_count": sentence_count,
            "reversed_text": reversed_text,
            "uppercase_text": uppercase_text
        }
        
        data = Data(value=analysis_result)
        self.status = data
        return data

1. To enable the custom component as a tool, click Tool Mode.

2. Connect the tool output to the agent's tools input.

3. Ask the agent, What tools are you using to answer my questions? Your response will be similar to the following, and will include your custom component.

I have access to several tools that assist me in answering your questions, including:
Search API: This allows me to search for recent information or results on the web.
HTTP Requests: I can make HTTP requests to various URLs to retrieve data or interact with APIs.
Calculator: I can evaluate basic arithmetic expressions.
Text Analyzer: I can analyze and transform input text.
Current Date and Time: I can retrieve the current date and time in various time zones.

Make any component a tool​

If the component you want to use as a tool doesn't have a Tool Mode button, add tool_mode=True to one of the component's inputs, and connect the new Toolset output to the agent's Tools input.

BroxiAI supports Tool Mode for the following data types:

• DataInput

• DataFrameInput

• PromptInput

• MessageTextInput

• MultilineInput

• DropdownInput

For example, the components as tools example above adds tool_mode=True to the MessageTextInput input so the custom component can be used as a tool.

inputs = [
    MessageTextInput(
        name="input_text",
        display_name="Input Text",
        info="Enter text to analyze",
        value="Hello, World!",
        tool_mode=True,
    ),
]

Use the Run Flow component as a tool​

An agent can use flows that are saved in your workspace as tools with the Run flow component.

1. To add a Run flow component, click and drag a Run flow component to your workspace.

2. Select the flow you want the agent to use as a tool.

3. Enable Tool Mode in the component.

4. Connect the tool output to the agent's tools input.

5. To enable tool mode, select a Flow in the Run flow component, and then click Tool Mode.

6. Ask the agent, What tools are you using to answer my questions? Your flow should be visible in the response as a tool.