How to integrate Braintrust MCP with OpenClaw

OpenClaw is the fastest growing agent harness out there, which can work 24/7 to automate almost any kind of tasks. However, its capabilities are limited to the tools it has access to. Composio allows your OpenClaw to access Braintrust with authentication management handled for you. You can execute actions on Braintrust via your favorite OpenClaw interface (Telegram, WhatsApp, TUI, etc), whichever you prefer.

Braintrust logoBraintrust
Api Key

Braintrust is an AI engineering platform for prompts, datasets, experiments, evaluations, observability, and production AI apps. Use it to ship better AI systems with faster debugging, clearer evals, and tighter feedback loops.

17 Tools

Introduction

OpenClaw is the fastest growing agent harness out there, which can work 24/7 to automate almost any kind of tasks. However, its capabilities are limited to the tools it has access to. Composio allows your OpenClaw to access Braintrust with authentication management handled for you. You can execute actions on Braintrust via your favorite OpenClaw interface (Telegram, WhatsApp, TUI, etc), whichever you prefer.

Also integrate Braintrust with

Why use Composio?

Apart from a managed and hosted MCP server, you will get:

  • Programmatic tool calling allows LLMs to write its code in a remote workbench to handle complex tool chaining. Reduces to-and-fro with LLMs for frequent tool calling.
  • Handling Large tool responses out of LLM context to minimize context rot.
  • Dynamic just-in-time access to 20,000 tools across 1000+ other Apps for cross-app workflows. It loads the tools you need, so LLMs aren't overwhelmed by tools you don't need.

How to install Braintrust with OpenClaw

Using Composio API Key and Setup Prompt

Copy the setup prompt from the OpenClaw dashboard
  • Run it in your OpenClaw chat interface.
  • Authenticate Braintrust from the dashboard
  • Go back to your OpenClaw interface and start asking questions.

Using OpenClaw/Composio Plugin

1. Install OpenClaw Composio plugin

bash
openclaw plugins install @composio/openclaw-plugin

2. Copy the API Key from dashboard.composio.dev

3. Setup OpenClaw Config

bash
openclaw config set plugins.entries.composio.config.consumerKey "ck_your_key_here"

4. Restart OpenClaw

bash
openclaw gateway restart

5. Go to your chat interface and start asking questions.

6. When prompted, authenticate the app and you're all set.

How It Works

The plugin connects to Composio's MCP server at https://connect.composio.dev/mcp and registers all available tools directly into the OpenClaw agent. Tools are called by name — no extra search or execute steps needed.

If a tool returns an auth error, the agent will prompt you to connect that toolkit at dashboard.composio.dev.

Configuration

bash
{
  "plugins": {
    "entries": {
      "composio": {
        "enabled": true,
        "config": {
          "consumerKey": "ck_your_key_here"
        }
      }
    }
  }
}
OptionDescriptionDefault
enabledEnable or disable the plugintrue
consumerKeyYour Composio consumer key (ck_...)—
mcpUrlMCP server URL (advanced)https://connect.composio.dev/mcp

What is the Braintrust MCP server, and what's possible with it?

The Braintrust MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to your Braintrust account. It provides structured and secure access to your projects, prompts, datasets, experiments, evaluations, and observability data, so your agent can create resources, manage evaluation data, inspect events, query results, and update configurations on your behalf.

  • Project and resource management: Have your agent create, list, update, or delete Braintrust projects and manage the experiments, datasets, and prompts within them.
  • Dataset creation and maintenance: Let the agent create datasets, add batches of examples, revise dataset details, and summarize their contents and metrics.
  • Experiment tracking and evaluation: Direct your agent to create experiments, add result events, update experiment details, and retrieve aggregate evaluation summaries.
  • Prompt configuration: Instruct your agent to create versioned prompts and update their metadata or configuration without running them.
  • Observability and data analysis: Have your agent fetch recent project, experiment, or dataset events and run read-only queries over Braintrust data to investigate results.

Conclusion

You've successfully integrated Braintrust with OpenClaw using Composio plugin. Now interact with Braintrust directly from your terminal, Web UI, or any messenger app using natural language commands.

Key benefits of this setup:

  • Seamless integration across TUI, Web UIs, and Messenger apps like Telegram, WhatsApp, Slack, etc.
  • Natural language commands for Braintrust operations
  • Managed authentication through Composio
  • Access to 20,000+ tools across 1000+ apps for cross-app workflows
  • Programmatic tool calling for complex tool chaining

Next steps:

  • Try asking OpenClaw to perform various Braintrust operations
  • Explore cross-app workflows by connecting more toolkits like Calendar, Slack, Notion, etc.
  • Build complex automation scripts that leverage OpenClaw's 24/7 running capabilities
TOOLS

Supported Tools

Every Braintrust action and event your agent gets out of the box.

Create Dataset

Create a named dataset under a Braintrust project, or return the existing dataset unchanged when its name already exists in that project.

Create Experiment

Create an experiment under a Braintrust project.

Create Project

Create a Braintrust project, or return the existing project unchanged when its name already exists.

Create Prompt

Upsert a versioned prompt configuration under a Braintrust project without invoking it.

Delete Project

Soft-delete a Braintrust project and return its deletion state.

Delete Experiment, Dataset, or Prompt

Delete one Braintrust experiment, dataset, or prompt by UUID for explicit lifecycle cleanup.

Fetch Events

Fetch one newest-to-oldest page of project log, experiment, or dataset events.

Get Braintrust Resource

Get one project, experiment, dataset, prompt, or function by UUID.

Insert Dataset Events

Upsert a batch of examples into an existing Braintrust dataset.

Insert Experiment Events

Upsert a batch of result events into an existing Braintrust experiment.

List Braintrust Resources

List and filter one page of projects, experiments, datasets, prompts, or functions visible to the connected Braintrust API key.

Query Braintrust Data

Run one bounded synchronous read-only BTQL query over Braintrust project logs, an experiment, or a dataset.

Summarize Experiment or Dataset

Return metadata and optional aggregate summaries for one Braintrust experiment or dataset.

Update Dataset

Update the name, description, tags, or metadata of a Braintrust dataset.

Update Experiment

Update selected metadata and linkage fields on a Braintrust experiment.

Update Project

Update selected fields of a Braintrust project.

Update Prompt

Update a Braintrust prompt's metadata or configuration without invoking it.

FAQ

Frequently asked questions

With a standalone Braintrust MCP server, the agents and LLMs can only access a fixed set of Braintrust tools tied to that server. However, with the Composio Tool Router, agents can dynamically load tools from Braintrust and many other apps based on the task at hand, all through a single MCP endpoint.

Yes, you can. OpenClaw fully supports MCP integration. You get structured tool calling, message history handling, and model orchestration while Tool Router takes care of discovering and serving the right Braintrust tools.

Yes, absolutely. You can configure which Braintrust scopes and actions are allowed when connecting your account to Composio. You can also bring your own OAuth credentials or API configuration so you keep full control over what the agent can do.

All sensitive data such as tokens, keys, and configuration is fully encrypted at rest and in transit. Composio is SOC 2 Type 2 compliant and follows strict security practices so your Braintrust data and credentials are handled as safely as possible.

Start with Braintrust.It takes 30 seconds.

Managed auth, hosted MCP servers, and every Braintrust tool your agent needs.Free to start.

Start building