The Braintrust MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to your Braintrust account. It provides structured and secure access to your projects, prompts, datasets, experiments, evaluations, and observability data, so your agent can create resources, manage evaluation data, inspect events, query results, and update configurations on your behalf.
- Project and resource management: Have your agent create, list, update, or delete Braintrust projects and manage the experiments, datasets, and prompts within them.
- Dataset creation and maintenance: Let the agent create datasets, add batches of examples, revise dataset details, and summarize their contents and metrics.
- Experiment tracking and evaluation: Direct your agent to create experiments, add result events, update experiment details, and retrieve aggregate evaluation summaries.
- Prompt configuration: Instruct your agent to create versioned prompts and update their metadata or configuration without running them.
- Observability and data analysis: Have your agent fetch recent project, experiment, or dataset events and run read-only queries over Braintrust data to investigate results.