How to integrate FutureAGI MCP with Codex

Codex is one of the most popular coding harnesses out there. And MCP makes the experience even better. With FutureAGI MCP integration, you can draft, triage, summarise emails, and much more, all without leaving the terminal or the app, whichever you prefer.

FutureAGI logoFutureAGI
Api Key

FutureAGI is an AI evaluation and observability platform for testing, tracing, simulating, and improving AI systems. Use it to measure model quality, debug failures, manage datasets, and close the loop with annotation workflows.

9 Tools

Introduction

Codex is one of the most popular coding harnesses out there. And MCP makes the experience even better. With FutureAGI MCP integration, you can draft, triage, summarise emails, and much more, all without leaving the terminal or the app, whichever you prefer.

Also integrate FutureAGI with

Why use Composio?

Apart from a managed and hosted MCP server, you will get:

  • CodeAct: A dedicated workbench that allows GPT to write its code to handle complex tool chaining. Reduces to-and-fro with LLMs for frequent tool calling.
  • Large tool responses: Handle them to minimise context rot.
  • Dynamic just-in-time access to 20,000 tools across 1000+ other Apps for cross-app workflows. It loads the tools you need, so GPTs aren't overwhelmed by tools you don't need.

How to install FutureAGI MCP in Codex

Run the setup command

Run this command in your terminal to add the Composio MCP server to Codex.

Terminal

It will initiate the authentication in a browser window, authorize Codex to access your Composio account.

Composio authentication page

(Optional) Authenticate with OAuth

To authenticate manually, run the login command to open a browser window and authorize Codex to access your Composio account.

bash
codex mcp login composio

Verify the connection

Run codex mcp list to confirm Composio appears as a registered MCP server.

bash
codex mcp list

Codex App

Codex App follows the same approach as VS Code.

  1. Click ⚙️ on the bottom left → MCP Servers → + Add servers → Streamable HTTP:
  2. Fill the header and Key fields with { "x-consumer-api-key" = "ck_*******" }.
  3. The Key is the Composio API key, that you can find on dashboard.composio.dev
  4. Click on Authenticate and authorize Codex to your Composio account and you're all set.
Codex App MCP setup
  1. Restart and verify if it's there in .codex/config.toml
bash
[mcp_servers.composio]
url = "https://connect.composio.dev/mcp"
http_headers = { "x-consumer-api-key" = "ck_*******" }

What is the FutureAGI MCP server, and what's possible with it?

The FutureAGI MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to your FutureAGI account. It provides structured and secure access to your evaluations, datasets, annotation workflows, agent definitions, and simulation resources, so your agent can review evaluation tasks, find datasets, inspect annotation work, browse agents, and explore simulations on your behalf.

  • Evaluation setup discovery: Have your agent find evaluation tasks and custom evaluation configurations for a specific project or task name.
  • Dataset and label review: Let the agent search your datasets and review annotation labels by name, type, project, or dataset.
  • Annotation queue oversight: Direct your agent to list annotation queues by name or status and include item counts when needed.
  • Agent and test inspection: Instruct your agent to find agent definitions and review configured run tests by name, source type, or prompt template without running them.
  • Simulation resource exploration: Have your agent browse personas and scenarios using agent type, simulation mode, agent definition, or search text.

Conclusion

You've successfully integrated FutureAGI with Codex using Composio's MCP server. Now you can interact with FutureAGI directly from your terminal, VS Code, or the Codex App using natural language commands.

Key benefits of this setup:

  • Seamless integration across CLI, VS Code, and standalone app
  • Natural language commands for FutureAGI operations
  • Managed authentication through Composio
  • Access to 20,000+ tools across 1000+ apps for cross-app workflows
  • CodeAct workbench for complex tool chaining

Next steps:

  • Try asking Codex to perform various FutureAGI operations
  • Explore cross-app workflows by connecting more toolkits
  • Build automation scripts that leverage Codex's AI capabilities
TOOLS

Supported Tools

Every FutureAGI action and event your agent gets out of the box.

List Agent Definitions

List one page of agent definitions in the connected FutureAGI organization, optionally filtering by type, name, assistant ID, or agent ID.

List Annotation Labels

List one page of FutureAGI annotation labels by type, name, project, or dataset, optionally including usage counts.

List Annotation Queues

List one page of FutureAGI annotation queues by status or name, optionally including item counts.

List Custom Eval Configs

List custom evaluation configurations, optionally restricted to a FutureAGI project or evaluation task.

List Datasets

List one page of datasets in the connected FutureAGI organization, optionally searching by name.

List Eval Tasks

List one page of FutureAGI evaluation tasks, optionally filtering by project ID or task name.

List Personas

List one page of built-in and workspace personas for FutureAGI simulations, with type, simulation-mode, and text filters.

List Run Tests

List one page of configured FutureAGI run tests without executing them, optionally filtering by name, source type, or prompt template.

List Scenarios

List one page of FutureAGI simulation scenarios, optionally filtering by agent definition, agent type, or search text.

FAQ

Frequently asked questions

With a standalone FutureAGI MCP server, the agents and LLMs can only access a fixed set of FutureAGI tools tied to that server. However, with the Composio Tool Router, agents can dynamically load tools from FutureAGI and many other apps based on the task at hand, all through a single MCP endpoint.

Yes, you can. Codex fully supports MCP integration. You get structured tool calling, message history handling, and model orchestration while Tool Router takes care of discovering and serving the right FutureAGI tools.

Yes, absolutely. You can configure which FutureAGI scopes and actions are allowed when connecting your account to Composio. You can also bring your own OAuth credentials or API configuration so you keep full control over what the agent can do.

All sensitive data such as tokens, keys, and configuration is fully encrypted at rest and in transit. Composio is SOC 2 Type 2 compliant and follows strict security practices so your FutureAGI data and credentials are handled as safely as possible.

Start with FutureAGI.It takes 30 seconds.

Managed auth, hosted MCP servers, and every FutureAGI tool your agent needs.Free to start.

Start building