How to integrate MrScraper MCP with OpenClaw

OpenClaw is the fastest growing agent harness out there, which can work 24/7 to automate almost any kind of tasks. However, its capabilities are limited to the tools it has access to. Composio allows your OpenClaw to access MrScraper with authentication management handled for you. You can execute actions on MrScraper via your favorite OpenClaw interface (Telegram, WhatsApp, TUI, etc), whichever you prefer.

MrScraper logoMrScraper
Api Key

MrScraper is a web scraping API platform for structured extraction, search results, marketplace data, travel data, and web unblocking. Use it to turn messy web pages into clean, usable data without managing scraper infrastructure.

11 Tools

Introduction

OpenClaw is the fastest growing agent harness out there, which can work 24/7 to automate almost any kind of tasks. However, its capabilities are limited to the tools it has access to. Composio allows your OpenClaw to access MrScraper with authentication management handled for you. You can execute actions on MrScraper via your favorite OpenClaw interface (Telegram, WhatsApp, TUI, etc), whichever you prefer.

Also integrate MrScraper with

Why use Composio?

Apart from a managed and hosted MCP server, you will get:

  • Programmatic tool calling allows LLMs to write its code in a remote workbench to handle complex tool chaining. Reduces to-and-fro with LLMs for frequent tool calling.
  • Handling Large tool responses out of LLM context to minimize context rot.
  • Dynamic just-in-time access to 20,000 tools across 1000+ other Apps for cross-app workflows. It loads the tools you need, so LLMs aren't overwhelmed by tools you don't need.

How to install MrScraper with OpenClaw

Using Composio API Key and Setup Prompt

Copy the setup prompt from the OpenClaw dashboard
  • Run it in your OpenClaw chat interface.
  • Authenticate MrScraper from the dashboard
  • Go back to your OpenClaw interface and start asking questions.

Using OpenClaw/Composio Plugin

1. Install OpenClaw Composio plugin

bash
openclaw plugins install @composio/openclaw-plugin

2. Copy the API Key from dashboard.composio.dev

3. Setup OpenClaw Config

bash
openclaw config set plugins.entries.composio.config.consumerKey "ck_your_key_here"

4. Restart OpenClaw

bash
openclaw gateway restart

5. Go to your chat interface and start asking questions.

6. When prompted, authenticate the app and you're all set.

How It Works

The plugin connects to Composio's MCP server at https://connect.composio.dev/mcp and registers all available tools directly into the OpenClaw agent. Tools are called by name — no extra search or execute steps needed.

If a tool returns an auth error, the agent will prompt you to connect that toolkit at dashboard.composio.dev.

Configuration

bash
{
  "plugins": {
    "entries": {
      "composio": {
        "enabled": true,
        "config": {
          "consumerKey": "ck_your_key_here"
        }
      }
    }
  }
}
OptionDescriptionDefault
enabledEnable or disable the plugintrue
consumerKeyYour Composio consumer key (ck_...)—
mcpUrlMCP server URL (advanced)https://connect.composio.dev/mcp

What is the MrScraper MCP server, and what's possible with it?

The MrScraper MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to your MrScraper account. It provides structured and secure access to your scraper workflows, results, usage, and analytics, so your agent can create AI scrapers, rerun saved scrapers, retrieve results, repair manual workflows, and review scraping activity on your behalf.

  • AI scraper creation: Have your agent create and run general, listing, or map AI scrapers against websites.
  • Single and bulk scraper runs: Direct your agent to rerun saved AI or manual scrapers against one website or multiple websites at once.
  • Result tracking and retrieval: Let the agent list past scrape results, filter and sort them, then retrieve the current status and output of a selected run.
  • Manual scraper repair: Instruct your agent to repair a saved manual scraper when changes to its target website cause the workflow to stop matching.
  • Usage and performance monitoring: Have your agent review plan usage, token consumption, concurrency, rate limits, success rates, request volume, latency, and scraping trends over time.

Conclusion

You've successfully integrated MrScraper with OpenClaw using Composio plugin. Now interact with MrScraper directly from your terminal, Web UI, or any messenger app using natural language commands.

Key benefits of this setup:

  • Seamless integration across TUI, Web UIs, and Messenger apps like Telegram, WhatsApp, Slack, etc.
  • Natural language commands for MrScraper operations
  • Managed authentication through Composio
  • Access to 20,000+ tools across 1000+ apps for cross-app workflows
  • Programmatic tool calling for complex tool chaining

Next steps:

  • Try asking OpenClaw to perform various MrScraper operations
  • Explore cross-app workflows by connecting more toolkits like Calendar, Slack, Notion, etc.
  • Build complex automation scripts that leverage OpenClaw's 24/7 running capabilities
TOOLS

Supported Tools

Every MrScraper action and event your agent gets out of the box.

Bulk Rerun AI Scraper

Run an existing General AI scraper configuration against multiple URLs in one request.

Bulk Rerun Manual Scraper

Run an existing saved manual scraper workflow against multiple URLs in one request.

Create AI Scraper

Create and run a general, listing, or map AI scraper against a website.

Get Account Usage

Return the connected MrScraper account's plan, token usage, concurrency allowance, and rate limits without exposing user identity or token details.

Get Scrape Status Analytics

Return aggregate scrape counts, success rate, request rate, latency, and status totals for a domain and action over a time range.

Get Scrape Analytics Timeline

Return time-series scrape activity and success metrics for a domain and action over a time range.

Get Scrape Result

Retrieve the current status and output for one accessible scrape result by ID.

Heal Manual Scraper

Ask MrScraper to repair an existing manual scraper workflow that no longer matches its target site.

List Scrape Results

List scrape results for the connected account with filtering, sorting, and agent-controlled pagination.

Rerun AI Scraper

Run an existing AI scraper configuration against a new URL, with optional map crawl controls.

Rerun Manual Scraper

Run an existing saved manual scraper workflow against a new URL.

FAQ

Frequently asked questions

With a standalone MrScraper MCP server, the agents and LLMs can only access a fixed set of MrScraper tools tied to that server. However, with the Composio Tool Router, agents can dynamically load tools from MrScraper and many other apps based on the task at hand, all through a single MCP endpoint.

Yes, you can. OpenClaw fully supports MCP integration. You get structured tool calling, message history handling, and model orchestration while Tool Router takes care of discovering and serving the right MrScraper tools.

Yes, absolutely. You can configure which MrScraper scopes and actions are allowed when connecting your account to Composio. You can also bring your own OAuth credentials or API configuration so you keep full control over what the agent can do.

All sensitive data such as tokens, keys, and configuration is fully encrypted at rest and in transit. Composio is SOC 2 Type 2 compliant and follows strict security practices so your MrScraper data and credentials are handled as safely as possible.

Start with MrScraper.It takes 30 seconds.

Managed auth, hosted MCP servers, and every MrScraper tool your agent needs.Free to start.

Start building