The Web MCP

🌐 Give your AI real-time web superpowers
Seamlessly connect LLMs to the live web without getting blocked

Quick Start • Features • Pricing • Demos • Docs • Support

🎉 Free Tier Available! 🎉

5,000 requests/month FREE
_{Perfect for prototyping and everyday AI workflows}

NEW: Code Tool group - Your Coding Agent's Best Friend

Instant access to npm and PyPI package data, right from your AI agent.

Need the latest version of a package? Want to read its README without leaving your workflow?
The Code tool group gives coding agents structured, reliable package metadata on demand —
no scraping, no stale caches, just the data your agent needs to make smart dependency decisions.

npm
_{Package versions, READMEs, metadata & dependencies}

PyPI
_{Python package info, versions & project details}

GROUPS="code" · The go-to tool for Claude Code, Cursor, Windsurf & any MCP-powered coding agent

GEO & AI Brand Visibility Tools

See how ChatGPT, Grok, and Perplexity talk about your brand.

Query leading LLMs directly from your agent and get back structured, markdown-formatted answers.
The ultimate feedback loop for Generative Engine Optimization (GEO) — monitor AI-generated recommendations, track brand mentions across LLMs, and understand how AI perceives your products.

ChatGPT
_{AI-generated insights, citations & recommendations}

Grok
_{Real-time AI analysis powered by X data}

Perplexity
_{Search-augmented AI answers with sources}

GROUPS="geo" · Works with any MCP-compatible agent

--- ## 🌟 Overview **The Web MCP** is your gateway to giving AI assistants true web capabilities. No more outdated responses, no more "I can't access real-time information" - just seamless, reliable web access that actually works. Built by [Bright Data](https://brightdata.com), the world's #1 web data platform, this MCP server ensures your AI never gets blocked, rate-limited, or served CAPTCHAs.

✅ Works with Any LLM
_{Claude, GPT, Gemini, Llama}

🛡️ Never Gets Blocked
_{Enterprise-grade unblocking}

🚀 5,000 Free Requests
_Monthly

⚡ Zero Config
_{Works out of the box}

--- ## 🎯 Perfect For - 🔍 **Real-time Research** - Get current prices, news, and live data - 🛍️ **E-commerce Intelligence** - Monitor products, prices, and availability - 📊 **Market Analysis** - Track competitors and industry trends - 🤖 **AI Agents** - Build agents that can actually browse the web - 💻 **Coding Agents** - Look up npm/PyPI packages, versions, and READMEs in real time - 🧠 **GEO & Brand Visibility** - See how ChatGPT, Grok, and Perplexity perceive your brand - 📝 **Content Creation** - Access up-to-date information for writing - 🎓 **Academic Research** - Gather data from multiple sources efficiently --- ## ⚡ Quick Start **Use the configuration wizard:** ![GIF for day2](https://github.com/user-attachments/assets/b3917553-6cf9-4264-bc7a-9b8b74df0a17)

📡 Use our hosted server - No installation needed!

Perfect for users who want zero setup. Just add this URL to your MCP client: ``` https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN_HERE ``` **Setup in Claude Desktop:** 1. Go to: Settings → Connectors → Add custom connector 2. Name: `Bright Data Web` 3. URL: `https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN` 4. Click "Add" and you're done! ✨

Run locally on your machine

```json { "mcpServers": { "Bright Data": { "command": "npx", "args": ["@brightdata/mcp"], "env": { "API_TOKEN": "" } } } } ``` --- ## 🚀 Pricing & Modes

⚡ Rapid Mode (Free tier) 💎 Pro Mode 🔧 Custom Mode

⚡ Rapid Mode (Free tier)	💎 Pro Mode	🔧 Custom Mode
$0/month 5,000 requests ✅ Web Search ✅ Scraping with Web unlocker ✅ AI-ranked Discover search ❌ Browser Automation ❌ Web data tools `Default Mode`	Pay-as-you-go Everything in rapid plus 60+ tools ✅ Browser Control ✅ Web Data APIs `PRO_MODE=true`	Usage-based Pick the tools you need ✅ Combine tool groups ✅ Add individual tools ❌ Overrides Pro eligibility `GROUPS="browser"` `TOOLS="scrape_as_html"`

$0/month

5,000 requests

✅ Web Search
✅ Scraping with Web unlocker
✅ AI-ranked Discover search
❌ Browser Automation
❌ Web data tools

Default Mode

Pay-as-you-go

Everything in rapid plus 60+ tools

✅ Browser Control
✅ Web Data APIs

PRO_MODE=true

Usage-based

Pick the tools you need

✅ Combine tool groups
✅ Add individual tools
❌ Overrides Pro eligibility

GROUPS="browser"
TOOLS="scrape_as_html"

> **💡 Note:** Pro mode is **not included** in the free tier and incurs > additional charges based on usage. --- ## 🧠 Advanced Tool Selection - `GROUPS` lets you enable curated tool bundles. Use comma-separated group IDs such as `ecommerce,browser`. - `TOOLS` adds explicit tool names on top of the selected groups. - Mode priority: `PRO_MODE=true` (all tools) → `GROUPS` / `TOOLS` (whitelist) → default rapid mode (base toolkit). - Base tools always enabled: `search_engine`, `search_engine_batch`, `scrape_as_markdown`, `scrape_batch`, `discover`. - Group ID `custom` is reserved; use `TOOLS` for bespoke picks.

Group ID	Description	Featured tools
`ecommerce`	Retail and marketplace datasets	`web_data_amazon_product`, `web_data_walmart_product`, `web_data_google_shopping`
`social`	Social, community, and creator insights	`web_data_linkedin_posts`, `web_data_tiktok_posts`, `web_data_youtube_videos`
`browser`	Bright Data Scraping Browser automation tools	`scraping_browser_snapshot`, `scraping_browser_click_ref`, `scraping_browser_screenshot`
`finance`	Financial intelligence datasets	`web_data_yahoo_finance_business`
`business`	Company and location intelligence datasets	`web_data_crunchbase_company`, `web_data_zoominfo_company_profile`, `web_data_zillow_properties_listing`
`research`	News and developer data feeds	`web_data_github_repository_file`, `web_data_reuter_news`
`app_stores`	App store data	`web_data_google_play_store`, `web_data_apple_app_store`
`travel`	Travel information	`web_data_booking_hotel_listings`
`geo`	GEO & LLM brand visibility	`web_data_chatgpt_ai_insights`, `web_data_grok_ai_insights`, `web_data_perplexity_ai_insights`
`code`	Package intelligence for coding agents	`web_data_npm_package`, `web_data_pypi_package`
`advanced_scraping`	Batch and AI-assisted extraction helpers	`search_engine_batch`, `scrape_batch`, `extract`

### Claude Desktop example ```json { "mcpServers": { "Bright Data": { "command": "npx", "args": ["@brightdata/mcp"], "env": { "API_TOKEN": "", "GROUPS": "browser,advanced_scraping", "TOOLS": "extract" } } } } ``` ### Coding agent example (Claude Code / Cursor / Windsurf) Give your coding agent real-time package intelligence — latest versions, READMEs, dependencies, and metadata from npm and PyPI without scraping: ```json { "mcpServers": { "Bright Data": { "command": "npx", "args": ["@brightdata/mcp"], "env": { "API_TOKEN": "", "GROUPS": "code" } } } } ``` --- ## ✨ Features ### 🔥 Core Capabilities

🔍 Smart Web Search Google-quality results optimized for AI	📄 Clean Markdown AI-ready content extraction
🌍 Global Access Bypass geo-restrictions automatically	🛡️ Anti-Bot Protection Never get blocked or rate-limited
🤖 Browser Automation Control real browsers remotely (Pro)	⚡ Lightning Fast Optimized for minimal latency

### 🎯 Example Queries That Just Work ```yaml ✅ "What's Tesla's current stock price?" ✅ "Find the best-rated restaurants in Tokyo right now" ✅ "Get today's weather forecast for New York" ✅ "What movies are releasing this week?" ✅ "What are the trending topics on Twitter today?" ✅ "What's the latest version of express on npm?" ✅ "Get the README for the langchain-brightdata PyPI package" ``` --- ## 🎬 Demos > **Note:** These videos show earlier versions. New demos coming soon! 🎥

View Demo Videos

### Basic Web Search Demo https://github.com/user-attachments/assets/59f6ebba-801a-49ab-8278-1b2120912e33 ### Advanced Scraping Demo https://github.com/user-attachments/assets/61ab0bee-fdfa-4d50-b0de-5fab96b4b91d [📺 More tutorials on YouTube →](https://github.com/brightdata-com/brightdata-mcp/blob/main/examples/README.md)

--- ## 🔧 Available Tools ### ⚡ Rapid Mode Tools (Default - Free) | Tool | Description | Use Case | |------|-------------|----------| | 🔍 `search_engine` | Web search with AI-optimized results | Research, fact-checking, current events | | 📄 `scrape_as_markdown` | Convert any webpage to clean markdown | Content extraction, documentation | | 🎯 `discover` | AI-ranked web search with intent-based relevance scoring | Deep research, RAG pipelines, competitive analysis | ### 💎 Pro Mode Tools (60+ Tools)

Click to see all Pro tools

| Category | Tools | Description | |----------|-------|-------------| | **Browser Control** | `scraping_browser.*` | Full browser automation | | **Web Data APIs** | `web_data_*` | Structured data extraction | | **E-commerce** | Product scrapers | Amazon, eBay, Walmart data | | **Social Media** | Social scrapers | Twitter, LinkedIn, Instagram | | **Maps & Local** | Location tools | Google Maps, business data | [📚 View complete tool documentation →](https://github.com/brightdata-com/brightdata-mcp/blob/main/assets/Tools.md)

--- ## 🎮 Try It Now! ### 🧪 Online Playground Try the Web MCP without any setup:

--- ## 🔧 Configuration ### Basic Setup ```json { "mcpServers": { "Bright Data": { "command": "npx", "args": ["@brightdata/mcp"], "env": { "API_TOKEN": "your-token-here" } } } } ``` ### Advanced Configuration ```json { "mcpServers": { "Bright Data": { "command": "npx", "args": ["@brightdata/mcp"], "env": { "API_TOKEN": "your-token-here", "PRO_MODE": "true", // Enable all 60+ tools "RATE_LIMIT": "100/1h", // Custom rate limiting "WEB_UNLOCKER_ZONE": "custom", // Custom unlocker zone "BROWSER_ZONE": "custom_browser", // Custom browser zone "POLLING_TIMEOUT": "600" // Polling timeout in seconds (default: 600) } } } } ``` ### Environment Variables | Variable | Description | Default | Example | |----------|-------------|---------|---------| | `API_TOKEN` | Your Bright Data API token (required) | - | `your-token-here` | | `PRO_MODE` | Enable all 60+ tools | `false` | `true` | | `RATE_LIMIT` | Custom rate limiting | unlimited | `100/1h`, `50/30m` | | `WEB_UNLOCKER_ZONE` | Custom Web Unlocker zone name | `mcp_unlocker` | `my_custom_zone` | | `BROWSER_ZONE` | Custom Browser zone name | `mcp_browser` | `my_browser_zone` | | `POLLING_TIMEOUT` | Timeout for web_data_* tools polling (seconds) | `600` | `300`, `1200` | | `BASE_TIMEOUT` | Request timeout for base tools in seconds (search & scrape) | No limit | `60`, `120` | | `BASE_MAX_RETRIES` | Max retries for base tools on transient errors (0-3) | `0` | `1`, `3` | | `GROUPS` | Comma-separated tool group IDs | - | `ecommerce,browser` | | `TOOLS` | Comma-separated individual tool names | - | `extract,scrape_as_html` | **Notes:** - `POLLING_TIMEOUT` controls how long web_data_* tools wait for results. Each second = 1 polling attempt. - Lower values (e.g., 300) will fail faster on slow data collections. - Higher values (e.g., 1200) allow more time for complex scraping tasks. --- ## 📚 Documentation

--- ## 🚨 Common Issues & Solutions

🔧 Troubleshooting Guide

### ❌ "spawn npx ENOENT" Error **Solution:** Install Node.js or use the full path to node: ```json "command": "/usr/local/bin/node" // macOS/Linux "command": "C:\\Program Files\\nodejs\\node.exe" // Windows ``` ### ⏱️ Timeouts on Complex Sites **Solution:** Increase timeout in your client settings to 180s ### 🔑 Authentication Issues **Solution:** Ensure your API token is valid and has proper permissions ### 📡 Remote Server Connection **Solution:** Check your internet connection and firewall settings [More troubleshooting →](https://github.com/brightdata-com/brightdata-mcp#troubleshooting)

--- ## 🤝 Contributing We love contributions! Here's how you can help: - 🐛 [Report bugs](https://github.com/brightdata-com/brightdata-mcp/issues) - 💡 [Suggest features](https://github.com/brightdata-com/brightdata-mcp/issues) - 🔧 [Submit PRs](https://github.com/brightdata-com/brightdata-mcp/pulls) - ⭐ Star this repo! Please follow [Bright Data's coding standards](https://brightdata.com/dna/js_code). --- ## 📞 Support

🐛 GitHub Issues
_{Report bugs & features}

📚 Documentation
_{Complete guides}

✉️ Email
_{support@brightdata.com}

Built with ❤️ by

_{The world's #1 web data platform}

⭐ Star us on GitHub • Read our Blog