All notable changes to this project will be documented in this file.
ask_brightdata_assistant: ask Sophie, Bright Data's support assistant, about products, zones, errors or setup. Pass the returneddialog_idto ask a follow-up. On by default and in every group, as on the hosted server.
- Playwright is pinned to 1.64.1, the same version as the hosted server.
- BREAKING: The
discovertool and its Discover API integration. It was in every tool group and on by default, so it is no longer served in any config. Usesearch_engineorsearch_engine_batchto find sources andscrape_as_markdownorscrape_batchto read them. POLLING_TIMEOUT. The AI insights tools wait up to 600 seconds, as before. Configs that set it keep working; it is ignored.
- All tools are on by default, including the browser tools,
scrape_as_html,search_datasetandsession_stats. SetGROUPSorTOOLSto limit the server to those tools only. - Results from search, scrape, scraper, dataset and browser tools are marked as untrusted web content, so the model treats text inside them as data, not instructions. Error bodies from scraped sites are marked too.
- The
web_scraping_strategyanddiagnose_scraping_approachprompts are reformatted, and no longer describe tools by cost. - The Docker image runs on Node.js 24.
PRO_MODE. Existing configs that set it keep working; it is ignored.
- 46
web_data_*tools (Amazon, LinkedIn, Instagram, TikTok, YouTube, npm, PyPI and others). The scraper tools cover the same scrapers and 1,200+ more:search_scrapers→get_scraper_details→run_scraper. web_data_grok_ai_insightsandweb_data_reuter_news. Their scrapers no longer exist, so these tools always failed.
web_data_chatgpt_ai_insightsandweb_data_perplexity_ai_insightsare renamed tochatgpt_ai_insightsandperplexity_ai_insights.- Existing configs keep working. Old group IDs (
ecommerce,social,business,finance,research,app_stores,travel,code) now enable the scraper tools, and oldweb_data_*names inTOOLSenable the scraper tools or the renamed AI tools. - Scraper tool requests send the scraper's dataset ID and method in
x-mcp-dataset-idandx-mcp-methodheaders, so failed runs can be traced to a scraper. - If you installed the
bright-data-mcp,competitive-intelorprice-comparisonskills, update them: older versions tell the agent to use the removed tools.
- Web Scraper API tools:
search_scrapers,get_scraper_details,run_scraper,get_scraper_progress,get_scraper_resultsandrefresh_scrapers. They give access to all 1,200+ pre-built scrapers from a catalog that updates itself, with no hardcoded list. On by default, or select them with the newscrapersgroup. run_scraperwaits up to 45 seconds. If the data is not ready by then, it returns a snapshot ID forget_scraper_progressandget_scraper_results.- Content gate: when page content from
scrape_as_markdown,search_engine,extractor their batch variants looks like instructions to change the MCP configuration, the server asks the user (via MCP elicitation) before returning it. Configure it withCONTENT_GATEandCONTENT_GATE_TIMEOUT(PR #190).
- Credentials embedded in URLs (
scheme://user:pass@host) are now redacted from error output.
- Hardened
scrape_batcherror handling to always report failed requests as sanitized error strings instead of raw error objects.
- Errors thrown from tools are now re-thrown as sanitized
Errorinstances. Messages for HTTP and network failures are unchanged; non-Errorthrows are now reported asTool execution failed.
- Fixed a broken string concatenation in the usage-limit error message
that caused a
TypeErrorinstead of the intended error.
- Fixed compatibility with updated Playwright API: replaced deprecated
page._snapshotForAI()withpage.ariaSnapshot({ mode: 'ai' }), restoring correct functionality ofscraping_browser_snapshotand all ref-based browser automation tools
- Added
reddit_commentstool to collect Reddit post comments
search_datasettool to search supported datasets by a filter and get matching records back directly via the fast search API (PR #142)list_dataset_fieldstool to discover a dataset's filterable fields (name, type, description) before building a filter (PR #142)
- Client name logging and header passthrough for improved observability (PR #75)
- ARIA ref-based browser automation for more reliable element interactions (PR #65)
- ARIA snapshot filtering for better element targeting
- Network request tracking in browser sessions
- MCP Registry support (PR #71)
scraping_browser_snapshottool to capture ARIA snapshotsscraping_browser_click_ref,scraping_browser_type_ref,scraping_browser_wait_for_reftools using ref-based selectorsscraping_browser_network_requeststool to track HTTP requests
- Enhanced search engine tool to return JSON with only relevant fields (PR #57)
- Added
fixed_valuesparameter to reduce token usage (PR #60) - Browser tools now use ARIA refs instead of CSS selectors for better reliability
- Stop polling on HTTP 400 errors in web data tools (PR #64)
- Legacy selector-based tools (
scraping_browser_click,scraping_browser_type,scraping_browser_wait_for) replaced by ref-based equivalents scraping_browser_linkstool deprecated in favor of snapshot-based approach
- Updated browser authentication to use API_TOKEN instead of previous authentication method
- BROWSER_ZONE is now an optional parameter, the deafult zone is
mcp_browser - Removed duplicate web_data_ tools
- Fixed GitHub references and repository settings
- Fixed spelling errors and improved coding conventions
- Converted files back to Unix line endings for consistency
- Added 23 new web data tools for enhanced data collection capabilities
- Added progress reporting functionality for better user feedback
- Added default parameter handling for improved tool usability
- Improved coding conventions and file formatting
- Enhanced web data API endpoints integration
- Added Bright Data MCP with Claude demo video to README.md
- Updated documentation with video demonstrations
- Bumped FastMCP version for improved performance
- Updated README.md with additional documentation
- Added 12 new WSAPI endpoints for enhanced functionality
- Changed to polling mechanism for better reliability
- Applied dos2unix formatting for consistency
- Updated Docker configuration
- Updated smithery.yaml configuration
- Added domain-based browser sessions to avoid navigation limit issues
- Added automatic creation of required unlocker zone when not present
- Fixed browser context maintenance across tool calls with current domain tracking
- Minor lint fixes
- Initial release of Bright Data MCP server
- Browser automation capabilities with Bright Data integration
- Core web scraping and data collection tools
- Smithery.yaml configuration for deployment in Smithery.ai
- MIT License
- Demo materials and documentation
- Created comprehensive README.md
- Added demo.md with usage examples
- Created examples/README.md for sample implementations
- Added Tools.md documentation for available tools
The 1.9.x series focuses on expanding web data collection capabilities and improving authentication mechanisms. Key highlights include the addition of 23 new web data tools.
The 1.8.x series introduced significant improvements to browser session management, WSAPI endpoints, and overall system reliability. Notable features include domain-based sessions and automatic zone creation.
Initial stable release providing core MCP server functionality for Bright Data integration with comprehensive browser automation and web scraping capabilities.