--- name: open-web-unlocker-30c1c205ce89 description: > Fetch web pages and search results as clean markdown, structured JSON, or raw HTML. Use this skill when the task involves fetching a URL, scraping web content, or querying search engines (examples include reading articles, extracting product data, getting search results from Brave/Bing/DuckDuckGo, or handling JS-rendered and anti-bot pages). --- # Open Web Unlocker — Fetch Skill Open Web Unlocker fetches web pages and returns clean markdown, raw HTML, or structured JSON. It handles static pages, JS-rendered pages, anti-bot challenges, and search engine results — all via a single CLI command with no installation required. ## Quick start ```bash bunx open-web-unlocker fetch ``` Bun (`bunx`) is preferred. Node (`npx`) also works. ## Format selection ```bash bunx open-web-unlocker fetch --format markdown # default bunx open-web-unlocker fetch --format json bunx open-web-unlocker fetch --format html ``` **Which format to use:** | Format | When to use | |------------|--------------------------------------------------------------| | `markdown` | Default. Clean content with nav/footer/boilerplate stripped. Best for reading or summarizing pages. | | `json` | When you need structured extracted fields (title, author, price, etc.) | | `html` | When you need the full raw page including all elements | 50+ site-specific parsers produce high-quality markdown and JSON for common domains. Pages without a parser fall back to generic extraction, which may include more noise. ## Search engines Fetch search result pages directly — Open Web Unlocker parses them into structured results: ```bash bunx open-web-unlocker fetch "https://search.brave.com/search?q=query" bunx open-web-unlocker fetch "https://www.bing.com/search?q=query" bunx open-web-unlocker fetch "https://duckduckgo.com/?q=query" ``` Google is **not** supported. ## Timeout ```bash bunx open-web-unlocker fetch --timeout 45000 ``` Default per-strategy timeouts: ~8s for fetch, ~15s for browser. Increase `--timeout` for slow or JS-heavy pages. --- Source attribution: LiranYoffe Original project: https://github.com/LiranYoffe/open-web-unlocker/blob/f2acfbfa353b1d230a7f8a1de0158b3e9d8dc7ce/skills/open-web-unlocker/SKILL.md License: MIT License information: https://opensource.org/license/mit Original upstream instructions; downloaded from Mega AI Hub. ## Upstream license notice MIT License Copyright (c) 2025 Open Web Unlocker Contributors Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE. # Mega AI Hub resource metadata Creator / publisher: LiranYoffe Original project: https://github.com/LiranYoffe/open-web-unlocker/blob/f2acfbfa353b1d230a7f8a1de0158b3e9d8dc7ce/skills/open-web-unlocker/SKILL.md Attribution basis: Source repository record Fields of work: Data & Analytics, Marketing Roles: Content Marketer, Data Analyst, Growth Marketer, Market Research Analyst, SEO Specialist Specialties: API Tools: Bun Country applicability: Country not specified Classification basis: Source catalog labels Instruction SHA-256: c09cfbaff14af0d3befac9d835c6576a7a8360b4e18affe7d16ad56167eeeaec