ScrapingBee Fetch

使用 ScrapingBee API 的高级 JavaScript 网页渲染器，提取主要内容并返回干净的 Markdown。

Use this skill to render JavaScript on target websites and extract the main content. It returns clean Markdown optimized for LLM reading.

Setup

You need a ScrapingBee API key to use this skill. Set it as an environment variable:

export SCRAPINGBEE_API_KEY="your_api_key_here"

Or add it to a .env file in the directory where you run the script.

uv run fetch.py --url "https://example.com"

--no-render-js: Disable JavaScript rendering (faster, but might miss dynamic content).
--country-code <code>: Use a proxy from a specific country (e.g., us, uk, ru).
--wait <milliseconds>: Wait time in milliseconds before extracting content (default: 3000).
--no-block-ads: Disable ad blocking (ads are blocked by default to save bandwidth and speed up rendering).
--premium-proxy: Use a premium proxy (useful for highly protected websites).

Fetch a website using a US proxy and wait 5 seconds:

uv run fetch.py --url "https://example.com" --country-code us --wait 5000

Fetch a highly protected website using a premium proxy:

uv run fetch.py --url "https://example.com" --premium-proxy

Fetch a simple website without rendering JavaScript:

uv run fetch.py --url "https://example.com" --no-render-js