Web API: Scrape a page (Auto), Fetch a page (plain request), Render a page (browser), Unblock a page (partner browser), Fetch a page from a residential IP, Render a page from a residential IP, Scrape a page with your own steps

Overview

Fetch any public URL and get the page back, whatever stands in front of it. Pick a strategy at a fixed price, a plain request (fetch), our browser (render), a partner's browser on its own IPs (unblock), a residential IP (residential) or our browser on one (render-residential); chain the ones you want with custom; or let scrape (Auto) try them cheapest first and charge for the one that got through. The web scraping guide explains the strategies, credits and failures.

Source: any public URL.

Try it live

Pick an endpoint and run it: real data, no signup, 5 free requests a day.

Endpoint

GET/v1/web/scrape

1 credit per request; +3 if a browser renders it, +4 if it needs a residential IP, +13 if a browser renders it on a residential IP, +10 if a captcha is solved

Examples

URL *url

The page to fetch: a full http(s) URL on a public host (ports 80 and 443 only).

Formatformat

What content holds: the page's html, markdown (best for LLMs) or plain text. Non-HTML pages (JSON, XML, plain text) come back as they are.

More options (6)

Renderrender

auto: a browser (ours or the unblocker) only when the page needs one (+3 when it does). true: always our browser, and the page after JavaScript ran (+3). false: plain requests only.

Proxyproxy

auto: static ISP IPs and the unblocker; a residential IP only when they're refused (+4 when it is, +13 with our browser). static: never residential. residential: residential IPs only.

Countrycountry

Fetch from a residential IP in this country (ISO code like us, gb, de); implies proxy=residential (+4).

Captchacaptcha

true: solve a captcha that blocks the browser (+10, only when one is solved). false: never pay for a solve.

Wait forwait_for

A CSS selector to wait for before returning, like .price or #reviews. Renders the page (+3).

Waitwait

Milliseconds to let the page settle after it loads, up to 10000. Renders the page (+3).

5 free tries a day, no signup

Press Run to fetch live data

Results come back as a table you can download as CSV, or as the raw JSON.

Endpoints

Scrape a page (Auto)GET /v1/web/scrape · 1 credit; +3 if a browser renders it, +4 if it needs a residential IP, +13 if a browser renders it on a residential IP, +10 if a captcha is solvedAny public page, escalating only as far as the site makes us. The price follows the strategy: 1–24 credits.

Fetch a page (plain request)GET /v1/web/fetch · 1 creditA plain request, from Cloudflare's network, then a static ISP IP as Chrome. 1 credit.

Render a page (browser)GET /v1/web/render · 4 credits; 14 if a captcha is solvedA real Chrome renders the page and clears JavaScript challenges. 4 credits.

Unblock a page (partner browser)GET /v1/web/unblock · 4 creditsA partner's browser on its own IPs, for sites that refuse ours (DataDome and the like). 4 credits.

Fetch a page from a residential IPGET /v1/web/residential · 5 creditsA plain request from a residential IP, in the country you pick. 5 credits.

Render a page from a residential IPGET /v1/web/render-residential · 14 credits; 24 if a captcha is solvedA real Chrome on a residential IP, for the hardest walls. 14 credits.

Scrape a page with your own stepsGET /v1/web/custom · 1 credit; +3 if a browser renders it, +4 if it needs a residential IP, +13 if a browser renders it on a residential IP, +10 if a captcha is solvedYour steps, in your order; you pay for the one that got the page.

Call it

Every endpoint is a GET with your key in the x-api-key header. For example, Scrape a page (Auto):

curl

curl "https://api.lurkapi.com/v1/web/scrape?url=https%3A%2F%2Fbooks.toscrape.com%2F&format=markdown" \
  -H "x-api-key: YOUR_API_KEY"

Get a free API key

Use it in Claude

Once LurkAPI is connected to Claude, each endpoint is a tool Claude can call:

Tool	What it does
`web_scrape`	Scrape a page (Auto): Any public page, escalating only as far as the site makes us. The price follows the strategy: 1–24 credits.
`web_fetch`	Fetch a page (plain request): A plain request, from Cloudflare's network, then a static ISP IP as Chrome. 1 credit.
`web_render`	Render a page (browser): A real Chrome renders the page and clears JavaScript challenges. 4 credits.
`web_unblock`	Unblock a page (partner browser): A partner's browser on its own IPs, for sites that refuse ours (DataDome and the like). 4 credits.
`web_residential`	Fetch a page from a residential IP: A plain request from a residential IP, in the country you pick. 5 credits.
`web_render_residential`	Render a page from a residential IP: A real Chrome on a residential IP, for the hardest walls. 14 credits.
`web_custom`	Scrape a page with your own steps: Your steps, in your order; you pay for the one that got the page.