Unblock a page (partner browser)

When to use this

Pass a url; a partner's browser visits it from its own IPs and returns the HTML the site sent, before JavaScript runs. It gets through walls that refuse our IPs, DataDome above all; it can't pick a country and doesn't report where redirects ended (url is the one you asked for). Usually 15–35 s. Always 4 credits, charged only when the page comes back; a call that's walled or can't reach the site fails with 502 upstream_error and costs nothing. For a page a site walls against this strategy, /v1/web/scrape (Auto) tries the others in turn, or /v1/web/custom chains the ones you pick. Pages over 2 MB are cut (truncated); use format=markdown for LLMs. The web scraping guide explains each strategy.

Parameters

All parameters go in the query string.

Example request

Replace YOUR_API_KEY with your key, or set LURKAPI_KEY for the code. Get a free key.

curl "https://api.lurkapi.com/v1/web/unblock?url=https%3A%2F%2Fbooks.toscrape.com%2F&format=markdown" \
  -H "x-api-key: YOUR_API_KEY"

const params = new URLSearchParams({
  url: "https://books.toscrape.com/",
  format: "markdown",
});
const res = await fetch(`https://api.lurkapi.com/v1/web/unblock?${params}`, {
  headers: { "x-api-key": process.env.LURKAPI_KEY },
});
const data = await res.json();
if (!data.success) throw new Error(`${data.code}: ${data.error}`);
console.log(data.content);

import os
import requests

res = requests.get(
    "https://api.lurkapi.com/v1/web/unblock",
    params={
        "url": "https://books.toscrape.com/",
        "format": "markdown",
    },
    headers={"x-api-key": os.environ["LURKAPI_KEY"]},
    timeout=95,
)
data = res.json()
if not data["success"]:
    raise RuntimeError(f"{data['code']}: {data['error']}")
print(data["content"])

Example response

A real response from this endpoint, captured from the live API and trimmed to a couple of items. Strings over 96 characters (mostly signed media URLs) are cut short and end in ….

{
  "success": true,
  "credits_remaining": 9996,
  "credits_charged": 4,
  "status": 200,
  "url": "https://books.toscrape.com/",
  "content_type": "text/html",
  "content": "[Books to Scrape](https://books.toscrape.com/index.html) We love being s…",
  "truncated": false,
  "via": "unblocker",
  "captcha": null,
  "attempts": [
    {
      "via": "unblocker",
      "ms": 9260,
      "status": 200,
      "wall": null,
      "error": null
    }
  ],
  "billing": {
    "mode": "fixed",
    "credits": 4,
    "breakdown": {
      "base": 4
    },
    "note": null
  }
}

Response fields

Every field of a successful response. [] marks a list: a[].b is the b of each item in a. nullable fields can be null; optional fields can be missing.

Caching and freshness

Not cached: every call is answered fresh.

Errors

Errors return { success: false, error, code, docs } with the HTTP status below. Validation errors, 401/402/429 rejections and 5xx failures are free; not_found is charged (how charging works). All error codes.

Use it in Claude

Once LurkAPI is connected to Claude, this endpoint is the web_unblock tool. Ask in plain English, for example:

Use LurkAPI's web_unblock with url "https://books.toscrape.com/", format "markdown" and summarize what you find.

Claude calls web_unblock with arguments like these, and each call costs 4 credits:

{
  "url": "https://books.toscrape.com/",
  "format": "markdown"
}

Tool results skip nulls and empty lists to save tokens.