# Web API

> Any public web page as HTML, markdown or text, past bot walls and captchas.

- **Platform:** [Web](https://lurkapi.com/docs/web.md) (any public URL)
- **Web page:** https://lurkapi.com/docs/web

## Overview

Fetch any public URL and get the page back, whatever stands in front of it. Pick a strategy at a fixed price, a plain request (`fetch`), our browser (`render`), a partner's browser on its own IPs (`unblock`), a residential IP (`residential`) or our browser on one (`render-residential`); chain the ones you want with `custom`; or let `scrape` (Auto) try them cheapest first and charge for the one that got through. The [web scraping guide](https://lurkapi.com/docs/web-scraping.md) explains the strategies, credits and failures.

Source: any public URL.

## Try it live

Pick an endpoint and run it: real data, no signup, 5 free requests a day.

Live playground: https://lurkapi.com/docs/web#try

## Endpoints

- [Scrape a page (Auto)](https://lurkapi.com/docs/web/scrape.md): Any public page, escalating only as far as the site makes us. The price follows the strategy: 1–24 credits. (GET /v1/web/scrape · 1 credit; +3 if a browser renders it, +4 if it needs a residential IP, +13 if a browser renders it on a residential IP, +10 if a captcha is solved)
- [Fetch a page (plain request)](https://lurkapi.com/docs/web/fetch.md): A plain request, from Cloudflare's network, then a static ISP IP as Chrome. 1 credit. (GET /v1/web/fetch · 1 credit)
- [Render a page (browser)](https://lurkapi.com/docs/web/render.md): A real Chrome renders the page and clears JavaScript challenges. 4 credits. (GET /v1/web/render · 4 credits; 14 if a captcha is solved)
- [Unblock a page (partner browser)](https://lurkapi.com/docs/web/unblock.md): A partner's browser on its own IPs, for sites that refuse ours (DataDome and the like). 4 credits. (GET /v1/web/unblock · 4 credits)
- [Fetch a page from a residential IP](https://lurkapi.com/docs/web/residential.md): A plain request from a residential IP, in the country you pick. 5 credits. (GET /v1/web/residential · 5 credits)
- [Render a page from a residential IP](https://lurkapi.com/docs/web/render-residential.md): A real Chrome on a residential IP, for the hardest walls. 14 credits. (GET /v1/web/render-residential · 14 credits; 24 if a captcha is solved)
- [Scrape a page with your own steps](https://lurkapi.com/docs/web/custom.md): Your steps, in your order; you pay for the one that got the page. (GET /v1/web/custom · 1 credit; +3 if a browser renders it, +4 if it needs a residential IP, +13 if a browser renders it on a residential IP, +10 if a captcha is solved)

## Call it

Every endpoint is a `GET` with your key in the `x-api-key` header. For example, [Scrape a page (Auto)](https://lurkapi.com/docs/web/scrape.md):

curl:

```bash
curl "https://api.lurkapi.com/v1/web/scrape?url=https%3A%2F%2Fbooks.toscrape.com%2F&format=markdown" \
  -H "x-api-key: YOUR_API_KEY"
```

[Get a free API key](https://lurkapi.com/login?next=/dashboard)

## Use it in Claude

Once LurkAPI is [connected to Claude](https://lurkapi.com/docs.md#claude), each endpoint is a tool Claude can call:

| Tool | What it does |
| --- | --- |
| `web_scrape` | [Scrape a page (Auto)](https://lurkapi.com/docs/web/scrape.md): Any public page, escalating only as far as the site makes us. The price follows the strategy: 1–24 credits. |
| `web_fetch` | [Fetch a page (plain request)](https://lurkapi.com/docs/web/fetch.md): A plain request, from Cloudflare's network, then a static ISP IP as Chrome. 1 credit. |
| `web_render` | [Render a page (browser)](https://lurkapi.com/docs/web/render.md): A real Chrome renders the page and clears JavaScript challenges. 4 credits. |
| `web_unblock` | [Unblock a page (partner browser)](https://lurkapi.com/docs/web/unblock.md): A partner's browser on its own IPs, for sites that refuse ours (DataDome and the like). 4 credits. |
| `web_residential` | [Fetch a page from a residential IP](https://lurkapi.com/docs/web/residential.md): A plain request from a residential IP, in the country you pick. 5 credits. |
| `web_render_residential` | [Render a page from a residential IP](https://lurkapi.com/docs/web/render-residential.md): A real Chrome on a residential IP, for the hardest walls. 14 credits. |
| `web_custom` | [Scrape a page with your own steps](https://lurkapi.com/docs/web/custom.md): Your steps, in your order; you pay for the one that got the page. |