#WebCrawler API Documentation Single Markdown

Name: WebCrawler API Documentation Dataset
Creator: WebCrawler API

WebCrawler API is a developer tool with comprehensive developer documentation. The full documentation spans 181 pages and 725 KB, last crawled 3 weeks ago. This page reflects the latest available version.

WebCrawler API / latest

181 pages·708.22 KB·updated Mar 13, 2026

### preview

[](/)[WebCrawlerAPI](https://webcrawlerapi.com)

Search

⌘K

[Get your API access key here](https://dash.webcrawlerapi.com)

[Getting Started](/docs/getting-started)[API access key](/docs/access-key)[Job](/docs/job)

API

[POSTCrawl](/docs/api/crawl)[POSTScrape](/docs/api/scrape)[GETJob Status](/docs/api/job)[GETURLs](/docs/api/urls)[GETJob Markdown (Link)](/docs/api/markdown)[GETJob Markdown (Content)](/docs/api/markdown-content)[POSTCancel](/docs/api/cancel)[GETUsage Stats](/docs/api/usage)

Feed

[POSTCreate Feed](/docs/api/feed/feed-create)[GETGet Feed](/docs/api/feed/feed-get)[GETList Feeds](/docs/api/feed/feed-list)[GETFeed RSS](/docs/api/feed/feed-rss)[GETFeed JSON](/docs/api/feed/feed-json)[POSTManage Feeds](/docs/api/feed/feed-manage)

SDKs and Code Examples

[JavaScript](/docs/sdk/js)[Python](/docs/sdk/python)[PHP](/docs/sdk/php)[Java](/docs/sdk/java)[.NET](/docs/sdk/dotnet)[🔗🦜LangChain](/docs/sdk/langchain)[MCP Server](/docs/sdk/mcp)[n8n](/docs/sdk/n8n)[Make.com](/docs/sdk/make)[Zapier](/docs/sdk/zapier)[S3 Upload](/docs/actions/s3-upload)

[Crawling output format types](/docs/crawling-types)[Async requests and Webhooks](/docs/async-requests)[Any website to feed](/docs/feeds)[Errors](/docs/errors)[Rate Limits](/docs/rate-limits)[Caching](/docs/api/caching)

Guides

[Structured Outputs with Prompts](/docs/structured-outputs)[Content Filtering](/docs/guides/filters)[Content Cleaning](/docs/guides/cleaning)

[](https://github.com/webcrawlerapi)

API access key

==============

Copy MarkdownOpen

How to sign up and get an API key for Webcrawler API

To use the Webcrawler API you need to obtain an API key. The API key is used to authenticate your requests to the API.

To get an API key sign up and get your key at the [API key section](https://dash.webcrawlerapi.com/access).

The API key is a secret key that should be kept confidential. Do not share your API key in publicly accessible areas such as GitHub, client-side code, and so on. If you suspect that your API key has been compromised, you can regenerate it at any time.

Webcrawler API uses Bearer Token authentication scheme. You need to include the API key in the `Authorization` header of your requests, so the header will looks like this:

    Authorization: Bearer <PASTE YOUR API KEY HERE>

For example, to make your first request you can use the following curl command:

    curl -i --request POST \

      --url https://api.webcrawlerapi.com/v1/crawl \

      --header 'Authorization: Bearer 009b131d7080df28640e' \

      --header 'Content-Type: application/json' \

      --data '{

    	"items_limit": 5,

    	"url": "https://example.com",

        "scrape_type": "cleaned",

    }'

If you done everything correctly you will receive a response with a `200` status code and a JSON object with a `id` field. Example:

    {

        "id": "5f7b1b7b-7b7b-4b7b-8b7b-7b7b7b7b7b7b"

    }

### [Unauthorized error](#unauthorized-error)

If you receive an `401 Unauthorized` error with body like th

##About WebCrawler API

WebCrawler API is a web crawling and data scraping service that turns websites into content for RAG and LLM contexts. Its main purpose is to fetch and format page content via a simple API call for AI workflows. Key capabilities include production-ready crawling with proxies and anti-bot protection, accurate content extraction in Markdown or text, and easy no-code or code-based integrations with popular tools like Zapier, Make, and n8n. The official documentation covers 181 pages of technical reference. This entry reflects the current stable release.

category:[Developer Tools]

source: https://webcrawlerapi.com