Scrape multiple URLs

POST

/api/v2/crawler/scrape/batch

Last modified:2025-07-25 01:11:00

Request

Authorization

Add parameter in header

x-api-token

Example:

x-api-token: ********************

Body Params application/json

Example

{
    "urls": [
        "http://example.com"
    ],
    "formats": [
        "markdown"
    ],
    "onlyMainContent": true,
    "includeTags": [
        "string"
    ],
    "excludeTags": [
        "string"
    ],
    "headers": {},
    "waitFor": 0,
    "timeout": 30000,
    "browserOptions": {
        "sessionName": "string",
        "sessionTTL": "string",
        "sessionRecording": "string",
        "proxyCountry": "string",
        "proxyURL": "string",
        "fingerprint": "string"
    }
}

Request Code Samples

Shell

JavaScript

Java

Swift

PHP

Python

HTTP

Objective-C

Ruby

OCaml

Dart

curl --location --request POST 'https://api.scrapeless.com/api/v2/crawler/scrape/batch' \
--header 'x-api-token: <api-key>' \
--header 'Content-Type: application/json' \
--data-raw '{
    "urls": [
        "http://example.com"
    ],
    "formats": [
        "markdown"
    ],
    "onlyMainContent": true,
    "includeTags": [
        "string"
    ],
    "excludeTags": [
        "string"
    ],
    "headers": {},
    "waitFor": 0,
    "timeout": 30000,
    "browserOptions": {
        "sessionName": "string",
        "sessionTTL": "string",
        "sessionRecording": "string",
        "proxyCountry": "string",
        "proxyURL": "string",
        "fingerprint": "string"
    }
}'

Responses

🟢200OK

application/json

Successful response

Body

Example

{
    "success": true,
    "id": "string",
    "invalidURLs": [
        "string"
    ]
}

🟠402402

🟠429429

🔴500Server Error

Modified at 2025-07-25 01:11:00

Scrape a single URL

Cancel a batch scrape job