WebScraping.AI API

by webscraping.ai

Overview

Web Scraping API with built-in proxies and JS rendering

WebScraping.AI is a development API from webscraping.ai. Requests are authenticated with an API key. It is served over HTTPS and allows browser requests (CORS). Its OpenAPI description documents 4 endpoints.

At a glance

Authentication: API key
HTTPS: Yes
CORS: Yes
Category: Development
Base URL: https://api.webscraping.ai
Version: 2.0.7
Endpoints: 4
OpenAPI: Specification ↗
Spec updated: 2023-03-06

Make a first request

Replace the placeholders; the documentation says exactly where credentials go.

cURL

curl -X GET "https://api.webscraping.ai/account" \
  -H "Accept: application/json" \
  -H "X-API-Key: YOUR_API_KEY"

JavaScript

const response = await fetch("https://api.webscraping.ai/account", {
  method: "GET",
  headers: {
    "Accept": "application/json",
    "X-API-Key": "YOUR_API_KEY",
  },
});
const data = await response.json();
console.log(data);

Python

import requests

response = requests.request(
    "GET",
    "https://api.webscraping.ai/account",
    headers={
    "Accept": "application/json",
    "X-API-Key": "YOUR_API_KEY",
    },
    timeout=30,
)
print(response.json())

Endpoints

Method	Path	What it does
GET	`/account`	Information about your account calls quota
GET	`/html`	Page HTML by URL
GET	`/selected`	HTML of a selected page area by URL and CSS selector
GET	`/selected-multiple`	HTML of multiple page areas by URL and CSS selectors