Tools

Oxylabs

The Oxylabs Web Scraper API (realtime)

View as Markdown

Proxies Oxylabs’ Web Scraper API realtime (synchronous) endpoint — a single endpoint that blocks until the scrape result is ready:

POST /oxylabs   → https://realtime.oxylabs.io/v1/queries

POST only. Every control travels in the JSON body ({source, url, query, parse, render, …}) and is forwarded unchanged.

What the gateway injects and strips

Oxylabs authenticates with HTTP Basic auth built from your account username and password — reusing the Authorization header you use for your gateway token. So the gateway overwrites it with the injected credential:

  • The Authorization header is overwritten with the secret Oxylabs Basic credential. You never send your Oxylabs username or password; your gateway token is consumed by the gateway and never reaches Oxylabs.
  • Oxylabs has no query-param spelling of the credential, so nothing is dropped from the query string.

Example

$curl -X POST "$GATEWAY/oxylabs" \
>  -H "Authorization: Bearer $TOKEN" \
>  -H "Content-Type: application/json" \
>  -d '{"source": "universal", "url": "https://example.com"}'

The response is Oxylabs’ JSON, returned unchanged. For request and response fields, follow Oxylabs’ documentation — the gateway does not alter them.