Skip to main content
Gologin Web Unlocker is a single-endpoint scraping API for JS-heavy and protected websites. You send a URL, receive rendered page HTML/text, and process it in your own extraction pipeline.

​
Why use it as a Scraping API

  • One endpoint for any target URL
  • API-key auth, no browser orchestration required
  • HTML-first response that plugs into existing parsers
  • Easy fit for ETL, monitoring, AI ingestion, and data pipelines

​
Endpoint

GET https://parsing.webunlocker.gologin.com/v1/scrape?url={encoded_url}

​
Authentication

Send your API key in headers: 
apikey: <API_KEY>

​
Request model

NameInTypeRequiredDescription
urlquerystring (absolute URL)yesTarget URL to scrape

​
Quickstart

​
cURL

curl "https://parsing.webunlocker.gologin.com/v1/scrape?url=https%3A%2F%2Fexample.com" \
  -H "apikey: YOUR_API_KEY"

​
Python

import requests

response = requests.get(
    "https://parsing.webunlocker.gologin.com/v1/scrape",
    params={"url": "https://example.com"},
    headers={"apikey": "YOUR_API_KEY"}
)

print(response.status_code)
print(response.text[:500])

​
JavaScript (fetch)

const response = await fetch(
  "https://parsing.webunlocker.gologin.com/v1/scrape?url=" +
    encodeURIComponent("https://example.com"),
  { headers: { apikey: "YOUR_API_KEY" } }
);

const html = await response.text();
console.log(response.status, html.slice(0, 500));

​
Response behavior

Current response body is raw rendered HTML/text.
  • 200 -> success, body contains page HTML/text
  • 401 / 403 -> invalid or missing API key
  • 422 -> invalid or missing url
  • 429 -> rate limit
  • 500+ -> temporary server-side error

​
Retry guidance

Retry with exponential backoff for:
  • network errors
  • 408, 429, 500, 502, 503, 504

​
Scope note

Current public endpoint is HTML-first. Do not assume extra backend endpoints (for example screenshot/crawl/search/usage) unless explicitly documented and enabled for your account.

​
Official Node.js SDK

Install: 
npm i gologin-webunlocker

​
SDK quick start

import { WebUnlocker } from "gologin-webunlocker";

const client = new WebUnlocker({
  apiKey: process.env.GOLOGIN_WEBUNLOCKER_API_KEY!
});

const result = await client.scrape("https://example.com");
console.log(result.status);
console.log(result.content.slice(0, 500));

​
Constructor options

new WebUnlocker({
  apiKey: "wu_live_xxx",
  baseUrl: "https://parsing.webunlocker.gologin.com",
  timeoutMs: 15000,
  maxRetries: 2
});

​
Core SDK methods

  • scrape(url) -> normalized response object
  • scrapeRaw(url) -> native Response
  • buildScrapeUrl(url) -> full request URL

​
SDK-side derived methods (from returned HTML)

These are not separate backend endpoints; they are derived from API HTML in the SDK:
  • scrapeText(url) -> plain text
  • scrapeMarkdown(url) -> markdown
  • scrapeJSON(url) -> structured metadata (title, meta, links, headings)
  • batchScrape(urls, { concurrency }) -> helper for multiple scrape calls

​
Typed errors

  • WebUnlockerError
  • AuthenticationError
  • RateLimitError
  • APIError
  • TimeoutError
  • NetworkError
Mapping:
  • 401 / 403 -> AuthenticationError
  • 429 -> RateLimitError
  • 500+ -> APIError
  • timeout/abort -> TimeoutError
  • fetch/network failure -> NetworkError

​
CLI

gologin-webunlocker <command> <url> [options]
Commands:
  • scrape (raw HTML/text)
  • text (derived text)
  • markdown (derived markdown)
  • json (derived metadata)
Examples: 
gologin-webunlocker scrape https://example.com --api-key wu_live_xxx
GOLOGIN_WEBUNLOCKER_API_KEY=wu_live_xxx gologin-webunlocker text https://example.com
GOLOGIN_WEBUNLOCKER_API_KEY=wu_live_xxx gologin-webunlocker json https://example.com

​
Typical scraping use cases

  • price and catalog monitoring
  • lead and directory enrichment
  • market intelligence pipelines
  • content aggregation and indexing
  • LLM ingestion and extraction workflows

​
Source docs