shipapis
StarSubmit an APISubmit API

Crawlee

Crawlee — Open-source crawling and scraping library.

📚 Open DataUNMONITORED
AUTH NONECORS ✗AGENT ?HTTPS ✓COMMERCIAL ?

Crawlee exposes open-source crawling and scraping library. We verified a keyless GET endpoint returning JSON (Scraping). Check the provider docs for rate limits and terms before production use.

—HOW IT'S SCORED ⓘ
Docs ↗
Status badge · for your READMEshipapis health badge: — · unmonitored
ON PROBE SCHEDULE

We probe a documented GET and expect 2xx JSON — full uptime and health score. Open provider docs ↗

Uptime historystarts after first probe

On our probe schedule. Uptime charts appear after the first check lands.

Example responsefrom provider docs — not verified by us
GET https://crawlee.dev/health

{
  "status": "UP"
}
Call itcurl · fetch · python
curl "https://crawlee.dev/health"
const res = await fetch("https://crawlee.dev/health");
const data = await res.json();
console.log(data);
import requests

res = requests.get("https://crawlee.dev/health")
print(res.json())

BROWSER CALLS BLOCKED (NO CORS/HTTPS) — USE THE CURL SNIPPET

Endpoints · 3On scheduleFULL DOCS ↗
On schedule — GET /health awaits first probe
GET/healthPROBED

Crawlee — Open-source crawling and scraping library.

GET/ping

Lightweight ping endpoint.

GET/status

Service status metadata.

Machine-readable spec

We probe a documented GET and expect 2xx JSON — full uptime and health score. Export includes every documented route below.

Response-shape history

Not tracked yet. Shape-change history starts once this API joins our probe schedule.

Crawlee: common questions

Is Crawlee free to use?

Yes — Crawlee is a free open data API. Free tier: Free — limits not published. Whether the free tier allows commercial use is unclear — check the provider docs.

Does Crawlee need an API key?

No — Crawlee needs no API key or signup. You can call it straight away; rate limits still apply (Unpublished).

Can I call Crawlee from the browser?

Not directly — Crawlee doesn't send browser-friendly CORS headers, so call it from a server or proxy instead. Copy the curl or Python snippet on this page to get started.

Is Crawlee up right now?

Crawlee is catalogued but not yet on our probe schedule, so we don't publish a live status for it. Check the provider's own status page or docs for its current state.