Plans
What each plan unlocks besides cheaper credits: requests at once, queueing, priority, retention.
Every plan uses the same credits. Paying more gets cheaper credits and these:
| Free | Go | Pro | Scale | |
|---|---|---|---|---|
| Requests running at once | 1 | 10 | 25 | 100 |
| Extra requests waiting their turn | — (refused) | 50 | 200 | 1,000 |
| Priority when the platform is busy | last | 3rd | 2nd | first |
| Logs kept | 7 days | 30 days | 90 days | 1 year |
| Stored files kept | 1 day | 7 days | 30 days | 90 days |
| Pages per crawl or batch | 10 | 100 | 500 | 2,000 |
| Longest run of one request | 1 min | 5 min | 15 min | 30 min |
| Support and marketplace reviews | first in line | first in line |
Go is any credit pack: buying one gets Go for good. Pro and Scale are subscriptions, monthly or yearly. See Pricing.
Requests at once
A batch counts one per page running; a crawl counts its concurrency (capped by your plan).
Past your plan's limit:
- Free: the request is refused at once with
429 TOO_MANY_CONCURRENT_REQUESTS: wait for the one running. - Paid plans: it waits in the queue, in order, until one of yours finishes. When the queue is full:
429 QUEUE_FULL.
A request that waits more than 2 minutes for a slot is answered 503 QUEUE_TIMEOUT (nothing ran, nothing billed). Retry it, or send it as an async job: jobs wait as long as needed.
Limits per request
A crawl may ask for at most your plan's pages (crawl.max_pages), a batch may list at most as many targets: more is refused with 403 PLAN_LIMIT before anything runs.
A request that runs longer than your plan allows is stopped on the engine and answered 504 REQUEST_TOO_LONG. In a batch the limit applies to each page; a crawl counts as one request. For long work, split it or send it as an async job per part.
Crawls always follow robots.txt (the crawl.robots: false option is ignored), unless the platform's admins decide otherwise.
Free trial and promo codes
A subscription may come with a free trial, shown on the Pricing page: once per account, the card is asked at checkout and charged when the trial ends unless you cancel before (from Manage subscription & invoices). The plan's credits are added when the trial starts.
The Stripe checkout page has an Add promotion code link: type a code there to get its discount.