Web services API
WEB Crawling
Get Crawl Status
Check the status and retrieve results of a crawl job
POST
Web services API
Get the current status and results of a crawl operation. For large crawls, results may be paginated.
Path Parameters
string
required
The ID of the crawl job to check
Response Fields
string
Current status of the crawl:
scraping, completed, or failedinteger
Total number of pages attempted to crawl
integer
Number of successfully crawled pages
integer
Number of credits consumed by the crawl
string
ISO 8601 timestamp when the crawl data expires
string
URL to retrieve next batch of data (for paginated results)
array
Example Request
Example Response
Status Codes
200 - Success
200 - Success
Status retrieved successfully
402 - Payment Required
402 - Payment Required
Insufficient credits
429 - Too Many Requests
429 - Too Many Requests
Rate limit exceeded
500 - Server Error
500 - Server Error
Server error or crawl failed
Authorizations
Enter your API key prefixed with 'Bearer '
Body
application/json
Response
200 - application/json
Successful response

