1
Get an API key
Sign in at go-fetch.io, open API keys and create a key with the read
and write scopes. The key is shown once: copy it now.Jobs spend prepaid credits from your organization’s balance. If your balance is empty, write to
support@go-fetch.io and we’ll add credits to your organization.Keep the key in an environment variable, never in code:
2
Install the SDK (Python)
3
Run a job
A job runs in the background. The SDK’s The create call answers
call() waits until it finishes; with the REST API you create it, then
check on it.201 with the job. Keep its id.4
Wait for it to finish (REST API)
Check the job until A finished job reads
is_terminal is true. Every few seconds is enough; a webhook saves you the
polling."status": "completed", with items_scraped (the billed result count) and actual_cost
(what it was charged, in USD).5
Read the results (REST API)
Results come a page at a time, up to 100 per page.The answer is
{"total", "offset", "limit", "count", "results"}. Each item in results is one row; for
Instagram, one post. The first row for each profile is a profile_info summary row; posts have type Image,
Video or Sidecar. total also counts $0 status rows, such as profile_error, so it can exceed items_scraped.Next steps
Jobs and results
Statuses, retries, paging and retention.
Instagram guide
Every input and output field of this scraper.
Webhooks
Get told when a job finishes, instead of polling.
Billing
How a job’s cost is worked out, and how to cap it.