Scraping API
The Scraping API takes a URL and returns the page. Proxy selection, browser rendering, ban detection and retries all happen on our side.
| Endpoint | http://api.scraping.rayobyte.com/ |
| Auth | a token query parameter |
| Billing | per scrape, from a dollar balance |
| Sub-accounts | not supported |
Get your token
Section titled “Get your token”-
Open app.rayobyte.com and go to Scraping API → Get Started.
-
Your token is shown under API Token. One is generated automatically the first time you open the page.
Scrape a page
Section titled “Scrape a page”curl "http://api.scraping.rayobyte.com/?token=YOUR_TOKEN&url=https://www.bing.com"POST with options
Section titled “POST with options”Sending JSON lets you choose a scraping module and pass module-specific options.
curl -X POST "http://api.scraping.rayobyte.com/?token=YOUR_TOKEN" \ -H "Content-Type: application/json" \ -d '{"url":"https://scrapingrobot.com/about-us","module":"HtmlRequestScraper"}'| Field | Required | Description |
|---|---|---|
url |
yes | The page to fetch |
module |
no | Which scraper to run. Defaults to a plain HTML fetch. |
module selects how the page is retrieved and parsed — a plain HTTP fetch, a
real browser, or a site-specific extractor. HtmlRequestScraper is the general
purpose HTML fetch.
Check your balance
Section titled “Check your balance”curl "http://api.scraping.rayobyte.com/balance?token=YOUR_TOKEN"The dashboard shows the same figure alongside an estimate of how many scrapes remain at the standard rate.
Was this page helpful?
Thanks — that helps us fix it.