Step 1
Point it at the site
Paste the listing, category or search page. The bot loads it in a real browser, the way a visitor would.
A web scraping bot visits sites for you and writes what it finds into rows. WebRobot is a hosted one: you describe the data in a sentence, and the bot opens the pages, follows pagination and detail links, and delivers a clean sheet every day or every hour. Nothing to install, no proxies to rent, no script to repair when a site changes.
Plans start at $79 a month for 10,000 records. You pay for rows delivered, not for retries.
Robot console
No account needed Running · s Complete · rows
Four ways
| Route | You own | Where it breaks | Fits |
|---|---|---|---|
| A script you write | Code, server, proxies, scheduler, storage | Layout changes, IP blocks, a developer leaving | An engineering team with spare time |
| Browser extension bot | Your own machine, kept open and logged in | Laptop closed, site layout changes, no real scheduling | A one-off list pulled once |
| Scraping API | The parser, the schedule, the storage | Credits burn faster on protected sites, HTML still needs parsing | Developers who want to keep the parser (see the web scraping API) |
| Hosted bot (WebRobot) | The sentence that describes the data | Sites you may not access, logins you cannot supply | Teams that want finished rows without owning code |
Procedure
Step 1
Paste the listing, category or search page. The bot loads it in a real browser, the way a visitor would.
Step 2
"Company, phone, city, rating." The bot maps each field itself. No selectors, no XPath.
Step 3
Review the first rows, adjust the sentence if a column is off, then approve the job.
Step 4
Daily on Launch, hourly on Scale, into Google Sheets, Excel or the REST API.
Use cases
A store tracking 300 products against a few rivals gets a fresh price sheet each morning. The competitor price monitoring page shows the output and what it costs by catalog size.
Agencies and sales teams collect business names, phones and sites from directories and maps. See web scraping for lead generation.
Recruiters and real estate teams watch new postings and price drops the hour they appear.
PR teams collect headlines, publish dates and sources from the outlets on their beat with the news scraper.
Operations leads who run back-office and customer onboarding workflows use a bot to pull vendor portal statuses and public competitor pages into one tracking sheet.
Teams paying per request for HTML they still have to parse compare it with flat rows in the scraper alternatives hub.
Cost
| Cost line | Own script | WebRobot hosted bot |
|---|---|---|
| Setup | Developer days per site | One sentence and a test run |
| When a site changes | Someone fixes the parser | The bot re-reads the page and re-maps the fields |
| Browsers, proxies, scheduler | Rented and wired by you | Included |
| Monthly price | Servers and proxies plus time | $79 for 10,000 records, $249 for 100,000 |
| Billing unit | Whatever your vendors meter | Records delivered, not requests or retries |
Full limits are on WebRobot pricing. If you want a point-and-click route with no developer, the no code web scraper page prices five tools on one daily job, and the web scraping tool page covers the full product.
FAQ
Describe the columns, check a live run, and get fresh rows in Sheets, Excel or the API on a schedule. Plans from $79 a month.