WebRobot blog
Practical notes from the team behind the WebRobot AI web scraper: how to get data off any website, what the law actually says, and how teams run monitors in production. Every guide is written from real robot runs. Want to try one yourself? The interactive demo extracts live data in about a minute.
ENTRY 01
2026-06-18
9 min read
Three practical ways to get data off any website in 2026, compared honestly - and a step-by-step walkthrough of the fastest no-code route.
how to scrape data from a website
ENTRY 02
2026-06-24
8 min read
Scraping public data is legal in most jurisdictions - with real conditions. What the case law says and the checklist every team should follow.
is web scraping legal
ENTRY 03
2026-06-29
14 min read
Ten scraping tools compared on the things that actually matter: reliability after site changes, agent actions, pricing model, and setup time.
best web scraping tools
ENTRY 04
2026-07-16
9 min read
Every way to pay for web scraping in 2026, with real numbers: APIs, no-code tools, managed services, and the in-house build nobody budgets honestly.
how much does web scraping cost
ENTRY 05
2026-07-16
8 min read
Sites block scrapers on five signals: IP reputation, request rate, browser fingerprint, behavior, and session state. What fixes each one, and what does not.
web scraping without getting blocked
ENTRY 06
2026-07-16
8 min read
Scraping behind a login is technically easy and legally different from scraping public pages. The rules to check first, then the setup that works.
how to scrape a website that requires login
ENTRY 07
2026-07-03
8 min read
APIs are cleaner but cover a fraction of the web. A practical framework for choosing between official APIs and scraping - and when to combine both.
web scraping vs api
ENTRY 08
2026-09-13
8 min read
Every Octoparse plan with monthly, quarterly and annual prices, the add-on fees that land on top, and the point where a flat-priced alternative costs less.
octoparse pricing
ENTRY 09
2026-09-15
9 min read
Every Apify plan with monthly and annual prices, how prepaid usage and compute units turn into an invoice, the proxy and storage fees on top, and two worked monthly bills.
apify pricing
ENTRY 10
2026-09-21
9 min read
Every Zyte API tier at pay as you go and at each monthly commitment, what counts as a billable request, the add-on fees, where proxy traffic went after Smart Proxy Manager, and three worked monthly bills.
zyte pricing
ENTRY 11
2026-10-08
8 min read
Every WebHarvy license with price per user, what happens after the first year of updates, the costs that are not on the price page, and three worked bills against a cloud plan.
webharvy pricing
ENTRY 12
2026-10-07
8 min read
Both ScrapeHero price lists in one place: every Cloud plan with credits and cost per 1,000, the four full-service tiers with setup fees, what counts as a page, and three worked bills.
scrapehero pricing
ENTRY 13
2026-10-06
8 min read
Every PhantomBuster plan with execution hours, slots and credits, what an hour really costs on each tier, what happens when time runs out, three worked bills and when a flat scraping plan is the better buy.
phantombuster pricing
ENTRY 14
2026-10-05
8 min read
Every Web Scraper Cloud plan at monthly and annual billing, how URL credits and concurrent scrapers are counted, the Scale per-scraper ladder, the residential proxy add-on and three worked monthly bills.
webscraper io pricing
ENTRY 15
2026-10-02
8 min read
Every Browserless plan at monthly and annual billing, what a unit buys in browser time, proxy and captcha, three worked monthly bills and when a no-script scraper is the better buy.
browserless pricing
ENTRY 16
2026-10-01
9 min read
Every ZenRows plan rung at monthly and annual billing, what each request type costs in credits, how many pages each plan really buys, the billing rules and three worked monthly bills.
zenrows pricing
ENTRY 17
2026-09-30
9 min read
Every Decodo Web Scraping API plan with per-request rates by proxy type and rendering, the residential, mobile, ISP, datacenter and Site Unblocker ladders, the billing rules and four worked monthly bills.
decodo pricing
ENTRY 18
2026-09-29
9 min read
Every Oxylabs Web Scraper API plan with per-target rates, what each plan really buys, the proxy and Unblocker price ladders, the refund rules and four worked monthly bills.
oxylabs pricing
ENTRY 19
2026-09-28
8 min read
Every ScraperAPI plan at monthly and annual rates, the credit cost of each request type, how many pages each plan really buys, and four worked monthly bills.
scraperapi pricing
ENTRY 20
2026-09-27
8 min read
Every Price2Spy plan and add-on with the prices it no longer prints on its own pricing page, how URL counts decide the tier, a comparison with Prisync, and three worked monthly bills.
price2spy pricing
ENTRY 21
2026-09-26
9 min read
Every Bright Data product with its pay-as-you-go and Scale rates, which prices are 3-month promos, how the shared free tier, KYC and refunds work, and three worked monthly bills.
bright data pricing
ENTRY 22
2026-09-25
9 min read
Every Outscraper service with its free tier and per-1,000 rates, how Maps, contacts, email and phone charges stack on one lead, how the billing period works, and three worked monthly bills.
outscraper pricing
ENTRY 23
2026-09-22
9 min read
Every ScrapingBee plan with its credits and concurrency, what each request type costs in credits, how many pages a plan really buys, which responses are billed, and three worked monthly bills.
scrapingbee pricing
ENTRY 24
2026-09-17
9 min read
Every Firecrawl plan at both billing periods, what a credit buys on each endpoint, why structured extraction costs five times a raw page, the overage rates and three worked monthly bills.
firecrawl pricing
ENTRY 25
2026-09-16
9 min read
Every Browse AI plan and credit tier with monthly and annual prices, how rows, detail pages and premium sites turn into credits, and three worked monthly bills.
browse ai pricing
New entries are filed as the robot learns something worth writing down.
Describe the data you want. Get a clean spreadsheet back tomorrow morning, and every morning after.