The Web Data Frontier Benchmark
Last updated October 30, 2026 · rerun regularly
Every web scraping vendor advertises a success rate between 98% and 100%, and they cannot all be right. So we built a test anyone can run. The Web Data Frontier Benchmark sends 17 providers the same 100 bot-protected websites, 5 attempts each, 8,500 live billable requests in total. In the run completed October 30, 2026, success rates ran from 27.6% to 98.6%. String placed first at 98.6%, 493 of 500 requests. The harness, the target list, the pass criteria, and every provider’s adapter are public, and the repository accepts your own API keys.
Which web scraping API has the highest success rate?
As of October 30, 2026, String has the highest success rate in the benchmark at 98.6%, followed by Scrape.do at 94.0%. Every provider, every target, same harness, same window. Numbers below come verbatim from the run completed October 30, 2026. Treat them as a snapshot of that date rather than a permanent ranking; the whole point of rerunning is that they move.
| Rank | Provider | Success rate | Latency score | Passed |
|---|---|---|---|---|
| 1 | String | 98.6% | 4.24s | 493/500 |
| 2 | Scrape.do | 94.0% | 5.08s | 470/500 |
| 3 | Context.dev | 93.0% | 10.96s | 465/500 |
| 4 | Scrapfly | 86.8% | 19.62s | 434/500 |
| 5 | ScrapingBee | 85.2% | 20.30s | 426/500 |
| 6 | Firecrawl | 81.2% | 8.87s | 406/500 |
| 7 | Zyte | 79.6% | 14.43s | 398/500 |
| 8 | Apify | 79.4% | 24.87s | 397/500 |
| 9 | ScraperAPI | 76.4% | 15.19s | 382/500 |
| 10 | Bright | 75.4% | 27.88s | 377/500 |
| 11 | Decodo | 71.2% | 28.29s | 356/500 |
| 12 | Nimble | 68.0% | 22.65s | 340/500 |
| 13 | Oxylabs | 67.4% | 16.62s | 337/500 |
| 14 | Browserbase | 43.0% | 18.01s | 215/500 |
| 15 | ZenRows | 41.8% | 21.91s | 209/500 |
| 16 | ScrapingAnt | 40.0% | 18.39s | 200/500 |
| 17 | Scrapingdog | 27.6% | 31.52s | 138/500 |
Key findings, October 2026
- In String's Web Data Frontier Benchmark (October 2026), String returned the real page on 98.6% of requests, the highest of 17 web scraping APIs tested on 100 bot-protected sites. Scrape.do was second at 94.0%.
- Across all 17 APIs in String's Web Data Frontier Benchmark (October 2026), 71.1% of 8,500 requests returned the real page, and the median API scored 76.4%.
- 6 of the 17 web scraping APIs in String's Web Data Frontier Benchmark (October 2026) returned the real page on fewer than 70% of requests.
- 400 requests in String's Web Data Frontier Benchmark (October 2026) came back with a success status but not the requested page, 16.3% of all failed requests.
- Akamai was the hardest major anti-bot system in String's Web Data Frontier Benchmark (October 2026): across 20 Akamai-protected sites, the 17 APIs averaged 64.8%, against 68.7% on DataDome and 70.8% on Cloudflare.
- Tickets & events sites were the hardest industry in String's Web Data Frontier Benchmark (October 2026), with a field average of 56.8% across 17 APIs.
- On 3 of 100 sites in String's Web Data Frontier Benchmark (October 2026), at least half of the 17 APIs never returned the real page.
More figures from this run, with third-party data on bots and anti-bot systems, are on the web scraping statistics page.
How the benchmark scores a request
Every provider receives the same 100 URLs and runs in its strongest anti-bot configuration. The request shape for each one lives in an adapter file in the repository, so the configuration is auditable rather than taken on faith. Requests go out live with a 90 second timeout and 5 attempts per page, paced so no provider is rate limited by test pressure. A miss is attributable to the target rather than to the harness.
A pass requires more than a successful status code. A 200 that returns a captcha interstitial or an empty JavaScript shell is a failure: the body must contain a marker, such as a product title or a listing address, that appears only on the real page. An error status, a timeout, or a body without the marker all count as failures.
The latency score is deliberately failure-aware. Per target it is the p75 of that provider’s successful attempts. A provider that returns nothing on a target inherits the p75 of the providers that did succeed there, and when nobody succeeds the target scores the 90 second timeout. A provider cannot look fast by failing quickly.
Success rate and speed
Success rate by anti-bot vendor
The 100 sites grouped by the anti-bot system in front of them, hardest first, with groups of fewer than three sites at the bottom. The field average is the mean success rate across all 17 providers on that group.
| Anti-bot vendor | Sites | Field average | String | Best other provider |
|---|---|---|---|---|
| AWS WAF | 6 | 61.0% | 100.0% | Scrape.do · 100.0% |
| Akamai | 20 | 64.8% | 97.0% | Scrape.do · 87.0% |
| DataDome | 19 | 68.7% | 97.9% | Context.dev · 100.0% |
| Cloudflare | 15 | 70.8% | 98.7% | Firecrawl · 98.7% |
| Proprietary / other | 27 | 75.6% | 100.0% | Scrape.do · 92.6% |
| Kasada | 3 | 80.0% | 100.0% | Scrape.do · 100.0% |
| PerimeterX | 9 | 81.8% | 97.8% | Scrape.do · 100.0% |
| Fastly | 1 | 61.2% | 100.0% | Scrape.do · 100.0% |
Every provider, every anti-bot vendor
| Provider | DataDome | Akamai | Cloudflare | PerimeterX | AWS WAF | Kasada | Fastly | Proprietary / other |
|---|---|---|---|---|---|---|---|---|
| String | 97.9% | 97.0% | 98.7% | 97.8% | 100.0% | 100.0% | 100.0% | 100.0% |
| Scrape.do | 97.9% | 87.0% | 93.3% | 100.0% | 100.0% | 100.0% | 100.0% | 92.6% |
| Context.dev | 100.0% | 79.0% | 96.0% | 97.8% | 100.0% | 100.0% | 100.0% | 92.6% |
| Scrapfly | 92.6% | 78.0% | 93.3% | 93.3% | 96.7% | 86.7% | 40.0% | 83.0% |
| ScrapingBee | 85.3% | 74.0% | 97.3% | 88.9% | 63.3% | 100.0% | 100.0% | 88.1% |
| Firecrawl | 85.3% | 80.0% | 98.7% | 100.0% | 83.3% | 100.0% | 100.0% | 60.0% |
| Zyte | 68.4% | 68.0% | 92.0% | 91.1% | 70.0% | 100.0% | 100.0% | 84.4% |
| Apify | 85.3% | 69.0% | 86.7% | 86.7% | 63.3% | 100.0% | 0.0% | 80.7% |
| ScraperAPI | 75.8% | 81.0% | 70.7% | 82.2% | 76.7% | 53.3% | 100.0% | 76.3% |
| Bright | 74.7% | 72.0% | 74.7% | 86.7% | 73.3% | 66.7% | 100.0% | 75.6% |
| Decodo | 65.3% | 68.0% | 73.3% | 86.7% | 73.3% | 100.0% | 0.0% | 70.4% |
| Nimble | 64.2% | 51.0% | 68.0% | 82.2% | 40.0% | 86.7% | 100.0% | 81.5% |
| Oxylabs | 67.4% | 53.0% | 68.0% | 91.1% | 16.7% | 100.0% | 0.0% | 80.0% |
| Browserbase | 31.6% | 28.0% | 6.7% | 73.3% | 16.7% | 33.3% | 0.0% | 80.7% |
| ZenRows | 52.6% | 57.0% | 33.3% | 73.3% | 36.7% | 60.0% | 0.0% | 17.8% |
| ScrapingAnt | 7.4% | 33.0% | 24.0% | 53.3% | 13.3% | 53.3% | 100.0% | 74.8% |
| Scrapingdog | 16.8% | 27.0% | 29.3% | 6.7% | 13.3% | 20.0% | 0.0% | 46.7% |
Success rate by industry
The same sites grouped by industry, in the same order.
| Industry | Sites | Field average | String | Best other provider |
|---|---|---|---|---|
| Tickets & events | 4 | 56.8% | 100.0% | Scrape.do · 100.0% |
| Retail & ecommerce | 17 | 63.1% | 100.0% | Scrape.do · 85.9% |
| Reviews & local | 6 | 64.7% | 96.7% | Scrape.do · 100.0% |
| Travel | 9 | 69.2% | 97.8% | Context.dev · 100.0% |
| Fashion & luxury | 11 | 71.2% | 100.0% | Context.dev · 100.0% |
| Marketplaces & classifieds | 10 | 72.0% | 100.0% | Scrape.do · 100.0% |
| Jobs & hiring | 5 | 73.4% | 100.0% | Scrape.do · 100.0% |
| Grocery & food | 5 | 75.1% | 88.0% | Nimble · 100.0% |
| Real estate | 7 | 75.5% | 100.0% | Scrape.do · 100.0% |
| Developer & research | 3 | 76.5% | 100.0% | Scrape.do · 100.0% |
| Social media | 8 | 79.7% | 100.0% | Scrape.do · 100.0% |
| News & finance | 9 | 82.4% | 95.6% | Scrape.do · 100.0% |
| Search engines | 2 | 62.9% | 100.0% | Scrape.do · 100.0% |
| Government | 1 | 63.5% | 100.0% | Scrape.do · 100.0% |
| Gaming & betting | 2 | 75.3% | 100.0% | Scrape.do · 100.0% |
| Health & pharmacy | 1 | 76.5% | 100.0% | Scrape.do · 100.0% |
Every provider, every industry
| Provider | Retail & ecommerce | Fashion & luxury | Marketplaces & classifieds | Travel | News & finance | Social media | Real estate | Reviews & local | Jobs & hiring | Grocery & food | Tickets & events | Developer & research | Search engines | Gaming & betting | Government | Health & pharmacy |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| String | 100.0% | 100.0% | 100.0% | 97.8% | 95.6% | 100.0% | 100.0% | 96.7% | 100.0% | 88.0% | 100.0% | 100.0% | 100.0% | 100.0% | 100.0% | 100.0% |
| Scrape.do | 85.9% | 90.9% | 100.0% | 86.7% | 100.0% | 100.0% | 100.0% | 100.0% | 100.0% | 72.0% | 100.0% | 100.0% | 100.0% | 100.0% | 100.0% | 100.0% |
| Context.dev | 75.3% | 100.0% | 90.0% | 100.0% | 100.0% | 100.0% | 100.0% | 100.0% | 88.0% | 80.0% | 100.0% | 100.0% | 100.0% | 100.0% | 100.0% | 80.0% |
| Scrapfly | 71.8% | 78.2% | 94.0% | 88.9% | 100.0% | 92.5% | 97.1% | 90.0% | 96.0% | 72.0% | 100.0% | 100.0% | 60.0% | 70.0% | 100.0% | 100.0% |
| ScrapingBee | 78.8% | 90.9% | 82.0% | 68.9% | 88.9% | 92.5% | 82.9% | 90.0% | 88.0% | 88.0% | 100.0% | 100.0% | 50.0% | 100.0% | 100.0% | 100.0% |
| Firecrawl | 76.5% | 90.9% | 82.0% | 88.9% | 88.9% | 25.0% | 100.0% | 83.3% | 96.0% | 80.0% | 100.0% | 66.7% | 60.0% | 100.0% | 100.0% | 100.0% |
| Zyte | 68.2% | 72.7% | 86.0% | 77.8% | 100.0% | 82.5% | 71.4% | 60.0% | 76.0% | 80.0% | 95.0% | 100.0% | 80.0% | 100.0% | 100.0% | 100.0% |
| Apify | 68.2% | 81.8% | 82.0% | 73.3% | 86.7% | 82.5% | 97.1% | 93.3% | 80.0% | 88.0% | 50.0% | 100.0% | 50.0% | 50.0% | 100.0% | 80.0% |
| ScraperAPI | 63.5% | 80.0% | 76.0% | 86.7% | 88.9% | 60.0% | 85.7% | 70.0% | 88.0% | 72.0% | 80.0% | 93.3% | 80.0% | 90.0% | 100.0% | 0.0% |
| Bright | 61.2% | 74.5% | 78.0% | 68.9% | 71.1% | 87.5% | 94.3% | 93.3% | 76.0% | 84.0% | 45.0% | 86.7% | 40.0% | 100.0% | 100.0% | 100.0% |
| Decodo | 63.5% | 81.8% | 78.0% | 68.9% | 100.0% | 92.5% | 82.9% | 63.3% | 80.0% | 76.0% | 0.0% | 53.3% | 0.0% | 50.0% | 0.0% | 100.0% |
| Nimble | 47.1% | 63.6% | 68.0% | 71.1% | 86.7% | 95.0% | 71.4% | 50.0% | 64.0% | 100.0% | 25.0% | 86.7% | 60.0% | 100.0% | 60.0% | 80.0% |
| Oxylabs | 67.1% | 47.3% | 84.0% | 64.4% | 97.8% | 87.5% | 62.9% | 50.0% | 84.0% | 84.0% | 0.0% | 66.7% | 50.0% | 50.0% | 0.0% | 100.0% |
| Browserbase | 36.5% | 32.7% | 32.0% | 22.2% | 77.8% | 100.0% | 42.9% | 0.0% | 20.0% | 60.0% | 30.0% | 33.3% | 100.0% | 50.0% | 0.0% | 80.0% |
| ZenRows | 54.1% | 69.1% | 48.0% | 44.4% | 51.1% | 25.0% | 20.0% | 40.0% | 60.0% | 40.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 80.0% |
| ScrapingAnt | 37.6% | 32.7% | 22.0% | 37.8% | 53.3% | 70.0% | 40.0% | 10.0% | 32.0% | 64.0% | 25.0% | 66.7% | 50.0% | 90.0% | 0.0% | 0.0% |
| Scrapingdog | 17.6% | 23.6% | 22.0% | 28.9% | 13.3% | 62.5% | 34.3% | 10.0% | 20.0% | 48.0% | 15.0% | 46.7% | 90.0% | 30.0% | 20.0% | 0.0% |
Success rate by website
The 100 targets, grouped into the 16 verticals they were drawn from, easiest first inside each one. A cell counts the attempts that returned the real page, out of 5. Columns run most accurate to least, opening on 5 providers; the button adds the other 12.
String returns every attempt on 95 of the 100 sites. It is beaten on 5: skyscanner.net, yellowpages.com, marketwatch.com, barrons.com, kroger.com. Those rows are in the table like any other, which is the only version of this page worth publishing.
Latency is left out of the cells on purpose. When a provider never returned a target, the run has no measurement to report there, only an inferred stand-in, and a column mixing the two would read as though both were measured.
5 of 17 providers, most accurate first.
| Site | Industry | String | Scrape.do | Context. | Scrapfly | Scraping | Firecrawl | Zyte | Apify | Scraper | Bright | Decodo | Nimble | Oxylabs | Browser | ZenRows | Scraping | Scraping |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Retail & ecommerce· 17 sites | ||||||||||||||||||
| verizon. | Retail & ecommerce | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 4/5 | 3/5 | 5/5 | 5/5 | 5/5 | 2/5 | 2/5 |
| alibaba. | Retail & ecommerce | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 5/5 | 5/5 | 5/5 | 3/5 | 5/5 | 5/5 | 5/5 | 3/5 | 5/5 | 4/5 | 5/5 | 3/5 |
| ashleyfurniture. | Retail & ecommerce | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 1/5 | 2/5 |
| target. | Retail & ecommerce | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 3/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 |
| walmart. | Retail & ecommerce | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 1/5 |
| att. | Retail & ecommerce | 5/5 | 3/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 0/5 | 5/5 | 0/5 | 5/5 | 5/5 | 4/5 | 3/5 |
| autozone. | Retail & ecommerce | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 4/5 | 3/5 | 5/5 | 4/5 | 0/5 | 4/5 | 0/5 | 0/5 | 0/5 | 0/5 |
| digikey. | Retail & ecommerce | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 1/5 | 4/5 | 3/5 | 5/5 | 5/5 | 0/5 | 0/5 | 1/5 | 2/5 |
| homedepot. | Retail & ecommerce | 5/5 | 5/5 | 4/5 | 2/5 | 5/5 | 5/5 | 5/5 | 4/5 | 4/5 | 4/5 | 5/5 | 0/5 | 5/5 | 0/5 | 3/5 | 0/5 | 0/5 |
| amazon. | Retail & ecommerce | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 0/5 | 5/5 | 0/5 | 3/5 | 5/5 | 5/5 | 1/5 |
| lowes. | Retail & ecommerce | 5/5 | 5/5 | 5/5 | 4/5 | 0/5 | 5/5 | 4/5 | 3/5 | 2/5 | 2/5 | 4/5 | 0/5 | 5/5 | 0/5 | 0/5 | 0/5 | 1/5 |
| bestbuy. | Retail & ecommerce | 5/5 | 2/5 | 5/5 | 0/5 | 5/5 | 0/5 | 0/5 | 5/5 | 2/5 | 5/5 | 3/5 | 0/5 | 5/5 | 0/5 | 0/5 | 0/5 | 0/5 |
| buybuybaby. | Retail & ecommerce | 5/5 | 5/5 | 0/5 | 4/5 | 5/5 | 5/5 | 3/5 | 0/5 | 4/5 | 0/5 | 5/5 | 1/5 | 5/5 | 0/5 | 0/5 | 0/5 | 0/5 |
| coupang. | Retail & ecommerce | 5/5 | 5/5 | 0/5 | 3/5 | 0/5 | 0/5 | 0/5 | 2/5 | 1/5 | 3/5 | 1/5 | 1/5 | 5/5 | 0/5 | 4/5 | 0/5 | 0/5 |
| mouser. | Retail & ecommerce | 5/5 | 3/5 | 0/5 | 3/5 | 2/5 | 5/5 | 2/5 | 1/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 |
| emag. | Retail & ecommerce | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 0/5 | 0/5 | 4/5 | 0/5 | 5/5 | 0/5 | 0/5 | 0/5 | 5/5 | 4/5 | 0/5 |
| temu. | Retail & ecommerce | 5/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 |
| Fashion & luxury· 11 sites | ||||||||||||||||||
| carters. | Fashion & luxury | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 3/5 | 0/5 |
| footlocker. | Fashion & luxury | 5/5 | 5/5 | 5/5 | 3/5 | 5/5 | 5/5 | 5/5 | 5/5 | 1/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 3/5 | 0/5 |
| macys. | Fashion & luxury | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 |
| ralphlauren. | Fashion & luxury | 5/5 | 5/5 | 5/5 | 2/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 3/5 | 1/5 | 3/5 | 4/5 | 1/5 | 0/5 |
| nike. | Fashion & luxury | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 3/5 | 0/5 | 5/5 | 5/5 | 2/5 |
| neimanmarcus. | Fashion & luxury | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 0/5 | 3/5 | 5/5 | 4/5 | 0/5 | 4/5 | 2/5 | 0/5 | 2/5 | 0/5 | 0/5 |
| canadagoose. | Fashion & luxury | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 3/5 | 0/5 | 5/5 | 5/5 | 5/5 | 0/5 | 4/5 | 5/5 | 3/5 |
| zara. | Fashion & luxury | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 5/5 | 5/5 | 2/5 | 3/5 | 5/5 | 5/5 | 0/5 | 0/5 | 0/5 | 5/5 | 0/5 | 3/5 |
| saksfifthavenue. | Fashion & luxury | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 2/5 | 5/5 | 5/5 | 3/5 | 1/5 | 0/5 | 0/5 | 0/5 | 3/5 | 0/5 | 0/5 |
| shop. | Fashion & luxury | 5/5 | 0/5 | 5/5 | 4/5 | 5/5 | 0/5 | 3/5 | 5/5 | 4/5 | 5/5 | 4/5 | 3/5 | 0/5 | 0/5 | 5/5 | 1/5 | 0/5 |
| us. | Fashion & luxury | 5/5 | 5/5 | 5/5 | 5/5 | 1/5 | 5/5 | 0/5 | 0/5 | 4/5 | 0/5 | 5/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 |
| Marketplaces & classifieds· 10 sites | ||||||||||||||||||
| goat. | Marketplaces & classifieds | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 3/5 |
| vinted. | Marketplaces & classifieds | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 4/5 | 0/5 | 5/5 | 5/5 |
| leboncoin. | Marketplaces & classifieds | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 4/5 | 4/5 | 0/5 | 0/5 | 2/5 |
| etsy. | Marketplaces & classifieds | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 5/5 | 4/5 | 4/5 | 3/5 | 5/5 | 5/5 | 5/5 | 3/5 | 5/5 | 0/5 | 0/5 |
| cars. | Marketplaces & classifieds | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 4/5 | 5/5 | 5/5 | 0/5 | 5/5 | 0/5 | 0/5 |
| ebay. | Marketplaces & classifieds | 5/5 | 5/5 | 0/5 | 4/5 | 5/5 | 5/5 | 5/5 | 3/5 | 4/5 | 4/5 | 0/5 | 3/5 | 5/5 | 0/5 | 4/5 | 0/5 | 1/5 |
| allegro. | Marketplaces & classifieds | 5/5 | 5/5 | 5/5 | 4/5 | 4/5 | 1/5 | 5/5 | 5/5 | 4/5 | 4/5 | 4/5 | 5/5 | 5/5 | 0/5 | 5/5 | 0/5 | 0/5 |
| autotrader. | Marketplaces & classifieds | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 0/5 | 4/5 | 0/5 | 5/5 | 5/5 | 5/5 | 1/5 | 5/5 | 0/5 | 5/5 | 1/5 | 0/5 |
| cargurus. | Marketplaces & classifieds | 5/5 | 5/5 | 5/5 | 5/5 | 3/5 | 5/5 | 0/5 | 4/5 | 1/5 | 2/5 | 5/5 | 0/5 | 3/5 | 0/5 | 0/5 | 0/5 | 0/5 |
| stockx. | Marketplaces & classifieds | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 5/5 | 0/5 | 3/5 | 3/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 |
| News & finance· 9 sites | ||||||||||||||||||
| coinmarketcap. | News & finance | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 0/5 |
| tradingview. | News & finance | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 1/5 |
| bloomberg. | News & finance | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 3/5 | 0/5 | 4/5 | 0/5 |
| marketwatch. | News & finance | 4/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 0/5 | 1/5 |
| wsj. | News & finance | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 2/5 | 3/5 | 5/5 | 4/5 | 5/5 | 5/5 | 3/5 | 0/5 | 0/5 |
| barrons. | News & finance | 4/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 5/5 | 3/5 | 5/5 | 0/5 | 0/5 |
| finance. | News & finance | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 0/5 |
| nytimes. | News & finance | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 2/5 |
| reuters. | News & finance | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 5/5 | 0/5 | 3/5 | 0/5 | 5/5 | 0/5 | 4/5 | 0/5 | 5/5 | 0/5 | 2/5 |
| Travel· 9 sites | ||||||||||||||||||
| airbnb. | Travel | 5/5 | 3/5 | 5/5 | 2/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 3/5 | 5/5 | 4/5 | 5/5 | 5/5 | 0/5 | 2/5 | 3/5 |
| delta. | Travel | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 0/5 | 5/5 | 0/5 |
| expedia. | Travel | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 3/5 | 5/5 | 5/5 | 2/5 | 5/5 | 5/5 | 5/5 | 5/5 |
| hyatt. | Travel | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 3/5 | 5/5 | 0/5 | 5/5 | 0/5 | 0/5 |
| tripadvisor. | Travel | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 3/5 | 5/5 | 4/5 | 3/5 | 4/5 | 5/5 | 5/5 | 0/5 | 5/5 | 0/5 | 1/5 |
| skyscanner. | Travel | 4/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 2/5 | 0/5 | 3/5 | 3/5 | 0/5 | 0/5 | 5/5 | 0/5 | 0/5 | 0/5 | 0/5 |
| kayak. | Travel | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 0/5 | 0/5 | 0/5 | 5/5 | 2/5 |
| booking. | Travel | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 5/5 | 0/5 | 4/5 | 3/5 | 5/5 | 5/5 | 0/5 | 0/5 | 4/5 | 0/5 | 1/5 |
| aa. | Travel | 5/5 | 1/5 | 5/5 | 3/5 | 1/5 | 0/5 | 0/5 | 3/5 | 5/5 | 1/5 | 2/5 | 0/5 | 2/5 | 0/5 | 1/5 | 0/5 | 1/5 |
| Social media· 8 sites | ||||||||||||||||||
| x. | Social media | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 |
| instagram. | Social media | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 0/5 | 5/5 | 5/5 | 0/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 5/5 |
| linkedin. | Social media | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 0/5 | 0/5 | 5/5 | 5/5 | 5/5 | 2/5 | 5/5 | 5/5 | 5/5 | 5/5 | 2/5 | 1/5 |
| pinterest. | Social media | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 0/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 5/5 |
| reddit. | Social media | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 3/5 | 4/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 1/5 | 1/5 |
| tiktok. | Social media | 5/5 | 5/5 | 5/5 | 5/5 | 2/5 | 0/5 | 5/5 | 4/5 | 4/5 | 5/5 | 5/5 | 3/5 | 5/5 | 5/5 | 0/5 | 1/5 | 2/5 |
| youtube. | Social media | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 4/5 | 5/5 |
| facebook. | Social media | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 0/5 | 5/5 | 5/5 | 0/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 0/5 | 5/5 | 1/5 |
| Real estate· 7 sites | ||||||||||||||||||
| redfin. | Real estate | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 0/5 | 1/5 |
| rightmove. | Real estate | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 3/5 |
| zillow. | Real estate | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 |
| zoopla. | Real estate | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 0/5 | 3/5 | 4/5 |
| apartments. | Real estate | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 0/5 | 0/5 | 0/5 | 1/5 | 0/5 |
| idealista. | Real estate | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 3/5 | 2/5 | 3/5 | 2/5 | 0/5 | 0/5 | 0/5 | 4/5 |
| realtor. | Real estate | 5/5 | 5/5 | 5/5 | 4/5 | 0/5 | 5/5 | 1/5 | 4/5 | 0/5 | 5/5 | 3/5 | 2/5 | 0/5 | 0/5 | 2/5 | 0/5 | 0/5 |
| Reviews & local· 6 sites | ||||||||||||||||||
| capterra. | Reviews & local | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 5/5 | 4/5 | 0/5 | 4/5 | 5/5 | 4/5 | 5/5 | 0/5 | 0/5 | 3/5 | 0/5 |
| crunchbase. | Reviews & local | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 0/5 | 5/5 | 0/5 | 5/5 | 0/5 | 0/5 |
| yellowpages. | Reviews & local | 4/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 0/5 | 0/5 | 3/5 |
| g2. | Reviews & local | 5/5 | 5/5 | 5/5 | 4/5 | 4/5 | 5/5 | 3/5 | 5/5 | 4/5 | 5/5 | 0/5 | 5/5 | 0/5 | 0/5 | 5/5 | 0/5 | 0/5 |
| trustpilot. | Reviews & local | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 |
| yelp. | Reviews & local | 5/5 | 5/5 | 5/5 | 5/5 | 3/5 | 0/5 | 0/5 | 4/5 | 2/5 | 5/5 | 0/5 | 1/5 | 0/5 | 0/5 | 2/5 | 0/5 | 0/5 |
| Grocery & food· 5 sites | ||||||||||||||||||
| allmenus. | Grocery & food | 5/5 | 3/5 | 5/5 | 5/5 | 3/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 4/5 | 5/5 | 5/5 | 5/5 | 0/5 | 3/5 | 3/5 |
| safeway. | Grocery & food | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 5/5 | 3/5 | 4/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 |
| asda. | Grocery & food | 5/5 | 0/5 | 5/5 | 3/5 | 5/5 | 5/5 | 5/5 | 5/5 | 1/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 3/5 | 4/5 |
| instacart. | Grocery & food | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 5/5 | 5/5 | 4/5 | 2/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 5/5 |
| kroger. | Grocery & food | 2/5 | 5/5 | 0/5 | 0/5 | 5/5 | 5/5 | 0/5 | 2/5 | 5/5 | 3/5 | 3/5 | 5/5 | 1/5 | 0/5 | 0/5 | 0/5 | 0/5 |
| Jobs & hiring· 5 sites | ||||||||||||||||||
| databricks. | Jobs & hiring | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 2/5 |
| monster. | Jobs & hiring | 5/5 | 5/5 | 5/5 | 5/5 | 3/5 | 5/5 | 0/5 | 5/5 | 3/5 | 5/5 | 3/5 | 0/5 | 5/5 | 0/5 | 0/5 | 0/5 | 0/5 |
| glassdoor. | Jobs & hiring | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 5/5 | 5/5 | 3/5 | 5/5 | 5/5 | 0/5 | 5/5 | 1/5 | 2/5 |
| ziprecruiter. | Jobs & hiring | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 4/5 | 5/5 | 2/5 | 5/5 | 0/5 | 0/5 | 0/5 | 1/5 |
| indeed. | Jobs & hiring | 5/5 | 5/5 | 2/5 | 4/5 | 4/5 | 5/5 | 5/5 | 0/5 | 4/5 | 0/5 | 4/5 | 4/5 | 1/5 | 0/5 | 5/5 | 2/5 | 0/5 |
| Tickets & events· 4 sites | ||||||||||||||||||
| seatgeek. | Tickets & events | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 3/5 | 3/5 | 4/5 | 0/5 | 5/5 | 0/5 | 1/5 | 0/5 | 0/5 | 1/5 |
| ticketmaster. | Tickets & events | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 1/5 | 5/5 | 0/5 | 0/5 | 0/5 | 0/5 | 5/5 | 0/5 | 5/5 | 0/5 |
| stubhub. | Tickets & events | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 2/5 |
| axs. | Tickets & events | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 1/5 | 3/5 | 1/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 |
| Developer & research· 3 sites | ||||||||||||||||||
| arxiv. | Developer & research | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 0/5 |
| github. | Developer & research | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 0/5 | 5/5 | 5/5 |
| stackoverflow. | Developer & research | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 3/5 | 3/5 | 3/5 | 0/5 | 0/5 | 0/5 | 0/5 | 2/5 |
| Gaming & betting· 2 sites | ||||||||||||||||||
| sportsbook. | Gaming & betting | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 4/5 | 3/5 |
| roblox. | Gaming & betting | 5/5 | 5/5 | 5/5 | 2/5 | 5/5 | 5/5 | 5/5 | 0/5 | 5/5 | 5/5 | 0/5 | 5/5 | 0/5 | 0/5 | 0/5 | 5/5 | 0/5 |
| Search engines· 2 sites | ||||||||||||||||||
| google. | Search engines | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 1/5 | 3/5 | 5/5 | 5/5 | 3/5 | 0/5 | 1/5 | 5/5 | 5/5 | 0/5 | 0/5 | 5/5 |
| bing. | Search engines | 5/5 | 5/5 | 5/5 | 1/5 | 5/5 | 5/5 | 5/5 | 0/5 | 3/5 | 1/5 | 0/5 | 5/5 | 0/5 | 5/5 | 0/5 | 5/5 | 4/5 |
| Government· 1 site | ||||||||||||||||||
| congress. | Government | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 5/5 | 0/5 | 3/5 | 0/5 | 0/5 | 0/5 | 0/5 | 1/5 |
| Health & pharmacy· 1 site | ||||||||||||||||||
| goodrx. | Health & pharmacy | 5/5 | 5/5 | 4/5 | 5/5 | 5/5 | 5/5 | 5/5 | 4/5 | 0/5 | 5/5 | 5/5 | 4/5 | 5/5 | 4/5 | 4/5 | 0/5 | 0/5 |
Attempts returning the real page, out of 5, per site · Web Data Frontier Benchmark · 100 targets · 500 requests per provider · October 30, 2026
Past runs
This page always carries the current run. Every run also gets a dated write-up covering what moved and why, and those are never edited after publication, so each one stays an accurate record of its own date.
Questions
What is the Web Data Frontier Benchmark?
An open-source test of how reliably web scraping providers return content from bot-protected pages. Each run sends 17 providers the same 100 real URLs, 5 attempts each, through adapters anyone can read. The harness, the target list, and the pass criteria are public, and the repo takes your own API keys.
What counts as a successful request?
A 2xx status is not enough. The response body has to contain a marker that appears only on the real page, such as a product title or a listing address. A captcha interstitial returning HTTP 200 counts as a failure, and so does an empty JavaScript shell.
How is the latency score calculated?
Per target, it is the p75 of that provider's successful attempts. A provider that returns nothing on a target inherits the p75 of the providers that did succeed there, and if nobody succeeds the target scores the 90 second timeout. The score refuses to reward a provider for failing quickly.
String built this benchmark and ranks first in it. Why trust it?
You should not have to. Everything needed to check the result is public: the harness, the target list, the pass criteria, and every provider's adapter. Run it with your own keys. If a provider is configured badly, the adapter is one short file and a pull request fixes it, which has already happened once.
How often does it run?
The benchmark reruns on a regular cadence and this page always carries the current numbers. Each run also gets a dated write-up in the blog, listed below, and those are never edited after publication.