# String > String is a web scraping API for reliable web data. Fetch any page on the web - anti-bot handling built in, and you only pay when content comes back. This file is generated from the site's source content. It is a curated index for AI assistants, not a crawler permissions file. For crawler permissions, see `/robots.txt`. ## Core Pages - [Home](https://usestring.ai/): Primary overview of the site. - [Products](https://usestring.ai/products): The three String products at a glance. - [Web Access API](https://usestring.ai/web-access): Self-serve API to reliably fetch any page on the web, with the full Web Data Frontier Benchmark. - [Composer](https://usestring.ai/composer): Describe a site and receive a structured feed. Coming this month, waitlist open. - [Bespoke Web Datasets](https://usestring.ai/managed-services): We run the data pipelines for you, with an SLA. - [Pricing](https://usestring.ai/pricing): Usage-based pricing. You only pay for data successfully delivered. - [About](https://usestring.ai/about): Built in New York City. - [Careers](https://usestring.ai/careers): Open roles at String. - [Book a demo](https://usestring.ai/book-demo): Tell us what web data you need and we route you to the right team. - [Blog](https://usestring.ai/blog): Notes from the String team on web access, benchmarks, and building for agents. ## Legal - [Terms of service](https://usestring.ai/terms) - [Privacy policy](https://usestring.ai/privacy) ## Blog Posts - [The web scraping industry has a benchmark problem](https://usestring.ai/blog/web-scraping-benchmark-problem): Every vendor claims a 98-100% success rate, and they can't all be right. So we open-sourced a benchmark anyone can run. - [Introducing the String Web Access API](https://usestring.ai/blog/introducing-web-access-api): State-of-the-art web access for humans and agents - [Our Web Access Manifesto: Information wants to be free](https://usestring.ai/blog/web-access-manifesto): We're building String to help the world access information on the web at scale ## Discovery - [Sitemap](https://usestring.ai/sitemap.xml): Complete search-engine sitemap, if available. - [Robots policy](https://usestring.ai/robots.txt): Crawler permissions and content signals for automated agents. The homepage, every product page (Web Access API, Pricing, Products, Composer, Bespoke Web Datasets, About), the blog index, and every blog post are also available as Markdown: request the page with an `Accept: text/markdown` header, or append `.md` to the URL (the homepage is `/index.md`).