Smart Web Scraper is a fast, reliable API for extracting structured content from any public web page.
Send a URL, get back clean data:
Built for lead generation, SEO analysis, content aggregation, AI pipelines, and research tools. Handles encoding detection, HTML sanitization, and content extraction automatically.
Scrapes a web page and returns structured content including title, body text, metadata, Open Graph tags, favicon, canonical URL, language, and structured data detection.
Scrape Web Page - Endpoint Features
| Object | Description |
|---|---|
url |
[Required] The full URL of the web page to scrape |
{"title":"Facebook","body":"Explore the things you love.","meta":{},"favicon":"https://static.xx.fbcdn.net/rsrc.php/y1/r/ay1hV6OlegS.ico","canonicalUrl":"https://www.facebook.com/","isAmp":false,"hasSchemaOrg":false,"hasJsonLd":false,"lang":"en","url":"https://www.facebook.com"}
curl --location --request GET 'https://zylalabs.com/api/12311/web+scraper+api/23127/scrape+web+page?url=https://www.facebook.com' --header 'Authorization: Bearer YOUR_API_KEY'
| Header | Description |
|---|---|
Authorization
|
[Required] Should be Bearer access_key. See "Your API Access Key" above when you are subscribed. |
No long-term commitment. Upgrade, downgrade, or cancel anytime. Free Trial includes up to 50 requests.
The Web Scraper API can extract structured content including the title, body text, metadata (such as description and keywords), Open Graph tags, favicons, canonical URLs, language detection, and support for AMP pages.
The API returns the extracted data in a clean, structured format that includes fields for title, body text, meta tags, Open Graph data, favicons, and more, allowing for easy integration into applications.
The Web Scraper API is ideal for lead generation, SEO analysis, content aggregation, AI pipelines, and research tools, enabling users to gather and analyze web content efficiently.
The API uses Mozilla Readability to extract article-quality content, ensuring that the title and body text are clean and relevant, while also handling HTML sanitization and encoding detection automatically.
Yes, the Web Scraper API can detect and extract structured data formats including Schema.org and JSON-LD, providing users with additional context and information from web pages.
The Web Scraper API returns structured data including the title, body text, metadata (like description and keywords), Open Graph tags, favicon, canonical URL, language, and structured data detection (Schema.org and JSON-LD).
Key fields in the response include "title," "body," "meta" (for metadata), "favicon," "canonicalUrl," "lang" (language), "isAmp" (AMP support), "hasSchemaOrg," and "hasJsonLd," providing comprehensive content details.
The response data is organized in a JSON format, with each key representing a specific piece of information about the scraped web page, making it easy to parse and integrate into applications.
The primary parameter for the endpoint is the URL of the web page to be scraped. Users can customize their requests by specifying different URLs to extract data from various web pages.
Users can utilize the returned data for various applications, such as displaying article summaries, analyzing SEO performance, aggregating content for research, or feeding data into AI models for further processing.
The data is extracted from publicly accessible web pages across the internet, ensuring a wide range of content is available for scraping, provided the pages comply with web scraping policies.
Data accuracy is maintained through the use of reliable extraction techniques, including Mozilla Readability for content extraction, and automated HTML sanitization to ensure clean and relevant data.
Typical use cases include lead generation for marketing, SEO analysis for website optimization, content aggregation for news or research platforms, and feeding structured data into AI pipelines for enhanced insights.
To obtain your API key, you first need to sign in to your account and subscribe to the API you want to use. Once subscribed, go to your Profile, open the Subscription section, and select the specific API. Your API key will be available there and can be used to authenticate your requests.
You can’t switch APIs during the free trial. If you subscribe to a different API, your trial will end and the new subscription will start as a paid plan.
If you don’t cancel before the 7th day, your free trial will end automatically and your subscription will switch to a paid plan under the same plan you originally subscribed to, meaning you will be charged and gain access to the API calls included in that plan.
The free trial ends when you reach 50 API requests or after 7 days, whichever comes first.
No, the free trial is available only once, so we recommend using it on the API that interests you the most. Most of our APIs offer a free trial, but some may not include this option.
Yes, we offer a 7-day free trial that allows you to make up to 50 API calls at no cost, so you can test our APIs without any commitment.
Zyla API Hub is like a big store for APIs, where you can find thousands of them all in one place. We also offer dedicated support and real-time monitoring of all APIs. Once you sign up, you can pick and choose which APIs you want to use. Just remember, each API needs its own subscription. But if you subscribe to multiple ones, you'll use the same key for all of them, making things easier for you.
Please have a look at our Refund Policy: https://zylalabs.com/terms#refund
Service Level:
100%
Response Time:
878ms
Service Level:
100%
Response Time:
2,507ms
Service Level:
100%
Response Time:
3,158ms
Service Level:
100%
Response Time:
2,697ms
Service Level:
100%
Response Time:
10,154ms
Service Level:
66%
Response Time:
7,990ms
Service Level:
100%
Response Time:
11,307ms
Service Level:
100%
Response Time:
3,107ms
Service Level:
100%
Response Time:
5,368ms
Service Level:
100%
Response Time:
1,434ms
Service Level:
100%
Response Time:
903ms
Service Level:
100%
Response Time:
7,340ms
Service Level:
100%
Response Time:
691ms
Service Level:
100%
Response Time:
1,116ms
Service Level:
90%
Response Time:
721ms
Service Level:
100%
Response Time:
137ms
Service Level:
100%
Response Time:
255ms
Service Level:
100%
Response Time:
814ms
Service Level:
100%
Response Time:
881ms
Service Level:
100%
Response Time:
672ms