# WebPageSnap

> Professional web content scraping API service built on Cloudflare Workers, with global CDN acceleration and intelligent caching.

WebPageSnap is an enterprise-grade web scraping API that fetches and caches web page content, extracting metadata and returning results in JSON or HTML format. It runs on Cloudflare Workers with KV storage for caching (7-day TTL) and achieves 20-50ms response times with 95%+ cache hit rate.

## Core Capabilities
- **Web Content Scraping**: Fetch any public web page content via simple API call
- **Metadata Extraction**: Automatically extract title, description, keywords, author, charset, viewport, Open Graph tags (ogTitle, ogDescription, ogImage, ogUrl), and Twitter Cards
- **Multiple Output Formats**: Return JSON (structured data with metadata + body) or raw HTML source
- **Intelligent Caching**: 7-day KV storage cache with 95%+ hit rate, optional cache bypass with `nocache=true`
- **Global CDN**: 200+ edge locations, 20-50ms response time (cached), <5s for real-time scraping
- **CORS Ready**: Direct browser access supported
- **Bilingual Interface**: English and Chinese web UI

## API
- [Scrape API](https://webpagesnap.com/api/scrape): Main endpoint for web content scraping. Parameters: url (required), format (json/html), nocache (boolean)


## Usage Examples

### cURL - Get JSON response
```bash
curl "https://webpagesnap.com/api/scrape?url=https://example.com&format=json"
```

### cURL - Get HTML source
```bash
curl "https://webpagesnap.com/api/scrape?url=https://example.com&format=html"
```

### cURL - Skip cache
```bash
curl "https://webpagesnap.com/api/scrape?url=https://example.com&nocache=true"
```

### JavaScript - Fetch structured data
```javascript
const response = await fetch('https://webpagesnap.com/api/scrape?url=https://example.com&format=json');
const data = await response.json();
if (data.success) {
  console.log('Title:', data.header.title);
  console.log('Description:', data.header.description);
  console.log('Body:', data.body);
}
```

### JSON Response Structure
```json
{
  "success": true,
  "url": "https://example.com",
  "format": "json",
  "header": {
    "title": "Example Domain",
    "description": "This domain is for use in illustrative examples...",
    "keywords": "",
    "author": "",
    "charset": "UTF-8",
    "viewport": "width=device-width, initial-scale=1",
    "ogTitle": "Example Domain",
    "ogDescription": "This domain is for use in illustrative examples...",
    "ogImage": "",
    "ogUrl": "https://example.com"
  },
  "body": "<div>Page body content...</div>",
  "size": 1234,
  "cached": true,
  "scrapedAt": "2024-01-15T10:30:00Z"
}
```